Duckietown Challenges Home Challenges Submissions

Submission 17654

Submission17654
Competingyes
Challengeaido-LFV_multi-sim-validation
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobssim-0of4: 105414 sim-1of4: 105401 sim-2of4: 105396 sim-3of4: 105418
Next
User labeltemplate-random
Admin priority50
Blessingn/a
User priority50

105418

Click the images to see detailed statistics about the episode.

loop-000

105414

Click the images to see detailed statistics about the episode.

loop2-000

105401

Click the images to see detailed statistics about the episode.

zigzag-000

105396

Click the images to see detailed statistics about the episode.

autolab-000

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
105418sim-3of4successyes0:19:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median53.599999999998715
driven_lanedir_consec_median0.17850006289932396
deviation-center-line_median0.49660205595737594


other stats
deviation-center-line_max0.7655517644258731
deviation-center-line_mean0.550438887644005
deviation-center-line_min0.4429996742353948
deviation-heading_max5.708723015945328
deviation-heading_mean4.314762107049478
deviation-heading_median4.260413639699664
deviation-heading_min3.029498132853256
distance-from-start_max1.4108418329398826
distance-from-start_mean1.1194358824993853
distance-from-start_median1.1354018196019648
distance-from-start_min0.7960980578537286
driven_any_max15.326310847370626
driven_any_mean11.633879106528216
driven_any_median12.316353572892982
driven_any_min6.576498432956271
driven_lanedir_consec_max0.271834711171973
driven_lanedir_consec_mean0.18178573943420095
driven_lanedir_consec_min0.0983081207661829
driven_lanedir_max0.25382999559920805
driven_lanedir_mean0.16790489531803093
driven_lanedir_median0.1652120582661244
driven_lanedir_min0.0873654691406669
in-drivable-lane_max54.699999999998695
in-drivable-lane_mean53.33749999999871
in-drivable-lane_min51.44999999999871
per-episodes
details{"loop-000-ego0": {"driven_any": 11.376062002465089, "survival_time": 59.99999999999873, "driven_lanedir": 0.25382999559920805, "in-drivable-lane": 51.44999999999871, "deviation-heading": 5.708723015945328, "distance-from-start": 1.0442247976691956, "deviation-center-line": 0.7655517644258731, "driven_lanedir_consec": 0.271834711171973}, "loop-000-ego1": {"driven_any": 6.576498432956271, "survival_time": 59.99999999999873, "driven_lanedir": 0.1969664999784144, "in-drivable-lane": 52.54999999999872, "deviation-heading": 4.716518246290203, "distance-from-start": 0.7960980578537286, "deviation-center-line": 0.5494202135367019, "driven_lanedir_consec": 0.2102948009868546}, "loop-000-ego2": {"driven_any": 13.256645143320878, "survival_time": 59.99999999999873, "driven_lanedir": 0.13345761655383437, "in-drivable-lane": 54.64999999999871, "deviation-heading": 3.029498132853256, "distance-from-start": 1.226578841534734, "deviation-center-line": 0.4429996742353948, "driven_lanedir_consec": 0.14670532481179333}, "loop-000-ego3": {"driven_any": 15.326310847370626, "survival_time": 59.99999999999873, "driven_lanedir": 0.0873654691406669, "in-drivable-lane": 54.699999999998695, "deviation-heading": 3.804309033109124, "distance-from-start": 1.4108418329398826, "deviation-center-line": 0.4437838983780501, "driven_lanedir_consec": 0.0983081207661829}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
105414sim-0of4successyes0:04:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median29.000000000000277
in-drivable-lane_median20.025000000000247
driven_lanedir_consec_median0.23004863869940056
deviation-center-line_median0.7278799269429306


other stats
deviation-center-line_max0.8194317074657906
deviation-center-line_mean0.7278799269429306
deviation-center-line_min0.6363281464200705
deviation-heading_max6.73261632177244
deviation-heading_mean6.633830808409963
deviation-heading_median6.633830808409963
deviation-heading_min6.535045295047486
distance-from-start_max0.8626308120701064
distance-from-start_mean0.8293644349619179
distance-from-start_median0.8293644349619179
distance-from-start_min0.7960980578537294
driven_any_max7.222519405652156
driven_any_mean6.586737153678611
driven_any_median6.586737153678611
driven_any_min5.950954901705066
driven_lanedir_consec_max0.26576074471389377
driven_lanedir_consec_mean0.23004863869940056
driven_lanedir_consec_min0.19433653268490736
driven_lanedir_max0.24775126076977572
driven_lanedir_mean0.21437974622313744
driven_lanedir_median0.21437974622313744
driven_lanedir_min0.18100823167649915
in-drivable-lane_max20.30000000000025
in-drivable-lane_mean20.025000000000247
in-drivable-lane_min19.750000000000245
per-episodes
details{"loop2-000-ego0": {"driven_any": 5.950954901705066, "survival_time": 29.000000000000277, "driven_lanedir": 0.24775126076977572, "in-drivable-lane": 19.750000000000245, "deviation-heading": 6.73261632177244, "distance-from-start": 0.7960980578537294, "deviation-center-line": 0.8194317074657906, "driven_lanedir_consec": 0.26576074471389377}, "loop2-000-ego1": {"driven_any": 7.222519405652156, "survival_time": 29.000000000000277, "driven_lanedir": 0.18100823167649915, "in-drivable-lane": 20.30000000000025, "deviation-heading": 6.535045295047486, "distance-from-start": 0.8626308120701064, "deviation-center-line": 0.6363281464200705, "driven_lanedir_consec": 0.19433653268490736}}
simulation-passed1
survival_time_max29.000000000000277
survival_time_mean29.000000000000277
survival_time_min29.000000000000277
No reset possible
105401sim-1of4successyes0:06:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median20.70000000000016
in-drivable-lane_median15.50000000000015
driven_lanedir_consec_median0.2523502432780965
deviation-center-line_median0.4270318356067208


other stats
deviation-center-line_max2.4472420705619533
deviation-center-line_mean0.834439744050357
deviation-center-line_min0.03645323442603294
deviation-heading_max5.758343124435709
deviation-heading_mean2.9647842264649227
deviation-heading_median2.4959523963356456
deviation-heading_min1.1088889887526905
distance-from-start_max0.735788357677379
distance-from-start_mean0.4455427430503656
distance-from-start_median0.3918367385500151
distance-from-start_min0.26270913742405294
driven_any_max5.001991003394667
driven_any_mean1.5256410869454424
driven_any_median0.4116848275607308
driven_any_min0.277203689265641
driven_lanedir_consec_max0.2737815745175769
driven_lanedir_consec_mean0.21260926710351993
driven_lanedir_consec_min0.07195500734030984
driven_lanedir_max0.25840198320624896
driven_lanedir_mean0.2081068961174864
driven_lanedir_median0.25103529696169347
driven_lanedir_min0.07195500734030984
in-drivable-lane_max19.05000000000016
in-drivable-lane_mean12.737500000000114
in-drivable-lane_min0.8999999999999998
per-episodes
details{"zigzag-000-ego0": {"driven_any": 5.001991003394667, "survival_time": 20.70000000000016, "driven_lanedir": 0.25577209057344286, "in-drivable-lane": 12.150000000000135, "deviation-heading": 5.758343124435709, "distance-from-start": 0.735788357677379, "deviation-center-line": 0.7687325001714215, "driven_lanedir_consec": 0.2737815745175769}, "zigzag-000-ego1": {"driven_any": 0.27720368926578076, "survival_time": 20.70000000000016, "driven_lanedir": 0.24629850334994408, "in-drivable-lane": 18.85000000000016, "deviation-heading": 1.2379708953066022, "distance-from-start": 0.26270913742405294, "deviation-center-line": 0.08533117104202012, "driven_lanedir_consec": 0.24629850334994408}, "zigzag-000-ego2": {"driven_any": 0.277203689265641, "survival_time": 20.70000000000016, "driven_lanedir": 0.25840198320624896, "in-drivable-lane": 0.8999999999999998, "deviation-heading": 3.7539338973646887, "distance-from-start": 0.262709137424054, "deviation-center-line": 2.4472420705619533, "driven_lanedir_consec": 0.25840198320624896}, "zigzag-000-ego3": {"driven_any": 0.5461659658556808, "survival_time": 20.70000000000016, "driven_lanedir": 0.07195500734030984, "in-drivable-lane": 19.05000000000016, "deviation-heading": 1.1088889887526905, "distance-from-start": 0.5209643396759762, "deviation-center-line": 0.03645323442603294, "driven_lanedir_consec": 0.07195500734030984}}
simulation-passed1
survival_time_max20.70000000000016
survival_time_mean20.70000000000016
survival_time_min20.70000000000016
No reset possible
105396sim-2of4successyes0:10:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median31.750000000000316
in-drivable-lane_median25.175000000000296
driven_lanedir_consec_median0.18552469171877983
deviation-center-line_median0.49966350574004126


other stats
deviation-center-line_max0.7555299219673969
deviation-center-line_mean0.5108643440264811
deviation-center-line_min0.2886004426584447
deviation-heading_max5.677922521471409
deviation-heading_mean4.088893264090181
deviation-heading_median4.163773732737991
deviation-heading_min2.3501030694133327
distance-from-start_max0.8824046752191012
distance-from-start_mean0.7245653197432453
distance-from-start_median0.7348495479071131
distance-from-start_min0.5461575079396542
driven_any_max7.70048061152867
driven_any_mean5.0586670251615145
driven_any_median5.018099001021708
driven_any_min2.497989487073972
driven_lanedir_consec_max0.26764923329146384
driven_lanedir_consec_mean0.1856362610589692
driven_lanedir_consec_min0.10384642750685336
driven_lanedir_max0.2496385572544461
driven_lanedir_mean0.17341917865234155
driven_lanedir_median0.17223668708559425
driven_lanedir_min0.09956478318373164
in-drivable-lane_max28.300000000000303
in-drivable-lane_mean25.4625000000003
in-drivable-lane_min23.200000000000298
per-episodes
details{"autolab-000-ego0": {"driven_any": 7.70048061152867, "survival_time": 31.750000000000316, "driven_lanedir": 0.2496385572544461, "in-drivable-lane": 23.200000000000298, "deviation-heading": 5.523299075233993, "distance-from-start": 0.8824046752191012, "deviation-center-line": 0.7555299219673969, "driven_lanedir_consec": 0.26764923329146384}, "autolab-000-ego1": {"driven_any": 6.066664798227061, "survival_time": 31.750000000000316, "driven_lanedir": 0.19493515195653055, "in-drivable-lane": 23.700000000000298, "deviation-heading": 5.677922521471409, "distance-from-start": 0.7960980578537342, "deviation-center-line": 0.5957741014324853, "driven_lanedir_consec": 0.20826345296493876}, "autolab-000-ego2": {"driven_any": 3.969533203816355, "survival_time": 31.750000000000316, "driven_lanedir": 0.14953822221465796, "in-drivable-lane": 26.650000000000297, "deviation-heading": 2.8042483902419892, "distance-from-start": 0.6736010379604919, "deviation-center-line": 0.40355291004759714, "driven_lanedir_consec": 0.1627859304726209}, "autolab-000-ego3": {"driven_any": 2.497989487073972, "survival_time": 31.750000000000316, "driven_lanedir": 0.09956478318373164, "in-drivable-lane": 28.300000000000303, "deviation-heading": 2.3501030694133327, "distance-from-start": 0.5461575079396542, "deviation-center-line": 0.2886004426584447, "driven_lanedir_consec": 0.10384642750685336}}
simulation-passed1
survival_time_max31.750000000000316
survival_time_mean31.750000000000316
survival_time_min31.750000000000316
No reset possible
103168sim-1of4failedno0:01:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103166sim-0of4failedno0:02:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103156sim-1of4failedno0:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103154sim-0of4failedno0:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103145sim-1of4failedno0:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103144sim-0of4failedno0:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103137sim-2of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103127sim-2of4failedno0:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103121sim-2of4failedno0:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103112sim-2of4failedno0:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103107sim-3of4failedno0:00:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
103104sim-2of4failedno0:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible