Submission 13622

Submission	`13622`

Competing	yes
Challenge	`aido-LFVI_multi-sim-validation`
User	Raphael Jean
Date submitted	2021-01-31 22:18:06+00:00
Last status update	2021-12-04 20:47:44+00:00
Complete	complete
Details	Evaluation is complete.
Sisters
Result	💚
Jobs	sim-0of4: `104949` sim-1of4: `104959` sim-2of4: `104947` sim-3of4: `104948`
Next
User label	mobile-segmentation-pedestrian
Admin priority	50
Blessing	n/a
User priority	50

104959

Click the images to see detailed statistics about the episode.

4way-000

104949

Click the images to see detailed statistics about the episode.

udem-000

Evaluation jobs for this submission

Show only up-to-date jobs

Job ID step status up to date date started date completed duration message

104959

sim-1of4

success

yes

2021-11-02 22:57:15+00:00

2021-11-02 23:01:25+00:00

0:04:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	7.699999999999981
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.553501158740397
deviation-center-line_median	0.7240288078800504

other stats

deviation-center-line_max	0.7507892287682824
deviation-center-line_mean	0.6497337526172446
deviation-center-line_min	0.4000881659405954
deviation-heading_max	3.9091257402011914
deviation-heading_mean	2.20967412449522
deviation-heading_median	1.8574426533463664
deviation-heading_min	1.2146854510869562
distance-from-start_max	2.065126099803248
distance-from-start_mean	1.6083640911743342
distance-from-start_median	1.4876233899148263
distance-from-start_min	1.393083485064437
driven_any_max	2.909550718791801
driven_any_mean	2.0702063363064394
driven_any_median	1.8756337669446024
driven_any_min	1.6200070925447516
driven_lanedir_consec_max	2.7167044751675964
driven_lanedir_consec_mean	1.7877970878272915
driven_lanedir_consec_min	1.3274815586607762
driven_lanedir_max	2.869406004483353
driven_lanedir_mean	1.9968236990267632
driven_lanedir_median	1.7720078131622687
driven_lanedir_min	1.5738731652991624
in-drivable-lane_max	0.04999999999999982
in-drivable-lane_mean	0.012499999999999956
in-drivable-lane_min	0.0
per-episodes	details {"4way-000-ego0": {"driven_any": 1.886132232903376, "survival_time": 7.699999999999981, "driven_lanedir": 1.841999378102899, "in-drivable-lane": 0.0, "deviation-heading": 1.4107006516129377, "distance-from-start": 1.4074409632367095, "deviation-center-line": 0.7507892287682824, "driven_lanedir_consec": 1.5490916364836884}, "4way-000-ego1": {"driven_any": 1.6200070925447516, "survival_time": 7.699999999999981, "driven_lanedir": 1.5738731652991624, "in-drivable-lane": 0.0, "deviation-heading": 2.304184655079796, "distance-from-start": 1.567805816592943, "deviation-center-line": 0.7428901740307082, "driven_lanedir_consec": 1.3274815586607762}, "4way-000-ego2": {"driven_any": 1.8651353009858296, "survival_time": 7.699999999999981, "driven_lanedir": 1.7020162482216386, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 3.9091257402011914, "distance-from-start": 1.393083485064437, "deviation-center-line": 0.7051674417293926, "driven_lanedir_consec": 1.557910680997106}, "4way-000-ego3": {"driven_any": 2.909550718791801, "survival_time": 7.699999999999981, "driven_lanedir": 2.869406004483353, "in-drivable-lane": 0.0, "deviation-heading": 1.2146854510869562, "distance-from-start": 2.065126099803248, "deviation-center-line": 0.4000881659405954, "driven_lanedir_consec": 2.7167044751675964}}
simulation-passed	1
survival_time_max	7.699999999999981
survival_time_mean	7.699999999999981
survival_time_min	7.699999999999981

No reset possible

104949

sim-0of4

success

yes

2021-11-02 22:51:10+00:00

2021-11-02 22:56:13+00:00

0:05:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.400000000000055
in-drivable-lane_median	5.750000000000045
driven_lanedir_consec_median	1.088602564596143
deviation-center-line_median	0.4964076799583262

other stats

deviation-center-line_max	1.9395524399718505
deviation-center-line_mean	0.756462577757864
deviation-center-line_min	0.0934825111429537
deviation-heading_max	16.676676865178834
deviation-heading_mean	5.42582122869342
deviation-heading_median	1.9146870450997056
deviation-heading_min	1.197233959395432
distance-from-start_max	3.2033334797881854
distance-from-start_mean	1.734456943590205
distance-from-start_median	1.3678213063598983
distance-from-start_min	0.9988516818528386
driven_any_max	5.421365623722326
driven_any_mean	2.3767139637676338
driven_any_median	1.536042656922607
driven_any_min	1.0134049175029942
driven_lanedir_consec_max	4.5675195144308045
driven_lanedir_consec_mean	1.8632067082870465
driven_lanedir_consec_min	0.7081021895250954
driven_lanedir_max	4.5675195144308045
driven_lanedir_mean	1.8769069980450055
driven_lanedir_median	1.1044869765093583
driven_lanedir_min	0.7311345247305014
in-drivable-lane_max	10.800000000000058
in-drivable-lane_mean	5.625000000000037
in-drivable-lane_min	0.1999999999999993
per-episodes	details {"udem-000-ego0": {"driven_any": 5.421365623722326, "survival_time": 13.400000000000055, "driven_lanedir": 4.5675195144308045, "in-drivable-lane": 2.400000000000027, "deviation-heading": 2.225433363570725, "distance-from-start": 3.2033334797881854, "deviation-center-line": 0.7072206194654328, "driven_lanedir_consec": 4.5675195144308045}, "udem-000-ego1": {"driven_any": 2.05570214242287, "survival_time": 13.400000000000055, "driven_lanedir": 1.4731037622359162, "in-drivable-lane": 9.100000000000064, "deviation-heading": 1.6039407266286867, "distance-from-start": 1.7355876572703883, "deviation-center-line": 0.28559474045121946, "driven_lanedir_consec": 1.4664015565889763}, "udem-000-ego2": {"driven_any": 1.0134049175029942, "survival_time": 13.400000000000055, "driven_lanedir": 0.7358701907828005, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 16.676676865178834, "distance-from-start": 0.9988516818528386, "deviation-center-line": 1.9395524399718505, "driven_lanedir_consec": 0.7081021895250954}, "udem-000-ego3": {"driven_any": 1.016383171422344, "survival_time": 13.400000000000055, "driven_lanedir": 0.7311345247305014, "in-drivable-lane": 10.800000000000058, "deviation-heading": 1.197233959395432, "distance-from-start": 1.0000549554494085, "deviation-center-line": 0.0934825111429537, "driven_lanedir_consec": 0.7108035726033093}}
simulation-passed	1
survival_time_max	13.400000000000055
survival_time_mean	13.400000000000055
survival_time_min	13.400000000000055

No reset possible

104948

sim-3of4

success

yes

2021-11-02 22:50:38+00:00

2021-11-02 22:51:48+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

104947

sim-2of4

success

yes

2021-11-02 22:50:35+00:00

2021-11-02 22:51:45+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

other stats

simulation-passed	1
skipped	1

No reset possible

104944

sim-3of4

success

yes

2021-11-02 22:49:09+00:00

2021-11-02 22:50:21+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104943

sim-2of4

success

yes

2021-11-02 22:49:08+00:00

2021-11-02 22:50:18+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104942

sim-3of4

success

yes

2021-11-02 22:47:34+00:00

2021-11-02 22:48:44+00:00

0:01:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104941

sim-2of4

success

yes

2021-11-02 22:47:32+00:00

2021-11-02 22:48:40+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

104940 sim-1of4 timeout yes 2021-11-02 22:47:29+00:00 - - - - No reset possible

104938

sim-0of4

success

yes

2021-11-02 22:46:57+00:00

2021-11-02 22:50:51+00:00

0:03:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100062

sim-2of4

success

2021-11-02 05:19:45+00:00

2021-11-02 05:21:28+00:00

0:01:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

100050

sim-2of4

success

2021-11-02 05:18:08+00:00

2021-11-02 05:19:32+00:00

0:01:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99961

sim-0of4

failed

2021-11-02 04:54:55+00:00

2021-11-02 04:56:22+00:00

0:01:27

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99955

sim-0of4

failed

2021-11-02 04:53:20+00:00

2021-11-02 04:54:42+00:00

0:01:22

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99950

sim-0of4

host-error

2021-11-02 04:51:21+00:00

2021-11-02 04:52:53+00:00

0:01:32

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99946

sim-0of4

failed

2021-11-02 04:49:50+00:00

2021-11-02 04:51:03+00:00

0:01:13

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99939

sim-0of4

failed

2021-11-02 04:48:13+00:00

2021-11-02 04:49:37+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99935

sim-0of4

failed

2021-11-02 04:46:37+00:00

2021-11-02 04:48:01+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99932

sim-1of4

failed

2021-11-02 04:45:42+00:00

2021-11-02 04:47:04+00:00

0:01:22

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99931

sim-3of4

success

2021-11-02 04:45:11+00:00

2021-11-02 04:46:18+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99925

sim-1of4

host-error

2021-11-02 04:43:44+00:00

2021-11-02 04:45:04+00:00

0:01:20

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99924

sim-3of4

success

2021-11-02 04:43:43+00:00

2021-11-02 04:44:54+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99922

sim-2of4

timeout

2021-11-02 04:43:14+00:00

2021-11-02 05:09:10+00:00

0:25:56

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99917

sim-3of4

success

2021-11-02 04:42:18+00:00

2021-11-02 04:43:27+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99916

sim-1of4

failed

2021-11-02 04:42:15+00:00

2021-11-02 04:43:37+00:00

0:01:22

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99911

sim-2of4

success

2021-11-02 04:41:44+00:00

2021-11-02 04:42:52+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99906

sim-3of4

success

2021-11-02 04:40:41+00:00

2021-11-02 04:41:46+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99905

sim-1of4

failed

2021-11-02 04:40:39+00:00

2021-11-02 04:42:05+00:00

0:01:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99901

sim-2of4

success

2021-11-02 04:40:07+00:00

2021-11-02 04:41:14+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99897

sim-3of4

success

2021-11-02 04:38:52+00:00

2021-11-02 04:40:03+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99891

sim-1of4

failed

2021-11-02 04:38:48+00:00

2021-11-02 04:40:12+00:00

0:01:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99890

sim-2of4

success

2021-11-02 04:38:47+00:00

2021-11-02 04:39:53+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99887

sim-3of4

success

2021-11-02 04:37:05+00:00

2021-11-02 04:38:10+00:00

0:01:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99884

sim-2of4

success

2021-11-02 04:36:10+00:00

2021-11-02 04:37:19+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99880

sim-1of4

host-error

2021-11-02 04:36:05+00:00

2021-11-02 04:37:31+00:00

0:01:26

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99877

sim-3of4

success

2021-11-02 04:35:01+00:00

2021-11-02 04:36:09+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99873

sim-2of4

success

2021-11-02 04:33:53+00:00

2021-11-02 04:35:01+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99868

sim-3of4

success

2021-11-02 04:33:22+00:00

2021-11-02 04:34:35+00:00

0:01:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

99867

sim-1of4

failed

2021-11-02 04:33:21+00:00

2021-11-02 04:34:47+00:00

0:01:26

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 293, in main
    sim_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97836

sim-3of4

success

2021-11-01 19:45:04+00:00

2021-11-01 19:46:10+00:00

0:01:06

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97832

sim-3of4

success

2021-11-01 19:43:25+00:00

2021-11-01 19:44:55+00:00

0:01:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97829

sim-3of4

success

2021-11-01 19:41:45+00:00

2021-11-01 19:42:57+00:00

0:01:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97827

sim-3of4

success

2021-11-01 19:40:15+00:00

2021-11-01 19:41:23+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97825

sim-2of4

success

2021-11-01 19:38:47+00:00

2021-11-01 19:39:55+00:00

0:01:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97823

sim-2of4

success

2021-11-01 19:37:19+00:00

2021-11-01 19:38:28+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97821

sim-2of4

success

2021-11-01 19:35:31+00:00

2021-11-01 19:36:40+00:00

0:01:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97820

sim-0of4

success

2021-11-01 19:34:56+00:00

2021-11-01 19:40:14+00:00

0:05:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97819

sim-2of4

success

2021-11-01 19:33:53+00:00

2021-11-01 19:35:04+00:00

0:01:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

97788

sim-1of4

success

2021-11-01 18:54:29+00:00

2021-11-01 18:59:29+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73791

sim-0of4

failed

2021-04-21 19:56:06+00:00

2021-04-21 19:59:00+00:00

0:02:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 219, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego2: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible