Submission 13627

Job ID	step	status	up to date	date started	date completed	duration	message
`73542`	sim-1of4	success	no	2021-04-21 19:35:34+00:00	2021-04-21 19:37:36+00:00	0:02:02		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73509`	sim-1of4	success	no	2021-04-21 19:33:11+00:00	2021-04-21 19:34:54+00:00	0:01:43		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73439`	sim-1of4	host-error	no	2021-04-21 19:27:42+00:00	2021-04-21 19:29:00+00:00	0:01:18	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73422`	sim-1of4	host-error	no	2021-04-21 19:26:12+00:00	2021-04-21 19:27:14+00:00	0:01:02	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73336`	sim-1of4	host-error	no	2021-04-21 19:19:57+00:00	2021-04-21 19:20:58+00:00	0:01:01	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73317`	sim-1of4	host-error	no	2021-04-21 19:18:33+00:00	2021-04-21 19:19:49+00:00	0:01:16	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73261`	sim-1of4	host-error	no	2021-04-21 19:14:34+00:00	2021-04-21 19:15:36+00:00	0:01:02	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73240`	sim-1of4	host-error	no	2021-04-21 19:13:15+00:00	2021-04-21 19:14:17+00:00	0:01:02	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73210`	sim-1of4	host-error	no	2021-04-21 19:11:30+00:00	2021-04-21 19:12:54+00:00	0:01:24	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73145`	sim-1of4	host-error	no	2021-04-21 19:06:01+00:00	2021-04-21 19:07:01+00:00	0:01:00	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73133`	sim-1of4	host-error	no	2021-04-21 19:04:30+00:00	2021-04-21 19:05:29+00:00	0:00:59	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73128`	sim-0of4	success	no	2021-04-21 19:04:02+00:00	2021-04-21 19:06:27+00:00	0:02:25		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73087`	sim-1of4	host-error	no	2021-04-21 18:59:37+00:00	2021-04-21 19:00:56+00:00	0:01:19	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73080`	sim-0of4	host-error	no	2021-04-21 18:59:33+00:00	2021-04-21 19:00:08+00:00	0:00:35	Uncaught exception: [...] Uncaught exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id raise ZValueError(container_ids=container_ids, services=services, res=res, names=names) zuper_commons.types.exceptions.ZValueError: │ container_ids: [cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122, │ 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d, │ bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86, │ a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872, │ 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd] │ services: dict[7] │ │ npc0: │ │ dict[6] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b │ │ │ environment: │ │ │ dict[13] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_NAME: npc0 │ │ │ │ AIDONODE_DATA_IN: /fifos/npc0-in │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc0-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ npc1: │ │ dict[6] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b │ │ │ environment: │ │ │ dict[13] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_NAME: npc1 │ │ │ │ AIDONODE_DATA_IN: /fifos/npc1-in │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc1-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ npc2: │ │ dict[6] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b │ │ │ environment: │ │ │ dict[13] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_NAME: npc2 │ │ │ │ AIDONODE_DATA_IN: /fifos/npc2-in │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc2-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ npc3: │ │ dict[6] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b │ │ │ environment: │ │ │ dict[13] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_NAME: npc3 │ │ │ │ AIDONODE_DATA_IN: /fifos/npc3-in │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc3-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ evaluator: │ │ dict[7] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:c8814db4c65edbdc50be1e4b4920151c00594f9e6a1bef86a5f1465c1714bab4 │ │ │ environment: │ │ │ dict[11] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ experiment_manager_parameters: │ │ │ │ \|episodes_per_scenario: 1 │ │ │ │ \|episode_length_s: 60.0 │ │ │ │ \|min_episode_length_s: 0.0 │ │ │ │ \|seed: 20200922 │ │ │ │ \|physics_dt: 0.05 │ │ │ │ \|max_failures: 2 │ │ │ │ \|fifo_dir: /fifos │ │ │ │ \|sim_in: /fifos/simulator-in │ │ │ │ \|sim_out: /fifos/simulator-out │ │ │ │ \|sm_in: /fifos/scenario_maker-in │ │ │ │ \|sm_out: /fifos/scenario_maker-out │ │ │ │ \|timeout_initialization: 120 │ │ │ │ \|timeout_regular: 120 │ │ │ │ \|port: 10123 │ │ │ │ \|scenarios: │ │ │ │ \|- /scenarios │ │ │ │ \| │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ ports: [10123] │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ simulator: │ │ dict[6] │ │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0 │ │ │ environment: │ │ │ dict[13] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_CONFIG: │ │ │ │ \|env_constructor: Simulator │ │ │ │ \|env_parameters: │ │ │ │ \| max_steps: 500001 # we don't want the gym to reset itself │ │ │ │ \| domain_rand: 0 │ │ │ │ \| camera_width: 640 │ │ │ │ \| camera_height: 480 │ │ │ │ \| distortion: true │ │ │ │ \| num_tris_distractors: 0 │ │ │ │ \| color_ground: [0, 0.3, 0] # green │ │ │ │ \| enable_leds: true │ │ │ │ \| │ │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ │ solution-ego0: │ │ dict[6] │ │ │ image: docker.io/raphjean/aido-submissions@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ environment: │ │ │ dict[14] │ │ │ │ replica: {"index": 0, "total": 4} │ │ │ │ AIDONODE_NAME: ego0 │ │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in │ │ │ │ AIDO_REQUIRE_GPU: 1 │ │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out │ │ │ │ challenge_name: aido-LFI-full-sim-testing │ │ │ │ challenge_step_name: sim-0of4 │ │ │ │ submission_id: 13627 │ │ │ │ submitter_name: Raphael Jean │ │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369 │ │ │ │ username: ubuntu │ │ │ │ uid: 0 │ │ │ │ USER: ubuntu │ │ │ │ HOME: /fake-home/ubuntu │ │ │ labels: │ │ │ dict[2] │ │ │ │ org.duckietown.created_by_runner: true │ │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83 │ │ │ user: 0:0 │ │ │ volumes: │ │ │ [ │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw, │ │ │ /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw, │ │ │ /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw] │ │ │ networks: {evaluation: {aliases: [evaluation]} } │ res: dict[5] │ │ npc0: cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122 │ │ npc1: 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d │ │ npc2: bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86 │ │ npc3: a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872 │ │ solution-ego0: 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd │ names: dict[5] │ │ cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc0_1 │ │ 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc1_1 │ │ bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc2_1 │ │ a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc3_1 │ │ 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_solution-ego0_1 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr cr = run_single( File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single write_logs(wd, project, services=config["services"]) File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services) File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id raise DockerComposeFail(msg, output=output.decode(), names=names) from e duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids │ output: \|cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122 │ \|8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d │ \|bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86 │ \|a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872 │ \|61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd │ \| │ names: dict[5] │ │ cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc0_1 │ │ 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc1_1 │ │ bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc2_1 │ │ a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc3_1 │ │ 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_solution-ego0_1	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73070`	sim-0of4	host-error	no	2021-04-21 18:58:06+00:00	2021-04-21 18:59:26+00:00	0:01:20	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`73069`	sim-1of4	host-error	no	2021-04-21 18:58:05+00:00	2021-04-21 18:59:26+00:00	0:01:21	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72996`	sim-0of4	host-error	no	2021-04-21 18:52:43+00:00	2021-04-21 18:53:44+00:00	0:01:01	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72985`	sim-2of4	success	no	2021-04-21 18:51:36+00:00	2021-04-21 18:52:40+00:00	0:01:04		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72984`	sim-1of4	host-error	no	2021-04-21 18:51:36+00:00	2021-04-21 18:52:38+00:00	0:01:02	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72981`	sim-3of4	success	no	2021-04-21 18:51:33+00:00	2021-04-21 18:53:04+00:00	0:01:31		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72975`	sim-0of4	host-error	no	2021-04-21 18:51:01+00:00	2021-04-21 18:52:00+00:00	0:00:59	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72954`	sim-2of4	success	no	2021-04-21 18:50:01+00:00	2021-04-21 18:51:02+00:00	0:01:01		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72950`	sim-1of4	host-error	no	2021-04-21 18:50:00+00:00	2021-04-21 18:50:58+00:00	0:00:58	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72946`	sim-0of4	host-error	no	2021-04-21 18:49:34+00:00	2021-04-21 18:50:37+00:00	0:01:03	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "/code/solution.py", line 32, in init \|\| self.check_gpu_available(context) \|\| File "/code/solution.py", line 49, in check_gpu_available \|\| raise RuntimeError(msg) \|\| RuntimeError: I need a GPU; bailing. \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`72943`	sim-3of4	success	no	2021-04-21 18:49:30+00:00	2021-04-21 18:50:30+00:00	0:01:00		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible

73439

sim-1of4

host-error

no

2021-04-21 19:27:42+00:00

2021-04-21 19:29:00+00:00

0:01:18

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73422

sim-1of4

host-error

no

2021-04-21 19:26:12+00:00

2021-04-21 19:27:14+00:00

0:01:02

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73336

sim-1of4

host-error

no

2021-04-21 19:19:57+00:00

2021-04-21 19:20:58+00:00

0:01:01

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73317

sim-1of4

host-error

no

2021-04-21 19:18:33+00:00

2021-04-21 19:19:49+00:00

0:01:16

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73261

sim-1of4

host-error

no

2021-04-21 19:14:34+00:00

2021-04-21 19:15:36+00:00

0:01:02

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73240

sim-1of4

host-error

no

2021-04-21 19:13:15+00:00

2021-04-21 19:14:17+00:00

0:01:02

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73210

sim-1of4

host-error

no

2021-04-21 19:11:30+00:00

2021-04-21 19:12:54+00:00

0:01:24

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73145

sim-1of4

host-error

no

2021-04-21 19:06:01+00:00

2021-04-21 19:07:01+00:00

0:01:00

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73133

sim-1of4

host-error

no

2021-04-21 19:04:30+00:00

2021-04-21 19:05:29+00:00

0:00:59

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73087

sim-1of4

host-error

no

2021-04-21 18:59:37+00:00

2021-04-21 19:00:56+00:00

0:01:19

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73080

sim-0of4

host-error

no

2021-04-21 18:59:33+00:00

2021-04-21 19:00:08+00:00

0:00:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122,
│                 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d,
│                 bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86,
│                 a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872,
│                 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd]
│      services: dict[7]
│                │ npc0:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: npc0
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc0-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc0-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc1:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: npc1
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc1-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc1-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc2:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: npc2
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc2-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc2-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc3:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:b0d2e8b9222bca9878a0c3762b17dd65d447243f3260e0fd89969099451af38b
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: npc3
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc3-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc3-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:c8814db4c65edbdc50be1e4b4920151c00594f9e6a1bef86a5f1465c1714bab4
│                │ │ environment:
│                │ │ dict[11]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/duckietown-challenges@sha256:74989d3337d7fc221b8550c34dab1359eb18109113950b27deaa647a983417e0
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/raphjean/aido-submissions@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ environment:
│                │ │ dict[14]
│                │ │ │ replica: {"index": 0, "total": 4}
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido-LFI-full-sim-testing
│                │ │ │ challenge_step_name: sim-0of4
│                │ │ │ submission_id: 13627
│                │ │ │ submitter_name: Raphael Jean
│                │ │ │ SUBMISSION_CONTAINER: docker.io/raphjean/aido-submissions:2020_12_18_22_03_32@sha256:1c95f1799682aa3e7252ed2e3755562d58f013e6a3c1474b18882df0c1a93369
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels:
│                │ │ dict[2]
│                │ │ │ org.duckietown.created_by_runner: true
│                │ │ │ org.duckietown.runner_name: nogpu-production-b-spot-3-05_58733bc5ca83
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido-LFI-full-sim-testing/submission13627/sim-0of4-nogpu-production-b-spot-3-05_58733bc5ca83-job73080-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/21_04_21_18_59_34-67068/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[5]
│                │ npc0: cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122
│                │ npc1: 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d
│                │ npc2: bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86
│                │ npc3: a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872
│                │ solution-ego0: 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd
│         names: dict[5]
│                │ cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc0_1
│                │ 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc1_1
│                │ bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc2_1
│                │ a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc3_1
│                │ 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 959, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122
│         |8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d
│         |bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86
│         |a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872
│         |61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd
│         |
│  names: dict[5]
│         │ cdc1d70f57c98c2c2cb29e10fe93be15503e33212b09ee47d723396f7a233122: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc0_1
│         │ 8348dffd240694c171fd6427a62e6cdc78ff0724b2bf89085e5d901b95203d1d: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc1_1
│         │ bb6fa8f92b0560c6f6c4851679c8e338739fc8cdbcb12e0db46fb302d8778e86: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc2_1
│         │ a8729a8d4c6c15379d6140b805851e625a4f5a59cb441418d215480f8e40a872: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_npc3_1
│         │ 61e84b070d3b059ce78750b9afdda6a7b6c1a3f442c220d3ad1e126213042bbd: nogpu-production-b-spot-3-05_58733bc5ca83-job73080-877973_solution-ego0_1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73070

sim-0of4

host-error

no

2021-04-21 18:58:06+00:00

2021-04-21 18:59:26+00:00

0:01:20

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

73069

sim-1of4

host-error

no

2021-04-21 18:58:05+00:00

2021-04-21 18:59:26+00:00

0:01:21

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72996

sim-0of4

host-error

no

2021-04-21 18:52:43+00:00

2021-04-21 18:53:44+00:00

0:01:01

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72984

sim-1of4

host-error

no

2021-04-21 18:51:36+00:00

2021-04-21 18:52:38+00:00

0:01:02

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72975

sim-0of4

host-error

no

2021-04-21 18:51:01+00:00

2021-04-21 18:52:00+00:00

0:00:59

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72950

sim-1of4

host-error

no

2021-04-21 18:50:00+00:00

2021-04-21 18:50:58+00:00

0:00:58

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

72946

sim-0of4

host-error

no

2021-04-21 18:49:34+00:00

2021-04-21 18:50:37+00:00

0:01:03

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 277, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 271, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/solution.py", line 32, in init
              ||     self.check_gpu_available(context)
              ||   File "/code/solution.py", line 49, in check_gpu_available
              ||     raise RuntimeError(msg)
              || RuntimeError: I need a GPU; bailing.
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

Submission	`13627`

Competing	yes
Challenge	`aido-LFI-full-sim-testing`
User	Raphael Jean
Date submitted	2021-01-31 22:18:15+00:00
Last status update	2021-12-04 20:48:19+00:00
Complete	complete
Details	Violations... Protocol does not match. Challenge: aido5-db20-full-z2. Sub: ['aido2_db18_agent-z2'].
Sisters
Result	💜
Jobs
Next
User label	mobile-segmentation
Admin priority	50
Blessing	n/a
User priority	50

Submission 13627

Evaluation jobs for this submission