Evaluator 4847

ID	4847
evaluator	`reg02`
owner	I don't have one 😀
machine	archimede_4ef621c989b6
process	reg02_4ef621c989b6
version	6.2.5
first heard	2020-12-02 02:24:53+00:00
last heard	2020-12-02 12:03:53+00:00
status	inactive
# evaluating
# success
# timeout	2 `50173`
# failed	12 `47644`
# error	34 `47717`
# aborted	6 `47567`
# host-error	15 `48039`
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID	submission	user	user label	challenge	step	status	up to date	evaluator	date started	date completed	duration	message
`52543`	`6819`	Bence Hadlaczky	template-random	`aido5-LF-sim-validation`	LFv-sim	timeout	no	`reg02`	2020-12-02 11:58:34+00:00	-	-		-	-	No reset possible
`52458`	`6846`	Daniil Lisus	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:42:45+00:00	2020-12-02 11:54:52+00:00	0:12:07	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140490020962800 - M:video_aido:cmdline(in:/;out:/) 140490020965728 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52423`	`9239`	Melisande Teng	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:37:18+00:00	2020-12-02 11:41:15+00:00	0:03:57	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140512266460992 - M:video_aido:cmdline(in:/;out:/) 140512266458784 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52393`	`9277`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 11:32:54+00:00	2020-12-02 11:37:07+00:00	0:04:13	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over raise TimeoutError(msg) from None TimeoutError: Timeout while reading output of node "ego0". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, *self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one raise TimeoutError(msg) from e TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52344`	`9302`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:26:48+00:00	2020-12-02 11:31:00+00:00	0:04:12	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139706008305968 - M:video_aido:cmdline(in:/;out:/) 139709119984688 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52311`	`9660`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 11:21:52+00:00	2020-12-02 11:26:13+00:00	0:04:21	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over raise TimeoutError(msg) from None TimeoutError: Timeout while reading output of node "ego0". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, *self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one raise TimeoutError(msg) from e TimeoutError: Timeout detected on /fifos/ego0-out after 76 messages. Expected topic "commands". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52271`	`9333`	Himanshu Arora 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:16:37+00:00	2020-12-02 11:20:31+00:00	0:03:54	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140029394114592 - M:video_aido:cmdline(in:/;out:/) 140032552467040 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52230`	`9370`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:12:19+00:00	2020-12-02 11:15:56+00:00	0:03:37	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140576717992960 - M:video_aido:cmdline(in:/;out:/) 140576719640176 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52178`	`9378`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 11:06:20+00:00	2020-12-02 11:11:45+00:00	0:05:25	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140695391469424 - M:video_aido:cmdline(in:/;out:/) 140695391468416 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52045`	`10031`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`reg02`	2020-12-02 10:44:27+00:00	2020-12-02 10:59:27+00:00	0:15:00	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`52011`	`10040`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 10:40:16+00:00	2020-12-02 10:44:03+00:00	0:03:47	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140001808587984 - M:video_aido:cmdline(in:/;out:/) 140001808604848 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51826`	`10722`	Dishank Bansal 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 10:18:08+00:00	2020-12-02 10:37:59+00:00	0:19:51	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140542720120960 - M:video_aido:cmdline(in:/;out:/) 140542591910624 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51765`	`10753`	Dishank Bansal 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 10:10:56+00:00	2020-12-02 10:17:55+00:00	0:06:59	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140409500404752 - M:video_aido:cmdline(in:/;out:/) 140409500405664 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51719`	`10787`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 10:04:58+00:00	2020-12-02 10:10:25+00:00	0:05:27	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140044443719520 - M:video_aido:cmdline(in:/;out:/) 140044443267808 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51694`	`10933`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`reg02`	2020-12-02 10:02:16+00:00	2020-12-02 10:03:39+00:00	0:01:23	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51614`	`10818`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 09:53:11+00:00	2020-12-02 10:01:36+00:00	0:08:25	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140048601622608 - M:video_aido:cmdline(in:/;out:/) 140048601623184 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51528`	`10840`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 09:43:34+00:00	2020-12-02 09:52:51+00:00	0:09:17	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140206645918064 - M:video_aido:cmdline(in:/;out:/) 140206868694640 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51467`	`10857`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 09:36:48+00:00	2020-12-02 09:40:35+00:00	0:03:47	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140535322109840 - M:video_aido:cmdline(in:/;out:/) 140535322111136 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51314`	`10895`	Daniil Lisus	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 09:21:19+00:00	2020-12-02 09:36:29+00:00	0:15:10	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140325402577504 - M:video_aido:cmdline(in:/;out:/) 140325402464416 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51254`	`10917`	Fernanda Custodio Pereira do Carmo 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 09:13:40+00:00	2020-12-02 09:20:01+00:00	0:06:21	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139833857514032 - M:video_aido:cmdline(in:/;out:/) 139833857514464 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51214`	`11012`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`reg02`	2020-12-02 09:08:35+00:00	2020-12-02 09:12:13+00:00	0:03:38	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51072`	`10968`	Yishu Malhotra 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 08:51:56+00:00	2020-12-02 09:07:53+00:00	0:15:57	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139971648056576 - M:video_aido:cmdline(in:/;out:/) 139971648054752 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`51047`	`11010`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`reg02`	2020-12-02 08:49:53+00:00	2020-12-02 08:51:36+00:00	0:01:43	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| raise Exception(msg) \|\| Exception: I need a GPU; bailing. \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| raise Exception(msg) \|\| \| Exception: I need a GPU; bailing. \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50982`	`10986`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	host-error	no	`reg02`	2020-12-02 08:43:06+00:00	2020-12-02 08:47:46+00:00	0:04:40	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50862`	`11030`	Mo Kleit 🇨🇦	sim-exercise-1	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 08:28:04+00:00	2020-12-02 08:42:17+00:00	0:14:13	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140049468019616 - M:video_aido:cmdline(in:/;out:/) 140049468021968 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50629`	`11281`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 08:07:36+00:00	2020-12-02 08:27:34+00:00	0:19:58	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140557060287360 - M:video_aido:cmdline(in:/;out:/) 140557060288368 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50571`	`11300`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 08:03:51+00:00	2020-12-02 08:06:50+00:00	0:02:59	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140521968326112 - M:video_aido:cmdline(in:/;out:/) 140521968325824 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50499`	`11291`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 07:58:37+00:00	2020-12-02 08:03:20+00:00	0:04:43	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140071777924000 - M:video_aido:cmdline(in:/;out:/) 140071777907328 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50455`	`11305`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 07:51:10+00:00	2020-12-02 07:57:06+00:00	0:05:56	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over raise RemoteNodeAborted(m) zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted: error in ego0 \|Exception while handling a message on topic "get_commands". \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop \|\| handle_message_node(parsed, receiver0, context0) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node \|\| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 70, in on_received_get_commands \|\| velocity, omega = self.compute_action(self.current_image) \|\| File "solution.py", line 67, in compute_action \|\| return action.astype(float) \|\| AttributeError: 'Tensor' object has no attribute 'astype' \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50384`	`11139`	Ayman Shams 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 07:41:56+00:00	2020-12-02 07:46:20+00:00	0:04:24	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main raise InvalidSubmission(msg) duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50321`	`11438`	Charlie Gauthier 🇨🇦	baseline-RL-sim-pytorch	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 07:34:09+00:00	2020-12-02 07:37:35+00:00	0:03:26	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 27, in init \|\| self.model.load("model", directory="./models") \|\| File "/workspace/model.py", line 236, in load \|\| self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device)) \|\| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load \|\| with _open_file_like(f, 'rb') as opened_file: \|\| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like \|\| return _open_file(name_or_buffer, mode) \|\| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__ \|\| super(_open_file, self).__init__(open(name, mode)) \|\| FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth' \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 27, in init \|\| \| self.model.load("model", directory="./models") \|\| \| File "/workspace/model.py", line 236, in load \|\| \| self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device)) \|\| \| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load \|\| \| with _open_file_like(f, 'rb') as opened_file: \|\| \| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like \|\| \| return _open_file(name_or_buffer, mode) \|\| \| File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__ \|\| \| super(_open_file, self).__init__(open(name, mode)) \|\| \| FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth' \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50276`	`11289`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 07:27:35+00:00	2020-12-02 07:32:05+00:00	0:04:30	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139825946669984 - M:video_aido:cmdline(in:/;out:/) 139828984187344 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50173`	`11302`	Moustafa Elarabi	template-pytorch	`aido5-LF-sim-validation`	LFv-sim	timeout	no	`reg02`	2020-12-02 07:15:37+00:00	2020-12-02 07:25:52+00:00	0:10:15	Timeout because eval [...] `Timeout because evaluator contacted us`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`50067`	`11351`	Anthony Courchesne 🇨🇦	exercise_ros_template	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 07:01:56+00:00	2020-12-02 07:05:33+00:00	0:03:37	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main raise InvalidSubmission(msg) duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49786`	`11399`	Charlie Gauthier 🇨🇦	Baseline solution using reinforcement learning	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 06:24:38+00:00	2020-12-02 07:01:46+00:00	0:37:08	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140261084968512 - M:video_aido:cmdline(in:/;out:/) 140261085003632 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49674`	`11624`	Anthony Courchesne 🇨🇦	TNetR1	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 06:08:22+00:00	2020-12-02 06:24:02+00:00	0:15:40	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140297986991776 - M:video_aido:cmdline(in:/;out:/) 140297986990672 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49587`	`11546`	Daniil Lisus	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 05:55:17+00:00	2020-12-02 06:07:45+00:00	0:12:28	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140514348396448 - M:video_aido:cmdline(in:/;out:/) 140514350246112 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49447`	`11603`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 05:37:39+00:00	2020-12-02 05:54:55+00:00	0:17:16	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140353803128896 - M:video_aido:cmdline(in:/;out:/) 140353803430112 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49415`	`12236`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 05:33:10+00:00	2020-12-02 05:37:17+00:00	0:04:07	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, **kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49384`	`12237`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 05:30:01+00:00	2020-12-02 05:32:20+00:00	0:02:19	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, **kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49351`	`12245`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 05:26:46+00:00	2020-12-02 05:29:13+00:00	0:02:27	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, **kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49332`	`12245`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 05:23:59+00:00	2020-12-02 05:26:21+00:00	0:02:22	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(*kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego1" aborted with the following error: error in ego1 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 44, in init \|\| self.model = FrankNet.build(200, 150) \|\| File "/submission/frankModel.py", line 76, in build \|\| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| self._maybe_build(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| self.build(input_shapes) # pylint:disable=not-callable \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| self.kernel = self.add_weight( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| variable = self._add_variable_with_custom_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| new_variable = getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| return tf_variables.VariableV1( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| return cls._variable_v1_call(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| return previous_getter( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| return resource_variable_ops.ResourceVariable( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| return super(VariableMetaclass, cls).__call__(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| self._init_from_args( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| initial_value() if init_from_fn else initial_value, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| init_val = lambda: initializer(shape, dtype=dtype) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| return op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| rnd = gen_random_ops.random_standard_normal( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| _ops.raise_from_not_ok_status(e, name) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| six.raise_from(core._status_to_exception(e.code, message), None) \|\| File "<string>", line 3, in raise_from \|\| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 44, in init \|\| \| self.model = FrankNet.build(200, 150) \|\| \| File "/submission/frankModel.py", line 76, in build \|\| \| linearVelocity = FrankNet.build_linear_branch(inputs) \|\| \| File "/submission/frankModel.py", line 31, in build_linear_branch \|\| \| x = Dense(1164, kernel_initializer='normal', activation='relu')(x) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 897, in __call__ \|\| \| self._maybe_build(inputs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 2416, in _maybe_build \|\| \| self.build(input_shapes) # pylint:disable=not-callable \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/core.py", line 1158, in build \|\| \| self.kernel = self.add_weight( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer.py", line 560, in add_weight \|\| \| variable = self._add_variable_with_custom_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/training/tracking/base.py", line 738, in _add_variable_with_custom_getter \|\| \| new_variable = getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 129, in make_variable \|\| \| return tf_variables.VariableV1( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 259, in __call__ \|\| \| return cls._variable_v1_call(args, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 205, in _variable_v1_call \|\| \| return previous_getter( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 198, in <lambda> \|\| \| previous_getter = lambda kwargs: default_variable_creator(None, kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variable_scope.py", line 2584, in default_variable_creator \|\| \| return resource_variable_ops.ResourceVariable( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/variables.py", line 263, in __call__ \|\| \| return super(VariableMetaclass, cls).__call__(args, **kwargs) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1423, in __init__ \|\| \| self._init_from_args( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/resource_variable_ops.py", line 1567, in _init_from_args \|\| \| initial_value() if init_from_fn else initial_value, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_utils.py", line 121, in <lambda> \|\| \| init_val = lambda: initializer(shape, dtype=dtype) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 381, in __call__ \|\| \| return self._random_generator.random_normal(shape, self.mean, self.stddev, \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/init_ops_v2.py", line 1058, in random_normal \|\| \| return op( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/random_ops.py", line 91, in random_normal \|\| \| rnd = gen_random_ops.random_standard_normal( \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_random_ops.py", line 641, in random_standard_normal \|\| \| _ops.raise_from_not_ok_status(e, name) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 6653, in raise_from_not_ok_status \|\| \| six.raise_from(core._status_to_exception(e.code, message), None) \|\| \| File "<string>", line 3, in raise_from \|\| \| tensorflow.python.framework.errors_impl.ResourceExhaustedError: OOM when allocating tensor with shape[13824,1164] and type float on /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc [Op:RandomStandardNormal] \|\| \| \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49313`	`12297`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 05:21:15+00:00	2020-12-02 05:23:39+00:00	0:02:24	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49259`	`11641`	Mo Kleit 🇨🇦	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	error	no	`reg02`	2020-12-02 05:15:46+00:00	2020-12-02 05:21:00+00:00	0:05:14	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139966566906992 - M:video_aido:cmdline(in:/;out:/) 139963742431888 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49241`	`12322`	Robert Moni 🇭🇺	duckietown-rm	`aido5-LF-sim-validation`	LFv-sim	failed	no	`reg02`	2020-12-02 05:12:50+00:00	2020-12-02 05:15:32+00:00	0:02:42	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode agent_ci.write_topic_and_expect_zero("observations", obs_plus) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over raise RemoteNodeAborted(m) zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted: error in ego0 \|Exception while handling a message on topic "observations". \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop \|\| handle_message_node(parsed, receiver0, context0) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node \|\| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(**kwargs) \|\| File "solution.py", line 67, in on_received_observations \|\| cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR)) \|\| cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]' \|\| > Unsupported depth of input image: \|\| > 'VDepth::contains(depth)' \|\| > where \|\| > 'depth' is 6 (CV_64F) \|\| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49219`	`12296`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 05:10:12+00:00	2020-12-02 05:12:29+00:00	0:02:17	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`49198`	`12305`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 05:07:41+00:00	2020-12-02 05:09:48+00:00	0:02:07	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error: error in ego3 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48710`	`12311`	Bea Baselines 🐤	template-pytorch	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	error	no	`reg02`	2020-12-02 04:17:14+00:00	2020-12-02 05:07:09+00:00	0:49:55	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140495147465888 - M:video_aido:cmdline(in:/;out:/) 140495147463104 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48620`	`12320`	Bea Baselines 🐤	template-pytorch	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	error	no	`reg02`	2020-12-02 04:06:59+00:00	2020-12-02 04:16:48+00:00	0:09:49	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140329519664336 - M:video_aido:cmdline(in:/;out:/) 140330253156464 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48589`	`12265`	Bea Baselines 🐤	baseline-duckietown	`aido5-LFP-sim-testing`	LFP-sim	error	no	`reg02`	2020-12-02 04:04:05+00:00	2020-12-02 04:06:37+00:00	0:02:32	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140249602555184 - M:video_aido:cmdline(in:/;out:/) 140252622250336 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48556`	`12243`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 04:01:30+00:00	2020-12-02 04:03:35+00:00	0:02:05	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 37, in init \|\| self.check_tensorflow_gpu() \|\| File "solution.py", line 53, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48484`	`12179`	Bea Baselines 🐤	template-tensorflow	`aido5-LFI-sim-testing`	LFVIv-sim	error	no	`reg02`	2020-12-02 03:57:49+00:00	2020-12-02 04:00:51+00:00	0:03:02	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139715725069232 - M:video_aido:cmdline(in:/;out:/) 139715725067648 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48457`	`12181`	Bea Baselines 🐤	template-tensorflow	`aido5-LF-sim-testing`	LFt-sim	error	no	`reg02`	2020-12-02 03:54:26+00:00	2020-12-02 03:57:23+00:00	0:02:57	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139649754028784 - M:video_aido:cmdline(in:/;out:/) 139649879335360 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48428`	`12184`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI-sim-testing`	LFVIt-sim	failed	no	`reg02`	2020-12-02 03:51:41+00:00	2020-12-02 03:54:12+00:00	0:02:31	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode r: MsgReceived = await loop.run_in_executor(executor, f) File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run result = self.fn(self.args, self.kwargs) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply others = read_until_over(fpout, timeout=timeout, nickname=nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over raise RemoteNodeAborted(m) zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted: error in ego0 \|Exception while handling a message on topic "get_commands". \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call \|\| return fn(args) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn \|\| return self._call_tf_sessionrun(options, feed_dict, fetch_list, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun \|\| return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict, \|\| tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found. \|\| (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. \|\| [[{{node conv2d/Conv2D}}]] \|\| [[Tanh/_47]] \|\| (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. \|\| [[{{node conv2d/Conv2D}}]] \|\| 0 successful operations. \|\| 0 derived errors ignored. \|\| \|\| During handling of the above exception, another exception occurred: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 341, in loop \|\| handle_message_node(parsed, receiver0, context0) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 502, in handle_message_node \|\| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 64, in on_received_get_commands \|\| pwm_left, pwm_right = self.compute_action(self.current_image) \|\| File "solution.py", line 60, in compute_action \|\| action = self.model.predict(observation) \|\| File "/submission/model.py", line 77, in predict \|\| action = self.tf_session.run(self._computation_graph, feed_dict={ \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run \|\| result = self._run(None, fetches, feed_dict, options_ptr, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run \|\| results = self._do_run(handle, final_targets, final_fetches, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run \|\| return self._do_call(_run_fn, feeds, fetches, targets, options, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call \|\| raise type(e)(node_def, op, message) \|\| tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found. \|\| (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. \|\| [[node conv2d/Conv2D (defined at /submission/model.py:41) ]] \|\| [[Tanh/_47]] \|\| (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. \|\| [[node conv2d/Conv2D (defined at /submission/model.py:41) ]] \|\| 0 successful operations. \|\| 0 derived errors ignored. \|\| \|\| Errors may have originated from an input operation. \|\| Input Source operations connected to node conv2d/Conv2D: \|\| map_1/TensorArrayV2Stack/TensorListStack (defined at /submission/model.py:104) \|\| \|\| Input Source operations connected to node conv2d/Conv2D: \|\| map_1/TensorArrayV2Stack/TensorListStack (defined at /submission/model.py:104) \|\| \|\| Original stack trace for 'conv2d/Conv2D': \|\| File "solution.py", line 112, in <module> \|\| main() \|\| File "solution.py", line 108, in main \|\| wrap_direct(node=node, protocol=protocol) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/interface.py", line 24, in wrap_direct \|\| run_loop(node, protocol, args) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 243, in run_loop \|\| loop(node_name, fi, fo, node, protocol, tin, tout, config=config, fi_desc=fin, fo_desc=fout) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 30, in init \|\| self.model = TfInference(observation_shape=(1,) + self.expect_shape, \|\| File "/submission/model.py", line 74, in __init__ \|\| self._initialize(observation_shape, action_shape, graph_location) \|\| File "/submission/model.py", line 99, in _initialize \|\| self._create(input_shape, action_shape) \|\| File "/submission/model.py", line 112, in _create \|\| self._computation_graph = self.computation_graph() \|\| File "/submission/model.py", line 83, in computation_graph \|\| model = one_residual(self._preprocessed_state, seed=self.seed) \|\| File "/submission/model.py", line 41, in one_residual \|\| nn = tf.compat.v1.layers.conv2d(x, filters=32, kernel_size=5, strides=2, padding='same', \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/deprecation.py", line 324, in new_func \|\| return func(args, kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/layers/convolutional.py", line 424, in conv2d \|\| return layer.apply(inputs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/util/deprecation.py", line 324, in new_func \|\| return func(args, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 1695, in apply \|\| return self.__call__(inputs, args, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/layers/base.py", line 547, in __call__ \|\| outputs = super(Layer, self).__call__(inputs, args, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 778, in __call__ \|\| outputs = call_fn(cast_inputs, args, *kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py", line 262, in wrapper \|\| return converted_call(f, args, kwargs, options=options) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py", line 492, in converted_call \|\| return _call_unconverted(f, args, kwargs, options) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/autograph/impl/api.py", line 346, in _call_unconverted \|\| return f(args, **kwargs) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/convolutional.py", line 207, in call \|\| outputs = self._convolution_op(inputs, self.kernel) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/nn_ops.py", line 1106, in __call__ \|\| return self.conv_op(inp, filter) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/nn_ops.py", line 638, in __call__ \|\| return self.call(inp, filter) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/nn_ops.py", line 231, in __call__ \|\| return self.conv_op( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/nn_ops.py", line 2006, in conv2d \|\| return gen_nn_ops.conv2d(input, # pylint: disable=redefined-builtin \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_nn_ops.py", line 965, in conv2d \|\| _, _, _op, _outputs = _op_def_library._apply_op_helper( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper \|\| op = g._create_op_internal(op_type_name, inputs, dtypes=None, \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 3319, in _create_op_internal \|\| ret = Operation( \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 1791, in __init__ \|\| self._traceback = tf_stack.extract_stack() \|\| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main length_s = await run_episode( File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode raise dc.InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48383`	`12208`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-sim-validation`	LFVIv-sim	failed	no	`reg02`	2020-12-02 03:49:04+00:00	2020-12-02 03:51:20+00:00	0:02:16	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48328`	`12210`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-full-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 03:46:28+00:00	2020-12-02 03:48:57+00:00	0:02:29	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48243`	`12229`	Bea Baselines 🐤	straight	`aido5-LFVI-sim-testing`	LFVIt-sim	error	no	`reg02`	2020-12-02 03:40:05+00:00	2020-12-02 03:46:14+00:00	0:06:09	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 139993508909216 - M:video_aido:cmdline(in:/;out:/) 139993509877792 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48163`	`11743`	Jean-Sébastien Grondin 🇨🇦	sim-exercise-2	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`reg02`	2020-12-02 03:38:18+00:00	2020-12-02 03:39:35+00:00	0:01:17	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48120`	`11760`	Ayman Shams 🇨🇦	exercise_state_estimation	`aido5-LF-sim-validation`	LFv-sim	aborted	no	`reg02`	2020-12-02 03:35:28+00:00	2020-12-02 03:37:56+00:00	0:02:28	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48097`	`12177`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 03:32:35+00:00	2020-12-02 03:34:46+00:00	0:02:11	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48077`	`12177`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-testing`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 03:30:06+00:00	2020-12-02 03:32:07+00:00	0:02:01	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48058`	`12176`	Bea Baselines 🐤	template-tensorflow	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	host-error	no	`reg02`	2020-12-02 03:27:29+00:00	2020-12-02 03:29:40+00:00	0:02:11	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`48039`	`12185`	Bea Baselines 🐤	template-tensorflow	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	host-error	no	`reg02`	2020-12-02 03:24:55+00:00	2020-12-02 03:26:58+00:00	0:02:03	InvalidEnvironment: [...] InvalidEnvironment: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main raise InvalidEnvironment(msg) from e duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error: error in ego2 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 22, in init \|\| self.check_tensorflow_gpu(context) \|\| File "solution.py", line 41, in check_tensorflow_gpu \|\| name = tf.test.gpu_device_name() \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name \|\| for x in device_lib.list_local_devices(): \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices \|\| _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config) \|\| RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory \|\|	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47990`	`12165`	Bea Baselines 🐤	template-pytorch	`aido5-LFI-full-sim-validation`	LFVIv-sim	error	no	`reg02`	2020-12-02 03:21:23+00:00	2020-12-02 03:24:33+00:00	0:03:10	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140311433552512 - M:video_aido:cmdline(in:/;out:/) 140314525606912 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47964`	`12203`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFI-full-sim-testing`	LFVIv-sim	failed	no	`reg02`	2020-12-02 03:18:43+00:00	2020-12-02 03:20:50+00:00	0:02:07	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47717`	`11881`	Bea Baselines 🐤	straight	`aido5-LFV-sim-testing`	LFVv-sim	error	no	`reg02`	2020-12-02 02:58:46+00:00	2020-12-02 03:18:35+00:00	0:19:49	InvalidEvaluator: Tr [...] InvalidEvaluator: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread im = Image.open(filename) File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open raise UnidentifiedImageError( PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update result = block.update() File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update image = imread(self.config.file) File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread raise ValueError(msg) from e ValueError: Could not open filename "banner1.png". During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main make_video2( File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2 pg("video_aido", params) File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg raise e File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg model.update() File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update raise BadMethodCall("update", block, traceback.format_exc()) procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'. - B:StaticImage:static_image(in:/;out:rgb) 140712715007408 - M:video_aido:cmdline(in:/;out:/) 140712716350848 > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread > im = Image.open(filename) > File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open > raise UnidentifiedImageError( > PIL.UnidentifiedImageError: cannot identify image file 'banner1.png' > > The above exception was the direct cause of the following exception: > > Traceback (most recent call last): > File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update > result = block.update() > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update > image = imread(self.config.file) > File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread > raise ValueError(msg) from e > ValueError: Could not open filename "banner1.png". The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main raise dc.InvalidEvaluator(msg) from e duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47680`	`12206`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFV_multi-sim-validation`	LFVmultibodyv-sim	failed	no	`reg02`	2020-12-02 02:56:45+00:00	2020-12-02 02:58:37+00:00	0:01:52	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47644`	`12215`	Bea Baselines 🐤	baseline-behavior-cloning	`aido5-LFVI_multi-sim-validation`	LFVIv-sim	failed	no	`reg02`	2020-12-02 02:54:11+00:00	2020-12-02 02:56:10+00:00	0:01:59	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main robot_ci.write_topic_and_expect_zero("seed", config.seed) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname) File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply raise RemoteNodeAborted(msg) zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error: error in ego0 \|Unexpected error: \| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| call_if_fun_exists(node, "init", context=context_data) \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| f(kwargs) \|\| File "solution.py", line 45, in init \|\| self.model.load_weights("FrankNet.h5") \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| with h5py.File(filepath, 'r') as f: \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| fid = make_fid(name, mode, userblock_size, \|\| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| fid = h5f.open(name, flags, fapl=fapl) \|\| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| OSError: Unable to open file (file signature not found) \|\| \|\| The above exception was the direct cause of the following exception: \|\| \|\| Traceback (most recent call last): \|\| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop \|\| raise Exception(msg) from e \|\| Exception: Exception while calling the node's init() function. \|\| \|\| \| Traceback (most recent call last): \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop \|\| \| call_if_fun_exists(node, "init", context=context_data) \|\| \| File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists \|\| \| f(kwargs) \|\| \| File "solution.py", line 45, in init \|\| \| self.model.load_weights("FrankNet.h5") \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights \|\| \| return super(Model, self).load_weights(filepath, by_name, skip_mismatch) \|\| \| File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights \|\| \| with h5py.File(filepath, 'r') as f: \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__ \|\| \| fid = make_fid(name, mode, userblock_size, \|\| \| File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid \|\| \| fid = h5f.open(name, flags, fapl=fapl) \|\| \| File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper \|\| \| File "h5py/h5f.pyx", line 88, in h5py.h5f.open \|\| \| OSError: Unable to open file (file signature not found) \|\| \| \|\| The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context yield cie File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go wrap(cie) File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap asyncio.run(main(cie, logdir, attempts), debug=True) File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete return future.result() File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main raise InvalidSubmission(msg) from e duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible
`47567`	`11874`	Bea Baselines 🐤	straight	`aido5-LFP-sim-testing`	LFP-sim	aborted	no	`reg02`	2020-12-02 02:25:08+00:00	2020-12-02 02:53:56+00:00	0:28:48	KeyboardInterrupt: T [...] `KeyboardInterrupt: Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one heartbeat() File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat raise KeyboardInterrupt(msg_) KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.		No reset possible