Evaluation Jobs

Job opportunities

Submission	Date	User	Challenge	Step	Admin priority	User priority	Previous	Avoid	Evaluator assignment
`3608`	2019-05-19 11:54:41+00:00	riza.velioglu	`aido2-LFV-real-validation`	eval0-videos-autobots	130	50	{'eval0': 23384}	1368	No assignment yet.
`3552`	2019-05-17 09:52:17+00:00	Bea Baselines	`aido2-LFV-real-validation`	eval0-videos-autobots	120	50	{'eval0': 23084}	1335	No assignment yet.
`3549`	2019-05-17 09:52:17+00:00	Bea Baselines	`aido2-LF-real-validation`	eval0-videos-autobots	120	50	{'eval0': 23229, 'eval1': 23365}	1330, 1331, 1332, 1333	No assignment yet.
`3535`	2019-05-16 20:49:58+00:00	almasip	`aido2-LF-real-validation`	eval1-videos-autobots	100	50	{'eval0': 22471, 'eval1': 23340, 'eval0-videos': 23099, 'eval0-videos-autobots': 23253, 'eval0-videos-watchtowers': 23254}		No assignment yet.
`3540`	2019-05-16 21:35:43+00:00	almasip	`aido2-LF-real-validation`	eval0-videos-watchtowers	90	50	{'eval0': 23063, 'eval1': 23341, 'eval0-videos': 23098, 'eval0-videos-autobots': 23255}		No assignment yet.
`3505`	2019-05-16 13:31:50+00:00	Bea Baselines	`aido2-LF-real-validation`	eval0-videos-autobots	90	50	{'eval0': 23062, 'eval1': 23342}		No assignment yet.
`3211`	2019-05-06 12:07:10+00:00	AmaurX	`aido2-LF-real-validation`	eval0-videos-autobots	90	50	{'eval0': 22453}		No assignment yet.
`3508`	2019-05-16 13:31:50+00:00	Bea Baselines	`aido2-LFV-real-validation`	eval0-videos-autobots	80	50	{'eval0': 23055}		No assignment yet.
`3511`	2019-05-16 13:31:51+00:00	Bea Baselines	`aido2-LFVI-real-validation`	eval0	70	50	{}		No assignment yet.
`3637`	2019-05-19 20:46:33+00:00	awoo424	`aido2-LF-real-validation`	eval0	50	50	{}		No assignment yet.

See all job opportunities

page 2

Job ID	submission	user	user label	challenge	step	status	up to date	evaluator	date started	date completed	duration	message
`23405`	`3552`	Bea Baselines	Running the real lane following -- without challenge container	`aido2-LFV-real-validation`	eval0-videos-autobots	aborted	yes	`1368`	2019-05-19 20:37:27+00:00	2019-05-19 21:00:35+00:00	0:23:08	KeyboardInterrupt: T [...] KeyboardInterrupt: Traceback (most recent call last): File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 544, in get_cr uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1123, in upload_files uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1373, in upload aws_object.load() File "/home/aleksanndar/.local/lib/python3.7/site-packages/boto3/resources/factory.py", line 505, in do_action response = action(self, args, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/boto3/resources/action.py", line 83, in __call__ response = getattr(parent.meta.client, operation_name)(*params) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/client.py", line 357, in _api_call return self._make_api_call(operation_name, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/client.py", line 648, in _make_api_call operation_model, request_dict, request_context) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/client.py", line 667, in _make_request return self._endpoint.make_request(operation_model, request_dict) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/endpoint.py", line 102, in make_request return self._send_request(request_dict, operation_model) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/endpoint.py", line 135, in _send_request request, operation_model, context) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/endpoint.py", line 167, in _get_response request, operation_model) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/endpoint.py", line 200, in _do_get_response http_response = self._send(request) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/endpoint.py", line 244, in _send return self.http_session.send(request) File "/home/aleksanndar/.local/lib/python3.7/site-packages/botocore/httpsession.py", line 258, in send decode_content=False, File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen chunked=chunked) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 343, in _make_request self._validate_conn(conn) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 839, in _validate_conn conn.connect() File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connection.py", line 344, in connect ssl_context=context) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/util/ssl_.py", line 344, in ssl_wrap_socket return context.wrap_socket(sock, server_hostname=server_hostname) File "/home/aleksanndar/miniconda3/lib/python3.7/ssl.py", line 412, in wrap_socket session=session File "/home/aleksanndar/miniconda3/lib/python3.7/ssl.py", line 853, in _create self.do_handshake() File "/home/aleksanndar/miniconda3/lib/python3.7/ssl.py", line 1117, in do_handshake self._sslobj.do_handshake() KeyboardInterrupt	(hidden)
`23404`	`3608`	riza.velioglu	challenge-aido_LF-template-pytorch	`aido2-LFV-real-validation`	eval0-videos-autobots	host-error	yes	`1368`	2019-05-19 20:36:02+00:00	2019-05-19 20:37:05+00:00	0:01:03	Could not access IPF [...] Could not access IPFS data: Traceback (most recent call last): File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1182, in download_artefacts try_to_get_hash(client, sha256hex) File "/home/aleksanndar/.local/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 81, in new_function return function(args, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1133, in try_to_get_hash res = client.file_ls(qm) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfsapi/client/__init__.py", line 205, in wrapper return value(args, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfsapi/client/__init__.py", line 242, in file_ls return self._client.request('/file/ls', args, decoder='json', kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/http.py", line 44, in wrapper return func(self, args, merged) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/http.py", line 364, in request files, headers, data, timeout=timeout) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/http.py", line 282, in _request timeout=timeout) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/http.py", line 245, in _do_request return requests.request(args, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/requests_wrapper.py", line 240, in request return session.request(method=method, url=url, kwargs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/ipfshttpclient/requests_wrapper.py", line 219, in request return super(Session, self).request(method, url, args, kwargs) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/requests/sessions.py", line 646, in send r = adapter.send(request, *kwargs) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/requests/adapters.py", line 449, in send timeout=timeout File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen chunked=chunked) File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 384, in _make_request six.raise_from(e, None) File "<string>", line 2, in raise_from File "/home/aleksanndar/miniconda3/lib/python3.7/site-packages/urllib3/connectionpool.py", line 380, in _make_request httplib_response = conn.getresponse() File "/home/aleksanndar/miniconda3/lib/python3.7/http/client.py", line 1321, in getresponse response.begin() File "/home/aleksanndar/miniconda3/lib/python3.7/http/client.py", line 296, in begin version, status, reason = self._read_status() File "/home/aleksanndar/miniconda3/lib/python3.7/http/client.py", line 257, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/home/aleksanndar/miniconda3/lib/python3.7/socket.py", line 589, in readinto return self._sock.recv_into(b) File "/home/aleksanndar/.local/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 72, in handler _raise_exception(timeout_exception, exception_message) File "/home/aleksanndar/.local/lib/python3.7/site-packages/timeout_decorator/timeout_decorator.py", line 45, in _raise_exception raise exception() timeout_decorator.timeout_decorator.TimeoutError: 'Timed Out' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 541, in get_cr allow_host_network=allow_host_network, use_ipfs=use_ipfs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 605, in run_single prepare_dir(wd, aws_config, steps2artefacts, use_ipfs=use_ipfs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 877, in prepare_dir download_artefacts(aws_config, steps2artefacts, previous_steps_dir, use_ipfs=use_ipfs) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1186, in download_artefacts raise IPFSException(msg) duckietown_challenges_runner.runner.IPFSException: Could not get IPFS hash QmajmKqPEwTgKruvJYqKDgRZDkaY7usNz8bAj9gZ2ePKBi	(hidden)
`23403`	`3636`	awoo424	Baseline-IL-logs-tensorflow	`aido2-LFVI-sim-validation`	step1-simulation	error	yes	`1288`	2019-05-19 19:58:22+00:00	2019-05-19 20:02:23+00:00	0:04:01	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	(hidden)
`23402`	`3635`	awoo424	Baseline-IL-logs-tensorflow	`aido2-LFV-sim-validation`	step1-simulation	error	yes	`1295`	2019-05-19 19:56:14+00:00	2019-05-19 20:00:15+00:00	0:04:01	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	(hidden)
`23401`	`3634`	awoo424	Baseline-IL-logs-tensorflow	`aido2-LF-sim-validation`	step1-simulation	success	yes	`1291`	2019-05-19 19:18:56+00:00	2019-05-19 19:34:07+00:00	0:15:11		(hidden)
`23400`	`3625`	enicky	Baseline solution using reinforcement learning	`aido2-LF-real-validation`	eval0	success	yes	`1360`	2019-05-19 18:54:40+00:00	2019-05-19 19:58:28+00:00	1:03:48		(hidden)
`23399`	`3628`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-real-validation`	eval0	success	yes	`1359`	2019-05-19 18:43:39+00:00	2019-05-19 19:08:12+00:00	0:24:33		(hidden)
`23398`	`3633`	enicky	Baseline solution using reinforcement learning	`aido2-LFVI-sim-validation`	step1-simulation	success	yes	`1289`	2019-05-19 18:34:01+00:00	2019-05-19 18:53:50+00:00	0:19:49		(hidden)
`23397`	`3630`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-sim-validation`	step1-simulation	success	yes	`1287`	2019-05-19 18:33:56+00:00	2019-05-19 18:52:14+00:00	0:18:18		(hidden)
`23396`	`3630`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-sim-validation`	step1-simulation	success	yes	`1285`	2019-05-19 18:33:56+00:00	2019-05-19 18:43:25+00:00	0:09:29		(hidden)
`23395`	`3627`	enicky	Baseline solution using reinforcement learning	`aido2-LF-sim-validation`	step1-simulation	success	yes	`1292`	2019-05-19 18:33:49+00:00	2019-05-19 18:40:49+00:00	0:07:00		(hidden)
`23394`	`3632`	enicky	Baseline solution using reinforcement learning	`aido2-LFVI-sim-testing`	step1-simulation	success	yes	`1286`	2019-05-19 18:33:39+00:00	2019-05-19 19:03:20+00:00	0:29:41		(hidden)
`23393`	`3630`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-sim-validation`	step1-simulation	success	yes	`1298`	2019-05-19 18:33:36+00:00	2019-05-19 18:43:15+00:00	0:09:39		(hidden)
`23392`	`3633`	enicky	Baseline solution using reinforcement learning	`aido2-LFVI-sim-validation`	step1-simulation	success	yes	`1295`	2019-05-19 18:33:23+00:00	2019-05-19 18:46:04+00:00	0:12:41		(hidden)
`23391`	`3627`	enicky	Baseline solution using reinforcement learning	`aido2-LF-sim-validation`	step1-simulation	success	yes	`1284`	2019-05-19 18:33:03+00:00	2019-05-19 18:40:10+00:00	0:07:07		(hidden)
`23390`	`3632`	enicky	Baseline solution using reinforcement learning	`aido2-LFVI-sim-testing`	step1-simulation	success	yes	`1291`	2019-05-19 18:33:03+00:00	2019-05-19 18:57:18+00:00	0:24:15		(hidden)
`23389`	`3629`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-sim-testing`	step1-simulation	success	yes	`1283`	2019-05-19 18:32:59+00:00	2019-05-19 19:10:32+00:00	0:37:33		(hidden)
`23388`	`3626`	enicky	Baseline solution using reinforcement learning	`aido2-LF-sim-testing`	step1-simulation	success	yes	`1288`	2019-05-19 18:32:56+00:00	2019-05-19 18:57:39+00:00	0:24:43		(hidden)
`23387`	`3444`	Andrea Censi	Lane following baseline	`aido2-LF-real-testing`	eval0-videos-autobots	aborted	no	`1358`	2019-05-19 18:23:54+00:00	2019-05-19 18:28:36+00:00	0:04:42	The container "evalu [...] `The container "evaluator" exited with code 1. Look at the logs for the container to know more about the error.`	(hidden)
`23386`	`3444`	Andrea Censi	Lane following baseline	`aido2-LF-real-testing`	eval0-videos-autobots	aborted	no	`1357`	2019-05-19 18:23:20+00:00	2019-05-19 18:23:34+00:00	0:00:14	KeyboardInterrupt: T [...] KeyboardInterrupt: Traceback (most recent call last): File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 743, in run_one run_docker(wd, project, cmd) File "/home/aleksanndar/.local/lib/python3.7/site-packages/duckietown_challenges_runner/runner.py", line 1100, in run_docker subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr) File "/home/aleksanndar/miniconda3/lib/python3.7/subprocess.py", line 336, in check_call retcode = call(popenargs, *kwargs) File "/home/aleksanndar/miniconda3/lib/python3.7/subprocess.py", line 319, in call return p.wait(timeout=timeout) File "/home/aleksanndar/miniconda3/lib/python3.7/subprocess.py", line 984, in wait return self._wait(timeout=timeout) File "/home/aleksanndar/miniconda3/lib/python3.7/subprocess.py", line 1618, in _wait (pid, sts) = self._try_wait(0) File "/home/aleksanndar/miniconda3/lib/python3.7/subprocess.py", line 1576, in _try_wait (pid, sts) = os.waitpid(self.pid, wait_flags) KeyboardInterrupt	(hidden)
`23385`	`3624`	enicky	Baseline solution using reinforcement learning	`aido2-LFV-sim-validation`	step1-simulation	success	yes	`1288`	2019-05-19 17:39:36+00:00	2019-05-19 17:47:23+00:00	0:07:47		(hidden)
`23384`	`3608`	riza.velioglu	challenge-aido_LF-template-pytorch	`aido2-LFV-real-validation`	eval0	success	yes	`1355`	2019-05-19 17:31:15+00:00	2019-05-19 18:14:30+00:00	0:43:15		(hidden)
`23383`	`3623`	ierosodin	Baseline solution using reinforcement learning	`aido2-LF-sim-validation`	step1-simulation	success	yes	`1299`	2019-05-19 17:12:54+00:00	2019-05-19 17:29:47+00:00	0:16:53		(hidden)
`23382`	`3622`	awoo424	Baseline-IL-logs-tensorflow	`aido2-LF-sim-validation`	step1-simulation	success	yes	`1283`	2019-05-19 16:57:50+00:00	2019-05-19 17:20:32+00:00	0:22:42		(hidden)
`23381`	`3543`	almasip	My solution using reinforcement learning	`aido2-LFV-real-validation`	eval1	success	yes	`1354`	2019-05-19 16:56:48+00:00	2019-05-19 17:36:48+00:00	0:40:00		(hidden)

List of evaluation jobs

Job opportunities