Evaluator 215

ID	215
evaluator	`idsc-rudolf-11443`
owner	Andrea Censi 🇨🇭
machine	idsc-rudolf
process	idsc-rudolf-11443
version	DC:3.1.49;DCR:3.2.10;DTS:3.0.29
first heard	2018-10-25 22:30:22+00:00
last heard	2018-10-25 22:45:08+00:00
status	inactive
# evaluating
# success
# timeout	1 `2810`
# failed	5 `2800`
# error	4 `2772`
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID	submission	user	user label	challenge	step	status	up to date	evaluator	date started	date completed	duration	message
`2810`	`150`	Julian Zilly	Baseline solution using imitation learning from logs	`aido1_LF1_r3-v3`	step1-simulation	timeout	no	`idsc-rudolf-11443`	2018-10-25 22:45:09+00:00	2018-10-25 22:56:10+00:00	0:11:01		Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2808`	`173`	Bhairav Mehta	ROS-based Lane Following	`aido1_LF1_r3-v3`	step1-simulation	failed	no	`idsc-rudolf-11443`	2018-10-25 22:44:36+00:00	2018-10-25 22:45:03+00:00	0:00:27	InvalidSubmission: T [...] `InvalidSubmission: Traceback (most recent call last): File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) InvalidSubmission: Invalid solution: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2807`	`179`	Bhairav Mehta	ROS-based Lane Following	`aido1_LF1_r3-v3`	step1-simulation	failed	no	`idsc-rudolf-11443`	2018-10-25 22:43:59+00:00	2018-10-25 22:44:29+00:00	0:00:30	InvalidSubmission: T [...] `InvalidSubmission: Traceback (most recent call last): File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) InvalidSubmission: Invalid solution: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2806`	`188`	Brian Wang 🇺🇸	ROS-based Lane Following	`aido1_LF1_r3-v3`	step1-simulation	failed	no	`idsc-rudolf-11443`	2018-10-25 22:43:25+00:00	2018-10-25 22:43:52+00:00	0:00:27	InvalidSubmission: T [...] `InvalidSubmission: Traceback (most recent call last): File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) InvalidSubmission: Invalid solution: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2803`	`216`	Bhairav Mehta	ROS-based Lane Following	`aido1_LF1_r3-v3`	step1-simulation	failed	no	`idsc-rudolf-11443`	2018-10-25 22:42:52+00:00	2018-10-25 22:43:19+00:00	0:00:27	InvalidSubmission: T [...] `InvalidSubmission: Traceback (most recent call last): File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) InvalidSubmission: Invalid solution: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2800`	`220`	Julian Zilly	Baseline solution using imitation learning from logs	`aido1_LF1_r3-v3`	step1-simulation	failed	no	`idsc-rudolf-11443`	2018-10-25 22:42:23+00:00	2018-10-25 22:42:45+00:00	0:00:22	InvalidSubmission: T [...] InvalidSubmission: Traceback (most recent call last): File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION]) InvalidSubmission: Invalid solution: Traceback (most recent call last): File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution solution.run(cis) File "solution.py", line 107, in run raise InvalidSubmission(str(e)) InvalidSubmission: Can't connect to the gym-duckietown-server	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2793`	`245`	Anton Mashikhin 🇷🇺	AI DL RL MML XXXL 2k18 yoo	`aido1_LF1_r3-v3`	step1-simulation	error	no	`idsc-rudolf-11443`	2018-10-25 22:41:51+00:00	2018-10-25 22:42:15+00:00	0:00:24	Uncaught exception w [...] Uncaught exception while running Docker Compose: Traceback (most recent call last): File "/project/src/duckietown_challenges_runner/runner.py", line 507, in run_one cr = read_challenge_results(wd) File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results raise Exception(msg) Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission245/step1-simulation-idsc-rudolf-11443-job2793/challenge-results/challenge_results.yaml' does not exist.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2789`	`270`	Anton Mashikhin 🇷🇺	AI DL RL MML XXXL 2k18 yoo	`aido1_LF1_r3-v3`	step1-simulation	error	no	`idsc-rudolf-11443`	2018-10-25 22:41:32+00:00	2018-10-25 22:41:42+00:00	0:00:10	Error while running [...] `Error while running Docker Compose: Could not run ['docker-compose', '-p', 'job2789-8196', 'up', '-d']: > Command '['docker-compose', '-p', 'job2789-8196', 'up', '-d']' returned non-zero exit status 1 docker-compose stdout \| None`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2783`	`274`	Anton Mashikhin 🇷🇺	AI DL RL MML XXXL 2k18 yoo	`aido1_LF1_r3-v3`	step1-simulation	error	no	`idsc-rudolf-11443`	2018-10-25 22:41:00+00:00	2018-10-25 22:41:26+00:00	0:00:26	Uncaught exception w [...] Uncaught exception while running Docker Compose: Traceback (most recent call last): File "/project/src/duckietown_challenges_runner/runner.py", line 507, in run_one cr = read_challenge_results(wd) File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results raise Exception(msg) Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission274/step1-simulation-idsc-rudolf-11443-job2783/challenge-results/challenge_results.yaml' does not exist.	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible
`2772`	`281`	Anton Mashikhin 🇷🇺	AI DL RL MML XXXL 2k18 yoo	`aido1_LF1_r3-v3`	step1-simulation	error	no	`idsc-rudolf-11443`	2018-10-25 22:30:25+00:00	2018-10-25 22:40:52+00:00	0:10:27	Timeout: Waited 602 [...] `Timeout: Waited 602.789566994 for container to finish. Giving up.`	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.	No reset possible

Job ID

submission

user

user label

challenge

step

status

up to date

evaluator

date started

date completed

duration

message

2810

150

Julian Zilly

Baseline solution using imitation learning from logs

aido1_LF1_r3-v3

step1-simulation

timeout

idsc-rudolf-11443

2018-10-25 22:45:09+00:00

2018-10-25 22:56:10+00:00

0:11:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2808

173

Bhairav Mehta

ROS-based Lane Following

aido1_LF1_r3-v3

step1-simulation

failed

idsc-rudolf-11443

2018-10-25 22:44:36+00:00

2018-10-25 22:45:03+00:00

0:00:27

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2807

179

Bhairav Mehta

ROS-based Lane Following

aido1_LF1_r3-v3

step1-simulation

failed

idsc-rudolf-11443

2018-10-25 22:43:59+00:00

2018-10-25 22:44:29+00:00

0:00:30

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2806

188

Brian Wang 🇺🇸

ROS-based Lane Following

aido1_LF1_r3-v3

step1-simulation

failed

idsc-rudolf-11443

2018-10-25 22:43:25+00:00

2018-10-25 22:43:52+00:00

0:00:27

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2803

216

Bhairav Mehta

ROS-based Lane Following

aido1_LF1_r3-v3

step1-simulation

failed

idsc-rudolf-11443

2018-10-25 22:42:52+00:00

2018-10-25 22:43:19+00:00

0:00:27

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2800

220

Julian Zilly

Baseline solution using imitation learning from logs

aido1_LF1_r3-v3

step1-simulation

failed

idsc-rudolf-11443

2018-10-25 22:42:23+00:00

2018-10-25 22:42:45+00:00

0:00:22

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2793

245

Anton Mashikhin 🇷🇺

AI DL RL MML XXXL 2k18 yoo

aido1_LF1_r3-v3

step1-simulation

error

idsc-rudolf-11443

2018-10-25 22:41:51+00:00

2018-10-25 22:42:15+00:00

0:00:24

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 507, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission245/step1-simulation-idsc-rudolf-11443-job2793/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2789

270

Anton Mashikhin 🇷🇺

AI DL RL MML XXXL 2k18 yoo

aido1_LF1_r3-v3

step1-simulation

error

idsc-rudolf-11443

2018-10-25 22:41:32+00:00

2018-10-25 22:41:42+00:00

0:00:10

Error while running [...]

Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2789-8196', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job2789-8196', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2783

274

Anton Mashikhin 🇷🇺

AI DL RL MML XXXL 2k18 yoo

aido1_LF1_r3-v3

step1-simulation

error

idsc-rudolf-11443

2018-10-25 22:41:00+00:00

2018-10-25 22:41:26+00:00

0:00:26

Uncaught exception w [...]

Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 507, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission274/step1-simulation-idsc-rudolf-11443-job2783/challenge-results/challenge_results.yaml' does not exist.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

2772

281

Anton Mashikhin 🇷🇺

AI DL RL MML XXXL 2k18 yoo

aido1_LF1_r3-v3

step1-simulation

error

idsc-rudolf-11443

2018-10-25 22:30:25+00:00

2018-10-25 22:40:52+00:00

0:10:27

Timeout: Waited 602 [...]

Timeout:

Waited 602.789566994 for container to finish. Giving up.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible