Duckietown Challenges Home Challenges Submissions

Evaluator 116

ID116
evaluatoridsc-rudolf-16386
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-16386
versionDC:3.1.42;DCR:3.2.4;DTS:3.0.29
first heard
last heard
statusinactive
# evaluating
# success18 543
# timeout1 673
# failed3 535
# error8 513
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6731Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationtimeoutnoidsc-rudolf-163860:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6691Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6631Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6591Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6511Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6461Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6411Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6361Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6321Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6271Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6211Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6151Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6101Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6041Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5981Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5931Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5871Andrea Censi 🇨🇭nullaido1_LF1-v3step1-simulationsuccessnoidsc-rudolf-163860:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
581219Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-163860:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
577179Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednoidsc-rudolf-163860:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
568281Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
563276Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job563-9029', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job563-9029', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
558271Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job558-4906', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job558-4906', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
553194Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
547302Benjamin Ramtoula 🇨🇦PyTorch DDPG templateaido1_LF1_r2-v3step1-simulationsuccessyesidsc-rudolf-163860:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
543299Mandana Samiei 🇨🇦Tensorflow templateaido1_LF1_r2-v3step1-simulationsuccessyesidsc-rudolf-163860:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
535291Claudio RuchJava templateaido1_amod1-v3step1-simulationfailedyesidsc-rudolf-163860:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 25, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-jar', '/aidamod/target/aidamod-1.4.7.jar', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
520277Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job520-9054', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job520-9054', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
519276Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job519-3001', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job519-3001', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
517274Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job517-2978', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job517-2978', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
513271Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornoidsc-rudolf-163860:03:45
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job513-1099', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job513-1099', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible