Duckietown Challenges Home Challenges Submissions

Evaluator 24

ID24
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
version3.0.26
first heard
last heard
statusinactive
# evaluating
# success10 91
# timeout
# failed1 101
# error1 107
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
11770Bhairav MehtaROS-based Lane Followingaido1_LF1-v3step1-simulationsuccessyesrudolf-30:03:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
11266Nick Wang 🇹🇼Tensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-14.072495682653908


other stats
ep000
details{"nsteps": 29, "reward": -35.811100491162}
ep001
details{"nsteps": 246, "reward": -4.021259001685245}
ep002
details{"nsteps": 58, "reward": -18.282701189661847}
ep003
details{"nsteps": 141, "reward": -7.3361274675591615}
ep004
details{"nsteps": 204, "reward": -4.911290263201283}
No reset possible
11166Nick Wang 🇹🇼Tensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
11065Nick Wang 🇹🇼Random executionaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-2.240686556851926


other stats
ep000
details{"nsteps": 500, "reward": -1.116296016216278}
ep001
details{"nsteps": 500, "reward": -2.8281955816745756}
ep002
details{"nsteps": 500, "reward": -1.981480960726738}
ep003
details{"nsteps": 315, "reward": -3.3807656018141037}
ep004
details{"nsteps": 500, "reward": -1.8966946238279343}
No reset possible
10965Nick Wang 🇹🇼Random executionaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
10864Nick Wang 🇹🇼Solution templateaido1_luck-v3step1successyesrudolf-30:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score124.926571227678437


No reset possible
10763Bhairav MehtaROS-based Lane Followingaido1_LF1-v3step1-simulationerroryesrudolf-30:01:08
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.26-py2.7.egg/duckietown_challenges/runner.py", line 364, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.26-py2.7.egg/duckietown_challenges/runner.py", line 503, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job107-111', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job107-111', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
10258Andrea Censi 🇨🇭Tensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-7.524800456175319


other stats
ep000
details{"nsteps": 74, "reward": -14.442200618258022}
ep001
details{"nsteps": 350, "reward": -2.980336620429464}
ep002
details{"nsteps": 194, "reward": -5.2899327177053905}
ep003
details{"nsteps": 185, "reward": -5.285957633803372}
ep004
details{"nsteps": 124, "reward": -9.62557469068035}
No reset possible
10161Andrea Censi 🇨🇭Java templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
9857Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step2successnorudolf-30:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step21


No reset possible
9557Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step1successnorudolf-30:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible
9153Andrea Censi 🇨🇭nullaido1_log_processing-v3logstep1successyesrudolf-30:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


No reset possible