Duckietown Challenges Home Challenges Submissions

Evaluator 13

ID13
evaluatorrudolf1
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf1
version3.0.24
first heard
last heard
statusinactive
# evaluating
# success14 22
# timeout
# failed2 66
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8048Andy SerSolution templateaido1_luck-v3step1successyesrudolf10:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score178.56220186473149


No reset possible
7747Andrea Censi 🇨🇭Java templateaido1_amod1-v3step1-simulationfailedyesrudolf10:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
7645Manfred DiazTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf10:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-18.053818639301575


other stats
ep000
details{"nsteps": 176, "reward": -5.635666238780356}
ep001
details{"nsteps": 131, "reward": -7.981235788341297}
ep002
details{"nsteps": 500, "reward": -0.12988964257366023}
ep003
details{"nsteps": 149, "reward": -7.140588724561369}
ep004
details{"nsteps": 15, "reward": -69.38171280225119}
No reset possible
7344Andrea Censi 🇨🇭Random executionaido1_LF1-v3step2-scoringsuccessyesrudolf10:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-4.0346384465571905


other stats
ep000
details{"nsteps": 500, "reward": -2.0404820749759676}
ep001
details{"nsteps": 400, "reward": -4.548277764804661}
ep002
details{"nsteps": 500, "reward": -0.7891023449238855}
ep003
details{"nsteps": 153, "reward": -6.89177492063103}
ep004
details{"nsteps": 184, "reward": -5.903555127450407}
No reset possible
7243Andrea Censi 🇨🇭Tensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf10:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-26.06666432720767


other stats
ep000
details{"nsteps": 39, "reward": -27.14820259169508}
ep001
details{"nsteps": 63, "reward": -16.9379549934307}
ep002
details{"nsteps": 153, "reward": -6.824021705408015}
ep003
details{"nsteps": 95, "reward": -11.769077633576174}
ep004
details{"nsteps": 15, "reward": -67.65406471192837}
No reset possible
6941Manfred DiazPython templateaido1_amod1-v3step2-scoringsuccessyesrudolf10:00:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-9271510.746700993
efficiency-6745244.819072089
fleet_size-1000000000


No reset possible
6840Manfred DiazRandom executionaido1_LF1-v3step2-scoringsuccessyesrudolf10:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-4.365488782785013


other stats
ep000
details{"nsteps": 440, "reward": -4.860976546460932}
ep001
details{"nsteps": 300, "reward": -5.966171091913517}
ep002
details{"nsteps": 414, "reward": -5.974919767195476}
ep003
details{"nsteps": 500, "reward": -2.333236505150795}
ep004
details{"nsteps": 500, "reward": -2.692140003204346}
No reset possible
6642Manfred DiazJava templateaido1_amod1-v3step1-simulationfailedyesrudolf10:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5534Liam Paull 🇨🇦Solution templateaido1_luck-v3step1successyesrudolf10:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score10


No reset possible
4931Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf10:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
4326Manfred DiazPython templateaido1_amod1-v3step1-simulationsuccessyesrudolf10:03:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
4225Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf10:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
3118Andrea Censi 🇨🇭Python templateaido1_amod1-v3step2-scoringsuccessyesrudolf10:00:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-7701726.772628051
efficiency-5624173.409019999
fleet_size-1000000000


No reset possible
3017Andrea Censi 🇨🇭Tensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf10:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-7.947051411038778


other stats
ep000
details{"nsteps": 178, "reward": -5.5207145906503445}
ep001
details{"nsteps": 293, "reward": -3.5409162714600613}
ep002
details{"nsteps": 224, "reward": -4.29446295699537}
ep003
details{"nsteps": 38, "reward": -26.466475781053305}
ep004
details{"nsteps": 500, "reward": 0.08731254496518523}
No reset possible
2616Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step2successnorudolf10:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step21


No reset possible
2214Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesrudolf10:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score192.68423721901291


No reset possible