Duckietown Challenges Home Challenges Submissions

Evaluator 11

ID11
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
version3.0.24
first heard
last heard
statusinactive
# evaluating
# success16 24
# timeout
# failed2 28
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8650Andy SerRandom executionaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
8549Andy SerTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-30.045445178373928


other stats
ep000
details{"nsteps": 12, "reward": -86.73428396383922}
ep001
details{"nsteps": 208, "reward": -5.121861849286898}
ep002
details{"nsteps": 137, "reward": -7.353503025186704}
ep003
details{"nsteps": 117, "reward": -8.893059627066041}
ep004
details{"nsteps": 25, "reward": -42.12451742649078}
No reset possible
7846Andrea Censi 🇨🇭Python templateaido1_amod1-v3step2-scoringsuccessyesrudolf-30:00:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-7727412.8989238385
efficiency-5642774.927802686
fleet_size-1000000000


No reset possible
7043Andrea Censi 🇨🇭Tensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-30:00:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6440Manfred DiazRandom executionaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
6238Andrea Daniele 🇮🇹Solution templateaido1_luck-v3step1successyesrudolf-30:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score140.65981624549491


No reset possible
6125Manfred DiazTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-30.358830861982973


other stats
ep000
details{"nsteps": 14, "reward": -74.3827612059457}
ep001
details{"nsteps": 170, "reward": -6.1510973169646395}
ep002
details{"nsteps": 47, "reward": -22.3339238131934}
ep003
details{"nsteps": 24, "reward": -42.85959360236302}
ep004
details{"nsteps": 169, "reward": -6.066778371448094}
No reset possible
6037Manfred DiazTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-20.08456530515818


other stats
ep000
details{"nsteps": 111, "reward": -10.285743691899755}
ep001
details{"nsteps": 19, "reward": -56.44555163383484}
ep002
details{"nsteps": 84, "reward": -13.074018412757487}
ep003
details{"nsteps": 114, "reward": -8.669518638336868}
ep004
details{"nsteps": 88, "reward": -11.947994148961946}
No reset possible
5836Jan HakenbergSolution templateaido1_luck-v3step1successyesrudolf-30:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score179.66385029703504


No reset possible
5233Manfred DiazJava templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4729Manfred Diaznullaido1_log_processing-v3logstep1successyesrudolf-30:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


No reset possible
4526Manfred DiazPython templateaido1_amod1-v3step2-scoringsuccessyesrudolf-30:00:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-9502201.956425795
efficiency-6911657.111732701
fleet_size-1000000000


No reset possible
4025Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
3723Manfred DiazSolution templateaido1_test_multistep-v3step1successnorudolf-30:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible
3321Andrea Censi 🇨🇭Random executionaido1_LF1-v3step1-simulationsuccessyesrudolf-30:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
2917Andrea Censi 🇨🇭Tensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-30:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-7.947051411038778


other stats
ep000
details{"nsteps": 178, "reward": -5.5207145906503445}
ep001
details{"nsteps": 293, "reward": -3.5409162714600613}
ep002
details{"nsteps": 224, "reward": -4.29446295699537}
ep003
details{"nsteps": 38, "reward": -26.466475781053305}
ep004
details{"nsteps": 500, "reward": 0.08731254496518523}
No reset possible
2819Andrea Censi 🇨🇭Java templateaido1_amod1-v3step1-simulationfailedyesrudolf-30:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 395, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
  File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
    solution.run(cis)
  File "/project/solution.py", line 14, in run
    subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
  File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
    raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2416Andrea Censi 🇨🇭Solution templateaido1_test_multistep-v3step1successnorudolf-30:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible