Duckietown Challenges Home Challenges Submissions

Evaluator 12

ID12
evaluatorrudolf-2
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-2
version3.0.24
first heard
last heard
statusinactive
# evaluating
# success17 27
# timeout
# failed
# error1 41
# aborted1 23
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8750Andy SerRandom executionaido1_LF1-v3step2-scoringsuccessyesrudolf-20:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-1.3584795961663128


other stats
ep000
details{"nsteps": 500, "reward": -0.7264573476314544}
ep001
details{"nsteps": 500, "reward": -0.4420313913449645}
ep002
details{"nsteps": 500, "reward": -1.2611878103613854}
ep003
details{"nsteps": 500, "reward": -1.7939736261367798}
ep004
details{"nsteps": 500, "reward": -2.568747805356979}
No reset possible
8449Andy SerTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-20:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
8148Andy SerSolution templateaido1_luck-v3step1successyesrudolf-20:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score158.25174474509544


No reset possible
7546Andrea Censi 🇨🇭Python templateaido1_amod1-v3step1-simulationsuccessyesrudolf-20:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
6739Manfred DiazTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-20:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-21.378165227326523


other stats
ep000
details{"nsteps": 125, "reward": -8.461144338650746}
ep001
details{"nsteps": 63, "reward": -17.303217866029296}
ep002
details{"nsteps": 72, "reward": -15.647384925021065}
ep003
details{"nsteps": 138, "reward": -7.7087854929976976}
ep004
details{"nsteps": 18, "reward": -57.770293513933815}
No reset possible
6339Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-20:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5937Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-20:00:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5635Liam Paull 🇨🇦Tensorflow templateaido1_LF1-v3step1-simulationsuccessyesrudolf-20:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation"1.0"
No reset possible
5432Manfred DiazPython templateaido1_amod1-v3step2-scoringsuccessyesrudolf-20:00:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-7722431.957367571
efficiency-5639904.255262545
fleet_size-1000000000


No reset possible
5331Manfred DiazTensorflow templateaido1_LF1-v3step2-scoringsuccessyesrudolf-20:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-22.666579160346096


other stats
ep000
details{"nsteps": 99, "reward": -11.191720477615794}
ep001
details{"nsteps": 64, "reward": -15.71863554767333}
ep002
details{"nsteps": 322, "reward": -3.23227034582276}
ep003
details{"nsteps": 62, "reward": -17.420586412291854}
ep004
details{"nsteps": 16, "reward": -65.76968301832676}
No reset possible
5130Manfred DiazSolution templateaido1_test_multistep-v3step2successnorudolf-20:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step21


No reset possible
4830Manfred DiazSolution templateaido1_test_multistep-v3step1successnorudolf-20:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed-step11


No reset possible
4125Manfred DiazTensorflow templateaido1_LF1-v3step1-simulationerroryesrudolf-20:00:16
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.24-py2.7.egg/duckietown_challenges/runner.py", line 344, in run
    pruned = client.networks.prune()
  File "/usr/local/lib/python2.7/dist-packages/docker/models/networks.py", line 214, in prune
    return self.client.api.prune_networks(filters=filters)
  File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 34, in wrapper
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/network.py", line 174, in prune_networks
    return self._result(self._post(url, params=params), True)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 235, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 231, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python2.7/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
APIError: 409 Client Error: Conflict ("a prune operation is already running")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3924Liam Paull 🇨🇦Solution templateaido1_luck-v3step1successyesrudolf-20:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score189.82252022716435


No reset possible
3622Manfred Diaznullaido1_log_processing-v3logstep1successyesrudolf-20:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


No reset possible
3521Andrea Censi 🇨🇭Random executionaido1_LF1-v3step2-scoringsuccessyesrudolf-20:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-1.8028458649332388


other stats
ep000
details{"nsteps": 500, "reward": -0.9126967093037676}
ep001
details{"nsteps": 500, "reward": -1.3699560401439668}
ep002
details{"nsteps": 367, "reward": -4.150276966088474}
ep003
details{"nsteps": 500, "reward": -0.48023060137417634}
ep004
details{"nsteps": 500, "reward": -2.10106900775581}
No reset possible
3220Manfred DiazSolution templateaido1_luck-v3step1successyesrudolf-20:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score116.162193766502426


No reset possible
2718Andrea Censi 🇨🇭Python templateaido1_amod1-v3step1-simulationsuccessyesrudolf-20:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
2315Andrea Censi 🇨🇭nullaido1_log_processing-v3logstep1abortedyesrudolf-20:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


No reset possible