Duckietown Challenges Home Challenges Submissions

Evaluator 71

ID71
evaluatorrudolf-3
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processrudolf-3
version3.0.36
first heard
last heard
statusinactive
# evaluating
# success24 238
# timeout
# failed1 281
# error13 248
# aborted2 298
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
354196Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.893333333333326
good_angle_mean8.636263953613158
valid_direction_mean7.826666666666648


other stats
episodes
details{"ep000": {"nsteps": 356, "reward": -3.6265787835058942, "good_angle": 10.346974715184604, "survival_time": 11.866666666666635, "traveled_tiles": 1, "valid_direction": 9.433333333333309}, "ep001": {"nsteps": 41, "reward": -26.0973138918237, "good_angle": 1.1552500879206298, "survival_time": 1.3666666666666676, "traveled_tiles": 1, "valid_direction": 1.1333333333333342}, "ep002": {"nsteps": 251, "reward": -6.04817963016045, "good_angle": 6.931127019955263, "survival_time": 4.866666666666659, "traveled_tiles": 3, "valid_direction": 6.86666666666665}, "ep003": {"nsteps": 376, "reward": -3.6588211100572656, "good_angle": 11.806425949819408, "survival_time": 0.7, "traveled_tiles": 4, "valid_direction": 8.733333333333311}, "ep004": {"nsteps": 500, "reward": -1.0544916333328, "good_angle": 12.941541995185885, "survival_time": 0.6666666666666666, "traveled_tiles": 3, "valid_direction": 12.96666666666663}}
good_angle_max12.941541995185885
good_angle_median10.346974715184604
good_angle_min1.1552500879206298
reward_max-1.0544916333328
reward_mean-8.097077009776022
reward_median-3.6588211100572656
reward_min-26.0973138918237
survival_time_max11.866666666666635
survival_time_median1.3666666666666676
survival_time_min0.6666666666666666
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max12.96666666666663
valid_direction_median8.733333333333311
valid_direction_min1.1333333333333342
No reset possible
353196Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationsuccessyesrudolf-30:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
352195Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornorudolf-30:00:29
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 392, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/challenge_results.py", line 65, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission195/step1-simulation-rudolf-3-job352/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
350193Adam PacheckRandom executionaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean21.61057851122759
valid_direction_mean13.066666666666658


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1772563876509667, "good_angle": 11.539899083557891, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.199999999999998}, "ep001": {"nsteps": 500, "reward": -2.095957361936569, "good_angle": 39.3670736068429, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.033333333333315}, "ep002": {"nsteps": 500, "reward": -1.337629452969879, "good_angle": 27.821879628024924, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.999999999999984}, "ep003": {"nsteps": 500, "reward": -1.03001177456975, "good_angle": 8.333079170037196, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.266666666666662}, "ep004": {"nsteps": 500, "reward": -1.4489351266548038, "good_angle": 20.990961067675045, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.833333333333323}}
good_angle_max39.3670736068429
good_angle_median20.990961067675045
good_angle_min8.333079170037196
reward_max-1.03001177456975
reward_mean-1.4179580207563935
reward_median-1.337629452969879
reward_min-2.095957361936569
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_median13.199999999999998
valid_direction_min11.266666666666662
No reset possible
345191Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryesrudolf-30:03:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 392, in run
    cr = read_challenge_results(wd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/challenge_results.py", line 65, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r2-v3/submission191/step1-simulation-rudolf-3-job345/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
341187Brian Wang 🇺🇸ROS-based Lane Followingaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median4
survival_time_mean7.426666666666658
good_angle_mean6.234451659201515
valid_direction_mean3.2333333333333343


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.44186159775801936, "good_angle": 27.745786118692777, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.933333333333349}, "ep001": {"nsteps": 324, "reward": -3.9026706771914137, "good_angle": 1.685887255775109, "survival_time": 10.76666666666664, "traveled_tiles": 4, "valid_direction": 5.399999999999986}, "ep002": {"nsteps": 104, "reward": -11.489493187803488, "good_angle": 0.6036906840196563, "survival_time": 3.466666666666664, "traveled_tiles": 1, "valid_direction": 2.1000000000000005}, "ep003": {"nsteps": 176, "reward": -7.660077611323107, "good_angle": 1.0337873549017196, "survival_time": 3.3666666666666645, "traveled_tiles": 4, "valid_direction": 2.7333333333333325}, "ep004": {"nsteps": 86, "reward": -14.024829195682392, "good_angle": 0.10310688261831334, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max27.745786118692777
good_angle_median1.0337873549017196
good_angle_min0.10310688261831334
reward_max-0.44186159775801936
reward_mean-7.503786453951685
reward_median-7.660077611323107
reward_min-14.024829195682392
survival_time_max16.666666666666654
survival_time_median3.466666666666664
survival_time_min2.8666666666666663
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_min1
valid_direction_max5.933333333333349
valid_direction_median2.7333333333333325
valid_direction_min0
No reset possible
339186Christina ChangRandom executionaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean14.77309060227069
valid_direction_mean12.55333333333332


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0069527428746223, "good_angle": 24.006273416630417, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.799999999999988}, "ep001": {"nsteps": 500, "reward": -1.894481227885932, "good_angle": 5.821557224022324, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.033333333333331}, "ep002": {"nsteps": 500, "reward": -0.9713754257721594, "good_angle": 24.453416317731698, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.06666666666664}, "ep003": {"nsteps": 500, "reward": -1.5242187535762788, "good_angle": 4.772028122879997, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 7.599999999999978}, "ep004": {"nsteps": 500, "reward": -1.6065384002625942, "good_angle": 14.81217793008902, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.266666666666657}}
good_angle_max24.453416317731698
good_angle_median14.81217793008902
good_angle_min4.772028122879997
reward_max-0.9713754257721594
reward_mean-1.4007133100743174
reward_median-1.5242187535762788
reward_min-1.894481227885932
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max15.799999999999988
valid_direction_median14.06666666666664
valid_direction_min7.599999999999978
No reset possible
336184Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.566666666666645
good_angle_mean10.597432359472338
valid_direction_mean10.51333333333332


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0949506850242614, "good_angle": 21.772962290279484, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.399999999999986}, "ep001": {"nsteps": 500, "reward": -0.8314622205481864, "good_angle": 5.701920326485813, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 8.066666666666643}, "ep002": {"nsteps": 500, "reward": -1.4145146659612655, "good_angle": 7.237055509856953, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 10.966666666666669}, "ep003": {"nsteps": 497, "reward": -3.4128620881789646, "good_angle": 7.242515657409486, "survival_time": 16.49999999999998, "traveled_tiles": 2, "valid_direction": 7.1000000000000005}, "ep004": {"nsteps": 500, "reward": -0.7115761669054628, "good_angle": 11.032708013329954, "survival_time": 16.466666666666644, "traveled_tiles": 2, "valid_direction": 11.033333333333305}}
good_angle_max21.772962290279484
good_angle_median7.242515657409486
good_angle_min5.701920326485813
reward_max-0.7115761669054628
reward_mean-1.4930731653236282
reward_median-1.0949506850242614
reward_min-3.4128620881789646
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.466666666666644
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max15.399999999999986
valid_direction_median10.966666666666669
valid_direction_min7.1000000000000005
No reset possible
335183Vadim Volodin 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-30:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean26.721956310027707
valid_direction_mean12.486666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7096727082133293, "good_angle": 10.69945295452396, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.133333333333336}, "ep001": {"nsteps": 500, "reward": -0.8498563954792917, "good_angle": 68.68821030623268, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.133333333333317}, "ep002": {"nsteps": 500, "reward": -1.2278265902996064, "good_angle": 31.572937105643057, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.899999999999965}, "ep003": {"nsteps": 500, "reward": -0.8844679707465694, "good_angle": 14.445288500898627, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.29999999999999}, "ep004": {"nsteps": 500, "reward": -1.1306172981262208, "good_angle": 8.203892682840209, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 9.96666666666667}}
good_angle_max68.68821030623268
good_angle_median14.445288500898627
good_angle_min8.203892682840209
reward_max-0.7096727082133293
reward_mean-0.9604881925730036
reward_median-0.8844679707465694
reward_min-1.2278265902996064
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max15.133333333333317
valid_direction_median12.29999999999999
valid_direction_min9.96666666666667
No reset possible
330181Florian GolemoPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationerroryesrudolf-30:02:23
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job330-9916', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job330-9916', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
319172Gianmarco BernasconiSolution templateaido1_luck-v3step1successyesrudolf-30:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score130.39303923589418


No reset possible
312167Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationerroryesrudolf-30:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job312-3155', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job312-3155', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
310165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step2-scoringsuccessnorudolf-32:00:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999992


other stats
episodes
details{"ep000": {"nsteps": 257, "reward": -5.935388254848806, "good_angle": 6.296167709086408, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 3.2333333333333227}, "ep001": {"nsteps": 206, "reward": -5.920791627916064, "good_angle": 23.061219503310294, "survival_time": 6.866666666666652, "traveled_tiles": 2, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 147, "reward": -9.38501587449288, "good_angle": 26.454510536122378, "survival_time": 4.899999999999992, "traveled_tiles": 2, "valid_direction": 3.966666666666659}, "ep003": {"nsteps": 110, "reward": -9.560454756290314, "good_angle": 1.177928792743366, "survival_time": 3.6666666666666634, "traveled_tiles": 1, "valid_direction": 2.1333333333333284}, "ep004": {"nsteps": 82, "reward": -12.843059412499027, "good_angle": 0.7175396934921026, "survival_time": 2.7333333333333334, "traveled_tiles": 1, "valid_direction": 1.7333333333333334}}
good_angle_max26.454510536122378
good_angle_mean11.541473246950908
good_angle_median6.296167709086408
good_angle_min0.7175396934921026
reward_max-5.920791627916064
reward_mean-8.728941985209417
reward_median-9.38501587449288
reward_min-12.843059412499027
survival_time_max8.566666666666647
survival_time_mean5.346666666666658
survival_time_min2.7333333333333334
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.966666666666659
valid_direction_mean3.0066666666666593
valid_direction_median3.2333333333333227
valid_direction_min1.7333333333333334
No reset possible
304165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-32:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
300166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step1-simulationabortednorudolf-32:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
298165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationabortednorudolf-32:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 378, in run
    pruned = client.networks.prune()
  File "/usr/local/lib/python2.7/dist-packages/docker/models/networks.py", line 214, in prune
    return self.client.api.prune_networks(filters=filters)
  File "/usr/local/lib/python2.7/dist-packages/docker/utils/decorators.py", line 34, in wrapper
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/network.py", line 174, in prune_networks
    return self._result(self._post(url, params=params), True)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 235, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python2.7/dist-packages/docker/api/client.py", line 231, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python2.7/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
APIError: 409 Client Error: Conflict ("a prune operation is already running")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
295148Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornorudolf-32:00:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job295-3228', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job295-3228', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
293164Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesrudolf-32:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score124.17836567079084


No reset possible
286157Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationerroryesrudolf-32:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job286-6491', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job286-6491', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
285156Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-32:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean23.62847313629661
valid_direction_mean14.219999999999976


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.8776559413808863, "good_angle": 15.62621214214034, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.133333333333324}, "ep001": {"nsteps": 500, "reward": -1.2643016768097877, "good_angle": 15.118320632022126, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.333333333333298}, "ep002": {"nsteps": 500, "reward": -1.6059184126108883, "good_angle": 52.92531868034771, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.266666666666625}, "ep003": {"nsteps": 500, "reward": -0.9848108924925328, "good_angle": 19.282160890696503, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 15.833333333333318}, "ep004": {"nsteps": 500, "reward": -0.9739089535214008, "good_angle": 15.190353336276354, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.533333333333324}}
good_angle_max52.92531868034771
good_angle_median15.62621214214034
good_angle_min15.118320632022126
reward_max-0.8776559413808863
reward_mean-1.141319175363099
reward_median-0.9848108924925328
reward_min-1.6059184126108883
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max15.833333333333318
valid_direction_median15.133333333333324
valid_direction_min11.333333333333298
No reset possible
284156Anna Tsalapova 🇷🇺Random executionaido1_LF1_r2-v3step1-simulationsuccessyesrudolf-32:01:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
283155Samuel LavoieSolution templateaido1_luck-v3step1successyesrudolf-32:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score122.919715540858448


No reset possible
282154Samuel LavoieSolution templateaido1_luck-v3step1erroryesrudolf-32:00:10
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 376, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job282-9238', 'pull']:

   >  Command '['docker-compose', '-p', 'job282-9238', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
281153Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationfailedyesrudolf-32:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 95, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Cannot interpret feed_dict key as Tensor: Tensor Tensor("x:0", shape=(?, 4608), dtype=float16) is not an element of this graph.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
280152Philippe LacailleSolution templateaido1_luck-v3step1successyesrudolf-32:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score151.26506910353963


No reset possible
277149Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornorudolf-32:00:09
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 376, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job277-1003', 'pull']:

   >  Command '['docker-compose', '-p', 'job277-1003', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
275147Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step2-scoringsuccessyesrudolf-32:01:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean16.613333333333316
good_angle_mean25.771964831069987
valid_direction_mean13.419999999999987


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4797640509775374, "good_angle": 14.712748669384927, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 10.8}, "ep001": {"nsteps": 500, "reward": -1.6860891943555325, "good_angle": 15.418608508629648, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.333333333333323}, "ep002": {"nsteps": 500, "reward": -1.2246707483828068, "good_angle": 67.71875619957684, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.43333333333332}, "ep003": {"nsteps": 500, "reward": -0.9678392139617352, "good_angle": 16.521559095471762, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.49999999999996}, "ep004": {"nsteps": 500, "reward": -0.8558977063894272, "good_angle": 14.488151682286766, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.033333333333324}}
good_angle_max67.71875619957684
good_angle_median15.418608508629648
good_angle_min14.488151682286766
reward_max-0.4797640509775374
reward_mean-1.042852182813408
reward_median-0.9678392139617352
reward_min-1.6860891943555325
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max15.43333333333332
valid_direction_median13.333333333333323
valid_direction_min10.8
No reset possible
273146Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesrudolf-32:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job273-8940', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job273-8940', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
270144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationsuccessnorudolf-32:02:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
268142Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesrudolf-32:00:32
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job268-471', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job268-471', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
267141Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesrudolf-32:01:08
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job267-9626', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job267-9626', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
266140Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r2-v3step1-simulationerroryesrudolf-32:00:09
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 376, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job266-176', 'pull']:

   >  Command '['docker-compose', '-p', 'job266-176', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
263137P PTF-v0aido1_LF1_r2-v3step2-scoringsuccessyesrudolf-32:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median3
survival_time_mean3.0933333333333293
good_angle_mean0.8407460296871907
valid_direction_mean1.0533333333333328


other stats
episodes
details{"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 39, "reward": -27.653480135477505, "good_angle": 0.3311275237464943, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 0.8666666666666668}, "ep004": {"nsteps": 111, "reward": -9.817891989746508, "good_angle": 0.7463608224551561, "survival_time": 1.166666666666667, "traveled_tiles": 5, "valid_direction": 1.7999999999999985}}
good_angle_max2.464011645649803
good_angle_median0.44670148280839816
good_angle_min0.21552867377610185
reward_max-4.432748170956362
reward_mean-14.82167089077248
reward_median-9.817891989746508
reward_min-27.653480135477505
survival_time_max7.899999999999982
survival_time_median1.500000000000001
survival_time_min1.166666666666667
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_min1
valid_direction_max1.7999999999999985
valid_direction_median0.8666666666666668
valid_direction_min0.5333333333333314
No reset possible
262137P PTF-v0aido1_LF1_r2-v3step1-simulationsuccessyesrudolf-32:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
258134Claudio RuchPython templateaido1_amod1-v3step2-scoringsuccessyesrudolf-32:00:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality-7706204.987671282
efficiency-5628170.705479487
fleet_size-1000000000


No reset possible
256134Claudio RuchPython templateaido1_amod1-v3step1-simulationsuccessyesrudolf-32:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
passedtrue
No reset possible
251130Andrea Censi 🇨🇭My labelaido1_luck-v3step1successyesrudolf-32:00:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score164.48880742363615


No reset possible
24874Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step2-scoringerroryesrudolf-32:00:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 390, in run
    run_docker(wd, project, cmd)
  File "/usr/local/lib/python2.7/dist-packages/duckietown_challenges-3.0.36-py2.7.egg/duckietown_challenges/runner.py", line 537, in run_docker
    raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job248-858', 'up', '--abort-on-container-exit']:

   >  Command '['docker-compose', '-p', 'job248-858', 'up', '--abort-on-container-exit']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
23974Andrea Censi 🇨🇭Random executionaido1_LF1_r2-v3step1-simulationsuccessyesrudolf-32:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
238129Andrea Censi 🇨🇭Solution templateaido1_luck-v3step1successyesrudolf-32:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score152.329397958193965


No reset possible