AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 318

evaluator318
ownerAndrea Censi
machinenutonomy-P50
processnutonomy-P50-2570
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success
# timeout
# failed
# error
# aborted166
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6725646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno318----
6721648Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission648'
(hidden)
6718650aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission650'
(hidden)
6715653iban_alexTemplate for ROS Submissionaido1_LF1_r3-v3step3-videosabortedyes3180:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission653'
(hidden)
6712656aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission656'
(hidden)
6709658aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission658'
(hidden)
6706659aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission659'
(hidden)
6702661gunshiTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission661'
(hidden)
6699664ManishTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission664'
(hidden)
6696665aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission665'
(hidden)
6693667JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission667'
(hidden)
6690674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission674/step1-simulation-nutonomy-P50-2570-job6690'
(hidden)
6687678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:05
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission678/step1-simulation-nutonomy-P50-2570-job6687'
(hidden)
6684681Maxim KuzminTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission681/step1-simulation-nutonomy-P50-2570-job6684'
(hidden)
6681683PolyProgrammistRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission683/step1-simulation-nutonomy-P50-2570-job6681'
(hidden)
6678685anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission685/step1-simulation-nutonomy-P50-2570-job6678'
(hidden)
6675688MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission688/step1-simulation-nutonomy-P50-2570-job6675'
(hidden)
6672691MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission691/step1-simulation-nutonomy-P50-2570-job6672'
(hidden)
6669694BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission694'
(hidden)
6666696MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission696'
(hidden)
6663699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission699/step1-simulation-nutonomy-P50-2570-job6663'
(hidden)
6660702BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission702/step1-simulation-nutonomy-P50-2570-job6660'
(hidden)
6657705JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission705/step1-simulation-nutonomy-P50-2570-job6657'
(hidden)
6654708JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission708/step1-simulation-nutonomy-P50-2570-job6654'
(hidden)
6651711BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission711/step1-simulation-nutonomy-P50-2570-job6651'
(hidden)
6648714PolyProgrammistROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission714'
(hidden)
6645717miksazPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission717'
(hidden)
6642721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission721/step2-scoring-nutonomy-P50-2570-job6642'
(hidden)
6639724BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission724/step1-simulation-nutonomy-P50-2570-job6639'
(hidden)
6635728heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission728'
(hidden)
6629730heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission730/step1-simulation-nutonomy-P50-2570-job6629'
(hidden)
6625733heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission733/step1-simulation-nutonomy-P50-2570-job6625'
(hidden)
6621737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission737/step1-simulation-nutonomy-P50-2570-job6621'
(hidden)
6617744heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission744/step1-simulation-nutonomy-P50-2570-job6617'
(hidden)
6612747Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission747'
(hidden)
6609751placailleROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission751/step1-simulation-nutonomy-P50-2570-job6609'
(hidden)
6606753miksazPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission753'
(hidden)
6603756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission756/step1-simulation-nutonomy-P50-2570-job6603'
(hidden)
6600759gunshiBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission759/step1-simulation-nutonomy-P50-2570-job6600'
(hidden)
6597764miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission764/step1-simulation-nutonomy-P50-2570-job6597'
(hidden)
6594768Dzenan LapandicRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission768/step1-simulation-nutonomy-P50-2570-job6594'
(hidden)
6591770sischaefAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission770/step1-simulation-nutonomy-P50-2570-job6591'
(hidden)
6588773AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission773/step1-simulation-nutonomy-P50-2570-job6588'
(hidden)
6585776morraaAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission776/step1-simulation-nutonomy-P50-2570-job6585'
(hidden)
6582777yanberAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission777/step1-simulation-nutonomy-P50-2570-job6582'
(hidden)
6579780AmaurXAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission780/step1-simulation-nutonomy-P50-2570-job6579'
(hidden)
6575783licAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission783/step1-simulation-nutonomy-P50-2570-job6575'
(hidden)
6572786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission786/step1-simulation-nutonomy-P50-2570-job6572'
(hidden)
6569789miksazROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission789/step2-scoring-nutonomy-P50-2570-job6569'
(hidden)
6566796heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission796/step1-simulation-nutonomy-P50-2570-job6566'
(hidden)
6563801placailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission801/step4-viz-nutonomy-P50-2570-job6563'
(hidden)
6560809BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission809/step4-viz-nutonomy-P50-2570-job6560'
(hidden)
6556812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission812/step2-scoring-nutonomy-P50-2570-job6556'
(hidden)
6552814BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission814/step4-viz-nutonomy-P50-2570-job6552'
(hidden)
6549818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6549'
(hidden)
6546820heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission820/step4-viz-nutonomy-P50-2570-job6546'
(hidden)
6543828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission828/step4-viz-nutonomy-P50-2570-job6543'
(hidden)
6538836miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:00:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission836'
(hidden)
6534837miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission837/step1-simulation-nutonomy-P50-2570-job6534'
(hidden)
6529653iban_alexTemplate for ROS Submissionaido1_LF1_r3-v3step3-videosabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission653'
(hidden)
6523644heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission644'
(hidden)
6520647aleksandarpetrROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission647'
(hidden)
6517650aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission650'
(hidden)
6512653iban_alexTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission653'
(hidden)
6509656aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission656'
(hidden)
6506658aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission658'
(hidden)
6503660iban_alexPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission660'
(hidden)
6496664ManishTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission664'
(hidden)
6494666ManishTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission666'
(hidden)
6492667JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission667'
(hidden)
6491668JonJP pipelineaido1_LFV_r1-v3step1-simulationabortedno3180:10:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1055, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 41, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python2.7/shutil.py", line 133, in copy
    copyfile(src, dst)
  File "/usr/lib/python2.7/shutil.py", line 98, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python2.7/shutil.py", line 66, in copyfileobj
    fdst.write(buf)
IOError: [Errno 28] No space left on device
(hidden)
6490672Liam PaullRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6490-6702', 'pull']:

   >  Command '['docker-compose', '-p', 'job6490-6702', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling evaluator ... done

stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob211870072: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob211870072: no space left on device
stderr | 
(hidden)
6489674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:20
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job6489-6602', 'pull']:

   >  Command '['docker-compose', '-p', 'job6489-6602', 'pull']' returned non-zero exit status 1

stdout | 

stderr | Pulling evaluator ...
stderr | Pulling solution  ...
stderr | 
Pulling evaluator ... done

stderr | ERROR: for solution  write /var/lib/docker/tmp/GetImageBlob750880295: no space left on device
stderr | write /var/lib/docker/tmp/GetImageBlob750880295: no space left on device
stderr | 
(hidden)
6486678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission678/step1-simulation-nutonomy-P50-2570-job6486'
(hidden)
6483681Maxim KuzminTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission681/step1-simulation-nutonomy-P50-2570-job6483'
(hidden)
6480684Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission684/step1-simulation-nutonomy-P50-2570-job6480'
(hidden)
6477687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission687/step1-simulation-nutonomy-P50-2570-job6477'
(hidden)
6474690yun chenRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission690/step1-simulation-nutonomy-P50-2570-job6474'
(hidden)
6471693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission693/step1-simulation-nutonomy-P50-2570-job6471'
(hidden)
6468695BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission695/step1-simulation-nutonomy-P50-2570-job6468'
(hidden)
6463720BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission720/step2-scoring-nutonomy-P50-2570-job6463'
(hidden)
6459721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission721/step2-scoring-nutonomy-P50-2570-job6459'
(hidden)
6456701BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission701/step1-simulation-nutonomy-P50-2570-job6456'
(hidden)
6453704JonRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission704/step1-simulation-nutonomy-P50-2570-job6453'
(hidden)
6450707JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission707'
(hidden)
6447709JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission709/step1-simulation-nutonomy-P50-2570-job6447'
(hidden)
6444712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission712/step1-simulation-nutonomy-P50-2570-job6444'
(hidden)
6441789miksazROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission789/step2-scoring-nutonomy-P50-2570-job6441'
(hidden)
6438799Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission799/step4-viz-nutonomy-P50-2570-job6438'
(hidden)
6435808lavoiemsPyTorch DDPG templateaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission808/step4-viz-nutonomy-P50-2570-job6435'
(hidden)
6431814BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission814/step4-viz-nutonomy-P50-2570-job6431'
(hidden)
6428818gunshiROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission818/step4-viz-nutonomy-P50-2570-job6428'
(hidden)
6425820heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3180:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission820/step4-viz-nutonomy-P50-2570-job6425'
(hidden)
6422828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission828/step4-viz-nutonomy-P50-2570-job6422'
(hidden)
6418838miksazRL solutionaido1_LF1_r3-v3step4-vizabortedyes3180:00:03
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission838/step4-viz-nutonomy-P50-2570-job6418'
(hidden)
6415715MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission715/step1-simulation-nutonomy-P50-2570-job6415'
(hidden)
6412719BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission719'
(hidden)
6407782zjdongAMOD18-AIDO not that random executionaido1_LF1_r3-v3step2-scoringabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission782/step2-scoring-nutonomy-P50-2570-job6407'
(hidden)
6404725JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission725'
(hidden)
6401728heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission728'
(hidden)
6398731heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission731/step1-simulation-nutonomy-P50-2570-job6398'
(hidden)
6395734heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission734'
(hidden)
6391742placailleROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission742/step1-simulation-nutonomy-P50-2570-job6391'
(hidden)
6388745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission745/step1-simulation-nutonomy-P50-2570-job6388'
(hidden)
6385748VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission748/step1-simulation-nutonomy-P50-2570-job6385'
(hidden)
6382752miksazPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission752'
(hidden)
6379754miksazPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission754'
(hidden)
6376756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission756/step1-simulation-nutonomy-P50-2570-job6376'
(hidden)
6373759gunshiBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission759/step1-simulation-nutonomy-P50-2570-job6373'
(hidden)
6370762miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission762/step1-simulation-nutonomy-P50-2570-job6370'
(hidden)
6366767Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission767'
(hidden)
6363770sischaefAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission770/step1-simulation-nutonomy-P50-2570-job6363'
(hidden)
6360772tomaszfAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission772/step1-simulation-nutonomy-P50-2570-job6360'
(hidden)
6357774Gianmarco Bernasconi Not Random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission774/step1-simulation-nutonomy-P50-2570-job6357'
(hidden)
6354765Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission765/step1-simulation-nutonomy-P50-2570-job6354'
(hidden)
6351778morraaAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission778/step1-simulation-nutonomy-P50-2570-job6351'
(hidden)
6348781amuniAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission781/step1-simulation-nutonomy-P50-2570-job6348'
(hidden)
6344792EdwardRandom executionaido1_LF1_r3-v3step3-videosabortedyes3180:00:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission792/step3-videos-nutonomy-P50-2570-job6344'
(hidden)
6341784haliangRandom executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission784/step1-simulation-nutonomy-P50-2570-job6341'
(hidden)
6338786martatintoreAMOD18-AIDO not that random executionaido1_LF1_r3-v3step1-simulationabortedno3180:00:00
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 353, in go_
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 28] No space left on device: '/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission786/step1-simulation-nutonomy-P50-2570-job6338'
(hidden)
6329794ManishAMOD18-AIDOaido1_LF1_r3-v3step1-simulationabortedno3180:01:54
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 375, in go_
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 903, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1055, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 41, in copy_to_cache
    shutil.copy(fn, have)
  File "/usr/lib/python2.7/shutil.py", line 133, in copy
    copyfile(src, dst)
  File "/usr/lib/python2.7/shutil.py", line 98, in copyfile
    copyfileobj(fsrc, fdst)
  File "/usr/lib/python2.7/shutil.py", line 66, in copyfileobj
    fdst.write(buf)
IOError: [Errno 28] No space left on device
(hidden)
6318828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedno3180:03:31(hidden)
driven_lanedir_median0.9254114232955112
deviation-center-line_median0.34716424712786537
in-drivable-lane_median0.2


other stats
deviation-center-line_max1.4167685615608725
deviation-center-line_mean0.6332457878653415
deviation-center-line_min0.0728620434723302
deviation-heading_max2.731182472816557
deviation-heading_mean1.314007592837785
deviation-heading_median1.4394916067662242
deviation-heading_min0.09593500972904843
driven_any_max4.512333507014194
driven_any_mean2.0907660367665906
driven_any_median1.362663024328915
driven_any_min0.2571904948121044
driven_lanedir_max4.448021372437546
driven_lanedir_mean1.707298215991483
driven_lanedir_min0.137365457108935
in-drivable-lane_max5.333333333333315
in-drivable-lane_mean1.2733333333333292
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.34265080352176447, "driven_lanedir": 0.137365457108935, "in-drivable-lane": 0.2, "deviation-heading": 0.7207526804880232, "deviation-center-line": 0.0728620434723302}, "ep001": {"driven_any": 0.2571904948121044, "driven_lanedir": 0.255497838621745, "in-drivable-lane": 0, "deviation-heading": 0.09593500972904843, "deviation-center-line": 0.0943673732710655}, "ep002": {"driven_any": 1.362663024328915, "driven_lanedir": 0.9254114232955112, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 1.4394916067662242, "deviation-center-line": 0.34716424712786537}, "ep003": {"driven_any": 3.978992354155975, "driven_lanedir": 2.7701949884936763, "in-drivable-lane": 5.333333333333315, "deviation-heading": 1.5826761943890724, "deviation-center-line": 1.235066713894574}, "ep004": {"driven_any": 4.512333507014194, "driven_lanedir": 4.448021372437546, "in-drivable-lane": 0, "deviation-heading": 2.731182472816557, "deviation-center-line": 1.4167685615608725}}
6312828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videosabortedyes3180:02:13(hidden)
other stats
videos1
6311828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedyes3180:00:21(hidden)
survival_time_median4.533333333333327


other stats
episodes
details{"ep000": {"nsteps": 28, "reward": -35.95489456695005, "good_angle": 0.4474365311684229, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.7999999999999998}, "ep001": {"nsteps": 27, "reward": -37.58797682435424, "good_angle": 0.013797535801493337, "survival_time": 0.8999999999999999, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 136, "reward": -7.685723551299067, "good_angle": 1.0357336127767165, "survival_time": 4.533333333333327, "traveled_tiles": 4, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 425, "reward": -2.8963668297077803, "good_angle": 1.4731832241115148, "survival_time": 14.166666666666629, "traveled_tiles": 8, "valid_direction": 2.966666666666656}, "ep004": {"nsteps": 500, "reward": -0.13921915099327453, "good_angle": 26.444442034394378, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 4.499999999999984}}
good_angle_max26.444442034394378
good_angle_mean5.882918587650505
good_angle_median1.0357336127767165
good_angle_min0.013797535801493337
reward_max-0.13921915099327453
reward_mean-16.85283618466088
reward_median-7.685723551299067
reward_min-37.58797682435424
survival_time_max16.666666666666654
survival_time_mean7.439999999999989
survival_time_min0.8999999999999999
traveled_tiles_max9
traveled_tiles_mean4.6
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max4.499999999999984
valid_direction_mean2.073333333333326
valid_direction_median2.0999999999999925
valid_direction_min0
6288828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:09:03(hidden)
other stats
simulation-passed1
6284810BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedyes3180:00:45(hidden)
other stats
videos1
6282810BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedyes3180:00:20(hidden)
survival_time_median0.7


other stats
episodes
details{"ep000": {"nsteps": 42, "reward": -23.99286168647398, "good_angle": 0.2125775826482476, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.4333333333333338}, "ep001": {"nsteps": 14, "reward": -71.85991205700806, "good_angle": 0.12703223800543678, "survival_time": 0.4666666666666666, "traveled_tiles": 2, "valid_direction": 0.2}, "ep002": {"nsteps": 15, "reward": -67.00759186247984, "good_angle": 0.033803326662617234, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0.1333333333333333}, "ep003": {"nsteps": 189, "reward": -5.513996925004191, "good_angle": 7.076802960699993, "survival_time": 6.299999999999987, "traveled_tiles": 8, "valid_direction": 1.7999999999999952}, "ep004": {"nsteps": 21, "reward": -48.10421071095126, "good_angle": 0.03686900364699356, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.1}}
good_angle_max7.076802960699993
good_angle_mean1.4974170223326575
good_angle_median0.12703223800543678
good_angle_min0.033803326662617234
reward_max-5.513996925004191
reward_mean-43.295714648383466
reward_median-48.10421071095126
reward_min-71.85991205700806
survival_time_max6.299999999999987
survival_time_mean1.8733333333333309
survival_time_min0.4666666666666666
traveled_tiles_max8
traveled_tiles_mean3
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7999999999999952
valid_direction_mean0.5333333333333324
valid_direction_median0.2
valid_direction_min0.1
6273810BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:02:39(hidden)
other stats
simulation-passed1
6263833orlando.m.bol@gmail.comBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationabortedno3180:02:12
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
(hidden)
6255817Gianmarco Bernasconi ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:03:10(hidden)
other stats
simulation-passed1
6243821heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedno3180:06:31(hidden)
driven_lanedir_median1.1677331265841218
deviation-center-line_median0.21369449920758316
in-drivable-lane_median0


other stats
deviation-center-line_max1.464411830780586
deviation-center-line_mean0.4563088753418883
deviation-center-line_min0.14607759722589408
deviation-heading_max3.4927926401690663
deviation-heading_mean1.2063914448630155
deviation-heading_median1.058876716298759
deviation-heading_min0.09639253705307378
driven_any_max4.602452585926608
driven_any_mean1.6442723429191433
driven_any_median1.1704445826380951
driven_any_min0.40884157584142633
driven_lanedir_max4.490264233223098
driven_lanedir_mean1.5726566807857558
driven_lanedir_min0.4075578251135321
in-drivable-lane_max0.633333333333334
in-drivable-lane_mean0.1266666666666668
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.6526231909238541, "driven_lanedir": 0.4609044611207218, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.058876716298759, "deviation-center-line": 0.21369449920758316}, "ep001": {"driven_any": 0.40884157584142633, "driven_lanedir": 0.4075578251135321, "in-drivable-lane": 0, "deviation-heading": 0.09639253705307378, "deviation-center-line": 0.14607759722589408}, "ep002": {"driven_any": 1.3869997792657325, "driven_lanedir": 1.3368237578873048, "in-drivable-lane": 0, "deviation-heading": 1.212248936259134, "deviation-center-line": 0.2647632241426425}, "ep003": {"driven_any": 1.1704445826380951, "driven_lanedir": 1.1677331265841218, "in-drivable-lane": 0, "deviation-heading": 0.17164639453504657, "deviation-center-line": 0.19259722535273616}, "ep004": {"driven_any": 4.602452585926608, "driven_lanedir": 4.490264233223098, "in-drivable-lane": 0, "deviation-heading": 3.4927926401690663, "deviation-center-line": 1.464411830780586}}
6236820heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:05:10(hidden)
other stats
simulation-passed1
6234822heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 356, in load
    f = open(f, 'rb')
IOError: [Errno 2] No such file or directory: '/workspace/models/weights/mml2_d_28_178000.pth.pth'


(hidden)
6232824heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 31, in init_model
    use_lstm=self.config.get("use_lstm", False)).to(self.device)
TypeError: __init__() got an unexpected keyword argument 'use_lstm'


(hidden)
6225830heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:10:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
6221832heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:31:05(hidden)
6218834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno3180:31:37(hidden)
6210839miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:01:26(hidden)
other stats
simulation-passed1
6201832heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:35:14(hidden)
6200832heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:37:21(hidden)
6197834lavoiemsYoung Dukeaido1_LF1_r3-v3step1-simulationabortedno3180:43:34(hidden)
6174838miksazRL solutionaido1_LF1_r3-v3step2-scoringabortedyes3180:33:54(hidden)
6160838miksazRL solutionaido1_LF1_r3-v3step1-simulationabortedno3180:01:28(hidden)
other stats
simulation-passed1
6151839miksazRL solutionaido1_LF1_r3-v3step3-videosabortedno3180:01:21(hidden)
other stats
videos1
6147839miksazRL solutionaido1_LF1_r3-v3step2-scoringabortedno3180:00:21(hidden)
survival_time_median6.899999999999985


other stats
episodes
details{"ep000": {"nsteps": 164, "reward": -6.705390841313979, "good_angle": 4.762022619145479, "survival_time": 5.466666666666657, "traveled_tiles": 1, "valid_direction": 4.5666666666666575}, "ep001": {"nsteps": 207, "reward": -5.820953307106443, "good_angle": 10.028977853210447, "survival_time": 6.899999999999985, "traveled_tiles": 1, "valid_direction": 5.999999999999986}, "ep002": {"nsteps": 90, "reward": -11.26712071566532, "good_angle": 0.855300465475497, "survival_time": 2.999999999999999, "traveled_tiles": 2, "valid_direction": 2.0333333333333323}, "ep003": {"nsteps": 330, "reward": -3.767540347289336, "good_angle": 7.093201338622533, "survival_time": 10.999999999999972, "traveled_tiles": 1, "valid_direction": 8.13333333333331}, "ep004": {"nsteps": 302, "reward": -4.224530833164255, "good_angle": 6.723103235107182, "survival_time": 10.066666666666642, "traveled_tiles": 1, "valid_direction": 7.366666666666647}}
good_angle_max10.028977853210447
good_angle_mean5.8925211023122275
good_angle_median6.723103235107182
good_angle_min0.855300465475497
reward_max-3.767540347289336
reward_mean-6.357107208907867
reward_median-5.820953307106443
reward_min-11.26712071566532
survival_time_max10.999999999999972
survival_time_mean7.28666666666665
survival_time_min2.999999999999999
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max8.13333333333331
valid_direction_mean5.619999999999986
valid_direction_median5.999999999999986
valid_direction_min2.0333333333333323
6139838miksazRL solutionaido1_LF1_r3-v3step2-scoringabortedno3180:02:32(hidden)
survival_time_median5.966666666666655


other stats
episodes
details{"ep000": {"nsteps": 148, "reward": -7.326902210097713, "good_angle": 3.8513875373206266, "survival_time": 4.933333333333326, "traveled_tiles": 1, "valid_direction": 3.999999999999992}, "ep001": {"nsteps": 179, "reward": -6.233594004814019, "good_angle": 8.24345295673754, "survival_time": 5.966666666666655, "traveled_tiles": 1, "valid_direction": 5.199999999999989}, "ep002": {"nsteps": 88, "reward": -11.529293883570723, "good_angle": 0.7052056161783535, "survival_time": 2.9333333333333327, "traveled_tiles": 2, "valid_direction": 1.8}, "ep003": {"nsteps": 327, "reward": -3.7954779892493415, "good_angle": 7.017368372635797, "survival_time": 10.899999999999972, "traveled_tiles": 1, "valid_direction": 7.933333333333311}, "ep004": {"nsteps": 309, "reward": -4.145339975521212, "good_angle": 6.583917946858259, "survival_time": 10.299999999999974, "traveled_tiles": 1, "valid_direction": 7.59999999999998}}
good_angle_max8.24345295673754
good_angle_mean5.280266485946115
good_angle_median6.583917946858259
good_angle_min0.7052056161783535
reward_max-3.7954779892493415
reward_mean-6.606121612650601
reward_median-6.233594004814019
reward_min-11.529293883570723
survival_time_max10.899999999999972
survival_time_mean7.006666666666652
survival_time_min2.9333333333333327
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max7.933333333333311
valid_direction_mean5.306666666666655
valid_direction_median5.199999999999989
valid_direction_min1.8
6128834lavoiemsYoung Dukeaido1_LF1_r3-v3step4-vizabortedno3180:02:23(hidden)
other stats
videos1
6123834lavoiemsYoung Dukeaido1_LF1_r3-v3step2-scoringabortedno3180:00:19(hidden)
survival_time_median11.733333333333302


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.934439358700599, "good_angle": 19.888117786020445, "survival_time": 5.59999999999999, "traveled_tiles": 6, "valid_direction": 3.099999999999997}, "ep001": {"nsteps": 242, "reward": -5.63131987395858, "good_angle": 18.727965412663018, "survival_time": 8.066666666666649, "traveled_tiles": 7, "valid_direction": 3.4666666666666552}, "ep002": {"nsteps": 500, "reward": -0.5593890390801244, "good_angle": 2.5609619856563275, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.9666666666666455}, "ep003": {"nsteps": 352, "reward": -5.00258318618448, "good_angle": 36.28035911926448, "survival_time": 11.733333333333302, "traveled_tiles": 10, "valid_direction": 4.966666666666652}, "ep004": {"nsteps": 500, "reward": -0.8166006759773009, "good_angle": 2.5717428190104616, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.5333333333333155}}
good_angle_max36.28035911926448
good_angle_mean16.005829424522947
good_angle_median18.727965412663018
good_angle_min2.5609619856563275
reward_max-0.5593890390801244
reward_mean-3.988866426780217
reward_median-5.00258318618448
reward_min-7.934439358700599
survival_time_max16.666666666666654
survival_time_mean11.74666666666665
survival_time_min5.59999999999999
traveled_tiles_max13
traveled_tiles_mean9.8
traveled_tiles_median10
traveled_tiles_min6
valid_direction_max5.9666666666666455
valid_direction_mean4.606666666666653
valid_direction_median4.966666666666652
valid_direction_min3.099999999999997
6103828heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedno3180:00:19(hidden)
survival_time_median10.533333333333308


other stats
episodes
details{"ep000": {"nsteps": 235, "reward": -4.686489805744149, "good_angle": 16.581324771165296, "survival_time": 7.833333333333315, "traveled_tiles": 5, "valid_direction": 3.399999999999994}, "ep001": {"nsteps": 316, "reward": -3.551720138605687, "good_angle": 14.5595987074719, "survival_time": 10.533333333333308, "traveled_tiles": 5, "valid_direction": 3.7999999999999874}, "ep002": {"nsteps": 449, "reward": -2.8138463129590208, "good_angle": 1.4849135792931378, "survival_time": 14.966666666666624, "traveled_tiles": 9, "valid_direction": 3.0333333333333226}, "ep003": {"nsteps": 484, "reward": -2.935699830079944, "good_angle": 46.30386110351722, "survival_time": 16.133333333333294, "traveled_tiles": 8, "valid_direction": 7.099999999999982}, "ep004": {"nsteps": 196, "reward": -7.483443850461318, "good_angle": 4.736916652604615, "survival_time": 6.53333333333332, "traveled_tiles": 3, "valid_direction": 2.766666666666657}}
good_angle_max46.30386110351722
good_angle_mean16.733322962810437
good_angle_median14.5595987074719
good_angle_min1.4849135792931378
reward_max-2.8138463129590208
reward_mean-4.294239987570023
reward_median-3.551720138605687
reward_min-7.483443850461318
survival_time_max16.133333333333294
survival_time_mean11.19999999999997
survival_time_min6.53333333333332
traveled_tiles_max9
traveled_tiles_mean6
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max7.099999999999982
valid_direction_mean4.019999999999989
valid_direction_median3.399999999999994
valid_direction_min2.766666666666657
6097827heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:10:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
(hidden)
6092826heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:09:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 82, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 79, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)
6082822heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 64, in solve
    model = Model(config_name=config_name, config=config)
  File "/workspace/model.py", line 15, in __init__
    self.init_model(config_name)
  File "/workspace/model.py", line 45, in init_model
    map_location=self.device))
  File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 356, in load
    f = open(f, 'rb')
IOError: [Errno 2] No such file or directory: '/workspace/models/weights/mml2_d_28_178000.pth.pth'


(hidden)
6079821heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step4-vizabortedno3180:01:58(hidden)
other stats
videos1
6076820heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step3-videosabortedno3180:01:48(hidden)
other stats
videos1
6070821heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step2-scoringabortedno3180:02:08(hidden)
survival_time_median8.566666666666647


other stats
episodes
details{"ep000": {"nsteps": 257, "reward": -4.378372870136509, "good_angle": 23.922353620219457, "survival_time": 8.566666666666647, "traveled_tiles": 4, "valid_direction": 3.7999999999999936}, "ep001": {"nsteps": 339, "reward": -3.4165047393585652, "good_angle": 29.73258777467919, "survival_time": 11.29999999999997, "traveled_tiles": 6, "valid_direction": 4.66666666666665}, "ep002": {"nsteps": 99, "reward": -10.13124891556329, "good_angle": 0.07467375246629761, "survival_time": 3.299999999999998, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 470, "reward": -2.4095897665413273, "good_angle": 15.688016218271525, "survival_time": 15.666666666666622, "traveled_tiles": 8, "valid_direction": 5.59999999999998}, "ep004": {"nsteps": 157, "reward": -7.765255263526064, "good_angle": 1.1790963587830048, "survival_time": 5.2333333333333245, "traveled_tiles": 4, "valid_direction": 1.8999999999999932}}
good_angle_max29.73258777467919
good_angle_mean14.119345544883894
good_angle_median15.688016218271525
good_angle_min0.07467375246629761
reward_max-2.4095897665413273
reward_mean-5.620194311025151
reward_median-4.378372870136509
reward_min-10.13124891556329
survival_time_max15.666666666666622
survival_time_mean8.813333333333313
survival_time_min3.299999999999998
traveled_tiles_max8
traveled_tiles_mean5
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max5.59999999999998
valid_direction_mean3.1933333333333236
valid_direction_median3.7999999999999936
valid_direction_min0
6062819lavoiemsBaby Dukeaido1_LF1_r3-v3step3-videosabortedno3180:00:54(hidden)
other stats
videos1
6053817Gianmarco Bernasconi ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedno3180:00:21(hidden)
survival_time_median13.866666666666628


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5271342291501351, "good_angle": 28.375124631925857, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.500000000000013}, "ep001": {"nsteps": 416, "reward": -2.8618602274879006, "good_angle": 10.793463613983889, "survival_time": 13.866666666666628, "traveled_tiles": 4, "valid_direction": 2.6999999999999904}, "ep002": {"nsteps": 95, "reward": -10.577229988271077, "good_angle": 1.5328071373636516, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 1.9999999999999964}, "ep003": {"nsteps": 278, "reward": -4.337046965688682, "good_angle": 14.067661143396233, "survival_time": 9.266666666666644, "traveled_tiles": 4, "valid_direction": 3.1999999999999895}, "ep004": {"nsteps": 500, "reward": -0.7766856929473579, "good_angle": 2.7667902721633477, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.033333333333319}}
good_angle_max28.375124631925857
good_angle_mean11.507169359766596
good_angle_median10.793463613983889
good_angle_min1.5328071373636516
reward_max-0.5271342291501351
reward_mean-3.81599142070903
reward_median-2.8618602274879006
reward_min-10.577229988271077
survival_time_max16.666666666666654
survival_time_mean11.926666666666648
survival_time_min3.166666666666665
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max6.500000000000013
valid_direction_mean4.086666666666662
valid_direction_median3.1999999999999895
valid_direction_min1.9999999999999964
6046814BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videosabortedno3180:02:27(hidden)
other stats
videos1
6022812BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationabortedno3180:13:26(hidden)
other stats
simulation-passed1
6020810BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedno3180:02:16(hidden)
other stats
videos1
6015810BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedno3180:00:20(hidden)
survival_time_median7.899999999999982


other stats
episodes
details{"ep000": {"nsteps": 186, "reward": -5.766371471746024, "good_angle": 11.214088792760116, "survival_time": 6.199999999999988, "traveled_tiles": 9, "valid_direction": 2.699999999999994}, "ep001": {"nsteps": 237, "reward": -4.633788709269388, "good_angle": 11.790978921687044, "survival_time": 7.899999999999982, "traveled_tiles": 10, "valid_direction": 2.5333333333333248}, "ep002": {"nsteps": 387, "reward": -3.1374980180308607, "good_angle": 1.3268066956970153, "survival_time": 12.899999999999965, "traveled_tiles": 16, "valid_direction": 3.066666666666656}, "ep003": {"nsteps": 57, "reward": -18.292969914904813, "good_angle": 3.309950780573108, "survival_time": 1.9000000000000024, "traveled_tiles": 4, "valid_direction": 0.9333333333333356}, "ep004": {"nsteps": 500, "reward": -0.6528214802772564, "good_angle": 1.4930295370101463, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.2333333333333267}}
good_angle_max11.790978921687044
good_angle_mean5.826970945545486
good_angle_median3.309950780573108
good_angle_min1.3268066956970153
reward_max-0.6528214802772564
reward_mean-6.496689918845668
reward_median-4.633788709269388
reward_min-18.292969914904813
survival_time_max16.666666666666654
survival_time_mean9.11333333333332
survival_time_min1.9000000000000024
traveled_tiles_max18
traveled_tiles_mean11.4
traveled_tiles_median10
traveled_tiles_min4
valid_direction_max3.2333333333333267
valid_direction_mean2.4933333333333274
valid_direction_median2.699999999999994
valid_direction_min0.9333333333333356
6001808lavoiemsPyTorch DDPG templateaido1_LF1_r3-v3step4-vizabortedno3180:01:59(hidden)
other stats
videos1
5991807JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno3180:02:14(hidden)
other stats
videos1
5984807JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno3180:06:57(hidden)
other stats
simulation-passed1
5980806Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringabortedno3180:02:40(hidden)
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5332078231436899, "good_angle": 28.61857924034673, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.833333333333346}, "ep001": {"nsteps": 500, "reward": -0.3106807243460789, "good_angle": 18.14611609257736, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.3333333333333215}, "ep002": {"nsteps": 500, "reward": -0.3855096261203289, "good_angle": 0.04511176152884631, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 257, "reward": -4.610536862788034, "good_angle": 7.57021824499129, "survival_time": 8.566666666666647, "traveled_tiles": 4, "valid_direction": 2.8666666666666583}, "ep004": {"nsteps": 500, "reward": -0.7826309668896719, "good_angle": 2.6838292526119356, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.733333333333319}}
good_angle_max28.61857924034673
good_angle_mean11.41277091841123
good_angle_median7.57021824499129
good_angle_min0.04511176152884631
reward_max-0.3106807243460789
reward_mean-1.3245132006575606
reward_median-0.5332078231436899
reward_min-4.610536862788034
survival_time_max16.666666666666654
survival_time_mean15.046666666666653
survival_time_min8.566666666666647
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.833333333333346
valid_direction_mean3.753333333333329
valid_direction_median3.3333333333333215
valid_direction_min0
5975805heyt0nySAIC MOSCOW MMLaido1_LF1_r3-v3step1-simulationabortedno3180:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 118, in run
    solve(params, cis)
  File "solution.py", line 83, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/wrappers.py", line 89, in step
    ob, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


(hidden)