Duckietown Challenges Home Challenges Submissions

Evaluator 231

ID231
evaluatornutonomy-P50-5611
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-5611
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success20 2895
# timeout91 3197
# failed7 2889
# error16 2884
# aborted2 2904
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3837372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step2-scoringtimeoutnonutonomy-P50-56110:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3618372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3609378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3606372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3597378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3593375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3590372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3587374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3582378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3578375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3576372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3572374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3568376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3565378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3559375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3557372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3553374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3550376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3546378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3542375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3537372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3533374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3530376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3528378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3524375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3520372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3513374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3510376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3506378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3505375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3500372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3494376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3489378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3488375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3484372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3481377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3469378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3467375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3464372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3461372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3457377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3456377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3455376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3452376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3449375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3446375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3445372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3444372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3442377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3439377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3436376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3434376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3361374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3351375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3349372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3344374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3342375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3336374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3335374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3333375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3331375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3329372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3327372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3325374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3324374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3321375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3319375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3317372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3313374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3312374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3307375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3303372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3301374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3300374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3295372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3285374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3281372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3277374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3274372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3271374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3268372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3263374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3260372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3250374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3249372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3245374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3236372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3234374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3228372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3225373Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:30
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission373/step1-simulation-nutonomy-P50-5611-job3225/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3202372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3197373Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-56110:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3167369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-56110:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3164371Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3154368Samuel LavoieRandom executionaido1_LF1_r2-v3step2-scoringsuccessyesnutonomy-P50-56110:01:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean18.911675225495497
valid_direction_mean11.279999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7512239266037941, "good_angle": 8.260605680285597, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 10.2}, "ep001": {"nsteps": 500, "reward": -1.276089951992035, "good_angle": 7.052116926454453, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.2}, "ep002": {"nsteps": 500, "reward": -1.0573792276978493, "good_angle": 67.40908496229231, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.266666666666652}, "ep003": {"nsteps": 500, "reward": -1.2037676911354065, "good_angle": 5.522359020361451, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.033333333333308}, "ep004": {"nsteps": 500, "reward": -0.9564020457863808, "good_angle": 6.314209538083673, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 9.700000000000005}}
good_angle_max67.40908496229231
good_angle_median7.052116926454453
good_angle_min5.522359020361451
reward_max-0.7512239266037941
reward_mean-1.048972568643093
reward_median-1.0573792276978493
reward_min-1.276089951992035
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max15.266666666666652
valid_direction_median10.2
valid_direction_min9.700000000000005
No reset possible
3125360Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-56110:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3083281Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:10:26
Timeout: Waited 601 [...]
Timeout:

Waited 601.79343605 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3062337Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:10:27
Timeout: Waited 601 [...]
Timeout:

Waited 601.819447041 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3051316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:02:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3050317Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission317/step1-simulation-nutonomy-P50-5611-job3050/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3049318Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3044324Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:02:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 40, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3042349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-56110:01:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3040349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-56110:00:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3038349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-56110:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.833333333333326


other stats
episodes
details{"ep000": {"nsteps": 145, "reward": -9.140103597065496, "good_angle": 16.64573076529853, "survival_time": 4.833333333333326, "traveled_tiles": 2, "valid_direction": 3.2333333333333245}, "ep001": {"nsteps": 138, "reward": -9.13596139524294, "good_angle": 0.6937085891205855, "survival_time": 4.599999999999993, "traveled_tiles": 2, "valid_direction": 2.8666666666666583}, "ep002": {"nsteps": 177, "reward": -5.712457708254099, "good_angle": 0.26088848628937233, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 242, "reward": -6.353195229837717, "good_angle": 24.90592660103627, "survival_time": 8.066666666666649, "traveled_tiles": 3, "valid_direction": 3.699999999999988}, "ep004": {"nsteps": 57, "reward": -20.155828651629, "good_angle": 0.22490921300714076, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.9000000000000027}}
good_angle_max24.90592660103627
good_angle_mean8.54623273095038
good_angle_median0.6937085891205855
good_angle_min0.22490921300714076
reward_max-5.712457708254099
reward_mean-10.09950931640585
reward_median-9.13596139524294
reward_min-20.155828651629
survival_time_max8.066666666666649
survival_time_mean5.059999999999992
survival_time_min1.9000000000000024
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.699999999999988
valid_direction_mean2.1399999999999944
valid_direction_median2.8666666666666583
valid_direction_min0
No reset possible
3024349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-56110:02:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
3013166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step1-simulationabortednonutonomy-P50-56110:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3009333Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-56110:01:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3003333Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-56110:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3000333Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-56110:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.166666666666651


other stats
episodes
details{"ep000": {"nsteps": 49, "reward": -21.013977104645907, "good_angle": 3.1363606392236787, "survival_time": 1.633333333333335, "traveled_tiles": 3, "valid_direction": 1.2666666666666684}, "ep001": {"nsteps": 122, "reward": -8.268821754410755, "good_angle": 0.5527441703687996, "survival_time": 4.066666666666662, "traveled_tiles": 2, "valid_direction": 0.8999999999999978}, "ep002": {"nsteps": 500, "reward": 0.054930976391846346, "good_angle": 0.4941867446231046, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.1333333333333293}, "ep003": {"nsteps": 215, "reward": -4.849887623503631, "good_angle": 5.355869516405512, "survival_time": 7.166666666666651, "traveled_tiles": 5, "valid_direction": 2.76666666666666}, "ep004": {"nsteps": 500, "reward": 0.03539378764200956, "good_angle": 1.3090289511173765, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 1.8999999999999964}}
good_angle_max5.355869516405512
good_angle_mean2.169638004347694
good_angle_median1.3090289511173765
good_angle_min0.4941867446231046
reward_max0.054930976391846346
reward_mean-6.808472343705287
reward_median-4.849887623503631
reward_min-21.013977104645907
survival_time_max16.666666666666654
survival_time_mean9.239999999999991
survival_time_min1.633333333333335
traveled_tiles_max11
traveled_tiles_mean6.2
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max2.76666666666666
valid_direction_mean1.5933333333333306
valid_direction_median1.2666666666666684
valid_direction_min0.8999999999999978
No reset possible
2987333Andrea Censi 🇨🇭Tensorflow templateaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-56110:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2985353Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:29
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission353/step1-simulation-nutonomy-P50-5611-job2985/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2983351Pravish Sainath 🇨🇦Solution templateaido1_luck-v3step1successyesnutonomy-P50-56110:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
score129.665075642597373


No reset possible
2977349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-56110:04:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.266666666666658


other stats
episodes
details{"ep000": {"nsteps": 145, "reward": -9.787529626385918, "good_angle": 16.667532726137505, "survival_time": 4.833333333333326, "traveled_tiles": 2, "valid_direction": 3.5666666666666584}, "ep001": {"nsteps": 158, "reward": -8.145741096403025, "good_angle": 0.5876391913007364, "survival_time": 5.266666666666658, "traveled_tiles": 2, "valid_direction": 2.466666666666659}, "ep002": {"nsteps": 176, "reward": -5.758236630795926, "good_angle": 0.26699629838908134, "survival_time": 5.866666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 245, "reward": -6.363682055473328, "good_angle": 24.806364508871205, "survival_time": 8.166666666666648, "traveled_tiles": 3, "valid_direction": 3.6333333333333218}, "ep004": {"nsteps": 64, "reward": -18.2832722812891, "good_angle": 0.19901200366608143, "survival_time": 2.1333333333333355, "traveled_tiles": 2, "valid_direction": 0.7333333333333347}}
good_angle_max24.806364508871205
good_angle_mean8.505508945672922
good_angle_median0.5876391913007364
good_angle_min0.19901200366608143
reward_max-5.758236630795926
reward_mean-9.66769233806946
reward_median-8.145741096403025
reward_min-18.2832722812891
survival_time_max8.166666666666648
survival_time_mean5.253333333333325
survival_time_min2.1333333333333355
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.6333333333333218
valid_direction_mean2.0799999999999947
valid_direction_median2.466666666666659
valid_direction_min0
No reset possible
2974346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessnonutonomy-P50-56110:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2970346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-56110:02:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.500000000000001


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -14.334179728428524, "good_angle": 5.501256831651871, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 1.7666666666666675}, "ep001": {"nsteps": 76, "reward": -14.7360854501787, "good_angle": 1.242759194817416, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 1.800000000000001}, "ep002": {"nsteps": 89, "reward": -12.475425450068512, "good_angle": 1.68633432212303, "survival_time": 2.966666666666666, "traveled_tiles": 2, "valid_direction": 2.066666666666666}, "ep003": {"nsteps": 63, "reward": -17.92272880909935, "good_angle": 0.7645386987529875, "survival_time": 2.1000000000000023, "traveled_tiles": 2, "valid_direction": 1.4333333333333356}, "ep004": {"nsteps": 48, "reward": -23.43614997466405, "good_angle": 0.35779319893925954, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.933333333333335}}
good_angle_max5.501256831651871
good_angle_mean1.9105364492569128
good_angle_median1.242759194817416
good_angle_min0.35779319893925954
reward_max-12.475425450068512
reward_mean-16.580913882487827
reward_median-14.7360854501787
reward_min-23.43614997466405
survival_time_max2.966666666666666
survival_time_mean2.3400000000000007
survival_time_min1.6000000000000016
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.066666666666666
valid_direction_mean1.600000000000001
valid_direction_median1.7666666666666675
valid_direction_min0.933333333333335
No reset possible
2967343Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission343/step1-simulation-nutonomy-P50-5611-job2967/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2957341Claudio RuchJava templateaido1_amod1-v3step1-simulationerroryesnutonomy-P50-56110:10:29
Timeout: Waited 601 [...]
Timeout:

Waited 601.765169144 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2933339Claudio RuchJava templateaido1_amod1-v3step1-simulationerroryesnutonomy-P50-56110:10:28
Timeout: Waited 601 [...]
Timeout:

Waited 601.641220093 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2932275Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission275/step1-simulation-nutonomy-P50-5611-job2932/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2931276Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission276/step1-simulation-nutonomy-P50-5611-job2931/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2930277Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission277/step1-simulation-nutonomy-P50-5611-job2930/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2929278Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission278/step1-simulation-nutonomy-P50-5611-job2929/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2928279Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission279/step1-simulation-nutonomy-P50-5611-job2928/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2927336Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step4-vizsuccessnonutonomy-P50-56110:01:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2924336Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step3-videossuccessnonutonomy-P50-56110:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
2922336Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step2-scoringsuccessnonutonomy-P50-56110:00:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.833333333333326


other stats
episodes
details{"ep000": {"nsteps": 184, "reward": -5.532437388670034, "good_angle": 6.684131509919067, "survival_time": 6.133333333333321, "traveled_tiles": 6, "valid_direction": 2.933333333333332}, "ep001": {"nsteps": 106, "reward": -9.665434135018655, "good_angle": 0.1770304077781541, "survival_time": 3.5333333333333306, "traveled_tiles": 2, "valid_direction": 0.466666666666665}, "ep002": {"nsteps": 243, "reward": -4.320148546278972, "good_angle": 0.5900323336977648, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 56, "reward": -18.574199175728214, "good_angle": 0.928847411588894, "survival_time": 1.8666666666666691, "traveled_tiles": 3, "valid_direction": 1.3666666666666685}, "ep004": {"nsteps": 145, "reward": -7.1845453544413465, "good_angle": 0.2878862142878547, "survival_time": 4.833333333333326, "traveled_tiles": 4, "valid_direction": 0.8999999999999999}}
good_angle_max6.684131509919067
good_angle_mean1.733585575454347
good_angle_median0.5900323336977648
good_angle_min0.1770304077781541
reward_max-4.320148546278972
reward_mean-9.055352920027444
reward_median-7.1845453544413465
reward_min-18.574199175728214
survival_time_max8.099999999999982
survival_time_mean4.8933333333333255
survival_time_min1.8666666666666691
traveled_tiles_max6
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max2.933333333333332
valid_direction_mean1.2533333333333332
valid_direction_median0.8999999999999999
valid_direction_min0.466666666666665
No reset possible
2918336Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step1-simulationsuccessnonutonomy-P50-56110:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2907304Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:10:27
Timeout: Waited 601 [...]
Timeout:

Waited 601.804412842 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2904166Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step1-simulationabortednonutonomy-P50-56110:00:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2895334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step1-simulationsuccessnonutonomy-P50-56110:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2893314Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2891316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2889318Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-56110:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2886322Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission322/step1-simulation-nutonomy-P50-5611-job2886/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2884323Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-56110:00:33
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission323/step1-simulation-nutonomy-P50-5611-job2884/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible