Duckietown Challenges Home Challenges Submissions

Evaluator 232

ID232
evaluatornutonomy-P50-539
ownerAndrea Censi 🇨🇭
machinenutonomy-P50
processnutonomy-P50-539
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success6 2993
# timeout110 3015
# failed8 2888
# error16 2885
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3831379Oshan Mudannayake 🇱🇰Solution templateaido1_luck-v3step1timeoutyesnutonomy-P50-5390:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3824372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step2-scoringtimeoutnonutonomy-P50-5390:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3823372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step2-scoringtimeoutnonutonomy-P50-5390:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3821372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3812376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessnonutonomy-P50-5390:01:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0333333333333323


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -15.144965386873968, "good_angle": 7.830836087374783, "survival_time": 2.4666666666666677, "traveled_tiles": 2, "valid_direction": 1.500000000000001}, "ep001": {"nsteps": 91, "reward": -12.447482296398707, "good_angle": 0.623453309942581, "survival_time": 3.0333333333333323, "traveled_tiles": 2, "valid_direction": 1.9999999999999991}, "ep002": {"nsteps": 111, "reward": -10.540010888834257, "good_angle": 1.2075460157833389, "survival_time": 3.6999999999999966, "traveled_tiles": 2, "valid_direction": 2.7999999999999967}, "ep003": {"nsteps": 142, "reward": -9.408231461551829, "good_angle": 2.71803237621097, "survival_time": 4.733333333333326, "traveled_tiles": 3, "valid_direction": 0.3999999999999989}, "ep004": {"nsteps": 42, "reward": -26.426816662152607, "good_angle": 0.2275503934080461, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.900000000000001}}
good_angle_max7.830836087374783
good_angle_mean2.521483636543944
good_angle_median1.2075460157833389
good_angle_min0.2275503934080461
reward_max-9.408231461551829
reward_mean-14.793501339162273
reward_median-12.447482296398707
reward_min-26.426816662152607
survival_time_max4.733333333333326
survival_time_mean3.0666666666666647
survival_time_min1.400000000000001
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.7999999999999967
valid_direction_mean1.5199999999999994
valid_direction_median1.500000000000001
valid_direction_min0.3999999999999989
No reset possible
3777378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3775375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3773372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3770374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3768376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3764378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3760375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3756372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3752374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3748376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3744378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3739375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3735372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3732374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3728376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3723375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3720372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3712378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3711378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3708375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3704372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3699374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3694376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3693378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3691375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3688372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3684374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3681376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3680376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3677378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3674375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3671372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3669374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3667376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3665378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3662375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3659372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3657374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3654376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3651378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3648375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3493376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3490378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3487375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3482372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3480374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3477377Anna Tsalapova 🇷🇺simple submissionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3475376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3474376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3466375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3460374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3447375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3440374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3435376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3429375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3428375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3424372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3423372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3418374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3415376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3414376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3405375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3403375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3401372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3399372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3395374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3389376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3388375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3386375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3384372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3381374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3371376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3367375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3364375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3362372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3358374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3357376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3355376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3315372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3314372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3310374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission374/step1-simulation-nutonomy-P50-539-job3310/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3309375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3306375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3305372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3299374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3298372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3290372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3288374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3282372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3279374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3269372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3266374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3256374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3252374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3242372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3239374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3231374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3189373Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3187374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3183372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3180373Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3176374Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3170372Samuel LavoieTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3148364Pravish Sainath 🇨🇦PyTorch templateaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-5390:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3137273Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission273/step1-simulation-nutonomy-P50-539-job3137/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3094280Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:10:28
Timeout: Waited 601 [...]
Timeout:

Waited 601.729709148 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3087358Anton Mashikhin 🇷🇺PyTorch templateaido1_LF1_r3-v3step3-videossuccessnonutonomy-P50-5390:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
No reset possible
3085359Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 96, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3082356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessnonutonomy-P50-5390:01:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
3059347Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:10:29
Timeout: Waited 601 [...]
Timeout:

Waited 601.791497946 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3033354Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:10:29
Timeout: Waited 601 [...]
Timeout:

Waited 601.401712894 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3026348Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:32
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 482, in wrap_evaluator
    raise InvalidEnvironment(out[SPECIAL_INVALID_ENVIRONMENT])
InvalidEnvironment: InvalidEnvironment:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 74, in solve
    check_valid_observations(observation)
  File "solution.py", line 21, in check_valid_observations
    raise InvalidEnvironment(msg)
InvalidEnvironment: I expected size (3, 480, 640), while I got size (3, 120, 160)

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3021352Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3019353Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3017144Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3015165Andrea Censi 🇨🇭Random executionaido1_LF1_r3-v3step1-simulationtimeoutnonutonomy-P50-5390:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3011268Andrea Censi 🇨🇭Random executionaido1_LFV_r1-v3step1-simulationfailednonutonomy-P50-5390:00:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3010334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step2-scoringsuccessnonutonomy-P50-5390:00:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.899999999999992


other stats
episodes
details{"ep000": {"nsteps": 184, "reward": -5.520947383767318, "good_angle": 7.727559357714655, "survival_time": 6.133333333333321, "traveled_tiles": 6, "valid_direction": 2.866666666666666}, "ep001": {"nsteps": 108, "reward": -9.504412423543355, "good_angle": 0.20416817505787468, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 243, "reward": -4.329589816263288, "good_angle": 0.5871797632120224, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 56, "reward": -18.54649259402816, "good_angle": 1.1305714538982885, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 1.4000000000000017}, "ep004": {"nsteps": 147, "reward": -7.091349111692536, "good_angle": 0.3688383772807954, "survival_time": 4.899999999999992, "traveled_tiles": 4, "valid_direction": 1.1666666666666652}}
good_angle_max7.727559357714655
good_angle_mean2.003663425432727
good_angle_median0.5871797632120224
good_angle_min0.20416817505787468
reward_max-4.329589816263288
reward_mean-8.998558265858932
reward_median-7.091349111692536
reward_min-18.54649259402816
survival_time_max8.099999999999982
survival_time_mean4.919999999999993
survival_time_min1.8666666666666691
traveled_tiles_max6
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max2.866666666666666
valid_direction_mean1.3133333333333328
valid_direction_median1.1666666666666652
valid_direction_min0.5333333333333314
No reset possible
2993334Andrea Censi 🇨🇭Tensorflow templateaido1_LFV_r1-v3step1-simulationsuccessnonutonomy-P50-5390:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
No reset possible
2989320Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 176, in predict
    return self.actor(state).cpu().data.numpy().flatten()
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/model.py", line 72, in forward
    x = self.lr(self.lin1(x))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
    return F.linear(input, self.weight, self.bias)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
    return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2956340Claudio RuchJava templateaido1_amod1-v3step1-simulationerroryesnutonomy-P50-5390:10:35
Timeout: Waited 601 [...]
Timeout:

Waited 601.634170055 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2954149Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job2954-4482', 'pull']:

   >  Command '['docker-compose', '-p', 'job2954-4482', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2940224Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2938270Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission270/step1-simulation-nutonomy-P50-539-job2938/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2936272Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission272/step1-simulation-nutonomy-P50-539-job2936/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2934274Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission274/step1-simulation-nutonomy-P50-539-job2934/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2920337Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:10:27
Timeout: Waited 601 [...]
Timeout:

Waited 601.299442053 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2910286Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:10:27
Timeout: Waited 601 [...]
Timeout:

Waited 601.693310022 for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2906311Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2900321Andrea Censi 🇨🇭PyTorch DDPG templateaido1_LFV_r1-v3step1-simulationfailednonutonomy-P50-5390:00:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 62, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2892315Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:02:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2890317Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission317/step1-simulation-nutonomy-P50-539-job2890/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2888319Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailednonutonomy-P50-5390:00:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2887322Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission322/step1-simulation-nutonomy-P50-539-job2887/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
2885323Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrornonutonomy-P50-5390:00:32
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission323/step1-simulation-nutonomy-P50-539-job2885/challenge-results/challenge_results.yaml' does not exist.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible