AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 240

evaluator240
ownerAndrea Censi
machineidsc-rudolf
processrudolf-8
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success263
# timeout144
# failed20
# error23
# aborted27
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5742764miksazRL solutionaido1_LF1_r3-v3step4-vizsuccessno2400:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5738764miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessno2400:02:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5715759gunshiBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessno2400:04:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5712758miksazRL solutionaido1_LF1_r3-v3step2-scoringsuccessno2400:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.333333333333291


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -6.866976710901626, "good_angle": 3.403053616397455, "survival_time": 5.166666666666658, "traveled_tiles": 1, "valid_direction": 4.299999999999992}, "ep001": {"nsteps": 500, "reward": 0.00944943419250194, "good_angle": 0.752010010860947, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 1.1666666666666865}, "ep002": {"nsteps": 500, "reward": 0.12434059941954911, "good_angle": 0.47198065184778526, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 317, "reward": -3.6299602725618, "good_angle": 3.59683180913112, "survival_time": 10.56666666666664, "traveled_tiles": 2, "valid_direction": 8.999999999999977}, "ep004": {"nsteps": 430, "reward": -2.7027417492828074, "good_angle": 2.7907369063415413, "survival_time": 14.333333333333291, "traveled_tiles": 3, "valid_direction": 6.033333333333317}}
good_angle_max3.59683180913112
good_angle_mean2.2029225989157695
good_angle_median2.7907369063415413
good_angle_min0.47198065184778526
reward_max0.12434059941954911
reward_mean-2.6131777398268365
reward_median-2.7027417492828074
reward_min-6.866976710901626
survival_time_max16.666666666666654
survival_time_mean12.67999999999998
survival_time_min5.166666666666658
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max8.999999999999977
valid_direction_mean4.099999999999994
valid_direction_median4.299999999999992
valid_direction_min0
5708757miksazRL solutionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.399999999999975


other stats
episodes
details{"ep000": {"nsteps": 149, "reward": -7.120061547263376, "good_angle": 3.209413445058235, "survival_time": 4.966666666666659, "traveled_tiles": 1, "valid_direction": 4.066666666666659}, "ep001": {"nsteps": 282, "reward": -3.7048815485627817, "good_angle": 1.2124035692470567, "survival_time": 9.399999999999975, "traveled_tiles": 2, "valid_direction": 2.833333333333326}, "ep002": {"nsteps": 500, "reward": -0.0144551980792603, "good_angle": 0.33327086427596136, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0}, "ep003": {"nsteps": 206, "reward": -5.351245579590063, "good_angle": 2.2475888055481144, "survival_time": 6.866666666666652, "traveled_tiles": 2, "valid_direction": 5.066666666666655}, "ep004": {"nsteps": 317, "reward": -4.260944242903901, "good_angle": 3.922491291612776, "survival_time": 10.56666666666664, "traveled_tiles": 3, "valid_direction": 5.866666666666647}}
good_angle_max3.922491291612776
good_angle_mean2.1850335951484285
good_angle_median2.2475888055481144
good_angle_min0.33327086427596136
reward_max-0.0144551980792603
reward_mean-4.0903176232798755
reward_median-4.260944242903901
reward_min-7.120061547263376
survival_time_max16.666666666666654
survival_time_mean9.693333333333316
survival_time_min4.966666666666659
traveled_tiles_max6
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.866666666666647
valid_direction_mean3.566666666666657
valid_direction_median4.066666666666659
valid_direction_min0
5706757miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessno2400:03:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5696756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5682751placailleROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5672748VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5667748VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:07:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5666747Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2400:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5662746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5658746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:07:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5649745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2400:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.133333333333318


other stats
episodes
details{"ep000": {"nsteps": 320, "reward": -3.493504843804476, "good_angle": 10.80054552018425, "survival_time": 10.66666666666664, "traveled_tiles": 4, "valid_direction": 4.833333333333322}, "ep001": {"nsteps": 167, "reward": -6.300075401846197, "good_angle": 5.697903143655912, "survival_time": 5.566666666666657, "traveled_tiles": 4, "valid_direction": 2.199999999999992}, "ep002": {"nsteps": 342, "reward": -3.0983721763705727, "good_angle": 0.4467618172119696, "survival_time": 11.39999999999997, "traveled_tiles": 7, "valid_direction": 1.233333333333329}, "ep003": {"nsteps": 204, "reward": -5.827742832913702, "good_angle": 13.094108382975016, "survival_time": 6.799999999999986, "traveled_tiles": 4, "valid_direction": 3.4999999999999876}, "ep004": {"nsteps": 214, "reward": -6.383901206254262, "good_angle": 5.496909782358589, "survival_time": 7.133333333333318, "traveled_tiles": 5, "valid_direction": 4.333333333333318}}
good_angle_max13.094108382975016
good_angle_mean7.107245729277148
good_angle_median5.697903143655912
good_angle_min0.4467618172119696
reward_max-3.0983721763705727
reward_mean-5.020719292237842
reward_median-5.827742832913702
reward_min-6.383901206254262
survival_time_max11.39999999999997
survival_time_mean8.313333333333315
survival_time_min5.566666666666657
traveled_tiles_max7
traveled_tiles_mean4.8
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max4.833333333333322
valid_direction_mean3.2199999999999904
valid_direction_median3.4999999999999876
valid_direction_min1.233333333333329
5643742placailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5640742placailleROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5334257249193033, "good_angle": 28.464448442858338, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.200000000000011}, "ep001": {"nsteps": 405, "reward": -2.915339407703895, "good_angle": 8.198197807330917, "survival_time": 13.499999999999964, "traveled_tiles": 4, "valid_direction": 2.5666666666666575}, "ep002": {"nsteps": 500, "reward": -0.368324667558074, "good_angle": 0.03215989255300494, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3583750884883339, "good_angle": 18.715206102624435, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.566666666666656}, "ep004": {"nsteps": 500, "reward": -0.7956220874506981, "good_angle": 2.827417955697753, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.8333333333333215}}
good_angle_max28.464448442858338
good_angle_mean11.64748604021289
good_angle_median8.198197807330917
good_angle_min0.03215989255300494
reward_max-0.3583750884883339
reward_mean-0.9942173952240608
reward_median-0.5334257249193033
reward_min-2.915339407703895
survival_time_max16.666666666666654
survival_time_mean16.033333333333317
survival_time_min13.499999999999964
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max7.200000000000011
valid_direction_mean3.8333333333333295
valid_direction_median3.566666666666656
valid_direction_min0
5627737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5618737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:05:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5592729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5589729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5586727heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5584727heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5567720BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:02:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5564724BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5553724BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:05:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5535721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:07:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5530717miksazPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5521715MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.233333333333311


other stats
episodes
details{"ep000": {"nsteps": 147, "reward": -7.480147649439013, "good_angle": 12.936741904799534, "survival_time": 4.899999999999992, "traveled_tiles": 3, "valid_direction": 2.966666666666658}, "ep001": {"nsteps": 415, "reward": -2.8612507890068355, "good_angle": 12.186561827281098, "survival_time": 13.833333333333297, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 159, "reward": -6.376447354097878, "good_angle": 0.6952169073957164, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.7999999999999978}, "ep003": {"nsteps": 277, "reward": -4.355154121449278, "good_angle": 13.508413594392676, "survival_time": 9.233333333333311, "traveled_tiles": 4, "valid_direction": 3.433333333333322}, "ep004": {"nsteps": 500, "reward": -0.7639039816061267, "good_angle": 2.894423716990918, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.699999999999986}}
good_angle_max13.508413594392676
good_angle_mean8.444271590171988
good_angle_median12.186561827281098
good_angle_min0.6952169073957164
reward_max-0.7639039816061267
reward_mean-4.367380779119826
reward_median-4.355154121449278
reward_min-7.480147649439013
survival_time_max16.666666666666654
survival_time_mean9.986666666666649
survival_time_min4.899999999999992
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max5.699999999999986
valid_direction_mean3.366666666666658
valid_direction_median2.966666666666658
valid_direction_min1.7999999999999978
5518714PolyProgrammistROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5515714PolyProgrammistROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 150, "reward": -7.347284248868624, "good_angle": 13.345978835505912, "survival_time": 4.999999999999992, "traveled_tiles": 3, "valid_direction": 2.866666666666658}, "ep001": {"nsteps": 500, "reward": -0.3225839899103157, "good_angle": 16.99840443425489, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.0333333333333226}, "ep002": {"nsteps": 500, "reward": -0.378405627772212, "good_angle": 0.03511738346382928, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3741501343552954, "good_angle": 19.7585844802923, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.29999999999999}, "ep004": {"nsteps": 81, "reward": -15.03620073824753, "good_angle": 0.6165366185709388, "survival_time": 2.7, "traveled_tiles": 2, "valid_direction": 1.6666666666666656}}
good_angle_max19.7585844802923
good_angle_mean10.150924350417576
good_angle_median13.345978835505912
good_angle_min0.03511738346382928
reward_max-0.3225839899103157
reward_mean-4.691724947830795
reward_median-0.378405627772212
reward_min-15.03620073824753
survival_time_max16.666666666666654
survival_time_mean11.539999999999992
survival_time_min2.7
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max3.29999999999999
valid_direction_mean2.1733333333333276
valid_direction_median2.866666666666658
valid_direction_min0
5508713BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6631416728068144, "good_angle": 25.37730008367105, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.0666666666666496}, "ep001": {"nsteps": 500, "reward": -0.34981133888754995, "good_angle": 25.89019170460868, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.933333333333317}, "ep002": {"nsteps": 500, "reward": -0.625916432082653, "good_angle": 1.154775913319328, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 3.533333333333321}, "ep003": {"nsteps": 500, "reward": -0.3946926848629955, "good_angle": 36.599325058878726, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.366666666666677}, "ep004": {"nsteps": 500, "reward": -0.7433039758391679, "good_angle": 2.6250036309808085, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.366666666666648}}
good_angle_max36.599325058878726
good_angle_mean18.329319278291717
good_angle_median25.37730008367105
good_angle_min1.154775913319328
reward_max-0.34981133888754995
reward_mean-0.5553732208958362
reward_median-0.625916432082653
reward_min-0.7433039758391679
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max7
traveled_tiles_mean5.4
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max7.366666666666677
valid_direction_mean5.653333333333322
valid_direction_median6.0666666666666496
valid_direction_min3.533333333333321
5505710BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5501713BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrorno2400:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5501-4646', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5501-4646', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5495712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5549307504342869, "good_angle": 28.906573263742025, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.200000000000011}, "ep001": {"nsteps": 500, "reward": -0.3181587567869574, "good_angle": 18.281628973374907, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.133333333333322}, "ep002": {"nsteps": 500, "reward": -0.38564417546987534, "good_angle": 0.0488346134607125, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.35650141959125176, "good_angle": 18.778318378546786, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.266666666666656}, "ep004": {"nsteps": 87, "reward": -14.048405466408566, "good_angle": 0.7437346447797271, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 1.533333333333332}}
good_angle_max28.906573263742025
good_angle_mean13.351817974780827
good_angle_median18.281628973374907
good_angle_min0.0488346134607125
reward_max-0.3181587567869574
reward_mean-3.1327281137381875
reward_median-0.38564417546987534
reward_min-14.048405466408566
survival_time_max16.666666666666654
survival_time_mean13.913333333333323
survival_time_min2.8999999999999995
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max7.200000000000011
valid_direction_mean3.0266666666666637
valid_direction_median3.133333333333322
valid_direction_min0
5477708JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:04:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5474705JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5462703JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5459703JonRandom executionaido1_LF1_r3-v3step3-videossuccessno2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5455702BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5447700BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5444700BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringerrorno2400:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5444-780', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5444-780', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5440699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5437699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.520073588193627, "good_angle": 28.372258145821053, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.56666666666668}, "ep001": {"nsteps": 500, "reward": -0.31609241442009806, "good_angle": 18.20454025902395, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.133333333333322}, "ep002": {"nsteps": 500, "reward": -0.3679287188500166, "good_angle": 0.035575018106605565, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3605381392007512, "good_angle": 18.65611139600455, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.9999999999999902}, "ep004": {"nsteps": 500, "reward": -0.7963048856555252, "good_angle": 2.526092621414395, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.999999999999987}}
good_angle_max28.372258145821053
good_angle_mean13.558915488074112
good_angle_median18.20454025902395
good_angle_min0.035575018106605565
reward_max-0.31609241442009806
reward_mean-0.4721875492640037
reward_median-0.3679287188500166
reward_min-0.7963048856555252
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max6.56666666666668
valid_direction_mean3.739999999999996
valid_direction_median3.133333333333322
valid_direction_min0
5422695BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:02:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5174464363264851, "good_angle": 36.0555980510905, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.366666666666646}, "ep001": {"nsteps": 285, "reward": -3.988052106769592, "good_angle": 11.246108572788714, "survival_time": 9.499999999999975, "traveled_tiles": 4, "valid_direction": 2.633333333333325}, "ep002": {"nsteps": 500, "reward": -0.5809747032001614, "good_angle": 0.5511520127900315, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 1.1666666666666623}, "ep003": {"nsteps": 464, "reward": -2.5291212963605583, "good_angle": 24.736383509079214, "survival_time": 15.466666666666622, "traveled_tiles": 7, "valid_direction": 4.76666666666665}, "ep004": {"nsteps": 500, "reward": -0.7460706018349156, "good_angle": 2.818362034005353, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.666666666666679}}
good_angle_max36.0555980510905
good_angle_mean15.08152083595076
good_angle_median11.246108572788714
good_angle_min0.5511520127900315
reward_max-0.5174464363264851
reward_mean-1.6723330288983422
reward_median-0.7460706018349156
reward_min-3.988052106769592
survival_time_max16.666666666666654
survival_time_mean14.993333333333316
survival_time_min9.499999999999975
traveled_tiles_max7
traveled_tiles_mean5.8
traveled_tiles_median6
traveled_tiles_min4
valid_direction_max7.366666666666646
valid_direction_mean4.5199999999999925
valid_direction_median4.76666666666665
valid_direction_min1.1666666666666623
5419694BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5418693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5416693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5414693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:04:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5412692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:02:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5409692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:08:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5407691MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5405691MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:07:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5401690yun chenRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.666666666666647


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.819196847607108, "good_angle": 24.32530414716686, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.899999999999987}, "ep001": {"nsteps": 376, "reward": -3.2379122018074726, "good_angle": 21.231813989893613, "survival_time": 12.5333333333333, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 200, "reward": -5.078467559028067, "good_angle": 0.21822420521583288, "survival_time": 6.666666666666653, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 260, "reward": -6.371230988777601, "good_angle": 25.892748903422156, "survival_time": 8.666666666666647, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep004": {"nsteps": 271, "reward": -5.612270546728244, "good_angle": 5.308371681161081, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}
good_angle_max25.892748903422156
good_angle_mean15.395292585371909
good_angle_median21.231813989893613
good_angle_min0.21822420521583288
reward_max-3.2379122018074726
reward_mean-5.623815628789698
reward_median-5.612270546728244
reward_min-7.819196847607108
survival_time_max12.5333333333333
survival_time_mean8.513333333333314
survival_time_min5.666666666666656
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666535
valid_direction_mean2.966666666666657
valid_direction_median3.899999999999987
valid_direction_min0
5395688MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median14.09999999999996


other stats
episodes
details{"ep000": {"nsteps": 148, "reward": -7.431404875541055, "good_angle": 12.738676669549523, "survival_time": 4.933333333333326, "traveled_tiles": 3, "valid_direction": 2.966666666666658}, "ep001": {"nsteps": 423, "reward": -2.8331109985497824, "good_angle": 12.362033404302332, "survival_time": 14.09999999999996, "traveled_tiles": 4, "valid_direction": 3.0333333333333226}, "ep002": {"nsteps": 500, "reward": -0.3844907549321652, "good_angle": 0.036203257846110753, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3662934238284361, "good_angle": 19.312327801366663, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.3666666666666565}, "ep004": {"nsteps": 80, "reward": -15.13905012011528, "good_angle": 0.6538558751059325, "survival_time": 2.666666666666667, "traveled_tiles": 2, "valid_direction": 1.2666666666666653}}
good_angle_max19.312327801366663
good_angle_mean9.020619401634113
good_angle_median12.362033404302332
good_angle_min0.036203257846110753
reward_max-0.3662934238284361
reward_mean-5.230870034593344
reward_median-2.8331109985497824
reward_min-15.13905012011528
survival_time_max16.666666666666654
survival_time_mean11.00666666666665
survival_time_min2.666666666666667
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max3.3666666666666565
valid_direction_mean2.1266666666666607
valid_direction_median2.966666666666658
valid_direction_min0
5381684Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5333675heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5329675heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.707524042937065, "good_angle": 4.558573615649922, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.333333333333332}, "ep001": {"nsteps": 95, "reward": -12.149568855135064, "good_angle": 2.2168865970853284, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.366666666666666}, "ep002": {"nsteps": 109, "reward": -10.434394388844114, "good_angle": 2.993975240420685, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 2.6999999999999966}, "ep003": {"nsteps": 76, "reward": -15.223712928985297, "good_angle": 1.3084261872204903, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 1.8666666666666671}, "ep004": {"nsteps": 57, "reward": -20.1426948706309, "good_angle": 0.5654761377833007, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max4.558573615649922
good_angle_mean2.3286675556319456
good_angle_median2.2168865970853284
good_angle_min0.5654761377833007
reward_max-10.434394388844114
reward_mean-13.931579017306486
reward_median-12.149568855135064
reward_min-20.1426948706309
survival_time_max3.63333333333333
survival_time_mean2.8666666666666663
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.6999999999999966
valid_direction_mean2.0999999999999996
valid_direction_median2.333333333333332
valid_direction_min1.2333333333333358
5327675heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5323674heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5322674heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.466666666666668


other stats
episodes
details{"ep000": {"nsteps": 44, "reward": -23.88088265738704, "good_angle": 3.70949417577136, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 1.0333333333333343}, "ep001": {"nsteps": 45, "reward": -23.776525971624583, "good_angle": 0.6708159161644452, "survival_time": 1.500000000000001, "traveled_tiles": 1, "valid_direction": 1.0333333333333348}, "ep002": {"nsteps": 52, "reward": -20.455973258528573, "good_angle": 0.9021072811734004, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 1.200000000000002}, "ep003": {"nsteps": 37, "reward": -29.080562771977604, "good_angle": 0.4446186164358923, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 0.8333333333333338}, "ep004": {"nsteps": 28, "reward": -38.27836284467152, "good_angle": 0.1990222119227902, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.5333333333333332}}
good_angle_max3.70949417577136
good_angle_mean1.1852116402935775
good_angle_median0.6708159161644452
good_angle_min0.1990222119227902
reward_max-20.455973258528573
reward_mean-27.09446150083786
reward_median-23.88088265738704
reward_min-38.27836284467152
survival_time_max1.7333333333333354
survival_time_mean1.3733333333333344
survival_time_min0.9333333333333332
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.200000000000002
valid_direction_mean0.9266666666666676
valid_direction_median1.0333333333333343
valid_direction_min0.5333333333333332
5319674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5315672Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.59999999999998


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.811692823792062, "good_angle": 24.28812986601777, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 378, "reward": -3.695406492109652, "good_angle": 22.76586970690279, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 241, "reward": -4.152174594516468, "good_angle": 0.20136059001702675, "survival_time": 8.033333333333315, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.3602991353633795, "good_angle": 26.00621789271218, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.601168967155671, "good_angle": 5.172273166308113, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.00621789271218
good_angle_mean15.686770244391576
good_angle_median22.76586970690279
good_angle_min0.20136059001702675
reward_max-3.695406492109652
reward_mean-5.524148402587447
reward_median-5.601168967155671
reward_min-7.811692823792062
survival_time_max12.599999999999966
survival_time_mean8.786666666666646
survival_time_min5.6999999999999895
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666544
valid_direction_mean2.9733333333333234
valid_direction_median3.93333333333332
valid_direction_min0
5311671Dennis WuSolution templateaido1_luck-v3step1successyes2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
score165.88816712103393


5309669Liam PaullSolution templateaido1_luck-v3step1successyes2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
score180.56102562986031


5306668JonJP pipelineaido1_LFV_r1-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.7721531042624266, "good_angle": 48.47399369745748, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 11.933333333333296}, "ep001": {"nsteps": 500, "reward": -0.7229095725985808, "good_angle": 23.805811841273066, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.966666666666678}, "ep002": {"nsteps": 500, "reward": -2.067040338754654, "good_angle": 2.5029413177801993, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.9666666666666943}, "ep003": {"nsteps": 42, "reward": -25.34570064714977, "good_angle": 0.0406843627928648, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": -1.3681577231884003, "good_angle": 0.47866020503854456, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.3666666666666971}}
good_angle_max48.47399369745748
good_angle_mean15.06041828486843
good_angle_median2.5029413177801993
good_angle_min0.0406843627928648
reward_max-0.7229095725985808
reward_mean-6.2551922771907655
reward_median-1.7721531042624266
reward_min-25.34570064714977
survival_time_max16.666666666666654
survival_time_mean13.61333333333332
survival_time_min1.400000000000001
traveled_tiles_max6
traveled_tiles_mean4.4
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max11.933333333333296
valid_direction_mean4.846666666666673
valid_direction_median2.9666666666666943
valid_direction_min0
5300667JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:05:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5296665aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2400:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5292662aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2400:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5291661gunshiTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessno2400:00:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5285661gunshiTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno2400:03:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5284660iban_alexPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5276660iban_alexPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5268657aleksandarpetrROS-based Lane Following (STest)aido1_LF1_r3-v3step1-simulationerrorno2400:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission657/step1-simulation-rudolf-8-job5268/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5262655miksazDDPGaido1_LF1_r3-v3step1-simulationsuccessno2400:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5257653iban_alexTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2400:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5246648Julian ZillyTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2400:10:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5244646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5237645heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.066666666666662


other stats
episodes
details{"ep000": {"nsteps": 122, "reward": -9.584048272156323, "good_angle": 4.15024539593361, "survival_time": 4.066666666666662, "traveled_tiles": 1, "valid_direction": 3.2999999999999954}, "ep001": {"nsteps": 125, "reward": -9.326586581707, "good_angle": 4.253873169300722, "survival_time": 4.166666666666662, "traveled_tiles": 1, "valid_direction": 3.366666666666662}, "ep002": {"nsteps": 150, "reward": -7.492702591568231, "good_angle": 5.0505519054772465, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 4.0999999999999925}, "ep003": {"nsteps": 97, "reward": -12.444948281209491, "good_angle": 2.6592831813146716, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.5666666666666647}, "ep004": {"nsteps": 70, "reward": -16.90499336378915, "good_angle": 1.0227292718412762, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.666666666666668}}
good_angle_max5.0505519054772465
good_angle_mean3.427336584773505
good_angle_median4.15024539593361
good_angle_min1.0227292718412762
reward_max-7.492702591568231
reward_mean-11.15065581808604
reward_median-9.584048272156323
reward_min-16.90499336378915
survival_time_max4.999999999999992
survival_time_mean3.7599999999999967
survival_time_min2.333333333333335
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.0999999999999925
valid_direction_mean2.9999999999999964
valid_direction_median3.2999999999999954
valid_direction_min1.666666666666668
5231645heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:02:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5225644heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:04:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5216641miksazSolution templateaido1_luck-v3step1successyes2400:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
score159.550517941171194


5213639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5208639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:06:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5200637JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5183635JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:06:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5182634tnd_duck18Solution templateaido1_luck-v3step1successyes2400:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
score112.529038562316131


5174629lavoiemsPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:02:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5171629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.433333333333324


other stats
episodes
details{"ep000": {"nsteps": 142, "reward": -9.917068860900232, "good_angle": 18.09525756528763, "survival_time": 4.733333333333326, "traveled_tiles": 2, "valid_direction": 3.5999999999999925}, "ep001": {"nsteps": 171, "reward": -7.560464622333035, "good_angle": 0.5729313785798368, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.6333333333333253}, "ep002": {"nsteps": 166, "reward": -6.096256680320948, "good_angle": 0.2554365493405618, "survival_time": 5.5333333333333234, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 163, "reward": -8.29269307376417, "good_angle": 9.701503703263583, "survival_time": 5.433333333333324, "traveled_tiles": 3, "valid_direction": 2.033333333333326}, "ep004": {"nsteps": 60, "reward": -19.260831459363303, "good_angle": 0.1967168642955068, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.0000000000000029}}
good_angle_max18.09525756528763
good_angle_mean5.764369212153424
good_angle_median0.5729313785798368
good_angle_min0.1967168642955068
reward_max-6.096256680320948
reward_mean-10.22546293933634
reward_median-8.29269307376417
reward_min-19.260831459363303
survival_time_max5.6999999999999895
survival_time_mean4.6799999999999935
survival_time_min2.0000000000000027
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.5999999999999925
valid_direction_mean1.8533333333333295
valid_direction_median2.033333333333326
valid_direction_min0
5169595heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5166595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5165628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
5163629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5160629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
5155629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5152629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
5149628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:09:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5146628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
5139595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
5138627heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5134627heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:02:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5128605DavidRandom executionaido1_LF1_r3-v3step4-vizerrorno2400:00:43
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5128-7645', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5128-7645', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5127625yun chenSolution templateaido1_luck-v3step1successyes2400:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
score145.3770199986906


5115615DavidPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5113615DavidPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.433333333333327


other stats
episodes
details{"ep000": {"nsteps": 131, "reward": -9.981399529307852, "good_angle": 15.735054237973005, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.06666666666666}, "ep001": {"nsteps": 133, "reward": -9.293049005189337, "good_angle": 0.605862045100284, "survival_time": 4.433333333333327, "traveled_tiles": 2, "valid_direction": 2.599999999999996}, "ep002": {"nsteps": 181, "reward": -5.5906819266225956, "good_angle": 0.2632210779455018, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 224, "reward": -6.823855211160013, "good_angle": 19.21508282985355, "survival_time": 7.46666666666665, "traveled_tiles": 3, "valid_direction": 3.133333333333322}, "ep004": {"nsteps": 61, "reward": -18.98610385128709, "good_angle": 0.19374652073973844, "survival_time": 2.033333333333336, "traveled_tiles": 2, "valid_direction": 0.7333333333333352}}
good_angle_max19.21508282985355
good_angle_mean7.202593342322416
good_angle_median0.605862045100284
good_angle_min0.19374652073973844
reward_max-5.5906819266225956
reward_mean-10.135017904713376
reward_median-9.293049005189337
reward_min-18.98610385128709
survival_time_max7.46666666666665
survival_time_mean4.866666666666659
survival_time_min2.033333333333336
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.133333333333322
valid_direction_mean1.9066666666666627
valid_direction_median2.599999999999996
valid_direction_min0
5097615DavidPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5090609DavidRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5087623lmandrilePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.533333333333327


other stats
episodes
details{"ep000": {"nsteps": 136, "reward": -10.209148713332766, "good_angle": 16.760545270418657, "survival_time": 4.533333333333327, "traveled_tiles": 2, "valid_direction": 3.433333333333327}, "ep001": {"nsteps": 230, "reward": -4.566715381259058, "good_angle": 0.35745705118566234, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 185, "reward": -5.465093763085787, "good_angle": 0.24664651097216264, "survival_time": 6.1666666666666545, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 51, "reward": -21.581425147898056, "good_angle": 0.4363266426876076, "survival_time": 1.700000000000002, "traveled_tiles": 2, "valid_direction": 0.9333333333333352}, "ep004": {"nsteps": 59, "reward": -19.598659733594474, "good_angle": 0.2190899360834058, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.9000000000000027}}
good_angle_max16.760545270418657
good_angle_mean3.604013082269499
good_angle_median0.35745705118566234
good_angle_min0.2190899360834058
reward_max-4.566715381259058
reward_mean-12.284208547834028
reward_median-10.209148713332766
reward_min-21.581425147898056
survival_time_max7.666666666666649
survival_time_mean4.406666666666661
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.433333333333327
valid_direction_mean1.053333333333333
valid_direction_median0.9000000000000027
valid_direction_min0
5078623lmandrilePyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:03:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5072609DavidRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2400:03:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5069620heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5066611DavidRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5060613lmandrilePyTorch templateaido1_LF1_r3-v3step3-videoserrorno2400:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5060-8118', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5060-8118', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5058617yun chenSolution templateaido1_luck-v3step1successyes2400:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
score189.2704524450636


5044595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
5032617yun chenSolution templateaido1_luck-v3step1timeoutyes2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5024598heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
5020600heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:36:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
5019601heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:36:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
5002608DavidRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2400:37:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
5001605DavidRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2400:37:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
4995602heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:38:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
4992599heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:38:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4976595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
4971488JonJP pipelineaido1_LF1_r3-v3step4-viztimeoutno2400:31:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
4961596heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = make_env(config)
  File "solution.py", line 23, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4948593heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:32:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
4942488JonJP pipelineaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
494015Andrea Censinullaido1_log_processing-v3logstep1abortedyes2400:01:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


4933591coolcat647Solution templateaido1_luck-v3step1successyes2400:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
score130.003853063841916


4931592coolcat647PyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4926592coolcat647PyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4923592coolcat647PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4897488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4890488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4888584JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4886584JonJP pipelineaido1_LF1_r3-v3step3-videoserrorno2400:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4886-7285', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4886-7285', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4883583JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4880583JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.399999999999974


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1010319255804644, "good_angle": 46.96881412331105, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 11.599999999999964}, "ep001": {"nsteps": 492, "reward": -3.170448393750239, "good_angle": 27.10441071139016, "survival_time": 16.399999999999974, "traveled_tiles": 5, "valid_direction": 6.999999999999997}, "ep002": {"nsteps": 410, "reward": -3.571986843318474, "good_angle": 1.6979209677580716, "survival_time": 13.666666666666629, "traveled_tiles": 5, "valid_direction": 2.766666666666657}, "ep003": {"nsteps": 500, "reward": -1.0850772544145584, "good_angle": 36.06395480282929, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.533333333333349}, "ep004": {"nsteps": 186, "reward": -7.602617400948719, "good_angle": 1.0265647302888334, "survival_time": 6.199999999999988, "traveled_tiles": 3, "valid_direction": 1.8999999999999932}}
good_angle_max46.96881412331105
good_angle_mean22.57233306711548
good_angle_median27.10441071139016
good_angle_min1.0265647302888334
reward_max-1.0850772544145584
reward_mean-3.3062323636024913
reward_median-3.170448393750239
reward_min-7.602617400948719
survival_time_max16.666666666666654
survival_time_mean13.91999999999998
survival_time_min6.199999999999988
traveled_tiles_max6
traveled_tiles_mean5
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max11.599999999999964
valid_direction_mean5.759999999999993
valid_direction_median5.533333333333349
valid_direction_min1.8999999999999932
4874582JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4872582JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0938952673496678, "good_angle": 47.65945546113703, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 11.66666666666663}, "ep001": {"nsteps": 500, "reward": -1.092040315405, "good_angle": 25.93723773938502, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.90000000000001}, "ep002": {"nsteps": 419, "reward": -3.5204645935846113, "good_angle": 1.7086155304993935, "survival_time": 13.966666666666628, "traveled_tiles": 6, "valid_direction": 2.6999999999999904}, "ep003": {"nsteps": 500, "reward": -1.107821210026741, "good_angle": 35.306656065971524, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.43333333333335}, "ep004": {"nsteps": 183, "reward": -7.70819045611418, "good_angle": 1.0080800749033976, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 1.6666666666666607}}
good_angle_max47.65945546113703
good_angle_mean22.324008974379275
good_angle_median25.93723773938502
good_angle_min1.0080800749033976
reward_max-1.092040315405
reward_mean-2.90448236849604
reward_median-1.107821210026741
reward_min-7.70819045611418
survival_time_max16.666666666666654
survival_time_mean14.013333333333316
survival_time_min6.099999999999988
traveled_tiles_max6
traveled_tiles_mean5.2
traveled_tiles_median6
traveled_tiles_min3
valid_direction_max11.66666666666663
valid_direction_mean5.6733333333333285
valid_direction_median5.43333333333335
valid_direction_min1.6666666666666607
4867581JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4862580JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4857580JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999993


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -6.359649095180872, "good_angle": 27.388063439098673, "survival_time": 7.399999999999984, "traveled_tiles": 3, "valid_direction": 4.899999999999988}, "ep001": {"nsteps": 141, "reward": -9.073139651024595, "good_angle": 0.6233174032214033, "survival_time": 4.699999999999993, "traveled_tiles": 2, "valid_direction": 2.099999999999997}, "ep002": {"nsteps": 173, "reward": -7.460346334630009, "good_angle": 0.7461143637402835, "survival_time": 5.766666666666656, "traveled_tiles": 3, "valid_direction": 2.766666666666662}, "ep003": {"nsteps": 104, "reward": -11.815939071086737, "good_angle": 0.5588586146605803, "survival_time": 3.466666666666664, "traveled_tiles": 2, "valid_direction": 1.3000000000000005}, "ep004": {"nsteps": 83, "reward": -14.738914880407862, "good_angle": 0.24759771750360615, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}}
good_angle_max27.388063439098673
good_angle_mean5.912790307644909
good_angle_median0.6233174032214033
good_angle_min0.24759771750360615
reward_max-6.359649095180872
reward_mean-9.889597806466016
reward_median-9.073139651024595
reward_min-14.738914880407862
survival_time_max7.399999999999984
survival_time_mean4.819999999999992
survival_time_min2.7666666666666666
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max4.899999999999988
valid_direction_mean2.286666666666662
valid_direction_median2.099999999999997
valid_direction_min0.36666666666666536
4850579JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4841578JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4834577JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:02:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4829576JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:03:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4826488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
4819574trimcaoPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4808571JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4803570JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4800570JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.766666666666636


other stats
episodes
details{"ep000": {"nsteps": 380, "reward": -3.4275734330818524, "good_angle": 19.67944015724277, "survival_time": 12.666666666666632, "traveled_tiles": 3, "valid_direction": 9.533333333333305}, "ep001": {"nsteps": 353, "reward": -3.6441456717900698, "good_angle": 17.582573372738576, "survival_time": 11.766666666666636, "traveled_tiles": 4, "valid_direction": 5.299999999999982}, "ep002": {"nsteps": 281, "reward": -4.588881395041306, "good_angle": 1.2569238526233293, "survival_time": 9.366666666666644, "traveled_tiles": 4, "valid_direction": 1.866666666666661}, "ep003": {"nsteps": 500, "reward": -0.962922149695456, "good_angle": 39.493378623929296, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 6.766666666666678}, "ep004": {"nsteps": 115, "reward": -10.9712619719298, "good_angle": 0.7337306193976895, "survival_time": 3.8333333333333295, "traveled_tiles": 2, "valid_direction": 1.0333333333333297}}
good_angle_max39.493378623929296
good_angle_mean15.749209325186332
good_angle_median17.582573372738576
good_angle_min0.7337306193976895
reward_max-0.962922149695456
reward_mean-4.718956924307697
reward_median-3.6441456717900698
reward_min-10.9712619719298
survival_time_max16.666666666666654
survival_time_mean10.85999999999998
survival_time_min3.8333333333333295
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max9.533333333333305
valid_direction_mean4.8999999999999915
valid_direction_median5.299999999999982
valid_direction_min1.0333333333333297
4797488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
4790569JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4785567JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4774488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4767562JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4764562JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4758488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4753561JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.16666666666664


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0546540737710892, "good_angle": 34.51138123885267, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.566666666666643}, "ep001": {"nsteps": 374, "reward": -3.6705022079740615, "good_angle": 14.125139649186789, "survival_time": 12.466666666666631, "traveled_tiles": 5, "valid_direction": 5.466666666666648}, "ep002": {"nsteps": 305, "reward": -4.419515617265076, "good_angle": 1.2470361245648718, "survival_time": 10.16666666666664, "traveled_tiles": 5, "valid_direction": 2.0666666666666593}, "ep003": {"nsteps": 164, "reward": -8.324975036266373, "good_angle": 19.507019132279822, "survival_time": 5.466666666666657, "traveled_tiles": 3, "valid_direction": 2.3999999999999915}, "ep004": {"nsteps": 52, "reward": -21.817430532895603, "good_angle": 0.19772912431812728, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.2666666666666675}}
good_angle_max34.51138123885267
good_angle_mean13.917661053840456
good_angle_median14.125139649186789
good_angle_min0.19772912431812728
reward_max-1.0546540737710892
reward_mean-7.85741549363444
reward_median-4.419515617265076
reward_min-21.817430532895603
survival_time_max16.666666666666654
survival_time_mean9.299999999999985
survival_time_min1.7333333333333354
traveled_tiles_max7
traveled_tiles_mean4.4
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max8.566666666666643
valid_direction_mean3.753333333333322
valid_direction_median2.3999999999999915
valid_direction_min0.2666666666666675
4745560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -2.093350087761879, "good_angle": 64.21378334739262, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 8.333333333333341}, "ep001": {"nsteps": 500, "reward": -0.4214482853714726, "good_angle": 17.17361435172728, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.33333333333333}, "ep002": {"nsteps": 382, "reward": -4.748119170753119, "good_angle": 30.681874208311783, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.333333333333323}, "ep003": {"nsteps": 500, "reward": -2.0625945639610292, "good_angle": 17.85825665677818, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 6.966666666666652}, "ep004": {"nsteps": 500, "reward": -1.8457750113010407, "good_angle": 0.038945071724899305, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}}
good_angle_max64.21378334739262
good_angle_mean25.993294727186953
good_angle_median17.85825665677818
good_angle_min0.038945071724899305
reward_max-0.4214482853714726
reward_mean-2.234257423829708
reward_median-2.0625945639610292
reward_min-4.748119170753119
survival_time_max16.666666666666654
survival_time_mean15.879999999999985
survival_time_min12.7333333333333
traveled_tiles_max5
traveled_tiles_mean4.2
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max8.333333333333341
valid_direction_mean4.793333333333329
valid_direction_median4.33333333333333
valid_direction_min0
4741557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessno2400:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4738488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4737488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4734558JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2400:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4729556JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:03:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4725554JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4723554JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:03:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4721553JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4718553JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.566666666666653


other stats
episodes
details{"ep000": {"nsteps": 160, "reward": -6.9175272558699366, "good_angle": 12.90549873417316, "survival_time": 5.333333333333324, "traveled_tiles": 3, "valid_direction": 3.3333333333333286}, "ep001": {"nsteps": 275, "reward": -5.165960996367715, "good_angle": 21.890191742276695, "survival_time": 9.166666666666645, "traveled_tiles": 4, "valid_direction": 3.63333333333332}, "ep002": {"nsteps": 197, "reward": -6.494275115354714, "good_angle": 0.3511578872896007, "survival_time": 6.566666666666653, "traveled_tiles": 4, "valid_direction": 0.33333333333333215}, "ep003": {"nsteps": 420, "reward": -3.7736171579359854, "good_angle": 36.54768511236157, "survival_time": 13.99999999999996, "traveled_tiles": 7, "valid_direction": 5.999999999999979}, "ep004": {"nsteps": 79, "reward": -15.227698244626009, "good_angle": 0.19844477972793512, "survival_time": 2.6333333333333337, "traveled_tiles": 2, "valid_direction": 0.29999999999999893}}
good_angle_max36.54768511236157
good_angle_mean14.378595651165792
good_angle_median12.90549873417316
good_angle_min0.19844477972793512
reward_max-3.7736171579359854
reward_mean-7.5158157540308705
reward_median-6.494275115354714
reward_min-15.227698244626009
survival_time_max13.99999999999996
survival_time_mean7.539999999999982
survival_time_min2.6333333333333337
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max5.999999999999979
valid_direction_mean2.719999999999992
valid_direction_median3.3333333333333286
valid_direction_min0.29999999999999893
4715488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4709524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4702488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4696524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4693551JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4690551JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:07:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4685488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4682524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videostimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4680548JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4677548JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4665488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4662524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videostimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4659488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4654524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4645524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4624488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4614524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4595524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4588536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.966666666666666


other stats
episodes
details{"ep000": {"nsteps": 89, "reward": -13.127272469274114, "good_angle": 10.665048509791976, "survival_time": 2.966666666666666, "traveled_tiles": 2, "valid_direction": 1.966666666666666}, "ep001": {"nsteps": 88, "reward": -12.823042251847006, "good_angle": 0.661973213908129, "survival_time": 2.9333333333333327, "traveled_tiles": 2, "valid_direction": 1.933333333333333}, "ep002": {"nsteps": 101, "reward": -11.170705346630353, "good_angle": 0.9513547538946444, "survival_time": 3.3666666666666645, "traveled_tiles": 2, "valid_direction": 2.3999999999999977}, "ep003": {"nsteps": 145, "reward": -9.278553971750982, "good_angle": 3.1949558105588975, "survival_time": 4.833333333333326, "traveled_tiles": 3, "valid_direction": 0.36666666666666536}, "ep004": {"nsteps": 50, "reward": -22.65142310142517, "good_angle": 0.2515818940641918, "survival_time": 1.6666666666666683, "traveled_tiles": 2, "valid_direction": 1.100000000000002}}
good_angle_max10.665048509791976
good_angle_mean3.1449828364435675
good_angle_median0.9513547538946444
good_angle_min0.2515818940641918
reward_max-9.278553971750982
reward_mean-13.810199428185523
reward_median-12.823042251847006
reward_min-22.65142310142517
survival_time_max4.833333333333326
survival_time_mean3.153333333333331
survival_time_min1.6666666666666683
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.3999999999999977
valid_direction_mean1.5533333333333328
valid_direction_median1.933333333333333
valid_direction_min0.36666666666666536
4578524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4575532heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4568532heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:02:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4563524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4558534heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:03:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4557531heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4554531heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.707524042937065, "good_angle": 4.558573615649922, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.333333333333332}, "ep001": {"nsteps": 95, "reward": -12.149568855135064, "good_angle": 2.2168865970853284, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.366666666666666}, "ep002": {"nsteps": 109, "reward": -10.434394388844114, "good_angle": 2.993975240420685, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 2.6999999999999966}, "ep003": {"nsteps": 76, "reward": -15.223712928985297, "good_angle": 1.3084261872204903, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 1.8666666666666671}, "ep004": {"nsteps": 57, "reward": -20.1426948706309, "good_angle": 0.5654761377833007, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max4.558573615649922
good_angle_mean2.3286675556319456
good_angle_median2.2168865970853284
good_angle_min0.5654761377833007
reward_max-10.434394388844114
reward_mean-13.931579017306486
reward_median-12.149568855135064
reward_min-20.1426948706309
survival_time_max3.63333333333333
survival_time_mean2.8666666666666663
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.6999999999999966
valid_direction_mean2.0999999999999996
valid_direction_median2.333333333333332
valid_direction_min1.2333333333333358
4546528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessno2400:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4540524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4538530JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4527526heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4520525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4517528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4516524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4513529JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2400:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: invalid syntax (LF_JP.py, line 21)

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4510488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
4509524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
4507526heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
4506525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4500523heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4496522heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2400:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4491488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:32:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
4487521heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4476517JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4475517JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0861283275363969, "good_angle": 45.5720992116859, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 12.233333333333295}, "ep001": {"nsteps": 500, "reward": -1.465490369081497, "good_angle": 33.27812516953315, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 8.433333333333339}, "ep002": {"nsteps": 438, "reward": -3.4569922676097313, "good_angle": 1.5186300182997654, "survival_time": 14.59999999999996, "traveled_tiles": 5, "valid_direction": 2.5666666666666575}, "ep003": {"nsteps": 500, "reward": -2.3652101945877075, "good_angle": 22.287193334092237, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.466666666666656}, "ep004": {"nsteps": 500, "reward": -2.3158394231796264, "good_angle": 0.9548555391944116, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max45.5720992116859
good_angle_mean20.722180654561093
good_angle_median22.287193334092237
good_angle_min0.9548555391944116
reward_max-1.0861283275363969
reward_mean-2.137932116398992
reward_median-2.3158394231796264
reward_min-3.4569922676097313
survival_time_max16.666666666666654
survival_time_mean16.253333333333316
survival_time_min14.59999999999996
traveled_tiles_max6
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max13.466666666666656
valid_direction_mean7.339999999999989
valid_direction_median8.433333333333339
valid_direction_min0
4468517JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:06:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4464516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4461515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.7120539120435714, "good_angle": 60.41237896496043, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.266666666666676}, "ep001": {"nsteps": 500, "reward": -1.5852752513885495, "good_angle": 43.76801128381483, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.76666666666665}, "ep002": {"nsteps": 500, "reward": -0.1753730518561788, "good_angle": 0.34168158492967393, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.6000000000000019}, "ep003": {"nsteps": 500, "reward": -1.69318417096138, "good_angle": 43.82370898961464, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.799999999999984}, "ep004": {"nsteps": 500, "reward": -1.7138571786880492, "good_angle": 0.8260860192215858, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.1333333333333258}}
good_angle_max60.41237896496043
good_angle_mean29.83437336850823
good_angle_median43.76801128381483
good_angle_min0.34168158492967393
reward_max-0.1753730518561788
reward_mean-1.3759487129875458
reward_median-1.69318417096138
reward_min-1.7138571786880492
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max7.266666666666676
valid_direction_mean3.913333333333328
valid_direction_median4.76666666666665
valid_direction_min0.6000000000000019
4449514JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:06:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4441510Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationerrorno2400:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
    evaluator.score(cie)
  File "eval.py", line 96, in score
    raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4438508JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:06:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4434488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4432507JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4428506JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:06:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4424488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4422504JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4419504JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4402488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4398502Liam PaullTensorflow templateaido1_LF1_r3-v3step3-videossuccessno2400:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4392501Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999983


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -11.11132962695372, "good_angle": 3.481079425999562, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 281, "reward": -4.521031430077298, "good_angle": 15.84928678080855, "survival_time": 9.366666666666644, "traveled_tiles": 4, "valid_direction": 3.4999999999999885}, "ep002": {"nsteps": 500, "reward": -0.16403283863254184, "good_angle": 0.24367834358166565, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 0.2333333333333325}, "ep003": {"nsteps": 216, "reward": -6.629146578135313, "good_angle": 14.501328060144532, "survival_time": 7.199999999999984, "traveled_tiles": 3, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 225, "reward": -4.7080057672977755, "good_angle": 1.5709037293728847, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.499999999999996}}
good_angle_max15.84928678080855
good_angle_mean7.129255267981439
good_angle_median3.481079425999562
good_angle_min0.24367834358166565
reward_max-0.16403283863254184
reward_mean-5.426709248219329
reward_median-4.7080057672977755
reward_min-11.11132962695372
survival_time_max16.666666666666654
survival_time_mean8.779999999999987
survival_time_min3.166666666666665
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max3.599999999999987
valid_direction_mean2.699999999999994
valid_direction_median3.4999999999999885
valid_direction_min0.2333333333333325
4388488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4385500heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 94, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    cis.info(observation.shape)
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 121, in info
    dclogger.info('solution:%s' % s)
TypeError: not all arguments converted during string formatting


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4383498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4379498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videoserrorno2400:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4379-8571', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4379-8571', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4375496heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 32, in solve
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 76, in __init__
    self.undistort = UndistortWrapper(env)
  File "/workspace/wrappers.py", line 182, in __init__
    assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4373495heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2400:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4369495heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2400:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4345488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4322488JonJP pipelineaido1_LF1_r3-v3step3-videosabortedno2400:31:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
4321490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4320488JonJP pipelineaido1_LF1_r3-v3step3-videosabortedno2400:31:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
4319490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
4318488JonJP pipelineaido1_LF1_r3-v3step3-videosabortedno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4316490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5327242352018365, "good_angle": 28.651288114844927, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.933333333333348}, "ep001": {"nsteps": 500, "reward": -0.3152015329403803, "good_angle": 18.008227041415477, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.1666666666666554}, "ep002": {"nsteps": 500, "reward": -0.3838280936330557, "good_angle": 0.04016557764447126, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3823062506136484, "good_angle": 20.09321848402581, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.266666666666656}, "ep004": {"nsteps": 91, "reward": -13.493354661124092, "good_angle": 0.878727362866366, "survival_time": 3.0333333333333323, "traveled_tiles": 2, "valid_direction": 1.3333333333333304}}
good_angle_max28.651288114844927
good_angle_mean13.53432531615941
good_angle_median18.008227041415477
good_angle_min0.04016557764447126
reward_max-0.3152015329403803
reward_mean-3.021482954702603
reward_median-0.3838280936330557
reward_min-13.493354661124092
survival_time_max16.666666666666654
survival_time_mean13.939999999999989
survival_time_min3.0333333333333323
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max5.933333333333348
valid_direction_mean2.739999999999998
valid_direction_median3.1666666666666554
valid_direction_min0
4315488JonJP pipelineaido1_LF1_r3-v3step3-videosabortedno2400:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4312490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
4289455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4287455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4283484JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4280484JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2400:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4278484JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 205, "reward": -6.436500313805371, "good_angle": 20.54234196110034, "survival_time": 6.833333333333319, "traveled_tiles": 3, "valid_direction": 5.633333333333319}, "ep001": {"nsteps": 469, "reward": -5.105829094137464, "good_angle": 10.42085039660989, "survival_time": 15.633333333333288, "traveled_tiles": 1, "valid_direction": 15.333333333333288}, "ep002": {"nsteps": 500, "reward": -2.869587086454034, "good_angle": 11.38326827745385, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 15.999999999999988}, "ep003": {"nsteps": 500, "reward": -3.1171939115524294, "good_angle": 11.351444369645655, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.133333333333322}, "ep004": {"nsteps": 500, "reward": -2.3990961790084837, "good_angle": 1.5751847876703131, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max20.54234196110034
good_angle_mean11.05461795849601
good_angle_median11.351444369645655
good_angle_min1.5751847876703131
reward_max-2.3990961790084837
reward_mean-3.985641316991556
reward_median-3.1171939115524294
reward_min-6.436500313805371
survival_time_max16.666666666666654
survival_time_mean14.493333333333316
survival_time_min6.833333333333319
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.133333333333322
valid_direction_mean10.61999999999998
valid_direction_median15.333333333333288
valid_direction_min0
4276483JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2400:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: unbound method __init__() must be called with ObservationWrapper instance as first argument (got undistort_JP instance instead)

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4267455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4259455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4254478JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2400:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4251478JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2400:05:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4250477JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2400:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'a' referenced before assignment

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4243476JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999989


other stats
episodes
details{"ep000": {"nsteps": 111, "reward": -11.36772947751724, "good_angle": 15.036579273402849, "survival_time": 3.6999999999999966, "traveled_tiles": 2, "valid_direction": 2.5999999999999965}, "ep001": {"nsteps": 240, "reward": -5.061970520999361, "good_angle": 13.047443438349845, "survival_time": 7.999999999999981, "traveled_tiles": 3, "valid_direction": 2.5666666666666575}, "ep002": {"nsteps": 343, "reward": -3.49004908525127, "good_angle": 1.8945685208986096, "survival_time": 11.433333333333303, "traveled_tiles": 5, "valid_direction": 1.533333333333328}, "ep003": {"nsteps": 169, "reward": -7.610986089565345, "good_angle": 18.29493943558457, "survival_time": 5.633333333333323, "traveled_tiles": 3, "valid_direction": 2.666666666666657}, "ep004": {"nsteps": 174, "reward": -7.811967819792636, "good_angle": 3.971270190950071, "survival_time": 5.799999999999989, "traveled_tiles": 3, "valid_direction": 2.033333333333326}}
good_angle_max18.29493943558457
good_angle_mean10.44896017183719
good_angle_median13.047443438349845
good_angle_min1.8945685208986096
reward_max-3.49004908525127
reward_mean-7.0685405986251695
reward_median-7.610986089565345
reward_min-11.36772947751724
survival_time_max11.433333333333303
survival_time_mean6.913333333333318
survival_time_min3.6999999999999966
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max2.666666666666657
valid_direction_mean2.279999999999993
valid_direction_median2.5666666666666575
valid_direction_min1.533333333333328
4238455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.71801254535333, "good_angle": 1.288231067747685, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900271487386944
good_angle_median1.288231067747685
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.21732336895035
reward_median-26.71801254535333
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4233454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4227472JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2400:00:38
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission472/step1-simulation-rudolf-8-job4227/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4222454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4215448JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4210454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4205455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.71801254535333, "good_angle": 1.288231067747685, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900271487386944
good_angle_median1.288231067747685
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.21732336895035
reward_median-26.71801254535333
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4203468sodabetaPyTorch templateaido1_LF1_r3-v3step4-vizerrorno2400:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4203-1705', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4203-1705', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4197448JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4196454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4192455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4189468sodabetaPyTorch templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4184448JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4180466sodabetaRandom executionaido1_LF1_r3-v3step3-videossuccessno2400:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4176454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4173455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4167448JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4163465JonROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:01:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4159465JonROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.733333333333295


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5793949821187416, "good_angle": 29.405881588842963, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.066666666666678}, "ep001": {"nsteps": 412, "reward": -2.872147422026192, "good_angle": 12.019882930897918, "survival_time": 13.733333333333295, "traveled_tiles": 4, "valid_direction": 2.666666666666657}, "ep002": {"nsteps": 500, "reward": -0.37387549106776713, "good_angle": 0.029804767821604836, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 267, "reward": -4.470494654210989, "good_angle": 14.562233685446616, "survival_time": 8.899999999999979, "traveled_tiles": 4, "valid_direction": 3.0999999999999908}, "ep004": {"nsteps": 85, "reward": -14.315450701994054, "good_angle": 0.7932405597856635, "survival_time": 2.833333333333333, "traveled_tiles": 2, "valid_direction": 1.4666666666666657}}
good_angle_max29.405881588842963
good_angle_mean11.362208706558953
good_angle_median12.019882930897918
good_angle_min0.029804767821604836
reward_max-0.37387549106776713
reward_mean-4.522272650283549
reward_median-2.872147422026192
reward_min-14.315450701994054
survival_time_max16.666666666666654
survival_time_mean11.759999999999984
survival_time_min2.833333333333333
traveled_tiles_max5
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max7.066666666666678
valid_direction_mean2.859999999999998
valid_direction_median2.666666666666657
valid_direction_min0
4155455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4148464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4138460MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2400:02:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4136448JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2400:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4132448JonRandom executionaido1_LF1_r3-v3step3-videossuccessno2400:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4128459Dzenan LapandicTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2400:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4121454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4118454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
4117455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4110447JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4109448JonRandom executionaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4106454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
4104455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4100456hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4096456hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.966666666666628


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5387819468716262, "good_angle": 28.31636892759439, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.800000000000012}, "ep001": {"nsteps": 419, "reward": -2.849345911629854, "good_angle": 10.74415739766498, "survival_time": 13.966666666666628, "traveled_tiles": 4, "valid_direction": 2.79999999999999}, "ep002": {"nsteps": 500, "reward": -0.3736067820861936, "good_angle": 0.040912040225681685, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 271, "reward": -4.441368413064972, "good_angle": 12.350672066441046, "survival_time": 9.033333333333312, "traveled_tiles": 4, "valid_direction": 2.866666666666658}, "ep004": {"nsteps": 38, "reward": -29.060990666088305, "good_angle": 1.3949491907304548, "survival_time": 1.2666666666666673, "traveled_tiles": 1, "valid_direction": 1.1666666666666672}}
good_angle_max28.31636892759439
good_angle_mean10.569411924531313
good_angle_median10.74415739766498
good_angle_min0.040912040225681685
reward_max-0.3736067820861936
reward_mean-7.45281874394819
reward_median-2.849345911629854
reward_min-29.060990666088305
survival_time_max16.666666666666654
survival_time_mean11.519999999999984
survival_time_min1.2666666666666673
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max6.800000000000012
valid_direction_mean2.7266666666666652
valid_direction_median2.79999999999999
valid_direction_min0
4094453JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno2400:00:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4093451JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno2400:00:18
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4082455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2400:05:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4080452JonRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
4079453JonRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
4076438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
4075449JonRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2400:31:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
4074447JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2400:33:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4073448JonRandom executionaido1_LF1_r3-v3step2-scoringtimeoutno2400:33:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4062442JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2400:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4062-1236', 'pull']:

   >  Command '['docker-compose', '-p', 'job4062-1236', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4061440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4058441orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -26.035667676851155, "good_angle": 1.2822907306824798, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep001": {"nsteps": 40, "reward": -26.000648751854897, "good_angle": 1.2843167211539923, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.5019761833264492, "good_angle": 32.352741554698035, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.06666666666664}, "ep003": {"nsteps": 28, "reward": -37.52138234462057, "good_angle": 0.9961203841089294, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.154680615977234, "good_angle": 0.3837631620541834, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max32.352741554698035
good_angle_mean7.259846510539523
good_angle_median1.2822907306824798
good_angle_min0.3837631620541834
reward_max-0.5019761833264492
reward_mean-29.042871114526054
reward_median-26.035667676851155
reward_min-55.154680615977234
survival_time_max16.666666666666654
survival_time_mean4.179999999999998
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.06666666666664
valid_direction_mean3.5399999999999947
valid_direction_median1.1666666666666674
valid_direction_min0.49999999999999994
4056438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4053440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4050438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2400:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4049439BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2400:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission439/step1-simulation-rudolf-8-job4049/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4046436orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4040432Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2400:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4035434BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2400:00:36
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission434/step1-simulation-rudolf-8-job4035/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4028428SashkasemRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 117, "reward": -9.991474496503162, "good_angle": 8.866560177579744, "survival_time": 3.899999999999996, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.3888421014547348, "good_angle": 3.638173429102398, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0.4}, "ep002": {"nsteps": 500, "reward": 0.23706295147072523, "good_angle": 0.1326869096702976, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -2.333500215291977, "good_angle": 121.97850228305688, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 14.566666666666652}, "ep004": {"nsteps": 500, "reward": -2.341332432746887, "good_angle": 0.016734103965512847, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max121.97850228305688
good_angle_mean26.92653138067497
good_angle_median3.638173429102398
good_angle_min0.016734103965512847
reward_max0.23706295147072523
reward_mean-2.9636172589052068
reward_median-2.333500215291977
reward_min-9.991474496503162
survival_time_max16.666666666666654
survival_time_mean14.113333333333324
survival_time_min3.899999999999996
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max14.566666666666652
valid_direction_mean3.286666666666662
valid_direction_median0.4
valid_direction_min0
4026426heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4024426heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.999999999999992


other stats
episodes
details{"ep000": {"nsteps": 134, "reward": -9.66455109350717, "good_angle": 15.541938407143263, "survival_time": 4.466666666666661, "traveled_tiles": 2, "valid_direction": 3.0666666666666593}, "ep001": {"nsteps": 150, "reward": -8.57790863831838, "good_angle": 0.5700214220288374, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 2.56666666666666}, "ep002": {"nsteps": 177, "reward": -5.710972491267668, "good_angle": 0.26672583536394956, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 153, "reward": -8.741664406520869, "good_angle": 7.163127806529571, "survival_time": 5.099999999999992, "traveled_tiles": 3, "valid_direction": 1.0333333333333297}, "ep004": {"nsteps": 67, "reward": -17.572272624542464, "good_angle": 0.1893898460350353, "survival_time": 2.233333333333335, "traveled_tiles": 2, "valid_direction": 0.36666666666666714}}
good_angle_max15.541938407143263
good_angle_mean4.7462406634201315
good_angle_median0.5700214220288374
good_angle_min0.1893898460350353
reward_max-5.710972491267668
reward_mean-10.05347385083131
reward_median-8.741664406520869
reward_min-17.572272624542464
survival_time_max5.899999999999989
survival_time_mean4.539999999999994
survival_time_min2.233333333333335
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.0666666666666593
valid_direction_mean1.4066666666666632
valid_direction_median1.0333333333333297
valid_direction_min0
4023427heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4021425SashkasemSolution templateaido1_luck-v3step1successyes2400:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
score145.909290170159295


4020424MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4018424MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4016424MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.766666666666663


other stats
episodes
details{"ep000": {"nsteps": 68, "reward": -16.357410183724234, "good_angle": 6.7225820502488, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 1.5000000000000018}, "ep001": {"nsteps": 113, "reward": -10.377122461795809, "good_angle": 0.6611195206538688, "survival_time": 3.766666666666663, "traveled_tiles": 2, "valid_direction": 2.133333333333328}, "ep002": {"nsteps": 114, "reward": -10.391047790581196, "good_angle": 1.2390121838547463, "survival_time": 3.799999999999996, "traveled_tiles": 2, "valid_direction": 3.099999999999996}, "ep003": {"nsteps": 149, "reward": -9.07946408995046, "good_angle": 3.2384714278815125, "survival_time": 4.966666666666659, "traveled_tiles": 3, "valid_direction": 0.433333333333332}, "ep004": {"nsteps": 55, "reward": -20.72703512798656, "good_angle": 0.23454960407846256, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 0.8000000000000024}}
good_angle_max6.7225820502488
good_angle_mean2.419146957343478
good_angle_median1.2390121838547463
good_angle_min0.23454960407846256
reward_max-9.07946408995046
reward_mean-13.386415930807653
reward_median-10.391047790581196
reward_min-20.72703512798656
survival_time_max4.966666666666659
survival_time_mean3.3266666666666644
survival_time_min1.8333333333333357
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.099999999999996
valid_direction_mean1.593333333333332
valid_direction_median1.5000000000000018
valid_direction_min0.433333333333332
4015424MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2400:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4012423MandanaSamieiPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.366666666666654


other stats
episodes
details{"ep000": {"nsteps": 191, "reward": -6.594921462432876, "good_angle": 25.15809625748351, "survival_time": 6.366666666666654, "traveled_tiles": 2, "valid_direction": 4.099999999999985}, "ep001": {"nsteps": 231, "reward": -4.532492851499807, "good_angle": 0.3839632103042235, "survival_time": 7.699999999999982, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 177, "reward": -5.730163173352784, "good_angle": 0.24975201196822353, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 219, "reward": -7.0042407049980335, "good_angle": 17.109359826318123, "survival_time": 7.299999999999984, "traveled_tiles": 3, "valid_direction": 2.933333333333323}, "ep004": {"nsteps": 66, "reward": -17.764905925953027, "good_angle": 0.19057792438439772, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 0.6333333333333337}}
good_angle_max25.15809625748351
good_angle_mean8.618349846091695
good_angle_median0.3839632103042235
good_angle_min0.19057792438439772
reward_max-4.532492851499807
reward_mean-8.325344823647304
reward_median-6.594921462432876
reward_min-17.764905925953027
survival_time_max7.699999999999982
survival_time_mean5.893333333333322
survival_time_min2.200000000000002
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max4.099999999999985
valid_direction_mean1.5333333333333283
valid_direction_median0.6333333333333337
valid_direction_min0
4009422jahanviRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4006422jahanviRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.966666666666645


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.639713048934936, "good_angle": 25.19146169910629, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 375, "reward": -3.8937896972497303, "good_angle": 24.622449211170416, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 500, "reward": 0.02070584638358559, "good_angle": 0.41528803023102856, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.1333333333333648}, "ep003": {"nsteps": 258, "reward": -5.905082889305529, "good_angle": 26.07364517252711, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 269, "reward": -5.511848372260981, "good_angle": 4.860136898949597, "survival_time": 8.966666666666645, "traveled_tiles": 3, "valid_direction": 2.966666666666657}}
good_angle_max26.07364517252711
good_angle_mean16.232596202396884
good_angle_median24.622449211170416
good_angle_min0.41528803023102856
reward_max0.02070584638358559
reward_mean-4.585945632273519
reward_median-5.511848372260981
reward_min-7.639713048934936
survival_time_max16.666666666666654
survival_time_mean10.486666666666649
survival_time_min5.6999999999999895
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9333333333333207
valid_direction_mean3.1666666666666634
valid_direction_median3.899999999999986
valid_direction_min1.1333333333333648
4002419happyduckiePyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3999419happyduckiePyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3997417placaillePyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3994417placaillePyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -12.69349746678465, "good_angle": 10.050552262699584, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 1.933333333333332}, "ep001": {"nsteps": 75, "reward": -14.920292414824168, "good_angle": 0.7334308202326671, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 1.7666666666666675}, "ep002": {"nsteps": 95, "reward": -11.689704145412696, "good_angle": 0.8477691805638999, "survival_time": 3.166666666666665, "traveled_tiles": 2, "valid_direction": 2.2333333333333316}, "ep003": {"nsteps": 146, "reward": -9.225531858940649, "good_angle": 3.491725595347668, "survival_time": 4.866666666666659, "traveled_tiles": 3, "valid_direction": 0.433333333333332}, "ep004": {"nsteps": 42, "reward": -26.369683748199822, "good_angle": 0.2143781414172637, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 0.6333333333333344}}
good_angle_max10.050552262699584
good_angle_mean3.067571200052216
good_angle_median0.8477691805638999
good_angle_min0.2143781414172637
reward_max-9.225531858940649
reward_mean-14.979741926832398
reward_median-12.69349746678465
reward_min-26.369683748199822
survival_time_max4.866666666666659
survival_time_mean3.006666666666665
survival_time_min1.400000000000001
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.2333333333333316
valid_direction_mean1.3999999999999997
valid_direction_median1.7666666666666675
valid_direction_min0.433333333333332
3991416BenjaminROS-based Lane Followingaido1_LF1_r3-v3step4-vizerrorno2400:00:11
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job3991-1136', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job3991-1136', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3989416BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5299001764110289, "good_angle": 28.27516945351004, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.366666666666681}, "ep001": {"nsteps": 419, "reward": -2.832638019451378, "good_angle": 15.009670035736756, "survival_time": 13.966666666666628, "traveled_tiles": 4, "valid_direction": 2.79999999999999}, "ep002": {"nsteps": 500, "reward": -0.3808008095175028, "good_angle": 0.042161689652295505, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 272, "reward": -4.417334762730581, "good_angle": 14.901149467404672, "survival_time": 9.066666666666643, "traveled_tiles": 4, "valid_direction": 2.933333333333324}, "ep004": {"nsteps": 500, "reward": -0.7570084566128208, "good_angle": 2.630224476774538, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.033333333333328}}
good_angle_max28.27516945351004
good_angle_mean12.17167502461566
good_angle_median14.901149467404672
good_angle_min0.042161689652295505
reward_max-0.3808008095175028
reward_mean-1.783536444944663
reward_median-0.7570084566128208
reward_min-4.417334762730581
survival_time_max16.666666666666654
survival_time_mean14.60666666666665
survival_time_min9.066666666666643
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.366666666666681
valid_direction_mean3.626666666666664
valid_direction_median2.933333333333324
valid_direction_min0
3987414Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3982415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2400:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3977414Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2400:07:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3976413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2400:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3974413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.099999999999978


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.5167744592790715, "good_angle": 16.164924527816332, "survival_time": 5.6999999999999895, "traveled_tiles": 3, "valid_direction": 3.333333333333322}, "ep001": {"nsteps": 403, "reward": -2.9321392473947285, "good_angle": 7.703963724348029, "survival_time": 13.433333333333296, "traveled_tiles": 4, "valid_direction": 2.5666666666666575}, "ep002": {"nsteps": 500, "reward": -0.3806745297759771, "good_angle": 0.032737717717656406, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 273, "reward": -4.398916779747813, "good_angle": 13.93652985780916, "survival_time": 9.099999999999978, "traveled_tiles": 4, "valid_direction": 2.933333333333324}, "ep004": {"nsteps": 40, "reward": -27.711050206422804, "good_angle": 1.335388568603442, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.2000000000000006}}
good_angle_max16.164924527816332
good_angle_mean7.8347088792589235
good_angle_median7.703963724348029
good_angle_min0.032737717717656406
reward_max-0.3806745297759771
reward_mean-8.387911044524078
reward_median-4.398916779747813
reward_min-27.711050206422804
survival_time_max16.666666666666654
survival_time_mean9.246666666666652
survival_time_min1.333333333333334
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max3.333333333333322
valid_direction_mean2.006666666666661
valid_direction_median2.5666666666666575
valid_direction_min0
3970411Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2400:10:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3969410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessno2400:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3965410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2400:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3962410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.9666666666666623


other stats
episodes
details{"ep000": {"nsteps": 129, "reward": -9.690229099850322, "good_angle": 21.744915339688692, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 3.0999999999999943}, "ep001": {"nsteps": 119, "reward": -8.645585073213663, "good_angle": 0.7734098568832906, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 1.233333333333329}, "ep002": {"nsteps": 110, "reward": -9.14712228512402, "good_angle": 0.35922224109675066, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 191, "reward": -6.671444808157327, "good_angle": 17.399821852370195, "survival_time": 6.366666666666654, "traveled_tiles": 3, "valid_direction": 3.8666666666666583}, "ep004": {"nsteps": 59, "reward": -19.454236374063008, "good_angle": 0.2504186638957055, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.8333333333333359}}
good_angle_max21.744915339688692
good_angle_mean8.105557590786928
good_angle_median0.7734098568832906
good_angle_min0.2504186638957055
reward_max-6.671444808157327
reward_mean-10.721723528081668
reward_median-9.14712228512402
reward_min-19.454236374063008
survival_time_max6.366666666666654
survival_time_mean4.053333333333328
survival_time_min1.9666666666666697
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.8666666666666583
valid_direction_mean1.9933333333333296
valid_direction_median1.233333333333329
valid_direction_min0.8333333333333359
3956408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3954408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3952408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7333333333333334


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.898837703030283, "good_angle": 9.072292878774263, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.6666666666666667}, "ep001": {"nsteps": 76, "reward": -14.719160148187688, "good_angle": 0.6928650066234555, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 1.8666666666666671}, "ep002": {"nsteps": 94, "reward": -11.86349624894718, "good_angle": 0.939482044436862, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.0999999999999988}, "ep003": {"nsteps": 145, "reward": -9.276180560835476, "good_angle": 3.4742654860667987, "survival_time": 4.833333333333326, "traveled_tiles": 3, "valid_direction": 0.433333333333332}, "ep004": {"nsteps": 44, "reward": -25.306292913176797, "good_angle": 0.22760734092946203, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.666666666666668}}
good_angle_max9.072292878774263
good_angle_mean2.8813025513661676
good_angle_median0.939482044436862
good_angle_min0.22760734092946203
reward_max-9.276180560835476
reward_mean-15.012793514835485
reward_median-13.898837703030283
reward_min-25.306292913176797
survival_time_max4.833333333333326
survival_time_mean2.9399999999999986
survival_time_min1.466666666666668
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.0999999999999988
valid_direction_mean1.3466666666666665
valid_direction_median1.6666666666666667
valid_direction_min0.433333333333332
3950407Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationerrorno2400:00:37
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission407/step1-simulation-rudolf-8-job3950/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3949406Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationerrorno2400:00:41
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission406/step1-simulation-rudolf-8-job3949/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3940399Alex1114Solution templateaido1_luck-v3step1abortedyes2400:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
score19.568818724898676


3937398Maxim KuzminRandom executionaido1_LF1_r3-v3step3-videossuccessno2400:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3933397PolyProgrammistRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3928396anna.tsalapovasimple submitionaido1_LF1_r3-v3step3-videossuccessno2400:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3922395Maxim KuzminRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.777325500460232, "good_angle": 23.73206443704702, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 379, "reward": -3.903377290608701, "good_angle": 25.225543794159297, "survival_time": 12.6333333333333, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep002": {"nsteps": 304, "reward": -3.299739558917185, "good_angle": 0.1450889818403155, "survival_time": 10.133333333333308, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.069876175056132, "good_angle": 25.91763516453875, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 271, "reward": -5.515748887463745, "good_angle": 4.9426335303917845, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max25.91763516453875
good_angle_mean15.992593181595437
good_angle_median23.73206443704702
good_angle_min0.1450889818403155
reward_max-3.299739558917185
reward_mean-5.313213482501199
reward_median-5.515748887463745
reward_min-7.777325500460232
survival_time_max12.6333333333333
survival_time_mean9.213333333333312
survival_time_min5.666666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.966666666666653
valid_direction_mean2.95999999999999
valid_direction_median3.899999999999987
valid_direction_min0
3916394Maxim KuzminRandom executionaido1_LF1_r3-v3step3-videossuccessno2400:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3912394Maxim KuzminRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2400:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3909392Liam PaullPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3906392Liam PaullPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:01:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3905389Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessno2400:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3903389Liam PaullRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.739968070563148, "good_angle": 24.356772244201625, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 377, "reward": -3.3342322190159397, "good_angle": 22.456211441752913, "survival_time": 12.566666666666633, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 500, "reward": 0.07154662412157632, "good_angle": 0.5835680561070901, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.5666666666666966}, "ep003": {"nsteps": 260, "reward": -6.42873113476313, "good_angle": 25.77385898697743, "survival_time": 8.666666666666647, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep004": {"nsteps": 271, "reward": -5.661266369036333, "good_angle": 5.575919509161841, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.09999999999999}}
good_angle_max25.77385898697743
good_angle_mean15.749266047640177
good_angle_median22.456211441752913
good_angle_min0.5835680561070901
reward_max0.07154662412157632
reward_mean-4.618530233851395
reward_median-5.661266369036333
reward_min-7.739968070563148
survival_time_max16.666666666666654
survival_time_mean10.51999999999998
survival_time_min5.666666666666656
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666535
valid_direction_mean3.2999999999999963
valid_direction_median3.9333333333333194
valid_direction_min1.5666666666666966
3899388SashkasemSolution templateaido1_luck-v3step1successyes2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
score175.80775616513584


3895386Bhairav MehtaPyTorch DDPG baselineaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 97, "reward": -12.384443586020126, "good_angle": 11.860046164159344, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.266666666666665}, "ep001": {"nsteps": 74, "reward": -15.065170561945116, "good_angle": 0.7425171315504571, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.700000000000001}, "ep002": {"nsteps": 93, "reward": -12.099754054459831, "good_angle": 0.9820208164628128, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.199999999999999}, "ep003": {"nsteps": 140, "reward": -9.513920048304966, "good_angle": 2.707333000264921, "survival_time": 4.66666666666666, "traveled_tiles": 3, "valid_direction": 0.5333333333333322}, "ep004": {"nsteps": 44, "reward": -25.369096869772132, "good_angle": 0.2404578152820228, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.9333333333333348}}
good_angle_max11.860046164159344
good_angle_mean3.306474985543912
good_angle_median0.9820208164628128
good_angle_min0.2404578152820228
reward_max-9.513920048304966
reward_mean-14.886477024100436
reward_median-12.384443586020126
reward_min-25.369096869772132
survival_time_max4.66666666666666
survival_time_mean2.9866666666666655
survival_time_min1.466666666666668
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.266666666666665
valid_direction_mean1.5266666666666662
valid_direction_median1.700000000000001
valid_direction_min0.5333333333333322
3892385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2400:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3890385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.133333333333332


other stats
episodes
details{"ep000": {"nsteps": 68, "reward": -16.281593110631494, "good_angle": 7.128279810058063, "survival_time": 2.2666666666666684, "traveled_tiles": 2, "valid_direction": 1.5333333333333352}, "ep001": {"nsteps": 101, "reward": -11.260839751451323, "good_angle": 0.6826700596614759, "survival_time": 3.3666666666666645, "traveled_tiles": 2, "valid_direction": 1.6666666666666623}, "ep002": {"nsteps": 94, "reward": -11.800562986430336, "good_angle": 0.8354016693024766, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.2999999999999985}, "ep003": {"nsteps": 142, "reward": -9.412202820811473, "good_angle": 2.96274209330573, "survival_time": 4.733333333333326, "traveled_tiles": 3, "valid_direction": 0.5999999999999988}, "ep004": {"nsteps": 48, "reward": -23.47101021806399, "good_angle": 0.23302195484849497, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 1.0666666666666682}}
good_angle_max7.128279810058063
good_angle_mean2.368423117435248
good_angle_median0.8354016693024766
good_angle_min0.23302195484849497
reward_max-9.412202820811473
reward_mean-14.445241777477724
reward_median-11.800562986430336
reward_min-23.47101021806399
survival_time_max4.733333333333326
survival_time_mean3.0199999999999987
survival_time_min1.6000000000000016
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max2.2999999999999985
valid_direction_mean1.433333333333333
valid_direction_median1.5333333333333352
valid_direction_min0.5999999999999988
3888385Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2400:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3886384ivanthaSolution templateaido1_luck-v3step1successyes2400:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
score169.35408794105047


3885382Andrea CensiTensorflow templateaido1_LFV_r1-v3step4-vizsuccessno2400:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3878383Andrea CensiRandom executionaido1_LF1_r3-v3step4-viztimeoutno2400:11:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
3875383Andrea CensiRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2400:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.966666666666645


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.81285531605993, "good_angle": 23.476013097647296, "survival_time": 5.59999999999999, "traveled_tiles": 2, "valid_direction": 3.8666666666666543}, "ep001": {"nsteps": 375, "reward": -3.4387499952232465, "good_angle": 22.289230527951595, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 363, "reward": -2.809226464649814, "good_angle": 0.11652595619339516, "survival_time": 12.099999999999968, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -6.067996551171233, "good_angle": 26.580938366474136, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep004": {"nsteps": 269, "reward": -5.601119281128603, "good_angle": 5.078170080934802, "survival_time": 8.966666666666645, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.580938366474136
good_angle_mean15.508175605840243
good_angle_median22.289230527951595
good_angle_min0.11652595619339516
reward_max-2.809226464649814
reward_mean-5.145989521646565
reward_median-5.601119281128603
reward_min-7.81285531605993
survival_time_max12.499999999999966
survival_time_mean9.559999999999976
survival_time_min5.59999999999999
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666535
valid_direction_mean2.9533333333333234
valid_direction_median3.8666666666666543
valid_direction_min0
3871382Andrea CensiTensorflow templateaido1_LFV_r1-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.766666666666663


other stats
episodes
details{"ep000": {"nsteps": 48, "reward": -21.42554907328061, "good_angle": 2.8207892741930283, "survival_time": 1.6000000000000016, "traveled_tiles": 3, "valid_direction": 1.2000000000000015}, "ep001": {"nsteps": 113, "reward": -9.126021487457034, "good_angle": 0.4336047256271916, "survival_time": 3.766666666666663, "traveled_tiles": 2, "valid_direction": 0.6333333333333311}, "ep002": {"nsteps": 243, "reward": -4.33631397868864, "good_angle": 0.5664875769269541, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 40, "reward": -27.10161850526929, "good_angle": 0.3398250760817241, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.8333333333333335}, "ep004": {"nsteps": 144, "reward": -7.179838152958029, "good_angle": 0.3167340923939786, "survival_time": 4.799999999999993, "traveled_tiles": 4, "valid_direction": 0.966666666666666}}
good_angle_max2.8207892741930283
good_angle_mean0.8954881490445754
good_angle_median0.4336047256271916
good_angle_min0.3167340923939786
reward_max-4.33631397868864
reward_mean-13.83386823953072
reward_median-9.126021487457034
reward_min-27.10161850526929
survival_time_max8.099999999999982
survival_time_mean3.9199999999999946
survival_time_min1.333333333333334
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.2000000000000015
valid_direction_mean0.8466666666666665
valid_direction_median0.8333333333333335
valid_direction_min0.5999999999999999
3870382Andrea CensiTensorflow templateaido1_LFV_r1-v3step2-scoringtimeoutno2400:11:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
3868166Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationfailedno2400:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server


Hidden. If you are the author, please login using the top-right link or use the dashboard.
3866381ivanthaSolution templateaido1_luck-v3step1successyes2400:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
score164.75929927276479


3865372lavoiemsTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2400:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3861376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2400:11:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
3859379ivanthaSolution templateaido1_luck-v3step1successyes2400:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
score117.763631603663725


3853376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3852379ivanthaSolution templateaido1_luck-v3step1timeoutyes2400:11:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
3850379ivanthaSolution templateaido1_luck-v3step1timeoutyes2400:11:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
3849380ivanthaSolution templateaido1_luck-v3step1successyes2400:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
score132.38497355572028


3846372lavoiemsTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.166666666666662


other stats
episodes
details{"ep000": {"nsteps": 42, "reward": -24.247367578098505, "good_angle": 1.4919614755985182, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 1.333333333333334}, "ep001": {"nsteps": 125, "reward": -8.128652286583558, "good_angle": 0.603657008897622, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.033333333333331}, "ep002": {"nsteps": 500, "reward": 0.08990062048962863, "good_angle": 0.27011240616433024, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.33333333333333215}, "ep003": {"nsteps": 80, "reward": -13.023323695920409, "good_angle": 1.7707682647873908, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 1.533333333333332}, "ep004": {"nsteps": 500, "reward": 0.07465394114446826, "good_angle": 1.1338198528210175, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.5999999999999974}}
good_angle_max1.7707682647873908
good_angle_mean1.0540638016537758
good_angle_median1.1338198528210175
good_angle_min0.27011240616433024
reward_max0.08990062048962863
reward_mean-9.046957799793676
reward_median-8.128652286583558
reward_min-24.247367578098505
survival_time_max16.666666666666654
survival_time_mean8.313333333333327
survival_time_min1.400000000000001
traveled_tiles_max11
traveled_tiles_mean6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.5999999999999974
valid_direction_mean1.1666666666666654
valid_direction_median1.333333333333334
valid_direction_min0.33333333333333215
3833376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2400:11:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
3830372lavoiemsTensorflow templateaido1_LF1_r3-v3step2-scoringtimeoutno2400:11:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
3705375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
3492376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
3491378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
3486375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3485372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
3483372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3478374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
3476377anna.tsalapovasimple submissionaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
3473376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
3468375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
3462372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
3458374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3453376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3441374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3426375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3425372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3420374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3412376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3402375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3400372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3396374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3390376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3387375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3383372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
3380374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
3366375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3365375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3363372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
3360374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3356376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
3352375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
3350375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3348372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
3347372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
3346374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
3343374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
3341375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3340375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3339372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3338372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
3337374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3334374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3326372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
3323374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3322374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3320375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3318375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3316372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
3311374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3308375Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
3302374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
3297372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
3292374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
3291372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3286374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3283372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3278374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3276372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
3273374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
3270372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
3264374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
3259372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3257374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3243372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3240374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
3235372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
3212373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
3190374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
3185372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3178374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3175374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
3173372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
3169372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2400:11:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
3163370MandanaSamieiPyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyes2400:00:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean3.2933333333333294
good_angle_mean5.273807540445858
valid_direction_mean4.173333333333322


other stats
episodes
details{"ep000": {"nsteps": 139, "reward": -7.565178305818532, "good_angle": 2.9537029902021565, "survival_time": 4.633333333333327, "traveled_tiles": 2, "valid_direction": 3.833333333333327}, "ep001": {"nsteps": 132, "reward": -8.31976330325459, "good_angle": 3.3420249625431753, "survival_time": 4.399999999999994, "traveled_tiles": 1, "valid_direction": 3.199999999999994}, "ep002": {"nsteps": 266, "reward": -4.626618917087002, "good_angle": 14.881676847466942, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 6.966666666666649}, "ep003": {"nsteps": 500, "reward": -1.7608802081346513, "good_angle": 2.912241784465008, "survival_time": 1.1333333333333335, "traveled_tiles": 5, "valid_direction": 4.166666666666652}, "ep004": {"nsteps": 154, "reward": -8.994127320004749, "good_angle": 2.2793911175520125, "survival_time": 5.133333333333325, "traveled_tiles": 1, "valid_direction": 2.6999999999999904}}
good_angle_max14.881676847466942
good_angle_median2.9537029902021565
good_angle_min2.2793911175520125
reward_max-1.7608802081346513
reward_mean-6.2533136108599034
reward_median-7.565178305818532
reward_min-8.994127320004749
survival_time_max5.133333333333325
survival_time_median4.399999999999994
survival_time_min1.1333333333333335
traveled_tiles_max5
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max6.966666666666649
valid_direction_median3.833333333333327
valid_direction_min2.6999999999999904
3159370MandanaSamieiPyTorch DDPG templateaido1_LF1_r2-v3step1-simulationsuccessyes2400:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3156369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringtimeoutno2400:11:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
3153368lavoiemsRandom executionaido1_LF1_r2-v3step2-scoringsuccessyes2400:00:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean16.613333333333316
good_angle_mean18.911675225495497
valid_direction_mean11.279999999999992


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7512239266037941, "good_angle": 8.260605680285597, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 10.2}, "ep001": {"nsteps": 500, "reward": -1.276089951992035, "good_angle": 7.052116926454453, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 11.2}, "ep002": {"nsteps": 500, "reward": -1.0573792276978493, "good_angle": 67.40908496229231, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.266666666666652}, "ep003": {"nsteps": 500, "reward": -1.2037676911354065, "good_angle": 5.522359020361451, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.033333333333308}, "ep004": {"nsteps": 500, "reward": -0.9564020457863808, "good_angle": 6.314209538083673, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 9.700000000000005}}
good_angle_max67.40908496229231
good_angle_median7.052116926454453
good_angle_min5.522359020361451
reward_max-0.7512239266037941
reward_mean-1.048972568643093
reward_median-1.0573792276978493
reward_min-1.276089951992035
survival_time_max16.666666666666654
survival_time_median16.599999999999984
survival_time_min16.599999999999984
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_min1
valid_direction_max15.266666666666652
valid_direction_median10.2
valid_direction_min9.700000000000005
3151367lavoiemsSolution templateaido1_luck-v3step1successyes2400:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
score19.134040707162852


3150364pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3147364pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 138, "reward": -9.944227305011474, "good_angle": 17.78581226319914, "survival_time": 4.599999999999993, "traveled_tiles": 2, "valid_direction": 3.4666666666666597}, "ep001": {"nsteps": 171, "reward": -7.550793215545298, "good_angle": 0.5577320054156198, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.033333333333326}, "ep002": {"nsteps": 170, "reward": -5.945409335289151, "good_angle": 0.27434307464769914, "survival_time": 5.666666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.713866951715881, "good_angle": 11.904673601179828, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 1.9333333333333265}, "ep004": {"nsteps": 75, "reward": -15.857028853098551, "good_angle": 0.20094615150713888, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.7666666666666655}}
good_angle_max17.78581226319914
good_angle_mean6.144701419189885
good_angle_median0.5577320054156198
good_angle_min0.20094615150713888
reward_max-5.945409335289151
reward_mean-9.402265132132069
reward_median-7.713866951715881
reward_min-15.857028853098551
survival_time_max6.033333333333322
survival_time_mean4.899999999999992
survival_time_min2.500000000000001
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.4666666666666597
valid_direction_mean1.6399999999999957
valid_direction_median1.9333333333333265
valid_direction_min0
3145366MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedno2400:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 176, in predict
    return self.actor(state).cpu().data.numpy().flatten()
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/model.py", line 72, in forward
    x = self.lr(self.lin1(x))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
    return F.linear(input, self.weight, self.bias)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
    return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070


Hidden. If you are the author, please login using the top-right link or use the dashboard.
3143365MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2400:00:09
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job3143-98', 'pull']:

   >  Command '['docker-compose', '-p', 'job3143-98', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3141364pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 138, "reward": -9.944227305011474, "good_angle": 17.78581226319914, "survival_time": 4.599999999999993, "traveled_tiles": 2, "valid_direction": 3.4666666666666597}, "ep001": {"nsteps": 171, "reward": -7.550793215545298, "good_angle": 0.5577320054156198, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.033333333333326}, "ep002": {"nsteps": 170, "reward": -5.945409335289151, "good_angle": 0.27434307464769914, "survival_time": 5.666666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.713866951715881, "good_angle": 11.904673601179828, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 1.9333333333333265}, "ep004": {"nsteps": 75, "reward": -15.857028853098551, "good_angle": 0.20094615150713888, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.7666666666666655}}
good_angle_max17.78581226319914
good_angle_mean6.144701419189885
good_angle_median0.5577320054156198
good_angle_min0.20094615150713888
reward_max-5.945409335289151
reward_mean-9.402265132132069
reward_median-7.713866951715881
reward_min-15.857028853098551
survival_time_max6.033333333333322
survival_time_mean4.899999999999992
survival_time_min2.500000000000001
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.4666666666666597
valid_direction_mean1.6399999999999957
valid_direction_median1.9333333333333265
valid_direction_min0
3140364pravishsainathPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3139363lavoiemsSolution templateaido1_luck-v3step1successyes2400:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
score14.251405599899186


3128194Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2400:10:29
Timeout: Waited 603 [...]
Timeout:

Waited 603.032896996 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3126216Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2400:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3123360pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3121360pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.733333333333326


other stats
episodes
details{"ep000": {"nsteps": 142, "reward": -9.692435552116851, "good_angle": 15.985605656735844, "survival_time": 4.733333333333326, "traveled_tiles": 2, "valid_direction": 3.333333333333325}, "ep001": {"nsteps": 128, "reward": -9.535646964330226, "good_angle": 0.699093042728946, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.566666666666662}, "ep002": {"nsteps": 175, "reward": -5.808517497837809, "good_angle": 0.27306933648542453, "survival_time": 5.833333333333322, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 223, "reward": -6.57433466579882, "good_angle": 19.26987408449344, "survival_time": 7.433333333333317, "traveled_tiles": 3, "valid_direction": 2.966666666666656}, "ep004": {"nsteps": 70, "reward": -16.886796011243547, "good_angle": 0.16835225474307725, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 0.5999999999999996}}
good_angle_max19.26987408449344
good_angle_mean7.279198875037345
good_angle_median0.699093042728946
good_angle_min0.16835225474307725
reward_max-5.808517497837809
reward_mean-9.69954613826545
reward_median-9.535646964330226
reward_min-16.886796011243547
survival_time_max7.433333333333317
survival_time_mean4.919999999999993
survival_time_min2.333333333333335
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.333333333333325
valid_direction_mean1.8933333333333284
valid_direction_median2.566666666666662
valid_direction_min0
3112360pravishsainathPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3107274heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2400:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission274/step1-simulation-rudolf-8-job3107/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3105276heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2400:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission276/step1-simulation-rudolf-8-job3105/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3101277heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2400:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission277/step1-simulation-rudolf-8-job3101/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3099278heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2400:00:24
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission278/step1-simulation-rudolf-8-job3099/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3092356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2400:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.166666666666658


other stats
episodes
details{"ep000": {"nsteps": 141, "reward": -9.511167316149312, "good_angle": 15.743324928542936, "survival_time": 4.699999999999993, "traveled_tiles": 2, "valid_direction": 3.1999999999999917}, "ep001": {"nsteps": 155, "reward": -8.062011552241541, "good_angle": 0.7134488732173193, "survival_time": 5.166666666666658, "traveled_tiles": 2, "valid_direction": 2.5999999999999908}, "ep002": {"nsteps": 170, "reward": -5.9289599807220785, "good_angle": 0.24962530208830777, "survival_time": 5.666666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 195, "reward": -7.410639813007452, "good_angle": 13.68538506603259, "survival_time": 6.499999999999987, "traveled_tiles": 3, "valid_direction": 2.466666666666658}, "ep004": {"nsteps": 87, "reward": -14.009191551427731, "good_angle": 0.19292985966981793, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 0.8666666666666636}}
good_angle_max15.743324928542936
good_angle_mean6.1169428059101945
good_angle_median0.7134488732173193
good_angle_min0.19292985966981793
reward_max-5.9289599807220785
reward_mean-8.984394042709622
reward_median-8.062011552241541
reward_min-14.009191551427731
survival_time_max6.499999999999987
survival_time_mean4.986666666666658
survival_time_min2.8999999999999995
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.1999999999999917
valid_direction_mean1.8266666666666609
valid_direction_median2.466666666666658
valid_direction_min0
3090358heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2400:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3088358heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2400:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3086359heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2400:00:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 96, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Hidden. If you are the author, please login using the top-right link or use the dashboard.
3084358heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2400:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.566666666666653


other stats
episodes
details{"ep000": {"nsteps": 197, "reward": -6.429972624566955, "good_angle": 27.11176941861634, "survival_time": 6.566666666666653, "traveled_tiles": 2, "valid_direction": 4.166666666666652}, "ep001": {"nsteps": 266, "reward": -5.041398164753179, "good_angle": 8.840040093536695, "survival_time": 8.866666666666646, "traveled_tiles": 3, "valid_direction": 3.299999999999989}, "ep002": {"nsteps": 191, "reward": -5.2457417950158485, "good_angle": 0.25789555400513287, "survival_time": 6.366666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 234, "reward": -6.5656139972882395, "good_angle": 20.9154961995923, "survival_time": 7.799999999999982, "traveled_tiles": 3, "valid_direction": 3.1666666666666554}, "ep004": {"nsteps": 63, "reward": -18.509032287294904, "good_angle": 0.18597894634154147, "survival_time": 2.1000000000000023, "traveled_tiles": 2, "valid_direction": 0.8333333333333353}}
good_angle_max27.11176941861634
good_angle_mean11.4622360424184
good_angle_median8.840040093536695
good_angle_min0.18597894634154147
reward_max-5.041398164753179
reward_mean-8.358351773783825
reward_median-6.429972624566955
reward_min-18.509032287294904
survival_time_max8.866666666666646
survival_time_mean6.339999999999987
survival_time_min2.1000000000000023
traveled_tiles_max3
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.166666666666652
valid_direction_mean2.293333333333327
valid_direction_median3.1666666666666554
valid_direction_min0
3081358heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2400:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3055352heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2400:10:28
Timeout: Waited 602 [...]
Timeout:

Waited 602.12637496 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.