AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 239

evaluator239
ownerAndrea Censi
machineidsc-rudolf
processrudolf-7
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success230
# timeout90
# failed31
# error23
# aborted31
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5741764miksazRL solutionaido1_LF1_r3-v3step3-videossuccessno2390:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5735763Bhairav MehtaTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2390:12:05
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5734762miksazRL solutionaido1_LF1_r3-v3step4-vizsuccessno2390:02:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5728761Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5713758miksazRL solutionaido1_LF1_r3-v3step3-videossuccessno2390:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5707757miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessno2390:04:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5700756marshinPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5698756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2390:02:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5694755miksazRL solutionaido1_LF1_r3-v3step4-vizsuccessno2390:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5689755miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessno2390:03:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5669749Bhairav MehtaTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2390:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5663746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:01:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5659746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.548696717698127, "good_angle": 28.684855505295012, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.800000000000012}, "ep001": {"nsteps": 420, "reward": -2.85699049268317, "good_angle": 11.364116466976084, "survival_time": 13.99999999999996, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 500, "reward": -0.3748335072174668, "good_angle": 0.04184695451078903, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3654535314438399, "good_angle": 18.990907365152548, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.033333333333323}, "ep004": {"nsteps": 500, "reward": -0.777309577524662, "good_angle": 2.9080267667119855, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.2666666666666515}}
good_angle_max28.684855505295012
good_angle_mean12.397950611729282
good_angle_median11.364116466976084
good_angle_min0.04184695451078903
reward_max-0.3654535314438399
reward_mean-0.984656765313453
reward_median-0.548696717698127
reward_min-2.85699049268317
survival_time_max16.666666666666654
survival_time_mean16.13333333333332
survival_time_min13.99999999999996
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max6.800000000000012
valid_direction_mean3.806666666666662
valid_direction_median3.033333333333323
valid_direction_min0
5655746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:06:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5651745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2390:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5641742placailleROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5628737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5617737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:05:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5616736heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 55, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 21, in make_env
    kwargs={"frame_skip": config['frame_skip']})
TypeError: make() got an unexpected keyword argument 'kwargs'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5607731heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5596730heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.05452753536724049, "good_angle": 24.23535417432326, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 4.833333333333322}, "ep001": {"nsteps": 500, "reward": -0.12353763392486145, "good_angle": 15.52345061305662, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.7999999999999954}, "ep002": {"nsteps": 175, "reward": -6.045018788062568, "good_angle": 0.0924096889573637, "survival_time": 5.833333333333322, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 294, "reward": -5.256518963851085, "good_angle": 25.865919918500797, "survival_time": 9.799999999999976, "traveled_tiles": 3, "valid_direction": 5.933333333333313}, "ep004": {"nsteps": 500, "reward": -0.7373143969518132, "good_angle": 1.845400832835972, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.499999999999981}}
good_angle_max25.865919918500797
good_angle_mean13.512507045534804
good_angle_median15.52345061305662
good_angle_min0.0924096889573637
reward_max-0.05452753536724049
reward_mean-2.4433834636315135
reward_median-0.7373143969518132
reward_min-6.045018788062568
survival_time_max16.666666666666654
survival_time_mean13.126666666666653
survival_time_min5.833333333333322
traveled_tiles_max7
traveled_tiles_mean5
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max5.933333333333313
valid_direction_mean3.813333333333323
valid_direction_median4.833333333333322
valid_direction_min0
5593729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5590729heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.066666666666662


other stats
episodes
details{"ep000": {"nsteps": 122, "reward": -9.584048272156323, "good_angle": 4.15024539593361, "survival_time": 4.066666666666662, "traveled_tiles": 1, "valid_direction": 3.2999999999999954}, "ep001": {"nsteps": 125, "reward": -9.326586581707, "good_angle": 4.253873169300722, "survival_time": 4.166666666666662, "traveled_tiles": 1, "valid_direction": 3.366666666666662}, "ep002": {"nsteps": 150, "reward": -7.492702591568231, "good_angle": 5.0505519054772465, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 4.0999999999999925}, "ep003": {"nsteps": 97, "reward": -12.444948281209491, "good_angle": 2.6592831813146716, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.5666666666666647}, "ep004": {"nsteps": 70, "reward": -16.90499336378915, "good_angle": 1.0227292718412762, "survival_time": 2.333333333333335, "traveled_tiles": 2, "valid_direction": 1.666666666666668}}
good_angle_max5.0505519054772465
good_angle_mean3.427336584773505
good_angle_median4.15024539593361
good_angle_min1.0227292718412762
reward_max-7.492702591568231
reward_mean-11.15065581808604
reward_median-9.584048272156323
reward_min-16.90499336378915
survival_time_max4.999999999999992
survival_time_mean3.7599999999999967
survival_time_min2.333333333333335
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max4.0999999999999925
valid_direction_mean2.9999999999999964
valid_direction_median3.2999999999999954
valid_direction_min1.666666666666668
5588728heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 116, in run
    solve(params, cis)
  File "solution.py", line 75, in solve
    cis.info("OBS", str(observation.shape), str(observation.min()), str(observation.max()))
TypeError: info() takes exactly 2 arguments (5 given)


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5587727heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5581726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5563724BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.09999999999996


other stats
episodes
details{"ep000": {"nsteps": 207, "reward": -5.359979340786357, "good_angle": 18.378352821134857, "survival_time": 6.899999999999985, "traveled_tiles": 7, "valid_direction": 3.566666666666661}, "ep001": {"nsteps": 96, "reward": -10.853584142401814, "good_angle": 5.643464722289135, "survival_time": 3.1999999999999984, "traveled_tiles": 4, "valid_direction": 0.93333333333333}, "ep002": {"nsteps": 500, "reward": -0.5942651022118516, "good_angle": 1.330046635990146, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 3.133333333333323}, "ep003": {"nsteps": 500, "reward": -0.324721316181236, "good_angle": 27.849770624270917, "survival_time": 16.666666666666654, "traveled_tiles": 15, "valid_direction": 4.733333333333322}, "ep004": {"nsteps": 483, "reward": -2.667582773715335, "good_angle": 1.6157486433519237, "survival_time": 16.09999999999996, "traveled_tiles": 15, "valid_direction": 4.033333333333328}}
good_angle_max27.849770624270917
good_angle_mean10.963476689407395
good_angle_median5.643464722289135
good_angle_min1.330046635990146
reward_max-0.324721316181236
reward_mean-3.960026535059319
reward_median-2.667582773715335
reward_min-10.853584142401814
survival_time_max16.666666666666654
survival_time_mean11.90666666666665
survival_time_min3.1999999999999984
traveled_tiles_max17
traveled_tiles_mean11.6
traveled_tiles_median15
traveled_tiles_min4
valid_direction_max4.733333333333322
valid_direction_mean3.2799999999999927
valid_direction_median3.566666666666661
valid_direction_min0.93333333333333
5561723BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5556722BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.59999999999999


other stats
episodes
details{"ep000": {"nsteps": 258, "reward": -4.356492124754185, "good_angle": 19.677907647133026, "survival_time": 8.59999999999998, "traveled_tiles": 9, "valid_direction": 4.266666666666659}, "ep001": {"nsteps": 62, "reward": -16.31402292706433, "good_angle": 1.041100915886002, "survival_time": 2.066666666666669, "traveled_tiles": 1, "valid_direction": 1.5333333333333357}, "ep002": {"nsteps": 65, "reward": -15.763221279302469, "good_angle": 0.404140758116733, "survival_time": 2.1666666666666687, "traveled_tiles": 3, "valid_direction": 0.9333333333333336}, "ep003": {"nsteps": 168, "reward": -6.289509233733822, "good_angle": 8.043993446897481, "survival_time": 5.59999999999999, "traveled_tiles": 7, "valid_direction": 2.4666666666666632}, "ep004": {"nsteps": 500, "reward": -0.6867090857587754, "good_angle": 1.6010709686531823, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 3.4999999999999956}}
good_angle_max19.677907647133026
good_angle_mean6.153642747337284
good_angle_median1.6010709686531823
good_angle_min0.404140758116733
reward_max-0.6867090857587754
reward_mean-8.681990930122717
reward_median-6.289509233733822
reward_min-16.31402292706433
survival_time_max16.666666666666654
survival_time_mean7.019999999999993
survival_time_min2.066666666666669
traveled_tiles_max18
traveled_tiles_mean7.6
traveled_tiles_median7
traveled_tiles_min1
valid_direction_max4.266666666666659
valid_direction_mean2.539999999999998
valid_direction_median2.4666666666666632
valid_direction_min0.9333333333333336
5550723BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:02:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5547721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5542721BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.3583180518115114, "good_angle": 35.388577433801856, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.066666666666652}, "ep001": {"nsteps": 500, "reward": -0.32232150391326286, "good_angle": 27.701117487878584, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.33333333333335}, "ep002": {"nsteps": 500, "reward": -0.6438964181095361, "good_angle": 1.3346811401222445, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 2.5999999999999917}, "ep003": {"nsteps": 409, "reward": -2.8165878027633133, "good_angle": 23.786906038949652, "survival_time": 13.633333333333296, "traveled_tiles": 11, "valid_direction": 6.233333333333315}, "ep004": {"nsteps": 500, "reward": -0.7099452675133944, "good_angle": 1.1987815010916103, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 2.8333333333333277}}
good_angle_max35.388577433801856
good_angle_mean17.88201272036879
good_angle_median23.786906038949652
good_angle_min1.1987815010916103
reward_max-0.32232150391326286
reward_mean-0.9702138088222036
reward_median-0.6438964181095361
reward_min-2.8165878027633133
survival_time_max16.666666666666654
survival_time_mean16.05999999999998
survival_time_min13.633333333333296
traveled_tiles_max17
traveled_tiles_mean14
traveled_tiles_median13
traveled_tiles_min11
valid_direction_max6.233333333333315
valid_direction_mean4.613333333333327
valid_direction_median5.33333333333335
valid_direction_min2.5999999999999917
5536719BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.599999999999971


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4328366373910103, "good_angle": 34.187533222867174, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 7.933333333333349}, "ep001": {"nsteps": 204, "reward": -5.368425539238196, "good_angle": 12.78469486786882, "survival_time": 6.799999999999986, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 500, "reward": -0.6328639456564561, "good_angle": 2.0584819535918646, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.033333333333333}, "ep003": {"nsteps": 318, "reward": -3.5255362078775914, "good_angle": 21.40221500430265, "survival_time": 10.599999999999971, "traveled_tiles": 7, "valid_direction": 4.233333333333318}, "ep004": {"nsteps": 55, "reward": -20.811791840466583, "good_angle": 0.6341215631548089, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max34.187533222867174
good_angle_mean14.213409322357062
good_angle_median12.78469486786882
good_angle_min0.6341215631548089
reward_max-0.4328366373910103
reward_mean-6.154290834125968
reward_median-3.5255362078775914
reward_min-20.811791840466583
survival_time_max16.666666666666654
survival_time_mean10.51333333333332
survival_time_min1.8333333333333357
traveled_tiles_max9
traveled_tiles_mean6
traveled_tiles_median7
traveled_tiles_min2
valid_direction_max7.933333333333349
valid_direction_mean4.273333333333332
valid_direction_median4.233333333333318
valid_direction_min1.2333333333333358
5531717miksazPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5529717miksazPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.9041261715888976, "good_angle": 12.618629466616206, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.533333333333331}, "ep001": {"nsteps": 500, "reward": -0.8981673195362091, "good_angle": 12.582678875788336, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.466666666666663}, "ep002": {"nsteps": 500, "reward": -1.1059375916272405, "good_angle": 50.10920355121067, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.26666666666666}, "ep003": {"nsteps": 500, "reward": -0.9705289892554284, "good_angle": 12.656061075455716, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.599999999999998}, "ep004": {"nsteps": 500, "reward": -1.2699005529454734, "good_angle": 12.651987005646069, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.599999999999998}}
good_angle_max50.10920355121067
good_angle_mean20.1237119949434
good_angle_median12.651987005646069
good_angle_min12.582678875788336
reward_max-0.8981673195362091
reward_mean-1.0297321249906497
reward_median-0.9705289892554284
reward_min-1.2699005529454734
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max1
traveled_tiles_mean1
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.26666666666666
valid_direction_mean12.89333333333333
valid_direction_median12.599999999999998
valid_direction_min12.466666666666663
5527716miksazPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2390:00:31
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission716/step1-simulation-rudolf-7-job5527/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5525715MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5520715MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.233333333333311


other stats
episodes
details{"ep000": {"nsteps": 147, "reward": -7.480147649439013, "good_angle": 12.936741904799534, "survival_time": 4.899999999999992, "traveled_tiles": 3, "valid_direction": 2.966666666666658}, "ep001": {"nsteps": 415, "reward": -2.8612507890068355, "good_angle": 12.186561827281098, "survival_time": 13.833333333333297, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 159, "reward": -6.376447354097878, "good_angle": 0.6952169073957164, "survival_time": 5.299999999999991, "traveled_tiles": 2, "valid_direction": 1.7999999999999978}, "ep003": {"nsteps": 277, "reward": -4.355154121449278, "good_angle": 13.508413594392676, "survival_time": 9.233333333333311, "traveled_tiles": 4, "valid_direction": 3.433333333333322}, "ep004": {"nsteps": 500, "reward": -0.7639039816061267, "good_angle": 2.894423716990918, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 5.699999999999986}}
good_angle_max13.508413594392676
good_angle_mean8.444271590171988
good_angle_median12.186561827281098
good_angle_min0.6952169073957164
reward_max-0.7639039816061267
reward_mean-4.367380779119826
reward_median-4.355154121449278
reward_min-7.480147649439013
survival_time_max16.666666666666654
survival_time_mean9.986666666666649
survival_time_min4.899999999999992
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max5.699999999999986
valid_direction_mean3.366666666666658
valid_direction_median2.966666666666658
valid_direction_min1.7999999999999978
5507714PolyProgrammistROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:06:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5500712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5492711BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:07:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5484709JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.577728519514203, "good_angle": 48.26358421644558, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.633333333333341}, "ep001": {"nsteps": 500, "reward": -1.0854666557144377, "good_angle": 21.89444445470377, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.666666666666664}, "ep002": {"nsteps": 500, "reward": -0.3708411160647374, "good_angle": 2.230681428334207, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.233333333333315}, "ep003": {"nsteps": 500, "reward": -1.4293122868076895, "good_angle": 42.44376119691759, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 7.066666666666647}, "ep004": {"nsteps": 108, "reward": -11.174042657397136, "good_angle": 1.9677892234531176, "survival_time": 3.599999999999997, "traveled_tiles": 5, "valid_direction": 1.2999999999999954}}
good_angle_max48.26358421644558
good_angle_mean23.360052103970855
good_angle_median21.89444445470377
good_angle_min1.9677892234531176
reward_max-0.3708411160647374
reward_mean-3.1274782470996407
reward_median-1.4293122868076895
reward_min-11.174042657397136
survival_time_max16.666666666666654
survival_time_mean14.053333333333322
survival_time_min3.599999999999997
traveled_tiles_max13
traveled_tiles_mean11.4
traveled_tiles_median13
traveled_tiles_min5
valid_direction_max7.066666666666647
valid_direction_mean5.379999999999993
valid_direction_median6.633333333333341
valid_direction_min1.2999999999999954
5465704JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5463703JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5458703JonRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5445700BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.4058023572163657, "good_angle": 25.6420952263652, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 5.099999999999989}, "ep001": {"nsteps": 500, "reward": -0.45728302312342567, "good_angle": 23.73109145103182, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.766666666666651}, "ep002": {"nsteps": 500, "reward": -0.6032523711565883, "good_angle": 1.3080701129728824, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 2.833333333333343}, "ep003": {"nsteps": 500, "reward": -0.533522666212637, "good_angle": 23.072171420380123, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 5.299999999999983}, "ep004": {"nsteps": 47, "reward": -23.676985390642855, "good_angle": 0.4760789764251272, "survival_time": 1.5666666666666682, "traveled_tiles": 2, "valid_direction": 0.4666666666666681}}
good_angle_max25.6420952263652
good_angle_mean14.845901437435032
good_angle_median23.072171420380123
good_angle_min0.4760789764251272
reward_max-0.4058023572163657
reward_mean-5.135369161670374
reward_median-0.533522666212637
reward_min-23.676985390642855
survival_time_max16.666666666666654
survival_time_mean13.646666666666656
survival_time_min1.5666666666666682
traveled_tiles_max11
traveled_tiles_mean9.2
traveled_tiles_median11
traveled_tiles_min2
valid_direction_max5.299999999999983
valid_direction_mean3.6933333333333263
valid_direction_median4.766666666666651
valid_direction_min0.4666666666666681
5438699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:02:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5430698BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:08:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5428696MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5421032422033604, "good_angle": 28.620416742117506, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.400000000000013}, "ep001": {"nsteps": 500, "reward": -0.3187833013450727, "good_angle": 18.4957640505086, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.9999999999999893}, "ep002": {"nsteps": 500, "reward": -0.3845633498579264, "good_angle": 0.05057516411719526, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3786923264078796, "good_angle": 19.11590343903976, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.1999999999999895}, "ep004": {"nsteps": 500, "reward": -0.7611795927473286, "good_angle": 2.945639238518338, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.266666666666656}}
good_angle_max28.620416742117506
good_angle_mean13.84565972686028
good_angle_median18.4957640505086
good_angle_min0.05057516411719526
reward_max-0.3187833013450727
reward_mean-0.47706436251231354
reward_median-0.3845633498579264
reward_min-0.7611795927473286
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max5
traveled_tiles_mean4.6
traveled_tiles_median5
traveled_tiles_min4
valid_direction_max7.266666666666656
valid_direction_mean3.973333333333329
valid_direction_median3.1999999999999895
valid_direction_min0
5425695BenjaminROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5396688MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:01:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5389686anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5386686anna.tsalapovaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:07:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5379684Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5375683PolyProgrammistRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5371683PolyProgrammistRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5358681Maxim KuzminTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno2390:05:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5354680PolyProgrammistRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5338676gunshiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:02:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5334675heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5330675heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.707524042937065, "good_angle": 4.558573615649922, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.333333333333332}, "ep001": {"nsteps": 95, "reward": -12.149568855135064, "good_angle": 2.2168865970853284, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.366666666666666}, "ep002": {"nsteps": 109, "reward": -10.434394388844114, "good_angle": 2.993975240420685, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 2.6999999999999966}, "ep003": {"nsteps": 76, "reward": -15.223712928985297, "good_angle": 1.3084261872204903, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 1.8666666666666671}, "ep004": {"nsteps": 57, "reward": -20.1426948706309, "good_angle": 0.5654761377833007, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max4.558573615649922
good_angle_mean2.3286675556319456
good_angle_median2.2168865970853284
good_angle_min0.5654761377833007
reward_max-10.434394388844114
reward_mean-13.931579017306486
reward_median-12.149568855135064
reward_min-20.1426948706309
survival_time_max3.63333333333333
survival_time_mean2.8666666666666663
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.6999999999999966
valid_direction_mean2.0999999999999996
valid_direction_median2.333333333333332
valid_direction_min1.2333333333333358
5320674heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
5318673hellolaiSolution templateaido1_luck-v3step1successyes2390:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
score179.9575350696925


5316672Liam PaullRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5304667JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5301667JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:05:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5279660iban_alexPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2390:03:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5272657aleksandarpetrROS-based Lane Following (STest)aido1_LF1_r3-v3step1-simulationerrorno2390:00:32
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission657/step1-simulation-rudolf-7-job5272/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5260653iban_alexTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessno2390:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5252652MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5247649aleksandarpetrTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2390:10:21
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5241646Julian ZillyROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median13.499999999999964


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.515815614085448, "good_angle": 15.731459146459398, "survival_time": 5.6999999999999895, "traveled_tiles": 3, "valid_direction": 3.1999999999999886}, "ep001": {"nsteps": 405, "reward": -2.912428674557143, "good_angle": 9.164415310902609, "survival_time": 13.499999999999964, "traveled_tiles": 4, "valid_direction": 2.5999999999999908}, "ep002": {"nsteps": 500, "reward": -0.3662686334699392, "good_angle": 0.03343646512277416, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3694856026396155, "good_angle": 19.118166097621504, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.09999999999999}, "ep004": {"nsteps": 80, "reward": -15.165403467416764, "good_angle": 0.634197902912057, "survival_time": 2.666666666666667, "traveled_tiles": 2, "valid_direction": 1.566666666666665}}
good_angle_max19.118166097621504
good_angle_mean8.936334984603668
good_angle_median9.164415310902609
good_angle_min0.03343646512277416
reward_max-0.3662686334699392
reward_mean-5.065880398433782
reward_median-2.912428674557143
reward_min-15.165403467416764
survival_time_max16.666666666666654
survival_time_mean11.039999999999983
survival_time_min2.666666666666667
traveled_tiles_max5
traveled_tiles_mean3.6
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max3.1999999999999886
valid_direction_mean2.093333333333327
valid_direction_median2.5999999999999908
valid_direction_min0
5232645heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:02:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5228644heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5269790861280635, "good_angle": 13.860983393856262, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999987}, "ep001": {"nsteps": 500, "reward": -0.5385801427662372, "good_angle": 28.4330701639556, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.49999999999999}, "ep002": {"nsteps": 500, "reward": -0.8243838335573673, "good_angle": 47.85120687516038, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.599999999999984}, "ep003": {"nsteps": 500, "reward": -1.0039927894249558, "good_angle": 13.88988153011114, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.833333333333323}, "ep004": {"nsteps": 20, "reward": -52.075557085871694, "good_angle": 0.7270306152193651, "survival_time": 0.6666666666666666, "traveled_tiles": 1, "valid_direction": 0.5666666666666665}}
good_angle_max47.85120687516038
good_angle_mean20.95243451566055
good_angle_median13.88988153011114
good_angle_min0.7270306152193651
reward_max-0.5269790861280635
reward_mean-10.993898587549664
reward_median-0.8243838335573673
reward_min-52.075557085871694
survival_time_max16.666666666666654
survival_time_mean13.466666666666658
survival_time_min0.6666666666666666
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.599999999999984
valid_direction_mean10.919999999999993
valid_direction_median13.099999999999987
valid_direction_min0.5666666666666665
5217642miksazRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:02:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5214639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5210639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job5210-6303', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job5210-6303', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5207639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:06:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5205638MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2390:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5202638MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:07:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5198637JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:06:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5192636JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:02:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1122087126707192, "good_angle": 50.40463661992644, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 12.199999999999962}, "ep001": {"nsteps": 500, "reward": -0.9444563968166476, "good_angle": 24.82625101482094, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.266666666666677}, "ep002": {"nsteps": 429, "reward": -3.4185708913179265, "good_angle": 1.6738886928328292, "survival_time": 14.29999999999996, "traveled_tiles": 5, "valid_direction": 2.5999999999999908}, "ep003": {"nsteps": 500, "reward": -1.1791939079463485, "good_angle": 36.93715410045572, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.43333333333335}, "ep004": {"nsteps": 187, "reward": -7.59629884633151, "good_angle": 0.9873761327044304, "survival_time": 6.233333333333321, "traveled_tiles": 3, "valid_direction": 1.699999999999994}}
good_angle_max50.40463661992644
good_angle_mean22.96586131214807
good_angle_median24.82625101482094
good_angle_min0.9873761327044304
reward_max-0.9444563968166476
reward_mean-2.8501457510166306
reward_median-1.1791939079463485
reward_min-7.59629884633151
survival_time_max16.666666666666654
survival_time_mean14.10666666666665
survival_time_min6.233333333333321
traveled_tiles_max6
traveled_tiles_mean5
traveled_tiles_median5
traveled_tiles_min3
valid_direction_max12.199999999999962
valid_direction_mean5.8399999999999945
valid_direction_median5.43333333333335
valid_direction_min1.699999999999994
5189636JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:10:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5187635JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5184635JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1105151548773282, "good_angle": 47.620834831967386, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 12.133333333333296}, "ep001": {"nsteps": 500, "reward": -1.0769892136729322, "good_angle": 25.190556678738485, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.966666666666678}, "ep002": {"nsteps": 420, "reward": -3.520322911370368, "good_angle": 1.6872243724104672, "survival_time": 13.99999999999996, "traveled_tiles": 6, "valid_direction": 2.8333333333333233}, "ep003": {"nsteps": 500, "reward": -1.102285744726658, "good_angle": 35.44567878911664, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.43333333333335}, "ep004": {"nsteps": 186, "reward": -7.618061553406459, "good_angle": 1.003703418088926, "survival_time": 6.199999999999988, "traveled_tiles": 3, "valid_direction": 1.7333333333333272}}
good_angle_max47.620834831967386
good_angle_mean22.189599618064385
good_angle_median25.190556678738485
good_angle_min1.003703418088926
reward_max-1.0769892136729322
reward_mean-2.885634915610749
reward_median-1.1105151548773282
reward_min-7.618061553406459
survival_time_max16.666666666666654
survival_time_mean14.039999999999983
survival_time_min6.199999999999988
traveled_tiles_max6
traveled_tiles_mean5.2
traveled_tiles_median6
traveled_tiles_min3
valid_direction_max12.133333333333296
valid_direction_mean5.819999999999995
valid_direction_median5.43333333333335
valid_direction_min1.7333333333333272
5179631heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 104, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 331, in step
    action = self.action(action)
  File "/workspace/wrappers.py", line 207, in action
    vel, angle = action
TypeError: 'numpy.int64' object is not iterable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5178628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5177629lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5175629lavoiemsPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:01:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5172629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.433333333333324


other stats
episodes
details{"ep000": {"nsteps": 142, "reward": -9.917068860900232, "good_angle": 18.09525756528763, "survival_time": 4.733333333333326, "traveled_tiles": 2, "valid_direction": 3.5999999999999925}, "ep001": {"nsteps": 171, "reward": -7.560464622333035, "good_angle": 0.5729313785798368, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.6333333333333253}, "ep002": {"nsteps": 166, "reward": -6.096256680320948, "good_angle": 0.2554365493405618, "survival_time": 5.5333333333333234, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 163, "reward": -8.29269307376417, "good_angle": 9.701503703263583, "survival_time": 5.433333333333324, "traveled_tiles": 3, "valid_direction": 2.033333333333326}, "ep004": {"nsteps": 60, "reward": -19.260831459363303, "good_angle": 0.1967168642955068, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.0000000000000029}}
good_angle_max18.09525756528763
good_angle_mean5.764369212153424
good_angle_median0.5729313785798368
good_angle_min0.1967168642955068
reward_max-6.096256680320948
reward_mean-10.22546293933634
reward_median-8.29269307376417
reward_min-19.260831459363303
survival_time_max5.6999999999999895
survival_time_mean4.6799999999999935
survival_time_min2.0000000000000027
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.5999999999999925
valid_direction_mean1.8533333333333295
valid_direction_median2.033333333333326
valid_direction_min0
5170630VincentMaiSolution templateaido1_luck-v3step1successyes2390:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
score126.001874529673017


5168595heyt0nyPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5156629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5153629lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
5147595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5143595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videostimeoutno2390:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
5136627heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.599999999999997


other stats
episodes
details{"ep000": {"nsteps": 108, "reward": -9.814701962004484, "good_angle": 3.3812371123098277, "survival_time": 3.599999999999997, "traveled_tiles": 1, "valid_direction": 2.899999999999997}, "ep001": {"nsteps": 105, "reward": -10.007785181851968, "good_angle": 3.235560527636945, "survival_time": 3.4999999999999973, "traveled_tiles": 1, "valid_direction": 2.8333333333333304}, "ep002": {"nsteps": 86, "reward": -11.784388407577522, "good_angle": 2.0713242872990176, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 2.233333333333333}, "ep003": {"nsteps": 136, "reward": -8.662728447802639, "good_angle": 4.7016704937818945, "survival_time": 4.533333333333327, "traveled_tiles": 2, "valid_direction": 3.733333333333327}, "ep004": {"nsteps": 178, "reward": -7.663683124137728, "good_angle": 5.500022397057104, "survival_time": 5.933333333333322, "traveled_tiles": 2, "valid_direction": 5.133333333333322}}
good_angle_max5.500022397057104
good_angle_mean3.7779629636169583
good_angle_median3.3812371123098277
good_angle_min2.0713242872990176
reward_max-7.663683124137728
reward_mean-9.586657424674868
reward_median-9.814701962004484
reward_min-11.784388407577522
survival_time_max5.933333333333322
survival_time_mean4.0866666666666625
survival_time_min2.8666666666666663
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.133333333333322
valid_direction_mean3.366666666666662
valid_direction_median2.899999999999997
valid_direction_min2.233333333333333
5117595heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5112606lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2390:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5108602heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5100608DavidRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5094608DavidRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5092608DavidRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.633333333333313


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.830923963644925, "good_angle": 23.860878588016348, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 375, "reward": -3.4145991263434214, "good_angle": 22.01536260024685, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 208, "reward": -4.859529416817308, "good_angle": 0.22279485595462264, "survival_time": 6.9333333333333185, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -5.987802368333441, "good_angle": 26.51517062768657, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 271, "reward": -5.5905160780212535, "good_angle": 5.045379274793216, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.51517062768657
good_angle_mean15.53191718933952
good_angle_median22.01536260024685
good_angle_min0.22279485595462264
reward_max-3.4145991263434214
reward_mean-5.53667419063207
reward_median-5.5905160780212535
reward_min-7.830923963644925
survival_time_max12.499999999999966
survival_time_mean8.553333333333313
survival_time_min5.666666666666656
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.933333333333321
valid_direction_mean2.95999999999999
valid_direction_median3.9333333333333194
valid_direction_min0
5085614lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5081614lavoiemsPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5079622heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 51, in solve
    num_actions=5)
  File "/workspace/model.py", line 15, in __init__
    self.net = dqn.RainbowDQN(*args, **kwargs).to(self.device)
TypeError: __init__() takes exactly 6 arguments (3 given)


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5074607lavoiemsPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2390:03:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5070620heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5068611DavidRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5063611DavidRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:01:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5059613lmandrilePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.199999999999991


other stats
episodes
details{"ep000": {"nsteps": 143, "reward": -9.882135665083265, "good_angle": 18.382575938713636, "survival_time": 4.7666666666666595, "traveled_tiles": 2, "valid_direction": 3.6333333333333258}, "ep001": {"nsteps": 200, "reward": -5.17015903569627, "good_angle": 0.36620499902195247, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 236, "reward": -4.230663951192351, "good_angle": 0.2941680649879752, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 156, "reward": -8.493440499672523, "good_angle": 9.155059392194122, "survival_time": 5.199999999999991, "traveled_tiles": 3, "valid_direction": 1.7666666666666604}, "ep004": {"nsteps": 66, "reward": -17.791886033433855, "good_angle": 0.20846047212537297, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 1.000000000000001}}
good_angle_max18.382575938713636
good_angle_mean5.681293773408612
good_angle_median0.36620499902195247
good_angle_min0.20846047212537297
reward_max-4.230663951192351
reward_mean-9.113657037015653
reward_median-8.493440499672523
reward_min-17.791886033433855
survival_time_max7.866666666666648
survival_time_mean5.339999999999991
survival_time_min2.200000000000002
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.6333333333333258
valid_direction_mean1.2799999999999976
valid_direction_median1.000000000000001
valid_direction_min0
5057599heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5041602heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
5037606lavoiemsPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
5035608DavidRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
5028613lmandrilePyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
5026615DavidPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
5016604heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:36:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
5012608DavidRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2390:36:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
5009612ayushsoniSolution templateaido1_luck-v3step1timeoutyes2390:35:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
5006610ayushsoniSolution templateaido1_luck-v3step1timeoutyes2390:35:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
5004609DavidRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2390:36:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
5000606lavoiemsPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:37:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
4994603heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:38:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
4991598heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
4989595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:34:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4987601heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:36:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
4984599heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:34:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
4982595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:32:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
4981595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4980597heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 18, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4978595heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.133333333333325


other stats
episodes
details{"ep000": {"nsteps": 132, "reward": -9.990973991426555, "good_angle": 15.143181866348982, "survival_time": 4.399999999999994, "traveled_tiles": 2, "valid_direction": 3.0333333333333266}, "ep001": {"nsteps": 154, "reward": -8.079247086466133, "good_angle": 0.6131951792558651, "survival_time": 5.133333333333325, "traveled_tiles": 2, "valid_direction": 2.1333333333333258}, "ep002": {"nsteps": 176, "reward": -5.732083536294753, "good_angle": 0.24999459564228108, "survival_time": 5.866666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 195, "reward": -7.319231865344904, "good_angle": 12.51541899933692, "survival_time": 6.499999999999987, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}, "ep004": {"nsteps": 54, "reward": -21.104272740858573, "good_angle": 0.19589197514542692, "survival_time": 1.8000000000000025, "traveled_tiles": 2, "valid_direction": 0.8000000000000024}}
good_angle_max15.143181866348982
good_angle_mean5.743536523145894
good_angle_median0.6131951792558651
good_angle_min0.19589197514542692
reward_max-5.732083536294753
reward_mean-10.445161844078182
reward_median-8.079247086466133
reward_min-21.104272740858573
survival_time_max6.499999999999987
survival_time_mean4.739999999999992
survival_time_min1.8000000000000025
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.0333333333333266
valid_direction_mean1.619999999999996
valid_direction_median2.1333333333333258
valid_direction_min0
4973595heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2390:07:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4972597heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
4959595heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
4958593heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = make_env(config)
  File "solution.py", line 23, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
4954594heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4950595heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:32:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
4945488JonJP pipelineaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4941488JonJP pipelineaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
493915Andrea Censinullaido1_log_processing-v3logstep1abortedyes2390:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
passed1


493515Andrea Censinullaido1_log_processing-v3logstep1abortedyes2390:00:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 303, in go_
    challenge_step_name, project, do_pull)
  File "/project/src/duckietown_challenges_runner/runner.py", line 351, in run_single
    prepare_dir(wd, aws_config, steps2artefacts)
  File "/project/src/duckietown_challenges_runner/runner.py", line 551, in prepare_dir
    os.makedirs(wd)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 150, in makedirs
    makedirs(head, mode)
  File "/usr/lib/python2.7/os.py", line 157, in makedirs
    mkdir(name, mode)
OSError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4929488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno239----
4916488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4912590Allen OuTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999983


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -11.11132962695372, "good_angle": 3.481079425999562, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 281, "reward": -4.521031430077298, "good_angle": 15.84928678080855, "survival_time": 9.366666666666644, "traveled_tiles": 4, "valid_direction": 3.4999999999999885}, "ep002": {"nsteps": 500, "reward": -0.16403283863254184, "good_angle": 0.24367834358166565, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 0.2333333333333325}, "ep003": {"nsteps": 216, "reward": -6.629146578135313, "good_angle": 14.501328060144532, "survival_time": 7.199999999999984, "traveled_tiles": 3, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 225, "reward": -4.7080057672977755, "good_angle": 1.5709037293728847, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.499999999999996}}
good_angle_max15.84928678080855
good_angle_mean7.129255267981439
good_angle_median3.481079425999562
good_angle_min0.24367834358166565
reward_max-0.16403283863254184
reward_mean-5.426709248219329
reward_median-4.7080057672977755
reward_min-11.11132962695372
survival_time_max16.666666666666654
survival_time_mean8.779999999999987
survival_time_min3.166666666666665
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max3.599999999999987
valid_direction_mean2.699999999999994
valid_direction_median3.4999999999999885
valid_direction_min0.2333333333333325
4910590Allen OuTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno2390:02:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4906589Allen OuRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4904589Allen OuRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:02:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4899488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4896488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4885584JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0938952673496678, "good_angle": 47.65945546113703, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 11.66666666666663}, "ep001": {"nsteps": 500, "reward": -1.092040315405, "good_angle": 25.93723773938502, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.90000000000001}, "ep002": {"nsteps": 419, "reward": -3.5204645935846113, "good_angle": 1.7086155304993935, "survival_time": 13.966666666666628, "traveled_tiles": 6, "valid_direction": 2.6999999999999904}, "ep003": {"nsteps": 500, "reward": -1.107821210026741, "good_angle": 35.306656065971524, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 5.43333333333335}, "ep004": {"nsteps": 183, "reward": -7.70819045611418, "good_angle": 1.0080800749033976, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 1.6666666666666607}}
good_angle_max47.65945546113703
good_angle_mean22.324008974379275
good_angle_median25.93723773938502
good_angle_min1.0080800749033976
reward_max-1.092040315405
reward_mean-2.90448236849604
reward_median-1.107821210026741
reward_min-7.70819045611418
survival_time_max16.666666666666654
survival_time_mean14.013333333333316
survival_time_min6.099999999999988
traveled_tiles_max6
traveled_tiles_mean5.2
traveled_tiles_median6
traveled_tiles_min3
valid_direction_max11.66666666666663
valid_direction_mean5.6733333333333285
valid_direction_median5.43333333333335
valid_direction_min1.6666666666666607
4877488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4869581JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:00:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4861580JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4856580JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999993


other stats
episodes
details{"ep000": {"nsteps": 222, "reward": -6.359649095180872, "good_angle": 27.388063439098673, "survival_time": 7.399999999999984, "traveled_tiles": 3, "valid_direction": 4.899999999999988}, "ep001": {"nsteps": 141, "reward": -9.073139651024595, "good_angle": 0.6233174032214033, "survival_time": 4.699999999999993, "traveled_tiles": 2, "valid_direction": 2.099999999999997}, "ep002": {"nsteps": 173, "reward": -7.460346334630009, "good_angle": 0.7461143637402835, "survival_time": 5.766666666666656, "traveled_tiles": 3, "valid_direction": 2.766666666666662}, "ep003": {"nsteps": 104, "reward": -11.815939071086737, "good_angle": 0.5588586146605803, "survival_time": 3.466666666666664, "traveled_tiles": 2, "valid_direction": 1.3000000000000005}, "ep004": {"nsteps": 83, "reward": -14.738914880407862, "good_angle": 0.24759771750360615, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.36666666666666536}}
good_angle_max27.388063439098673
good_angle_mean5.912790307644909
good_angle_median0.6233174032214033
good_angle_min0.24759771750360615
reward_max-6.359649095180872
reward_mean-9.889597806466016
reward_median-9.073139651024595
reward_min-14.738914880407862
survival_time_max7.399999999999984
survival_time_mean4.819999999999992
survival_time_min2.7666666666666666
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max4.899999999999988
valid_direction_mean2.286666666666662
valid_direction_median2.099999999999997
valid_direction_min0.36666666666666536
4851579JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4844578JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4835577JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.433333333333327


other stats
episodes
details{"ep000": {"nsteps": 167, "reward": -6.882622125196065, "good_angle": 12.487108909689354, "survival_time": 5.566666666666657, "traveled_tiles": 4, "valid_direction": 3.999999999999993}, "ep001": {"nsteps": 133, "reward": -8.898763729217357, "good_angle": 0.8633276057827683, "survival_time": 4.433333333333327, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep002": {"nsteps": 160, "reward": -7.433734356891364, "good_angle": 0.7822009061250322, "survival_time": 5.333333333333324, "traveled_tiles": 4, "valid_direction": 0.7666666666666644}, "ep003": {"nsteps": 66, "reward": -16.77685692274209, "good_angle": 0.4963660969048465, "survival_time": 2.200000000000002, "traveled_tiles": 2, "valid_direction": 0.4333333333333331}, "ep004": {"nsteps": 19, "reward": -55.33585316256473, "good_angle": 0.3967680446002714, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.4666666666666666}}
good_angle_max12.487108909689354
good_angle_mean3.0051543126204545
good_angle_median0.7822009061250322
good_angle_min0.3967680446002714
reward_max-6.882622125196065
reward_mean-19.06556605932232
reward_median-8.898763729217357
reward_min-55.33585316256473
survival_time_max5.566666666666657
survival_time_mean3.633333333333328
survival_time_min0.6333333333333333
traveled_tiles_max4
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.999999999999993
valid_direction_mean1.2666666666666644
valid_direction_median0.6666666666666643
valid_direction_min0.4333333333333331
4823488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
4815574trimcaoPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2390:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4812573JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.466666666666657


other stats
episodes
details{"ep000": {"nsteps": 219, "reward": -5.233097820235834, "good_angle": 15.929213860917804, "survival_time": 7.299999999999984, "traveled_tiles": 3, "valid_direction": 5.066666666666654}, "ep001": {"nsteps": 164, "reward": -7.277908351726648, "good_angle": 1.031567041212422, "survival_time": 5.466666666666657, "traveled_tiles": 3, "valid_direction": 1.1999999999999955}, "ep002": {"nsteps": 273, "reward": -4.758277852702272, "good_angle": 1.1582611772976252, "survival_time": 9.099999999999978, "traveled_tiles": 4, "valid_direction": 1.733333333333328}, "ep003": {"nsteps": 100, "reward": -11.597499220371246, "good_angle": 0.8976642374106614, "survival_time": 3.3333333333333313, "traveled_tiles": 2, "valid_direction": 1.0333333333333297}, "ep004": {"nsteps": 35, "reward": -31.14567690576826, "good_angle": 0.4010291363539435, "survival_time": 1.166666666666667, "traveled_tiles": 2, "valid_direction": 0.466666666666667}}
good_angle_max15.929213860917804
good_angle_mean3.883547090638492
good_angle_median1.031567041212422
good_angle_min0.4010291363539435
reward_max-4.758277852702272
reward_mean-12.002492030160852
reward_median-7.277908351726648
reward_min-31.14567690576826
survival_time_max9.099999999999978
survival_time_mean5.273333333333324
survival_time_min1.166666666666667
traveled_tiles_max4
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max5.066666666666654
valid_direction_mean1.8999999999999944
valid_direction_median1.1999999999999955
valid_direction_min0.466666666666667
4806571JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4802570JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4796488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4791569JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4782568JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2390:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4778565JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2390:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4770562JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4763562JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4757488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4756561JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4752561JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.16666666666664


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0546540737710892, "good_angle": 34.51138123885267, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.566666666666643}, "ep001": {"nsteps": 374, "reward": -3.6705022079740615, "good_angle": 14.125139649186789, "survival_time": 12.466666666666631, "traveled_tiles": 5, "valid_direction": 5.466666666666648}, "ep002": {"nsteps": 305, "reward": -4.419515617265076, "good_angle": 1.2470361245648718, "survival_time": 10.16666666666664, "traveled_tiles": 5, "valid_direction": 2.0666666666666593}, "ep003": {"nsteps": 164, "reward": -8.324975036266373, "good_angle": 19.507019132279822, "survival_time": 5.466666666666657, "traveled_tiles": 3, "valid_direction": 2.3999999999999915}, "ep004": {"nsteps": 52, "reward": -21.817430532895603, "good_angle": 0.19772912431812728, "survival_time": 1.7333333333333354, "traveled_tiles": 2, "valid_direction": 0.2666666666666675}}
good_angle_max34.51138123885267
good_angle_mean13.917661053840456
good_angle_median14.125139649186789
good_angle_min0.19772912431812728
reward_max-1.0546540737710892
reward_mean-7.85741549363444
reward_median-4.419515617265076
reward_min-21.817430532895603
survival_time_max16.666666666666654
survival_time_mean9.299999999999985
survival_time_min1.7333333333333354
traveled_tiles_max7
traveled_tiles_mean4.4
traveled_tiles_median5
traveled_tiles_min2
valid_direction_max8.566666666666643
valid_direction_mean3.753333333333322
valid_direction_median2.3999999999999915
valid_direction_min0.2666666666666675
4749560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessno2390:01:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4744560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationsuccessno2390:03:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4742557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessno2390:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4732557Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessno2390:03:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4728555Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationfailedno2390:03:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4726554JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4724554JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.499999999999987


other stats
episodes
details{"ep000": {"nsteps": 159, "reward": -6.97851879206199, "good_angle": 12.998523861642338, "survival_time": 5.299999999999991, "traveled_tiles": 3, "valid_direction": 3.366666666666662}, "ep001": {"nsteps": 277, "reward": -5.070989667508576, "good_angle": 21.73301581877692, "survival_time": 9.233333333333311, "traveled_tiles": 4, "valid_direction": 3.7999999999999865}, "ep002": {"nsteps": 195, "reward": -6.481622083294086, "good_angle": 0.4096932040749916, "survival_time": 6.499999999999987, "traveled_tiles": 4, "valid_direction": 0.36666666666666536}, "ep003": {"nsteps": 415, "reward": -3.692441266740347, "good_angle": 35.53230100238834, "survival_time": 13.833333333333297, "traveled_tiles": 7, "valid_direction": 5.933333333333312}, "ep004": {"nsteps": 83, "reward": -14.653361533061569, "good_angle": 0.2074203284472921, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999893}}
good_angle_max35.53230100238834
good_angle_mean14.176190843065976
good_angle_median12.998523861642338
good_angle_min0.2074203284472921
reward_max-3.692441266740347
reward_mean-7.375386668533312
reward_median-6.481622083294086
reward_min-14.653361533061569
survival_time_max13.833333333333297
survival_time_mean7.5266666666666495
survival_time_min2.7666666666666666
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max5.933333333333312
valid_direction_mean2.753333333333325
valid_direction_median3.366666666666662
valid_direction_min0.29999999999999893
4722553JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4710524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-viztimeoutno2390:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4706552JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4701488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4697524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videostimeoutno2390:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4695551JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4658488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4656524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videostimeoutno2390:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4646524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4642488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4633543JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4629542JonJP pipelineaido1_LF1_r3-v3step3-videoserrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4629-2245', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4629-2245', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4622488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4616539JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:02:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4615524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4609538JonRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.066666666666643


other stats
episodes
details{"ep000": {"nsteps": 170, "reward": -7.8410682664198035, "good_angle": 24.414630691997957, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 378, "reward": -3.995917722582817, "good_angle": 24.64140519726927, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 500, "reward": -0.0121647260064492, "good_angle": 0.5409618548263001, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.5000000000000302}, "ep003": {"nsteps": 257, "reward": -6.028316759877631, "good_angle": 25.7066711410596, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 272, "reward": -5.558730736623094, "good_angle": 5.263895122646778, "survival_time": 9.066666666666643, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}
good_angle_max25.7066711410596
good_angle_mean16.113512801559978
good_angle_median24.414630691997957
good_angle_min0.5409618548263001
reward_max-0.0121647260064492
reward_mean-4.687239642301959
reward_median-5.558730736623094
reward_min-7.8410682664198035
survival_time_max16.666666666666654
survival_time_mean10.513333333333316
survival_time_min5.666666666666656
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.933333333333321
valid_direction_mean3.2533333333333294
valid_direction_median3.899999999999986
valid_direction_min1.5000000000000302
4605537JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:00:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4602537JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:01:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4598488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4594524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4591536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:00:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4587536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4587-8502', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4587-8502', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4582488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4572488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
4571488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4569533heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6019684975304699, "good_angle": 13.82938892216634, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666656}, "ep001": {"nsteps": 500, "reward": -0.5759754842678085, "good_angle": 28.8533070118042, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.499999999999988}, "ep002": {"nsteps": 500, "reward": -0.7206092807501554, "good_angle": 44.30537190150216, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.43333333333332}, "ep003": {"nsteps": 32, "reward": -32.39161221077666, "good_angle": 0.9404128682253534, "survival_time": 1.0666666666666669, "traveled_tiles": 2, "valid_direction": 0.8999999999999998}, "ep004": {"nsteps": 18, "reward": -57.993936121463776, "good_angle": 0.595728859826405, "survival_time": 0.6, "traveled_tiles": 1, "valid_direction": 0.49999999999999994}}
good_angle_max44.30537190150216
good_angle_mean17.704841912704893
good_angle_median13.82938892216634
good_angle_min0.595728859826405
reward_max-0.5759754842678085
reward_mean-18.456820318957774
reward_median-0.7206092807501554
reward_min-57.993936121463776
survival_time_max16.666666666666654
survival_time_mean10.333333333333323
survival_time_min0.6
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.43333333333332
valid_direction_mean8.459999999999992
valid_direction_median12.966666666666656
valid_direction_min0.49999999999999994
4553533heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:09:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4548488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4543528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.833333333333307


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.8794647445678712, "good_angle": 61.75622544660765, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 7.266666666666676}, "ep001": {"nsteps": 295, "reward": -3.9322456289145906, "good_angle": 0.8068758896759249, "survival_time": 9.833333333333307, "traveled_tiles": 3, "valid_direction": 0.9666666666666632}, "ep002": {"nsteps": 160, "reward": -7.620797420380404, "good_angle": 7.983005433670267, "survival_time": 5.333333333333324, "traveled_tiles": 1, "valid_direction": 4.633333333333324}, "ep003": {"nsteps": 42, "reward": -25.70478118601299, "good_angle": 0.22201811620022588, "survival_time": 1.400000000000001, "traveled_tiles": 1, "valid_direction": 0.6666666666666677}, "ep004": {"nsteps": 500, "reward": -1.759301787376404, "good_angle": 0.022239286162344003, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}}
good_angle_max61.75622544660765
good_angle_mean14.158072834463283
good_angle_median0.8068758896759249
good_angle_min0.022239286162344003
reward_max-1.759301787376404
reward_mean-8.179318153450453
reward_median-3.9322456289145906
reward_min-25.70478118601299
survival_time_max16.666666666666654
survival_time_mean9.97999999999999
survival_time_min1.400000000000001
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max7.266666666666676
valid_direction_mean2.706666666666666
valid_direction_median0.9666666666666632
valid_direction_min0
4533526heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4526527heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2390:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4522526heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.707524042937065, "good_angle": 4.558573615649922, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.333333333333332}, "ep001": {"nsteps": 95, "reward": -12.149568855135064, "good_angle": 2.2168865970853284, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.366666666666666}, "ep002": {"nsteps": 109, "reward": -10.434394388844114, "good_angle": 2.993975240420685, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 2.6999999999999966}, "ep003": {"nsteps": 76, "reward": -15.223712928985297, "good_angle": 1.3084261872204903, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 1.8666666666666671}, "ep004": {"nsteps": 57, "reward": -20.1426948706309, "good_angle": 0.5654761377833007, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max4.558573615649922
good_angle_mean2.3286675556319456
good_angle_median2.2168865970853284
good_angle_min0.5654761377833007
reward_max-10.434394388844114
reward_mean-13.931579017306486
reward_median-12.149568855135064
reward_min-20.1426948706309
survival_time_max3.63333333333333
survival_time_mean2.8666666666666663
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.6999999999999966
valid_direction_mean2.0999999999999996
valid_direction_median2.333333333333332
valid_direction_min1.2333333333333358
4519525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.0999999999999988


other stats
episodes
details{"ep000": {"nsteps": 93, "reward": -11.707524042937065, "good_angle": 4.558573615649922, "survival_time": 3.0999999999999988, "traveled_tiles": 2, "valid_direction": 2.333333333333332}, "ep001": {"nsteps": 95, "reward": -12.149568855135064, "good_angle": 2.2168865970853284, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.366666666666666}, "ep002": {"nsteps": 109, "reward": -10.434394388844114, "good_angle": 2.993975240420685, "survival_time": 3.63333333333333, "traveled_tiles": 2, "valid_direction": 2.6999999999999966}, "ep003": {"nsteps": 76, "reward": -15.223712928985297, "good_angle": 1.3084261872204903, "survival_time": 2.533333333333334, "traveled_tiles": 2, "valid_direction": 1.8666666666666671}, "ep004": {"nsteps": 57, "reward": -20.1426948706309, "good_angle": 0.5654761377833007, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 1.2333333333333358}}
good_angle_max4.558573615649922
good_angle_mean2.3286675556319456
good_angle_median2.2168865970853284
good_angle_min0.5654761377833007
reward_max-10.434394388844114
reward_mean-13.931579017306486
reward_median-12.149568855135064
reward_min-20.1426948706309
survival_time_max3.63333333333333
survival_time_mean2.8666666666666663
survival_time_min1.9000000000000024
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.6999999999999966
valid_direction_mean2.0999999999999996
valid_direction_median2.333333333333332
valid_direction_min1.2333333333333358
4518528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4511528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationsuccessno2390:02:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4508527heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
4502523heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:01:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4499523heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.790185122191906, "good_angle": 13.68879742692638, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.066666666666654}, "ep001": {"nsteps": 500, "reward": -0.871827680528164, "good_angle": 23.723849501480423, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.999999999999986}, "ep002": {"nsteps": 500, "reward": -1.0785522184818983, "good_angle": 53.99050029506355, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.466666666666656}, "ep003": {"nsteps": 500, "reward": -0.8081413357686251, "good_angle": 13.679351103727727, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep004": {"nsteps": 500, "reward": -1.406687313616276, "good_angle": 13.679120345071256, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.899999999999988}}
good_angle_max53.99050029506355
good_angle_mean23.752323734453867
good_angle_median13.68879742692638
good_angle_min13.679120345071256
reward_max-0.790185122191906
reward_mean-0.991078734117374
reward_median-0.871827680528164
reward_min-1.406687313616276
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.466666666666656
valid_direction_mean13.259999999999987
valid_direction_median12.999999999999986
valid_direction_min12.866666666666656
4497522heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4492522heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:05:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4488488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:32:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
4486521heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4484521heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.166666666666665


other stats
episodes
details{"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 132, "reward": -8.560128116697976, "good_angle": 8.371777309085797, "survival_time": 4.399999999999994, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 140, "reward": -7.20356833904516, "good_angle": 0.034675126335285154, "survival_time": 4.66666666666666, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 91, "reward": -13.248195889231924, "good_angle": 9.188896207380877, "survival_time": 3.0333333333333323, "traveled_tiles": 3, "valid_direction": 1.3999999999999972}, "ep004": {"nsteps": 95, "reward": -12.396050412678404, "good_angle": 1.806465789696306, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 1.0666666666666629}}
good_angle_max9.188896207380877
good_angle_mean5.606635248719142
good_angle_median8.371777309085797
good_angle_min0.034675126335285154
reward_max-7.20356833904516
reward_mean-11.993379487523889
reward_median-12.396050412678404
reward_min-18.55895467996597
survival_time_max4.66666666666666
survival_time_mean3.4533333333333305
survival_time_min2.0000000000000027
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.4000000000000028
valid_direction_mean1.0533333333333317
valid_direction_median1.399999999999995
valid_direction_min0
4481521heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4477518Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationfailedno2390:02:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 120, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4471488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4467516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2390:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4463515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessno2390:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4459514JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4456512JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4447512JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:06:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4443508JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4431507JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.1246948208808898, "good_angle": 67.85685316541604, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.499999999999986}, "ep001": {"nsteps": 500, "reward": -3.0380495955944062, "good_angle": 17.17991347809843, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.53333333333332}, "ep002": {"nsteps": 500, "reward": -2.907704526901245, "good_angle": 17.314454280860954, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.499999999999986}, "ep003": {"nsteps": 500, "reward": -3.119110053539276, "good_angle": 16.92364257371301, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.599999999999984}, "ep004": {"nsteps": 500, "reward": -2.4116466751098633, "good_angle": 1.8287785762794335, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max67.85685316541604
good_angle_mean24.220728414873573
good_angle_median17.17991347809843
good_angle_min1.8287785762794335
reward_max-1.1246948208808898
reward_mean-2.5202411344051363
reward_median-2.907704526901245
reward_min-3.119110053539276
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.599999999999984
valid_direction_mean13.226666666666654
valid_direction_median16.499999999999986
valid_direction_min0
4427506JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2390:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4427-7959', 'pull']:

   >  Command '['docker-compose', '-p', 'job4427-7959', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4423488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4417504JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4415504JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.108636876821518, "good_angle": 68.22477874027577, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.46666666666665}, "ep001": {"nsteps": 500, "reward": -3.0297250851392747, "good_angle": 17.71182939790664, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.53333333333332}, "ep002": {"nsteps": 500, "reward": -2.941762415751815, "good_angle": 17.73106219683863, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.333333333333318}, "ep003": {"nsteps": 500, "reward": -3.132249420642853, "good_angle": 16.85681268203902, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.599999999999984}, "ep004": {"nsteps": 500, "reward": -2.407511763572693, "good_angle": 1.7801396142722483, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max68.22477874027577
good_angle_mean24.46092452626646
good_angle_median17.71182939790664
good_angle_min1.7801396142722483
reward_max-1.108636876821518
reward_mean-2.523977112385631
reward_median-2.941762415751815
reward_min-3.132249420642853
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.599999999999984
valid_direction_mean13.186666666666651
valid_direction_median16.46666666666665
valid_direction_min0
4414505Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno2390:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: index 1 is out of bounds for axis 1 with size 1

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4405488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4401488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4399502Liam PaullTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4397502Liam PaullTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.499999999999983


other stats
episodes
details{"ep000": {"nsteps": 95, "reward": -11.11132962695372, "good_angle": 3.481079425999562, "survival_time": 3.166666666666665, "traveled_tiles": 3, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 281, "reward": -4.521031430077298, "good_angle": 15.84928678080855, "survival_time": 9.366666666666644, "traveled_tiles": 4, "valid_direction": 3.4999999999999885}, "ep002": {"nsteps": 500, "reward": -0.16403283863254184, "good_angle": 0.24367834358166565, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 0.2333333333333325}, "ep003": {"nsteps": 216, "reward": -6.629146578135313, "good_angle": 14.501328060144532, "survival_time": 7.199999999999984, "traveled_tiles": 3, "valid_direction": 3.599999999999987}, "ep004": {"nsteps": 225, "reward": -4.7080057672977755, "good_angle": 1.5709037293728847, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.499999999999996}}
good_angle_max15.84928678080855
good_angle_mean7.129255267981439
good_angle_median3.481079425999562
good_angle_min0.24367834358166565
reward_max-0.16403283863254184
reward_mean-5.426709248219329
reward_median-4.7080057672977755
reward_min-11.11132962695372
survival_time_max16.666666666666654
survival_time_mean8.779999999999987
survival_time_min3.166666666666665
traveled_tiles_max7
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max3.599999999999987
valid_direction_mean2.699999999999994
valid_direction_median3.4999999999999885
valid_direction_min0.2333333333333325
4394501Manfred DiazTensorflow templateaido1_LF1_r3-v3step3-videossuccessno2390:00:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4389488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4381498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:00:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4377498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2390:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4371495heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.8666666666666663


other stats
episodes
details{"ep000": {"nsteps": 196, "reward": -5.847100113708602, "good_angle": 15.395216975247184, "survival_time": 6.53333333333332, "traveled_tiles": 4, "valid_direction": 3.8999999999999937}, "ep001": {"nsteps": 70, "reward": -14.565727055694774, "good_angle": 0.7211930906972697, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 1.5333333333333348}, "ep002": {"nsteps": 58, "reward": -17.35311852735447, "good_angle": 0.5207001175021045, "survival_time": 1.933333333333336, "traveled_tiles": 2, "valid_direction": 1.3000000000000027}, "ep003": {"nsteps": 86, "reward": -12.300520614057584, "good_angle": 1.1183139549780166, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 1.8999999999999997}, "ep004": {"nsteps": 98, "reward": -11.384389918345043, "good_angle": 1.6835829617277054, "survival_time": 3.266666666666665, "traveled_tiles": 2, "valid_direction": 2.299999999999998}}
good_angle_max15.395216975247184
good_angle_mean3.887801420030456
good_angle_median1.1183139549780166
good_angle_min0.5207001175021045
reward_max-5.847100113708602
reward_mean-12.290171245832097
reward_median-12.300520614057584
reward_min-17.35311852735447
survival_time_max6.53333333333332
survival_time_mean3.3866666666666645
survival_time_min1.933333333333336
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.8999999999999937
valid_direction_mean2.186666666666666
valid_direction_median1.8999999999999997
valid_direction_min1.3000000000000027
4366494heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2390:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4361488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4347488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
4344488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
4336490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-viztimeoutno2390:31:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
4333488JonJP pipelineaido1_LF1_r3-v3step4-vizabortedno2390:31:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
4330488JonJP pipelineaido1_LF1_r3-v3step3-videosabortedno2390:09:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4329490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-viztimeoutno2390:32:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
4306487happyduckieROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5545079732625745, "good_angle": 28.931327855786904, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.46666666666668}, "ep001": {"nsteps": 500, "reward": -0.31952018570806834, "good_angle": 18.045456534391867, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.966666666666656}, "ep002": {"nsteps": 500, "reward": -0.36758588337898257, "good_angle": 0.029334863211391317, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3752321130917408, "good_angle": 18.93853396643962, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 2.9999999999999902}, "ep004": {"nsteps": 83, "reward": -14.670803153371237, "good_angle": 0.7187725581557998, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 1.4333333333333311}}
good_angle_max28.931327855786904
good_angle_mean13.332685155597115
good_angle_median18.045456534391867
good_angle_min0.029334863211391317
reward_max-0.31952018570806834
reward_mean-3.257529861762521
reward_median-0.3752321130917408
reward_min-14.670803153371237
survival_time_max16.666666666666654
survival_time_mean13.886666666666656
survival_time_min2.7666666666666666
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min2
valid_direction_max6.46666666666668
valid_direction_mean2.7733333333333317
valid_direction_median2.966666666666656
valid_direction_min0
4303487happyduckieROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:07:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4299488JonJP pipelineaido1_LF1_r3-v3step1-simulationabortedno2390:08:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4296486JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:02:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4292485JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4285485JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:06:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4282484JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4279484JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:01:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4277484JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2390:06:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4273482JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2390:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: unbound method __init__() must be called with ObservationWrapper instance as first argument (got UndistortWrapper instance instead)

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4272481JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2390:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: 'NoneType' object has no attribute 'action_space'

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4270455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4265455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.71801254535333, "good_angle": 1.288231067747685, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900271487386944
good_angle_median1.288231067747685
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.21732336895035
reward_median-26.71801254535333
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4264479JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:01:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4261479JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -3.8824563524723055, "good_angle": 107.6660548112832, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.23333333333332}, "ep001": {"nsteps": 500, "reward": -2.7104420055150986, "good_angle": 4.969803507369229, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 16.266666666666655}, "ep002": {"nsteps": 471, "reward": -4.892908734437513, "good_angle": 5.097164217983522, "survival_time": 15.699999999999957, "traveled_tiles": 3, "valid_direction": 11.166666666666636}, "ep003": {"nsteps": 500, "reward": -2.9333713345527648, "good_angle": 9.101736004840609, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.199999999999985}, "ep004": {"nsteps": 500, "reward": -2.3411339049339293, "good_angle": 1.1657804343981717, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max107.6660548112832
good_angle_mean25.600107795174942
good_angle_median5.097164217983522
good_angle_min1.1657804343981717
reward_max-2.3411339049339293
reward_mean-3.352062466382322
reward_median-2.9333713345527648
reward_min-4.892908734437513
survival_time_max16.666666666666654
survival_time_mean16.473333333333315
survival_time_min15.699999999999957
traveled_tiles_max3
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.266666666666655
valid_direction_mean11.97333333333332
valid_direction_median16.199999999999985
valid_direction_min0
4258455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4249476JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2390:00:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4246476JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2390:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4242476JonJP pipelineaido1_LF1_r3-v3step2-scoringerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4242-1645', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4242-1645', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4230455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
4217455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.71801254535333, "good_angle": 1.288231067747685, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900271487386944
good_angle_median1.288231067747685
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.21732336895035
reward_median-26.71801254535333
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4213448JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4212471tsummersSolution templateaido1_luck-v3step1erroryes2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4212-2642', 'pull']:

   >  Command '['docker-compose', '-p', 'job4212-2642', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4207455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4201468sodabetaPyTorch templateaido1_LF1_r3-v3step3-videossuccessno2390:00:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4195454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videostimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4191455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4182448JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4175454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2390:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4172455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
4166467JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2390:00:28
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission467/step1-simulation-rudolf-7-job4166/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4156454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2390:00:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4153455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4149463orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4146464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.718001002684616, "good_angle": 1.287850892883585, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900195452414124
good_angle_median1.287850892883585
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.2173210604166
reward_median-26.718001002684616
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4142463orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 40, "reward": -26.03198633901775, "good_angle": 1.282565333483163, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep001": {"nsteps": 40, "reward": -26.00138644352555, "good_angle": 1.2866681661178705, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.7828761839370126, "good_angle": 37.13480749630649, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.233333333333327}, "ep003": {"nsteps": 28, "reward": -37.52491937364851, "good_angle": 0.9984941263882064, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15264507343895, "good_angle": 0.3818226617838063, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max37.13480749630649
good_angle_mean8.216871556815908
good_angle_median1.282565333483163
good_angle_min0.3818226617838063
reward_max-0.7828761839370126
reward_mean-29.098762682713556
reward_median-26.03198633901775
reward_min-55.15264507343895
survival_time_max16.666666666666654
survival_time_mean4.179999999999998
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.233333333333327
valid_direction_mean3.573333333333333
valid_direction_median1.1666666666666674
valid_direction_min0.49999999999999994
4137460MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videoserrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4137-4291', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job4137-4291', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4135448JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4131448JonRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4129461sodabetaSolution templateaido1_luck-v3step1erroryes2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4129-721', 'pull']:

   >  Command '['docker-compose', '-p', 'job4129-721', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4126459Dzenan LapandicTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4124459Dzenan LapandicTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.166666666666662


other stats
episodes
details{"ep000": {"nsteps": 42, "reward": -24.247367578098505, "good_angle": 1.4919614755985182, "survival_time": 1.400000000000001, "traveled_tiles": 2, "valid_direction": 1.333333333333334}, "ep001": {"nsteps": 125, "reward": -8.128652286583558, "good_angle": 0.603657008897622, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.033333333333331}, "ep002": {"nsteps": 500, "reward": 0.08990062048962863, "good_angle": 0.27011240616433024, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 0.33333333333333215}, "ep003": {"nsteps": 80, "reward": -13.023323695920409, "good_angle": 1.7707682647873908, "survival_time": 2.666666666666667, "traveled_tiles": 3, "valid_direction": 1.533333333333332}, "ep004": {"nsteps": 500, "reward": 0.07465394114446826, "good_angle": 1.1338198528210175, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 1.5999999999999974}}
good_angle_max1.7707682647873908
good_angle_mean1.0540638016537758
good_angle_median1.1338198528210175
good_angle_min0.27011240616433024
reward_max0.08990062048962863
reward_mean-9.046957799793676
reward_median-8.128652286583558
reward_min-24.247367578098505
survival_time_max16.666666666666654
survival_time_mean8.313333333333327
survival_time_min1.400000000000001
traveled_tiles_max11
traveled_tiles_mean6
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max1.5999999999999974
valid_direction_mean1.1666666666666654
valid_direction_median1.333333333333334
valid_direction_min0.33333333333333215
4120454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2390:00:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4115455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.3000000000000007


other stats
episodes
details{"ep000": {"nsteps": 39, "reward": -26.71801254535333, "good_angle": 1.288231067747685, "survival_time": 1.3000000000000007, "traveled_tiles": 1, "valid_direction": 1.133333333333334}, "ep001": {"nsteps": 40, "reward": -26.004260089062154, "good_angle": 1.293420470438038, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.1666666666666674}, "ep002": {"nsteps": 500, "reward": -0.6970270132733276, "good_angle": 25.551554082811936, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.033333333333315}, "ep003": {"nsteps": 28, "reward": -37.51613992878369, "good_angle": 0.989852945856892, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.7999999999999998}, "ep004": {"nsteps": 19, "reward": -55.15117726827923, "good_angle": 0.3782988700801687, "survival_time": 0.6333333333333333, "traveled_tiles": 2, "valid_direction": 0.49999999999999994}}
good_angle_max25.551554082811936
good_angle_mean5.900271487386944
good_angle_median1.288231067747685
good_angle_min0.3782988700801687
reward_max-0.6970270132733276
reward_mean-29.21732336895035
reward_median-26.71801254535333
reward_min-55.15117726827923
survival_time_max16.666666666666654
survival_time_mean4.173333333333331
survival_time_min0.6333333333333333
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max14.033333333333315
valid_direction_mean3.5266666666666637
valid_direction_median1.133333333333334
valid_direction_min0.49999999999999994
4113458JonRandom executionaido1_LF1_r3-v3step1-simulationerrorno2390:00:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission458/step1-simulation-rudolf-7-job4113/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4103454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
4099456hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2390:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4091456hvrigazovROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2390:06:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4090450JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno2390:00:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4086447JonRandom executionaido1_LF1_r3-v3step4-viztimeoutno2390:31:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
4085448JonRandom executionaido1_LF1_r3-v3step2-scoringtimeoutno2390:31:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
4081454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2390:06:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4078451JonRandom executionaido1_LF1_r3-v3step1-simulationtimeoutno2390:31:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
4069448JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2390:03:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4066438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringtimeoutno2390:32:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
4065445JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno2390:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 58, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Hidden. If you are the author, please login using the top-right link or use the dashboard.
4064444JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4064-8101', 'pull']:

   >  Command '['docker-compose', '-p', 'job4064-8101', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4063443JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job4063-8463', 'pull']:

   >  Command '['docker-compose', '-p', 'job4063-8463', 'pull']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
4060441orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
4057441orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2390:01:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
4043432Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessno2390:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3985414Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step4-vizerrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job3985-6551', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job3985-6551', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3981415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2390:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3978415Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno2390:03:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3971412Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:10:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3968410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessno2390:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3966410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2390:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3963410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.9666666666666623


other stats
episodes
details{"ep000": {"nsteps": 129, "reward": -9.690229099850322, "good_angle": 21.744915339688692, "survival_time": 4.2999999999999945, "traveled_tiles": 2, "valid_direction": 3.0999999999999943}, "ep001": {"nsteps": 119, "reward": -8.645585073213663, "good_angle": 0.7734098568832906, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 1.233333333333329}, "ep002": {"nsteps": 110, "reward": -9.14712228512402, "good_angle": 0.35922224109675066, "survival_time": 3.6666666666666634, "traveled_tiles": 3, "valid_direction": 0.93333333333333}, "ep003": {"nsteps": 191, "reward": -6.671444808157327, "good_angle": 17.399821852370195, "survival_time": 6.366666666666654, "traveled_tiles": 3, "valid_direction": 3.8666666666666583}, "ep004": {"nsteps": 59, "reward": -19.454236374063008, "good_angle": 0.2504186638957055, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.8333333333333359}}
good_angle_max21.744915339688692
good_angle_mean8.105557590786928
good_angle_median0.7734098568832906
good_angle_min0.2504186638957055
reward_max-6.671444808157327
reward_mean-10.721723528081668
reward_median-9.14712228512402
reward_min-19.454236374063008
survival_time_max6.366666666666654
survival_time_mean4.053333333333328
survival_time_min1.9666666666666697
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.8666666666666583
valid_direction_mean1.9933333333333296
valid_direction_median1.233333333333329
valid_direction_min0.8333333333333359
3957408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3955408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2390:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3953408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7333333333333334


other stats
episodes
details{"ep000": {"nsteps": 82, "reward": -13.898837703030283, "good_angle": 9.072292878774263, "survival_time": 2.7333333333333334, "traveled_tiles": 2, "valid_direction": 1.6666666666666667}, "ep001": {"nsteps": 76, "reward": -14.719160148187688, "good_angle": 0.6928650066234555, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 1.8666666666666671}, "ep002": {"nsteps": 94, "reward": -11.86349624894718, "good_angle": 0.939482044436862, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.0999999999999988}, "ep003": {"nsteps": 145, "reward": -9.276180560835476, "good_angle": 3.4742654860667987, "survival_time": 4.833333333333326, "traveled_tiles": 3, "valid_direction": 0.433333333333332}, "ep004": {"nsteps": 44, "reward": -25.306292913176797, "good_angle": 0.22760734092946203, "survival_time": 1.466666666666668, "traveled_tiles": 2, "valid_direction": 0.666666666666668}}
good_angle_max9.072292878774263
good_angle_mean2.8813025513661676
good_angle_median0.939482044436862
good_angle_min0.22760734092946203
reward_max-9.276180560835476
reward_mean-15.012793514835485
reward_median-13.898837703030283
reward_min-25.306292913176797
survival_time_max4.833333333333326
survival_time_mean2.9399999999999986
survival_time_min1.466666666666668
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.0999999999999988
valid_direction_mean1.3466666666666665
valid_direction_median1.6666666666666667
valid_direction_min0.433333333333332
3951408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2390:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3945399Alex1114Solution templateaido1_luck-v3step1successyes2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
score146.333346354761886


3941400Alex1114Solution templateaido1_luck-v3step1successyes2390:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
score113.48782939792686


3939398Maxim KuzminRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3936398Maxim KuzminRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.033333333333312


other stats
episodes
details{"ep000": {"nsteps": 169, "reward": -7.795088624107767, "good_angle": 24.065090603267784, "survival_time": 5.633333333333323, "traveled_tiles": 2, "valid_direction": 3.933333333333321}, "ep001": {"nsteps": 378, "reward": -3.396214148390634, "good_angle": 22.23872126707025, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 500, "reward": 0.19932390081719495, "good_angle": 0.5507356825079411, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.333333333333364}, "ep003": {"nsteps": 257, "reward": -5.932294208715862, "good_angle": 26.366437521368717, "survival_time": 8.566666666666647, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 271, "reward": -5.702189674999606, "good_angle": 5.989477916481412, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.133333333333323}}
good_angle_max26.366437521368717
good_angle_mean15.84209259813922
good_angle_median22.23872126707025
good_angle_min0.5507356825079411
reward_max0.19932390081719495
reward_mean-4.5252925510793345
reward_median-5.702189674999606
reward_min-7.795088624107767
survival_time_max16.666666666666654
survival_time_mean10.49999999999998
survival_time_min5.633333333333323
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.933333333333321
valid_direction_mean3.2466666666666626
valid_direction_median3.899999999999987
valid_direction_min1.333333333333364
3931397PolyProgrammistRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 117, "reward": -9.991474496503162, "good_angle": 8.866560177579744, "survival_time": 3.899999999999996, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.3888421014547348, "good_angle": 3.638173429102398, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0.4}, "ep002": {"nsteps": 500, "reward": 0.23706295147072523, "good_angle": 0.1326869096702976, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -2.333500215291977, "good_angle": 121.97850228305688, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 14.566666666666652}, "ep004": {"nsteps": 500, "reward": -2.341332432746887, "good_angle": 0.016734103965512847, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max121.97850228305688
good_angle_mean26.92653138067497
good_angle_median3.638173429102398
good_angle_min0.016734103965512847
reward_max0.23706295147072523
reward_mean-2.9636172589052068
reward_median-2.333500215291977
reward_min-9.991474496503162
survival_time_max16.666666666666654
survival_time_mean14.113333333333324
survival_time_min3.899999999999996
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max14.566666666666652
valid_direction_mean3.286666666666662
valid_direction_median0.4
valid_direction_min0
3926396anna.tsalapovasimple submitionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 117, "reward": -9.991474496503162, "good_angle": 8.866560177579744, "survival_time": 3.899999999999996, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 500, "reward": -0.3888421014547348, "good_angle": 3.638173429102398, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0.4}, "ep002": {"nsteps": 500, "reward": 0.23706295147072523, "good_angle": 0.1326869096702976, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -2.333500215291977, "good_angle": 121.97850228305688, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 14.566666666666652}, "ep004": {"nsteps": 500, "reward": -2.341332432746887, "good_angle": 0.016734103965512847, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max121.97850228305688
good_angle_mean26.92653138067497
good_angle_median3.638173429102398
good_angle_min0.016734103965512847
reward_max0.23706295147072523
reward_mean-2.9636172589052068
reward_median-2.333500215291977
reward_min-9.991474496503162
survival_time_max16.666666666666654
survival_time_mean14.113333333333324
survival_time_min3.899999999999996
traveled_tiles_max3
traveled_tiles_mean2.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max14.566666666666652
valid_direction_mean3.286666666666662
valid_direction_median0.4
valid_direction_min0
3924395Maxim KuzminRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3921395Maxim KuzminRandom executionaido1_LF1_r3-v3step2-scoringerrorno2390:00:09
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job3921-2440', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job3921-2440', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3915394Maxim KuzminRandom executionaido1_LF1_r3-v3step3-videoserrorno2390:00:10
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job3915-748', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job3915-748', 'up', '-d']' returned non-zero exit status 1

 docker-compose stdout  | None
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3907392Liam PaullPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.166666666666658


other stats
episodes
details{"ep000": {"nsteps": 136, "reward": -9.805884119780623, "good_angle": 16.565620647301646, "survival_time": 4.533333333333327, "traveled_tiles": 2, "valid_direction": 3.2666666666666595}, "ep001": {"nsteps": 212, "reward": -4.903022511912738, "good_angle": 0.37201886793995104, "survival_time": 7.066666666666651, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 177, "reward": -5.718259569192549, "good_angle": 0.2605543755386543, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 155, "reward": -8.698432126352865, "good_angle": 8.035554062587698, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 1.1666666666666623}, "ep004": {"nsteps": 57, "reward": -20.17012047767639, "good_angle": 0.18632442950223171, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.7000000000000021}}
good_angle_max16.565620647301646
good_angle_mean5.084014476574035
good_angle_median0.37201886793995104
good_angle_min0.18632442950223171
reward_max-4.903022511912738
reward_mean-9.859143760983034
reward_median-8.698432126352865
reward_min-20.17012047767639
survival_time_max7.066666666666651
survival_time_mean4.913333333333325
survival_time_min1.9000000000000024
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.2666666666666595
valid_direction_mean1.0266666666666648
valid_direction_median0.7000000000000021
valid_direction_min0
3901390Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/$(arg pkg_name)/$(arg node_name)/$(arg param_file_name).yaml"/>

Hidden. If you are the author, please login using the top-right link or use the dashboard.
3898387Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>

Hidden. If you are the author, please login using the top-right link or use the dashboard.
3893386Bhairav MehtaPyTorch DDPG baselineaido1_LF1_r3-v3step1-simulationsuccessno2390:01:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3883383Andrea CensiRandom executionaido1_LF1_r3-v3step4-vizsuccessno2390:01:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3881382Andrea CensiTensorflow templateaido1_LFV_r1-v3step4-vizsuccessno2390:00:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3879382Andrea CensiTensorflow templateaido1_LFV_r1-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.766666666666663


other stats
episodes
details{"ep000": {"nsteps": 48, "reward": -21.42554907328061, "good_angle": 2.8207892741930283, "survival_time": 1.6000000000000016, "traveled_tiles": 3, "valid_direction": 1.2000000000000015}, "ep001": {"nsteps": 113, "reward": -9.126021487457034, "good_angle": 0.4336047256271916, "survival_time": 3.766666666666663, "traveled_tiles": 2, "valid_direction": 0.6333333333333311}, "ep002": {"nsteps": 243, "reward": -4.33631397868864, "good_angle": 0.5664875769269541, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5999999999999999}, "ep003": {"nsteps": 40, "reward": -27.10161850526929, "good_angle": 0.3398250760817241, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.8333333333333335}, "ep004": {"nsteps": 144, "reward": -7.179838152958029, "good_angle": 0.3167340923939786, "survival_time": 4.799999999999993, "traveled_tiles": 4, "valid_direction": 0.966666666666666}}
good_angle_max2.8207892741930283
good_angle_mean0.8954881490445754
good_angle_median0.4336047256271916
good_angle_min0.3167340923939786
reward_max-4.33631397868864
reward_mean-13.83386823953072
reward_median-9.126021487457034
reward_min-27.10161850526929
survival_time_max8.099999999999982
survival_time_mean3.9199999999999946
survival_time_min1.333333333333334
traveled_tiles_max5
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.2000000000000015
valid_direction_mean0.8466666666666665
valid_direction_median0.8333333333333335
valid_direction_min0.5999999999999999
3876383Andrea CensiRandom executionaido1_LF1_r3-v3step3-videossuccessno2390:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3874383Andrea CensiRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.966666666666645


other stats
episodes
details{"ep000": {"nsteps": 168, "reward": -7.81285531605993, "good_angle": 23.476013097647296, "survival_time": 5.59999999999999, "traveled_tiles": 2, "valid_direction": 3.8666666666666543}, "ep001": {"nsteps": 375, "reward": -3.4387499952232465, "good_angle": 22.289230527951595, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 363, "reward": -2.809226464649814, "good_angle": 0.11652595619339516, "survival_time": 12.099999999999968, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 259, "reward": -6.067996551171233, "good_angle": 26.580938366474136, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}, "ep004": {"nsteps": 269, "reward": -5.601119281128603, "good_angle": 5.078170080934802, "survival_time": 8.966666666666645, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}
good_angle_max26.580938366474136
good_angle_mean15.508175605840243
good_angle_median22.289230527951595
good_angle_min0.11652595619339516
reward_max-2.809226464649814
reward_mean-5.145989521646565
reward_median-5.601119281128603
reward_min-7.81285531605993
survival_time_max12.499999999999966
survival_time_mean9.559999999999976
survival_time_min5.59999999999999
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.9666666666666535
valid_direction_mean2.9533333333333234
valid_direction_median3.8666666666666543
valid_direction_min0
3863372lavoiemsTensorflow templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
3862372lavoiemsTensorflow templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
3851379ivanthaSolution templateaido1_luck-v3step1timeoutyes2390:11:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
3848372lavoiemsTensorflow templateaido1_LF1_r3-v3step3-videostimeoutno2390:11:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
3845376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
3843376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
3841379ivanthaSolution templateaido1_luck-v3step1timeoutyes2390:11:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
3836372lavoiemsTensorflow templateaido1_LF1_r3-v3step2-scoringtimeoutno2390:11:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
3834376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
3828376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-viztimeoutno2390:11:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
3646372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
3645374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
3631376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
3507378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3497377anna.tsalapovasimple submissionaido1_LF1_r3-v3step1-simulationfailedno2390:00:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Hidden. If you are the author, please login using the top-right link or use the dashboard.
3430378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
3411378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3407378Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
3377377anna.tsalapovasimple submissionaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3373377anna.tsalapovasimple submissionaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
3253372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3248372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
3246374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3230372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3226373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationerrorno2390:00:33
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission373/step1-simulation-rudolf-7-job3226/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3222374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
3219372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
3218372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
3214374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
3213373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
3209372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
3205374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
3204373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
3203372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3196374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3195374lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
3191373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
3184372lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
3181373lavoiemsTensorflow templateaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
3161370MandanaSamieiPyTorch DDPG templateaido1_LF1_r2-v3step2-scoringsuccessyes2390:00:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median2
survival_time_mean3.2933333333333294
good_angle_mean5.273807540445858
valid_direction_mean4.173333333333322


other stats
episodes
details{"ep000": {"nsteps": 139, "reward": -7.565178305818532, "good_angle": 2.9537029902021565, "survival_time": 4.633333333333327, "traveled_tiles": 2, "valid_direction": 3.833333333333327}, "ep001": {"nsteps": 132, "reward": -8.31976330325459, "good_angle": 3.3420249625431753, "survival_time": 4.399999999999994, "traveled_tiles": 1, "valid_direction": 3.199999999999994}, "ep002": {"nsteps": 266, "reward": -4.626618917087002, "good_angle": 14.881676847466942, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 6.966666666666649}, "ep003": {"nsteps": 500, "reward": -1.7608802081346513, "good_angle": 2.912241784465008, "survival_time": 1.1333333333333335, "traveled_tiles": 5, "valid_direction": 4.166666666666652}, "ep004": {"nsteps": 154, "reward": -8.994127320004749, "good_angle": 2.2793911175520125, "survival_time": 5.133333333333325, "traveled_tiles": 1, "valid_direction": 2.6999999999999904}}
good_angle_max14.881676847466942
good_angle_median2.9537029902021565
good_angle_min2.2793911175520125
reward_max-1.7608802081346513
reward_mean-6.2533136108599034
reward_median-7.565178305818532
reward_min-8.994127320004749
survival_time_max5.133333333333325
survival_time_median4.399999999999994
survival_time_min1.1333333333333335
traveled_tiles_max5
traveled_tiles_mean2.4
traveled_tiles_min1
valid_direction_max6.966666666666649
valid_direction_median3.833333333333327
valid_direction_min2.6999999999999904
3157369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessno2390:00:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.6333333333333195


other stats
episodes
details{"ep000": {"nsteps": 169, "reward": -6.8283765424076, "good_angle": 7.999303425448919, "survival_time": 5.633333333333323, "traveled_tiles": 3, "valid_direction": 5.066666666666657}, "ep001": {"nsteps": 268, "reward": -5.4336542407078525, "good_angle": 16.490502453353404, "survival_time": 8.933333333333312, "traveled_tiles": 3, "valid_direction": 2.833333333333324}, "ep002": {"nsteps": 278, "reward": -3.755402221434863, "good_angle": 0.34385514214482626, "survival_time": 9.266666666666644, "traveled_tiles": 4, "valid_direction": 0.6999999999999975}, "ep003": {"nsteps": 199, "reward": -7.1359357522360645, "good_angle": 25.071511405613673, "survival_time": 6.6333333333333195, "traveled_tiles": 3, "valid_direction": 3.133333333333322}, "ep004": {"nsteps": 56, "reward": -20.508893579244617, "good_angle": 0.2844236053366078, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 1.2333333333333356}}
good_angle_max25.071511405613673
good_angle_mean10.037919206379486
good_angle_median7.999303425448919
good_angle_min0.2844236053366078
reward_max-3.755402221434863
reward_mean-8.732452467206198
reward_median-6.8283765424076
reward_min-20.508893579244617
survival_time_max9.266666666666644
survival_time_mean6.466666666666653
survival_time_min1.8666666666666691
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max5.066666666666657
valid_direction_mean2.5933333333333275
valid_direction_median2.833333333333324
valid_direction_min0.6999999999999975
3155369Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno2390:04:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3152368lavoiemsRandom executionaido1_LF1_r2-v3step1-simulationsuccessyes2390:02:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3149364pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3146364pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessno2390:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.666666666666656


other stats
episodes
details{"ep000": {"nsteps": 138, "reward": -9.944227305011474, "good_angle": 17.78581226319914, "survival_time": 4.599999999999993, "traveled_tiles": 2, "valid_direction": 3.4666666666666597}, "ep001": {"nsteps": 171, "reward": -7.550793215545298, "good_angle": 0.5577320054156198, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.033333333333326}, "ep002": {"nsteps": 170, "reward": -5.945409335289151, "good_angle": 0.27434307464769914, "survival_time": 5.666666666666656, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.713866951715881, "good_angle": 11.904673601179828, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 1.9333333333333265}, "ep004": {"nsteps": 75, "reward": -15.857028853098551, "good_angle": 0.20094615150713888, "survival_time": 2.500000000000001, "traveled_tiles": 2, "valid_direction": 0.7666666666666655}}
good_angle_max17.78581226319914
good_angle_mean6.144701419189885
good_angle_median0.5577320054156198
good_angle_min0.20094615150713888
reward_max-5.945409335289151
reward_mean-9.402265132132069
reward_median-7.713866951715881
reward_min-15.857028853098551
survival_time_max6.033333333333322
survival_time_mean4.899999999999992
survival_time_min2.500000000000001
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max3.4666666666666597
valid_direction_mean1.6399999999999957
valid_direction_median1.9333333333333265
valid_direction_min0
3127195Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno2390:10:31
Timeout: Waited 603 [...]
Timeout:

Waited 603.03736186 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3124217Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3122361heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2390:00:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 96, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Hidden. If you are the author, please login using the top-right link or use the dashboard.
3120219Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2390:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3118221Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno2390:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory

Hidden. If you are the author, please login using the top-right link or use the dashboard.
3115245heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2390:00:25
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission245/step1-simulation-rudolf-7-job3115/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3111272heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2390:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission272/step1-simulation-rudolf-7-job3111/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3110273heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationtimeoutno2390:11:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
3104356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessno2390:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3098356Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessno2390:00:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3093350Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3077304heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2390:10:28
Timeout: Waited 602 [...]
Timeout:

Waited 602.66029191 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
3074314Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailedno2390:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
3068350Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessno2390:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
3060346Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno2390:03:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
3054353heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno2390:00:26
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 526, in run_one
    cr = read_challenge_results(wd)
  File "/project/src/duckietown-challenges/src/duckietown_challenges/challenge_results.py", line 63, in read_challenge_results
    raise Exception(msg)
Exception: File u'/tmp/duckietown/DT18/evaluator/executions/aido1_LF1_r3-v3/submission353/step1-simulation-rudolf-7-job3054/challenge-results/challenge_results.yaml' does not exist.
Hidden. If you are the author, please login using the top-right link or use the dashboard.