AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 269

evaluator269
ownerAndrea Censi
machinenutonomy-P50
processnutonomy-P50-2570
versionDC:3.1.52;DCR:3.2.12;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success50
# timeout
# failed9
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5740764miksazRL solutionaido1_LF1_r3-v3step2-scoringsuccessno2690:02:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.299999999999978


other stats
episodes
details{"ep000": {"nsteps": 151, "reward": -7.049707989082348, "good_angle": 3.2308304545972866, "survival_time": 5.033333333333325, "traveled_tiles": 1, "valid_direction": 4.199999999999992}, "ep001": {"nsteps": 279, "reward": -3.891245903510694, "good_angle": 0.9299167932474692, "survival_time": 9.299999999999978, "traveled_tiles": 2, "valid_direction": 2.599999999999998}, "ep002": {"nsteps": 500, "reward": -0.31183041554270313, "good_angle": 0.42334523255448425, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 203, "reward": -5.425280580441054, "good_angle": 2.0918994328631215, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 5.499999999999988}, "ep004": {"nsteps": 500, "reward": -1.5710352215059102, "good_angle": 42.97100593665618, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 11.499999999999991}}
good_angle_max42.97100593665618
good_angle_mean9.929399569983708
good_angle_median2.0918994328631215
good_angle_min0.42334523255448425
reward_max-0.31183041554270313
reward_mean-3.6498200220165415
reward_median-3.891245903510694
reward_min-7.049707989082348
survival_time_max16.666666666666654
survival_time_mean10.886666666666653
survival_time_min5.033333333333325
traveled_tiles_max6
traveled_tiles_mean2.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max11.499999999999991
valid_direction_mean4.90666666666666
valid_direction_median4.199999999999992
valid_direction_min0.7333333333333307
5736763Bhairav MehtaTuned lane controller - ETHZ baseline extensionaido1_LF1_r3-v3step1-simulationfailedno2690:10:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5733762miksazRL solutionaido1_LF1_r3-v3step3-videossuccessno2690:01:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5727761Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2690:02:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5724761Maxim KuzminROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2690:00:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 149, "reward": -7.392234276105094, "good_angle": 13.035006652002206, "survival_time": 4.966666666666659, "traveled_tiles": 3, "valid_direction": 2.933333333333324}, "ep001": {"nsteps": 500, "reward": -0.3217624191492796, "good_angle": 18.06820610150098, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.933333333333323}, "ep002": {"nsteps": 500, "reward": -0.38393971337378024, "good_angle": 0.04169037891178736, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 266, "reward": -4.495429577824092, "good_angle": 12.341967398129391, "survival_time": 8.866666666666646, "traveled_tiles": 4, "valid_direction": 2.866666666666658}, "ep004": {"nsteps": 500, "reward": -0.7817404213696718, "good_angle": 2.8608257095229974, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.066666666666652}}
good_angle_max18.06820610150098
good_angle_mean9.269539248013473
good_angle_median12.341967398129391
good_angle_min0.04169037891178736
reward_max-0.3217624191492796
reward_mean-2.6750212815643835
reward_median-0.7817404213696718
reward_min-7.392234276105094
survival_time_max16.666666666666654
survival_time_mean12.766666666666657
survival_time_min4.966666666666659
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max6.066666666666652
valid_direction_mean2.959999999999991
valid_direction_median2.933333333333323
valid_direction_min0
5722760yjz093Solution templateaido1_luck-v3step1successyes2690:00:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
score170.4790248470247


5717759gunshiBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessno2690:02:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.833333333333306


other stats
episodes
details{"ep000": {"nsteps": 204, "reward": -6.82617858607395, "good_angle": 29.052760615620816, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 4.699999999999983}, "ep001": {"nsteps": 452, "reward": -3.266038857532286, "good_angle": 28.412707913017694, "survival_time": 15.066666666666624, "traveled_tiles": 3, "valid_direction": 4.699999999999983}, "ep002": {"nsteps": 500, "reward": -0.08889611337642418, "good_angle": 0.1127756778563064, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 0}, "ep003": {"nsteps": 310, "reward": -5.325173655248458, "good_angle": 31.515511266871705, "survival_time": 10.333333333333307, "traveled_tiles": 3, "valid_direction": 4.699999999999984}, "ep004": {"nsteps": 325, "reward": -4.907598058059811, "good_angle": 5.662633962039346, "survival_time": 10.833333333333306, "traveled_tiles": 3, "valid_direction": 3.566666666666655}}
good_angle_max31.515511266871705
good_angle_mean18.951277887081172
good_angle_median28.412707913017694
good_angle_min0.1127756778563064
reward_max-0.08889611337642418
reward_mean-4.082777054058186
reward_median-4.907598058059811
reward_min-6.82617858607395
survival_time_max16.666666666666654
survival_time_mean11.939999999999976
survival_time_min6.799999999999986
traveled_tiles_max5
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.699999999999984
valid_direction_mean3.5333333333333217
valid_direction_median4.699999999999983
valid_direction_min0
5711758miksazRL solutionaido1_LF1_r3-v3step1-simulationsuccessno2690:03:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5702756marshinPyTorch templateaido1_LF1_r3-v3step4-vizsuccessno2690:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5695756marshinPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno2690:02:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5693755miksazRL solutionaido1_LF1_r3-v3step4-vizsuccessno2690:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5677750marshinSolution templateaido1_luck-v3step1successyes2690:00:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
score147.01263780933539


5673748VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:04:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5657746VincentMaiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:08:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5653745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessno2690:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5648745heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno2690:09:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5646743heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2690:10:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
5644742placailleROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:01:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5637741ManishSolution templateaido1_luck-v3step1successyes2690:00:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
score143.27358327758777


5636740Andrea CensiCopy of #15: sub 574 by trimcao (PyTorch template)aido1_LF1_r3-v3step4-vizsuccessno2690:01:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5622737heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessno2690:02:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.7947607793244533, "good_angle": 50.871895001177585, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 8.79999999999997}, "ep001": {"nsteps": 500, "reward": -0.791930663626641, "good_angle": 36.79047601703185, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.233333333333344}, "ep002": {"nsteps": 500, "reward": -1.007000924691558, "good_angle": 1.2174371064857936, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 2.0999999999999925}, "ep003": {"nsteps": 500, "reward": -0.8188124289009721, "good_angle": 42.098294342947696, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.466666666666679}, "ep004": {"nsteps": 500, "reward": -1.3624944336237386, "good_angle": 5.402375667365257, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.700000000000013}}
good_angle_max50.871895001177585
good_angle_mean27.27609562700163
good_angle_median36.79047601703185
good_angle_min1.2174371064857936
reward_max-0.791930663626641
reward_mean-0.9549998460334724
reward_median-0.8188124289009721
reward_min-1.3624944336237386
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max7
traveled_tiles_mean6.2
traveled_tiles_median6
traveled_tiles_min6
valid_direction_max8.79999999999997
valid_direction_mean6.26
valid_direction_median6.700000000000013
valid_direction_min2.0999999999999925
5615736heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno2690:00:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 117, in run
    solve(params, cis)
  File "solution.py", line 55, in solve
    env = make_env(config, debug=debug)
  File "solution.py", line 21, in make_env
    kwargs={"frame_skip": config['frame_skip']})
TypeError: make() got an unexpected keyword argument 'kwargs'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
5604731heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessno2690:04:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5583726JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2690:01:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5577726JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2690:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5568720BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5566724BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:03:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5558722BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2690:03:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5549723BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2690:02:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5511713BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:05:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5499712Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:05:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5491711BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:08:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5487709JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessno2690:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5482709JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno2690:05:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5480708JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2690:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5473705JonJP pipelineaido1_LF1_r3-v3step3-videossuccessno2690:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5469704JonRandom executionaido1_LF1_r3-v3step4-vizsuccessno2690:02:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5464704JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2690:01:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5460703JonRandom executionaido1_LF1_r3-v3step3-videossuccessno2690:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5456703JonRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2690:02:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5453702BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2690:01:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5450700BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:03:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5441700BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2690:07:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5432699MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2690:07:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5427697BenjaminMy modified ROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:05:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5421695BenjaminROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno2690:07:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5417693BenjaminROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessno2690:02:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5413692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5410692MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2690:02:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5231579206675815, "good_angle": 28.464478016032334, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.333333333333348}, "ep001": {"nsteps": 500, "reward": -0.31609272902086377, "good_angle": 17.538302246765024, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 2.8999999999999897}, "ep002": {"nsteps": 500, "reward": -0.38211745707690714, "good_angle": 0.04292090082765797, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 271, "reward": -4.448645181651485, "good_angle": 11.543214536801488, "survival_time": 9.033333333333312, "traveled_tiles": 4, "valid_direction": 2.866666666666658}, "ep004": {"nsteps": 500, "reward": -0.7898046460151672, "good_angle": 2.789892196969417, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.333333333333318}}
good_angle_max28.464478016032334
good_angle_mean12.075761579479185
good_angle_median11.543214536801488
good_angle_min0.04292090082765797
reward_max-0.31609272902086377
reward_mean-1.291963586886401
reward_median-0.5231579206675815
reward_min-4.448645181651485
survival_time_max16.666666666666654
survival_time_mean15.139999999999985
survival_time_min9.033333333333312
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.333333333333348
valid_direction_mean3.6866666666666625
valid_direction_median2.8999999999999897
valid_direction_min0
5408691MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessno2690:04:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5402690yun chenRandom executionaido1_LF1_r3-v3step3-videossuccessno2690:00:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5399689MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:06:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5390687MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:06:11
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
5372683PolyProgrammistRandom executionaido1_LF1_r3-v3step2-scoringsuccessno2690:02:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.099999999999978


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -7.906903265163913, "good_angle": 23.167319904536384, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 383, "reward": -3.2070510478580236, "good_angle": 16.473773167522435, "survival_time": 12.766666666666632, "traveled_tiles": 4, "valid_direction": 4.033333333333319}, "ep002": {"nsteps": 500, "reward": -0.006893814329640009, "good_angle": 0.49274114419548326, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.2333333333333645}, "ep003": {"nsteps": 235, "reward": -6.704229172239912, "good_angle": 19.915258517632104, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 273, "reward": -5.652174131810583, "good_angle": 5.997302694493859, "survival_time": 9.099999999999978, "traveled_tiles": 3, "valid_direction": 3.09999999999999}}
good_angle_max23.167319904536384
good_angle_mean13.209279085676052
good_angle_median16.473773167522435
good_angle_min0.49274114419548326
reward_max-0.006893814329640009
reward_mean-4.695450286280414
reward_median-5.652174131810583
reward_min-7.906903265163913
survival_time_max16.666666666666654
survival_time_mean10.413333333333314
survival_time_min5.6999999999999895
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max4.033333333333319
valid_direction_mean3.0866666666666633
valid_direction_median3.09999999999999
valid_direction_min1.2333333333333645
5362681Maxim KuzminTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessno2690:01:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5355680PolyProgrammistRandom executionaido1_LF1_r3-v3step4-vizsuccessno2690:01:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
5346680PolyProgrammistRandom executionaido1_LF1_r3-v3step1-simulationsuccessno2690:02:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
5343679MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessno2690:00:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.5562462318208999, "good_angle": 29.14299777536943, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.56666666666668}, "ep001": {"nsteps": 408, "reward": -2.897838855249004, "good_angle": 8.031778959820222, "survival_time": 13.599999999999962, "traveled_tiles": 4, "valid_direction": 2.5666666666666575}, "ep002": {"nsteps": 500, "reward": -0.3696697205603123, "good_angle": 0.04233579610914566, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 260, "reward": -4.583290520654275, "good_angle": 8.244836990294793, "survival_time": 8.666666666666647, "traveled_tiles": 4, "valid_direction": 2.633333333333325}, "ep004": {"nsteps": 500, "reward": -0.7933614415351767, "good_angle": 2.7771075905646283, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.133333333333319}}
good_angle_max29.14299777536943
good_angle_mean9.647811422431642
good_angle_median8.031778959820222
good_angle_min0.04233579610914566
reward_max-0.3696697205603123
reward_mean-1.8400813539639336
reward_median-0.7933614415351767
reward_min-4.583290520654275
survival_time_max16.666666666666654
survival_time_mean14.453333333333314
survival_time_min8.666666666666647
traveled_tiles_max5
traveled_tiles_mean4.4
traveled_tiles_median4
traveled_tiles_min4
valid_direction_max6.56666666666668
valid_direction_mean3.579999999999996
valid_direction_median2.633333333333325
valid_direction_min0
5341678MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno2690:06:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.