AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 347

evaluator347
ownerAndrea Censi
machineidsc-rudolf
processidsc-rudolf-17690
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success74
# timeout
# failed20
# error6
# aborted7
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
10657150Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3470:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10649216Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3470:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10607282heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno3470:10:35
Timeout: Waited 602 [...]
Timeout:

Waited 602.300241947 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10601311Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationfailedno3470:00:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 61, in run
    solve(params, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 64, in predict
    self._observation: [state],
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 887, in run
    run_metadata_ptr)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/client/session.py", line 1086, in _run
    str(subfeed_t.get_shape())))
ValueError: Cannot feed value of shape (1, 120, 160, 3) for Tensor u'state:0', which has shape '(1, 480, 640, 3)'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10597316Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3470:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10594319Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3470:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 88, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10586306Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationfailedno3470:02:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10583309Andrea CensiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3470:00:32
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10569350Manfred DiazTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3470:04:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median4.957104968155909
deviation-center-line_median0.7247238632408081
in-drivable-lane_median0.6666666666666643


other stats
deviation-center-line_max0.8558600659644088
deviation-center-line_mean0.5303206218884994
deviation-center-line_min0.14072291605953918
deviation-heading_max2.6783711227860767
deviation-heading_mean1.7398067848802503
deviation-heading_median2.427801074207694
deviation-heading_min0.3348345054110024
driven_any_max5.573678738813689
driven_any_mean3.6396075513152466
driven_any_median5.4776200803724135
driven_any_min0.5063193345377046
driven_lanedir_max5.1011520889022055
driven_lanedir_mean3.3258327113616835
driven_lanedir_min0.4868507497890653
in-drivable-lane_max1.166666666666666
in-drivable-lane_mean0.5000000000000007
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 5.573678738813689, "driven_lanedir": 4.957104968155909, "in-drivable-lane": 1.166666666666666, "deviation-heading": 2.5835160794424943, "deviation-center-line": 0.7589039731909486}, "ep001": {"driven_any": 0.5063193345377046, "driven_lanedir": 0.4868507497890653, "in-drivable-lane": 0, "deviation-heading": 0.3348345054110024, "deviation-center-line": 0.14072291605953918}, "ep002": {"driven_any": 5.556806530029744, "driven_lanedir": 5.1011520889022055, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 2.6783711227860767, "deviation-center-line": 0.7247238632408081}, "ep003": {"driven_any": 5.4776200803724135, "driven_lanedir": 5.050297849005792, "in-drivable-lane": 0.6666666666666732, "deviation-heading": 2.427801074207694, "deviation-center-line": 0.8558600659644088}, "ep004": {"driven_any": 1.0836130728226845, "driven_lanedir": 1.033757900955444, "in-drivable-lane": 0, "deviation-heading": 0.674511142553985, "deviation-center-line": 0.1713922909867925}}
10565349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3470:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10561349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.399999999999987


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.604170745698116, "good_angle": 1.2301917502973174, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.1000000000000005}, "ep001": {"nsteps": 192, "reward": -6.595385138668159, "good_angle": 16.434846620280414, "survival_time": 6.399999999999987, "traveled_tiles": 2, "valid_direction": 3.899999999999986}, "ep002": {"nsteps": 243, "reward": -4.708477047295501, "good_angle": 2.9835800616583676, "survival_time": 8.099999999999982, "traveled_tiles": 4, "valid_direction": 5.433333333333317}, "ep003": {"nsteps": 235, "reward": -5.313450702277825, "good_angle": 0.9382884341781615, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 3.8333333333333215}, "ep004": {"nsteps": 182, "reward": -6.635858653987, "good_angle": 1.485718414663734, "survival_time": 6.066666666666655, "traveled_tiles": 2, "valid_direction": 4.4666666666666535}}
good_angle_max16.434846620280414
good_angle_mean4.6145250562156
good_angle_median1.485718414663734
good_angle_min0.9382884341781615
reward_max-4.708477047295501
reward_mean-7.37146845758532
reward_median-6.595385138668159
reward_min-13.604170745698116
survival_time_max8.099999999999982
survival_time_mean6.179999999999988
survival_time_min2.500000000000001
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.433333333333317
valid_direction_mean3.946666666666656
valid_direction_median3.899999999999986
valid_direction_min2.1000000000000005
10554321Andrea CensiPyTorch DDPG templateaido1_LFV_r1-v3step1-simulationfailedno3470:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 62, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
    return self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
    observation, reward, done, info = self.env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10550334Andrea CensiTensorflow templateaido1_LFV_r1-v3step4-vizsuccessno3470:01:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.14056212882966856
in-drivable-lane_median0


other stats
deviation-center-line_max0.2088482491745832
deviation-center-line_mean0.15471185572303592
deviation-center-line_min0.11857116864988688
deviation-heading_max0.6909281020566628
deviation-heading_mean0.54082895501694
deviation-heading_median0.5051233802717945
deviation-heading_min0.43235700221045265
driven_any_max2.7094732207334946
driven_any_mean1.500430197030569
driven_any_median1.3951946942847553
driven_any_min0.7722235922831703
driven_lanedir_max2.189437723172276
driven_lanedir_mean1.3699010835235828
driven_lanedir_median1.3758390579958164
driven_lanedir_min0.7422319306479934
in-drivable-lane_max1.266666666666667
in-drivable-lane_mean0.2533333333333334
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.7094732207334946, "driven_lanedir": 2.189437723172276, "in-drivable-lane": 1.266666666666667, "deviation-heading": 0.6410149290523307, "deviation-center-line": 0.2088482491745832}, "ep001": {"driven_any": 0.7722235922831703, "driven_lanedir": 0.7422319306479934, "in-drivable-lane": 0, "deviation-heading": 0.43235700221045265, "deviation-center-line": 0.11857116864988688}, "ep002": {"driven_any": 1.195056730021914, "driven_lanedir": 1.1450018401336526, "in-drivable-lane": 0, "deviation-heading": 0.6909281020566628, "deviation-center-line": 0.1805652050091962}, "ep003": {"driven_any": 1.4302027478295092, "driven_lanedir": 1.3969948656681752, "in-drivable-lane": 0, "deviation-heading": 0.5051233802717945, "deviation-center-line": 0.14056212882966856}, "ep004": {"driven_any": 1.3951946942847553, "driven_lanedir": 1.3758390579958164, "in-drivable-lane": 0, "deviation-heading": 0.43472136149345897, "deviation-center-line": 0.12501252695184475}}
10546334Andrea CensiTensorflow templateaido1_LFV_r1-v3step3-videossuccessyes3470:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10544334Andrea CensiTensorflow templateaido1_LFV_r1-v3step2-scoringsuccessyes3470:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.466666666666661


other stats
episodes
details{"ep000": {"nsteps": 243, "reward": -4.3291447396737945, "good_angle": 0.581499576920051, "survival_time": 8.099999999999982, "traveled_tiles": 5, "valid_direction": 0.5666666666666665}, "ep001": {"nsteps": 78, "reward": -13.021996507850975, "good_angle": 0.42176923689785734, "survival_time": 2.6000000000000005, "traveled_tiles": 3, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 118, "reward": -8.68112879300932, "good_angle": 0.4726089712352656, "survival_time": 3.933333333333329, "traveled_tiles": 2, "valid_direction": 0.6666666666666643}, "ep003": {"nsteps": 139, "reward": -7.295423986885521, "good_angle": 0.27100701034671554, "survival_time": 4.633333333333327, "traveled_tiles": 3, "valid_direction": 0.5666666666666647}, "ep004": {"nsteps": 134, "reward": -7.560127618597949, "good_angle": 1.0827692353518417, "survival_time": 4.466666666666661, "traveled_tiles": 4, "valid_direction": 0.5333333333333314}}
good_angle_max1.0827692353518417
good_angle_mean0.5659308061503463
good_angle_median0.4726089712352656
good_angle_min0.27100701034671554
reward_max-4.3291447396737945
reward_mean-8.177564329203515
reward_median-7.560127618597949
reward_min-13.021996507850975
survival_time_max8.099999999999982
survival_time_mean4.74666666666666
survival_time_min2.6000000000000005
traveled_tiles_max5
traveled_tiles_mean3.4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max0.6666666666666643
valid_direction_mean0.5733333333333317
valid_direction_median0.5666666666666647
valid_direction_min0.5333333333333314
10533334Andrea CensiTensorflow templateaido1_LFV_r1-v3step1-simulationsuccessno3470:02:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10524364pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3470:02:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5595474272820549
deviation-center-line_median0.28694183703818704
in-drivable-lane_median3.266666666666655


other stats
deviation-center-line_max0.5604621640188293
deviation-center-line_mean0.3088653044866211
deviation-center-line_min0.15469694830615136
deviation-heading_max3.6140301383805906
deviation-heading_mean1.4974190774376648
deviation-heading_median1.0668466076435914
deviation-heading_min0.31545320326952786
driven_any_max1.950092311294152
driven_any_mean0.9747195659796196
driven_any_median1.1829301176841596
driven_any_min0.12776479806561683
driven_lanedir_max0.9420818020679832
driven_lanedir_mean0.4962804615613585
driven_lanedir_min0.12241453975447893
in-drivable-lane_max5.0333333333333155
in-drivable-lane_mean2.579999999999991
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3747020105583748, "driven_lanedir": 0.1538791159023375, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.598145774419718, "deviation-center-line": 0.1745379082770337}, "ep001": {"driven_any": 0.12776479806561683, "driven_lanedir": 0.12241453975447893, "in-drivable-lane": 0, "deviation-heading": 0.31545320326952786, "deviation-center-line": 0.15469694830615136}, "ep002": {"driven_any": 1.950092311294152, "driven_lanedir": 0.9420818020679832, "in-drivable-lane": 5.0333333333333155, "deviation-heading": 3.6140301383805906, "deviation-center-line": 0.5604621640188293}, "ep003": {"driven_any": 1.1829301176841596, "driven_lanedir": 0.5595474272820549, "in-drivable-lane": 4.066666666666652, "deviation-heading": 0.8926196634748961, "deviation-center-line": 0.28694183703818704}, "ep004": {"driven_any": 1.238108592295796, "driven_lanedir": 0.7034794227999377, "in-drivable-lane": 3.266666666666655, "deviation-heading": 1.0668466076435914, "deviation-center-line": 0.36768766479290393}}
10519358heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.199999999999984


other stats
episodes
details{"ep000": {"nsteps": 69, "reward": -14.744397077041311, "good_angle": 0.9002840182850722, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 1.8666666666666685}, "ep001": {"nsteps": 195, "reward": -6.667362828789136, "good_angle": 17.536791284684597, "survival_time": 6.499999999999987, "traveled_tiles": 2, "valid_direction": 4.5999999999999845}, "ep002": {"nsteps": 230, "reward": -4.756876854896141, "good_angle": 2.4849022245898893, "survival_time": 7.666666666666649, "traveled_tiles": 3, "valid_direction": 3.69999999999999}, "ep003": {"nsteps": 216, "reward": -5.893432596459105, "good_angle": 1.093232124761194, "survival_time": 7.199999999999984, "traveled_tiles": 3, "valid_direction": 5.299999999999983}, "ep004": {"nsteps": 231, "reward": -5.421133343231142, "good_angle": 8.610002623285633, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 4.499999999999984}}
good_angle_max17.536791284684597
good_angle_mean6.125042455121276
good_angle_median2.4849022245898893
good_angle_min0.9002840182850722
reward_max-4.756876854896141
reward_mean-7.496640540083368
reward_median-5.893432596459105
reward_min-14.744397077041311
survival_time_max7.699999999999982
survival_time_mean6.273333333333321
survival_time_min2.3000000000000016
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.299999999999983
valid_direction_mean3.9933333333333225
valid_direction_median4.499999999999984
valid_direction_min1.8666666666666685
10502358heyt0nyPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3470:04:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10497361heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 96, in run
    solve(params, cis)
  File "solution.py", line 28, in solve
    env = gym.make(params['env'])
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 167, in make
    return registry.make(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 118, in make
    spec = self.spec(id)
  File "/opt/conda/lib/python2.7/site-packages/gym/envs/registration.py", line 151, in spec
    raise error.DeprecatedEnv('Env {} not found (valid versions include {})'.format(id, matching_envs))
DeprecatedEnv: Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10468396anna.tsalapovasimple submitionaido1_LF1_r3-v3step4-vizsuccessyes3470:06:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7199114328934264
deviation-center-line_median0.725651349029092
in-drivable-lane_median0


other stats
deviation-center-line_max1.610356179034906
deviation-center-line_mean0.8676533233647288
deviation-center-line_min0.4922185378333373
deviation-heading_max4.100867133286692
deviation-heading_mean1.339475690890793
deviation-heading_median1.1240165941114446
deviation-heading_min0.07942104943374231
driven_any_max6.6400000000001045
driven_any_mean6.640000000000072
driven_any_median6.640000000000084
driven_any_min6.640000000000005
driven_lanedir_max1.4933261824878092
driven_lanedir_mean0.6576413857612371
driven_lanedir_min0.0905657460899354
in-drivable-lane_max9.266666666666666
in-drivable-lane_mean1.853333333333333
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.6400000000001045, "driven_lanedir": 0.0905657460899354, "in-drivable-lane": 9.266666666666666, "deviation-heading": 4.100867133286692, "deviation-center-line": 0.8693818689862097}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.15960164900917606, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.610356179034906}, "ep002": {"driven_any": 6.640000000000005, "driven_lanedir": 0.7199114328934264, "in-drivable-lane": 0, "deviation-heading": 0.2671562683613517, "deviation-center-line": 0.725651349029092}, "ep003": {"driven_any": 6.640000000000079, "driven_lanedir": 1.4933261824878092, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374231, "deviation-center-line": 0.6406586819400985}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8248019183258386, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.4922185378333373}}
10456396anna.tsalapovasimple submitionaido1_LF1_r3-v3step3-videossuccessyes3470:03:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10451396anna.tsalapovasimple submitionaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.21171160599775612, "good_angle": 1.7908999000353618, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 7.39999999999999}, "ep001": {"nsteps": 500, "reward": -0.49661089354753496, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.182835554510355, "good_angle": 0.03030352864283182, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.14843576791882515, "good_angle": 0.03284738421522274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.2250587911726907, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max1.7908999000353618
good_angle_mean0.4012442705904789
good_angle_median0.07595671165358207
good_angle_min0.03030352864283182
reward_max0.2250587911726907
reward_mean-0.16290700616035608
reward_median-0.182835554510355
reward_min-0.49661089354753496
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max7.39999999999999
valid_direction_mean1.479999999999998
valid_direction_median0
valid_direction_min0
10436398Maxim KuzminRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3470:03:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.100212150265079
deviation-center-line_median0.3319764478185237
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max0.8779627467315307
deviation-center-line_mean0.4685416857206235
deviation-center-line_min0.2143967335335437
deviation-heading_max2.7778411958080516
deviation-heading_mean1.4556369648291063
deviation-heading_median1.344696073358676
deviation-heading_min0.17442151568286787
driven_any_max2.117546243441621
driven_any_mean1.1284342875345947
driven_any_median1.1271275539762102
driven_any_min0.3670302240713871
driven_lanedir_max2.0512202757657048
driven_lanedir_mean0.9788472337625772
driven_lanedir_min0.1546323139106669
in-drivable-lane_max2.166666666666659
in-drivable-lane_mean0.5799999999999984
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3670302240713871, "driven_lanedir": 0.1546323139106669, "in-drivable-lane": 0.6, "deviation-heading": 2.060706133431772, "deviation-center-line": 0.2143967335335437}, "ep001": {"driven_any": 0.41852819517312134, "driven_lanedir": 0.41780791702524733, "in-drivable-lane": 0, "deviation-heading": 0.17442151568286787, "deviation-center-line": 0.3319764478185237}, "ep002": {"driven_any": 1.1271275539762102, "driven_lanedir": 1.100212150265079, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.9205199058641648, "deviation-center-line": 0.5925302469351246}, "ep003": {"driven_any": 2.117546243441621, "driven_lanedir": 2.0512202757657048, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.344696073358676, "deviation-center-line": 0.3258422535843949}, "ep004": {"driven_any": 1.6119392210106345, "driven_lanedir": 1.170363511846189, "in-drivable-lane": 2.166666666666659, "deviation-heading": 2.7778411958080516, "deviation-center-line": 0.8779627467315307}}
10427398Maxim KuzminRandom executionaido1_LF1_r3-v3step3-videossuccessyes3470:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10425398Maxim KuzminRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.133333333333315


other stats
episodes
details{"ep000": {"nsteps": 81, "reward": -12.599018872318858, "good_angle": 1.2199876007295178, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2666666666666666}, "ep001": {"nsteps": 92, "reward": -11.436616245819176, "good_angle": 0.010323141356750592, "survival_time": 3.0666666666666655, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 244, "reward": -4.649135648043917, "good_angle": 0.9288137793883512, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 456, "reward": -2.3612767614957257, "good_angle": 1.3724275229750202, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.3666666666666583}, "ep004": {"nsteps": 348, "reward": -3.748740924725004, "good_angle": 23.0249771772223, "survival_time": 11.59999999999997, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max23.0249771772223
good_angle_mean5.311305844334388
good_angle_median1.2199876007295178
good_angle_min0.010323141356750592
reward_max-2.3612767614957257
reward_mean-6.958957690480536
reward_median-4.649135648043917
reward_min-12.599018872318858
survival_time_max15.199999999999957
survival_time_mean8.139999999999981
survival_time_min2.7
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean2.1399999999999944
valid_direction_median2.2666666666666666
valid_direction_min0
10421410Liam PaullTemplate for ROS Submissionaido1_LF1_r3-v3step4-vizsuccessyes3470:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.4234837373444573
deviation-center-line_median0.16483417063736874
in-drivable-lane_median2.466666666666658


other stats
deviation-center-line_max0.28924845715410685
deviation-center-line_mean0.19272202697959837
deviation-center-line_min0.1253833219935629
deviation-heading_max1.2301769728897156
deviation-heading_mean0.9549473930107688
deviation-heading_median1.0684684712414263
deviation-heading_min0.477930265319624
driven_any_max2.013832697585437
driven_any_mean1.0185367564458176
driven_any_median0.8697044725327119
driven_any_min0.37472506406383016
driven_lanedir_max0.6221646501296145
driven_lanedir_mean0.4048640519105616
driven_lanedir_min0.15083821255592256
in-drivable-lane_max7.86666666666664
in-drivable-lane_mean2.8799999999999906
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.37472506406383016, "driven_lanedir": 0.15083821255592256, "in-drivable-lane": 0.5666666666666669, "deviation-heading": 1.2301769728897156, "deviation-center-line": 0.1253833219935629}, "ep001": {"driven_any": 1.1960298271488394, "driven_lanedir": 0.4234837373444573, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 1.1795678461784105, "deviation-center-line": 0.22259042055281617}, "ep002": {"driven_any": 0.6383917208982697, "driven_lanedir": 0.6221646501296145, "in-drivable-lane": 0, "deviation-heading": 0.477930265319624, "deviation-center-line": 0.16483417063736874}, "ep003": {"driven_any": 0.8697044725327119, "driven_lanedir": 0.39915843911274695, "in-drivable-lane": 2.466666666666658, "deviation-heading": 0.8185934094246683, "deviation-center-line": 0.16155376456013726}, "ep004": {"driven_any": 2.013832697585437, "driven_lanedir": 0.4286752204100668, "in-drivable-lane": 7.86666666666664, "deviation-heading": 1.0684684712414263, "deviation-center-line": 0.28924845715410685}}
10417408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.133333333333332


other stats
episodes
details{"ep000": {"nsteps": 73, "reward": -13.913316035566671, "good_angle": 1.045392562444471, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 86, "reward": -11.956789544220408, "good_angle": 3.02166692046445, "survival_time": 2.8666666666666663, "traveled_tiles": 2, "valid_direction": 2.033333333333333}, "ep002": {"nsteps": 156, "reward": -7.691832452564715, "good_angle": 1.562632668279302, "survival_time": 5.199999999999991, "traveled_tiles": 4, "valid_direction": 3.2999999999999936}, "ep003": {"nsteps": 119, "reward": -9.212272953297887, "good_angle": 1.330101325560742, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 3.099999999999996}, "ep004": {"nsteps": 94, "reward": -11.344474870533226, "good_angle": 1.3763510691387104, "survival_time": 3.133333333333332, "traveled_tiles": 2, "valid_direction": 2.633333333333332}}
good_angle_max3.02166692046445
good_angle_mean1.6672289091775354
good_angle_median1.3763510691387104
good_angle_min1.045392562444471
reward_max-7.691832452564715
reward_mean-10.823737171236584
reward_median-11.344474870533226
reward_min-13.913316035566671
survival_time_max5.199999999999991
survival_time_mean3.519999999999998
survival_time_min2.4333333333333345
traveled_tiles_max4
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max3.2999999999999936
valid_direction_mean2.6066666666666647
valid_direction_median2.633333333333332
valid_direction_min1.966666666666668
10404408Liam PaullPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3470:02:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10401409Liam PaullROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3470:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "./solution.py", line 89, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: error loading <rosparam> tag: 
	'param' attribute must be set for non-dictionary values
XML is <rosparam command="load" file="$(find duckietown)/config/$(arg config)/line_detector/$(arg node_name)/$(arg param_file_name).yaml"/>

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10399413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median3.8333333333333295


other stats
episodes
details{"ep000": {"nsteps": 158, "reward": -6.461606025404025, "good_angle": 1.3059732882872144, "survival_time": 5.266666666666658, "traveled_tiles": 2, "valid_direction": 1.7666666666666604}, "ep001": {"nsteps": 93, "reward": -11.3460173318463, "good_angle": 0.028273924228359372, "survival_time": 3.0999999999999988, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 123, "reward": -8.611848360154687, "good_angle": 0.230575734261408, "survival_time": 4.099999999999995, "traveled_tiles": 2, "valid_direction": 0.4333333333333318}, "ep003": {"nsteps": 115, "reward": -9.07730649586605, "good_angle": 0.13338177073337495, "survival_time": 3.8333333333333295, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}, "ep004": {"nsteps": 66, "reward": -15.63405049343904, "good_angle": 0.3547177459559659, "survival_time": 2.200000000000002, "traveled_tiles": 1, "valid_direction": 0.6333333333333337}}
good_angle_max1.3059732882872144
good_angle_mean0.41058449269326447
good_angle_median0.230575734261408
good_angle_min0.028273924228359372
reward_max-6.461606025404025
reward_mean-10.22616574134202
reward_median-9.07730649586605
reward_min-15.63405049343904
survival_time_max5.266666666666658
survival_time_mean3.6999999999999966
survival_time_min2.200000000000002
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max1.7666666666666604
valid_direction_mean0.6133333333333317
valid_direction_median0.4333333333333318
valid_direction_min0
10387413Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3470:03:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10367428SashkasemRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3470:06:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7198854330971003
deviation-center-line_median0.6993923666374686
in-drivable-lane_median0


other stats
deviation-center-line_max1.536236930464029
deviation-center-line_mean0.8128197848981245
deviation-center-line_min0.46218760059102654
deviation-heading_max3.2844048986051786
deviation-heading_mean1.1761832439544904
deviation-heading_median1.1240165941114446
deviation-heading_min0.07942104943374192
driven_any_max6.640000000000109
driven_any_mean6.64000000000007
driven_any_median6.640000000000084
driven_any_min6.639999999999995
driven_lanedir_max1.6799844318612076
driven_lanedir_mean0.6880583663417399
driven_lanedir_min0.07977707085548635
in-drivable-lane_max10.733333333333334
in-drivable-lane_mean2.146666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.640000000000109, "driven_lanedir": 0.13584553075677963, "in-drivable-lane": 10.733333333333334, "deviation-heading": 3.2844048986051786, "deviation-center-line": 0.7281699018240043}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.07977707085548635, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.536236930464029}, "ep002": {"driven_any": 6.639999999999995, "driven_lanedir": 0.7198854330971003, "in-drivable-lane": 0, "deviation-heading": 0.26715626836135253, "deviation-center-line": 0.6993923666374686}, "ep003": {"driven_any": 6.640000000000073, "driven_lanedir": 1.6799844318612076, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374192, "deviation-center-line": 0.6381121249740939}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8247993651381256, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.46218760059102654}}
10359428SashkasemRandom executionaido1_LF1_r3-v3step3-videossuccessyes3470:03:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10356426heyt0nyPyTorch templateaido1_LF1_r3-v3step3-videosabortedyes3470:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10356-935', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10356-935', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10356-935_evaluation" with the default driver
stderr | Creating job10356-935_videos_1 ...
stderr | 
Creating job10356-935_videos_1 ... error

stderr | ERROR: for job10356-935_videos_1  Cannot start service videos: network job10356-935_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job10356-935_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10353426heyt0nyPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.133333333333315


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.619904056129355, "good_angle": 1.296344350450928, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.000000000000001}, "ep001": {"nsteps": 200, "reward": -6.67220719177858, "good_angle": 19.33263181642809, "survival_time": 6.666666666666653, "traveled_tiles": 2, "valid_direction": 5.499999999999986}, "ep002": {"nsteps": 248, "reward": -4.533551920119921, "good_angle": 3.2297073074693565, "survival_time": 8.266666666666648, "traveled_tiles": 4, "valid_direction": 5.233333333333316}, "ep003": {"nsteps": 244, "reward": -5.259607985593783, "good_angle": 0.9615504649098168, "survival_time": 8.133333333333315, "traveled_tiles": 3, "valid_direction": 5.166666666666651}, "ep004": {"nsteps": 259, "reward": -4.950044048173375, "good_angle": 11.964128500622458, "survival_time": 8.633333333333313, "traveled_tiles": 3, "valid_direction": 2.6999999999999913}}
good_angle_max19.33263181642809
good_angle_mean7.356872487976131
good_angle_median3.2297073074693565
good_angle_min0.9615504649098168
reward_max-4.533551920119921
reward_mean-7.007063040359003
reward_median-5.259607985593783
reward_min-13.619904056129355
survival_time_max8.633333333333313
survival_time_mean6.8399999999999865
survival_time_min2.500000000000001
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.499999999999986
valid_direction_mean4.119999999999989
valid_direction_median5.166666666666651
valid_direction_min2.000000000000001
10350440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videosabortedyes3470:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10350-8471', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10350-8471', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10350-8471_evaluation" with the default driver
stderr | Creating job10350-8471_videos_1 ...
stderr | 
Creating job10350-8471_videos_1 ... error

stderr | ERROR: for job10350-8471_videos_1  Cannot start service videos: network job10350-8471_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job10350-8471_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10346440orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6382543184608221, "good_angle": 26.18110894363119, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999978}, "ep001": {"nsteps": 500, "reward": -0.4151158498296281, "good_angle": 13.553417258114488, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.89999999999999}, "ep002": {"nsteps": 500, "reward": -0.2500560587957734, "good_angle": 13.658932232202693, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333326}, "ep003": {"nsteps": 500, "reward": -0.17730202129750977, "good_angle": 13.64760310090124, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999991}, "ep004": {"nsteps": 500, "reward": -0.29369213936530286, "good_angle": 13.728997991349493, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}}
good_angle_max26.18110894363119
good_angle_mean16.15401190523982
good_angle_median13.658932232202693
good_angle_min13.553417258114488
reward_max-0.17730202129750977
reward_mean-0.3548840775498073
reward_median-0.29369213936530286
reward_min-0.6382543184608221
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max13.033333333333326
valid_direction_mean12.719999999999988
valid_direction_median12.96666666666666
valid_direction_min11.699999999999978
10342432Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step3-videossuccessyes3470:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10340438BenjaminROS-based Lane Followingaido1_LF1_r3-v3step4-vizabortedyes3470:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10340-3082', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10340-3082', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10340-3082_evaluation" with the default driver
stderr | Creating job10340-3082_visualization_1 ...
stderr | 
Creating job10340-3082_visualization_1 ... error

stderr | ERROR: for job10340-3082_visualization_1  Cannot start service visualization: network job10340-3082_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job10340-3082_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10339432Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.8999999999999995


other stats
episodes
details{"ep000": {"nsteps": 100, "reward": -10.179613821655511, "good_angle": 0.3620843450670401, "survival_time": 3.3333333333333313, "traveled_tiles": 2, "valid_direction": 1.5666666666666669}, "ep001": {"nsteps": 31, "reward": -32.847541288983436, "good_angle": 0.04835720120402734, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.06666666666666665}, "ep002": {"nsteps": 56, "reward": -18.323521735678828, "good_angle": 0.09308440087844524, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.2666666666666674}, "ep003": {"nsteps": 87, "reward": -11.565834969185806, "good_angle": 0.27039609574992746, "survival_time": 2.8999999999999995, "traveled_tiles": 2, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 240, "reward": -4.979632231296273, "good_angle": 15.012059567050626, "survival_time": 7.999999999999981, "traveled_tiles": 3, "valid_direction": 2.9333333333333247}}
good_angle_max15.012059567050626
good_angle_mean3.157196321990013
good_angle_median0.27039609574992746
good_angle_min0.04835720120402734
reward_max-4.979632231296273
reward_mean-15.57922880935997
reward_median-11.565834969185806
reward_min-32.847541288983436
survival_time_max7.999999999999981
survival_time_mean3.426666666666663
survival_time_min1.0333333333333332
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.9333333333333247
valid_direction_mean1.133333333333331
valid_direction_median0.8333333333333304
valid_direction_min0.06666666666666665
10328432Bhairav MehtaTemplate for ROS Submissionaido1_LF1_r3-v3step1-simulationsuccessno3470:03:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10326441orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringabortedyes3470:00:16
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10326-6804', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10326-6804', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10326-6804_evaluation" with the default driver
stderr | Creating job10326-6804_scorer_1 ...
stderr | 
Creating job10326-6804_scorer_1 ... error

stderr | ERROR: for job10326-6804_scorer_1  Cannot start service scorer: network job10326-6804_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job10326-6804_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10325433orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3470:00:35
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10324434BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3470:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10322437BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3470:00:33
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10318439BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3470:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10306464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3470:06:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.100249689175728
deviation-center-line_median1.3449474516272864
in-drivable-lane_median1.6999999999999946


other stats
deviation-center-line_max1.3768982623538213
deviation-center-line_mean1.1562875543915694
deviation-center-line_min0.3685860053560791
deviation-heading_max11.68388141943642
deviation-heading_mean9.352449839692795
deviation-heading_median10.618271797823088
deviation-heading_min3.660740042655455
driven_any_max4.979113636122271
driven_any_mean4.852610389758444
driven_any_median4.979031772314665
driven_any_min4.346832205322924
driven_lanedir_max3.167659217109948
driven_lanedir_mean2.624352949811872
driven_lanedir_min0.676559070177116
in-drivable-lane_max10.433333333333302
in-drivable-lane_mean3.339999999999989
in-drivable-lane_min0.8666666666666638
per-episodes
details{"ep000": {"driven_any": 4.346832205322924, "driven_lanedir": 0.676559070177116, "in-drivable-lane": 10.433333333333302, "deviation-heading": 3.660740042655455, "deviation-center-line": 0.3685860053560791}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.979031772314665, "driven_lanedir": 3.1223517073098175, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.846312140368983, "deviation-center-line": 1.3449474516272864}, "ep003": {"driven_any": 4.978960698910106, "driven_lanedir": 3.167659217109948, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 11.68388141943642, "deviation-center-line": 1.342293455826984}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
10280464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3470:04:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10276464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 437, "reward": -2.9288726860958496, "good_angle": 23.9779702734845, "survival_time": 14.566666666666626, "traveled_tiles": 1, "valid_direction": 10.433333333333303}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25310920631792394, "good_angle": 13.56356330463625, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 500, "reward": -0.1725637492822534, "good_angle": 13.543601805681016, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.999999999999986}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}
good_angle_max23.9779702734845
good_angle_mean15.668053312695392
good_angle_median13.56356330463625
good_angle_min13.49085374796333
reward_max-0.1725637492822534
reward_mean-0.808093436285598
reward_median-0.3079843127221684
reward_min-2.9288726860958496
survival_time_max16.666666666666654
survival_time_mean16.24666666666665
survival_time_min14.566666666666626
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.033333333333324
valid_direction_mean12.459999999999985
valid_direction_median12.96666666666665
valid_direction_min10.433333333333303
10250464orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3470:09:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10234488JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:05:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9484799136944472
deviation-center-line_median0.5677877054113932
in-drivable-lane_median8.600000000000005


other stats
deviation-center-line_max2.028264730701824
deviation-center-line_mean0.7845677824160513
deviation-center-line_min0
deviation-heading_max3.855478019303108
deviation-heading_mean1.8401736616315607
deviation-heading_median1.2599816114188076
deviation-heading_min0
driven_any_max2.3498124000699914
driven_any_mean1.5674342795309453
driven_any_median1.6626210159854036
driven_any_min0.8266315486538579
driven_lanedir_max2.2167245049148843
driven_lanedir_mean0.9400170857578052
driven_lanedir_min0
in-drivable-lane_max13.233333333333324
in-drivable-lane_mean7.80666666666666
in-drivable-lane_min0.3333333333333499
per-episodes
details{"ep000": {"driven_any": 1.6626210159854036, "driven_lanedir": 0, "in-drivable-lane": 11.466666666666637, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.2304390214165508, "driven_lanedir": 0.9484799136944472, "in-drivable-lane": 8.600000000000005, "deviation-heading": 2.9701903473088436, "deviation-center-line": 0.5677877054113932}, "ep002": {"driven_any": 0.8266315486538579, "driven_lanedir": 0.4717396946818984, "in-drivable-lane": 13.233333333333324, "deviation-heading": 1.2599816114188076, "deviation-center-line": 0.2952874933258186}, "ep003": {"driven_any": 1.7676674115289226, "driven_lanedir": 1.0631413154977951, "in-drivable-lane": 5.399999999999982, "deviation-heading": 1.1152183301270446, "deviation-center-line": 1.0314989826412202}, "ep004": {"driven_any": 2.3498124000699914, "driven_lanedir": 2.2167245049148843, "in-drivable-lane": 0.3333333333333499, "deviation-heading": 3.855478019303108, "deviation-center-line": 2.028264730701824}}
10218488JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:03:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10216488JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 345, "reward": -4.313861366026644, "good_angle": 1.546963724020236, "survival_time": 11.49999999999997, "traveled_tiles": 4, "valid_direction": 3.29999999999999}, "ep001": {"nsteps": 500, "reward": -1.4437675743107683, "good_angle": 36.38482725489614, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 13.533333333333326}, "ep002": {"nsteps": 500, "reward": -2.2561783680744703, "good_angle": 17.112066147994756, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.299999999999986}, "ep003": {"nsteps": 381, "reward": -3.5520301861364993, "good_angle": 2.049322127125053, "survival_time": 12.699999999999966, "traveled_tiles": 4, "valid_direction": 3.5333333333333212}, "ep004": {"nsteps": 500, "reward": -0.2958944531888701, "good_angle": 15.908114050280265, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.8999999999999897}}
good_angle_max36.38482725489614
good_angle_mean14.60025866086329
good_angle_median15.908114050280265
good_angle_min1.546963724020236
reward_max-0.2958944531888701
reward_mean-2.3723463895474506
reward_median-2.2561783680744703
reward_min-4.313861366026644
survival_time_max16.666666666666654
survival_time_mean14.83999999999998
survival_time_min11.49999999999997
traveled_tiles_max5
traveled_tiles_mean3.8
traveled_tiles_median4
traveled_tiles_min3
valid_direction_max15.299999999999986
valid_direction_mean7.913333333333323
valid_direction_median3.8999999999999897
valid_direction_min3.29999999999999
102151267delfinSolution templateaido1_luck-v3step1successyes3470:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
score146.63534936468395


10190489JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3470:09:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10185495heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringabortedyes3470:00:13
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10185-7607', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10185-7607', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10185-7607_evaluation" with the default driver
stderr | Creating job10185-7607_scorer_1 ...
stderr | 
Creating job10185-7607_scorer_1 ... error

stderr | ERROR: for job10185-7607_scorer_1  Cannot start service scorer: network job10185-7607_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job10185-7607_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10179492heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 93, in run
    solve(params, cis)
  File "solution.py", line 33, in solve
    env = ScaleObservations(env)
  File "/workspace/wrappers.py", line 65, in __init__
    super().__init__(env)
TypeError: super() takes at least 1 argument (0 given)


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10166504JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:03:53Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.0941251577979232
deviation-center-line_median0.1049754905501176
in-drivable-lane_median14.96666666666665


other stats
deviation-center-line_max0.15852697775707889
deviation-center-line_mean0.10181130671066452
deviation-center-line_min0
deviation-heading_max7.493452325397093
deviation-heading_mean2.3905845928234184
deviation-heading_median1.4465686023627768
deviation-heading_min0
driven_any_max0.6068662327667798
driven_any_mean0.5144064444799654
driven_any_median0.5200624914823357
driven_any_min0.38447408955460327
driven_lanedir_max0.20131010512618275
driven_lanedir_mean0.10520494816477814
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean14.57999999999999
in-drivable-lane_min10.866666666666664
per-episodes
details{"ep000": {"driven_any": 0.38447408955460327, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.5200624914823357, "driven_lanedir": 0.0941251577979232, "in-drivable-lane": 14.83333333333332, "deviation-heading": 1.8447023684636368, "deviation-center-line": 0.15852697775707889}, "ep002": {"driven_any": 0.5892270118460103, "driven_lanedir": 0.16879272881447172, "in-drivable-lane": 10.866666666666664, "deviation-heading": 7.493452325397093, "deviation-center-line": 0.14728183195328062}, "ep003": {"driven_any": 0.4714023967500981, "driven_lanedir": 0.061796749085313074, "in-drivable-lane": 15.599999999999984, "deviation-heading": 1.1681996678935862, "deviation-center-line": 0.09827223329284553}, "ep004": {"driven_any": 0.6068662327667798, "driven_lanedir": 0.20131010512618275, "in-drivable-lane": 14.96666666666665, "deviation-heading": 1.4465686023627768, "deviation-center-line": 0.1049754905501176}}
10162501Manfred DiazTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}
good_angle_max0.8928199947802034
good_angle_mean0.44726467462067304
good_angle_median0.33400722083424306
good_angle_min0.060537386068120175
reward_max-0.28626655193418266
reward_mean-5.91151246140921
reward_median-4.076980934218227
reward_min-15.93245312479826
survival_time_max16.666666666666654
survival_time_mean8.973333333333319
survival_time_min2.1666666666666687
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.4999999999999956
valid_direction_mean0.7466666666666641
valid_direction_median0.6666666666666643
valid_direction_min0.09999999999999964
10151501Manfred DiazTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3470:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10131506JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3470:07:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10097517JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3470:06:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10086523heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3470:01:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.04411107874427467
deviation-center-line_median0.03382312812944439
in-drivable-lane_median0


other stats
deviation-center-line_max0.036932541750262865
deviation-center-line_mean0.025155405677972437
deviation-center-line_min0
deviation-heading_max0.33344468140579925
deviation-heading_mean0.22039329655951928
deviation-heading_median0.26280377843412867
deviation-heading_min0
driven_any_max3.3176367416071093
driven_any_mean0.7248170230659711
driven_any_median0.07328113284674392
driven_any_min0.05329536934308598
driven_lanedir_max0.04675978410254445
driven_lanedir_mean0.034855625077198346
driven_lanedir_min0
in-drivable-lane_max16.63333333333332
in-drivable-lane_mean3.3733333333333304
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 3.3176367416071093, "driven_lanedir": 0, "in-drivable-lane": 16.63333333333332, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.05329536934308598, "driven_lanedir": 0.03825011064919037, "in-drivable-lane": 0, "deviation-heading": 0.21638555899448664, "deviation-center-line": 0.034025485829071465}, "ep002": {"driven_any": 0.07328113284674392, "driven_lanedir": 0.04515715188998226, "in-drivable-lane": 0, "deviation-heading": 0.33344468140579925, "deviation-center-line": 0.036932541750262865}, "ep003": {"driven_any": 0.11325265985405814, "driven_lanedir": 0.04411107874427467, "in-drivable-lane": 0.23333333333333336, "deviation-heading": 0.28933246396318174, "deviation-center-line": 0.020995872681083456}, "ep004": {"driven_any": 0.0666192116788584, "driven_lanedir": 0.04675978410254445, "in-drivable-lane": 0, "deviation-heading": 0.26280377843412867, "deviation-center-line": 0.03382312812944439}}
10083520heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 65, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 19, in predict
    assert state.shape[1] == 120, "Passed shape, {}".format(state.shape)
AssertionError: Passed shape, (3, 480, 640)


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10079527heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizabortedyes3470:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10079-4478', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10079-4478', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10079-4478_evaluation" with the default driver
stderr | Creating job10079-4478_visualization_1 ...
stderr | 
Creating job10079-4478_visualization_1 ... error

stderr | ERROR: for job10079-4478_visualization_1  Cannot start service visualization: network job10079-4478_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job10079-4478_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10071527heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3470:02:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10068527heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.366666666666661


other stats
episodes
details{"ep000": {"nsteps": 171, "reward": -6.709294177134309, "good_angle": 3.212081557270962, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 2.79999999999999}, "ep001": {"nsteps": 141, "reward": -7.600244003372822, "good_angle": 4.804851725848225, "survival_time": 4.699999999999993, "traveled_tiles": 1, "valid_direction": 3.833333333333327}, "ep002": {"nsteps": 131, "reward": -8.178489692882414, "good_angle": 4.636373361798506, "survival_time": 4.366666666666661, "traveled_tiles": 2, "valid_direction": 3.6666666666666607}, "ep003": {"nsteps": 127, "reward": -8.459673733430305, "good_angle": 4.4107527352806075, "survival_time": 4.233333333333328, "traveled_tiles": 1, "valid_direction": 3.4999999999999947}, "ep004": {"nsteps": 129, "reward": -8.281368599211898, "good_angle": 4.686365787635289, "survival_time": 4.2999999999999945, "traveled_tiles": 1, "valid_direction": 3.699999999999995}}
good_angle_max4.804851725848225
good_angle_mean4.350085033566717
good_angle_median4.636373361798506
good_angle_min3.212081557270962
reward_max-6.709294177134309
reward_mean-7.84581404120635
reward_median-8.178489692882414
reward_min-8.459673733430305
survival_time_max5.6999999999999895
survival_time_mean4.659999999999993
survival_time_min4.233333333333328
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max3.833333333333327
valid_direction_mean3.499999999999994
valid_direction_median3.6666666666666607
valid_direction_min2.79999999999999
10054526heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno3470:06:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10050536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3470:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.41394887044043016
deviation-center-line_median0.16756217708037385
in-drivable-lane_median0.9333333333333308


other stats
deviation-center-line_max0.2102576219175792
deviation-center-line_mean0.16537338620109854
deviation-center-line_min0.11687463832659307
deviation-heading_max2.1375979812093284
deviation-heading_mean1.062444246296126
deviation-heading_median0.7351144237952995
deviation-heading_min0.7101333660511545
driven_any_max0.8922290980920313
driven_any_mean0.7007453863014537
driven_any_median0.7427064856026734
driven_any_min0.3518726212483181
driven_lanedir_max0.5429536253783105
driven_lanedir_mean0.38314420802987936
driven_lanedir_min0.12263231341020107
in-drivable-lane_max1.0666666666666629
in-drivable-lane_mean0.8866666666666646
in-drivable-lane_min0.6666666666666666
per-episodes
details{"ep000": {"driven_any": 0.3518726212483181, "driven_lanedir": 0.12263231341020107, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.1375979812093284, "deviation-center-line": 0.19919529762014984}, "ep001": {"driven_any": 0.8922290980920313, "driven_lanedir": 0.5429536253783105, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 1.0172572681808212, "deviation-center-line": 0.2102576219175792}, "ep002": {"driven_any": 0.7427064856026734, "driven_lanedir": 0.41394887044043016, "in-drivable-lane": 0.9333333333333308, "deviation-heading": 0.7351144237952995, "deviation-center-line": 0.13297719606079678}, "ep003": {"driven_any": 0.8167191083574574, "driven_lanedir": 0.4617633572818338, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 0.7121181922440264, "deviation-center-line": 0.16756217708037385}, "ep004": {"driven_any": 0.7001996182067881, "driven_lanedir": 0.37442287363862126, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.7101333660511545, "deviation-center-line": 0.11687463832659307}}
10046536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3470:01:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10045536BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.7666666666666666


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.75244092210196, "good_angle": 1.3066275386172672, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2}, "ep001": {"nsteps": 112, "reward": -9.292650389300045, "good_angle": 5.325693931373402, "survival_time": 3.73333333333333, "traveled_tiles": 2, "valid_direction": 2.93333333333333}, "ep002": {"nsteps": 83, "reward": -12.741244890480246, "good_angle": 1.4080609011818457, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 2.0999999999999996}, "ep003": {"nsteps": 97, "reward": -10.95527533372413, "good_angle": 1.2018329464235085, "survival_time": 3.2333333333333316, "traveled_tiles": 2, "valid_direction": 2.4999999999999982}, "ep004": {"nsteps": 72, "reward": -14.63379717091771, "good_angle": 1.423569750375535, "survival_time": 2.4000000000000012, "traveled_tiles": 2, "valid_direction": 2.000000000000001}}
good_angle_max5.325693931373402
good_angle_mean2.133157013594311
good_angle_median1.4080609011818457
good_angle_min1.2018329464235085
reward_max-9.292650389300045
reward_mean-12.075081741304816
reward_median-12.741244890480246
reward_min-14.63379717091771
survival_time_max3.73333333333333
survival_time_mean2.9599999999999995
survival_time_min2.4000000000000012
traveled_tiles_max2
traveled_tiles_mean1.8
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max2.93333333333333
valid_direction_mean2.3466666666666653
valid_direction_median2.2
valid_direction_min2.000000000000001
10040537JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:00:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10036537JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9666666666666666


other stats
episodes
details{"ep000": {"nsteps": 41, "reward": -26.03552148472972, "good_angle": 3.0844503624032997, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 1.233333333333334}, "ep001": {"nsteps": 31, "reward": -34.00843090960576, "good_angle": 0.9595897654984332, "survival_time": 1.0333333333333332, "traveled_tiles": 1, "valid_direction": 0.9666666666666665}, "ep002": {"nsteps": 24, "reward": -43.26566152833402, "good_angle": 0.991599544622662, "survival_time": 0.7999999999999999, "traveled_tiles": 2, "valid_direction": 0.7333333333333332}, "ep003": {"nsteps": 28, "reward": -37.53936479277244, "good_angle": 1.156671689445627, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep004": {"nsteps": 29, "reward": -36.280787767778186, "good_angle": 0.8047930596681112, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.8999999999999998}}
good_angle_max3.0844503624032997
good_angle_mean1.3994208843276268
good_angle_median0.991599544622662
good_angle_min0.8047930596681112
reward_max-26.03552148472972
reward_mean-35.425953296644025
reward_median-36.280787767778186
reward_min-43.26566152833402
survival_time_max1.3666666666666676
survival_time_mean1.02
survival_time_min0.7999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.233333333333334
valid_direction_mean0.9399999999999998
valid_direction_median0.8999999999999998
valid_direction_min0.7333333333333332
10031537JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3470:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10023543JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.556511482949603
deviation-center-line_median0.27999622831039583
in-drivable-lane_median1.8999999999999948


other stats
deviation-center-line_max1.0923573999517773
deviation-center-line_mean0.3724609376105471
deviation-center-line_min0
deviation-heading_max2.812228279935465
deviation-heading_mean1.1241329388970351
deviation-heading_median0.7236008447660953
deviation-heading_min0
driven_any_max4.014281751451181
driven_any_mean1.7513904822053277
driven_any_median1.3053964573512806
driven_any_min0.8694291840591771
driven_lanedir_max1.9536100225069195
driven_lanedir_mean0.7747287187844668
driven_lanedir_min0
in-drivable-lane_max7.899999999999973
in-drivable-lane_mean3.393333333333324
in-drivable-lane_min0.6333333333333311
per-episodes
details{"ep000": {"driven_any": 1.3706023338601256, "driven_lanedir": 0, "in-drivable-lane": 4.66666666666666, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.3053964573512806, "driven_lanedir": 0.9462014920882916, "in-drivable-lane": 0.6333333333333311, "deviation-heading": 1.4360808982249993, "deviation-center-line": 0.3276055880041256}, "ep002": {"driven_any": 0.8694291840591771, "driven_lanedir": 0.4173205963775197, "in-drivable-lane": 1.8999999999999948, "deviation-heading": 0.7236008447660953, "deviation-center-line": 0.16234547178643677}, "ep003": {"driven_any": 1.1972426843048751, "driven_lanedir": 0.556511482949603, "in-drivable-lane": 1.86666666666666, "deviation-heading": 0.6487546715586159, "deviation-center-line": 0.27999622831039583}, "ep004": {"driven_any": 4.014281751451181, "driven_lanedir": 1.9536100225069195, "in-drivable-lane": 7.899999999999973, "deviation-heading": 2.812228279935465, "deviation-center-line": 1.0923573999517773}}
10016543JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10010542JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:00:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.19503683289986729
deviation-center-line_median0.02802053009519329
in-drivable-lane_median0.5333333333333332


other stats
deviation-center-line_max0.051997452446258946
deviation-center-line_mean0.0330616234564004
deviation-center-line_min0.024439441715664523
deviation-heading_max0.6727610204778094
deviation-heading_mean0.32117820019293025
deviation-heading_median0.25202402706215876
deviation-heading_min0.2110863127918992
driven_any_max0.8807057078679261
driven_any_mean0.6293775838252362
driven_any_median0.5688055139620741
driven_any_min0.5359312103086633
driven_lanedir_max0.2693026765029015
driven_lanedir_mean0.21839582002031613
driven_lanedir_min0.1903540021568055
in-drivable-lane_max0.8333333333333338
in-drivable-lane_mean0.5466666666666667
in-drivable-lane_min0.26666666666666666
per-episodes
details{"ep000": {"driven_any": 0.8807057078679261, "driven_lanedir": 0.2693026765029015, "in-drivable-lane": 0.8333333333333338, "deviation-heading": 0.25584701411493577, "deviation-center-line": 0.02802053009519329}, "ep001": {"driven_any": 0.6187478995778053, "driven_lanedir": 0.24658602653714337, "in-drivable-lane": 0.5333333333333332, "deviation-heading": 0.25202402706215876, "deviation-center-line": 0.03484926287266754}, "ep002": {"driven_any": 0.5426975874097125, "driven_lanedir": 0.19069956200486304, "in-drivable-lane": 0.26666666666666666, "deviation-heading": 0.6727610204778094, "deviation-center-line": 0.051997452446258946}, "ep003": {"driven_any": 0.5359312103086633, "driven_lanedir": 0.1903540021568055, "in-drivable-lane": 0.4666666666666666, "deviation-heading": 0.2110863127918992, "deviation-center-line": 0.02600143015221769}, "ep004": {"driven_any": 0.5688055139620741, "driven_lanedir": 0.19503683289986729, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 0.21417262651784796, "deviation-center-line": 0.024439441715664523}}
10003542JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:00:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10000542JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median0.9333333333333332


other stats
episodes
details{"ep000": {"nsteps": 37, "reward": -28.360527072806615, "good_angle": 2.6052579409068777, "survival_time": 1.2333333333333338, "traveled_tiles": 2, "valid_direction": 1.1000000000000003}, "ep001": {"nsteps": 28, "reward": -37.34995021960848, "good_angle": 0.9385993003310564, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.8666666666666665}, "ep002": {"nsteps": 27, "reward": -37.97064161797365, "good_angle": 1.2633080131148096, "survival_time": 0.8999999999999999, "traveled_tiles": 2, "valid_direction": 0.8333333333333331}, "ep003": {"nsteps": 24, "reward": -43.28004418802448, "good_angle": 0.8152663290129198, "survival_time": 0.7999999999999999, "traveled_tiles": 1, "valid_direction": 0.7333333333333332}, "ep004": {"nsteps": 29, "reward": -36.26324317594669, "good_angle": 1.016251950937411, "survival_time": 0.9666666666666666, "traveled_tiles": 1, "valid_direction": 0.8999999999999998}}
good_angle_max2.6052579409068777
good_angle_mean1.327736706860615
good_angle_median1.016251950937411
good_angle_min0.8152663290129198
reward_max-28.360527072806615
reward_mean-36.644881254871976
reward_median-37.34995021960848
reward_min-43.28004418802448
survival_time_max1.2333333333333338
survival_time_mean0.9666666666666666
survival_time_min0.7999999999999999
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.1000000000000003
valid_direction_mean0.8866666666666665
valid_direction_median0.8666666666666665
valid_direction_min0.7333333333333332
9996550JonJP pipelineaido1_LF1_r3-v3step2-scoringabortedyes3470:00:14
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9996-2545', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9996-2545', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9996-2545_evaluation" with the default driver
stderr | Creating job9996-2545_scorer_1 ...
stderr | 
Creating job9996-2545_scorer_1 ... error

stderr | ERROR: for job9996-2545_scorer_1  Cannot start service scorer: network job9996-2545_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job9996-2545_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
9981548JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3470:02:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9975558JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:02:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.8310775732718574
deviation-center-line_median0.358587896243237
in-drivable-lane_median2.5666666666666575


other stats
deviation-center-line_max1.3719539375269192
deviation-center-line_mean0.459777576598594
deviation-center-line_min0
deviation-heading_max2.6407440419377446
deviation-heading_mean1.2093936883196572
deviation-heading_median0.7776821886704663
deviation-heading_min0
driven_any_max4.470132966843854
driven_any_mean1.9645306089924752
driven_any_median1.5143328068832085
driven_any_min0.8232277310327957
driven_lanedir_max2.6613849463150387
driven_lanedir_mean1.020442414377809
driven_lanedir_min0
in-drivable-lane_max5.666666666666682
in-drivable-lane_mean3.1266666666666643
in-drivable-lane_min0.9999999999999964
per-episodes
details{"ep000": {"driven_any": 1.4478513931552153, "driven_lanedir": 0, "in-drivable-lane": 5.333333333333324, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.5143328068832085, "driven_lanedir": 1.1042868663110277, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 1.987654212366769, "deviation-center-line": 0.41757706343780304}, "ep002": {"driven_any": 0.8232277310327957, "driven_lanedir": 0.5054626859911222, "in-drivable-lane": 1.0666666666666629, "deviation-heading": 0.7776821886704663, "deviation-center-line": 0.15076898578501108}, "ep003": {"driven_any": 1.5671081470473025, "driven_lanedir": 0.8310775732718574, "in-drivable-lane": 2.5666666666666575, "deviation-heading": 0.6408879986233063, "deviation-center-line": 0.358587896243237}, "ep004": {"driven_any": 4.470132966843854, "driven_lanedir": 2.6613849463150387, "in-drivable-lane": 5.666666666666682, "deviation-heading": 2.6407440419377446, "deviation-center-line": 1.3719539375269192}}
9967558JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:01:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9963558JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.966666666666655


other stats
episodes
details{"ep000": {"nsteps": 161, "reward": -8.229781145819967, "good_angle": 0.3544784221021973, "survival_time": 5.366666666666657, "traveled_tiles": 3, "valid_direction": 0.6999999999999991}, "ep001": {"nsteps": 193, "reward": -5.659544882157074, "good_angle": 12.644083654058043, "survival_time": 6.43333333333332, "traveled_tiles": 3, "valid_direction": 3.966666666666655}, "ep002": {"nsteps": 102, "reward": -10.579663636464188, "good_angle": 2.159795561900263, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 2.1999999999999975}, "ep003": {"nsteps": 179, "reward": -6.362599972474217, "good_angle": 0.8787199042538155, "survival_time": 5.966666666666655, "traveled_tiles": 3, "valid_direction": 1.2333333333333296}, "ep004": {"nsteps": 500, "reward": -0.7066865459436085, "good_angle": 25.651328513820513, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.7999999999999874}}
good_angle_max25.651328513820513
good_angle_mean8.337681211226968
good_angle_median2.159795561900263
good_angle_min0.3544784221021973
reward_max-0.7066865459436085
reward_mean-6.3076552365718115
reward_median-6.362599972474217
reward_min-10.579663636464188
survival_time_max16.666666666666654
survival_time_mean7.5666666666666575
survival_time_min3.3999999999999977
traveled_tiles_max9
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.966666666666655
valid_direction_mean2.3799999999999932
valid_direction_median2.1999999999999975
valid_direction_min0.6999999999999991
9950558JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3470:04:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9937570JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3470:03:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9926578JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1112780059021603
deviation-center-line_median0.14826000833213157
in-drivable-lane_median4.399999999999994


other stats
deviation-center-line_max0.932971221209534
deviation-center-line_mean0.3341223577953655
deviation-center-line_min0
deviation-heading_max2.824074396092524
deviation-heading_mean1.2458190664588202
deviation-heading_median0.6911087184990405
deviation-heading_min0
driven_any_max4.942355489727362
driven_any_mean2.5082233305496
driven_any_median2.338484933390528
driven_any_min1.3638335951679057
driven_lanedir_max2.7092869900977936
driven_lanedir_mean1.24084248250569
driven_lanedir_min0
in-drivable-lane_max6.7666666666666435
in-drivable-lane_mean4.073333333333329
in-drivable-lane_min1.1333333333333293
per-episodes
details{"ep000": {"driven_any": 1.3638335951679057, "driven_lanedir": 0, "in-drivable-lane": 4.399999999999994, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.50009968648738, "driven_lanedir": 1.1112780059021603, "in-drivable-lane": 1.1333333333333293, "deviation-heading": 2.228603310315176, "deviation-center-line": 0.44173951160764063}, "ep002": {"driven_any": 2.3963429479748264, "driven_lanedir": 0.7210890070690643, "in-drivable-lane": 6.7666666666666435, "deviation-heading": 0.6911087184990405, "deviation-center-line": 0.14826000833213157}, "ep003": {"driven_any": 2.338484933390528, "driven_lanedir": 1.6625584094594317, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.4853089073873599, "deviation-center-line": 0.1476410478275212}, "ep004": {"driven_any": 4.942355489727362, "driven_lanedir": 2.7092869900977936, "in-drivable-lane": 5.666666666666683, "deviation-heading": 2.824074396092524, "deviation-center-line": 0.932971221209534}}
9919578JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3470:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9904583JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3470:03:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9974379100572336
deviation-center-line_median0.6560590207850371
in-drivable-lane_median3.699999999999987


other stats
deviation-center-line_max1.8788618819421845
deviation-center-line_mean0.7440539779834248
deviation-center-line_min0
deviation-heading_max3.6541289260109022
deviation-heading_mean1.7614495500973806
deviation-heading_median1.3203671878871144
deviation-heading_min0
driven_any_max2.444226372077783
driven_any_mean1.6843065428712958
driven_any_median1.6572132165268052
driven_any_min0.9085628560098704
driven_lanedir_max2.2570891926315286
driven_lanedir_mean0.9682329297041452
driven_lanedir_min0
in-drivable-lane_max11.099999999999971
in-drivable-lane_mean4.733333333333325
in-drivable-lane_min0.6333333333333648
per-episodes
details{"ep000": {"driven_any": 1.6572132165268052, "driven_lanedir": 0, "in-drivable-lane": 11.099999999999971, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.6544189234489706, "driven_lanedir": 1.1038938191780283, "in-drivable-lane": 3.699999999999987, "deviation-heading": 2.7077627268438604, "deviation-center-line": 0.6560590207850371}, "ep002": {"driven_any": 0.9085628560098704, "driven_lanedir": 0.48274372665393583, "in-drivable-lane": 2.79999999999999, "deviation-heading": 1.3203671878871144, "deviation-center-line": 0.30032301321125654}, "ep003": {"driven_any": 1.75711134629305, "driven_lanedir": 0.9974379100572336, "in-drivable-lane": 5.433333333333315, "deviation-heading": 1.1249889097450263, "deviation-center-line": 0.885025973978646}, "ep004": {"driven_any": 2.444226372077783, "driven_lanedir": 2.2570891926315286, "in-drivable-lane": 0.6333333333333648, "deviation-heading": 3.6541289260109022, "deviation-center-line": 1.8788618819421845}}
9890577JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3470:03:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9864584JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3470:06:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9859593heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 102, in run
    solve(params, cis)
  File "solution.py", line 42, in solve
    env = make_env(config)
  File "solution.py", line 23, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9853597heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 18, in make_env
    env.__init__(frame_skip=config['frame_skip'])
TypeError: __init__() got an unexpected keyword argument 'frame_skip'


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9845599heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9840602heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 99, in run
    solve(params, cis)
  File "solution.py", line 39, in solve
    env = make_env(config)
  File "solution.py", line 20, in make_env
    env = FrameStackWrappper(env=env, k=3)
  File "/workspace/wrappers.py", line 77, in __init__
    self.undistort = UndistortWrapper(env)
NameError: global name 'UndistortWrapper' is not defined


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9828613lmandrilePyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3470:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5661020704594424
deviation-center-line_median0.2740354783309631
in-drivable-lane_median3.266666666666655


other stats
deviation-center-line_max0.5603588606390013
deviation-center-line_mean0.3120589482029849
deviation-center-line_min0.19846746065156567
deviation-heading_max3.214183416776645
deviation-heading_mean1.6059425773309546
deviation-heading_median1.2834201828497314
deviation-heading_min0.8871462076947535
driven_any_max1.3560961776989535
driven_any_mean1.04737111715508
driven_any_median1.1251706898040728
driven_any_min0.3746769082831119
driven_lanedir_max0.6715017430237435
driven_lanedir_mean0.5148131075456355
driven_lanedir_min0.15612622869521509
in-drivable-lane_max4.799999999999983
in-drivable-lane_mean2.99999999999999
in-drivable-lane_min0.5333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3746769082831119, "driven_lanedir": 0.15612622869521509, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.7338392601903574, "deviation-center-line": 0.19846746065156567}, "ep001": {"driven_any": 1.1251706898040728, "driven_lanedir": 0.6292605959907072, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 1.2834201828497314, "deviation-center-line": 0.3138953503935618}, "ep002": {"driven_any": 1.3560961776989535, "driven_lanedir": 0.6715017430237435, "in-drivable-lane": 3.266666666666655, "deviation-heading": 3.214183416776645, "deviation-center-line": 0.5603588606390013}, "ep003": {"driven_any": 1.2984217247544845, "driven_lanedir": 0.5510748995590697, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.911123819143286, "deviation-center-line": 0.2740354783309631}, "ep004": {"driven_any": 1.0824900852347763, "driven_lanedir": 0.5661020704594424, "in-drivable-lane": 3.533333333333321, "deviation-heading": 0.8871462076947535, "deviation-center-line": 0.21353759099983263}}
9820613lmandrilePyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3470:01:29Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9816613lmandrilePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.53333333333332


other stats
episodes
details{"ep000": {"nsteps": 69, "reward": -14.755288307703491, "good_angle": 0.9631811344985584, "survival_time": 2.3000000000000016, "traveled_tiles": 1, "valid_direction": 1.9000000000000017}, "ep001": {"nsteps": 196, "reward": -6.650094018956856, "good_angle": 18.18657823217711, "survival_time": 6.53333333333332, "traveled_tiles": 2, "valid_direction": 4.933333333333319}, "ep002": {"nsteps": 252, "reward": -4.722392324177134, "good_angle": 3.9299346565474216, "survival_time": 8.39999999999998, "traveled_tiles": 4, "valid_direction": 6.533333333333316}, "ep003": {"nsteps": 233, "reward": -5.56180613676222, "good_angle": 0.9968810333366812, "survival_time": 7.766666666666649, "traveled_tiles": 3, "valid_direction": 4.73333333333332}, "ep004": {"nsteps": 195, "reward": -6.338301128024558, "good_angle": 1.4994381334640132, "survival_time": 6.499999999999987, "traveled_tiles": 2, "valid_direction": 4.799999999999985}}
good_angle_max18.18657823217711
good_angle_mean5.115202638004757
good_angle_median1.4994381334640132
good_angle_min0.9631811344985584
reward_max-4.722392324177134
reward_mean-7.605576383124853
reward_median-6.338301128024558
reward_min-14.755288307703491
survival_time_max8.39999999999998
survival_time_mean6.299999999999987
survival_time_min2.3000000000000016
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max6.533333333333316
valid_direction_mean4.5799999999999885
valid_direction_median4.799999999999985
valid_direction_min1.9000000000000017
9811614lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.333333333333321


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.598021065033972, "good_angle": 1.11901761045598, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.133333333333334}, "ep001": {"nsteps": 51, "reward": -20.165890015807808, "good_angle": 0.0671978157848164, "survival_time": 1.700000000000002, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 230, "reward": -4.791167088502856, "good_angle": 2.5516459539091634, "survival_time": 7.666666666666649, "traveled_tiles": 3, "valid_direction": 4.5999999999999845}, "ep003": {"nsteps": 208, "reward": -6.038359020527703, "good_angle": 1.0460847425227788, "survival_time": 6.9333333333333185, "traveled_tiles": 3, "valid_direction": 5.7666666666666515}, "ep004": {"nsteps": 190, "reward": -6.313083494276323, "good_angle": 1.5298196489724811, "survival_time": 6.333333333333321, "traveled_tiles": 2, "valid_direction": 3.7999999999999865}}
good_angle_max2.5516459539091634
good_angle_mean1.2627531543290438
good_angle_median1.11901761045598
good_angle_min0.0671978157848164
reward_max-4.791167088502856
reward_mean-10.181304136829732
reward_median-6.313083494276323
reward_min-20.165890015807808
survival_time_max7.666666666666649
survival_time_mean5.026666666666658
survival_time_min1.700000000000002
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.7666666666666515
valid_direction_mean3.259999999999991
valid_direction_median3.7999999999999865
valid_direction_min0
9801614lavoiemsPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3470:02:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9790628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3470:03:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median-0.839634730476746
deviation-center-line_median0.3876309937395394
in-drivable-lane_median8.29999999999999


other stats
deviation-center-line_max0.5747826826548895
deviation-center-line_mean0.3643303634439444
deviation-center-line_min0.13729734885380554
deviation-heading_max6.58245575091181
deviation-heading_mean5.302655958935572
deviation-heading_median6.539566120620427
deviation-heading_min0.32328388756500265
driven_any_max2.6532777821831983
driven_any_mean2.6532777821831908
driven_any_median2.6532777821831885
driven_any_min2.653277782183184
driven_lanedir_max-0.2575588697397758
driven_lanedir_mean-0.7245298252797052
driven_lanedir_min-0.8446015392792754
in-drivable-lane_max14.933333333333325
in-drivable-lane_mean9.633333333333322
in-drivable-lane_min8.299999999999988
per-episodes
details{"ep000": {"driven_any": 2.6532777821831983, "driven_lanedir": -0.2575588697397758, "in-drivable-lane": 14.933333333333325, "deviation-heading": 0.32328388756500265, "deviation-center-line": 0.3959689180795801}, "ep001": {"driven_any": 2.6532777821831877, "driven_lanedir": -0.8392146675166066, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.58245575091181, "deviation-center-line": 0.5747826826548895}, "ep002": {"driven_any": 2.653277782183195, "driven_lanedir": -0.8416393193861229, "in-drivable-lane": 8.29999999999999, "deviation-heading": 6.556737670234658, "deviation-center-line": 0.3259718738919073}, "ep003": {"driven_any": 2.653277782183184, "driven_lanedir": -0.839634730476746, "in-drivable-lane": 8.333333333333323, "deviation-heading": 6.511236365345967, "deviation-center-line": 0.13729734885380554}, "ep004": {"driven_any": 2.6532777821831885, "driven_lanedir": -0.8446015392792754, "in-drivable-lane": 8.299999999999988, "deviation-heading": 6.539566120620427, "deviation-center-line": 0.3876309937395394}}
9775628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3470:03:30Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9771628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3470:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -1.0979843356609345, "good_angle": 50.512573961104266, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.53333333333332}, "ep001": {"nsteps": 500, "reward": -1.4751862567067149, "good_angle": 13.737403256340093, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.833333333333323}, "ep002": {"nsteps": 500, "reward": -1.2926475285887715, "good_angle": 13.709315082596058, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.199999999999989}, "ep003": {"nsteps": 500, "reward": -1.103815818578005, "good_angle": 13.72145423128464, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.033333333333324}, "ep004": {"nsteps": 500, "reward": -1.3380856087207795, "good_angle": 13.731167035162231, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.933333333333325}}
good_angle_max50.512573961104266
good_angle_mean21.082382713297456
good_angle_median13.731167035162231
good_angle_min13.709315082596058
reward_max-1.0979843356609345
reward_mean-1.261543909651041
reward_median-1.2926475285887715
reward_min-1.4751862567067149
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.2
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max14.53333333333332
valid_direction_mean13.306666666666654
valid_direction_median13.033333333333324
valid_direction_min12.833333333333323
9743628heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno3470:09:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9737631heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationfailedno3470:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 104, in run
    solve(params, cis)
  File "solution.py", line 69, in solve
    observation, reward, done, info = env.step(action)
  File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 331, in step
    action = self.action(action)
  File "/workspace/wrappers.py", line 207, in action
    vel, angle = action
TypeError: 'numpy.int64' object is not iterable


Hidden. If you are the author, please login using the top-right link or use the dashboard.
9724639MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3470:03:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1