AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 349

evaluator349
ownerAndrea Censi
machineidsc-rudolf
processidsc-rudolf-18140
versionDC:3.1.56;DCR:3.2.14;DTS:3.0.30
first heard
last heard
statusinactive
# evaluating
# success80
# timeout
# failed17
# error9
# aborted3
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
10652194Florian GolemoPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3490:10:38
Timeout: Waited 602 [...]
Timeout:

Waited 602.497819901 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
106453Andrea Censinullaido1_LF1-v3step2-scoringsuccessyes3490:01:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
reward-27.45844166764747


other stats
ep000
details{"nsteps": 171, "reward": -6.168826045855139}
ep001
details{"nsteps": 88, "reward": -13.200233698759058}
ep002
details{"nsteps": 18, "reward": -58.63515728049808}
ep003
details{"nsteps": 80, "reward": -13.576747538545169}
ep004
details{"nsteps": 23, "reward": -45.71124377457992}
10639144Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationfailedno3490:00:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 60, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 35, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10635221Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3490:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10633165Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationfailedno3490:00:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
    solution.run(cis)
  File "solution.py", line 64, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 39, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
    raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10631223Julian ZillyBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationfailedno3490:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 107, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10627270heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno3490:00:32
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10623272heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno3490:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10618275heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationerrorno3490:00:36
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10578330BenjaminPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3490:10:41
Timeout: Waited 602 [...]
Timeout:

Waited 602.204530001 for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10572312Andrea CensiTensorflow templateaido1_LF1_r3-v3step1-simulationerrorno3490:00:39
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10571349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3490:02:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6198867320950967
deviation-center-line_median0.34402940780714075
in-drivable-lane_median2.8333333333333233


other stats
deviation-center-line_max0.5317058803554829
deviation-center-line_mean0.3552189889958307
deviation-center-line_min0.190894379144421
deviation-heading_max3.585781960492237
deviation-heading_mean2.083000714172086
deviation-heading_median1.9019429906857557
deviation-heading_min0.9429226979585345
driven_any_max1.3414318772046931
driven_any_mean1.0421043293529035
driven_any_median1.1243802023780556
driven_any_min0.3486383218895127
driven_lanedir_max0.7418838579509837
driven_lanedir_mean0.5479006394295165
driven_lanedir_min0.12038187450900384
in-drivable-lane_max4.133333333333319
in-drivable-lane_mean2.326666666666659
in-drivable-lane_min0.7333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3486383218895127, "driven_lanedir": 0.12038187450900384, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 1.9019429906857557, "deviation-center-line": 0.190894379144421}, "ep001": {"driven_any": 1.1243802023780556, "driven_lanedir": 0.7104853358594905, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.585781960492237, "deviation-center-line": 0.5317058803554829}, "ep002": {"driven_any": 1.337676917439405, "driven_lanedir": 0.7418838579509837, "in-drivable-lane": 2.8333333333333233, "deviation-heading": 3.017150993481058, "deviation-center-line": 0.48309131012450207}, "ep003": {"driven_any": 1.3414318772046931, "driven_lanedir": 0.6198867320950967, "in-drivable-lane": 4.133333333333319, "deviation-heading": 0.9672049282428472, "deviation-center-line": 0.34402940780714075}, "ep004": {"driven_any": 1.0583943278528511, "driven_lanedir": 0.5468653967330084, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 0.9429226979585345, "deviation-center-line": 0.22637396754760705}}
10568313Andrea CensiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3490:00:45
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10566343Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationerrorno3490:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10562345Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedno3490:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 116, in run
    solve(params, cis)
  File "solution.py", line 65, in solve
    model.load("model", "models")
  File "/workspace/model.py", line 229, in load
    self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
    self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for ActorCNN:
	size mismatch for lin1.weight: copying a param of torch.Size([512, 127872]) from checkpoint, where the shape is torch.Size([512, 4032]) in current model.


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10551349Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3490:02:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10538331Andrea CensiRandom executionaido1_LF1_r3-v3step1-simulationfailedno3490:02:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 46, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10535332Andrea CensiRandom executionaido1_LFV_r1-v3step1-simulationfailedno3490:00:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 73, in run
    solve(gym_environment, cis)  # let's try to solve the challenge, exciting ah?
  File "solution.py", line 46, in solve
    observation, reward, done, info = env.step(action)
  File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
    observation, reward, done, info = self.env.step(action)
  File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
    obs, rew, done, misc = self.sim.step(action, with_observation=True)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
    return self._failsafe_observe(msg)
  File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
    raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10528360pravishsainathPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:02:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6840735691388744
deviation-center-line_median0.3035878835678968
in-drivable-lane_median1.86666666666666


other stats
deviation-center-line_max0.4726738099223275
deviation-center-line_mean0.2942831490795076
deviation-center-line_min0.1595384303826503
deviation-heading_max2.7341520929162275
deviation-heading_mean1.3848471616927558
deviation-heading_median1.0726168791489834
deviation-heading_min0.2790026520471443
driven_any_max1.3049459102403291
driven_any_mean0.8764390762576355
driven_any_median1.2495104674100357
driven_any_min0.19878313657519525
driven_lanedir_max0.8050051576008688
driven_lanedir_mean0.5103962183714653
driven_lanedir_min0.12905346598606626
in-drivable-lane_max3.866666666666653
in-drivable-lane_mean1.973333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.34462667413683057, "driven_lanedir": 0.12905346598606626, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 1.933867961803972, "deviation-center-line": 0.1595384303826503}, "ep001": {"driven_any": 0.19878313657519525, "driven_lanedir": 0.19394601880144213, "in-drivable-lane": 0, "deviation-heading": 0.2790026520471443, "deviation-center-line": 0.2011347366627285}, "ep002": {"driven_any": 1.2495104674100357, "driven_lanedir": 0.8050051576008688, "in-drivable-lane": 1.86666666666666, "deviation-heading": 2.7341520929162275, "deviation-center-line": 0.4726738099223275}, "ep003": {"driven_any": 1.284329192925787, "driven_lanedir": 0.6840735691388744, "in-drivable-lane": 3.866666666666653, "deviation-heading": 0.9045962225474526, "deviation-center-line": 0.3035878835678968}, "ep004": {"driven_any": 1.3049459102403291, "driven_lanedir": 0.7399028803300753, "in-drivable-lane": 3.3666666666666547, "deviation-heading": 1.0726168791489834, "deviation-center-line": 0.3344808848619352}}
10518360pravishsainathPyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3490:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10516360pravishsainathPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:23Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.599999999999983


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.958519177867949, "good_angle": 1.2841682992947514, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 57, "reward": -18.10167970312269, "good_angle": 0.05340326991644695, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 228, "reward": -4.6792328577987, "good_angle": 1.929419517714582, "survival_time": 7.599999999999983, "traveled_tiles": 3, "valid_direction": 3.599999999999987}, "ep003": {"nsteps": 232, "reward": -5.362626247872209, "good_angle": 1.091317569886713, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 4.533333333333317}, "ep004": {"nsteps": 236, "reward": -5.280892781806731, "good_angle": 8.315036035917688, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.833333333333316}}
good_angle_max8.315036035917688
good_angle_mean2.5346689385460364
good_angle_median1.2841682992947514
good_angle_min0.05340326991644695
reward_max-4.6792328577987
reward_mean-9.276590153693656
reward_median-5.362626247872209
reward_min-18.10167970312269
survival_time_max7.866666666666648
survival_time_mean5.546666666666657
survival_time_min1.9000000000000024
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max4.833333333333316
valid_direction_mean3.0199999999999907
valid_direction_median3.599999999999987
valid_direction_min0
10499360pravishsainathPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3490:04:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10492365MandanaSamieiPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationfailedno3490:00:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
    solution.run(cis)
  File "solution.py", line 87, in run
    solve(params, cis)
  File "solution.py", line 60, in solve
    action = model.predict(observation)
  File "/workspace/model.py", line 176, in predict
    return self.actor(state).cpu().data.numpy().flatten()
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/workspace/model.py", line 72, in forward
    x = self.lr(self.lin1(x))
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
    result = self.forward(*input, **kwargs)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
    return F.linear(input, self.weight, self.bias)
  File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
    return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070


Hidden. If you are the author, please login using the top-right link or use the dashboard.
10482376Bhairav MehtaPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3490:02:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10475389Liam PaullRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3490:02:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.828310674996585
deviation-center-line_median0.39675702124407014
in-drivable-lane_median0


other stats
deviation-center-line_max0.7179354734005684
deviation-center-line_mean0.4064549886813335
deviation-center-line_min0.214033161323768
deviation-heading_max3.82953016565333
deviation-heading_mean1.496615913836184
deviation-heading_median1.0018811217976218
deviation-heading_min0.18888049888053884
driven_any_max1.6148765125383513
driven_any_mean0.8644251786016122
driven_any_median0.831568440938805
driven_any_min0.3219592324979507
driven_lanedir_max1.255171198733825
driven_lanedir_mean0.7417908945600653
driven_lanedir_min0.16277084737591307
in-drivable-lane_max0.9999999999999964
in-drivable-lane_mean0.32666666666666594
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.37570161473959574, "driven_lanedir": 0.16277084737591307, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 1.9914188553009555, "deviation-center-line": 0.214033161323768}, "ep001": {"driven_any": 0.3219592324979507, "driven_lanedir": 0.3207934956529499, "in-drivable-lane": 0, "deviation-heading": 0.18888049888053884, "deviation-center-line": 0.2509394613684371}, "ep002": {"driven_any": 1.1780200922933584, "driven_lanedir": 1.1419082560410534, "in-drivable-lane": 0, "deviation-heading": 1.0018811217976218, "deviation-center-line": 0.45260982606982386}, "ep003": {"driven_any": 0.831568440938805, "driven_lanedir": 0.828310674996585, "in-drivable-lane": 0, "deviation-heading": 0.4713689275484741, "deviation-center-line": 0.39675702124407014}, "ep004": {"driven_any": 1.6148765125383513, "driven_lanedir": 1.255171198733825, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.82953016565333, "deviation-center-line": 0.7179354734005684}}
10457395Maxim KuzminRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3490:03:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1357725518318953
deviation-center-line_median0.5036149562068063
in-drivable-lane_median0.09999999999999964


other stats
deviation-center-line_max1.215349847416704
deviation-center-line_mean0.5681132000226986
deviation-center-line_min0.20861380512448008
deviation-heading_max3.665989859099655
deviation-heading_mean1.6256913396789858
deviation-heading_median1.1379421412773951
deviation-heading_min0.1701327427751769
driven_any_max2.1139811689173973
driven_any_mean1.152695879700692
driven_any_median1.178335544531556
driven_any_min0.3659916150719905
driven_lanedir_max2.0782301810521457
driven_lanedir_mean1.0279721529494932
driven_lanedir_min0.15254813962803604
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.27999999999999947
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.3659916150719905, "driven_lanedir": 0.15254813962803604, "in-drivable-lane": 0.6, "deviation-heading": 2.0584555637142303, "deviation-center-line": 0.20861380512448008}, "ep001": {"driven_any": 0.49853996099012526, "driven_lanedir": 0.4979099907962971, "in-drivable-lane": 0, "deviation-heading": 0.1701327427751769, "deviation-center-line": 0.3872369486249898}, "ep002": {"driven_any": 1.178335544531556, "driven_lanedir": 1.1357725518318953, "in-drivable-lane": 0, "deviation-heading": 1.095936391528472, "deviation-center-line": 0.5036149562068063}, "ep003": {"driven_any": 2.1139811689173973, "driven_lanedir": 2.0782301810521457, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.1379421412773951, "deviation-center-line": 1.215349847416704}, "ep004": {"driven_any": 1.6066311089923906, "driven_lanedir": 1.2753999014390915, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 3.665989859099655, "deviation-center-line": 0.5257504427405131}}
10453396anna.tsalapovasimple submitionaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.21171160599775612, "good_angle": 1.7908999000353618, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 7.39999999999999}, "ep001": {"nsteps": 500, "reward": -0.49661089354753496, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.182835554510355, "good_angle": 0.03030352864283182, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.14843576791882515, "good_angle": 0.03284738421522274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.2250587911726907, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max1.7908999000353618
good_angle_mean0.4012442705904789
good_angle_median0.07595671165358207
good_angle_min0.03030352864283182
reward_max0.2250587911726907
reward_mean-0.16290700616035608
reward_median-0.182835554510355
reward_min-0.49661089354753496
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max7.39999999999999
valid_direction_mean1.479999999999998
valid_direction_median0
valid_direction_min0
10429396anna.tsalapovasimple submitionaido1_LF1_r3-v3step1-simulationsuccessno3490:04:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10389412Bhairav MehtaROS-based Lane Followingaido1_LF1_r3-v3step1-simulationfailedno3490:10:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
    cie.wait_for_solution()
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
    raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10366428SashkasemRandom executionaido1_LF1_r3-v3step4-vizsuccessyes3490:06:31Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7198854330971003
deviation-center-line_median0.6993923666374686
in-drivable-lane_median0


other stats
deviation-center-line_max1.536236930464029
deviation-center-line_mean0.8128197848981245
deviation-center-line_min0.46218760059102654
deviation-heading_max3.2844048986051786
deviation-heading_mean1.1761832439544904
deviation-heading_median1.1240165941114446
deviation-heading_min0.07942104943374192
driven_any_max6.640000000000109
driven_any_mean6.64000000000007
driven_any_median6.640000000000084
driven_any_min6.639999999999995
driven_lanedir_max1.6799844318612076
driven_lanedir_mean0.6880583663417399
driven_lanedir_min0.07977707085548635
in-drivable-lane_max10.733333333333334
in-drivable-lane_mean2.146666666666667
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 6.640000000000109, "driven_lanedir": 0.13584553075677963, "in-drivable-lane": 10.733333333333334, "deviation-heading": 3.2844048986051786, "deviation-center-line": 0.7281699018240043}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.07977707085548635, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.536236930464029}, "ep002": {"driven_any": 6.639999999999995, "driven_lanedir": 0.7198854330971003, "in-drivable-lane": 0, "deviation-heading": 0.26715626836135253, "deviation-center-line": 0.6993923666374686}, "ep003": {"driven_any": 6.640000000000073, "driven_lanedir": 1.6799844318612076, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374192, "deviation-center-line": 0.6381121249740939}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8247993651381256, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.46218760059102654}}
10358428SashkasemRandom executionaido1_LF1_r3-v3step3-videossuccessyes3490:03:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10355428SashkasemRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.25889285968244075, "good_angle": 1.5014712110594055, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 5.933333333333321}, "ep001": {"nsteps": 500, "reward": -0.4693750252127647, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.18027196016907693, "good_angle": 0.04390423891890585, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.1492788551747799, "good_angle": 0.039369698187299546, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.20312675948161632, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}
good_angle_max1.5014712110594055
good_angle_mean0.3473831376449178
good_angle_median0.07595671165358207
good_angle_min0.039369698187299546
reward_max0.20312675948161632
reward_mean-0.17093838815148923
reward_median-0.18027196016907693
reward_min-0.4693750252127647
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max4
traveled_tiles_mean2.6
traveled_tiles_median2
traveled_tiles_min2
valid_direction_max5.933333333333321
valid_direction_mean1.1866666666666643
valid_direction_median0
valid_direction_min0
10334428SashkasemRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3490:05:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10315454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step4-vizsuccessyes3490:07:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median3.100249689175728
deviation-center-line_median1.3487125967936766
in-drivable-lane_median1.6999999999999946


other stats
deviation-center-line_max1.3768982623538213
deviation-center-line_mean1.1636604921397915
deviation-center-line_min0.39795317456375984
deviation-heading_max11.728842752525235
deviation-heading_mean9.45503895620446
deviation-heading_median10.618271797823088
deviation-heading_min4.129313534169556
driven_any_max4.979113636122271
driven_any_mean4.978687540041603
driven_any_median4.979113636122251
driven_any_min4.977288194248459
driven_lanedir_max3.169624548409674
driven_lanedir_mean2.6372312658476145
driven_lanedir_min0.7388358492195609
in-drivable-lane_max12.099999999999998
in-drivable-lane_mean3.666666666666662
in-drivable-lane_min0.8333333333333306
per-episodes
details{"ep000": {"driven_any": 4.977288194248459, "driven_lanedir": 0.7388358492195609, "in-drivable-lane": 12.099999999999998, "deviation-heading": 4.129313534169556, "deviation-center-line": 0.39795317456375984}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.978808597592767, "driven_lanedir": 3.1225011771463587, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.845722898324402, "deviation-center-line": 1.3449545003012535}, "ep003": {"driven_any": 4.979113636122271, "driven_lanedir": 3.169624548409674, "in-drivable-lane": 0.8333333333333306, "deviation-heading": 11.728842752525235, "deviation-center-line": 1.349783926686447}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
10302454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step3-videossuccessyes3490:04:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10295454orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.6358119174102321, "good_angle": 26.119034103876217, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999974}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25285773413255813, "good_angle": 13.562961716495696, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}
good_angle_max26.119034103876217
good_angle_mean16.095647580263446
good_angle_median13.562961716495696
good_angle_min13.49085374796333
reward_max-0.17246611558226868
reward_mean-0.3494114613714046
reward_median-0.3079843127221684
reward_min-0.6358119174102321
survival_time_max16.666666666666654
survival_time_mean16.666666666666654
survival_time_min16.666666666666654
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.033333333333324
valid_direction_mean12.699999999999983
valid_direction_median12.96666666666665
valid_direction_min11.699999999999974
10289455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 341, "reward": -3.5732938650779733, "good_angle": 18.779461385468952, "survival_time": 11.366666666666635, "traveled_tiles": 1, "valid_direction": 8.133333333333313}, "ep001": {"nsteps": 500, "reward": -0.3809802600943949, "good_angle": 13.488598718146529, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.999999999999986}, "ep002": {"nsteps": 500, "reward": -0.2547652696329169, "good_angle": 13.563933314027404, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.899999999999988}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}
good_angle_max18.779461385468952
good_angle_mean14.627476350124976
good_angle_median13.563933314027404
good_angle_min13.488598718146529
reward_max-0.17246611558226868
reward_mean-0.9378979646219444
reward_median-0.3079843127221684
reward_min-3.5732938650779733
survival_time_max16.666666666666654
survival_time_mean15.606666666666651
survival_time_min11.366666666666635
traveled_tiles_max2
traveled_tiles_mean1.6
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max13.033333333333324
valid_direction_mean12.006666666666652
valid_direction_median12.966666666666653
valid_direction_min8.133333333333313
10263455orlando.m.bol@gmail.comPyTorch DDPG templateaido1_LF1_r3-v3step1-simulationsuccessno3490:09:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10259457JonRandom executionaido1_LF1_r3-v3step1-simulationfailedno3490:00:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 59, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10254462JonJP pipelineaido1_LF1_r3-v3step1-simulationerrorno3490:00:34
The result file is n [...]
The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.

Check the evaluator log to see what happened.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10242479JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3490:03:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.3143855010633223
deviation-center-line_median0.14709453095890548
in-drivable-lane_median13.36666666666662


other stats
deviation-center-line_max0.20762858195819092
deviation-center-line_mean0.14618581991587334
deviation-center-line_min0.05805242341066197
deviation-heading_max1.0342945271318067
deviation-heading_mean0.7991210663519178
deviation-heading_median0.9433568496091662
deviation-heading_min0.19154913286138767
driven_any_max1.3142242371276414
driven_any_mean0.8169040764939842
driven_any_median0.7981214917420629
driven_any_min0.41325712939466286
driven_lanedir_max0.4217906671598224
driven_lanedir_mean0.2847960783970781
driven_lanedir_min0.03179017915486693
in-drivable-lane_max14.899999999999984
in-drivable-lane_mean13.199999999999967
in-drivable-lane_min10.233333333333306
per-episodes
details{"ep000": {"driven_any": 0.41325712939466286, "driven_lanedir": 0.03179017915486693, "in-drivable-lane": 10.233333333333306, "deviation-heading": 0.19154913286138767, "deviation-center-line": 0.05805242341066197}, "ep001": {"driven_any": 1.3142242371276414, "driven_lanedir": 0.4217906671598224, "in-drivable-lane": 14.266666666666652, "deviation-heading": 1.0342945271318067, "deviation-center-line": 0.20762858195819092}, "ep002": {"driven_any": 0.7082173885402527, "driven_lanedir": 0.3576641860676455, "in-drivable-lane": 13.36666666666662, "deviation-heading": 0.9433568496091662, "deviation-center-line": 0.1720680310518174}, "ep003": {"driven_any": 0.7981214917420629, "driven_lanedir": 0.2983498585397335, "in-drivable-lane": 14.899999999999984, "deviation-heading": 0.8518391764407385, "deviation-center-line": 0.14608553219979098}, "ep004": {"driven_any": 0.8507001356653012, "driven_lanedir": 0.3143855010633223, "in-drivable-lane": 13.233333333333288, "deviation-heading": 0.9745656457164904, "deviation-center-line": 0.14709453095890548}}
10233479JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3490:03:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10228479JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median15.43333333333329


other stats
episodes
details{"ep000": {"nsteps": 316, "reward": -6.694362660327667, "good_angle": 57.64487463278051, "survival_time": 10.533333333333308, "traveled_tiles": 1, "valid_direction": 10.399999999999972}, "ep001": {"nsteps": 500, "reward": -2.5161149753979406, "good_angle": 81.0376543603515, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.966666666666654}, "ep002": {"nsteps": 463, "reward": -4.7653772363159606, "good_angle": 19.282750215433236, "survival_time": 15.43333333333329, "traveled_tiles": 2, "valid_direction": 14.966666666666622}, "ep003": {"nsteps": 500, "reward": -2.7780723442053423, "good_angle": 12.031034218647056, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.199999999999985}, "ep004": {"nsteps": 454, "reward": -4.3911374833482, "good_angle": 6.754166297777159, "survival_time": 15.13333333333329, "traveled_tiles": 2, "valid_direction": 14.666666666666623}}
good_angle_max81.0376543603515
good_angle_mean35.35009594499788
good_angle_median19.282750215433236
good_angle_min6.754166297777159
reward_max-2.5161149753979406
reward_mean-4.229012939919022
reward_median-4.3911374833482
reward_min-6.694362660327667
survival_time_max16.666666666666654
survival_time_mean14.886666666666638
survival_time_min10.533333333333308
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max16.199999999999985
valid_direction_mean14.439999999999973
valid_direction_median14.966666666666622
valid_direction_min10.399999999999972
10211479JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3490:10:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10209480JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:00:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: No module named distortions

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10206482JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:00:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: unbound method __init__() must be called with ObservationWrapper instance as first argument (got UndistortWrapper instance instead)

Hidden. If you are the author, please login using the top-right link or use the dashboard.
10187490MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step1-simulationsuccessno3490:02:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10183494heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringabortedyes3490:00:15
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10183-5449', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10183-5449', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10183-5449_evaluation" with the default driver
stderr | Creating job10183-5449_scorer_1 ...
stderr | 
Creating job10183-5449_scorer_1 ... error

stderr | ERROR: for job10183-5449_scorer_1  Cannot start service scorer: network job10183-5449_evaluation not found
stderr | 
stderr | ERROR: for scorer  Cannot start service scorer: network job10183-5449_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10180498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizabortedyes3490:00:15
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job10180-5007', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job10180-5007', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job10180-5007_evaluation" with the default driver
stderr | Creating job10180-5007_visualization_1 ...
stderr | 
Creating job10180-5007_visualization_1 ... error

stderr | ERROR: for job10180-5007_visualization_1  Cannot start service visualization: network job10180-5007_evaluation not found
stderr | 
stderr | ERROR: for visualization  Cannot start service visualization: network job10180-5007_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
10174498heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3490:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10158502Liam PaullTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3490:03:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.176965747776464
deviation-center-line_median0.5392367820639963
in-drivable-lane_median0


other stats
deviation-center-line_max1.178028140676327
deviation-center-line_mean0.6361231864346794
deviation-center-line_min0.24801466543439213
deviation-heading_max2.933357011087066
deviation-heading_mean1.5031939640182812
deviation-heading_median1.6784445577499594
deviation-heading_min0.3078096120600184
driven_any_max2.889379743962332
driven_any_mean1.5333652672511588
driven_any_median1.323416997902066
driven_any_min0.35252349840349056
driven_lanedir_max2.5840774511468547
driven_lanedir_mean1.3669448964654074
driven_lanedir_min0.3369860007938392
in-drivable-lane_max0.7666666666666639
in-drivable-lane_mean0.28666666666666607
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.2712292594336065, "driven_lanedir": 1.9166299693512645, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.933357011087066, "deviation-center-line": 0.7040900403146501}, "ep001": {"driven_any": 0.35252349840349056, "driven_lanedir": 0.3369860007938392, "in-drivable-lane": 0, "deviation-heading": 0.3078096120600184, "deviation-center-line": 0.24801466543439213}, "ep002": {"driven_any": 1.323416997902066, "driven_lanedir": 1.176965747776464, "in-drivable-lane": 0, "deviation-heading": 2.1538570627189197, "deviation-center-line": 0.5392367820639963}, "ep003": {"driven_any": 2.889379743962332, "driven_lanedir": 2.5840774511468547, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.6784445577499594, "deviation-center-line": 1.178028140676327}, "ep004": {"driven_any": 0.8302768365542986, "driven_lanedir": 0.8200653132586138, "in-drivable-lane": 0, "deviation-heading": 0.4425015764754437, "deviation-center-line": 0.5112463036840313}}
10155502Liam PaullTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3490:00:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10153502Liam PaullTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.733333333333316


other stats
episodes
details{"ep000": {"nsteps": 352, "reward": -2.972652845297654, "good_angle": 0.9435485787757228, "survival_time": 11.733333333333302, "traveled_tiles": 4, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 70, "reward": -14.850869218366489, "good_angle": 0.15773340133636415, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 232, "reward": -4.485274965531627, "good_angle": 0.7989591448603707, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 1.1666666666666623}, "ep003": {"nsteps": 500, "reward": -0.284857301548589, "good_angle": 0.31528647713212143, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.5999999999999979}, "ep004": {"nsteps": 173, "reward": -6.230304401389437, "good_angle": 0.12016554063972, "survival_time": 5.766666666666656, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}}
good_angle_max0.9435485787757228
good_angle_mean0.4671386285488598
good_angle_median0.31528647713212143
good_angle_min0.12016554063972
reward_max-0.284857301548589
reward_mean-5.764791746426758
reward_median-4.485274965531627
reward_min-14.850869218366489
survival_time_max16.666666666666654
survival_time_mean8.846666666666653
survival_time_min2.333333333333335
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.4666666666666617
valid_direction_mean0.7533333333333306
valid_direction_median0.5999999999999979
valid_direction_min0.2666666666666657
10145502Liam PaullTensorflow templateaido1_LF1_r3-v3step1-simulationsuccessno3490:03:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10135515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step4-vizsuccessyes3490:04:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.441346419252589
deviation-center-line_median0.475443203904307
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max0.8928446787182662
deviation-center-line_mean0.5409045380505465
deviation-center-line_min0.292160150573776
deviation-heading_max2.432001830566156
deviation-heading_mean1.67843726333518
deviation-heading_median1.613297174346244
deviation-heading_min0.950089853554849
driven_any_max1.9333785426469663
driven_any_mean1.4061619423712286
driven_any_median1.5063230723519694
driven_any_min0.5357524764781381
driven_lanedir_max1.9210683760128144
driven_lanedir_mean1.340064019082472
driven_lanedir_min0.5084034561928898
in-drivable-lane_max1.066666666666667
in-drivable-lane_mean0.23333333333333336
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.9333765079754035, "driven_lanedir": 1.7550904020885971, "in-drivable-lane": 1.066666666666667, "deviation-heading": 2.432001830566156, "deviation-center-line": 0.8928446787182662}, "ep001": {"driven_any": 0.5357524764781381, "driven_lanedir": 0.5084034561928898, "in-drivable-lane": 0, "deviation-heading": 0.950089853554849, "deviation-center-line": 0.4633403308133458}, "ep002": {"driven_any": 1.5063230723519694, "driven_lanedir": 1.441346419252589, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.3082848051836877, "deviation-center-line": 0.5807343262430376}, "ep003": {"driven_any": 1.9333785426469663, "driven_lanedir": 1.9210683760128144, "in-drivable-lane": 0, "deviation-heading": 1.0885126530249634, "deviation-center-line": 0.475443203904307}, "ep004": {"driven_any": 1.1219791124036649, "driven_lanedir": 1.0744114418654702, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.613297174346244, "deviation-center-line": 0.292160150573776}}
10130515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step3-videossuccessyes3490:01:09Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10126515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median12.999999999999964


other stats
episodes
details{"ep000": {"nsteps": 500, "reward": -0.194689963654615, "good_angle": 0.4609717757732299, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.933333333333334}, "ep001": {"nsteps": 140, "reward": -7.67487527685506, "good_angle": 0.5334618295157368, "survival_time": 4.66666666666666, "traveled_tiles": 1, "valid_direction": 0.9999999999999964}, "ep002": {"nsteps": 390, "reward": -2.8082431686230196, "good_angle": 0.8056607639157276, "survival_time": 12.999999999999964, "traveled_tiles": 4, "valid_direction": 1.399999999999995}, "ep003": {"nsteps": 500, "reward": -0.11725767087766872, "good_angle": 0.032161736569720045, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 291, "reward": -3.549292758276408, "good_angle": 2.2099661417209053, "survival_time": 9.699999999999976, "traveled_tiles": 3, "valid_direction": 1.566666666666661}}
good_angle_max2.2099661417209053
good_angle_mean0.808444449499064
good_angle_median0.5334618295157368
good_angle_min0.032161736569720045
reward_max-0.11725767087766872
reward_mean-2.868871767657354
reward_median-2.8082431686230196
reward_min-7.67487527685506
survival_time_max16.666666666666654
survival_time_mean12.13999999999998
survival_time_min4.66666666666666
traveled_tiles_max4
traveled_tiles_mean3.2
traveled_tiles_median4
traveled_tiles_min1
valid_direction_max1.566666666666661
valid_direction_mean0.9799999999999972
valid_direction_median0.9999999999999964
valid_direction_min0
10116515Dzenan LapandicBaseline solution using imitation learning from logsaido1_LF1_r3-v3step1-simulationsuccessno3490:02:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10112516heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median1.333333333333334


other stats
episodes
details{"ep000": {"nsteps": 36, "reward": -28.044976969818688, "good_angle": 0.7666464469069899, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 1.0333333333333337}, "ep001": {"nsteps": 22, "reward": -46.008810850706965, "good_angle": 0.019661774370933752, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 40, "reward": -25.42171614915133, "good_angle": 0.03801718555044795, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 45, "reward": -22.546772726045713, "good_angle": 0.06567918563705034, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep004": {"nsteps": 46, "reward": -22.152781161925063, "good_angle": 0.03641383012341944, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 0}}
good_angle_max0.7666464469069899
good_angle_mean0.18528368451776828
good_angle_median0.03801718555044795
good_angle_min0.019661774370933752
reward_max-22.152781161925063
reward_mean-28.835011571529556
reward_median-25.42171614915133
reward_min-46.008810850706965
survival_time_max1.5333333333333348
survival_time_mean1.260000000000001
survival_time_min0.7333333333333333
traveled_tiles_max2
traveled_tiles_mean1.4
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max1.0333333333333337
valid_direction_mean0.21333333333333343
valid_direction_median0
valid_direction_min0
10103525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step4-vizsuccessyes3490:01:40Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.28977579066348724
deviation-center-line_median0.2596306626838413
in-drivable-lane_median0.8999999999999968


other stats
deviation-center-line_max0.3495269439274484
deviation-center-line_mean0.2816719556808085
deviation-center-line_min0.23084578070496203
deviation-heading_max3.140638799446339
deviation-heading_mean2.412886947725279
deviation-heading_median2.769138296409296
deviation-heading_min0.834297520530139
driven_any_max0.7873202975740567
driven_any_mean0.6419688580219205
driven_any_median0.6009722981482444
driven_any_min0.5823374982056604
driven_lanedir_max0.34105884308565093
driven_lanedir_mean0.3003442252313668
driven_lanedir_min0.28535129762116584
in-drivable-lane_max3.3333333333333277
in-drivable-lane_mean1.3666666666666631
in-drivable-lane_min0.7333333333333307
per-episodes
details{"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
10095525heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step3-videossuccessyes3490:01:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10064524heyt0nyAI DL RL MML XXXL 2k18 yooaido1_LF1_r3-v3step1-simulationsuccessno3490:05:41Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10058528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step3-videossuccessyes3490:02:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10057528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessyes3490:00:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median10.599999999999971


other stats
episodes
details{"ep000": {"nsteps": 176, "reward": -7.915465039024142, "good_angle": 11.390526656295732, "survival_time": 5.866666666666656, "traveled_tiles": 1, "valid_direction": 5.199999999999989}, "ep001": {"nsteps": 211, "reward": -4.9611815624630085, "good_angle": 1.399867232221524, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep002": {"nsteps": 318, "reward": -3.4529474489438443, "good_angle": 1.9488720024101256, "survival_time": 10.599999999999971, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep003": {"nsteps": 386, "reward": -2.6256591085427643, "good_angle": 2.166939571478787, "survival_time": 12.866666666666632, "traveled_tiles": 4, "valid_direction": 1.533333333333328}, "ep004": {"nsteps": 369, "reward": -2.74263650648459, "good_angle": 2.162438495246906, "survival_time": 12.299999999999969, "traveled_tiles": 4, "valid_direction": 1.533333333333328}}
good_angle_max11.390526656295732
good_angle_mean3.813728791530615
good_angle_median2.162438495246906
good_angle_min1.399867232221524
reward_max-2.6256591085427643
reward_mean-4.33957793309167
reward_median-3.4529474489438443
reward_min-7.915465039024142
survival_time_max12.866666666666632
survival_time_mean9.73333333333331
survival_time_min5.866666666666656
traveled_tiles_max4
traveled_tiles_mean3
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.199999999999989
valid_direction_mean2.2399999999999936
valid_direction_median1.533333333333328
valid_direction_min1.4666666666666617
10052528Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step1-simulationsuccessno3490:04:11Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
10028560Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step4-vizsuccessno3490:05:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median0.6966981932489035
in-drivable-lane_median3.4333333333333567


other stats
deviation-center-line_max0.8396911967223216
deviation-center-line_mean0.618579445562464
deviation-center-line_min0.111235643799134
deviation-heading_max2.871292479414406
deviation-heading_mean2.1289509190319302
deviation-heading_median2.2184872548011763
deviation-heading_min0.9169930535457488
driven_any_max1.933375680664721
driven_any_mean1.7019888713055498
driven_any_median1.9333739957688072
driven_any_min0.7880917906528434
driven_lanedir_max1.7005911978677994
driven_lanedir_mean1.168578031825227
driven_lanedir_median1.459353942030693
driven_lanedir_min0.00953202253090346
in-drivable-lane_max7.000000000000011
in-drivable-lane_mean3.9533333333333487
in-drivable-lane_min1.2666666666666924
per-episodes
details{"ep000": {"driven_any": 0.7880917906528434, "driven_lanedir": 0.00953202253090346, "in-drivable-lane": 6.1666666666666545, "deviation-heading": 0.9169930535457488, "deviation-center-line": 0.111235643799134}, "ep001": {"driven_any": 1.9333739957688072, "driven_lanedir": 1.0342380330110823, "in-drivable-lane": 7.000000000000011, "deviation-heading": 2.426604799300448, "deviation-center-line": 0.6966981932489035}, "ep002": {"driven_any": 1.933375680664721, "driven_lanedir": 1.459353942030693, "in-drivable-lane": 3.4333333333333567, "deviation-heading": 2.871292479414406, "deviation-center-line": 0.66709367947772}, "ep003": {"driven_any": 1.921727714285188, "driven_lanedir": 1.7005911978677994, "in-drivable-lane": 1.2666666666666924, "deviation-heading": 2.211377008097873, "deviation-center-line": 0.8396911967223216}, "ep004": {"driven_any": 1.9333751751561896, "driven_lanedir": 1.6391749636856572, "in-drivable-lane": 1.9000000000000288, "deviation-heading": 2.2184872548011763, "deviation-center-line": 0.7781785145642409}}
10025538JonRandom executionaido1_LF1_r3-v3step3-videossuccessyes3490:00:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
10013555Dzenan LapandicBaseline solution using imitation learning from logsaido1_LFV_r1-v3step2-scoringsuccessyes3490:02:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median16.666666666666654


other stats
episodes
details{"ep000": {"nsteps": 203, "reward": -7.517153282177272, "good_angle": 18.773294719833164, "survival_time": 6.766666666666652, "traveled_tiles": 1, "valid_direction": 5.699999999999986}, "ep001": {"nsteps": 500, "reward": -0.9862548477053642, "good_angle": 15.15010660837492, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.6000000000000165}, "ep002": {"nsteps": 500, "reward": -0.36153481669770554, "good_angle": 17.143092288140753, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.099999999999985}, "ep003": {"nsteps": 497, "reward": -2.535689466121331, "good_angle": 16.606684416108454, "survival_time": 16.56666666666665, "traveled_tiles": 5, "valid_direction": 3.266666666666655}, "ep004": {"nsteps": 500, "reward": -0.38193090801686047, "good_angle": 16.47307776883877, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.566666666666654}}
good_angle_max18.773294719833164
good_angle_mean16.82925116025921
good_angle_median16.606684416108454
good_angle_min15.15010660837492
reward_max-0.36153481669770554
reward_mean-2.356512664143706
reward_median-0.9862548477053642
reward_min-7.517153282177272
survival_time_max16.666666666666654
survival_time_mean14.666666666666652
survival_time_min6.766666666666652
traveled_tiles_max5
traveled_tiles_mean4
traveled_tiles_median5
traveled_tiles_min1
valid_direction_max5.699999999999986
valid_direction_mean4.24666666666666
valid_direction_median4.099999999999985
valid_direction_min3.266666666666655
10012543JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.699999999999993


other stats
episodes
details{"ep000": {"nsteps": 141, "reward": -8.463073508747925, "good_angle": 0.8371806302206455, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 0.7333333333333318}, "ep001": {"nsteps": 141, "reward": -7.681345546373715, "good_angle": 12.792675556376697, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 3.4333333333333247}, "ep002": {"nsteps": 109, "reward": -10.430570920638807, "good_angle": 2.0212082943923804, "survival_time": 3.63333333333333, "traveled_tiles": 4, "valid_direction": 2.999999999999997}, "ep003": {"nsteps": 125, "reward": -8.698307935584337, "good_angle": 0.7952693358564087, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999998}, "ep004": {"nsteps": 500, "reward": -0.7987198795562145, "good_angle": 26.417648129773863, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.73333333333332}}
good_angle_max26.417648129773863
good_angle_mean8.572796389324
good_angle_median2.0212082943923804
good_angle_min0.7952693358564087
reward_max-0.7987198795562145
reward_mean-7.2144035581802
reward_median-8.463073508747925
reward_min-10.430570920638807
survival_time_max16.666666666666654
survival_time_mean6.773333333333326
survival_time_min3.63333333333333
traveled_tiles_max8
traveled_tiles_mean4.2
traveled_tiles_median3
traveled_tiles_min3
valid_direction_max5.73333333333332
valid_direction_mean2.8599999999999945
valid_direction_median2.999999999999997
valid_direction_min0.7333333333333318
9986543JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3490:03:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9979552JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3490:01:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9831727977496568
deviation-center-line_median0.3672205081923034
in-drivable-lane_median4.166666666666662


other stats
deviation-center-line_max0.3973635291194515
deviation-center-line_mean0.27994419078557026
deviation-center-line_min0.019250353138126345
deviation-heading_max1.9674481045734984
deviation-heading_mean0.8958297569628216
deviation-heading_median0.7999999999999945
deviation-heading_min0.2433808912349376
driven_any_max3.17335318345451
driven_any_mean1.9040619062808588
driven_any_median1.482145043287037
driven_any_min0.960597542999026
driven_lanedir_max1.69057860582297
driven_lanedir_mean0.9459349663317084
driven_lanedir_min0.003223174585412991
in-drivable-lane_max5.3666666666666485
in-drivable-lane_mean3.079999999999991
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 1.4758617281633035, "driven_lanedir": 0.003223174585412991, "in-drivable-lane": 4.166666666666662, "deviation-heading": 0.2433808912349376, "deviation-center-line": 0.019250353138126345}, "ep001": {"driven_any": 1.482145043287037, "driven_lanedir": 1.1028251013162031, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 1.9674481045734984, "deviation-center-line": 0.3973635291194515}, "ep002": {"driven_any": 2.4283520335004187, "driven_lanedir": 0.9831727977496568, "in-drivable-lane": 4.999999999999983, "deviation-heading": 1.1847280971323766, "deviation-center-line": 0.3672205081923034}, "ep003": {"driven_any": 3.17335318345451, "driven_lanedir": 1.69057860582297, "in-drivable-lane": 5.3666666666666485, "deviation-heading": 0.7999999999999945, "deviation-center-line": 0.3712317093005242}, "ep004": {"driven_any": 0.960597542999026, "driven_lanedir": 0.9498751521842984, "in-drivable-lane": 0, "deviation-heading": 0.2835916918733016, "deviation-center-line": 0.2446548541774459}}
9973552JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3490:01:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9972552JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.899999999999989


other stats
episodes
details{"ep000": {"nsteps": 131, "reward": -9.064354197442077, "good_angle": 0.9303220567558887, "survival_time": 4.366666666666661, "traveled_tiles": 3, "valid_direction": 1.099999999999997}, "ep001": {"nsteps": 177, "reward": -6.224365193707577, "good_angle": 11.05919640223386, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 3.8999999999999906}, "ep002": {"nsteps": 251, "reward": -5.271373118566576, "good_angle": 3.0937542334432666, "survival_time": 8.366666666666648, "traveled_tiles": 5, "valid_direction": 3.4333333333333256}, "ep003": {"nsteps": 314, "reward": -4.755956446413829, "good_angle": 1.6312098446650494, "survival_time": 10.46666666666664, "traveled_tiles": 6, "valid_direction": 1.7999999999999936}, "ep004": {"nsteps": 83, "reward": -12.501483575048216, "good_angle": 0.14873306890204158, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}
good_angle_max11.05919640223386
good_angle_mean3.372643121200022
good_angle_median1.6312098446650494
good_angle_min0.14873306890204158
reward_max-4.755956446413829
reward_mean-7.563506506235655
reward_median-6.224365193707577
reward_min-12.501483575048216
survival_time_max10.46666666666664
survival_time_mean6.373333333333321
survival_time_min2.7666666666666666
traveled_tiles_max6
traveled_tiles_mean3.8
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.8999999999999906
valid_direction_mean2.0933333333333275
valid_direction_median1.7999999999999936
valid_direction_min0.2333333333333325
9970553JonJP pipelineaido1_LF1_r3-v3step3-videosabortedyes3490:00:12
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job9970-4056', 'up', '-d']:

   >  Command '['docker-compose', '-p', 'job9970-4056', 'up', '-d']' returned non-zero exit status 1

stdout | 

stderr | Creating network "job9970-4056_evaluation" with the default driver
stderr | Creating job9970-4056_videos_1 ...
stderr | 
Creating job9970-4056_videos_1 ... error

stderr | ERROR: for job9970-4056_videos_1  Cannot start service videos: network job9970-4056_evaluation not found
stderr | 
stderr | ERROR: for videos  Cannot start service videos: network job9970-4056_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
9966553JonJP pipelineaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.833333333333322


other stats
episodes
details{"ep000": {"nsteps": 155, "reward": -8.335501825809478, "good_angle": 0.35247416523660835, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 0.6333333333333322}, "ep001": {"nsteps": 188, "reward": -5.824763317005411, "good_angle": 11.940781384947671, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 3.999999999999988}, "ep002": {"nsteps": 102, "reward": -10.220616815561502, "good_angle": 2.502139831761016, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 1.7666666666666626}, "ep003": {"nsteps": 175, "reward": -6.363159887939691, "good_angle": 0.969941746031617, "survival_time": 5.833333333333322, "traveled_tiles": 3, "valid_direction": 1.03333333333333}, "ep004": {"nsteps": 500, "reward": -0.6525341186731238, "good_angle": 25.14615760888846, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.833333333333321}}
good_angle_max25.14615760888846
good_angle_mean8.182298947373074
good_angle_median2.502139831761016
good_angle_min0.35247416523660835
reward_max-0.6525341186731238
reward_mean-6.279315192997841
reward_median-6.363159887939691
reward_min-10.220616815561502
survival_time_max16.666666666666654
survival_time_mean7.466666666666657
survival_time_min3.3999999999999977
traveled_tiles_max9
traveled_tiles_mean4
traveled_tiles_median3
traveled_tiles_min2
valid_direction_max3.999999999999988
valid_direction_mean2.2533333333333267
valid_direction_median1.7666666666666626
valid_direction_min0.6333333333333322
9955553JonJP pipelineaido1_LF1_r3-v3step1-simulationsuccessno3490:04:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9946563JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:02:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9940568JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:01:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9923582JonJP pipelineaido1_LF1_r3-v3step4-vizsuccessyes3490:03:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.9383190694439334
deviation-center-line_median0.7240131484038275
in-drivable-lane_median3.73333333333332


other stats
deviation-center-line_max1.9619654491777856
deviation-center-line_mean0.7753943411997068
deviation-center-line_min0
deviation-heading_max3.793329521177811
deviation-heading_mean1.8795327391597776
deviation-heading_median1.3995957880828112
deviation-heading_min0
driven_any_max2.3535470851994265
driven_any_mean1.6708180301707751
driven_any_median1.686390230302575
driven_any_min0.9052097758720424
driven_lanedir_max2.2058171493534338
driven_lanedir_mean0.944658395699251
driven_lanedir_min0
in-drivable-lane_max11.066666666666638
in-drivable-lane_mean4.779999999999989
in-drivable-lane_min0.4000000000000199
per-episodes
details{"ep000": {"driven_any": 1.655856637073334, "driven_lanedir": 0, "in-drivable-lane": 11.066666666666638, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.686390230302575, "driven_lanedir": 1.1126443406905695, "in-drivable-lane": 3.73333333333332, "deviation-heading": 3.0064294534060703, "deviation-center-line": 0.7240131484038275}, "ep002": {"driven_any": 0.9052097758720424, "driven_lanedir": 0.4665114190083184, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.3995957880828112, "deviation-center-line": 0.32430418341812345}, "ep003": {"driven_any": 1.753086422406498, "driven_lanedir": 0.9383190694439334, "in-drivable-lane": 5.79999999999998, "deviation-heading": 1.1983089331321926, "deviation-center-line": 0.8666889249987981}, "ep004": {"driven_any": 2.3535470851994265, "driven_lanedir": 2.2058171493534338, "in-drivable-lane": 0.4000000000000199, "deviation-heading": 3.793329521177811, "deviation-center-line": 1.9619654491777856}}
9912582JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3490:01:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9909580JonJP pipelineaido1_LF1_r3-v3step3-videossuccessyes3490:01:12Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9897573JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:02:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9895575JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:00:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'omega' referenced before assignment

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9891576JonJP pipelineaido1_LF1_r3-v3step1-simulationfailedno3490:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
    raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
  File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
    solution.run(cis)
  File "solution.py", line 63, in run
    raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x

Hidden. If you are the author, please login using the top-right link or use the dashboard.
9885590Allen OuTensorflow templateaido1_LF1_r3-v3step4-vizsuccessyes3490:02:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median1.1802755024585134
deviation-center-line_median0.5754096123679283
in-drivable-lane_median0.033333333333333215


other stats
deviation-center-line_max1.1831827320618895
deviation-center-line_mean0.6341360178813958
deviation-center-line_min0.22474959476747397
deviation-heading_max2.6463413950694106
deviation-heading_mean1.4716556367984308
deviation-heading_median1.655338948591104
deviation-heading_min0.24402069512793112
driven_any_max2.888481976798732
driven_any_mean1.5185948664746167
driven_any_median1.3336938584292013
driven_any_min0.3169846704443646
driven_lanedir_max2.5715150173412997
driven_lanedir_mean1.34575575171303
driven_lanedir_min0.30535009450292927
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.3133333333333327
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 2.267982984756009, "driven_lanedir": 1.8912094979622496, "in-drivable-lane": 0.7333333333333332, "deviation-heading": 2.6463413950694106, "deviation-center-line": 0.7006105605048246}, "ep001": {"driven_any": 0.3169846704443646, "driven_lanedir": 0.30535009450292927, "in-drivable-lane": 0, "deviation-heading": 0.24402069512793112, "deviation-center-line": 0.22474959476747397}, "ep002": {"driven_any": 1.3336938584292013, "driven_lanedir": 1.1802755024585134, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.4607810007432205, "deviation-center-line": 0.5754096123679283}, "ep003": {"driven_any": 2.888481976798732, "driven_lanedir": 2.5715150173412997, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.655338948591104, "deviation-center-line": 1.1831827320618895}, "ep004": {"driven_any": 0.7858308419447766, "driven_lanedir": 0.7804286463001577, "in-drivable-lane": 0, "deviation-heading": 0.35179614446048796, "deviation-center-line": 0.4867275897048623}}
9877590Allen OuTensorflow templateaido1_LF1_r3-v3step3-videossuccessyes3490:01:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9874590Allen OuTensorflow templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:18Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.533333333333314


other stats
episodes
details{"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}
good_angle_max0.8928199947802034
good_angle_mean0.44726467462067304
good_angle_median0.33400722083424306
good_angle_min0.060537386068120175
reward_max-0.28626655193418266
reward_mean-5.91151246140921
reward_median-4.076980934218227
reward_min-15.93245312479826
survival_time_max16.666666666666654
survival_time_mean8.973333333333319
survival_time_min2.1666666666666687
traveled_tiles_max6
traveled_tiles_mean3.2
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max1.4999999999999956
valid_direction_mean0.7466666666666641
valid_direction_median0.6666666666666643
valid_direction_min0.09999999999999964
9869592coolcat647PyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:19Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.799999999999989


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.400087172387622, "good_angle": 1.3142241469019869, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 52, "reward": -19.78199272660109, "good_angle": 0.08163371101430023, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 229, "reward": -4.757955190636407, "good_angle": 2.1314649418355702, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 4.099999999999986}, "ep003": {"nsteps": 229, "reward": -5.533671027996504, "good_angle": 1.1018644129241444, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 5.399999999999981}, "ep004": {"nsteps": 174, "reward": -6.955468747807645, "good_angle": 1.4543242829737104, "survival_time": 5.799999999999989, "traveled_tiles": 2, "valid_direction": 4.866666666666656}}
good_angle_max2.1314649418355702
good_angle_mean1.2167022991299423
good_angle_median1.3142241469019869
good_angle_min0.08163371101430023
reward_max-4.757955190636407
reward_mean-10.085834973085852
reward_median-6.955468747807645
reward_min-19.78199272660109
survival_time_max7.633333333333316
survival_time_mean5.0666666666666575
survival_time_min1.7333333333333354
traveled_tiles_max3
traveled_tiles_mean2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.399999999999981
valid_direction_mean3.2999999999999914
valid_direction_median4.099999999999986
valid_direction_min0
9860592coolcat647PyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3490:02:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9841606lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:01:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5166925639708038
deviation-center-line_median0.2302817963673843
in-drivable-lane_median0.6


other stats
deviation-center-line_max0.8590517130551906
deviation-center-line_mean0.3647794293193752
deviation-center-line_min0.1766154612705062
deviation-heading_max5.05737131005766
deviation-heading_mean1.6976848703126368
deviation-heading_median0.9391534539036354
deviation-heading_min0.19166106732704172
driven_any_max2.60680515540643
driven_any_mean0.981672501989357
driven_any_median0.7271008193689704
driven_any_min0.2167661398628974
driven_lanedir_max1.217647358427854
driven_lanedir_mean0.5599642324470806
driven_lanedir_min0.13437413629629913
in-drivable-lane_max7.899999999999972
in-drivable-lane_mean2.339999999999992
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.35230213828487744, "driven_lanedir": 0.13437413629629913, "in-drivable-lane": 0.6, "deviation-heading": 1.7866760708844476, "deviation-center-line": 0.18475698018777356}, "ep001": {"driven_any": 0.2167661398628974, "driven_lanedir": 0.2140501790212612, "in-drivable-lane": 0, "deviation-heading": 0.19166106732704172, "deviation-center-line": 0.1766154612705062}, "ep002": {"driven_any": 2.60680515540643, "driven_lanedir": 1.217647358427854, "in-drivable-lane": 7.899999999999972, "deviation-heading": 5.05737131005766, "deviation-center-line": 0.8590517130551906}, "ep003": {"driven_any": 0.7271008193689704, "driven_lanedir": 0.7170569245191847, "in-drivable-lane": 0, "deviation-heading": 0.5135624493903992, "deviation-center-line": 0.3731911957160216}, "ep004": {"driven_any": 1.0053882570236092, "driven_lanedir": 0.5166925639708038, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.9391534539036354, "deviation-center-line": 0.2302817963673843}}
9829613lmandrilePyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:01:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5661020704594424
deviation-center-line_median0.2740354783309631
in-drivable-lane_median3.266666666666655


other stats
deviation-center-line_max0.5603588606390013
deviation-center-line_mean0.3120589482029849
deviation-center-line_min0.19846746065156567
deviation-heading_max3.214183416776645
deviation-heading_mean1.6059425773309546
deviation-heading_median1.2834201828497314
deviation-heading_min0.8871462076947535
driven_any_max1.3560961776989535
driven_any_mean1.04737111715508
driven_any_median1.1251706898040728
driven_any_min0.3746769082831119
driven_lanedir_max0.6715017430237435
driven_lanedir_mean0.5148131075456355
driven_lanedir_min0.15612622869521509
in-drivable-lane_max4.799999999999983
in-drivable-lane_mean2.99999999999999
in-drivable-lane_min0.5333333333333333
per-episodes
details{"ep000": {"driven_any": 0.3746769082831119, "driven_lanedir": 0.15612622869521509, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.7338392601903574, "deviation-center-line": 0.19846746065156567}, "ep001": {"driven_any": 1.1251706898040728, "driven_lanedir": 0.6292605959907072, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 1.2834201828497314, "deviation-center-line": 0.3138953503935618}, "ep002": {"driven_any": 1.3560961776989535, "driven_lanedir": 0.6715017430237435, "in-drivable-lane": 3.266666666666655, "deviation-heading": 3.214183416776645, "deviation-center-line": 0.5603588606390013}, "ep003": {"driven_any": 1.2984217247544845, "driven_lanedir": 0.5510748995590697, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.911123819143286, "deviation-center-line": 0.2740354783309631}, "ep004": {"driven_any": 1.0824900852347763, "driven_lanedir": 0.5661020704594424, "in-drivable-lane": 3.533333333333321, "deviation-heading": 0.8871462076947535, "deviation-center-line": 0.21353759099983263}}
9826607lavoiemsPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.766666666666652


other stats
episodes
details{"ep000": {"nsteps": 74, "reward": -13.787438218072811, "good_angle": 1.119777471345656, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.9333333333333345}, "ep001": {"nsteps": 203, "reward": -6.593767599032944, "good_angle": 18.49659831115776, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 5.2666666666666515}, "ep002": {"nsteps": 225, "reward": -4.836047241100006, "good_angle": 2.099535963172931, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep003": {"nsteps": 231, "reward": -5.5219402299282745, "good_angle": 1.026867242839075, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 5.599999999999982}, "ep004": {"nsteps": 188, "reward": -6.54944158991504, "good_angle": 1.5930068507168955, "survival_time": 6.266666666666654, "traveled_tiles": 2, "valid_direction": 4.899999999999986}}
good_angle_max18.49659831115776
good_angle_mean4.867157167846463
good_angle_median1.5930068507168955
good_angle_min1.026867242839075
reward_max-4.836047241100006
reward_mean-7.457726975609816
reward_median-6.54944158991504
reward_min-13.787438218072811
survival_time_max7.699999999999982
survival_time_mean6.139999999999988
survival_time_min2.4666666666666677
traveled_tiles_max3
traveled_tiles_mean2.2
traveled_tiles_median2
traveled_tiles_min1
valid_direction_max5.599999999999982
valid_direction_mean4.319999999999988
valid_direction_median4.899999999999986
valid_direction_min1.9333333333333345
9817611DavidRandom executionaido1_LF1_r3-v3step3-videossuccessyes3490:01:25Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9812611DavidRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.6999999999999895


other stats
episodes
details{"ep000": {"nsteps": 79, "reward": -12.92334378996416, "good_angle": 1.2860110947254035, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 63, "reward": -16.439583957668336, "good_angle": 0.01455387420995444, "survival_time": 2.1000000000000023, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 171, "reward": -6.293316102341602, "good_angle": 0.04582194768596806, "survival_time": 5.6999999999999895, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 456, "reward": -2.247400954376708, "good_angle": 1.7582262547504697, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.299999999999992}, "ep004": {"nsteps": 344, "reward": -3.55477666423851, "good_angle": 18.893290685764693, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}
good_angle_max18.893290685764693
good_angle_mean4.399580771427297
good_angle_median1.2860110947254035
good_angle_min0.01455387420995444
reward_max-2.247400954376708
reward_mean-8.291684293717863
reward_median-6.293316102341602
reward_min-16.439583957668336
survival_time_max15.199999999999957
survival_time_mean7.419999999999985
survival_time_min2.1000000000000023
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.9666666666666535
valid_direction_mean1.6999999999999955
valid_direction_median2.2333333333333334
valid_direction_min0
9805611DavidRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3490:02:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9794616lmandrilePyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:01:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.5250709193177174
deviation-center-line_median0.2556973600975583
in-drivable-lane_median3.066666666666656


other stats
deviation-center-line_max0.6143296719023782
deviation-center-line_mean0.33376954739821685
deviation-center-line_min0.1642583397836546
deviation-heading_max4.27947587994958
deviation-heading_mean2.058809599902401
deviation-heading_median1.9218451548887905
deviation-heading_min0.8852028205539008
driven_any_max1.2737737203338624
driven_any_mean0.989022824867824
driven_any_median1.1280364621627208
driven_any_min0.3473602189962636
driven_lanedir_max0.7238885910052046
driven_lanedir_mean0.509742936471809
driven_lanedir_min0.1186094684650233
in-drivable-lane_max3.9333333333333194
in-drivable-lane_mean2.3199999999999923
in-drivable-lane_min0.5666666666666647
per-episodes
details{"ep000": {"driven_any": 0.3473602189962636, "driven_lanedir": 0.1186094684650233, "in-drivable-lane": 0.7, "deviation-heading": 1.9218451548887905, "deviation-center-line": 0.1642583397836546}, "ep001": {"driven_any": 1.1280364621627208, "driven_lanedir": 0.7238885910052046, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.27947587994958, "deviation-center-line": 0.6143296719023782}, "ep002": {"driven_any": 1.2737737203338624, "driven_lanedir": 0.6765251412198185, "in-drivable-lane": 3.066666666666656, "deviation-heading": 2.2145363677736527, "deviation-center-line": 0.39217382596932027}, "ep003": {"driven_any": 1.1563411371643584, "driven_lanedir": 0.5250709193177174, "in-drivable-lane": 3.9333333333333194, "deviation-heading": 0.8852028205539008, "deviation-center-line": 0.2556973600975583}, "ep004": {"driven_any": 1.0396025856819144, "driven_lanedir": 0.5046205623512812, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 0.9929877763460834, "deviation-center-line": 0.24238853923817305}}
9793616lmandrilePyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3490:01:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9784623lmandrilePyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.6771302486299837
deviation-center-line_median0.4069244650493848
in-drivable-lane_median3.0333333333333226


other stats
deviation-center-line_max0.5717517583743436
deviation-center-line_mean0.3795060526977586
deviation-center-line_min0.1931257746045532
deviation-heading_max3.1718159400981114
deviation-heading_mean1.9065801222515797
deviation-heading_median2.000091925471767
deviation-heading_min0.9151100333383154
driven_any_max1.4299641173590594
driven_any_mean1.0657856652780648
driven_any_median1.186299182960599
driven_any_min0.3435133543707523
driven_lanedir_max0.8857982064863736
driven_lanedir_mean0.5980372925376503
driven_lanedir_min0.11205669080070256
in-drivable-lane_max4.099999999999985
in-drivable-lane_mean2.353333333333326
in-drivable-lane_min0.6666666666666643
per-episodes
details{"ep000": {"driven_any": 0.3435133543707523, "driven_lanedir": 0.11205669080070256, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.000091925471767, "deviation-center-line": 0.1931257746045532}, "ep001": {"driven_any": 1.096941413846466, "driven_lanedir": 0.7224239149767802, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 3.1718159400981114, "deviation-center-line": 0.5717517583743436}, "ep002": {"driven_any": 1.272210257853448, "driven_lanedir": 0.6771302486299837, "in-drivable-lane": 3.0333333333333226, "deviation-heading": 2.338189048072027, "deviation-center-line": 0.43475856496634896}, "ep003": {"driven_any": 1.186299182960599, "driven_lanedir": 0.5927774017944114, "in-drivable-lane": 4.099999999999985, "deviation-heading": 0.9151100333383154, "deviation-center-line": 0.29096970049416276}, "ep004": {"driven_any": 1.4299641173590594, "driven_lanedir": 0.8857982064863736, "in-drivable-lane": 3.2333333333333227, "deviation-heading": 1.107693664277678, "deviation-center-line": 0.4069244650493848}}
9783623lmandrilePyTorch templateaido1_LF1_r3-v3step3-videossuccessyes3490:01:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9781623lmandrilePyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.36666666666665


other stats
episodes
details{"ep000": {"nsteps": 76, "reward": -13.405452955293615, "good_angle": 1.2139051963793814, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.000000000000001}, "ep001": {"nsteps": 198, "reward": -6.283026755683952, "good_angle": 11.315300692667604, "survival_time": 6.599999999999986, "traveled_tiles": 2, "valid_direction": 3.3333333333333215}, "ep002": {"nsteps": 228, "reward": -4.947113494722688, "good_angle": 2.7312966536069982, "survival_time": 7.599999999999983, "traveled_tiles": 3, "valid_direction": 4.666666666666655}, "ep003": {"nsteps": 221, "reward": -5.769975510286799, "good_angle": 1.173055412130904, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 5.36666666666665}, "ep004": {"nsteps": 260, "reward": -4.8838148414605085, "good_angle": 13.222013377919655, "survival_time": 8.666666666666647, "traveled_tiles": 3, "valid_direction": 3.599999999999988}}
good_angle_max13.222013377919655
good_angle_mean5.9311142665409085
good_angle_median2.7312966536069982
good_angle_min1.173055412130904
reward_max-4.8838148414605085
reward_mean-7.057876711489511
reward_median-5.769975510286799
reward_min-13.405452955293615
survival_time_max8.666666666666647
survival_time_mean6.553333333333319
survival_time_min2.533333333333334
traveled_tiles_max3
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max5.36666666666665
valid_direction_mean3.7933333333333232
valid_direction_median3.599999999999988
valid_direction_min2.000000000000001
9767623lmandrilePyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3490:02:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9758629lavoiemsPyTorch templateaido1_LF1_r3-v3step4-vizsuccessyes3490:02:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.7013652812302966
deviation-center-line_median0.32650281262845576
in-drivable-lane_median1.233333333333329


other stats
deviation-center-line_max0.531647420231844
deviation-center-line_mean0.35492870222705536
deviation-center-line_min0.18179657501427013
deviation-heading_max3.908798573221953
deviation-heading_mean2.065308947946612
deviation-heading_median1.6217999883349208
deviation-heading_min0.906093019712902
driven_any_max1.4497804061594632
driven_any_mean1.0402889767672645
driven_any_median1.1193479216509026
driven_any_min0.4010653447999526
driven_lanedir_max0.8820297295817688
driven_lanedir_mean0.5966891209714047
driven_lanedir_min0.1863940249753766
in-drivable-lane_max4.699999999999984
in-drivable-lane_mean1.9533333333333267
in-drivable-lane_min0.46666666666666695
per-episodes
details{"ep000": {"driven_any": 0.4010653447999526, "driven_lanedir": 0.1863940249753766, "in-drivable-lane": 0.46666666666666695, "deviation-heading": 1.6217999883349208, "deviation-center-line": 0.18179657501427013}, "ep001": {"driven_any": 1.1193479216509026, "driven_lanedir": 0.7013652812302966, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.908798573221953, "deviation-center-line": 0.531647420231844}, "ep002": {"driven_any": 1.2538459073284771, "driven_lanedir": 0.8820297295817688, "in-drivable-lane": 1.233333333333329, "deviation-heading": 2.837983715998678, "deviation-center-line": 0.47874800960423586}, "ep003": {"driven_any": 1.4497804061594632, "driven_lanedir": 0.7224644012027293, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.906093019712902, "deviation-center-line": 0.32650281262845576}, "ep004": {"driven_any": 0.9774053038975272, "driven_lanedir": 0.4911921678668522, "in-drivable-lane": 2.5666666666666575, "deviation-heading": 1.0518694424646071, "deviation-center-line": 0.255948693656471}}
9757626yun chenPyTorch templateaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:22Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.8666666666666663


other stats
episodes
details{"ep000": {"nsteps": 75, "reward": -13.594147127090643, "good_angle": 1.1853772977391637, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.0666666666666673}, "ep001": {"nsteps": 55, "reward": -18.773121839219872, "good_angle": 0.117414489762818, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.20000000000000065}, "ep002": {"nsteps": 234, "reward": -4.85179854529058, "good_angle": 3.08135221103936, "survival_time": 7.799999999999982, "traveled_tiles": 4, "valid_direction": 5.533333333333317}, "ep003": {"nsteps": 86, "reward": -11.964551168125729, "good_angle": 0.1257789332817162, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 150, "reward": -7.666139459673237, "good_angle": 1.6286658963624736, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 3.6999999999999913}}
good_angle_max3.08135221103936
good_angle_mean1.2277177656371063
good_angle_median1.1853772977391637
good_angle_min0.117414489762818
reward_max-4.85179854529058
reward_mean-11.369951627880011
reward_median-11.964551168125729
reward_min-18.773121839219872
survival_time_max7.799999999999982
survival_time_mean3.999999999999995
survival_time_min1.8333333333333357
traveled_tiles_max4
traveled_tiles_mean1.8
traveled_tiles_median1
traveled_tiles_min1
valid_direction_max5.533333333333317
valid_direction_mean2.299999999999995
valid_direction_median2.0666666666666673
valid_direction_min0
9746626yun chenPyTorch templateaido1_LF1_r3-v3step1-simulationsuccessno3490:02:47Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
9744638MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step4-vizsuccessyes3490:01:37Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median0.21923036405021623
deviation-center-line_median0.20114689017621745
in-drivable-lane_median0


other stats
deviation-center-line_max0.3546401261611177
deviation-center-line_mean0.21980283196756345
deviation-center-line_min0.06591220891092249
deviation-heading_max1.7687127694435452
deviation-heading_mean0.8225879697570478
deviation-heading_median0.6226670365945953
deviation-heading_min0.3813831367755872
driven_any_max0.8000211011153562
driven_any_mean0.3442917560405993
driven_any_median0.23929191808567157
driven_any_min0.06070626051022837
driven_lanedir_max0.5594855386288404
driven_lanedir_mean0.2828160478778809
driven_lanedir_min0.045800167389093094
in-drivable-lane_max1.9000000000000024
in-drivable-lane_mean0.3800000000000005
in-drivable-lane_min0
per-episodes
details{"ep000": {"driven_any": 0.8000211011153562, "driven_lanedir": 0.5594855386288404, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7687127694435452, "deviation-center-line": 0.3546401261611177}, "ep001": {"driven_any": 0.06070626051022837, "driven_lanedir": 0.045800167389093094, "in-drivable-lane": 0, "deviation-heading": 0.3813831367755872, "deviation-center-line": 0.06591220891092249}, "ep002": {"driven_any": 0.1678486433668507, "driven_lanedir": 0.14951999504293156, "in-drivable-lane": 0, "deviation-heading": 0.5769794251031379, "deviation-center-line": 0.13499007845450084}, "ep003": {"driven_any": 0.4535908571248896, "driven_lanedir": 0.4400441742783232, "in-drivable-lane": 0, "deviation-heading": 0.7631974808683735, "deviation-center-line": 0.3423248561350588}, "ep004": {"driven_any": 0.23929191808567157, "driven_lanedir": 0.21923036405021623, "in-drivable-lane": 0, "deviation-heading": 0.6226670365945953, "deviation-center-line": 0.20114689017621745}}
9740638MandanaSamieiROS-based Lane Followingaido1_LF1_r3-v3step3-videossuccessyes3490:00:51Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9732642miksazRandom executionaido1_LF1_r3-v3step3-videossuccessyes3490:00:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
videos1
9730642miksazRandom executionaido1_LF1_r3-v3step2-scoringsuccessyes3490:00:21Hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.266666666666654


other stats
episodes
details{"ep000": {"nsteps": 80, "reward": -12.74193479833193, "good_angle": 1.2125596404295538, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 52, "reward": -19.79740259395196, "good_angle": 0.02008840683930248, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.721608808383029, "good_angle": 0.12034214678637478, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 456, "reward": -2.375910223140524, "good_angle": 1.0182056404675923, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 1.9666666666666597}, "ep004": {"nsteps": 343, "reward": -3.556067698073109, "good_angle": 17.709997021722945, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}
good_angle_max17.709997021722945
good_angle_mean4.016238571249153
good_angle_median1.0182056404675923
good_angle_min0.02008840683930248
reward_max-2.375910223140524
reward_mean-8.83858482437611
reward_median-5.721608808383029
reward_min-19.79740259395196
survival_time_max15.199999999999957
survival_time_mean7.459999999999984
survival_time_min1.7333333333333354
traveled_tiles_max4
traveled_tiles_mean2.4
traveled_tiles_median3
traveled_tiles_min1
valid_direction_max3.899999999999987
valid_direction_mean1.6733333333333291
valid_direction_median1.9666666666666597
valid_direction_min0
9723642miksazRandom executionaido1_LF1_r3-v3step1-simulationsuccessno3490:01:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1