Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 10652
194
Florian Golemo PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:48:33+00:00 2018-11-18 03:59:11+00:00 0:10:38 Timeout:
Waited 602 [...] Timeout:
Waited 602.497819901 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10645
3
Andrea Censi 🇨🇭null aido1_LF1-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 03:47:09+00:00 2018-11-18 03:48:23+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats ep000 details {"nsteps": 171, "reward": -6.168826045855139}ep001 details {"nsteps": 88, "reward": -13.200233698759058}ep002 details {"nsteps": 18, "reward": -58.63515728049808}ep003 details {"nsteps": 80, "reward": -13.576747538545169}ep004 details {"nsteps": 23, "reward": -45.71124377457992}
No reset possible 10639
144
Andrea Censi 🇨🇭Random execution aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:46:28+00:00 2018-11-18 03:46:59+00:00 0:00:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
solution.run(cis)
File "solution.py", line 60, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 35, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10635
221
Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:45:44+00:00 2018-11-18 03:46:18+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 107, in run
raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10633
165
Andrea Censi 🇨🇭Random execution aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:44:56+00:00 2018-11-18 03:45:30+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 580, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 575, in wrap_solution
solution.run(cis)
File "solution.py", line 64, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 39, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 107, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 52, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 74, in _failsafe_observe
raise Exception("Can't connect to the gym-duckietown-server")
Exception: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10631
223
Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:44:17+00:00 2018-11-18 03:44:49+00:00 0:00:32 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 107, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10627
270
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:43:35+00:00 2018-11-18 03:44:07+00:00 0:00:32 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10623
272
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:42:54+00:00 2018-11-18 03:43:28+00:00 0:00:34 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10618
275
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:42:11+00:00 2018-11-18 03:42:47+00:00 0:00:36 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10578
330
Benjamin Ramtoula 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:31:23+00:00 2018-11-18 03:42:04+00:00 0:10:41 Timeout:
Waited 602 [...] Timeout:
Waited 602.204530001 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10572
312
Andrea Censi 🇨🇭Tensorflow template aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:30:33+00:00 2018-11-18 03:31:12+00:00 0:00:39 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10571
349
Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 03:28:02+00:00 2018-11-18 03:30:25+00:00 0:02:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.6198867320950967 deviation-center-line_median 0.34402940780714075 in-drivable-lane_median 2.8333333333333233
other stats deviation-center-line_max 0.5317058803554829 deviation-center-line_mean 0.3552189889958307 deviation-center-line_min 0.190894379144421 deviation-heading_max 3.585781960492237 deviation-heading_mean 2.083000714172086 deviation-heading_median 1.9019429906857557 deviation-heading_min 0.9429226979585345 driven_any_max 1.3414318772046931 driven_any_mean 1.0421043293529035 driven_any_median 1.1243802023780556 driven_any_min 0.3486383218895127 driven_lanedir_max 0.7418838579509837 driven_lanedir_mean 0.5479006394295165 driven_lanedir_min 0.12038187450900384 in-drivable-lane_max 4.133333333333319 in-drivable-lane_mean 2.326666666666659 in-drivable-lane_min 0.7333333333333333 per-episodes details {"ep000": {"driven_any": 0.3486383218895127, "driven_lanedir": 0.12038187450900384, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 1.9019429906857557, "deviation-center-line": 0.190894379144421}, "ep001": {"driven_any": 1.1243802023780556, "driven_lanedir": 0.7104853358594905, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.585781960492237, "deviation-center-line": 0.5317058803554829}, "ep002": {"driven_any": 1.337676917439405, "driven_lanedir": 0.7418838579509837, "in-drivable-lane": 2.8333333333333233, "deviation-heading": 3.017150993481058, "deviation-center-line": 0.48309131012450207}, "ep003": {"driven_any": 1.3414318772046931, "driven_lanedir": 0.6198867320950967, "in-drivable-lane": 4.133333333333319, "deviation-heading": 0.9672049282428472, "deviation-center-line": 0.34402940780714075}, "ep004": {"driven_any": 1.0583943278528511, "driven_lanedir": 0.5468653967330084, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 0.9429226979585345, "deviation-center-line": 0.22637396754760705}}
No reset possible 10568
313
Andrea Censi 🇨🇭PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:27:10+00:00 2018-11-18 03:27:55+00:00 0:00:45 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10566
343
Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 03:26:29+00:00 2018-11-18 03:27:03+00:00 0:00:34 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10562
345
Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:25:38+00:00 2018-11-18 03:26:20+00:00 0:00:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 116, in run
solve(params, cis)
File "solution.py", line 65, in solve
model.load("model", "models")
File "/workspace/model.py", line 229, in load
self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 719, in load_state_dict
self.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for ActorCNN:
size mismatch for lin1.weight: copying a param of torch.Size([512, 127872]) from checkpoint, where the shape is torch.Size([512, 4032]) in current model.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10551
349
Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 03:22:35+00:00 2018-11-18 03:25:31+00:00 0:02:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10538
331
Andrea Censi 🇨🇭Random execution aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:19:57+00:00 2018-11-18 03:22:28+00:00 0:02:31 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 73, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 46, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10535
332
Andrea Censi 🇨🇭Random execution aido1_LFV_r1-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:18:52+00:00 2018-11-18 03:19:50+00:00 0:00:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 73, in run
solve(gym_environment, cis) # let's try to solve the challenge, exciting ah?
File "solution.py", line 46, in solve
observation, reward, done, info = env.step(action)
File "/usr/local/lib/python2.7/dist-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/notebooks/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/notebooks/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10528
360
Pravish Sainath 🇨🇦PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 03:16:42+00:00 2018-11-18 03:18:44+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.6840735691388744 deviation-center-line_median 0.3035878835678968 in-drivable-lane_median 1.86666666666666
other stats deviation-center-line_max 0.4726738099223275 deviation-center-line_mean 0.2942831490795076 deviation-center-line_min 0.1595384303826503 deviation-heading_max 2.7341520929162275 deviation-heading_mean 1.3848471616927558 deviation-heading_median 1.0726168791489834 deviation-heading_min 0.2790026520471443 driven_any_max 1.3049459102403291 driven_any_mean 0.8764390762576355 driven_any_median 1.2495104674100357 driven_any_min 0.19878313657519525 driven_lanedir_max 0.8050051576008688 driven_lanedir_mean 0.5103962183714653 driven_lanedir_min 0.12905346598606626 in-drivable-lane_max 3.866666666666653 in-drivable-lane_mean 1.973333333333327 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.34462667413683057, "driven_lanedir": 0.12905346598606626, "in-drivable-lane": 0.7666666666666666, "deviation-heading": 1.933867961803972, "deviation-center-line": 0.1595384303826503}, "ep001": {"driven_any": 0.19878313657519525, "driven_lanedir": 0.19394601880144213, "in-drivable-lane": 0, "deviation-heading": 0.2790026520471443, "deviation-center-line": 0.2011347366627285}, "ep002": {"driven_any": 1.2495104674100357, "driven_lanedir": 0.8050051576008688, "in-drivable-lane": 1.86666666666666, "deviation-heading": 2.7341520929162275, "deviation-center-line": 0.4726738099223275}, "ep003": {"driven_any": 1.284329192925787, "driven_lanedir": 0.6840735691388744, "in-drivable-lane": 3.866666666666653, "deviation-heading": 0.9045962225474526, "deviation-center-line": 0.3035878835678968}, "ep004": {"driven_any": 1.3049459102403291, "driven_lanedir": 0.7399028803300753, "in-drivable-lane": 3.3666666666666547, "deviation-heading": 1.0726168791489834, "deviation-center-line": 0.3344808848619352}}
No reset possible 10518
360
Pravish Sainath 🇨🇦PyTorch template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 03:15:10+00:00 2018-11-18 03:16:35+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10516
360
Pravish Sainath 🇨🇦PyTorch template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 03:14:40+00:00 2018-11-18 03:15:03+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.599999999999983
other stats episodes details {"ep000": {"nsteps": 79, "reward": -12.958519177867949, "good_angle": 1.2841682992947514, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 57, "reward": -18.10167970312269, "good_angle": 0.05340326991644695, "survival_time": 1.9000000000000024, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 228, "reward": -4.6792328577987, "good_angle": 1.929419517714582, "survival_time": 7.599999999999983, "traveled_tiles": 3, "valid_direction": 3.599999999999987}, "ep003": {"nsteps": 232, "reward": -5.362626247872209, "good_angle": 1.091317569886713, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 4.533333333333317}, "ep004": {"nsteps": 236, "reward": -5.280892781806731, "good_angle": 8.315036035917688, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.833333333333316}}good_angle_max 8.315036035917688 good_angle_mean 2.5346689385460364 good_angle_median 1.2841682992947514 good_angle_min 0.05340326991644695 reward_max -4.6792328577987 reward_mean -9.276590153693656 reward_median -5.362626247872209 reward_min -18.10167970312269 survival_time_max 7.866666666666648 survival_time_mean 5.546666666666657 survival_time_min 1.9000000000000024 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.833333333333316 valid_direction_mean 3.0199999999999907 valid_direction_median 3.599999999999987 valid_direction_min 0
No reset possible 10499
360
Pravish Sainath 🇨🇦PyTorch template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 03:10:25+00:00 2018-11-18 03:14:33+00:00 0:04:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10492
365
Mandana Samiei 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 03:09:41+00:00 2018-11-18 03:10:16+00:00 0:00:35 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 586, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 87, in run
solve(params, cis)
File "solution.py", line 60, in solve
action = model.predict(observation)
File "/workspace/model.py", line 176, in predict
return self.actor(state).cpu().data.numpy().flatten()
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/workspace/model.py", line 72, in forward
x = self.lr(self.lin1(x))
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/opt/conda/lib/python2.7/site-packages/torch/nn/modules/linear.py", line 55, in forward
return F.linear(input, self.weight, self.bias)
File "/opt/conda/lib/python2.7/site-packages/torch/nn/functional.py", line 1024, in linear
return torch.addmm(bias, input, weight.t())
RuntimeError: size mismatch, m1: [1 x 127872], m2: [4032 x 512] at /tmp/pip-req-build-vRRdPa/aten/src/TH/generic/THTensorMath.cpp:2070
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10482
376
Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 03:07:25+00:00 2018-11-18 03:09:34+00:00 0:02:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10475
389
Liam Paull 🇨🇦Random execution aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 03:04:50+00:00 2018-11-18 03:07:18+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.828310674996585 deviation-center-line_median 0.39675702124407014 in-drivable-lane_median 0
other stats deviation-center-line_max 0.7179354734005684 deviation-center-line_mean 0.4064549886813335 deviation-center-line_min 0.214033161323768 deviation-heading_max 3.82953016565333 deviation-heading_mean 1.496615913836184 deviation-heading_median 1.0018811217976218 deviation-heading_min 0.18888049888053884 driven_any_max 1.6148765125383513 driven_any_mean 0.8644251786016122 driven_any_median 0.831568440938805 driven_any_min 0.3219592324979507 driven_lanedir_max 1.255171198733825 driven_lanedir_mean 0.7417908945600653 driven_lanedir_min 0.16277084737591307 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.32666666666666594 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.37570161473959574, "driven_lanedir": 0.16277084737591307, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 1.9914188553009555, "deviation-center-line": 0.214033161323768}, "ep001": {"driven_any": 0.3219592324979507, "driven_lanedir": 0.3207934956529499, "in-drivable-lane": 0, "deviation-heading": 0.18888049888053884, "deviation-center-line": 0.2509394613684371}, "ep002": {"driven_any": 1.1780200922933584, "driven_lanedir": 1.1419082560410534, "in-drivable-lane": 0, "deviation-heading": 1.0018811217976218, "deviation-center-line": 0.45260982606982386}, "ep003": {"driven_any": 0.831568440938805, "driven_lanedir": 0.828310674996585, "in-drivable-lane": 0, "deviation-heading": 0.4713689275484741, "deviation-center-line": 0.39675702124407014}, "ep004": {"driven_any": 1.6148765125383513, "driven_lanedir": 1.255171198733825, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.82953016565333, "deviation-center-line": 0.7179354734005684}}
No reset possible 10457
395
Maxim Kuzmin 🇷🇺Random execution aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 03:00:50+00:00 2018-11-18 03:04:40+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1357725518318953 deviation-center-line_median 0.5036149562068063 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 1.215349847416704 deviation-center-line_mean 0.5681132000226986 deviation-center-line_min 0.20861380512448008 deviation-heading_max 3.665989859099655 deviation-heading_mean 1.6256913396789858 deviation-heading_median 1.1379421412773951 deviation-heading_min 0.1701327427751769 driven_any_max 2.1139811689173973 driven_any_mean 1.152695879700692 driven_any_median 1.178335544531556 driven_any_min 0.3659916150719905 driven_lanedir_max 2.0782301810521457 driven_lanedir_mean 1.0279721529494932 driven_lanedir_min 0.15254813962803604 in-drivable-lane_max 0.6999999999999975 in-drivable-lane_mean 0.27999999999999947 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3659916150719905, "driven_lanedir": 0.15254813962803604, "in-drivable-lane": 0.6, "deviation-heading": 2.0584555637142303, "deviation-center-line": 0.20861380512448008}, "ep001": {"driven_any": 0.49853996099012526, "driven_lanedir": 0.4979099907962971, "in-drivable-lane": 0, "deviation-heading": 0.1701327427751769, "deviation-center-line": 0.3872369486249898}, "ep002": {"driven_any": 1.178335544531556, "driven_lanedir": 1.1357725518318953, "in-drivable-lane": 0, "deviation-heading": 1.095936391528472, "deviation-center-line": 0.5036149562068063}, "ep003": {"driven_any": 2.1139811689173973, "driven_lanedir": 2.0782301810521457, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.1379421412773951, "deviation-center-line": 1.215349847416704}, "ep004": {"driven_any": 1.6066311089923906, "driven_lanedir": 1.2753999014390915, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 3.665989859099655, "deviation-center-line": 0.5257504427405131}}
No reset possible 10453
396
Anna Tsalapova 🇷🇺simple submition aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 03:00:20+00:00 2018-11-18 03:00:44+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.21171160599775612, "good_angle": 1.7908999000353618, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 7.39999999999999}, "ep001": {"nsteps": 500, "reward": -0.49661089354753496, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.182835554510355, "good_angle": 0.03030352864283182, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.14843576791882515, "good_angle": 0.03284738421522274, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.2250587911726907, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}good_angle_max 1.7908999000353618 good_angle_mean 0.4012442705904789 good_angle_median 0.07595671165358207 good_angle_min 0.03030352864283182 reward_max 0.2250587911726907 reward_mean -0.16290700616035608 reward_median -0.182835554510355 reward_min -0.49661089354753496 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 7.39999999999999 valid_direction_mean 1.479999999999998 valid_direction_median 0 valid_direction_min 0
No reset possible 10429
396
Anna Tsalapova 🇷🇺simple submition aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 02:56:05+00:00 2018-11-18 03:00:11+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10389
412
Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 02:45:18+00:00 2018-11-18 02:55:57+00:00 0:10:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10366
428
????????? ??????? Random execution aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 02:38:35+00:00 2018-11-18 02:45:06+00:00 0:06:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7198854330971003 deviation-center-line_median 0.6993923666374686 in-drivable-lane_median 0
other stats deviation-center-line_max 1.536236930464029 deviation-center-line_mean 0.8128197848981245 deviation-center-line_min 0.46218760059102654 deviation-heading_max 3.2844048986051786 deviation-heading_mean 1.1761832439544904 deviation-heading_median 1.1240165941114446 deviation-heading_min 0.07942104943374192 driven_any_max 6.640000000000109 driven_any_mean 6.64000000000007 driven_any_median 6.640000000000084 driven_any_min 6.639999999999995 driven_lanedir_max 1.6799844318612076 driven_lanedir_mean 0.6880583663417399 driven_lanedir_min 0.07977707085548635 in-drivable-lane_max 10.733333333333334 in-drivable-lane_mean 2.146666666666667 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 6.640000000000109, "driven_lanedir": 0.13584553075677963, "in-drivable-lane": 10.733333333333334, "deviation-heading": 3.2844048986051786, "deviation-center-line": 0.7281699018240043}, "ep001": {"driven_any": 6.640000000000089, "driven_lanedir": 0.07977707085548635, "in-drivable-lane": 0, "deviation-heading": 1.1259174092607342, "deviation-center-line": 1.536236930464029}, "ep002": {"driven_any": 6.639999999999995, "driven_lanedir": 0.7198854330971003, "in-drivable-lane": 0, "deviation-heading": 0.26715626836135253, "deviation-center-line": 0.6993923666374686}, "ep003": {"driven_any": 6.640000000000073, "driven_lanedir": 1.6799844318612076, "in-drivable-lane": 0, "deviation-heading": 0.07942104943374192, "deviation-center-line": 0.6381121249740939}, "ep004": {"driven_any": 6.640000000000084, "driven_lanedir": 0.8247993651381256, "in-drivable-lane": 0, "deviation-heading": 1.1240165941114446, "deviation-center-line": 0.46218760059102654}}
No reset possible 10358
428
????????? ??????? Random execution aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 02:35:21+00:00 2018-11-18 02:38:28+00:00 0:03:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10355
428
????????? ??????? Random execution aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 02:34:51+00:00 2018-11-18 02:35:13+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.25889285968244075, "good_angle": 1.5014712110594055, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 5.933333333333321}, "ep001": {"nsteps": 500, "reward": -0.4693750252127647, "good_angle": 0.07621382840539564, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.18027196016907693, "good_angle": 0.04390423891890585, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.1492788551747799, "good_angle": 0.039369698187299546, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.20312675948161632, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}good_angle_max 1.5014712110594055 good_angle_mean 0.3473831376449178 good_angle_median 0.07595671165358207 good_angle_min 0.039369698187299546 reward_max 0.20312675948161632 reward_mean -0.17093838815148923 reward_median -0.18027196016907693 reward_min -0.4693750252127647 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 5.933333333333321 valid_direction_mean 1.1866666666666643 valid_direction_median 0 valid_direction_min 0
No reset possible 10334
428
????????? ??????? Random execution aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 02:28:50+00:00 2018-11-18 02:34:44+00:00 0:05:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10315
454
Orlando Marquez 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 02:21:28+00:00 2018-11-18 02:28:43+00:00 0:07:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.100249689175728 deviation-center-line_median 1.3487125967936766 in-drivable-lane_median 1.6999999999999946
other stats deviation-center-line_max 1.3768982623538213 deviation-center-line_mean 1.1636604921397915 deviation-center-line_min 0.39795317456375984 deviation-heading_max 11.728842752525235 deviation-heading_mean 9.45503895620446 deviation-heading_median 10.618271797823088 deviation-heading_min 4.129313534169556 driven_any_max 4.979113636122271 driven_any_mean 4.978687540041603 driven_any_median 4.979113636122251 driven_any_min 4.977288194248459 driven_lanedir_max 3.169624548409674 driven_lanedir_mean 2.6372312658476145 driven_lanedir_min 0.7388358492195609 in-drivable-lane_max 12.099999999999998 in-drivable-lane_mean 3.666666666666662 in-drivable-lane_min 0.8333333333333306 per-episodes details {"ep000": {"driven_any": 4.977288194248459, "driven_lanedir": 0.7388358492195609, "in-drivable-lane": 12.099999999999998, "deviation-heading": 4.129313534169556, "deviation-center-line": 0.39795317456375984}, "ep001": {"driven_any": 4.979113636122251, "driven_lanedir": 3.05494506528675, "in-drivable-lane": 2.199999999999993, "deviation-heading": 9.953043798180028, "deviation-center-line": 1.3768982623538213}, "ep002": {"driven_any": 4.978808597592767, "driven_lanedir": 3.1225011771463587, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 10.845722898324402, "deviation-center-line": 1.3449545003012535}, "ep003": {"driven_any": 4.979113636122271, "driven_lanedir": 3.169624548409674, "in-drivable-lane": 0.8333333333333306, "deviation-heading": 11.728842752525235, "deviation-center-line": 1.349783926686447}, "ep004": {"driven_any": 4.979113636122271, "driven_lanedir": 3.100249689175728, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 10.618271797823088, "deviation-center-line": 1.3487125967936766}}
No reset possible 10302
454
Orlando Marquez 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 02:17:01+00:00 2018-11-18 02:21:22+00:00 0:04:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10295
454
Orlando Marquez 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 02:16:28+00:00 2018-11-18 02:16:49+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.6358119174102321, "good_angle": 26.119034103876217, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.699999999999974}, "ep001": {"nsteps": 500, "reward": -0.3779372270097956, "good_angle": 13.49085374796333, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.96666666666665}, "ep002": {"nsteps": 500, "reward": -0.25285773413255813, "good_angle": 13.562961716495696, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.83333333333332}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 26.119034103876217 good_angle_mean 16.095647580263446 good_angle_median 13.562961716495696 good_angle_min 13.49085374796333 reward_max -0.17246611558226868 reward_mean -0.3494114613714046 reward_median -0.3079843127221684 reward_min -0.6358119174102321 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.699999999999983 valid_direction_median 12.96666666666665 valid_direction_min 11.699999999999974
No reset possible 10289
455
Orlando Marquez 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 02:15:54+00:00 2018-11-18 02:16:18+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 341, "reward": -3.5732938650779733, "good_angle": 18.779461385468952, "survival_time": 11.366666666666635, "traveled_tiles": 1, "valid_direction": 8.133333333333313}, "ep001": {"nsteps": 500, "reward": -0.3809802600943949, "good_angle": 13.488598718146529, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.999999999999986}, "ep002": {"nsteps": 500, "reward": -0.2547652696329169, "good_angle": 13.563933314027404, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.899999999999988}, "ep003": {"nsteps": 500, "reward": -0.17246611558226868, "good_angle": 13.541110901270132, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.966666666666653}, "ep004": {"nsteps": 500, "reward": -0.3079843127221684, "good_angle": 13.764277431711864, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 13.033333333333324}}good_angle_max 18.779461385468952 good_angle_mean 14.627476350124976 good_angle_median 13.563933314027404 good_angle_min 13.488598718146529 reward_max -0.17246611558226868 reward_mean -0.9378979646219444 reward_median -0.3079843127221684 reward_min -3.5732938650779733 survival_time_max 16.666666666666654 survival_time_mean 15.606666666666651 survival_time_min 11.366666666666635 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 13.033333333333324 valid_direction_mean 12.006666666666652 valid_direction_median 12.966666666666653 valid_direction_min 8.133333333333313
No reset possible 10263
455
Orlando Marquez 🇨🇦PyTorch DDPG template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 02:06:46+00:00 2018-11-18 02:15:48+00:00 0:09:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10259
457
Jonathan Plante 🇨🇦Random execution aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 02:06:10+00:00 2018-11-18 02:06:38+00:00 0:00:28 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named cv2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10254
462
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation error no idsc-rudolf-18140
2018-11-18 02:05:30+00:00 2018-11-18 02:06:04+00:00 0:00:34 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10242
479
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 02:01:27+00:00 2018-11-18 02:05:23+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.3143855010633223 deviation-center-line_median 0.14709453095890548 in-drivable-lane_median 13.36666666666662
other stats deviation-center-line_max 0.20762858195819092 deviation-center-line_mean 0.14618581991587334 deviation-center-line_min 0.05805242341066197 deviation-heading_max 1.0342945271318067 deviation-heading_mean 0.7991210663519178 deviation-heading_median 0.9433568496091662 deviation-heading_min 0.19154913286138767 driven_any_max 1.3142242371276414 driven_any_mean 0.8169040764939842 driven_any_median 0.7981214917420629 driven_any_min 0.41325712939466286 driven_lanedir_max 0.4217906671598224 driven_lanedir_mean 0.2847960783970781 driven_lanedir_min 0.03179017915486693 in-drivable-lane_max 14.899999999999984 in-drivable-lane_mean 13.199999999999967 in-drivable-lane_min 10.233333333333306 per-episodes details {"ep000": {"driven_any": 0.41325712939466286, "driven_lanedir": 0.03179017915486693, "in-drivable-lane": 10.233333333333306, "deviation-heading": 0.19154913286138767, "deviation-center-line": 0.05805242341066197}, "ep001": {"driven_any": 1.3142242371276414, "driven_lanedir": 0.4217906671598224, "in-drivable-lane": 14.266666666666652, "deviation-heading": 1.0342945271318067, "deviation-center-line": 0.20762858195819092}, "ep002": {"driven_any": 0.7082173885402527, "driven_lanedir": 0.3576641860676455, "in-drivable-lane": 13.36666666666662, "deviation-heading": 0.9433568496091662, "deviation-center-line": 0.1720680310518174}, "ep003": {"driven_any": 0.7981214917420629, "driven_lanedir": 0.2983498585397335, "in-drivable-lane": 14.899999999999984, "deviation-heading": 0.8518391764407385, "deviation-center-line": 0.14608553219979098}, "ep004": {"driven_any": 0.8507001356653012, "driven_lanedir": 0.3143855010633223, "in-drivable-lane": 13.233333333333288, "deviation-heading": 0.9745656457164904, "deviation-center-line": 0.14709453095890548}}
No reset possible 10233
479
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:57:40+00:00 2018-11-18 02:01:20+00:00 0:03:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10228
479
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 01:57:09+00:00 2018-11-18 01:57:31+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 15.43333333333329
other stats episodes details {"ep000": {"nsteps": 316, "reward": -6.694362660327667, "good_angle": 57.64487463278051, "survival_time": 10.533333333333308, "traveled_tiles": 1, "valid_direction": 10.399999999999972}, "ep001": {"nsteps": 500, "reward": -2.5161149753979406, "good_angle": 81.0376543603515, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 15.966666666666654}, "ep002": {"nsteps": 463, "reward": -4.7653772363159606, "good_angle": 19.282750215433236, "survival_time": 15.43333333333329, "traveled_tiles": 2, "valid_direction": 14.966666666666622}, "ep003": {"nsteps": 500, "reward": -2.7780723442053423, "good_angle": 12.031034218647056, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 16.199999999999985}, "ep004": {"nsteps": 454, "reward": -4.3911374833482, "good_angle": 6.754166297777159, "survival_time": 15.13333333333329, "traveled_tiles": 2, "valid_direction": 14.666666666666623}}good_angle_max 81.0376543603515 good_angle_mean 35.35009594499788 good_angle_median 19.282750215433236 good_angle_min 6.754166297777159 reward_max -2.5161149753979406 reward_mean -4.229012939919022 reward_median -4.3911374833482 reward_min -6.694362660327667 survival_time_max 16.666666666666654 survival_time_mean 14.886666666666638 survival_time_min 10.533333333333308 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 16.199999999999985 valid_direction_mean 14.439999999999973 valid_direction_median 14.966666666666622 valid_direction_min 10.399999999999972
No reset possible 10211
479
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:46:58+00:00 2018-11-18 01:57:02+00:00 0:10:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10209
480
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 01:46:17+00:00 2018-11-18 01:46:47+00:00 0:00:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: No module named distortions
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10206
482
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 01:45:33+00:00 2018-11-18 01:46:10+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: unbound method __init__() must be called with ObservationWrapper instance as first argument (got UndistortWrapper instance instead)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10187
490
Mandana Samiei 🇨🇦ROS-based Lane Following aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:42:31+00:00 2018-11-18 01:45:26+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10183
494
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step2-scoring aborted yes idsc-rudolf-18140
2018-11-18 01:42:08+00:00 2018-11-18 01:42:23+00:00 0:00:15 Error while running [...]
Creating job10183-5449_scorer_1 ... error
stderr | ERROR: for job10183-5449_scorer_1 Cannot start service scorer: network job10183-5449_evaluation not found
stderr |
stderr | ERROR: for scorer Cannot start service scorer: network job10183-5449_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10180
498
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step4-viz aborted yes idsc-rudolf-18140
2018-11-18 01:41:45+00:00 2018-11-18 01:42:00+00:00 0:00:15 Error while running [...]
Creating job10180-5007_visualization_1 ... error
stderr | ERROR: for job10180-5007_visualization_1 Cannot start service visualization: network job10180-5007_evaluation not found
stderr |
stderr | ERROR: for visualization Cannot start service visualization: network job10180-5007_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10174
498
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:40:13+00:00 2018-11-18 01:41:38+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10158
502
Liam Paull 🇨🇦Tensorflow template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 01:36:51+00:00 2018-11-18 01:40:06+00:00 0:03:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.176965747776464 deviation-center-line_median 0.5392367820639963 in-drivable-lane_median 0
other stats deviation-center-line_max 1.178028140676327 deviation-center-line_mean 0.6361231864346794 deviation-center-line_min 0.24801466543439213 deviation-heading_max 2.933357011087066 deviation-heading_mean 1.5031939640182812 deviation-heading_median 1.6784445577499594 deviation-heading_min 0.3078096120600184 driven_any_max 2.889379743962332 driven_any_mean 1.5333652672511588 driven_any_median 1.323416997902066 driven_any_min 0.35252349840349056 driven_lanedir_max 2.5840774511468547 driven_lanedir_mean 1.3669448964654074 driven_lanedir_min 0.3369860007938392 in-drivable-lane_max 0.7666666666666639 in-drivable-lane_mean 0.28666666666666607 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.2712292594336065, "driven_lanedir": 1.9166299693512645, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 2.933357011087066, "deviation-center-line": 0.7040900403146501}, "ep001": {"driven_any": 0.35252349840349056, "driven_lanedir": 0.3369860007938392, "in-drivable-lane": 0, "deviation-heading": 0.3078096120600184, "deviation-center-line": 0.24801466543439213}, "ep002": {"driven_any": 1.323416997902066, "driven_lanedir": 1.176965747776464, "in-drivable-lane": 0, "deviation-heading": 2.1538570627189197, "deviation-center-line": 0.5392367820639963}, "ep003": {"driven_any": 2.889379743962332, "driven_lanedir": 2.5840774511468547, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.6784445577499594, "deviation-center-line": 1.178028140676327}, "ep004": {"driven_any": 0.8302768365542986, "driven_lanedir": 0.8200653132586138, "in-drivable-lane": 0, "deviation-heading": 0.4425015764754437, "deviation-center-line": 0.5112463036840313}}
No reset possible 10155
502
Liam Paull 🇨🇦Tensorflow template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:35:49+00:00 2018-11-18 01:36:45+00:00 0:00:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10153
502
Liam Paull 🇨🇦Tensorflow template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 01:35:21+00:00 2018-11-18 01:35:42+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.733333333333316
other stats episodes details {"ep000": {"nsteps": 352, "reward": -2.972652845297654, "good_angle": 0.9435485787757228, "survival_time": 11.733333333333302, "traveled_tiles": 4, "valid_direction": 1.4666666666666617}, "ep001": {"nsteps": 70, "reward": -14.850869218366489, "good_angle": 0.15773340133636415, "survival_time": 2.333333333333335, "traveled_tiles": 1, "valid_direction": 0.2666666666666657}, "ep002": {"nsteps": 232, "reward": -4.485274965531627, "good_angle": 0.7989591448603707, "survival_time": 7.733333333333316, "traveled_tiles": 3, "valid_direction": 1.1666666666666623}, "ep003": {"nsteps": 500, "reward": -0.284857301548589, "good_angle": 0.31528647713212143, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.5999999999999979}, "ep004": {"nsteps": 173, "reward": -6.230304401389437, "good_angle": 0.12016554063972, "survival_time": 5.766666666666656, "traveled_tiles": 2, "valid_direction": 0.2666666666666657}}good_angle_max 0.9435485787757228 good_angle_mean 0.4671386285488598 good_angle_median 0.31528647713212143 good_angle_min 0.12016554063972 reward_max -0.284857301548589 reward_mean -5.764791746426758 reward_median -4.485274965531627 reward_min -14.850869218366489 survival_time_max 16.666666666666654 survival_time_mean 8.846666666666653 survival_time_min 2.333333333333335 traveled_tiles_max 6 traveled_tiles_mean 3.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.4666666666666617 valid_direction_mean 0.7533333333333306 valid_direction_median 0.5999999999999979 valid_direction_min 0.2666666666666657
No reset possible 10145
502
Liam Paull 🇨🇦Tensorflow template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:32:12+00:00 2018-11-18 01:35:14+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10135
515
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 01:27:56+00:00 2018-11-18 01:32:05+00:00 0:04:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.441346419252589 deviation-center-line_median 0.475443203904307 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.8928446787182662 deviation-center-line_mean 0.5409045380505465 deviation-center-line_min 0.292160150573776 deviation-heading_max 2.432001830566156 deviation-heading_mean 1.67843726333518 deviation-heading_median 1.613297174346244 deviation-heading_min 0.950089853554849 driven_any_max 1.9333785426469663 driven_any_mean 1.4061619423712286 driven_any_median 1.5063230723519694 driven_any_min 0.5357524764781381 driven_lanedir_max 1.9210683760128144 driven_lanedir_mean 1.340064019082472 driven_lanedir_min 0.5084034561928898 in-drivable-lane_max 1.066666666666667 in-drivable-lane_mean 0.23333333333333336 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.9333765079754035, "driven_lanedir": 1.7550904020885971, "in-drivable-lane": 1.066666666666667, "deviation-heading": 2.432001830566156, "deviation-center-line": 0.8928446787182662}, "ep001": {"driven_any": 0.5357524764781381, "driven_lanedir": 0.5084034561928898, "in-drivable-lane": 0, "deviation-heading": 0.950089853554849, "deviation-center-line": 0.4633403308133458}, "ep002": {"driven_any": 1.5063230723519694, "driven_lanedir": 1.441346419252589, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.3082848051836877, "deviation-center-line": 0.5807343262430376}, "ep003": {"driven_any": 1.9333785426469663, "driven_lanedir": 1.9210683760128144, "in-drivable-lane": 0, "deviation-heading": 1.0885126530249634, "deviation-center-line": 0.475443203904307}, "ep004": {"driven_any": 1.1219791124036649, "driven_lanedir": 1.0744114418654702, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.613297174346244, "deviation-center-line": 0.292160150573776}}
No reset possible 10130
515
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:26:39+00:00 2018-11-18 01:27:48+00:00 0:01:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10126
515
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 01:26:09+00:00 2018-11-18 01:26:28+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.999999999999964
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.194689963654615, "good_angle": 0.4609717757732299, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0.933333333333334}, "ep001": {"nsteps": 140, "reward": -7.67487527685506, "good_angle": 0.5334618295157368, "survival_time": 4.66666666666666, "traveled_tiles": 1, "valid_direction": 0.9999999999999964}, "ep002": {"nsteps": 390, "reward": -2.8082431686230196, "good_angle": 0.8056607639157276, "survival_time": 12.999999999999964, "traveled_tiles": 4, "valid_direction": 1.399999999999995}, "ep003": {"nsteps": 500, "reward": -0.11725767087766872, "good_angle": 0.032161736569720045, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 291, "reward": -3.549292758276408, "good_angle": 2.2099661417209053, "survival_time": 9.699999999999976, "traveled_tiles": 3, "valid_direction": 1.566666666666661}}good_angle_max 2.2099661417209053 good_angle_mean 0.808444449499064 good_angle_median 0.5334618295157368 good_angle_min 0.032161736569720045 reward_max -0.11725767087766872 reward_mean -2.868871767657354 reward_median -2.8082431686230196 reward_min -7.67487527685506 survival_time_max 16.666666666666654 survival_time_mean 12.13999999999998 survival_time_min 4.66666666666666 traveled_tiles_max 4 traveled_tiles_mean 3.2 traveled_tiles_median 4 traveled_tiles_min 1 valid_direction_max 1.566666666666661 valid_direction_mean 0.9799999999999972 valid_direction_median 0.9999999999999964 valid_direction_min 0
No reset possible 10116
515
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:23:21+00:00 2018-11-18 01:26:01+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10112
516
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 01:22:55+00:00 2018-11-18 01:23:15+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.333333333333334
other stats episodes details {"ep000": {"nsteps": 36, "reward": -28.044976969818688, "good_angle": 0.7666464469069899, "survival_time": 1.2000000000000004, "traveled_tiles": 1, "valid_direction": 1.0333333333333337}, "ep001": {"nsteps": 22, "reward": -46.008810850706965, "good_angle": 0.019661774370933752, "survival_time": 0.7333333333333333, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 40, "reward": -25.42171614915133, "good_angle": 0.03801718555044795, "survival_time": 1.333333333333334, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 45, "reward": -22.546772726045713, "good_angle": 0.06567918563705034, "survival_time": 1.500000000000001, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep004": {"nsteps": 46, "reward": -22.152781161925063, "good_angle": 0.03641383012341944, "survival_time": 1.5333333333333348, "traveled_tiles": 1, "valid_direction": 0}}good_angle_max 0.7666464469069899 good_angle_mean 0.18528368451776828 good_angle_median 0.03801718555044795 good_angle_min 0.019661774370933752 reward_max -22.152781161925063 reward_mean -28.835011571529556 reward_median -25.42171614915133 reward_min -46.008810850706965 survival_time_max 1.5333333333333348 survival_time_mean 1.260000000000001 survival_time_min 0.7333333333333333 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.0333333333333337 valid_direction_mean 0.21333333333333343 valid_direction_median 0 valid_direction_min 0
No reset possible 10103
525
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 01:21:04+00:00 2018-11-18 01:22:44+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.28977579066348724 deviation-center-line_median 0.2596306626838413 in-drivable-lane_median 0.8999999999999968
other stats deviation-center-line_max 0.3495269439274484 deviation-center-line_mean 0.2816719556808085 deviation-center-line_min 0.23084578070496203 deviation-heading_max 3.140638799446339 deviation-heading_mean 2.412886947725279 deviation-heading_median 2.769138296409296 deviation-heading_min 0.834297520530139 driven_any_max 0.7873202975740567 driven_any_mean 0.6419688580219205 driven_any_median 0.6009722981482444 driven_any_min 0.5823374982056604 driven_lanedir_max 0.34105884308565093 driven_lanedir_mean 0.3003442252313668 driven_lanedir_min 0.28535129762116584 in-drivable-lane_max 3.3333333333333277 in-drivable-lane_mean 1.3666666666666631 in-drivable-lane_min 0.7333333333333307 per-episodes details {"ep000": {"driven_any": 0.7873202975740567, "driven_lanedir": 0.28977579066348724, "in-drivable-lane": 3.3333333333333277, "deviation-heading": 0.834297520530139, "deviation-center-line": 0.3495269439274484}, "ep001": {"driven_any": 0.647559298004693, "driven_lanedir": 0.34105884308565093, "in-drivable-lane": 0.7333333333333307, "deviation-heading": 3.140638799446339, "deviation-center-line": 0.3138973423502348}, "ep002": {"driven_any": 0.6009722981482444, "driven_lanedir": 0.2978870322519669, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 2.769138296409296, "deviation-center-line": 0.254459048737556}, "ep003": {"driven_any": 0.5823374982056604, "driven_lanedir": 0.28535129762116584, "in-drivable-lane": 1.0333333333333297, "deviation-heading": 2.4218935945541102, "deviation-center-line": 0.23084578070496203}, "ep004": {"driven_any": 0.5916548981769478, "driven_lanedir": 0.28764816253456305, "in-drivable-lane": 0.8333333333333304, "deviation-heading": 2.89846652768651, "deviation-center-line": 0.2596306626838413}}
No reset possible 10095
525
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:19:32+00:00 2018-11-18 01:20:53+00:00 0:01:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10064
524
Anton Mashikhin 🇷🇺AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:13:40+00:00 2018-11-18 01:19:21+00:00 0:05:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10058
528
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LFV_r1-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 01:11:19+00:00 2018-11-18 01:13:33+00:00 0:02:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10057
528
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LFV_r1-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 01:10:48+00:00 2018-11-18 01:11:12+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.599999999999971
other stats episodes details {"ep000": {"nsteps": 176, "reward": -7.915465039024142, "good_angle": 11.390526656295732, "survival_time": 5.866666666666656, "traveled_tiles": 1, "valid_direction": 5.199999999999989}, "ep001": {"nsteps": 211, "reward": -4.9611815624630085, "good_angle": 1.399867232221524, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep002": {"nsteps": 318, "reward": -3.4529474489438443, "good_angle": 1.9488720024101256, "survival_time": 10.599999999999971, "traveled_tiles": 3, "valid_direction": 1.4666666666666617}, "ep003": {"nsteps": 386, "reward": -2.6256591085427643, "good_angle": 2.166939571478787, "survival_time": 12.866666666666632, "traveled_tiles": 4, "valid_direction": 1.533333333333328}, "ep004": {"nsteps": 369, "reward": -2.74263650648459, "good_angle": 2.162438495246906, "survival_time": 12.299999999999969, "traveled_tiles": 4, "valid_direction": 1.533333333333328}}good_angle_max 11.390526656295732 good_angle_mean 3.813728791530615 good_angle_median 2.162438495246906 good_angle_min 1.399867232221524 reward_max -2.6256591085427643 reward_mean -4.33957793309167 reward_median -3.4529474489438443 reward_min -7.915465039024142 survival_time_max 12.866666666666632 survival_time_mean 9.73333333333331 survival_time_min 5.866666666666656 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.199999999999989 valid_direction_mean 2.2399999999999936 valid_direction_median 1.533333333333328 valid_direction_min 1.4666666666666617
No reset possible 10052
528
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LFV_r1-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 01:06:31+00:00 2018-11-18 01:10:42+00:00 0:04:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10028
560
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LFV_r1-v3
step4-viz success no idsc-rudolf-18140
2018-11-18 01:00:43+00:00 2018-11-18 01:06:25+00:00 0:05:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.6966981932489035 in-drivable-lane_median 3.4333333333333567
other stats deviation-center-line_max 0.8396911967223216 deviation-center-line_mean 0.618579445562464 deviation-center-line_min 0.111235643799134 deviation-heading_max 2.871292479414406 deviation-heading_mean 2.1289509190319302 deviation-heading_median 2.2184872548011763 deviation-heading_min 0.9169930535457488 driven_any_max 1.933375680664721 driven_any_mean 1.7019888713055498 driven_any_median 1.9333739957688072 driven_any_min 0.7880917906528434 driven_lanedir_max 1.7005911978677994 driven_lanedir_mean 1.168578031825227 driven_lanedir_median 1.459353942030693 driven_lanedir_min 0.00953202253090346 in-drivable-lane_max 7.000000000000011 in-drivable-lane_mean 3.9533333333333487 in-drivable-lane_min 1.2666666666666924 per-episodes details {"ep000": {"driven_any": 0.7880917906528434, "driven_lanedir": 0.00953202253090346, "in-drivable-lane": 6.1666666666666545, "deviation-heading": 0.9169930535457488, "deviation-center-line": 0.111235643799134}, "ep001": {"driven_any": 1.9333739957688072, "driven_lanedir": 1.0342380330110823, "in-drivable-lane": 7.000000000000011, "deviation-heading": 2.426604799300448, "deviation-center-line": 0.6966981932489035}, "ep002": {"driven_any": 1.933375680664721, "driven_lanedir": 1.459353942030693, "in-drivable-lane": 3.4333333333333567, "deviation-heading": 2.871292479414406, "deviation-center-line": 0.66709367947772}, "ep003": {"driven_any": 1.921727714285188, "driven_lanedir": 1.7005911978677994, "in-drivable-lane": 1.2666666666666924, "deviation-heading": 2.211377008097873, "deviation-center-line": 0.8396911967223216}, "ep004": {"driven_any": 1.9333751751561896, "driven_lanedir": 1.6391749636856572, "in-drivable-lane": 1.9000000000000288, "deviation-heading": 2.2184872548011763, "deviation-center-line": 0.7781785145642409}}
No reset possible 10025
538
Jonathan Plante 🇨🇦Random execution aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:59:43+00:00 2018-11-18 01:00:31+00:00 0:00:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10013
555
Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LFV_r1-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:57:19+00:00 2018-11-18 00:59:37+00:00 0:02:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 203, "reward": -7.517153282177272, "good_angle": 18.773294719833164, "survival_time": 6.766666666666652, "traveled_tiles": 1, "valid_direction": 5.699999999999986}, "ep001": {"nsteps": 500, "reward": -0.9862548477053642, "good_angle": 15.15010660837492, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 4.6000000000000165}, "ep002": {"nsteps": 500, "reward": -0.36153481669770554, "good_angle": 17.143092288140753, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 4.099999999999985}, "ep003": {"nsteps": 497, "reward": -2.535689466121331, "good_angle": 16.606684416108454, "survival_time": 16.56666666666665, "traveled_tiles": 5, "valid_direction": 3.266666666666655}, "ep004": {"nsteps": 500, "reward": -0.38193090801686047, "good_angle": 16.47307776883877, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.566666666666654}}good_angle_max 18.773294719833164 good_angle_mean 16.82925116025921 good_angle_median 16.606684416108454 good_angle_min 15.15010660837492 reward_max -0.36153481669770554 reward_mean -2.356512664143706 reward_median -0.9862548477053642 reward_min -7.517153282177272 survival_time_max 16.666666666666654 survival_time_mean 14.666666666666652 survival_time_min 6.766666666666652 traveled_tiles_max 5 traveled_tiles_mean 4 traveled_tiles_median 5 traveled_tiles_min 1 valid_direction_max 5.699999999999986 valid_direction_mean 4.24666666666666 valid_direction_median 4.099999999999985 valid_direction_min 3.266666666666655
No reset possible 10012
543
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:56:51+00:00 2018-11-18 00:57:12+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.699999999999993
other stats episodes details {"ep000": {"nsteps": 141, "reward": -8.463073508747925, "good_angle": 0.8371806302206455, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 0.7333333333333318}, "ep001": {"nsteps": 141, "reward": -7.681345546373715, "good_angle": 12.792675556376697, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 3.4333333333333247}, "ep002": {"nsteps": 109, "reward": -10.430570920638807, "good_angle": 2.0212082943923804, "survival_time": 3.63333333333333, "traveled_tiles": 4, "valid_direction": 2.999999999999997}, "ep003": {"nsteps": 125, "reward": -8.698307935584337, "good_angle": 0.7952693358564087, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999998}, "ep004": {"nsteps": 500, "reward": -0.7987198795562145, "good_angle": 26.417648129773863, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.73333333333332}}good_angle_max 26.417648129773863 good_angle_mean 8.572796389324 good_angle_median 2.0212082943923804 good_angle_min 0.7952693358564087 reward_max -0.7987198795562145 reward_mean -7.2144035581802 reward_median -8.463073508747925 reward_min -10.430570920638807 survival_time_max 16.666666666666654 survival_time_mean 6.773333333333326 survival_time_min 3.63333333333333 traveled_tiles_max 8 traveled_tiles_mean 4.2 traveled_tiles_median 3 traveled_tiles_min 3 valid_direction_max 5.73333333333332 valid_direction_mean 2.8599999999999945 valid_direction_median 2.999999999999997 valid_direction_min 0.7333333333333318
No reset possible 9986
543
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 00:53:08+00:00 2018-11-18 00:56:43+00:00 0:03:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9979
552
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:51:05+00:00 2018-11-18 00:53:01+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9831727977496568 deviation-center-line_median 0.3672205081923034 in-drivable-lane_median 4.166666666666662
other stats deviation-center-line_max 0.3973635291194515 deviation-center-line_mean 0.27994419078557026 deviation-center-line_min 0.019250353138126345 deviation-heading_max 1.9674481045734984 deviation-heading_mean 0.8958297569628216 deviation-heading_median 0.7999999999999945 deviation-heading_min 0.2433808912349376 driven_any_max 3.17335318345451 driven_any_mean 1.9040619062808588 driven_any_median 1.482145043287037 driven_any_min 0.960597542999026 driven_lanedir_max 1.69057860582297 driven_lanedir_mean 0.9459349663317084 driven_lanedir_min 0.003223174585412991 in-drivable-lane_max 5.3666666666666485 in-drivable-lane_mean 3.079999999999991 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.4758617281633035, "driven_lanedir": 0.003223174585412991, "in-drivable-lane": 4.166666666666662, "deviation-heading": 0.2433808912349376, "deviation-center-line": 0.019250353138126345}, "ep001": {"driven_any": 1.482145043287037, "driven_lanedir": 1.1028251013162031, "in-drivable-lane": 0.8666666666666636, "deviation-heading": 1.9674481045734984, "deviation-center-line": 0.3973635291194515}, "ep002": {"driven_any": 2.4283520335004187, "driven_lanedir": 0.9831727977496568, "in-drivable-lane": 4.999999999999983, "deviation-heading": 1.1847280971323766, "deviation-center-line": 0.3672205081923034}, "ep003": {"driven_any": 3.17335318345451, "driven_lanedir": 1.69057860582297, "in-drivable-lane": 5.3666666666666485, "deviation-heading": 0.7999999999999945, "deviation-center-line": 0.3712317093005242}, "ep004": {"driven_any": 0.960597542999026, "driven_lanedir": 0.9498751521842984, "in-drivable-lane": 0, "deviation-heading": 0.2835916918733016, "deviation-center-line": 0.2446548541774459}}
No reset possible 9973
552
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:49:43+00:00 2018-11-18 00:50:58+00:00 0:01:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9972
552
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:49:14+00:00 2018-11-18 00:49:35+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.899999999999989
other stats episodes details {"ep000": {"nsteps": 131, "reward": -9.064354197442077, "good_angle": 0.9303220567558887, "survival_time": 4.366666666666661, "traveled_tiles": 3, "valid_direction": 1.099999999999997}, "ep001": {"nsteps": 177, "reward": -6.224365193707577, "good_angle": 11.05919640223386, "survival_time": 5.899999999999989, "traveled_tiles": 3, "valid_direction": 3.8999999999999906}, "ep002": {"nsteps": 251, "reward": -5.271373118566576, "good_angle": 3.0937542334432666, "survival_time": 8.366666666666648, "traveled_tiles": 5, "valid_direction": 3.4333333333333256}, "ep003": {"nsteps": 314, "reward": -4.755956446413829, "good_angle": 1.6312098446650494, "survival_time": 10.46666666666664, "traveled_tiles": 6, "valid_direction": 1.7999999999999936}, "ep004": {"nsteps": 83, "reward": -12.501483575048216, "good_angle": 0.14873306890204158, "survival_time": 2.7666666666666666, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}good_angle_max 11.05919640223386 good_angle_mean 3.372643121200022 good_angle_median 1.6312098446650494 good_angle_min 0.14873306890204158 reward_max -4.755956446413829 reward_mean -7.563506506235655 reward_median -6.224365193707577 reward_min -12.501483575048216 survival_time_max 10.46666666666664 survival_time_mean 6.373333333333321 survival_time_min 2.7666666666666666 traveled_tiles_max 6 traveled_tiles_mean 3.8 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.8999999999999906 valid_direction_mean 2.0933333333333275 valid_direction_median 1.7999999999999936 valid_direction_min 0.2333333333333325
No reset possible 9970
553
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step3-videos aborted yes idsc-rudolf-18140
2018-11-18 00:48:56+00:00 2018-11-18 00:49:08+00:00 0:00:12 Error while running [...]
Creating job9970-4056_videos_1 ... error
stderr | ERROR: for job9970-4056_videos_1 Cannot start service videos: network job9970-4056_evaluation not found
stderr |
stderr | ERROR: for videos Cannot start service videos: network job9970-4056_evaluation not found
stderr | Encountered errors while bringing up the project.
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9966
553
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:48:28+00:00 2018-11-18 00:48:48+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.833333333333322
other stats episodes details {"ep000": {"nsteps": 155, "reward": -8.335501825809478, "good_angle": 0.35247416523660835, "survival_time": 5.166666666666658, "traveled_tiles": 3, "valid_direction": 0.6333333333333322}, "ep001": {"nsteps": 188, "reward": -5.824763317005411, "good_angle": 11.940781384947671, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 3.999999999999988}, "ep002": {"nsteps": 102, "reward": -10.220616815561502, "good_angle": 2.502139831761016, "survival_time": 3.3999999999999977, "traveled_tiles": 2, "valid_direction": 1.7666666666666626}, "ep003": {"nsteps": 175, "reward": -6.363159887939691, "good_angle": 0.969941746031617, "survival_time": 5.833333333333322, "traveled_tiles": 3, "valid_direction": 1.03333333333333}, "ep004": {"nsteps": 500, "reward": -0.6525341186731238, "good_angle": 25.14615760888846, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 3.833333333333321}}good_angle_max 25.14615760888846 good_angle_mean 8.182298947373074 good_angle_median 2.502139831761016 good_angle_min 0.35247416523660835 reward_max -0.6525341186731238 reward_mean -6.279315192997841 reward_median -6.363159887939691 reward_min -10.220616815561502 survival_time_max 16.666666666666654 survival_time_mean 7.466666666666657 survival_time_min 3.3999999999999977 traveled_tiles_max 9 traveled_tiles_mean 4 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.999999999999988 valid_direction_mean 2.2533333333333267 valid_direction_median 1.7666666666666626 valid_direction_min 0.6333333333333322
No reset possible 9955
553
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 00:43:58+00:00 2018-11-18 00:48:20+00:00 0:04:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9946
563
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 00:41:38+00:00 2018-11-18 00:43:52+00:00 0:02:14 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9940
568
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 00:40:24+00:00 2018-11-18 00:41:31+00:00 0:01:07 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9923
582
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:36:58+00:00 2018-11-18 00:40:17+00:00 0:03:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9383190694439334 deviation-center-line_median 0.7240131484038275 in-drivable-lane_median 3.73333333333332
other stats deviation-center-line_max 1.9619654491777856 deviation-center-line_mean 0.7753943411997068 deviation-center-line_min 0 deviation-heading_max 3.793329521177811 deviation-heading_mean 1.8795327391597776 deviation-heading_median 1.3995957880828112 deviation-heading_min 0 driven_any_max 2.3535470851994265 driven_any_mean 1.6708180301707751 driven_any_median 1.686390230302575 driven_any_min 0.9052097758720424 driven_lanedir_max 2.2058171493534338 driven_lanedir_mean 0.944658395699251 driven_lanedir_min 0 in-drivable-lane_max 11.066666666666638 in-drivable-lane_mean 4.779999999999989 in-drivable-lane_min 0.4000000000000199 per-episodes details {"ep000": {"driven_any": 1.655856637073334, "driven_lanedir": 0, "in-drivable-lane": 11.066666666666638, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 1.686390230302575, "driven_lanedir": 1.1126443406905695, "in-drivable-lane": 3.73333333333332, "deviation-heading": 3.0064294534060703, "deviation-center-line": 0.7240131484038275}, "ep002": {"driven_any": 0.9052097758720424, "driven_lanedir": 0.4665114190083184, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 1.3995957880828112, "deviation-center-line": 0.32430418341812345}, "ep003": {"driven_any": 1.753086422406498, "driven_lanedir": 0.9383190694439334, "in-drivable-lane": 5.79999999999998, "deviation-heading": 1.1983089331321926, "deviation-center-line": 0.8666889249987981}, "ep004": {"driven_any": 2.3535470851994265, "driven_lanedir": 2.2058171493534338, "in-drivable-lane": 0.4000000000000199, "deviation-heading": 3.793329521177811, "deviation-center-line": 1.9619654491777856}}
No reset possible 9912
582
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:35:16+00:00 2018-11-18 00:36:51+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9909
580
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:33:58+00:00 2018-11-18 00:35:10+00:00 0:01:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9897
573
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 00:31:41+00:00 2018-11-18 00:33:51+00:00 0:02:10 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9895
575
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 00:30:56+00:00 2018-11-18 00:31:34+00:00 0:00:38 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'omega' referenced before assignment
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9891
576
Jonathan Plante 🇨🇦JP pipeline aido1_LF1_r3-v3
step1-simulation failed no idsc-rudolf-18140
2018-11-18 00:29:46+00:00 2018-11-18 00:30:49+00:00 0:01:03 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 63, in run
raise InvalidSubmission(str(e))
InvalidSubmission: expected non-empty vector for x
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9885
590
Allen Ou Tensorflow template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:26:44+00:00 2018-11-18 00:29:39+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1802755024585134 deviation-center-line_median 0.5754096123679283 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 1.1831827320618895 deviation-center-line_mean 0.6341360178813958 deviation-center-line_min 0.22474959476747397 deviation-heading_max 2.6463413950694106 deviation-heading_mean 1.4716556367984308 deviation-heading_median 1.655338948591104 deviation-heading_min 0.24402069512793112 driven_any_max 2.888481976798732 driven_any_mean 1.5185948664746167 driven_any_median 1.3336938584292013 driven_any_min 0.3169846704443646 driven_lanedir_max 2.5715150173412997 driven_lanedir_mean 1.34575575171303 driven_lanedir_min 0.30535009450292927 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.3133333333333327 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.267982984756009, "driven_lanedir": 1.8912094979622496, "in-drivable-lane": 0.7333333333333332, "deviation-heading": 2.6463413950694106, "deviation-center-line": 0.7006105605048246}, "ep001": {"driven_any": 0.3169846704443646, "driven_lanedir": 0.30535009450292927, "in-drivable-lane": 0, "deviation-heading": 0.24402069512793112, "deviation-center-line": 0.22474959476747397}, "ep002": {"driven_any": 1.3336938584292013, "driven_lanedir": 1.1802755024585134, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.4607810007432205, "deviation-center-line": 0.5754096123679283}, "ep003": {"driven_any": 2.888481976798732, "driven_lanedir": 2.5715150173412997, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 1.655338948591104, "deviation-center-line": 1.1831827320618895}, "ep004": {"driven_any": 0.7858308419447766, "driven_lanedir": 0.7804286463001577, "in-drivable-lane": 0, "deviation-heading": 0.35179614446048796, "deviation-center-line": 0.4867275897048623}}
No reset possible 9877
590
Allen Ou Tensorflow template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:25:35+00:00 2018-11-18 00:26:36+00:00 0:01:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9874
590
Allen Ou Tensorflow template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:25:06+00:00 2018-11-18 00:25:24+00:00 0:00:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.533333333333314
other stats episodes details {"ep000": {"nsteps": 355, "reward": -2.9481367096754156, "good_angle": 0.8206651183447821, "survival_time": 11.833333333333302, "traveled_tiles": 4, "valid_direction": 1.2666666666666622}, "ep001": {"nsteps": 65, "reward": -15.93245312479826, "good_angle": 0.12829365307601664, "survival_time": 2.1666666666666687, "traveled_tiles": 1, "valid_direction": 0.1999999999999993}, "ep002": {"nsteps": 256, "reward": -4.076980934218227, "good_angle": 0.8928199947802034, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 1.4999999999999956}, "ep003": {"nsteps": 500, "reward": -0.28626655193418266, "good_angle": 0.33400722083424306, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.6666666666666643}, "ep004": {"nsteps": 170, "reward": -6.313724986419958, "good_angle": 0.060537386068120175, "survival_time": 5.666666666666656, "traveled_tiles": 2, "valid_direction": 0.09999999999999964}}good_angle_max 0.8928199947802034 good_angle_mean 0.44726467462067304 good_angle_median 0.33400722083424306 good_angle_min 0.060537386068120175 reward_max -0.28626655193418266 reward_mean -5.91151246140921 reward_median -4.076980934218227 reward_min -15.93245312479826 survival_time_max 16.666666666666654 survival_time_mean 8.973333333333319 survival_time_min 2.1666666666666687 traveled_tiles_max 6 traveled_tiles_mean 3.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.4999999999999956 valid_direction_mean 0.7466666666666641 valid_direction_median 0.6666666666666643 valid_direction_min 0.09999999999999964
No reset possible 9869
592
Liu Sam 🇹🇼PyTorch template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:24:38+00:00 2018-11-18 00:24:57+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.799999999999989
other stats episodes details {"ep000": {"nsteps": 76, "reward": -13.400087172387622, "good_angle": 1.3142241469019869, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.1333333333333337}, "ep001": {"nsteps": 52, "reward": -19.78199272660109, "good_angle": 0.08163371101430023, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 229, "reward": -4.757955190636407, "good_angle": 2.1314649418355702, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 4.099999999999986}, "ep003": {"nsteps": 229, "reward": -5.533671027996504, "good_angle": 1.1018644129241444, "survival_time": 7.633333333333316, "traveled_tiles": 3, "valid_direction": 5.399999999999981}, "ep004": {"nsteps": 174, "reward": -6.955468747807645, "good_angle": 1.4543242829737104, "survival_time": 5.799999999999989, "traveled_tiles": 2, "valid_direction": 4.866666666666656}}good_angle_max 2.1314649418355702 good_angle_mean 1.2167022991299423 good_angle_median 1.3142241469019869 good_angle_min 0.08163371101430023 reward_max -4.757955190636407 reward_mean -10.085834973085852 reward_median -6.955468747807645 reward_min -19.78199272660109 survival_time_max 7.633333333333316 survival_time_mean 5.0666666666666575 survival_time_min 1.7333333333333354 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.399999999999981 valid_direction_mean 3.2999999999999914 valid_direction_median 4.099999999999986 valid_direction_min 0
No reset possible 9860
592
Liu Sam 🇹🇼PyTorch template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 00:21:40+00:00 2018-11-18 00:24:31+00:00 0:02:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9841
606
Samuel Lavoie PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:19:36+00:00 2018-11-18 00:21:33+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5166925639708038 deviation-center-line_median 0.2302817963673843 in-drivable-lane_median 0.6
other stats deviation-center-line_max 0.8590517130551906 deviation-center-line_mean 0.3647794293193752 deviation-center-line_min 0.1766154612705062 deviation-heading_max 5.05737131005766 deviation-heading_mean 1.6976848703126368 deviation-heading_median 0.9391534539036354 deviation-heading_min 0.19166106732704172 driven_any_max 2.60680515540643 driven_any_mean 0.981672501989357 driven_any_median 0.7271008193689704 driven_any_min 0.2167661398628974 driven_lanedir_max 1.217647358427854 driven_lanedir_mean 0.5599642324470806 driven_lanedir_min 0.13437413629629913 in-drivable-lane_max 7.899999999999972 in-drivable-lane_mean 2.339999999999992 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.35230213828487744, "driven_lanedir": 0.13437413629629913, "in-drivable-lane": 0.6, "deviation-heading": 1.7866760708844476, "deviation-center-line": 0.18475698018777356}, "ep001": {"driven_any": 0.2167661398628974, "driven_lanedir": 0.2140501790212612, "in-drivable-lane": 0, "deviation-heading": 0.19166106732704172, "deviation-center-line": 0.1766154612705062}, "ep002": {"driven_any": 2.60680515540643, "driven_lanedir": 1.217647358427854, "in-drivable-lane": 7.899999999999972, "deviation-heading": 5.05737131005766, "deviation-center-line": 0.8590517130551906}, "ep003": {"driven_any": 0.7271008193689704, "driven_lanedir": 0.7170569245191847, "in-drivable-lane": 0, "deviation-heading": 0.5135624493903992, "deviation-center-line": 0.3731911957160216}, "ep004": {"driven_any": 1.0053882570236092, "driven_lanedir": 0.5166925639708038, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.9391534539036354, "deviation-center-line": 0.2302817963673843}}
No reset possible 9829
613
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:17:38+00:00 2018-11-18 00:19:29+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5661020704594424 deviation-center-line_median 0.2740354783309631 in-drivable-lane_median 3.266666666666655
other stats deviation-center-line_max 0.5603588606390013 deviation-center-line_mean 0.3120589482029849 deviation-center-line_min 0.19846746065156567 deviation-heading_max 3.214183416776645 deviation-heading_mean 1.6059425773309546 deviation-heading_median 1.2834201828497314 deviation-heading_min 0.8871462076947535 driven_any_max 1.3560961776989535 driven_any_mean 1.04737111715508 driven_any_median 1.1251706898040728 driven_any_min 0.3746769082831119 driven_lanedir_max 0.6715017430237435 driven_lanedir_mean 0.5148131075456355 driven_lanedir_min 0.15612622869521509 in-drivable-lane_max 4.799999999999983 in-drivable-lane_mean 2.99999999999999 in-drivable-lane_min 0.5333333333333333 per-episodes details {"ep000": {"driven_any": 0.3746769082831119, "driven_lanedir": 0.15612622869521509, "in-drivable-lane": 0.5333333333333333, "deviation-heading": 1.7338392601903574, "deviation-center-line": 0.19846746065156567}, "ep001": {"driven_any": 1.1251706898040728, "driven_lanedir": 0.6292605959907072, "in-drivable-lane": 2.8666666666666565, "deviation-heading": 1.2834201828497314, "deviation-center-line": 0.3138953503935618}, "ep002": {"driven_any": 1.3560961776989535, "driven_lanedir": 0.6715017430237435, "in-drivable-lane": 3.266666666666655, "deviation-heading": 3.214183416776645, "deviation-center-line": 0.5603588606390013}, "ep003": {"driven_any": 1.2984217247544845, "driven_lanedir": 0.5510748995590697, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.911123819143286, "deviation-center-line": 0.2740354783309631}, "ep004": {"driven_any": 1.0824900852347763, "driven_lanedir": 0.5661020704594424, "in-drivable-lane": 3.533333333333321, "deviation-heading": 0.8871462076947535, "deviation-center-line": 0.21353759099983263}}
No reset possible 9826
607
Samuel Lavoie PyTorch template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:17:08+00:00 2018-11-18 00:17:29+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.766666666666652
other stats episodes details {"ep000": {"nsteps": 74, "reward": -13.787438218072811, "good_angle": 1.119777471345656, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.9333333333333345}, "ep001": {"nsteps": 203, "reward": -6.593767599032944, "good_angle": 18.49659831115776, "survival_time": 6.766666666666652, "traveled_tiles": 2, "valid_direction": 5.2666666666666515}, "ep002": {"nsteps": 225, "reward": -4.836047241100006, "good_angle": 2.099535963172931, "survival_time": 7.499999999999983, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep003": {"nsteps": 231, "reward": -5.5219402299282745, "good_angle": 1.026867242839075, "survival_time": 7.699999999999982, "traveled_tiles": 3, "valid_direction": 5.599999999999982}, "ep004": {"nsteps": 188, "reward": -6.54944158991504, "good_angle": 1.5930068507168955, "survival_time": 6.266666666666654, "traveled_tiles": 2, "valid_direction": 4.899999999999986}}good_angle_max 18.49659831115776 good_angle_mean 4.867157167846463 good_angle_median 1.5930068507168955 good_angle_min 1.026867242839075 reward_max -4.836047241100006 reward_mean -7.457726975609816 reward_median -6.54944158991504 reward_min -13.787438218072811 survival_time_max 7.699999999999982 survival_time_mean 6.139999999999988 survival_time_min 2.4666666666666677 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.599999999999982 valid_direction_mean 4.319999999999988 valid_direction_median 4.899999999999986 valid_direction_min 1.9333333333333345
No reset possible 9817
611
David Abraham Random execution aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:15:36+00:00 2018-11-18 00:17:01+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9812
611
David Abraham Random execution aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:15:08+00:00 2018-11-18 00:15:29+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.6999999999999895
other stats episodes details {"ep000": {"nsteps": 79, "reward": -12.92334378996416, "good_angle": 1.2860110947254035, "survival_time": 2.6333333333333337, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 63, "reward": -16.439583957668336, "good_angle": 0.01455387420995444, "survival_time": 2.1000000000000023, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 171, "reward": -6.293316102341602, "good_angle": 0.04582194768596806, "survival_time": 5.6999999999999895, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 456, "reward": -2.247400954376708, "good_angle": 1.7582262547504697, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 2.299999999999992}, "ep004": {"nsteps": 344, "reward": -3.55477666423851, "good_angle": 18.893290685764693, "survival_time": 11.466666666666637, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 18.893290685764693 good_angle_mean 4.399580771427297 good_angle_median 1.2860110947254035 good_angle_min 0.01455387420995444 reward_max -2.247400954376708 reward_mean -8.291684293717863 reward_median -6.293316102341602 reward_min -16.439583957668336 survival_time_max 15.199999999999957 survival_time_mean 7.419999999999985 survival_time_min 2.1000000000000023 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 1.6999999999999955 valid_direction_median 2.2333333333333334 valid_direction_min 0
No reset possible 9805
611
David Abraham Random execution aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 00:12:23+00:00 2018-11-18 00:15:02+00:00 0:02:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9794
616
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:10:27+00:00 2018-11-18 00:12:16+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5250709193177174 deviation-center-line_median 0.2556973600975583 in-drivable-lane_median 3.066666666666656
other stats deviation-center-line_max 0.6143296719023782 deviation-center-line_mean 0.33376954739821685 deviation-center-line_min 0.1642583397836546 deviation-heading_max 4.27947587994958 deviation-heading_mean 2.058809599902401 deviation-heading_median 1.9218451548887905 deviation-heading_min 0.8852028205539008 driven_any_max 1.2737737203338624 driven_any_mean 0.989022824867824 driven_any_median 1.1280364621627208 driven_any_min 0.3473602189962636 driven_lanedir_max 0.7238885910052046 driven_lanedir_mean 0.509742936471809 driven_lanedir_min 0.1186094684650233 in-drivable-lane_max 3.9333333333333194 in-drivable-lane_mean 2.3199999999999923 in-drivable-lane_min 0.5666666666666647 per-episodes details {"ep000": {"driven_any": 0.3473602189962636, "driven_lanedir": 0.1186094684650233, "in-drivable-lane": 0.7, "deviation-heading": 1.9218451548887905, "deviation-center-line": 0.1642583397836546}, "ep001": {"driven_any": 1.1280364621627208, "driven_lanedir": 0.7238885910052046, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.27947587994958, "deviation-center-line": 0.6143296719023782}, "ep002": {"driven_any": 1.2737737203338624, "driven_lanedir": 0.6765251412198185, "in-drivable-lane": 3.066666666666656, "deviation-heading": 2.2145363677736527, "deviation-center-line": 0.39217382596932027}, "ep003": {"driven_any": 1.1563411371643584, "driven_lanedir": 0.5250709193177174, "in-drivable-lane": 3.9333333333333194, "deviation-heading": 0.8852028205539008, "deviation-center-line": 0.2556973600975583}, "ep004": {"driven_any": 1.0396025856819144, "driven_lanedir": 0.5046205623512812, "in-drivable-lane": 3.3333333333333215, "deviation-heading": 0.9929877763460834, "deviation-center-line": 0.24238853923817305}}
No reset possible 9793
616
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:09:21+00:00 2018-11-18 00:10:21+00:00 0:01:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9784
623
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:07:17+00:00 2018-11-18 00:09:15+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.6771302486299837 deviation-center-line_median 0.4069244650493848 in-drivable-lane_median 3.0333333333333226
other stats deviation-center-line_max 0.5717517583743436 deviation-center-line_mean 0.3795060526977586 deviation-center-line_min 0.1931257746045532 deviation-heading_max 3.1718159400981114 deviation-heading_mean 1.9065801222515797 deviation-heading_median 2.000091925471767 deviation-heading_min 0.9151100333383154 driven_any_max 1.4299641173590594 driven_any_mean 1.0657856652780648 driven_any_median 1.186299182960599 driven_any_min 0.3435133543707523 driven_lanedir_max 0.8857982064863736 driven_lanedir_mean 0.5980372925376503 driven_lanedir_min 0.11205669080070256 in-drivable-lane_max 4.099999999999985 in-drivable-lane_mean 2.353333333333326 in-drivable-lane_min 0.6666666666666643 per-episodes details {"ep000": {"driven_any": 0.3435133543707523, "driven_lanedir": 0.11205669080070256, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 2.000091925471767, "deviation-center-line": 0.1931257746045532}, "ep001": {"driven_any": 1.096941413846466, "driven_lanedir": 0.7224239149767802, "in-drivable-lane": 0.6666666666666643, "deviation-heading": 3.1718159400981114, "deviation-center-line": 0.5717517583743436}, "ep002": {"driven_any": 1.272210257853448, "driven_lanedir": 0.6771302486299837, "in-drivable-lane": 3.0333333333333226, "deviation-heading": 2.338189048072027, "deviation-center-line": 0.43475856496634896}, "ep003": {"driven_any": 1.186299182960599, "driven_lanedir": 0.5927774017944114, "in-drivable-lane": 4.099999999999985, "deviation-heading": 0.9151100333383154, "deviation-center-line": 0.29096970049416276}, "ep004": {"driven_any": 1.4299641173590594, "driven_lanedir": 0.8857982064863736, "in-drivable-lane": 3.2333333333333227, "deviation-heading": 1.107693664277678, "deviation-center-line": 0.4069244650493848}}
No reset possible 9783
623
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-18 00:05:45+00:00 2018-11-18 00:07:11+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9781
623
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-18 00:05:16+00:00 2018-11-18 00:05:37+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.36666666666665
other stats episodes details {"ep000": {"nsteps": 76, "reward": -13.405452955293615, "good_angle": 1.2139051963793814, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 2.000000000000001}, "ep001": {"nsteps": 198, "reward": -6.283026755683952, "good_angle": 11.315300692667604, "survival_time": 6.599999999999986, "traveled_tiles": 2, "valid_direction": 3.3333333333333215}, "ep002": {"nsteps": 228, "reward": -4.947113494722688, "good_angle": 2.7312966536069982, "survival_time": 7.599999999999983, "traveled_tiles": 3, "valid_direction": 4.666666666666655}, "ep003": {"nsteps": 221, "reward": -5.769975510286799, "good_angle": 1.173055412130904, "survival_time": 7.36666666666665, "traveled_tiles": 3, "valid_direction": 5.36666666666665}, "ep004": {"nsteps": 260, "reward": -4.8838148414605085, "good_angle": 13.222013377919655, "survival_time": 8.666666666666647, "traveled_tiles": 3, "valid_direction": 3.599999999999988}}good_angle_max 13.222013377919655 good_angle_mean 5.9311142665409085 good_angle_median 2.7312966536069982 good_angle_min 1.173055412130904 reward_max -4.8838148414605085 reward_mean -7.057876711489511 reward_median -5.769975510286799 reward_min -13.405452955293615 survival_time_max 8.666666666666647 survival_time_mean 6.553333333333319 survival_time_min 2.533333333333334 traveled_tiles_max 3 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.36666666666665 valid_direction_mean 3.7933333333333232 valid_direction_median 3.599999999999988 valid_direction_min 2.000000000000001
No reset possible 9767
623
Laurent Mandrile PyTorch template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-18 00:02:26+00:00 2018-11-18 00:05:09+00:00 0:02:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9758
629
Samuel Lavoie PyTorch template aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-18 00:00:11+00:00 2018-11-18 00:02:18+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7013652812302966 deviation-center-line_median 0.32650281262845576 in-drivable-lane_median 1.233333333333329
other stats deviation-center-line_max 0.531647420231844 deviation-center-line_mean 0.35492870222705536 deviation-center-line_min 0.18179657501427013 deviation-heading_max 3.908798573221953 deviation-heading_mean 2.065308947946612 deviation-heading_median 1.6217999883349208 deviation-heading_min 0.906093019712902 driven_any_max 1.4497804061594632 driven_any_mean 1.0402889767672645 driven_any_median 1.1193479216509026 driven_any_min 0.4010653447999526 driven_lanedir_max 0.8820297295817688 driven_lanedir_mean 0.5966891209714047 driven_lanedir_min 0.1863940249753766 in-drivable-lane_max 4.699999999999984 in-drivable-lane_mean 1.9533333333333267 in-drivable-lane_min 0.46666666666666695 per-episodes details {"ep000": {"driven_any": 0.4010653447999526, "driven_lanedir": 0.1863940249753766, "in-drivable-lane": 0.46666666666666695, "deviation-heading": 1.6217999883349208, "deviation-center-line": 0.18179657501427013}, "ep001": {"driven_any": 1.1193479216509026, "driven_lanedir": 0.7013652812302966, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.908798573221953, "deviation-center-line": 0.531647420231844}, "ep002": {"driven_any": 1.2538459073284771, "driven_lanedir": 0.8820297295817688, "in-drivable-lane": 1.233333333333329, "deviation-heading": 2.837983715998678, "deviation-center-line": 0.47874800960423586}, "ep003": {"driven_any": 1.4497804061594632, "driven_lanedir": 0.7224644012027293, "in-drivable-lane": 4.699999999999984, "deviation-heading": 0.906093019712902, "deviation-center-line": 0.32650281262845576}, "ep004": {"driven_any": 0.9774053038975272, "driven_lanedir": 0.4911921678668522, "in-drivable-lane": 2.5666666666666575, "deviation-heading": 1.0518694424646071, "deviation-center-line": 0.255948693656471}}
No reset possible 9757
626
Yun Chen 🇨🇦PyTorch template aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-17 23:59:38+00:00 2018-11-18 00:00:00+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.8666666666666663
other stats episodes details {"ep000": {"nsteps": 75, "reward": -13.594147127090643, "good_angle": 1.1853772977391637, "survival_time": 2.500000000000001, "traveled_tiles": 1, "valid_direction": 2.0666666666666673}, "ep001": {"nsteps": 55, "reward": -18.773121839219872, "good_angle": 0.117414489762818, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.20000000000000065}, "ep002": {"nsteps": 234, "reward": -4.85179854529058, "good_angle": 3.08135221103936, "survival_time": 7.799999999999982, "traveled_tiles": 4, "valid_direction": 5.533333333333317}, "ep003": {"nsteps": 86, "reward": -11.964551168125729, "good_angle": 0.1257789332817162, "survival_time": 2.8666666666666663, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 150, "reward": -7.666139459673237, "good_angle": 1.6286658963624736, "survival_time": 4.999999999999992, "traveled_tiles": 2, "valid_direction": 3.6999999999999913}}good_angle_max 3.08135221103936 good_angle_mean 1.2277177656371063 good_angle_median 1.1853772977391637 good_angle_min 0.117414489762818 reward_max -4.85179854529058 reward_mean -11.369951627880011 reward_median -11.964551168125729 reward_min -18.773121839219872 survival_time_max 7.799999999999982 survival_time_mean 3.999999999999995 survival_time_min 1.8333333333333357 traveled_tiles_max 4 traveled_tiles_mean 1.8 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 5.533333333333317 valid_direction_mean 2.299999999999995 valid_direction_median 2.0666666666666673 valid_direction_min 0
No reset possible 9746
626
Yun Chen 🇨🇦PyTorch template aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-17 23:56:44+00:00 2018-11-17 23:59:31+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9744
638
Mandana Samiei 🇨🇦ROS-based Lane Following aido1_LF1_r3-v3
step4-viz success yes idsc-rudolf-18140
2018-11-17 23:55:01+00:00 2018-11-17 23:56:38+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.21923036405021623 deviation-center-line_median 0.20114689017621745 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3546401261611177 deviation-center-line_mean 0.21980283196756345 deviation-center-line_min 0.06591220891092249 deviation-heading_max 1.7687127694435452 deviation-heading_mean 0.8225879697570478 deviation-heading_median 0.6226670365945953 deviation-heading_min 0.3813831367755872 driven_any_max 0.8000211011153562 driven_any_mean 0.3442917560405993 driven_any_median 0.23929191808567157 driven_any_min 0.06070626051022837 driven_lanedir_max 0.5594855386288404 driven_lanedir_mean 0.2828160478778809 driven_lanedir_min 0.045800167389093094 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.8000211011153562, "driven_lanedir": 0.5594855386288404, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.7687127694435452, "deviation-center-line": 0.3546401261611177}, "ep001": {"driven_any": 0.06070626051022837, "driven_lanedir": 0.045800167389093094, "in-drivable-lane": 0, "deviation-heading": 0.3813831367755872, "deviation-center-line": 0.06591220891092249}, "ep002": {"driven_any": 0.1678486433668507, "driven_lanedir": 0.14951999504293156, "in-drivable-lane": 0, "deviation-heading": 0.5769794251031379, "deviation-center-line": 0.13499007845450084}, "ep003": {"driven_any": 0.4535908571248896, "driven_lanedir": 0.4400441742783232, "in-drivable-lane": 0, "deviation-heading": 0.7631974808683735, "deviation-center-line": 0.3423248561350588}, "ep004": {"driven_any": 0.23929191808567157, "driven_lanedir": 0.21923036405021623, "in-drivable-lane": 0, "deviation-heading": 0.6226670365945953, "deviation-center-line": 0.20114689017621745}}
No reset possible 9740
638
Mandana Samiei 🇨🇦ROS-based Lane Following aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-17 23:54:04+00:00 2018-11-17 23:54:55+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9732
642
Mikita Sazanovich 🇷🇺Random execution aido1_LF1_r3-v3
step3-videos success yes idsc-rudolf-18140
2018-11-17 23:53:04+00:00 2018-11-17 23:53:56+00:00 0:00:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 9730
642
Mikita Sazanovich 🇷🇺Random execution aido1_LF1_r3-v3
step2-scoring success yes idsc-rudolf-18140
2018-11-17 23:52:36+00:00 2018-11-17 23:52:57+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.266666666666654
other stats episodes details {"ep000": {"nsteps": 80, "reward": -12.74193479833193, "good_angle": 1.2125596404295538, "survival_time": 2.666666666666667, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 52, "reward": -19.79740259395196, "good_angle": 0.02008840683930248, "survival_time": 1.7333333333333354, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 188, "reward": -5.721608808383029, "good_angle": 0.12034214678637478, "survival_time": 6.266666666666654, "traveled_tiles": 3, "valid_direction": 0.2666666666666657}, "ep003": {"nsteps": 456, "reward": -2.375910223140524, "good_angle": 1.0182056404675923, "survival_time": 15.199999999999957, "traveled_tiles": 4, "valid_direction": 1.9666666666666597}, "ep004": {"nsteps": 343, "reward": -3.556067698073109, "good_angle": 17.709997021722945, "survival_time": 11.433333333333303, "traveled_tiles": 3, "valid_direction": 3.899999999999987}}good_angle_max 17.709997021722945 good_angle_mean 4.016238571249153 good_angle_median 1.0182056404675923 good_angle_min 0.02008840683930248 reward_max -2.375910223140524 reward_mean -8.83858482437611 reward_median -5.721608808383029 reward_min -19.79740259395196 survival_time_max 15.199999999999957 survival_time_mean 7.459999999999984 survival_time_min 1.7333333333333354 traveled_tiles_max 4 traveled_tiles_mean 2.4 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.899999999999987 valid_direction_mean 1.6733333333333291 valid_direction_median 1.9666666666666597 valid_direction_min 0
No reset possible 9723
642
Mikita Sazanovich 🇷🇺Random execution aido1_LF1_r3-v3
step1-simulation success no idsc-rudolf-18140
2018-11-17 23:50:31+00:00 2018-11-17 23:52:29+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible