Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 5939786Marta Tintore AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success no rudolf-82018-11-07 15:38:16+00:00 2018-11-07 15:39:03+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5930800Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation aborted no rudolf-82018-11-07 15:13:30+00:00 2018-11-07 15:16:23+00:00 0:02:53 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 118, in run
solve(params, cis)
File "solution.py", line 83, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/wrappers.py", line 89, in step
ob, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5927799Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos aborted no rudolf-82018-11-07 13:53:23+00:00 2018-11-07 13:54:28+00:00 0:01:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5918798Luca Bonamini Random execution aido1_LF1_r3-v3step2-scoring success no rudolf-82018-11-07 13:38:33+00:00 2018-11-07 13:38:49+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.999999999999979
other stats episodes details {"ep000": {"nsteps": 171, "reward": -7.729742120232499, "good_angle": 25.07383215378148, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9333333333333207}, "ep001": {"nsteps": 382, "reward": -4.457744235767744, "good_angle": 24.218758506416364, "survival_time": 12.7333333333333, "traveled_tiles": 3, "valid_direction": 4.066666666666652}, "ep002": {"nsteps": 338, "reward": -3.039140198254471, "good_angle": 0.1268074882377727, "survival_time": 11.266666666666636, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 258, "reward": -6.04335063233856, "good_angle": 27.571145449058, "survival_time": 8.59999999999998, "traveled_tiles": 3, "valid_direction": 3.93333333333332}, "ep004": {"nsteps": 270, "reward": -5.542087158836701, "good_angle": 4.78818581978914, "survival_time": 8.999999999999979, "traveled_tiles": 3, "valid_direction": 2.9999999999999902}}good_angle_max 27.571145449058 good_angle_mean 16.355745883456553 good_angle_median 24.218758506416364 good_angle_min 0.1268074882377727 reward_max -3.039140198254471 reward_mean -5.362412869085995 reward_median -5.542087158836701 reward_min -7.729742120232499 survival_time_max 12.7333333333333 survival_time_mean 9.459999999999976 survival_time_min 5.6999999999999895 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 4.066666666666652 valid_direction_mean 2.9866666666666566 valid_direction_median 3.93333333333332 valid_direction_min 0
No reset possible 5909795Andrea Censi Random execution aido1_LF1_r3-v3step3-videos success no rudolf-82018-11-07 13:10:48+00:00 2018-11-07 13:11:34+00:00 0:00:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5896794Manish Prajapat AMOD18-AIDO aido1_LF1_r3-v3step1-simulation success no rudolf-82018-11-07 13:04:16+00:00 2018-11-07 13:06:23+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5885789Mikita Sazanovich ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no rudolf-82018-11-07 12:05:50+00:00 2018-11-07 12:07:16+00:00 0:01:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5879789Mikita Sazanovich ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success no rudolf-82018-11-07 12:01:33+00:00 2018-11-07 12:01:51+00:00 0:00:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 147, "reward": -7.483778158215438, "good_angle": 11.5501667838303, "survival_time": 4.899999999999992, "traveled_tiles": 3, "valid_direction": 2.866666666666658}, "ep001": {"nsteps": 500, "reward": -0.32564113597408867, "good_angle": 18.040583723581097, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 3.1666666666666607}, "ep002": {"nsteps": 500, "reward": -0.3706761087477207, "good_angle": 0.04195710814195461, "survival_time": 16.666666666666654, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.3631334312947947, "good_angle": 18.964130352810113, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 3.09999999999999}, "ep004": {"nsteps": 500, "reward": -0.7984821920012182, "good_angle": 2.844816453757069, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 6.266666666666653}}good_angle_max 18.964130352810113 good_angle_mean 10.288330884424106 good_angle_median 11.5501667838303 good_angle_min 0.04195710814195461 reward_max -0.32564113597408867 reward_mean -1.8683422052466525 reward_median -0.3706761087477207 reward_min -7.483778158215438 survival_time_max 16.666666666666654 survival_time_mean 14.313333333333322 survival_time_min 4.899999999999992 traveled_tiles_max 5 traveled_tiles_mean 4.2 traveled_tiles_median 4 traveled_tiles_min 3 valid_direction_max 6.266666666666653 valid_direction_mean 3.079999999999992 valid_direction_median 3.09999999999999 valid_direction_min 0
No reset possible 5867788Aoming Liu Random execution aido1_LF1_r3-v3step1-simulation success no rudolf-82018-11-07 11:15:43+00:00 2018-11-07 11:17:50+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5860782Zijian Dong AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-82018-11-07 10:59:54+00:00 2018-11-07 11:01:07+00:00 0:01:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5853786Marta Tintore AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation aborted no rudolf-82018-11-07 10:57:30+00:00 2018-11-07 10:59:26+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5847785Francesco Milano AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success no rudolf-82018-11-07 10:55:53+00:00 2018-11-07 10:57:03+00:00 0:01:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5836783Cliff Li AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation error no rudolf-82018-11-07 10:53:44+00:00 2018-11-07 10:54:42+00:00 0:00:58 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
evaluator.score(cie)
File "eval.py", line 96, in score
raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5820778Alessandro Morra AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-82018-11-07 10:40:11+00:00 2018-11-07 10:41:00+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5814776Alessandro Morra AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success no rudolf-82018-11-07 10:38:34+00:00 2018-11-07 10:39:23+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5806775Tim Franzmeyer AMOD18-AIDO not tht random execution aido1_LF1_r3-v3step3-videos success no rudolf-82018-11-07 10:36:23+00:00 2018-11-07 10:37:36+00:00 0:01:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5793772Tomasz Firynowicz AMOD18-AIDO not that random execution aido1_LF1_r3-v3step2-scoring success no rudolf-82018-11-07 10:32:06+00:00 2018-11-07 10:34:03+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.333333333333321
other stats episodes details {"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}good_angle_max 18.313907760322827 good_angle_mean 11.144112641222362 good_angle_median 16.51740361855984 good_angle_min 0.06896665489742422 reward_max -3.644003686591512 reward_mean -6.730785605532084 reward_median -7.142260233303042 reward_min -10.29928544088572 survival_time_max 9.299999999999978 survival_time_mean 6.886666666666652 survival_time_min 3.9666666666666623 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 2.766666666666662 valid_direction_mean 2.08666666666666 valid_direction_median 2.766666666666657 valid_direction_min 0
No reset possible 5786774Gianmarco Bernasconi Not Random execution aido1_LF1_r3-v3step1-simulation success no rudolf-82018-11-07 10:29:14+00:00 2018-11-07 10:31:15+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5776770Simon Schaefer AMOD18-AIDO not that random execution aido1_LF1_r3-v3step2-scoring success no rudolf-82018-11-07 10:23:23+00:00 2018-11-07 10:23:40+00:00 0:00:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.333333333333321
other stats episodes details {"ep000": {"nsteps": 119, "reward": -10.29928544088572, "good_angle": 17.226891564339322, "survival_time": 3.9666666666666623, "traveled_tiles": 2, "valid_direction": 2.766666666666662}, "ep001": {"nsteps": 264, "reward": -4.779882687623754, "good_angle": 16.51740361855984, "survival_time": 8.79999999999998, "traveled_tiles": 3, "valid_direction": 2.7666666666666577}, "ep002": {"nsteps": 279, "reward": -3.644003686591512, "good_angle": 0.06896665489742422, "survival_time": 9.299999999999978, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 181, "reward": -7.788495979256393, "good_angle": 18.313907760322827, "survival_time": 6.033333333333322, "traveled_tiles": 3, "valid_direction": 2.766666666666657}, "ep004": {"nsteps": 190, "reward": -7.142260233303042, "good_angle": 3.5933936079923985, "survival_time": 6.333333333333321, "traveled_tiles": 3, "valid_direction": 2.1333333333333258}}good_angle_max 18.313907760322827 good_angle_mean 11.144112641222362 good_angle_median 16.51740361855984 good_angle_min 0.06896665489742422 reward_max -3.644003686591512 reward_mean -6.730785605532084 reward_median -7.142260233303042 reward_min -10.29928544088572 survival_time_max 9.299999999999978 survival_time_mean 6.886666666666652 survival_time_min 3.9666666666666623 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 2.766666666666662 valid_direction_mean 2.08666666666666 valid_direction_median 2.766666666666657 valid_direction_min 0
No reset possible 5773769Benson Kuan AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation error no rudolf-82018-11-07 10:14:26+00:00 2018-11-07 10:15:07+00:00 0:00:41 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
evaluator.score(cie)
File "eval.py", line 96, in score
raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5770768Dzenan Lapandic Random execution aido1_LF1_r3-v3step3-videos success no rudolf-82018-11-07 09:58:58+00:00 2018-11-07 09:59:43+00:00 0:00:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5762765Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success no rudolf-82018-11-07 04:03:00+00:00 2018-11-07 04:04:52+00:00 0:01:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5753766Andrea Censi Random execution aido1_LFV_r1-v3step3-videos success no rudolf-82018-11-07 04:01:54+00:00 2018-11-07 04:02:45+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5744766Andrea Censi Random execution aido1_LFV_r1-v3step1-simulation success no rudolf-82018-11-07 03:58:03+00:00 2018-11-07 03:59:52+00:00 0:01:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
