Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 5731762Mikita Sazanovich RL solution aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-06 15:40:32+00:00 2018-11-06 15:40:49+00:00 0:00:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.4633594030737877, "good_angle": 8.964284849678757, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.83333333333332}, "ep001": {"nsteps": 500, "reward": -0.6293033194085583, "good_angle": 7.011532880445017, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 6.866666666666683}, "ep002": {"nsteps": 500, "reward": -0.20836991069852956, "good_angle": 0.3530570460101898, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep003": {"nsteps": 500, "reward": -0.02938091635890305, "good_angle": 3.4537989437343484, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 14.76666666666666}, "ep004": {"nsteps": 500, "reward": -1.1880763600829296, "good_angle": 18.29885897621506, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 9.33333333333334}}good_angle_max 18.29885897621506 good_angle_mean 7.616306539216675 good_angle_median 7.011532880445017 good_angle_min 0.3530570460101898 reward_max -0.02938091635890305 reward_mean -0.5036979819245416 reward_median -0.4633594030737877 reward_min -1.1880763600829296 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 15.83333333333332 valid_direction_mean 9.36 valid_direction_median 9.33333333333334 valid_direction_min 0
No reset possible 5723761Maxim Kuzmin ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-06 15:16:08+00:00 2018-11-06 15:22:54+00:00 0:06:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5718759Gunshi Gupta Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-06 12:42:31+00:00 2018-11-06 12:43:26+00:00 0:00:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5709757Mikita Sazanovich RL solution aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-06 11:17:13+00:00 2018-11-06 11:20:44+00:00 0:03:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5668749Bhairav Mehta Tuned lane controller - ETHZ baseline extension aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-05 22:06:20+00:00 2018-11-05 22:16:41+00:00 0:10:21 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5664746Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no nutonomy-P50-22102018-11-05 18:42:06+00:00 2018-11-05 18:44:57+00:00 0:02:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5656746Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-05 18:32:30+00:00 2018-11-05 18:40:24+00:00 0:07:54 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5647744Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-22102018-11-05 15:54:27+00:00 2018-11-05 15:54:48+00:00 0:00:21 Error while running [...] Error while running Docker Compose:
Could not run ['docker-compose', '-p', 'job5647-9699', 'pull']:
> Command '['docker-compose', '-p', 'job5647-9699', 'pull']' returned non-zero exit status 1
docker-compose stdout | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5645743Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-05 15:41:34+00:00 2018-11-05 15:52:04+00:00 0:10:30 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5642742Philippe Lacaille ROS-based Lane Following aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-05 15:06:17+00:00 2018-11-05 15:08:18+00:00 0:02:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5638742Philippe Lacaille ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-05 14:56:14+00:00 2018-11-05 15:03:51+00:00 0:07:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5625737Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-05 10:02:22+00:00 2018-11-05 10:06:11+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5614736Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-05 09:51:25+00:00 2018-11-05 09:51:44+00:00 0:00:19 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 117, in run
solve(params, cis)
File "solution.py", line 55, in solve
env = make_env(config, debug=debug)
File "solution.py", line 21, in make_env
kwargs={"frame_skip": config['frame_skip']})
TypeError: make() got an unexpected keyword argument 'kwargs'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5609732Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-05 09:31:12+00:00 2018-11-05 09:34:54+00:00 0:03:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 117, in run
solve(params, cis)
File "solution.py", line 82, in solve
observation, reward, done, info = env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/wrappers.py", line 89, in step
ob, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5603731Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-05 08:56:47+00:00 2018-11-05 09:01:03+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5600730Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step4-viz success no nutonomy-P50-22102018-11-05 07:53:23+00:00 2018-11-05 07:55:28+00:00 0:02:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5579726Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz error no nutonomy-P50-22102018-11-05 06:06:13+00:00 2018-11-05 06:07:02+00:00 0:00:49 Error while running [...] Error while running Docker Compose:
Could not run ['docker-compose', '-p', 'job5579-5673', 'up', '-d']:
> Command '['docker-compose', '-p', 'job5579-5673', 'up', '-d']' returned non-zero exit status 1
docker-compose stdout | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5576726Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-05 06:02:21+00:00 2018-11-05 06:04:18+00:00 0:01:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.5482772109312937, "good_angle": 45.85291574377827, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.233333333333313}, "ep001": {"nsteps": 500, "reward": -1.3214039908000268, "good_angle": 39.45868151088105, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.933333333333345}, "ep002": {"nsteps": 218, "reward": -4.578549463967146, "good_angle": 0.698688621525974, "survival_time": 7.266666666666651, "traveled_tiles": 9, "valid_direction": 1.3666666666666618}, "ep003": {"nsteps": 500, "reward": -1.5141833693385125, "good_angle": 46.938958097691355, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 7.266666666666648}, "ep004": {"nsteps": 42, "reward": -26.426783873921348, "good_angle": 0.040033951121231176, "survival_time": 1.400000000000001, "traveled_tiles": 3, "valid_direction": 0}}good_angle_max 46.938958097691355 good_angle_mean 26.597855584999586 good_angle_median 39.45868151088105 good_angle_min 0.040033951121231176 reward_max -1.3214039908000268 reward_mean -7.077839581791665 reward_median -1.5482772109312937 reward_min -26.426783873921348 survival_time_max 16.666666666666654 survival_time_mean 11.733333333333322 survival_time_min 1.400000000000001 traveled_tiles_max 18 traveled_tiles_mean 13.2 traveled_tiles_median 18 traveled_tiles_min 3 valid_direction_max 7.933333333333345 valid_direction_mean 4.759999999999993 valid_direction_median 7.233333333333313 valid_direction_min 0
No reset possible 5551724Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-05 01:03:01+00:00 2018-11-05 01:09:49+00:00 0:06:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5539720Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-05 00:51:11+00:00 2018-11-05 00:53:19+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.3371097060596803, "good_angle": 27.025753935226103, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 5.466666666666665}, "ep001": {"nsteps": 500, "reward": -0.33562959362962286, "good_angle": 22.305991557359896, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.5999999999999845}, "ep002": {"nsteps": 500, "reward": -0.5304610565009061, "good_angle": 1.7306914968174207, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.433333333333351}, "ep003": {"nsteps": 500, "reward": -0.3869976337046828, "good_angle": 31.241625309721908, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 5.666666666666673}, "ep004": {"nsteps": 500, "reward": -0.748817532086745, "good_angle": 1.7197503265757432, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 4.633333333333319}}good_angle_max 31.241625309721908 good_angle_mean 16.804762525140216 good_angle_median 22.305991557359896 good_angle_min 1.7197503265757432 reward_max -0.33562959362962286 reward_mean -0.4678031043963274 reward_median -0.3869976337046828 reward_min -0.748817532086745 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 12 traveled_tiles_mean 11.6 traveled_tiles_median 12 traveled_tiles_min 11 valid_direction_max 5.666666666666673 valid_direction_mean 4.959999999999998 valid_direction_median 4.633333333333319 valid_direction_min 4.433333333333351
No reset possible 5513713Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no nutonomy-P50-22102018-11-04 19:27:03+00:00 2018-11-04 19:32:59+00:00 0:05:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5503710Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-04 19:15:48+00:00 2018-11-04 19:17:48+00:00 0:02:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5489710Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-04 19:05:13+00:00 2018-11-04 19:15:24+00:00 0:10:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5485709Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-04 17:54:37+00:00 2018-11-04 17:56:40+00:00 0:02:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5483709Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-04 17:52:30+00:00 2018-11-04 17:52:47+00:00 0:00:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.577728519514203, "good_angle": 48.26358421644558, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.633333333333341}, "ep001": {"nsteps": 500, "reward": -1.0854666557144377, "good_angle": 21.89444445470377, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 6.666666666666664}, "ep002": {"nsteps": 500, "reward": -0.3708411160647374, "good_angle": 2.230681428334207, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 5.233333333333315}, "ep003": {"nsteps": 500, "reward": -1.4293122868076895, "good_angle": 42.44376119691759, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 7.066666666666647}, "ep004": {"nsteps": 108, "reward": -11.174042657397136, "good_angle": 1.9677892234531176, "survival_time": 3.599999999999997, "traveled_tiles": 5, "valid_direction": 1.2999999999999954}}good_angle_max 48.26358421644558 good_angle_mean 23.360052103970855 good_angle_median 21.89444445470377 good_angle_min 1.9677892234531176 reward_max -0.3708411160647374 reward_mean -3.1274782470996407 reward_median -1.4293122868076895 reward_min -11.174042657397136 survival_time_max 16.666666666666654 survival_time_mean 14.053333333333322 survival_time_min 3.599999999999997 traveled_tiles_max 13 traveled_tiles_mean 11.4 traveled_tiles_median 13 traveled_tiles_min 5 valid_direction_max 7.066666666666647 valid_direction_mean 5.379999999999993 valid_direction_median 6.633333333333341 valid_direction_min 1.2999999999999954
No reset possible 5479708Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-04 17:09:54+00:00 2018-11-04 17:11:56+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.933333333333309
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.7767751636505127, "good_angle": 50.854512115381254, "survival_time": 16.666666666666654, "traveled_tiles": 12, "valid_direction": 6.20000000000002}, "ep001": {"nsteps": 104, "reward": -9.9869894286743, "good_angle": 1.4741682590518028, "survival_time": 3.466666666666664, "traveled_tiles": 3, "valid_direction": 0.8999999999999968}, "ep002": {"nsteps": 500, "reward": -0.4454572081409861, "good_angle": 1.8392847063280993, "survival_time": 16.666666666666654, "traveled_tiles": 13, "valid_direction": 4.466666666666651}, "ep003": {"nsteps": 298, "reward": -5.310037099675045, "good_angle": 30.541267599331825, "survival_time": 9.933333333333309, "traveled_tiles": 8, "valid_direction": 3.9333333333333225}, "ep004": {"nsteps": 63, "reward": -18.33765479496547, "good_angle": 0.25978028756452276, "survival_time": 2.1000000000000023, "traveled_tiles": 3, "valid_direction": 0.5000000000000007}}good_angle_max 50.854512115381254 good_angle_mean 16.993802593531502 good_angle_median 1.8392847063280993 good_angle_min 0.25978028756452276 reward_max -0.4454572081409861 reward_mean -7.171382739021263 reward_median -5.310037099675045 reward_min -18.33765479496547 survival_time_max 16.666666666666654 survival_time_mean 9.766666666666657 survival_time_min 2.1000000000000023 traveled_tiles_max 13 traveled_tiles_mean 7.8 traveled_tiles_median 8 traveled_tiles_min 3 valid_direction_max 6.20000000000002 valid_direction_mean 3.199999999999998 valid_direction_median 3.9333333333333225 valid_direction_min 0.5000000000000007
No reset possible 5452702Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-04 08:45:35+00:00 2018-11-04 08:47:51+00:00 0:02:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.633333333333292
other stats episodes details {"ep000": {"nsteps": 363, "reward": -3.169632585899784, "good_angle": 20.267129195548772, "survival_time": 12.099999999999968, "traveled_tiles": 8, "valid_direction": 4.666666666666657}, "ep001": {"nsteps": 500, "reward": -0.34502139007672666, "good_angle": 23.809800127213432, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.933333333333316}, "ep002": {"nsteps": 439, "reward": -2.9047267032078636, "good_angle": 2.1390020379753993, "survival_time": 14.633333333333292, "traveled_tiles": 10, "valid_direction": 3.3333333333333215}, "ep003": {"nsteps": 95, "reward": -11.256066765165643, "good_angle": 4.166187443923666, "survival_time": 3.166666666666665, "traveled_tiles": 4, "valid_direction": 1.43333333333333}, "ep004": {"nsteps": 500, "reward": -0.7504556718831882, "good_angle": 2.42499626803153, "survival_time": 16.666666666666654, "traveled_tiles": 11, "valid_direction": 4.666666666666652}}good_angle_max 23.809800127213432 good_angle_mean 10.56142301453856 good_angle_median 4.166187443923666 good_angle_min 2.1390020379753993 reward_max -0.34502139007672666 reward_mean -3.685180623246641 reward_median -2.9047267032078636 reward_min -11.256066765165643 survival_time_max 16.666666666666654 survival_time_mean 12.646666666666649 survival_time_min 3.166666666666665 traveled_tiles_max 11 traveled_tiles_mean 8.6 traveled_tiles_median 10 traveled_tiles_min 4 valid_direction_max 4.933333333333316 valid_direction_mean 3.806666666666655 valid_direction_median 4.666666666666652 valid_direction_min 1.43333333333333
No reset possible 5443701Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-04 08:28:46+00:00 2018-11-04 08:35:38+00:00 0:06:52 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5436698Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no nutonomy-P50-22102018-11-04 08:18:12+00:00 2018-11-04 08:20:41+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5434698Benjamin Ramtoula My modified ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-04 08:13:21+00:00 2018-11-04 08:15:49+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.48449373023118825, "good_angle": 31.869053742172053, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 6.499999999999983}, "ep001": {"nsteps": 500, "reward": -0.4889615613436326, "good_angle": 33.14417264715783, "survival_time": 16.666666666666654, "traveled_tiles": 7, "valid_direction": 7.099999999999975}, "ep002": {"nsteps": 500, "reward": -0.6176585400998592, "good_angle": 0.8840413521001964, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.3000000000000274}, "ep003": {"nsteps": 391, "reward": -2.976796660663398, "good_angle": 23.57854488185258, "survival_time": 13.033333333333298, "traveled_tiles": 7, "valid_direction": 4.866666666666649}, "ep004": {"nsteps": 500, "reward": -0.8023943607425317, "good_angle": 2.3672322337918383, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 5.7333333333333165}}good_angle_max 33.14417264715783 good_angle_mean 18.3686089714149 good_angle_median 23.57854488185258 good_angle_min 0.8840413521001964 reward_max -0.48449373023118825 reward_mean -1.074060970616122 reward_median -0.6176585400998592 reward_min -2.976796660663398 survival_time_max 16.666666666666654 survival_time_mean 15.93999999999998 survival_time_min 13.033333333333298 traveled_tiles_max 8 traveled_tiles_mean 7.4 traveled_tiles_median 7 traveled_tiles_min 7 valid_direction_max 7.099999999999975 valid_direction_mean 5.299999999999991 valid_direction_median 5.7333333333333165 valid_direction_min 2.3000000000000274
No reset possible 5423695Benjamin Ramtoula ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-04 07:43:38+00:00 2018-11-04 07:43:54+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.5174464363264851, "good_angle": 36.0555980510905, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 7.366666666666646}, "ep001": {"nsteps": 285, "reward": -3.988052106769592, "good_angle": 11.246108572788714, "survival_time": 9.499999999999975, "traveled_tiles": 4, "valid_direction": 2.633333333333325}, "ep002": {"nsteps": 500, "reward": -0.5809747032001614, "good_angle": 0.5511520127900315, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 1.1666666666666623}, "ep003": {"nsteps": 464, "reward": -2.5291212963605583, "good_angle": 24.736383509079214, "survival_time": 15.466666666666622, "traveled_tiles": 7, "valid_direction": 4.76666666666665}, "ep004": {"nsteps": 500, "reward": -0.7460706018349156, "good_angle": 2.818362034005353, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 6.666666666666679}}good_angle_max 36.0555980510905 good_angle_mean 15.08152083595076 good_angle_median 11.246108572788714 good_angle_min 0.5511520127900315 reward_max -0.5174464363264851 reward_mean -1.6723330288983422 reward_median -0.7460706018349156 reward_min -3.988052106769592 survival_time_max 16.666666666666654 survival_time_mean 14.993333333333316 survival_time_min 9.499999999999975 traveled_tiles_max 7 traveled_tiles_mean 5.8 traveled_tiles_median 6 traveled_tiles_min 4 valid_direction_max 7.366666666666646 valid_direction_mean 4.5199999999999925 valid_direction_median 4.76666666666665 valid_direction_min 1.1666666666666623
No reset possible 5392688Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-03 21:31:46+00:00 2018-11-03 21:40:33+00:00 0:08:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5385685Anna Tsalapova ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-22102018-11-03 18:39:58+00:00 2018-11-03 18:47:37+00:00 0:07:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5373683Vadim Volodin Random execution aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-03 17:14:12+00:00 2018-11-03 17:16:36+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.099999999999978
other stats episodes details {"ep000": {"nsteps": 171, "reward": -7.906903265163913, "good_angle": 23.167319904536384, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.9666666666666544}, "ep001": {"nsteps": 383, "reward": -3.2070510478580236, "good_angle": 16.473773167522435, "survival_time": 12.766666666666632, "traveled_tiles": 4, "valid_direction": 4.033333333333319}, "ep002": {"nsteps": 500, "reward": -0.006893814329640009, "good_angle": 0.49274114419548326, "survival_time": 16.666666666666654, "traveled_tiles": 5, "valid_direction": 1.2333333333333645}, "ep003": {"nsteps": 235, "reward": -6.704229172239912, "good_angle": 19.915258517632104, "survival_time": 7.833333333333315, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 273, "reward": -5.652174131810583, "good_angle": 5.997302694493859, "survival_time": 9.099999999999978, "traveled_tiles": 3, "valid_direction": 3.09999999999999}}good_angle_max 23.167319904536384 good_angle_mean 13.209279085676052 good_angle_median 16.473773167522435 good_angle_min 0.49274114419548326 reward_max -0.006893814329640009 reward_mean -4.695450286280414 reward_median -5.652174131810583 reward_min -7.906903265163913 survival_time_max 16.666666666666654 survival_time_mean 10.413333333333314 survival_time_min 5.6999999999999895 traveled_tiles_max 5 traveled_tiles_mean 3.4 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 4.033333333333319 valid_direction_mean 3.0866666666666633 valid_direction_median 3.09999999999999 valid_direction_min 1.2333333333333645
No reset possible 5367682Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-03 17:02:37+00:00 2018-11-03 17:06:51+00:00 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5359681Maxim Kuzmin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-03 16:52:34+00:00 2018-11-03 16:54:30+00:00 0:01:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.133333333333328
other stats episodes details {"ep000": {"nsteps": 124, "reward": -9.464519434225474, "good_angle": 16.6057139817514, "survival_time": 4.133333333333328, "traveled_tiles": 2, "valid_direction": 3.433333333333328}, "ep001": {"nsteps": 272, "reward": -4.253494696385186, "good_angle": 17.427836948139806, "survival_time": 9.066666666666643, "traveled_tiles": 3, "valid_direction": 3.6333333333333218}, "ep002": {"nsteps": 385, "reward": -2.9362640112154668, "good_angle": 1.7247606671975984, "survival_time": 12.833333333333298, "traveled_tiles": 5, "valid_direction": 1.4333333333333282}, "ep003": {"nsteps": 103, "reward": -11.71759037253926, "good_angle": 2.600052219787166, "survival_time": 3.433333333333331, "traveled_tiles": 3, "valid_direction": 1.4333333333333291}, "ep004": {"nsteps": 96, "reward": -12.852147919436296, "good_angle": 0.23873913423689327, "survival_time": 3.1999999999999984, "traveled_tiles": 2, "valid_direction": 0.93333333333333}}good_angle_max 17.427836948139806 good_angle_mean 7.719420590222573 good_angle_median 2.600052219787166 good_angle_min 0.23873913423689327 reward_max -2.9362640112154668 reward_mean -8.244803286760337 reward_median -9.464519434225474 reward_min -12.852147919436296 survival_time_max 12.833333333333298 survival_time_mean 6.53333333333332 survival_time_min 3.1999999999999984 traveled_tiles_max 5 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.6333333333333218 valid_direction_mean 2.1733333333333276 valid_direction_median 1.4333333333333291 valid_direction_min 0.93333333333333
No reset possible 5351680Vadim Volodin Random execution aido1_LF1_r3-v3step3-videos success no nutonomy-P50-22102018-11-03 16:46:16+00:00 2018-11-03 16:47:14+00:00 0:00:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5349680Vadim Volodin Random execution aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-22102018-11-03 16:44:12+00:00 2018-11-03 16:44:28+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.033333333333312
other stats episodes details {"ep000": {"nsteps": 169, "reward": -7.7063290995253615, "good_angle": 24.236812711581575, "survival_time": 5.633333333333323, "traveled_tiles": 2, "valid_direction": 3.899999999999988}, "ep001": {"nsteps": 375, "reward": -3.842255097468694, "good_angle": 23.998689920838753, "survival_time": 12.499999999999966, "traveled_tiles": 3, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 331, "reward": -3.074778109690674, "good_angle": 0.13386154685152946, "survival_time": 11.033333333333305, "traveled_tiles": 4, "valid_direction": 0}, "ep003": {"nsteps": 256, "reward": -6.376807949040085, "good_angle": 26.490228803371373, "survival_time": 8.533333333333314, "traveled_tiles": 3, "valid_direction": 3.899999999999987}, "ep004": {"nsteps": 271, "reward": -5.610285222217633, "good_angle": 5.235805382630728, "survival_time": 9.033333333333312, "traveled_tiles": 3, "valid_direction": 3.033333333333323}}good_angle_max 26.490228803371373 good_angle_mean 16.01907967305479 good_angle_median 23.998689920838753 good_angle_min 0.13386154685152946 reward_max -3.074778109690674 reward_mean -5.32209109558849 reward_median -5.610285222217633 reward_min -7.7063290995253615 survival_time_max 12.499999999999966 survival_time_mean 9.346666666666644 survival_time_min 5.633333333333323 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 2 valid_direction_max 3.9333333333333194 valid_direction_mean 2.953333333333324 valid_direction_median 3.899999999999987 valid_direction_min 0
No reset possible 5348679Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step4-viz success no nutonomy-P50-22102018-11-03 16:41:31+00:00 2018-11-03 16:43:09+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5342679Mandana Samiei ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-22102018-11-03 16:32:29+00:00 2018-11-03 16:39:36+00:00 0:07:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 5340677Vadim Volodin Solution template aido1_luck-v3step1 success yes nutonomy-P50-22102018-11-03 16:15:26+00:00 2018-11-03 16:16:02+00:00 0:00:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
