Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 447258Vadim Volodin Simple based on center pixel aido1_LF1_r2-v3step1-simulation success yes nutonomy-P50-300372018-10-23 18:45:37+00:00 2018-10-23 18:46:51+00:00 0:01:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 443255Vadim Volodin Simple based on center pixel aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-23 18:40:17+00:00 2018-10-23 18:41:16+00:00 0:00:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 2 survival_time_mean 2.373333333333332 good_angle_mean 3.2448348216917005 valid_direction_mean 0.7733333333333331
other stats episodes details {"ep000": {"nsteps": 60, "reward": -18.55895467996597, "good_angle": 8.631361811097454, "survival_time": 2.0000000000000027, "traveled_tiles": 2, "valid_direction": 1.4000000000000028}, "ep001": {"nsteps": 125, "reward": -8.8210487947464, "good_angle": 5.922127375530279, "survival_time": 4.166666666666662, "traveled_tiles": 3, "valid_direction": 1.399999999999995}, "ep002": {"nsteps": 40, "reward": -26.14327304959297, "good_angle": 1.60895172094825, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 1.066666666666667}, "ep003": {"nsteps": 15, "reward": -68.38100338776907, "good_angle": 0.017532853174180282, "survival_time": 0.49999999999999994, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 116, "reward": -9.494371339903566, "good_angle": 0.04420034770833667, "survival_time": 3.8666666666666623, "traveled_tiles": 4, "valid_direction": 0}}good_angle_max 8.631361811097454 good_angle_median 1.60895172094825 good_angle_min 0.017532853174180282 reward_max -8.8210487947464 reward_mean -26.279730250395595 reward_median -18.55895467996597 reward_min -68.38100338776907 survival_time_max 4.166666666666662 survival_time_median 2.0000000000000027 survival_time_min 0.49999999999999994 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_min 1 valid_direction_max 1.4000000000000028 valid_direction_median 1.066666666666667 valid_direction_min 0
No reset possible 441254Vadim Volodin Simple based on center pixel aido1_LF1_r2-v3step1-simulation failed yes nutonomy-P50-300372018-10-23 18:35:47+00:00 2018-10-23 18:36:16+00:00 0:00:29 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 475, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
global name 'dec' is not defined
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 438252Mandana Samiei Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-23 18:20:26+00:00 2018-10-23 18:21:50+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 2 survival_time_mean 16.613333333333316 good_angle_mean 27.075240205221593 valid_direction_mean 13.846666666666655
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.036918387413025, "good_angle": 16.145241857243672, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 15.599999999999987}, "ep001": {"nsteps": 500, "reward": -0.480481212771032, "good_angle": 60.01806533463249, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.399999999999988}, "ep002": {"nsteps": 500, "reward": -1.0258958237012847, "good_angle": 29.53478474064314, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.033333333333315}, "ep003": {"nsteps": 500, "reward": -1.32253132340312, "good_angle": 11.06540188471044, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.09999999999999}, "ep004": {"nsteps": 500, "reward": -0.9973625722527504, "good_angle": 18.61270720887821, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 14.09999999999999}}good_angle_max 60.01806533463249 good_angle_median 18.61270720887821 good_angle_min 11.06540188471044 reward_max -0.480481212771032 reward_mean -0.9726378639082424 reward_median -1.0258958237012847 reward_min -1.32253132340312 survival_time_max 16.666666666666654 survival_time_median 16.599999999999984 survival_time_min 16.599999999999984 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_min 1 valid_direction_max 15.599999999999987 valid_direction_median 14.09999999999999 valid_direction_min 12.09999999999999
No reset possible 437251David Abraham Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-23 18:19:01+00:00 2018-10-23 18:19:26+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 3 survival_time_mean 9.60666666666665 good_angle_mean 8.738932150305212 valid_direction_mean 8.466666666666649
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.2727269411180169, "good_angle": 15.287022501700282, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.299999999999992}, "ep001": {"nsteps": 144, "reward": -9.042670455230915, "good_angle": 2.694384999070173, "survival_time": 4.733333333333326, "traveled_tiles": 3, "valid_direction": 4.099999999999993}, "ep002": {"nsteps": 500, "reward": -2.6643407019376757, "good_angle": 10.794727103782549, "survival_time": 4.699999999999993, "traveled_tiles": 3, "valid_direction": 10.166666666666636}, "ep003": {"nsteps": 259, "reward": -4.663204992467333, "good_angle": 3.2600758015141977, "survival_time": 8.633333333333313, "traveled_tiles": 1, "valid_direction": 5.633333333333321}, "ep004": {"nsteps": 500, "reward": -1.684873000945896, "good_angle": 11.658450345458862, "survival_time": 13.299999999999963, "traveled_tiles": 3, "valid_direction": 10.133333333333306}}good_angle_max 15.287022501700282 good_angle_median 10.794727103782549 good_angle_min 2.694384999070173 reward_max -1.2727269411180169 reward_mean -3.8655632183399673 reward_median -2.6643407019376757 reward_min -9.042670455230915 survival_time_max 16.666666666666654 survival_time_median 8.633333333333313 survival_time_min 4.699999999999993 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_min 1 valid_direction_max 12.299999999999992 valid_direction_median 10.133333333333306 valid_direction_min 4.099999999999993
No reset possible 429247Ikra Monjur Solution template aido1_luck-v3step1 success yes nutonomy-P50-300372018-10-23 16:22:58+00:00 2018-10-23 16:23:14+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 428246Anton Mashikhin PyTorch DDPG template aido1_LF1_r2-v3step1-simulation error yes nutonomy-P50-300372018-10-23 15:41:19+00:00 2018-10-23 15:41:29+00:00 0:00:10 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
run_docker(wd, project, cmd)
File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job428-5559', 'pull']:
> Command '['docker-compose', '-p', 'job428-5559', 'pull']' returned non-zero exit status 1
docker-compose stdout | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 427245Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation error no nutonomy-P50-300372018-10-23 13:03:14+00:00 2018-10-23 13:03:24+00:00 0:00:10 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 395, in run
run_docker(wd, project, cmd)
File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job427-3725', 'pull']:
> Command '['docker-compose', '-p', 'job427-3725', 'pull']' returned non-zero exit status 1
docker-compose stdout | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 423242Benjamin Ramtoula Template for ROS Submission aido1_LF1_r2-v3step1-simulation error yes nutonomy-P50-300372018-10-22 19:31:46+00:00 2018-10-22 19:32:19+00:00 0:00:33 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 412, in run
run_docker(wd, project, cmd)
File "/project/src/duckietown_challenges_runner/runner.py", line 560, in run_docker
raise DockerComposeFail(msg)
DockerComposeFail: Could not run ['docker-compose', '-p', 'job423-5823', 'up', '--abort-on-container-exit']:
> Command '['docker-compose', '-p', 'job423-5823', 'up', '--abort-on-container-exit']' returned non-zero exit status 1
docker-compose stdout | None
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 421241Emma Sung Random execution aido1_LF1_r2-v3step1-simulation success yes nutonomy-P50-300372018-10-22 19:02:17+00:00 2018-10-22 19:03:39+00:00 0:01:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 419240Emma Sung Random execution aido1_LF1_r2-v3step1-simulation success yes nutonomy-P50-300372018-10-22 18:58:14+00:00 2018-10-22 18:59:35+00:00 0:01:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 417238Anton Mashikhin Solution template aido1_luck-v3step1 success yes nutonomy-P50-300372018-10-22 17:06:08+00:00 2018-10-22 17:06:42+00:00 0:00:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 416237Jonathan Plante Tensorflow template aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-22 16:02:11+00:00 2018-10-22 16:02:34+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 3 survival_time_mean 3.106666666666663 good_angle_mean 0.8532457460036523 valid_direction_mean 1.0799999999999996
other stats episodes details {"ep000": {"nsteps": 45, "reward": -22.730665498682193, "good_angle": 2.464011645649803, "survival_time": 1.500000000000001, "traveled_tiles": 3, "valid_direction": 1.400000000000001}, "ep001": {"nsteps": 108, "reward": -9.473568658999822, "good_angle": 0.21552867377610185, "survival_time": 3.599999999999997, "traveled_tiles": 2, "valid_direction": 0.5333333333333314}, "ep002": {"nsteps": 237, "reward": -4.432748170956362, "good_angle": 0.44670148280839816, "survival_time": 7.899999999999982, "traveled_tiles": 5, "valid_direction": 0.6666666666666666}, "ep003": {"nsteps": 40, "reward": -27.013019865751268, "good_angle": 0.3643350051548137, "survival_time": 1.333333333333334, "traveled_tiles": 1, "valid_direction": 0.9333333333333336}, "ep004": {"nsteps": 111, "reward": -9.886567245438895, "good_angle": 0.7756519226291452, "survival_time": 1.2000000000000004, "traveled_tiles": 5, "valid_direction": 1.8666666666666651}}good_angle_max 2.464011645649803 good_angle_median 0.44670148280839816 good_angle_min 0.21552867377610185 reward_max -4.432748170956362 reward_mean -14.70731388796571 reward_median -9.886567245438895 reward_min -27.013019865751268 survival_time_max 7.899999999999982 survival_time_median 1.500000000000001 survival_time_min 1.2000000000000004 traveled_tiles_max 5 traveled_tiles_mean 3.2 traveled_tiles_min 1 valid_direction_max 1.8666666666666651 valid_direction_median 0.9333333333333336 valid_direction_min 0.5333333333333314
No reset possible 415237Jonathan Plante Tensorflow template aido1_LF1_r2-v3step1-simulation success yes nutonomy-P50-300372018-10-22 16:01:11+00:00 2018-10-22 16:02:05+00:00 0:00:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 414236Jonathan Plante Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-22 15:41:01+00:00 2018-10-22 15:41:30+00:00 0:00:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 3 survival_time_mean 16.613333333333316 good_angle_mean 34.42087593116726 valid_direction_mean 12.626666666666656
other stats episodes details {"ep000": {"nsteps": 500, "reward": -1.0002795575857162, "good_angle": 10.371212949210284, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.466666666666663}, "ep001": {"nsteps": 500, "reward": -1.6683495569229123, "good_angle": 51.155118401339, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.333333333333323}, "ep002": {"nsteps": 500, "reward": -1.2194725445508956, "good_angle": 81.25321589422992, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.799999999999988}, "ep003": {"nsteps": 500, "reward": -1.7070470515573395, "good_angle": 11.014429387179227, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 10.833333333333314}, "ep004": {"nsteps": 500, "reward": -1.227472954928875, "good_angle": 18.310403023877857, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 13.699999999999983}}good_angle_max 81.25321589422992 good_angle_median 18.310403023877857 good_angle_min 10.371212949210284 reward_max -1.0002795575857162 reward_mean -1.364524333109148 reward_median -1.227472954928875 reward_min -1.7070470515573395 survival_time_max 16.666666666666654 survival_time_median 16.599999999999984 survival_time_min 16.599999999999984 traveled_tiles_max 3 traveled_tiles_mean 2.4 traveled_tiles_min 1 valid_direction_max 14.799999999999988 valid_direction_median 12.333333333333323 valid_direction_min 10.833333333333314
No reset possible 413236Jonathan Plante Random execution aido1_LF1_r2-v3step1-simulation success yes nutonomy-P50-300372018-10-22 15:39:27+00:00 2018-10-22 15:40:56+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 412235Jonathan Plante Solution template aido1_luck-v3step1 success yes nutonomy-P50-300372018-10-22 15:03:32+00:00 2018-10-22 15:04:11+00:00 0:00:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 411234Inspur- team Solution template aido1_luck-v3step1 success yes nutonomy-P50-300372018-10-22 11:22:02+00:00 2018-10-22 11:22:37+00:00 0:00:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 410233Benjamin Ramtoula Template for ROS Submission aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-22 07:13:16+00:00 2018-10-22 07:13:39+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 2 survival_time_mean 3.2666666666666635 good_angle_mean 5.573907592278874 valid_direction_mean 1.8199999999999976
other stats episodes details {"ep000": {"nsteps": 128, "reward": -9.600020315963777, "good_angle": 21.134904899556435, "survival_time": 4.266666666666661, "traveled_tiles": 2, "valid_direction": 2.999999999999994}, "ep001": {"nsteps": 151, "reward": -6.600312632131575, "good_angle": 0.6683427249858845, "survival_time": 5.033333333333325, "traveled_tiles": 2, "valid_direction": 1.2666666666666626}, "ep002": {"nsteps": 99, "reward": -11.67629972653407, "good_angle": 5.470192592883934, "survival_time": 3.299999999999998, "traveled_tiles": 1, "valid_direction": 2.8333333333333313}, "ep003": {"nsteps": 32, "reward": -32.96746315062046, "good_angle": 0.028911937430508912, "survival_time": 1.0666666666666669, "traveled_tiles": 1, "valid_direction": 0}, "ep004": {"nsteps": 80, "reward": -14.745833478868008, "good_angle": 0.5671858065376111, "survival_time": 2.666666666666667, "traveled_tiles": 2, "valid_direction": 2}}good_angle_max 21.134904899556435 good_angle_median 0.6683427249858845 good_angle_min 0.028911937430508912 reward_max -6.600312632131575 reward_mean -15.117985860823577 reward_median -11.67629972653407 reward_min -32.96746315062046 survival_time_max 5.033333333333325 survival_time_median 3.299999999999998 survival_time_min 1.0666666666666669 traveled_tiles_max 2 traveled_tiles_mean 1.6 traveled_tiles_min 1 valid_direction_max 2.999999999999994 valid_direction_median 2 valid_direction_min 0
No reset possible 408232John Hughes Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-22 06:20:27+00:00 2018-10-22 06:20:52+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 3 survival_time_mean 12.98666666666665 good_angle_mean 11.380410969306974 valid_direction_mean 9.419999999999977
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.7932140330076217, "good_angle": 9.664119232355455, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.066666666666654}, "ep001": {"nsteps": 500, "reward": -2.0966846167743207, "good_angle": 6.817795180734229, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.799999999999969}, "ep002": {"nsteps": 500, "reward": -1.0901086805462836, "good_angle": 24.289195995241908, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 12.333333333333302}, "ep003": {"nsteps": 380, "reward": -4.339734431369365, "good_angle": 15.073649274227854, "survival_time": 12.599999999999966, "traveled_tiles": 3, "valid_direction": 12.2333333333333}, "ep004": {"nsteps": 74, "reward": -16.259130494014638, "good_angle": 1.0572951639754211, "survival_time": 2.4666666666666677, "traveled_tiles": 1, "valid_direction": 1.6666666666666672}}good_angle_max 24.289195995241908 good_angle_median 9.664119232355455 good_angle_min 1.0572951639754211 reward_max -0.7932140330076217 reward_mean -4.915774451142445 reward_median -2.0966846167743207 reward_min -16.259130494014638 survival_time_max 16.666666666666654 survival_time_median 16.599999999999984 survival_time_min 2.4666666666666677 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_min 1 valid_direction_max 12.333333333333302 valid_direction_median 11.066666666666654 valid_direction_min 1.6666666666666672
No reset possible 405230Irene Hung Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-22 05:07:25+00:00 2018-10-22 05:07:52+00:00 0:00:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 2 survival_time_mean 16.613333333333316 good_angle_mean 33.64367907193359 valid_direction_mean 13.246666666666655
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.8292855309844017, "good_angle": 16.863279149834483, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.79999999999998}, "ep001": {"nsteps": 500, "reward": -1.5477754533533008, "good_angle": 30.128748653863212, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 9.766666666666664}, "ep002": {"nsteps": 500, "reward": -0.864044932126999, "good_angle": 96.11326191177496, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 15.56666666666665}, "ep003": {"nsteps": 500, "reward": -1.327184747636318, "good_angle": 12.938644771876024, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 14.49999999999999}, "ep004": {"nsteps": 500, "reward": -1.27256230892241, "good_angle": 12.174460872319257, "survival_time": 16.599999999999984, "traveled_tiles": 2, "valid_direction": 12.599999999999996}}good_angle_max 96.11326191177496 good_angle_median 16.863279149834483 good_angle_min 12.174460872319257 reward_max -0.8292855309844017 reward_mean -1.168170594604686 reward_median -1.27256230892241 reward_min -1.5477754533533008 survival_time_max 16.666666666666654 survival_time_median 16.599999999999984 survival_time_min 16.599999999999984 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_min 1 valid_direction_max 15.56666666666665 valid_direction_median 13.79999999999998 valid_direction_min 9.766666666666664
No reset possible 396224Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step2-scoring aborted no nutonomy-P50-300372018-10-21 16:02:41+00:00 2018-10-21 16:02:55+00:00 0:00:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.333333333333304
other stats episodes details {"ep000": {"nsteps": 490, "reward": -4.171412545077655, "good_angle": 14.379182228026304, "survival_time": 16.333333333333304, "traveled_tiles": 3, "valid_direction": 6.066666666666664}, "ep001": {"nsteps": 500, "reward": -1.0339719699919223, "good_angle": 52.42523924297719, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.133333333333309}, "ep002": {"nsteps": 500, "reward": -1.4501068297624589, "good_angle": 74.28098761715059, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 7.899999999999977}, "ep003": {"nsteps": 246, "reward": -4.999525907684148, "good_angle": 1.22724322608484, "survival_time": 8.199999999999982, "traveled_tiles": 1, "valid_direction": 2.6666666666666647}, "ep004": {"nsteps": 163, "reward": -7.094105166571637, "good_angle": 0.711536075115334, "survival_time": 5.433333333333324, "traveled_tiles": 1, "valid_direction": 2.0666666666666673}}good_angle_max 74.28098761715059 good_angle_mean 28.604837677870854 good_angle_median 14.379182228026304 good_angle_min 0.711536075115334 reward_max -1.0339719699919223 reward_mean -3.749824483817565 reward_median -4.171412545077655 reward_min -7.094105166571637 survival_time_max 16.666666666666654 survival_time_mean 12.659999999999984 survival_time_min 5.433333333333324 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 7.899999999999977 valid_direction_mean 5.166666666666656 valid_direction_median 6.066666666666664 valid_direction_min 2.0666666666666673
No reset possible 394223Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-300372018-10-21 15:26:21+00:00 2018-10-21 15:28:39+00:00 0:02:18 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 107, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Can't connect to the gym-duckietown-server
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 393222Suzanne Petryk Random execution aido1_LF1_r2-v3step2-scoring success yes nutonomy-P50-300372018-10-21 15:21:52+00:00 2018-10-21 15:22:18+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
traveled_tiles_median 3 survival_time_mean 16.613333333333316 good_angle_mean 11.285662849153288 valid_direction_mean 11.546666666666656
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.4203298093047924, "good_angle": 7.890866130069249, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 11.533333333333337}, "ep001": {"nsteps": 500, "reward": -2.1653990453332663, "good_angle": 3.078885745446617, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 7.466666666666647}, "ep002": {"nsteps": 500, "reward": -1.2375537265070595, "good_angle": 19.325236491490884, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.833333333333318}, "ep003": {"nsteps": 500, "reward": -1.1455610923171042, "good_angle": 14.884935455392098, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 13.799999999999988}, "ep004": {"nsteps": 500, "reward": -0.7775738411396742, "good_angle": 11.248390423367594, "survival_time": 16.599999999999984, "traveled_tiles": 3, "valid_direction": 11.09999999999999}}good_angle_max 19.325236491490884 good_angle_median 11.248390423367594 good_angle_min 3.078885745446617 reward_max -0.4203298093047924 reward_mean -1.1492835029203792 reward_median -1.1455610923171042 reward_min -2.1653990453332663 survival_time_max 16.666666666666654 survival_time_median 16.599999999999984 survival_time_min 16.599999999999984 traveled_tiles_max 3 traveled_tiles_mean 2.6 traveled_tiles_min 1 valid_direction_max 13.833333333333318 valid_direction_median 11.533333333333337 valid_direction_min 7.466666666666647
No reset possible 391221Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-300372018-10-21 15:19:57+00:00 2018-10-21 15:20:18+00:00 0:00:21 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 581, in wrap_solution
solution.run(cis)
File "solution.py", line 107, in run
raise InvalidSubmission(str(e))
InvalidSubmission: frozen_graph.pb; No such file or directory
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 390220Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos success no nutonomy-P50-300372018-10-21 10:20:46+00:00 2018-10-21 10:21:33+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 389220Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step2-scoring success no nutonomy-P50-300372018-10-21 10:20:26+00:00 2018-10-21 10:20:41+00:00 0:00:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.833333333333298
other stats episodes details {"ep000": {"nsteps": 253, "reward": -6.627978940255086, "good_angle": 1.280181574914256, "survival_time": 8.433333333333314, "traveled_tiles": 2, "valid_direction": 2.499999999999992}, "ep001": {"nsteps": 500, "reward": -0.3061336755362572, "good_angle": 24.901943926295687, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 5.033333333333316}, "ep002": {"nsteps": 500, "reward": -1.709346336841583, "good_angle": 90.00061748987427, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 10.86666666666663}, "ep003": {"nsteps": 385, "reward": -2.826298477887418, "good_angle": 0.5398567841255246, "survival_time": 12.833333333333298, "traveled_tiles": 1, "valid_direction": 0.7333333333333323}, "ep004": {"nsteps": 202, "reward": -5.356281492582495, "good_angle": 0.21214036967145497, "survival_time": 6.733333333333319, "traveled_tiles": 1, "valid_direction": 0}}good_angle_max 90.00061748987427 good_angle_mean 23.38694802897624 good_angle_median 1.280181574914256 good_angle_min 0.21214036967145497 reward_max -0.3061336755362572 reward_mean -3.365207784620568 reward_median -2.826298477887418 reward_min -6.627978940255086 survival_time_max 16.666666666666654 survival_time_mean 12.266666666666648 survival_time_min 6.733333333333319 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 10.86666666666663 valid_direction_mean 3.826666666666654 valid_direction_median 2.499999999999992 valid_direction_min 0
No reset possible 388220Julian Zilly Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation success no nutonomy-P50-300372018-10-21 10:17:34+00:00 2018-10-21 10:20:21+00:00 0:02:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 387219Bhairav Mehta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no nutonomy-P50-300372018-10-20 23:13:11+00:00 2018-10-20 23:13:37+00:00 0:00:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 480, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Env Duckietown-Lf-Lfv-Navv-Silent-v1 not found (valid versions include ['Duckietown-Lf-Lfv-Navv-Silent-v0'])
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 382210Andrea Censi Python template aido1_amod_service_quality_r1-v3step2-scoring success yes nutonomy-P50-300372018-10-20 19:04:26+00:00 2018-10-20 19:05:54+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.75324003154215
other stats efficiency -63.96424012616591 fleet_size -1000000000
No reset possible 379214Andrea Censi Java template aido1_amod_fleet_size_r1-v3step1-simulation failed no nutonomy-P50-300372018-10-20 19:03:31+00:00 2018-10-20 19:04:10+00:00 0:00:39 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/amod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Uncaught exception in solution:
Traceback (most recent call last):
File "/aidamod/target/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 485, in wrap_solution
solution.run(cis)
File "/project/solution.py", line 25, in run
subprocess.check_call(cmd, cwd=cwd, stdout=sys.stdout, stderr=sys.stderr)
File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['java', '-Xmx10000m', '-cp', 'aidamod-1.4.7.jar', 'aidamod.demo.AidoGuest', 'aido-host']' returned non-zero exit status 1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
