Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 114021309Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no idsc-rudolf-202332018-11-21 22:05:26+00:00 2018-11-21 22:06:16+00:00 0:00:50 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113971308Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no idsc-rudolf-202332018-11-21 21:52:56+00:00 2018-11-21 21:55:33+00:00 0:02:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11387942Claudio Ruch Python template aido1_amod_service_quality_r1-v3step2-scoring success yes idsc-rudolf-202332018-11-21 20:58:50+00:00 2018-11-21 20:59:12+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.87038394834193
other stats efficiency -64.14325579336746 fleet_size -1000000000
No reset possible 11381945Claudio Ruch Python template aido1_amod_fleet_size_r1-v3step2-scoring success yes idsc-rudolf-202332018-11-21 20:57:54+00:00 2018-11-21 20:58:12+00:00 0:00:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats efficiency -63.45590163968151 service_quality -32.5813154099211
No reset possible 11374949Claudio Ruch Funky Controller 1 aido1_amod_service_quality_r1-v3step2-scoring success yes idsc-rudolf-202332018-11-21 20:56:11+00:00 2018-11-21 20:56:29+00:00 0:00:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -31.972205871029583
other stats efficiency -62.24230348411543 fleet_size -1000000000
No reset possible 11359949Claudio Ruch Funky Controller 1 aido1_amod_service_quality_r1-v3step1-simulation success yes idsc-rudolf-202332018-11-21 20:51:46+00:00 2018-11-21 20:56:04+00:00 0:04:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11350211Andrea Censi Python template aido1_amod_fleet_size_r1-v3step2-scoring success yes idsc-rudolf-202332018-11-21 20:51:23+00:00 2018-11-21 20:51:39+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats efficiency -66.37977173064483 service_quality -33.107272932661175
No reset possible 11340210Andrea Censi Python template aido1_amod_service_quality_r1-v3step1-simulation success yes idsc-rudolf-202332018-11-21 20:46:40+00:00 2018-11-21 20:51:14+00:00 0:04:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113321067Claudio Ruch Webinar Algorithm aido1_amod_service_quality_r1-v3step1-simulation error yes idsc-rudolf-202332018-11-21 20:35:29+00:00 2018-11-21 20:46:31+00:00 0:11:02 Timeout:
Waited 602 [...] Timeout:
Waited 602.128271818 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113161283Claudio Ruch Big Fleet Controller aido1_amod_fleet_size_r1-v3step1-simulation error yes idsc-rudolf-202332018-11-21 20:23:56+00:00 2018-11-21 20:35:20+00:00 0:11:24 Timeout:
Waited 601 [...] Timeout:
Waited 601.612314939 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113081307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-21 10:21:39+00:00 2018-11-21 10:23:15+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2272303180768307 deviation-center-line_median 0.20681915361280567 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3568243903921427 deviation-center-line_mean 0.2339024184529846 deviation-center-line_min 0.12317304458368264 deviation-heading_max 1.7477521518583374 deviation-heading_mean 0.8385864351768578 deviation-heading_median 0.625932399356574 deviation-heading_min 0.4663073293798452 driven_any_max 0.7928832038719099 driven_any_mean 0.3442899087143174 driven_any_median 0.2464303825004456 driven_any_min 0.16427501307806475 driven_lanedir_max 0.5568157761076884 driven_lanedir_mean 0.28308198639260274 driven_lanedir_min 0.1488538314418193 in-drivable-lane_max 1.8666666666666691 in-drivable-lane_mean 0.37333333333333385 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7928832038719099, "driven_lanedir": 0.5568157761076884, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7477521518583374, "deviation-center-line": 0.3451234776069457}, "ep001": {"driven_any": 0.3285759873680623, "driven_lanedir": 0.3206965291801671, "in-drivable-lane": 0, "deviation-heading": 0.4663073293798452, "deviation-center-line": 0.3568243903921427}, "ep002": {"driven_any": 0.16427501307806475, "driven_lanedir": 0.1488538314418193, "in-drivable-lane": 0, "deviation-heading": 0.5559356998062136, "deviation-center-line": 0.137572026069346}, "ep003": {"driven_any": 0.18928495675310453, "driven_lanedir": 0.16181347715650807, "in-drivable-lane": 0, "deviation-heading": 0.7970045954833189, "deviation-center-line": 0.12317304458368264}, "ep004": {"driven_any": 0.2464303825004456, "driven_lanedir": 0.2272303180768307, "in-drivable-lane": 0, "deviation-heading": 0.625932399356574, "deviation-center-line": 0.20681915361280567}}
No reset possible 112971307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-21 10:20:28+00:00 2018-11-21 10:21:30+00:00 0:01:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112901307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-21 10:19:55+00:00 2018-11-21 10:20:16+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.366666666666668
other stats episodes details {"ep000": {"nsteps": 224, "reward": -4.614468659430713, "good_angle": 0.736912173000433, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 94, "reward": -11.249216741703924, "good_angle": 0.19649234145495015, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.30313229933381, "good_angle": 0.36602712571830665, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 55, "reward": -18.556428309191357, "good_angle": 0.6146218368799753, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 71, "reward": -14.55548485525897, "good_angle": 0.42671573150912695, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6333333333333326}}good_angle_max 0.736912173000433 good_angle_mean 0.4681538417125584 good_angle_median 0.42671573150912695 good_angle_min 0.19649234145495015 reward_max -4.614468659430713 reward_mean -14.055746172983756 reward_median -14.55548485525897 reward_min -21.30313229933381 survival_time_max 7.46666666666665 survival_time_mean 3.2799999999999976 survival_time_min 1.6000000000000016 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.099999999999996 valid_direction_mean 0.6733333333333329 valid_direction_median 0.6666666666666681 valid_direction_min 0.29999999999999893
No reset possible 112781306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 18:41:25+00:00 2018-11-20 18:43:09+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.199999999999974
other stats episodes details {"ep000": {"nsteps": 95, "reward": -10.783506638635146, "good_angle": 1.5058336819559393, "survival_time": 3.166666666666665, "traveled_tiles": 1, "valid_direction": 2.666666666666665}, "ep001": {"nsteps": 83, "reward": -12.614138619368337, "good_angle": 0.017220027804123142, "survival_time": 2.7666666666666666, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 306, "reward": -3.879368552244177, "good_angle": 1.199392002118851, "survival_time": 10.199999999999974, "traveled_tiles": 3, "valid_direction": 2.633333333333325}, "ep003": {"nsteps": 353, "reward": -3.1296388487682463, "good_angle": 0.03134739572415276, "survival_time": 11.766666666666636, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 413, "reward": -3.021035787713016, "good_angle": 23.628148302403908, "survival_time": 13.766666666666628, "traveled_tiles": 3, "valid_direction": 4.699999999999983}}good_angle_max 23.628148302403908 good_angle_mean 5.2763882820013945 good_angle_median 1.199392002118851 good_angle_min 0.017220027804123142 reward_max -3.021035787713016 reward_mean -6.685537689345783 reward_median -3.879368552244177 reward_min -12.614138619368337 survival_time_max 13.766666666666628 survival_time_mean 8.333333333333314 survival_time_min 2.7666666666666666 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.699999999999983 valid_direction_mean 1.999999999999995 valid_direction_median 2.633333333333325 valid_direction_min 0
No reset possible 112721306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 18:38:00+00:00 2018-11-20 18:40:54+00:00 0:02:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112701305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-20 14:36:34+00:00 2018-11-20 14:41:41+00:00 0:05:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.466416467829077 deviation-center-line_median 0.7491075821771831 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 1.0852097769842697 deviation-center-line_mean 0.6828056697229344 deviation-center-line_min 0.110456458929874 deviation-heading_max 3.088169914104725 deviation-heading_mean 1.9361613489916736 deviation-heading_median 1.9716545225234337 deviation-heading_min 0.5532418461875583 driven_any_max 9.395397994412496 driven_any_mean 6.118783919231438 driven_any_median 8.673270359145661 driven_any_min 1.2271279931045092 driven_lanedir_max 9.106972393834644 driven_lanedir_mean 5.887907266761421 driven_lanedir_min 1.1523564491476126 in-drivable-lane_max 0.6999999999999994 in-drivable-lane_mean 0.19999999999999968 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
No reset possible 112601305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-20 14:34:46+00:00 2018-11-20 14:36:23+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112471305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 14:29:29+00:00 2018-11-20 14:34:27+00:00 0:04:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112411303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-20 14:00:57+00:00 2018-11-20 14:05:20+00:00 0:04:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.247947866530568 deviation-center-line_median 0.4327948281734701 in-drivable-lane_median 0.33333333333333215
other stats deviation-center-line_max 0.8951573984927605 deviation-center-line_mean 0.5294639676056159 deviation-center-line_min 0.2553864082264141 deviation-heading_max 2.5086434238842648 deviation-heading_mean 1.7176914721650511 deviation-heading_median 1.3764712107670771 deviation-heading_min 0.935815621123276 driven_any_max 9.83643308694634 driven_any_mean 5.49635327088284 driven_any_median 4.3797351459243234 driven_any_min 2.1044204655967538 driven_lanedir_max 9.247955113262256 driven_lanedir_mean 5.215254784547498 driven_lanedir_min 1.8076115267915815 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.3466666666666658 in-drivable-lane_min 0.033333333333333215 per-episodes details {"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
No reset possible 112291304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-20 13:51:18+00:00 2018-11-20 13:55:32+00:00 0:04:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112171304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 13:49:24+00:00 2018-11-20 13:49:48+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}good_angle_max 41.3027307319338 good_angle_mean 16.843258630714534 good_angle_median 0.6659104569093917 good_angle_min 0.4061192818354377 reward_max -0.025241015423089267 reward_mean -0.16468490227229196 reward_median -0.10230048004770652 reward_min -0.3235300897718407 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 17 traveled_tiles_mean 16.4 traveled_tiles_median 16 traveled_tiles_min 16 valid_direction_max 5.600000000000018 valid_direction_mean 2.986666666666665 valid_direction_median 1.9666666666666597 valid_direction_min 0.9333333333333308
No reset possible 112111304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 13:41:02+00:00 2018-11-20 13:48:53+00:00 0:07:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112001303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-20 13:25:59+00:00 2018-11-20 13:28:39+00:00 0:02:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111951303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 13:25:22+00:00 2018-11-20 13:25:45+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.333333333333317
other stats episodes details {"ep000": {"nsteps": 135, "reward": -7.617946757625624, "good_angle": 0.24914791547711929, "survival_time": 4.499999999999994, "traveled_tiles": 5, "valid_direction": 0.5999999999999985}, "ep001": {"nsteps": 149, "reward": -7.085851560353032, "good_angle": 10.035174620388348, "survival_time": 4.966666666666659, "traveled_tiles": 5, "valid_direction": 1.8999999999999992}, "ep002": {"nsteps": 500, "reward": -0.12116984189208596, "good_angle": 0.6114449517312698, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 220, "reward": -4.690160607782045, "good_angle": 0.18338344049862731, "survival_time": 7.333333333333317, "traveled_tiles": 8, "valid_direction": 0.3999999999999986}, "ep004": {"nsteps": 500, "reward": -0.31342388660390863, "good_angle": 33.864049863006905, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.833333333333349}}good_angle_max 33.864049863006905 good_angle_mean 8.988640158220454 good_angle_median 0.6114449517312698 good_angle_min 0.18338344049862731 reward_max -0.12116984189208596 reward_mean -3.9657105308513385 reward_median -4.690160607782045 reward_min -7.617946757625624 survival_time_max 16.666666666666654 survival_time_mean 10.026666666666651 survival_time_min 4.499999999999994 traveled_tiles_max 18 traveled_tiles_mean 10.8 traveled_tiles_median 8 traveled_tiles_min 5 valid_direction_max 4.833333333333349 valid_direction_mean 1.8733333333333348 valid_direction_median 1.6333333333333275 valid_direction_min 0.3999999999999986
No reset possible 111751302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-20 12:15:31+00:00 2018-11-20 12:17:35+00:00 0:02:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5323895106250947 deviation-center-line_median 0.2069133082272764 in-drivable-lane_median 1.7666666666666604
other stats deviation-center-line_max 0.5467131081696794 deviation-center-line_mean 0.2602226065031052 deviation-center-line_min 0.109306961893104 deviation-heading_max 1.742323630223919 deviation-heading_mean 1.1567573530878712 deviation-heading_median 1.3282976503274275 deviation-heading_min 0.24355646859871627 driven_any_max 2.1899668958618665 driven_any_mean 0.991835190048022 driven_any_median 0.9696925230542558 driven_any_min 0.3178171092322331 driven_lanedir_max 0.7169311640978855 driven_lanedir_mean 0.45386049169510273 driven_lanedir_min 0.04178689899496413 in-drivable-lane_max 6.533333333333311 in-drivable-lane_mean 2.1733333333333262 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
No reset possible 111711302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 12:08:31+00:00 2018-11-20 12:08:52+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.66666666666666
other stats episodes details {"ep000": {"nsteps": 50, "reward": -20.329378296332433, "good_angle": 1.468160510939434, "survival_time": 1.6666666666666683, "traveled_tiles": 1, "valid_direction": 1.4000000000000017}, "ep001": {"nsteps": 171, "reward": -7.239350287157944, "good_angle": 12.220765922292202, "survival_time": 5.6999999999999895, "traveled_tiles": 2, "valid_direction": 3.066666666666656}, "ep002": {"nsteps": 49, "reward": -20.82356342794944, "good_angle": 0.0475471341694313, "survival_time": 1.633333333333335, "traveled_tiles": 2, "valid_direction": 0.03333333333333344}, "ep003": {"nsteps": 328, "reward": -3.9637742684987263, "good_angle": 3.5554145744831076, "survival_time": 10.933333333333303, "traveled_tiles": 4, "valid_direction": 4.066666666666658}, "ep004": {"nsteps": 140, "reward": -8.124590363497763, "good_angle": 1.3339038883512928, "survival_time": 4.66666666666666, "traveled_tiles": 2, "valid_direction": 3.366666666666659}}good_angle_max 12.220765922292202 good_angle_mean 3.725158406047094 good_angle_median 1.468160510939434 good_angle_min 0.0475471341694313 reward_max -3.9637742684987263 reward_mean -12.09613132868726 reward_median -8.124590363497763 reward_min -20.82356342794944 survival_time_max 10.933333333333303 survival_time_mean 4.919999999999992 survival_time_min 1.633333333333335 traveled_tiles_max 4 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 4.066666666666658 valid_direction_mean 2.386666666666662 valid_direction_median 3.066666666666656 valid_direction_min 0.03333333333333344
No reset possible 111631302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 12:04:46+00:00 2018-11-20 12:08:03+00:00 0:03:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111561301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-20 11:22:21+00:00 2018-11-20 11:23:59+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111461301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 11:20:33+00:00 2018-11-20 11:20:54+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.033333333333329
other stats episodes details {"ep000": {"nsteps": 60, "reward": -16.986505389073862, "good_angle": 0.9061986341032228, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep001": {"nsteps": 175, "reward": -7.165024964154831, "good_angle": 16.00891330525849, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 3.9333333333333234}, "ep002": {"nsteps": 121, "reward": -8.572560073753957, "good_angle": 0.1181062316229642, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 0.13333333333333286}, "ep003": {"nsteps": 183, "reward": -6.431596156241515, "good_angle": 1.08940483738514, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 28, "reward": -36.25624855714185, "good_angle": 0.18152285177428645, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}good_angle_max 16.00891330525849 good_angle_mean 3.66082917202882 good_angle_median 0.9061986341032228 good_angle_min 0.1181062316229642 reward_max -6.431596156241515 reward_mean -15.082387028073205 reward_median -8.572560073753957 reward_min -36.25624855714185 survival_time_max 6.099999999999988 survival_time_mean 3.779999999999995 survival_time_min 0.9333333333333332 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.9333333333333234 valid_direction_mean 1.879999999999996 valid_direction_median 1.7666666666666693 valid_direction_min 0.13333333333333286
No reset possible 111401301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 11:14:39+00:00 2018-11-20 11:20:13+00:00 0:05:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111381300Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-20 10:25:44+00:00 2018-11-20 10:26:31+00:00 0:00:47 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 89, in solve
cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111231299Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-20 10:19:40+00:00 2018-11-20 10:20:28+00:00 0:00:48 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111071297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-20 09:54:49+00:00 2018-11-20 10:03:19+00:00 0:08:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.051829096858754 deviation-center-line_median 0.92971426400998 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.942361718872175 deviation-center-line_mean 0.8572808146222097 deviation-center-line_min 0.6352737923652181 deviation-heading_max 4.154968182851831 deviation-heading_mean 3.0043615237383805 deviation-heading_median 3.2100480227248354 deviation-heading_min 1.448995458537678 driven_any_max 4.685052912313802 driven_any_mean 4.268651858623994 driven_any_median 4.270000785139785 driven_any_min 3.6056512932929903 driven_lanedir_max 4.666314634594814 driven_lanedir_mean 4.092641922881887 driven_lanedir_min 3.3140298965753785 in-drivable-lane_max 1.2666666666666664 in-drivable-lane_mean 0.3999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible 111001297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-20 09:49:55+00:00 2018-11-20 09:51:49+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.12872719888342543, "good_angle": 0.9576191171400944, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.299999999999994}, "ep001": {"nsteps": 500, "reward": -0.32568414630950426, "good_angle": 31.885946853786997, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.8000000000000025}, "ep002": {"nsteps": 500, "reward": -0.026519747545942662, "good_angle": 0.7382874364771269, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.8999999999999932}, "ep003": {"nsteps": 500, "reward": -0.14358187809749506, "good_angle": 0.736805346290642, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.9000000000000057}, "ep004": {"nsteps": 500, "reward": -0.3258316019057529, "good_angle": 37.830552116191214, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.66666666666665}}good_angle_max 37.830552116191214 good_angle_mean 14.429842173977216 good_angle_median 0.9576191171400944 good_angle_min 0.736805346290642 reward_max -0.026519747545942662 reward_mean -0.1900689145484241 reward_median -0.14358187809749506 reward_min -0.3258316019057529 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 10 traveled_tiles_mean 8.8 traveled_tiles_median 9 traveled_tiles_min 8 valid_direction_max 5.8000000000000025 valid_direction_mean 3.313333333333329 valid_direction_median 2.299999999999994 valid_direction_min 1.8999999999999932
No reset possible 110951297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-20 09:40:39+00:00 2018-11-20 09:49:49+00:00 0:09:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110921296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 19:11:41+00:00 2018-11-19 19:17:54+00:00 0:06:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.059602090256015 deviation-center-line_median 0.9233774452974473 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 0.949820010509239 deviation-center-line_mean 0.8471167073284788 deviation-center-line_min 0.5946126139614508 deviation-heading_max 4.152007344027524 deviation-heading_mean 3.00191975331795 deviation-heading_median 3.225164541782035 deviation-heading_min 1.5002234411759428 driven_any_max 4.71754922294293 driven_any_mean 4.27810584519334 driven_any_median 4.257084832627703 driven_any_min 3.64324106737124 driven_lanedir_max 4.698600876684635 driven_lanedir_mean 4.1050019299967575 driven_lanedir_min 3.3439683783780128 in-drivable-lane_max 1.2666666666666666 in-drivable-lane_mean 0.39999999999999947 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.257084832627703, "driven_lanedir": 3.912478498972464, "in-drivable-lane": 1.2666666666666666, "deviation-heading": 3.4242468414709983, "deviation-center-line": 0.9234806487754208}, "ep001": {"driven_any": 3.64324106737124, "driven_lanedir": 3.3439683783780128, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 4.152007344027524, "deviation-center-line": 0.949820010509239}, "ep002": {"driven_any": 4.147042135683437, "driven_lanedir": 4.059602090256015, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 2.70795659813325, "deviation-center-line": 0.8442928180988358}, "ep003": {"driven_any": 4.625611967341394, "driven_lanedir": 4.510359805692658, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.225164541782035, "deviation-center-line": 0.9233774452974473}, "ep004": {"driven_any": 4.71754922294293, "driven_lanedir": 4.698600876684635, "in-drivable-lane": 0, "deviation-heading": 1.5002234411759428, "deviation-center-line": 0.5946126139614508}}
No reset possible 110841296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-19 19:08:58+00:00 2018-11-19 19:11:31+00:00 0:02:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110761296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 19:01:05+00:00 2018-11-19 19:08:34+00:00 0:07:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110681295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 18:45:51+00:00 2018-11-19 18:51:08+00:00 0:05:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.910996529633443 deviation-center-line_median 0.804829668110413 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 1.039879518692922 deviation-center-line_mean 0.7667227890186241 deviation-center-line_min 0.3222291105867537 deviation-heading_max 3.2571936050662273 deviation-heading_mean 2.1809540644258907 deviation-heading_median 2.6458401641549094 deviation-heading_min 0.9822962818116744 driven_any_max 5.123266602593036 driven_any_mean 3.5595592135593237 driven_any_median 4.272131146626368 driven_any_min 1.5077016675170083 driven_lanedir_max 5.10905363944258 driven_lanedir_mean 3.432994515958099 driven_lanedir_min 1.4595445026629377 in-drivable-lane_max 1.0999999999999994 in-drivable-lane_mean 0.25999999999999973 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
No reset possible 110591295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-19 18:43:31+00:00 2018-11-19 18:45:25+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110451295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 18:38:26+00:00 2018-11-19 18:42:41+00:00 0:04:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110401294Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-19 15:59:49+00:00 2018-11-19 16:00:35+00:00 0:00:46 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 126, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
File "/workspace/wrappers.py", line 392, in __init__
assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110371293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step4-viz success no idsc-rudolf-202332018-11-19 13:55:36+00:00 2018-11-19 13:59:17+00:00 0:03:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.44433964314315433 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.5512591199175949 deviation-center-line_mean 0.4645859205989189 deviation-center-line_min 0.39335855914159346 deviation-heading_max 3.5598471575751542 deviation-heading_mean 1.764030711792994 deviation-heading_median 1.381299485180658 deviation-heading_min 1.1199561623878598 driven_any_max 1.49079583364818 driven_any_mean 1.1297417190774648 driven_any_median 1.2306824401524008 driven_any_min 0.6871560381108496 driven_lanedir_max 1.450214316231856 driven_lanedir_mean 0.9909222089183176 driven_lanedir_median 1.1890923792085335 driven_lanedir_min 0.1581492283862641 in-drivable-lane_max 2.7333333333333316 in-drivable-lane_mean 0.5599999999999996 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
No reset possible 110261293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step3-videos success yes idsc-rudolf-202332018-11-19 13:53:53+00:00 2018-11-19 13:55:28+00:00 0:01:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110211293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step2-scoring success yes idsc-rudolf-202332018-11-19 13:52:07+00:00 2018-11-19 13:52:28+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 10.633333333333306
other stats episodes details {"ep000": {"nsteps": 179, "reward": -7.248710109878269, "good_angle": 10.627331976833926, "survival_time": 5.966666666666655, "traveled_tiles": 1, "valid_direction": 5.266666666666655}, "ep001": {"nsteps": 209, "reward": -5.0600387267233655, "good_angle": 1.184123936080564, "survival_time": 6.966666666666652, "traveled_tiles": 3, "valid_direction": 1.2999999999999954}, "ep002": {"nsteps": 319, "reward": -3.38833040183521, "good_angle": 2.451607556109596, "survival_time": 10.633333333333306, "traveled_tiles": 3, "valid_direction": 1.3666666666666618}, "ep003": {"nsteps": 386, "reward": -2.7739159322207936, "good_angle": 2.434990919949518, "survival_time": 12.866666666666632, "traveled_tiles": 4, "valid_direction": 1.3666666666666618}, "ep004": {"nsteps": 372, "reward": -2.8408372522867222, "good_angle": 3.1134733827407173, "survival_time": 12.399999999999968, "traveled_tiles": 4, "valid_direction": 1.499999999999995}}good_angle_max 10.627331976833926 good_angle_mean 3.962305554342864 good_angle_median 2.451607556109596 good_angle_min 1.184123936080564 reward_max -2.7739159322207936 reward_mean -4.262366484588872 reward_median -3.38833040183521 reward_min -7.248710109878269 survival_time_max 12.866666666666632 survival_time_mean 9.766666666666644 survival_time_min 5.966666666666655 traveled_tiles_max 4 traveled_tiles_mean 3 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 5.266666666666655 valid_direction_mean 2.159999999999994 valid_direction_median 1.3666666666666618 valid_direction_min 1.2999999999999954
No reset possible 110131292Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-19 13:32:03+00:00 2018-11-19 13:32:37+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 280, in __init__
self.cur_pos = self._env.cur_pos
AttributeError: 'TimeLimit' object has no attribute 'cur_pos'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110011290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 12:51:53+00:00 2018-11-19 12:58:35+00:00 0:06:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.567528656397519 deviation-center-line_median 1.0314261754372154 in-drivable-lane_median 1.8000000000000025
other stats deviation-center-line_max 1.1495890962817945 deviation-center-line_mean 0.9690856088373276 deviation-center-line_min 0.6766247807849696 deviation-heading_max 3.941604068378368 deviation-heading_mean 2.2824951855297098 deviation-heading_median 2.29469239931807 deviation-heading_min 0.490186778431544 driven_any_max 1.77870780337893 driven_any_mean 1.7786930581721971 driven_any_median 1.7786958483229494 driven_any_min 1.778665937185382 driven_lanedir_max 1.7755630287738702 driven_lanedir_mean 1.5640709458206878 driven_lanedir_min 1.3262672930289792 in-drivable-lane_max 3.733333333333355 in-drivable-lane_mean 1.5133333333333367 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.7787039960005906, "driven_lanedir": 1.567528656397519, "in-drivable-lane": 1.8000000000000025, "deviation-heading": 1.5419265634410058, "deviation-center-line": 0.6766247807849696}, "ep001": {"driven_any": 1.778665937185382, "driven_lanedir": 1.3262672930289792, "in-drivable-lane": 3.733333333333355, "deviation-heading": 3.1440661180795613, "deviation-center-line": 1.1495890962817945}, "ep002": {"driven_any": 1.778691705973134, "driven_lanedir": 1.4091608907992712, "in-drivable-lane": 2.033333333333326, "deviation-heading": 3.941604068378368, "deviation-center-line": 1.0314261754372154}, "ep003": {"driven_any": 1.77870780337893, "driven_lanedir": 1.7755630287738702, "in-drivable-lane": 0, "deviation-heading": 0.490186778431544, "deviation-center-line": 0.8534399105921283}, "ep004": {"driven_any": 1.7786958483229494, "driven_lanedir": 1.741834860103799, "in-drivable-lane": 0, "deviation-heading": 2.29469239931807, "deviation-center-line": 1.1343480810905304}}
No reset possible 109911290Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 12:35:29+00:00 2018-11-19 12:46:59+00:00 0:11:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109831289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 11:33:58+00:00 2018-11-19 11:47:16+00:00 0:13:18 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109811288Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-19 09:36:38+00:00 2018-11-19 09:47:12+00:00 0:10:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109741286Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-19 09:21:26+00:00 2018-11-19 09:22:03+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 120, in run
solve(params, cis)
File "solution.py", line 68, in solve
env = make_env(config, debug=debug)
File "solution.py", line 37, in make_env
env = FrameStackWrappper(env=env, k=3, config=config)
File "/workspace/wrappers.py", line 89, in __init__
self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
return _load(f, map_location, pickle_module)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
result = unpickler.load()
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
data_type(size), location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
result = fn(storage, location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109651283Claudio Ruch Big Fleet Controller aido1_amod_fleet_size_r1-v3step1-simulation error no idsc-rudolf-202332018-11-19 07:27:31+00:00 2018-11-19 07:39:10+00:00 0:11:39 Timeout:
Waited 601 [...] Timeout:
Waited 601.422827005 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109621282Yun Chen PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 04:31:21+00:00 2018-11-19 04:36:22+00:00 0:05:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -1.05985247177248 deviation-center-line_median 0.32463013910329175 in-drivable-lane_median 8.23333333333332
other stats deviation-center-line_max 1.2229848197846576 deviation-center-line_mean 0.5013585011463242 deviation-center-line_min 0.18421462158296809 deviation-heading_max 6.639256027638261 deviation-heading_mean 6.130316773672168 deviation-heading_median 6.587348625790274 deviation-heading_min 4.253182461720226 driven_any_max 3.317636741607105 driven_any_mean 3.31763674160709 driven_any_median 3.317636741607098 driven_any_min 3.3176367416070653 driven_lanedir_max -0.8727849850798894 driven_lanedir_mean -1.0237415377242507 driven_lanedir_min -1.0652501105207834 in-drivable-lane_max 10.466666666666663 in-drivable-lane_mean 8.686666666666657 in-drivable-lane_min 8.233333333333318 per-episodes details {"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
No reset possible 109491282Yun Chen PyTorch template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-19 04:29:15+00:00 2018-11-19 04:31:10+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109371281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 04:22:16+00:00 2018-11-19 04:25:14+00:00 0:02:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -0.1277084947325524 deviation-center-line_median 0.21813380591001513 in-drivable-lane_median 4.899999999999988
other stats deviation-center-line_max 0.380914912819748 deviation-center-line_mean 0.2305222638710954 deviation-center-line_min 0.08042209529634169 deviation-heading_max 6.695251918755404 deviation-heading_mean 2.968397790615076 deviation-heading_median 2.3803439804106667 deviation-heading_min 0.7340334522927733 driven_any_max 1.147514414161098 driven_any_mean 0.6321277046803103 driven_any_median 0.6292780798715786 driven_any_min 0.1451745708877611 driven_lanedir_max -0.03062263736441606 driven_lanedir_mean -0.16399291768892374 driven_lanedir_min -0.38661333766655104 in-drivable-lane_max 13.69999999999998 in-drivable-lane_mean 5.933333333333326 in-drivable-lane_min 1.0333333333333348 per-episodes details {"ep000": {"driven_any": 1.147514414161098, "driven_lanedir": -0.1277084947325524, "in-drivable-lane": 13.69999999999998, "deviation-heading": 2.3803439804106667, "deviation-center-line": 0.380914912819748}, "ep001": {"driven_any": 0.24250416908067615, "driven_lanedir": -0.0847419274714194, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 1.408962372196319, "deviation-center-line": 0.1930310368565834}, "ep002": {"driven_any": 0.9961672894004376, "driven_lanedir": -0.38661333766655104, "in-drivable-lane": 8.099999999999996, "deviation-heading": 6.695251918755404, "deviation-center-line": 0.2801094684727889}, "ep003": {"driven_any": 0.6292780798715786, "driven_lanedir": -0.1902781912096798, "in-drivable-lane": 4.899999999999988, "deviation-heading": 3.6233972294202177, "deviation-center-line": 0.21813380591001513}, "ep004": {"driven_any": 0.1451745708877611, "driven_lanedir": -0.03062263736441606, "in-drivable-lane": 1.0333333333333348, "deviation-heading": 0.7340334522927733, "deviation-center-line": 0.08042209529634169}}
No reset possible 109291281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-19 04:19:46+00:00 2018-11-19 04:22:07+00:00 0:02:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109161281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 04:11:09+00:00 2018-11-19 04:19:22+00:00 0:08:13 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109101280Yun Chen Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 03:53:08+00:00 2018-11-19 03:55:37+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.0912619516892297 deviation-center-line_median 0.35434867307286394 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.5503217644623789 deviation-center-line_mean 0.3430555191422603 deviation-center-line_min 0.19008849208663176 deviation-heading_max 3.5738141012812856 deviation-heading_mean 1.5780346998192003 deviation-heading_median 1.6281599088608705 deviation-heading_min 0.17673821454925606 driven_any_max 1.600431044772758 driven_any_mean 0.8967643246163399 driven_any_median 1.0949819717424556 driven_any_min 0.2573432846425337 driven_lanedir_max 1.2646710312972245 driven_lanedir_mean 0.7693333122921573 driven_lanedir_min 0.1261801357102449 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.2999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3483184683821576, "driven_lanedir": 0.1261801357102449, "in-drivable-lane": 0.6, "deviation-heading": 2.035647668091897, "deviation-center-line": 0.19008849208663176}, "ep001": {"driven_any": 0.2573432846425337, "driven_lanedir": 0.2561200256083098, "in-drivable-lane": 0, "deviation-heading": 0.17673821454925606, "deviation-center-line": 0.20420172648538432}, "ep002": {"driven_any": 1.182746853541795, "driven_lanedir": 1.1084334171557773, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 1.6281599088608705, "deviation-center-line": 0.35434867307286394}, "ep003": {"driven_any": 1.0949819717424556, "driven_lanedir": 1.0912619516892297, "in-drivable-lane": 0, "deviation-heading": 0.4758136063126942, "deviation-center-line": 0.4163169396040424}, "ep004": {"driven_any": 1.600431044772758, "driven_lanedir": 1.2646710312972245, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 3.5738141012812856, "deviation-center-line": 0.5503217644623789}}
No reset possible 108941280Yun Chen Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-19 03:47:28+00:00 2018-11-19 03:49:45+00:00 0:02:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108791279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-19 03:29:06+00:00 2018-11-19 03:30:48+00:00 0:01:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2332896871989636 deviation-center-line_median 0.2116792544883902 in-drivable-lane_median 0
other stats deviation-center-line_max 0.6323564732185519 deviation-center-line_mean 0.2912504656486582 deviation-center-line_min 0.12670548452775535 deviation-heading_max 1.728976789403258 deviation-heading_mean 0.8194124233994693 deviation-heading_median 0.582523377361064 deviation-heading_min 0.4668112744530743 driven_any_max 1.0714883694442423 driven_any_mean 0.39858127916586666 driven_any_median 0.25000443206491196 driven_any_min 0.14641855465317552 driven_lanedir_max 0.8388467814636376 driven_lanedir_mean 0.33922668007033285 driven_lanedir_min 0.129237910180789 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
No reset possible 108141271Andrea Censi Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 13:51:23+00:00 2018-11-18 13:52:19+00:00 0:00:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108081271Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 13:50:56+00:00 2018-11-18 13:51:16+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 21.142156874080055 good_angle_mean 7.8959403329559406 good_angle_median 1.179753153433826 good_angle_min 0.034109257356551625 reward_max -3.0704857812487516 reward_mean -5.8017310789899135 reward_median -4.346870108328614 reward_min -12.594963072856634 survival_time_max 12.0333333333333 survival_time_mean 8.486666666666647 survival_time_min 2.7 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.4466666666666597 valid_direction_median 2.2333333333333334 valid_direction_min 0
No reset possible 107961270Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 13:45:22+00:00 2018-11-18 13:47:47+00:00 0:02:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9394202467524176 deviation-center-line_median 0.5005461180613384 in-drivable-lane_median 0
other stats deviation-center-line_max 0.8019762026714526 deviation-center-line_mean 0.46453888385325126 deviation-center-line_min 0.21054410665275972 deviation-heading_max 3.827263075148643 deviation-heading_mean 1.494999243689109 deviation-heading_median 0.9923897161178532 deviation-heading_min 0.17098922103056 driven_any_max 1.6105203163952195 driven_any_mean 0.8935799240412866 driven_any_median 0.9415373933628172 driven_any_min 0.3657972991350469 driven_lanedir_max 1.2454280154214263 driven_lanedir_mean 0.7705575447787474 driven_lanedir_min 0.15506621419634292 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.3199999999999993 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3657972991350469, "driven_lanedir": 0.15506621419634292, "in-drivable-lane": 0.6, "deviation-heading": 2.0441369547682884, "deviation-center-line": 0.21054410665275972}, "ep001": {"driven_any": 0.37268928175592897, "driven_lanedir": 0.37189411852472865, "in-drivable-lane": 0, "deviation-heading": 0.17098922103056, "deviation-center-line": 0.2916484846388874}, "ep002": {"driven_any": 1.1773553295574206, "driven_lanedir": 1.1409791289988214, "in-drivable-lane": 0, "deviation-heading": 0.9923897161178532, "deviation-center-line": 0.5005461180613384}, "ep003": {"driven_any": 0.9415373933628172, "driven_lanedir": 0.9394202467524176, "in-drivable-lane": 0, "deviation-heading": 0.4402172513802, "deviation-center-line": 0.5179795072418177}, "ep004": {"driven_any": 1.6105203163952195, "driven_lanedir": 1.2454280154214263, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.827263075148643, "deviation-center-line": 0.8019762026714526}}
No reset possible 107921270Andrea Censi Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 13:44:22+00:00 2018-11-18 13:45:13+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 107881270Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 13:43:49+00:00 2018-11-18 13:44:14+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.799999999999986
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.59392248302767, "good_angle": 1.2156126068944273, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 81, "reward": -12.911595400836733, "good_angle": 0.011156086737876828, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.437077517995215, "good_angle": 0.8658368839697798, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 204, "reward": -5.272974844510649, "good_angle": 0.03033246554319256, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.655747907953468, "good_angle": 21.771657353630022, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}good_angle_max 21.771657353630022 good_angle_mean 4.77891907935506 good_angle_median 0.8658368839697798 good_angle_min 0.011156086737876828 reward_max -3.655747907953468 reward_mean -7.7742636308647475 reward_median -5.272974844510649 reward_min -12.911595400836733 survival_time_max 11.533333333333305 survival_time_mean 6.439999999999986 survival_time_min 2.7 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.93333333333332 valid_direction_mean 1.6399999999999963 valid_direction_median 2.033333333333327 valid_direction_min 0
No reset possible 107811270Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 13:41:51+00:00 2018-11-18 13:43:42+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10779356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 12:27:13+00:00 2018-11-18 12:29:04+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.481042290524149 deviation-center-line_median 0.2339370288761713 in-drivable-lane_median 3.1666666666666554
other stats deviation-center-line_max 0.3887111922952009 deviation-center-line_mean 0.2586161601601217 deviation-center-line_min 0.18135154954873856 deviation-heading_max 2.50309613217222 deviation-heading_mean 1.2944517420712691 deviation-heading_median 0.9876146032429244 deviation-heading_min 0.22282122232957288 driven_any_max 1.2789432717800575 driven_any_mean 0.8078205932391744 driven_any_median 1.0186256472933577 driven_any_min 0.2568548411010332 driven_lanedir_max 0.6886799360751179 driven_lanedir_mean 0.4077758085758731 driven_lanedir_min 0.12255962906563632 in-drivable-lane_max 4.366666666666651 in-drivable-lane_mean 2.3533333333333255 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3451086440022018, "driven_lanedir": 0.12255962906563632, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 1.845635471935517, "deviation-center-line": 0.18135154954873856}, "ep001": {"driven_any": 0.2568548411010332, "driven_lanedir": 0.25402061296093104, "in-drivable-lane": 0, "deviation-heading": 0.22282122232957288, "deviation-center-line": 0.2339370288761713}, "ep002": {"driven_any": 1.2789432717800575, "driven_lanedir": 0.6886799360751179, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 2.50309613217222, "deviation-center-line": 0.3887111922952009}, "ep003": {"driven_any": 1.1395705620192222, "driven_lanedir": 0.4925765742535315, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.913091280676112, "deviation-center-line": 0.25652286886349257}, "ep004": {"driven_any": 1.0186256472933577, "driven_lanedir": 0.481042290524149, "in-drivable-lane": 3.566666666666654, "deviation-heading": 0.9876146032429244, "deviation-center-line": 0.232558161217005}}
No reset possible 10774356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 12:25:39+00:00 2018-11-18 12:26:56+00:00 0:01:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10769356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 12:25:07+00:00 2018-11-18 12:25:28+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.1666666666666545
other stats episodes details {"ep000": {"nsteps": 73, "reward": -13.967838363830408, "good_angle": 1.1348289113064052, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 64, "reward": -16.202794682234526, "good_angle": 0.02641407510084338, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 236, "reward": -4.795201715855401, "good_angle": 2.6918874701801223, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.799999999999985}, "ep003": {"nsteps": 211, "reward": -6.0455723037704345, "good_angle": 1.1701484093436572, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 5.899999999999984}, "ep004": {"nsteps": 185, "reward": -6.662634145226833, "good_angle": 1.516460368667395, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 5.066666666666654}}good_angle_max 2.6918874701801223 good_angle_mean 1.3079478469196846 good_angle_median 1.1701484093436572 good_angle_min 0.02641407510084338 reward_max -4.795201715855401 reward_mean -9.53480824218352 reward_median -6.662634145226833 reward_min -16.202794682234526 survival_time_max 7.866666666666648 survival_time_mean 5.126666666666658 survival_time_min 2.1333333333333355 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.899999999999984 valid_direction_mean 3.5466666666666584 valid_direction_median 4.799999999999985 valid_direction_min 0
No reset possible 107501234Gunshi Gupta ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 12:13:51+00:00 2018-11-18 12:24:34+00:00 0:10:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10742557Dzenan Lapandic Baseline solution using imitation learning from logs aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 12:06:27+00:00 2018-11-18 12:13:42+00:00 0:07:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.697447157376711 deviation-center-line_median 0.8333370531576382 in-drivable-lane_median 1.2333333333333645
other stats deviation-center-line_max 0.8954064824764659 deviation-center-line_mean 0.7696312303797095 deviation-center-line_min 0.58835431142482 deviation-heading_max 3.4315409257591747 deviation-heading_mean 2.428374665292112 deviation-heading_median 2.8280385066204383 deviation-heading_min 0.8791768257264414 driven_any_max 1.9333780766102693 driven_any_mean 1.9333746117866073 driven_any_median 1.9333757141071009 driven_any_min 1.9333701519557005 driven_lanedir_max 1.9200788676514409 driven_lanedir_mean 1.5049861526237842 driven_lanedir_min 0.8062156565309881 in-drivable-lane_max 8.800000000000006 in-drivable-lane_mean 3.1066666666666785 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.9333762991920855, "driven_lanedir": 1.7552625607851289, "in-drivable-lane": 1.100000000000001, "deviation-heading": 2.1480048187776437, "deviation-center-line": 0.8920941577548562}, "ep001": {"driven_any": 1.9333701519557005, "driven_lanedir": 0.8062156565309881, "in-drivable-lane": 8.800000000000006, "deviation-heading": 2.8280385066204383, "deviation-center-line": 0.6389641470847671}, "ep002": {"driven_any": 1.9333728170678803, "driven_lanedir": 1.697447157376711, "in-drivable-lane": 1.2333333333333645, "deviation-heading": 3.4315409257591747, "deviation-center-line": 0.8954064824764659}, "ep003": {"driven_any": 1.9333780766102693, "driven_lanedir": 1.9200788676514409, "in-drivable-lane": 0, "deviation-heading": 0.8791768257264414, "deviation-center-line": 0.8333370531576382}, "ep004": {"driven_any": 1.9333757141071009, "driven_lanedir": 1.345926520774653, "in-drivable-lane": 4.40000000000002, "deviation-heading": 2.855112249576862, "deviation-center-line": 0.58835431142482}}
No reset possible 10712745Anton Mashikhin AI DL RL MML XXXL 2k18 yoo aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-202332018-11-18 11:54:08+00:00 2018-11-18 12:04:44+00:00 0:10:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106951143Krishna Murthy Jatavallabhula gym_duckietown + opencv aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-202332018-11-18 11:50:37+00:00 2018-11-18 11:54:01+00:00 0:03:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10692308Andrea Censi PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-202332018-11-18 11:49:52+00:00 2018-11-18 11:50:24+00:00 0:00:32 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106851269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-202332018-11-18 11:02:29+00:00 2018-11-18 11:05:50+00:00 0:03:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1858751062372497 deviation-center-line_median 0.563832971626301 in-drivable-lane_median 0
other stats deviation-center-line_max 1.171904084883277 deviation-center-line_mean 0.6539107884903486 deviation-center-line_min 0.24020081309801997 deviation-heading_max 3.0057576388028675 deviation-heading_mean 1.5424166222765243 deviation-heading_median 1.7568368852682044 deviation-heading_min 0.2120145709685025 driven_any_max 2.881829737813101 driven_any_mean 1.5227547131437291 driven_any_median 1.3207264084194723 driven_any_min 0.3081525678993841 driven_lanedir_max 2.566276890528922 driven_lanedir_mean 1.353809568945074 driven_lanedir_min 0.30220264994404955 in-drivable-lane_max 0.7666666666666639 in-drivable-lane_mean 0.2999999999999995 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.2732605836701687, "driven_lanedir": 1.899170232720776, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 3.0057576388028675, "deviation-center-line": 0.7382793824375652}, "ep001": {"driven_any": 0.3081525678993841, "driven_lanedir": 0.30220264994404955, "in-drivable-lane": 0, "deviation-heading": 0.2120145709685025, "deviation-center-line": 0.24020081309801997}, "ep002": {"driven_any": 1.3207264084194723, "driven_lanedir": 1.1858751062372497, "in-drivable-lane": 0, "deviation-heading": 2.2534935478285467, "deviation-center-line": 0.5553366904065802}, "ep003": {"driven_any": 2.881829737813101, "driven_lanedir": 2.566276890528922, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.7568368852682044, "deviation-center-line": 1.171904084883277}, "ep004": {"driven_any": 0.8298042679165203, "driven_lanedir": 0.8155229652943727, "in-drivable-lane": 0, "deviation-heading": 0.4839804685145004, "deviation-center-line": 0.563832971626301}}
No reset possible 106731269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-202332018-11-18 11:00:52+00:00 2018-11-18 11:01:58+00:00 0:01:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106701269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-202332018-11-18 11:00:17+00:00 2018-11-18 11:00:38+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.066666666666649
other stats episodes details {"ep000": {"nsteps": 366, "reward": -2.8605892974333647, "good_angle": 1.0505563586293576, "survival_time": 12.199999999999967, "traveled_tiles": 4, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 68, "reward": -15.262957413845202, "good_angle": 0.07264626603606153, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.13333333333333286}, "ep002": {"nsteps": 242, "reward": -4.316510446161111, "good_angle": 0.7448688903986106, "survival_time": 8.066666666666649, "traveled_tiles": 3, "valid_direction": 1.1333333333333302}, "ep003": {"nsteps": 500, "reward": -0.28015136850846467, "good_angle": 0.36737863546305544, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 185, "reward": -5.872051970217679, "good_angle": 0.12052446599570546, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}good_angle_max 1.0505563586293576 good_angle_mean 0.47119492330455814 good_angle_median 0.36737863546305544 good_angle_min 0.07264626603606153 reward_max -0.28015136850846467 reward_mean -5.718452099233165 reward_median -4.316510446161111 reward_min -15.262957413845202 survival_time_max 16.666666666666654 survival_time_mean 9.07333333333332 survival_time_min 2.2666666666666684 traveled_tiles_max 6 traveled_tiles_mean 3.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.5999999999999943 valid_direction_mean 0.7866666666666641 valid_direction_median 0.8333333333333304 valid_direction_min 0.13333333333333286
No reset possible
Andrea Censi 🇨🇭
