Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 113961308Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no idsc-rudolf-183282018-11-21 21:52:56+00:00 2018-11-21 21:55:33+00:00 0:02:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11388942Claudio Ruch Python template aido1_amod_service_quality_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-21 20:58:51+00:00 2018-11-21 20:59:11+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
service_quality -32.87038394834193
other stats efficiency -64.14325579336746 fleet_size -1000000000
No reset possible 11382945Claudio Ruch Python template aido1_amod_fleet_size_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-21 20:57:56+00:00 2018-11-21 20:58:12+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats efficiency -63.45590163968151 service_quality -32.5813154099211
No reset possible 11366945Claudio Ruch Python template aido1_amod_fleet_size_r1-v3step1-simulation success yes idsc-rudolf-183282018-11-21 20:53:26+00:00 2018-11-21 20:57:48+00:00 0:04:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11357950Claudio Ruch Funky Controller 1 aido1_amod_efficiency_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-21 20:51:43+00:00 2018-11-21 20:53:19+00:00 0:01:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -73.71543919268404
other stats fleet_size -1000000000 service_quality -35.358429798170974
No reset possible 11347212Andrea Censi Python template aido1_amod_efficiency_r1-v3step2-scoring success yes idsc-rudolf-183282018-11-21 20:51:12+00:00 2018-11-21 20:51:33+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -64.05881123584692
other stats fleet_size -1000000000 service_quality -32.88480280896185
No reset possible 11342210Andrea Censi Python template aido1_amod_service_quality_r1-v3step1-simulation success yes idsc-rudolf-183282018-11-21 20:46:42+00:00 2018-11-21 20:51:05+00:00 0:04:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113331067Claudio Ruch Webinar Algorithm aido1_amod_service_quality_r1-v3step1-simulation error yes idsc-rudolf-183282018-11-21 20:35:30+00:00 2018-11-21 20:46:33+00:00 0:11:03 Timeout:
Waited 601 [...] Timeout:
Waited 601.927587032 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113201078Claudio Ruch Big Fleet Controller aido1_amod_fleet_size_r1-v3step1-simulation error yes idsc-rudolf-183282018-11-21 20:24:01+00:00 2018-11-21 20:35:20+00:00 0:11:19 Timeout:
Waited 601 [...] Timeout:
Waited 601.661817074 for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 113091307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-21 10:21:40+00:00 2018-11-21 10:23:20+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2272303180768307 deviation-center-line_median 0.20681915361280567 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3568243903921427 deviation-center-line_mean 0.2339024184529846 deviation-center-line_min 0.12317304458368264 deviation-heading_max 1.7477521518583374 deviation-heading_mean 0.8385864351768578 deviation-heading_median 0.625932399356574 deviation-heading_min 0.4663073293798452 driven_any_max 0.7928832038719099 driven_any_mean 0.3442899087143174 driven_any_median 0.2464303825004456 driven_any_min 0.16427501307806475 driven_lanedir_max 0.5568157761076884 driven_lanedir_mean 0.28308198639260274 driven_lanedir_min 0.1488538314418193 in-drivable-lane_max 1.8666666666666691 in-drivable-lane_mean 0.37333333333333385 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7928832038719099, "driven_lanedir": 0.5568157761076884, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7477521518583374, "deviation-center-line": 0.3451234776069457}, "ep001": {"driven_any": 0.3285759873680623, "driven_lanedir": 0.3206965291801671, "in-drivable-lane": 0, "deviation-heading": 0.4663073293798452, "deviation-center-line": 0.3568243903921427}, "ep002": {"driven_any": 0.16427501307806475, "driven_lanedir": 0.1488538314418193, "in-drivable-lane": 0, "deviation-heading": 0.5559356998062136, "deviation-center-line": 0.137572026069346}, "ep003": {"driven_any": 0.18928495675310453, "driven_lanedir": 0.16181347715650807, "in-drivable-lane": 0, "deviation-heading": 0.7970045954833189, "deviation-center-line": 0.12317304458368264}, "ep004": {"driven_any": 0.2464303825004456, "driven_lanedir": 0.2272303180768307, "in-drivable-lane": 0, "deviation-heading": 0.625932399356574, "deviation-center-line": 0.20681915361280567}}
No reset possible 113031307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-21 10:20:32+00:00 2018-11-21 10:21:31+00:00 0:00:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112951307Tina Chu ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-21 10:19:58+00:00 2018-11-21 10:20:20+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.366666666666668
other stats episodes details {"ep000": {"nsteps": 224, "reward": -4.614468659430713, "good_angle": 0.736912173000433, "survival_time": 7.46666666666665, "traveled_tiles": 2, "valid_direction": 1.099999999999996}, "ep001": {"nsteps": 94, "reward": -11.249216741703924, "good_angle": 0.19649234145495015, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 0.29999999999999893}, "ep002": {"nsteps": 48, "reward": -21.30313229933381, "good_angle": 0.36602712571830665, "survival_time": 1.6000000000000016, "traveled_tiles": 2, "valid_direction": 0.6666666666666681}, "ep003": {"nsteps": 55, "reward": -18.556428309191357, "good_angle": 0.6146218368799753, "survival_time": 1.8333333333333357, "traveled_tiles": 1, "valid_direction": 0.6666666666666687}, "ep004": {"nsteps": 71, "reward": -14.55548485525897, "good_angle": 0.42671573150912695, "survival_time": 2.366666666666668, "traveled_tiles": 1, "valid_direction": 0.6333333333333326}}good_angle_max 0.736912173000433 good_angle_mean 0.4681538417125584 good_angle_median 0.42671573150912695 good_angle_min 0.19649234145495015 reward_max -4.614468659430713 reward_mean -14.055746172983756 reward_median -14.55548485525897 reward_min -21.30313229933381 survival_time_max 7.46666666666665 survival_time_mean 3.2799999999999976 survival_time_min 1.6000000000000016 traveled_tiles_max 2 traveled_tiles_mean 1.4 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 1.099999999999996 valid_direction_mean 0.6733333333333329 valid_direction_median 0.6666666666666681 valid_direction_min 0.29999999999999893
No reset possible 112851306Tri Cao Baseline solution using imitation learning from logs aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-20 18:41:55+00:00 2018-11-20 18:44:10+00:00 0:02:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112631305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-20 14:36:31+00:00 2018-11-20 14:41:28+00:00 0:04:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 8.466416467829077 deviation-center-line_median 0.7491075821771831 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 1.0852097769842697 deviation-center-line_mean 0.6828056697229344 deviation-center-line_min 0.110456458929874 deviation-heading_max 3.088169914104725 deviation-heading_mean 1.9361613489916736 deviation-heading_median 1.9716545225234337 deviation-heading_min 0.5532418461875583 driven_any_max 9.395397994412496 driven_any_mean 6.118783919231438 driven_any_median 8.673270359145661 driven_any_min 1.2271279931045092 driven_lanedir_max 9.106972393834644 driven_lanedir_mean 5.887907266761421 driven_lanedir_min 1.1523564491476126 in-drivable-lane_max 0.6999999999999994 in-drivable-lane_mean 0.19999999999999968 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 9.13343633823087, "driven_lanedir": 8.632442293612678, "in-drivable-lane": 0.6999999999999994, "deviation-heading": 2.9109849023974417, "deviation-center-line": 1.0852097769842697}, "ep001": {"driven_any": 2.164686911263656, "driven_lanedir": 2.0813487293830906, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.1567555597452082, "deviation-center-line": 0.3937472257413113}, "ep002": {"driven_any": 1.2271279931045092, "driven_lanedir": 1.1523564491476126, "in-drivable-lane": 0, "deviation-heading": 0.5532418461875583, "deviation-center-line": 0.110456458929874}, "ep003": {"driven_any": 9.395397994412496, "driven_lanedir": 9.106972393834644, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 3.088169914104725, "deviation-center-line": 1.0755073047820347}, "ep004": {"driven_any": 8.673270359145661, "driven_lanedir": 8.466416467829077, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.9716545225234337, "deviation-center-line": 0.7491075821771831}}
No reset possible 112541305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-20 14:34:19+00:00 2018-11-20 14:34:44+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 14.999999999999956
other stats episodes details {"ep000": {"nsteps": 496, "reward": -2.0943019221591648, "good_angle": 0.7418744038601746, "survival_time": 16.533333333333314, "traveled_tiles": 15, "valid_direction": 2.0999999999999934}, "ep001": {"nsteps": 157, "reward": -6.806706450876608, "good_angle": 14.159941219201931, "survival_time": 5.2333333333333245, "traveled_tiles": 5, "valid_direction": 2.0999999999999996}, "ep002": {"nsteps": 59, "reward": -17.04080068322009, "good_angle": 0.15271570187640776, "survival_time": 1.9666666666666697, "traveled_tiles": 3, "valid_direction": 0.33333333333333437}, "ep003": {"nsteps": 500, "reward": 0.02414321799436584, "good_angle": 0.6871705559821161, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.1333333333333302}, "ep004": {"nsteps": 450, "reward": -2.2807499980605725, "good_angle": 35.64433197185651, "survival_time": 14.999999999999956, "traveled_tiles": 17, "valid_direction": 4.83333333333332}}good_angle_max 35.64433197185651 good_angle_mean 10.277206770555429 good_angle_median 0.7418744038601746 good_angle_min 0.15271570187640776 reward_max 0.02414321799436584 reward_mean -5.639683167264414 reward_median -2.2807499980605725 reward_min -17.04080068322009 survival_time_max 16.666666666666654 survival_time_mean 11.079999999999984 survival_time_min 1.9666666666666697 traveled_tiles_max 17 traveled_tiles_mean 11.2 traveled_tiles_median 15 traveled_tiles_min 3 valid_direction_max 4.83333333333332 valid_direction_mean 2.0999999999999956 valid_direction_median 2.0999999999999934 valid_direction_min 0.33333333333333437
No reset possible 112481305Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-20 14:29:29+00:00 2018-11-20 14:33:58+00:00 0:04:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112421303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-20 14:00:58+00:00 2018-11-20 14:05:25+00:00 0:04:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.247947866530568 deviation-center-line_median 0.4327948281734701 in-drivable-lane_median 0.33333333333333215
other stats deviation-center-line_max 0.8951573984927605 deviation-center-line_mean 0.5294639676056159 deviation-center-line_min 0.2553864082264141 deviation-heading_max 2.5086434238842648 deviation-heading_mean 1.7176914721650511 deviation-heading_median 1.3764712107670771 deviation-heading_min 0.935815621123276 driven_any_max 9.83643308694634 driven_any_mean 5.49635327088284 driven_any_median 4.3797351459243234 driven_any_min 2.1044204655967538 driven_lanedir_max 9.247955113262256 driven_lanedir_mean 5.215254784547498 driven_lanedir_min 1.8076115267915815 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.3466666666666658 in-drivable-lane_min 0.033333333333333215 per-episodes details {"ep000": {"driven_any": 2.4350440530543422, "driven_lanedir": 2.1641183480391843, "in-drivable-lane": 0.5, "deviation-heading": 0.935815621123276, "deviation-center-line": 0.2553864082264141}, "ep001": {"driven_any": 2.1044204655967538, "driven_lanedir": 1.8076115267915815, "in-drivable-lane": 0.33333333333333215, "deviation-heading": 1.3764712107670771, "deviation-center-line": 0.3623346537121123}, "ep002": {"driven_any": 9.83643308694634, "driven_lanedir": 9.247955113262256, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 2.4644149719140565, "deviation-center-line": 0.8951573984927605}, "ep003": {"driven_any": 4.3797351459243234, "driven_lanedir": 4.247947866530568, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.3031121331365825, "deviation-center-line": 0.4327948281734701}, "ep004": {"driven_any": 8.726133602892439, "driven_lanedir": 8.608641068113897, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.5086434238842648, "deviation-center-line": 0.701646549423322}}
No reset possible 112271304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-20 13:51:17+00:00 2018-11-20 13:55:33+00:00 0:04:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 112211304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-20 13:49:27+00:00 2018-11-20 13:49:51+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.025241015423089267, "good_angle": 0.5660956539852379, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.3333333333333302}, "ep001": {"nsteps": 500, "reward": -0.3052277488233522, "good_angle": 41.3027307319338, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.600000000000018}, "ep002": {"nsteps": 500, "reward": -0.10230048004770652, "good_angle": 0.6659104569093917, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 1.9666666666666597}, "ep003": {"nsteps": 500, "reward": -0.06712517729547107, "good_angle": 0.4061192818354377, "survival_time": 16.666666666666654, "traveled_tiles": 16, "valid_direction": 0.9333333333333308}, "ep004": {"nsteps": 500, "reward": -0.3235300897718407, "good_angle": 41.2754370289088, "survival_time": 16.666666666666654, "traveled_tiles": 17, "valid_direction": 5.099999999999985}}good_angle_max 41.3027307319338 good_angle_mean 16.843258630714534 good_angle_median 0.6659104569093917 good_angle_min 0.4061192818354377 reward_max -0.025241015423089267 reward_mean -0.16468490227229196 reward_median -0.10230048004770652 reward_min -0.3235300897718407 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 17 traveled_tiles_mean 16.4 traveled_tiles_median 16 traveled_tiles_min 16 valid_direction_max 5.600000000000018 valid_direction_mean 2.986666666666665 valid_direction_median 1.9666666666666597 valid_direction_min 0.9333333333333308
No reset possible 112141304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-20 13:41:08+00:00 2018-11-20 13:49:09+00:00 0:08:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111981303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-20 13:25:58+00:00 2018-11-20 13:28:39+00:00 0:02:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111941303Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-20 13:25:21+00:00 2018-11-20 13:25:44+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 7.333333333333317
other stats episodes details {"ep000": {"nsteps": 135, "reward": -7.617946757625624, "good_angle": 0.24914791547711929, "survival_time": 4.499999999999994, "traveled_tiles": 5, "valid_direction": 0.5999999999999985}, "ep001": {"nsteps": 149, "reward": -7.085851560353032, "good_angle": 10.035174620388348, "survival_time": 4.966666666666659, "traveled_tiles": 5, "valid_direction": 1.8999999999999992}, "ep002": {"nsteps": 500, "reward": -0.12116984189208596, "good_angle": 0.6114449517312698, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.6333333333333275}, "ep003": {"nsteps": 220, "reward": -4.690160607782045, "good_angle": 0.18338344049862731, "survival_time": 7.333333333333317, "traveled_tiles": 8, "valid_direction": 0.3999999999999986}, "ep004": {"nsteps": 500, "reward": -0.31342388660390863, "good_angle": 33.864049863006905, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 4.833333333333349}}good_angle_max 33.864049863006905 good_angle_mean 8.988640158220454 good_angle_median 0.6114449517312698 good_angle_min 0.18338344049862731 reward_max -0.12116984189208596 reward_mean -3.9657105308513385 reward_median -4.690160607782045 reward_min -7.617946757625624 survival_time_max 16.666666666666654 survival_time_mean 10.026666666666651 survival_time_min 4.499999999999994 traveled_tiles_max 18 traveled_tiles_mean 10.8 traveled_tiles_median 8 traveled_tiles_min 5 valid_direction_max 4.833333333333349 valid_direction_mean 1.8733333333333348 valid_direction_median 1.6333333333333275 valid_direction_min 0.3999999999999986
No reset possible 111791302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-20 12:15:36+00:00 2018-11-20 12:17:38+00:00 0:02:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.5323895106250947 deviation-center-line_median 0.2069133082272764 in-drivable-lane_median 1.7666666666666604
other stats deviation-center-line_max 0.5467131081696794 deviation-center-line_mean 0.2602226065031052 deviation-center-line_min 0.109306961893104 deviation-heading_max 1.742323630223919 deviation-heading_mean 1.1567573530878712 deviation-heading_median 1.3282976503274275 deviation-heading_min 0.24355646859871627 driven_any_max 2.1899668958618665 driven_any_mean 0.991835190048022 driven_any_median 0.9696925230542558 driven_any_min 0.3178171092322331 driven_lanedir_max 0.7169311640978855 driven_lanedir_mean 0.45386049169510273 driven_lanedir_min 0.04178689899496413 in-drivable-lane_max 6.533333333333311 in-drivable-lane_mean 2.1733333333333262 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3178171092322331, "driven_lanedir": 0.04178689899496413, "in-drivable-lane": 0.633333333333334, "deviation-heading": 1.3282976503274275, "deviation-center-line": 0.109306961893104}, "ep001": {"driven_any": 1.1502565226532864, "driven_lanedir": 0.6512425203302821, "in-drivable-lane": 1.7666666666666604, "deviation-heading": 1.5861269978141073, "deviation-center-line": 0.30358180641808197}, "ep002": {"driven_any": 0.3314428994384689, "driven_lanedir": 0.32695236442728737, "in-drivable-lane": 0, "deviation-heading": 0.24355646859871627, "deviation-center-line": 0.1345978478073843}, "ep003": {"driven_any": 2.1899668958618665, "driven_lanedir": 0.7169311640978855, "in-drivable-lane": 6.533333333333311, "deviation-heading": 1.742323630223919, "deviation-center-line": 0.5467131081696794}, "ep004": {"driven_any": 0.9696925230542558, "driven_lanedir": 0.5323895106250947, "in-drivable-lane": 1.9333333333333265, "deviation-heading": 0.8834820184751857, "deviation-center-line": 0.2069133082272764}}
No reset possible 111641302Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-20 12:04:48+00:00 2018-11-20 12:08:22+00:00 0:03:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111541301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-20 11:22:20+00:00 2018-11-20 11:24:00+00:00 0:01:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111481301Anton Mashikhin Template for ROS Submission aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-20 11:20:36+00:00 2018-11-20 11:20:57+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.033333333333329
other stats episodes details {"ep000": {"nsteps": 60, "reward": -16.986505389073862, "good_angle": 0.9061986341032228, "survival_time": 2.0000000000000027, "traveled_tiles": 1, "valid_direction": 1.7666666666666693}, "ep001": {"nsteps": 175, "reward": -7.165024964154831, "good_angle": 16.00891330525849, "survival_time": 5.833333333333322, "traveled_tiles": 2, "valid_direction": 3.9333333333333234}, "ep002": {"nsteps": 121, "reward": -8.572560073753957, "good_angle": 0.1181062316229642, "survival_time": 4.033333333333329, "traveled_tiles": 3, "valid_direction": 0.13333333333333286}, "ep003": {"nsteps": 183, "reward": -6.431596156241515, "good_angle": 1.08940483738514, "survival_time": 6.099999999999988, "traveled_tiles": 3, "valid_direction": 3.099999999999989}, "ep004": {"nsteps": 28, "reward": -36.25624855714185, "good_angle": 0.18152285177428645, "survival_time": 0.9333333333333332, "traveled_tiles": 1, "valid_direction": 0.4666666666666666}}good_angle_max 16.00891330525849 good_angle_mean 3.66082917202882 good_angle_median 0.9061986341032228 good_angle_min 0.1181062316229642 reward_max -6.431596156241515 reward_mean -15.082387028073205 reward_median -8.572560073753957 reward_min -36.25624855714185 survival_time_max 6.099999999999988 survival_time_mean 3.779999999999995 survival_time_min 0.9333333333333332 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.9333333333333234 valid_direction_mean 1.879999999999996 valid_direction_median 1.7666666666666693 valid_direction_min 0.13333333333333286
No reset possible 111371300Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-20 10:25:44+00:00 2018-11-20 10:26:24+00:00 0:00:40 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 89, in solve
cis.info('Logging. %s %s %s ' % (str(env.unwrapped.robot_speed), str(env.unwrapped.cur_pos), str(env.unwrapped.cur_angle)))
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'robot_speed'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111281299Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-20 10:19:42+00:00 2018-11-20 10:20:26+00:00 0:00:44 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
AttributeError: 'module' object has no attribute 'UndistortWrapper'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111151298Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-20 10:14:12+00:00 2018-11-20 10:15:03+00:00 0:00:51 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 128, in run
solve(params, cis)
File "solution.py", line 73, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
File "/workspace/wrappers.py", line 392, in __init__
assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 111061297Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-20 09:54:47+00:00 2018-11-20 10:03:27+00:00 0:08:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 4.051829096858754 deviation-center-line_median 0.92971426400998 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.942361718872175 deviation-center-line_mean 0.8572808146222097 deviation-center-line_min 0.6352737923652181 deviation-heading_max 4.154968182851831 deviation-heading_mean 3.0043615237383805 deviation-heading_median 3.2100480227248354 deviation-heading_min 1.448995458537678 driven_any_max 4.685052912313802 driven_any_mean 4.268651858623994 driven_any_median 4.270000785139785 driven_any_min 3.6056512932929903 driven_lanedir_max 4.666314634594814 driven_lanedir_mean 4.092641922881887 driven_lanedir_min 3.3140298965753785 in-drivable-lane_max 1.2666666666666664 in-drivable-lane_mean 0.3999999999999994 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.270000785139785, "driven_lanedir": 3.9149195004453623, "in-drivable-lane": 1.2666666666666664, "deviation-heading": 3.4530617576225806, "deviation-center-line": 0.92971426400998}, "ep001": {"driven_any": 3.6056512932929903, "driven_lanedir": 3.3140298965753785, "in-drivable-lane": 0.5666666666666647, "deviation-heading": 4.154968182851831, "deviation-center-line": 0.942361718872175}, "ep002": {"driven_any": 4.151214909073667, "driven_lanedir": 4.051829096858754, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 2.7547341969549755, "deviation-center-line": 0.8444769561548144}, "ep003": {"driven_any": 4.631339393299723, "driven_lanedir": 4.516116485935129, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 3.2100480227248354, "deviation-center-line": 0.9345773417088612}, "ep004": {"driven_any": 4.685052912313802, "driven_lanedir": 4.666314634594814, "in-drivable-lane": 0, "deviation-heading": 1.448995458537678, "deviation-center-line": 0.6352737923652181}}
No reset possible 110811296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-19 19:08:32+00:00 2018-11-19 19:08:53+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.13191250260279047, "good_angle": 0.9342887944446808, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.233333333333327}, "ep001": {"nsteps": 500, "reward": -0.3301688215431059, "good_angle": 31.76286504283027, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 5.76666666666666}, "ep002": {"nsteps": 500, "reward": -0.025698846134357155, "good_angle": 0.711488019133847, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 1.86666666666666}, "ep003": {"nsteps": 500, "reward": -0.13875287239276804, "good_angle": 0.7780243634004977, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.933333333333341}, "ep004": {"nsteps": 500, "reward": -0.3089834259635536, "good_angle": 37.28687603320567, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.599999999999984}}good_angle_max 37.28687603320567 good_angle_mean 14.294708450602991 good_angle_median 0.9342887944446808 good_angle_min 0.711488019133847 reward_max -0.025698846134357155 reward_mean -0.18710329372731505 reward_median -0.13875287239276804 reward_min -0.3301688215431059 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 10 traveled_tiles_mean 8.8 traveled_tiles_median 9 traveled_tiles_min 8 valid_direction_max 5.76666666666666 valid_direction_mean 3.279999999999994 valid_direction_median 2.233333333333327 valid_direction_min 1.86666666666666
No reset possible 110801296Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-19 19:01:07+00:00 2018-11-19 19:08:24+00:00 0:07:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110691295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-19 18:45:51+00:00 2018-11-19 18:51:12+00:00 0:05:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 3.910996529633443 deviation-center-line_median 0.804829668110413 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 1.039879518692922 deviation-center-line_mean 0.7667227890186241 deviation-center-line_min 0.3222291105867537 deviation-heading_max 3.2571936050662273 deviation-heading_mean 2.1809540644258907 deviation-heading_median 2.6458401641549094 deviation-heading_min 0.9822962818116744 driven_any_max 5.123266602593036 driven_any_mean 3.5595592135593237 driven_any_median 4.272131146626368 driven_any_min 1.5077016675170083 driven_lanedir_max 5.10905363944258 driven_lanedir_mean 3.432994515958099 driven_lanedir_min 1.4595445026629377 in-drivable-lane_max 1.0999999999999994 in-drivable-lane_mean 0.25999999999999973 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 4.272131146626368, "driven_lanedir": 3.910996529633443, "in-drivable-lane": 1.0999999999999994, "deviation-heading": 3.2571936050662273, "deviation-center-line": 1.039879518692922}, "ep001": {"driven_any": 2.1447119551227667, "driven_lanedir": 2.0224400944249012, "in-drivable-lane": 0.13333333333333286, "deviation-heading": 2.6585454794779535, "deviation-center-line": 0.7527271103559265}, "ep002": {"driven_any": 1.5077016675170083, "driven_lanedir": 1.4595445026629377, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3608947916186889, "deviation-center-line": 0.3222291105867537}, "ep003": {"driven_any": 4.74998469593744, "driven_lanedir": 4.66293781362663, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 2.6458401641549094, "deviation-center-line": 0.804829668110413}, "ep004": {"driven_any": 5.123266602593036, "driven_lanedir": 5.10905363944258, "in-drivable-lane": 0, "deviation-heading": 0.9822962818116744, "deviation-center-line": 0.9139485373471052}}
No reset possible 110541295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-19 18:43:26+00:00 2018-11-19 18:45:17+00:00 0:01:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110491295Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-19 18:42:47+00:00 2018-11-19 18:43:07+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.12137116433726625, "good_angle": 1.0419096888881556, "survival_time": 16.666666666666654, "traveled_tiles": 8, "valid_direction": 2.633333333333326}, "ep001": {"nsteps": 303, "reward": -3.62843049893931, "good_angle": 15.400139654029603, "survival_time": 10.099999999999977, "traveled_tiles": 5, "valid_direction": 3.1666666666666554}, "ep002": {"nsteps": 186, "reward": -5.627489280993975, "good_angle": 0.27681601352758295, "survival_time": 6.199999999999988, "traveled_tiles": 4, "valid_direction": 0.7333333333333307}, "ep003": {"nsteps": 500, "reward": -0.18406181560666304, "good_angle": 0.7270384677449752, "survival_time": 16.666666666666654, "traveled_tiles": 9, "valid_direction": 1.6666666666666732}, "ep004": {"nsteps": 500, "reward": -0.04293484631704632, "good_angle": 40.92457506370659, "survival_time": 16.666666666666654, "traveled_tiles": 10, "valid_direction": 4.633333333333317}}good_angle_max 40.92457506370659 good_angle_mean 11.674095777579382 good_angle_median 1.0419096888881556 good_angle_min 0.27681601352758295 reward_max -0.04293484631704632 reward_mean -1.920857521238852 reward_median -0.18406181560666304 reward_min -5.627489280993975 survival_time_max 16.666666666666654 survival_time_mean 13.259999999999986 survival_time_min 6.199999999999988 traveled_tiles_max 10 traveled_tiles_mean 7.2 traveled_tiles_median 8 traveled_tiles_min 4 valid_direction_max 4.633333333333317 valid_direction_mean 2.56666666666666 valid_direction_median 2.633333333333326 valid_direction_min 0.7333333333333307
No reset possible 110411294Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-19 15:59:50+00:00 2018-11-19 16:00:33+00:00 0:00:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 126, in run
solve(params, cis)
File "solution.py", line 72, in solve
env = make_env(config, debug=debug)
File "solution.py", line 38, in make_env
env = wrp.Act(wrp.ChannelsFirstWrapper(wrp.FrameStack(wrp.PreprocessFrameWrapper(wrp.UndistortWrapper(wrp.SkipEnv(env, skip=config['frame_skip']))))))
File "/workspace/wrappers.py", line 392, in __init__
assert env.unwrapped.distortion, "Distortion is false, no need for this wrapper"
AttributeError: 'SimpleSimAgentEnv' object has no attribute 'distortion'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110341293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step4-viz success no idsc-rudolf-183282018-11-19 13:55:35+00:00 2018-11-19 13:59:12+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
deviation-center-line_median 0.44433964314315433 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.5512591199175949 deviation-center-line_mean 0.4645859205989189 deviation-center-line_min 0.39335855914159346 deviation-heading_max 3.5598471575751542 deviation-heading_mean 1.764030711792994 deviation-heading_median 1.381299485180658 deviation-heading_min 1.1199561623878598 driven_any_max 1.49079583364818 driven_any_mean 1.1297417190774648 driven_any_median 1.2306824401524008 driven_any_min 0.6871560381108496 driven_lanedir_max 1.450214316231856 driven_lanedir_mean 0.9909222089183176 driven_lanedir_median 1.1890923792085335 driven_lanedir_min 0.1581492283862641 in-drivable-lane_max 2.7333333333333316 in-drivable-lane_mean 0.5599999999999996 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.6871560381108496, "driven_lanedir": 0.1581492283862641, "in-drivable-lane": 2.7333333333333316, "deviation-heading": 3.5598471575751542, "deviation-center-line": 0.4027841572493933}, "ep001": {"driven_any": 0.8036306246797625, "driven_lanedir": 0.7607355319904787, "in-drivable-lane": 0, "deviation-heading": 1.1199561623878598, "deviation-center-line": 0.39335855914159346}, "ep002": {"driven_any": 1.2306824401524008, "driven_lanedir": 1.1890923792085335, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.381299485180658, "deviation-center-line": 0.5512591199175949}, "ep003": {"driven_any": 1.49079583364818, "driven_lanedir": 1.450214316231856, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3004450133719043, "deviation-center-line": 0.5311881235428586}, "ep004": {"driven_any": 1.4364436587961311, "driven_lanedir": 1.3964195887744555, "in-drivable-lane": 0, "deviation-heading": 1.458605740449393, "deviation-center-line": 0.44433964314315433}}
No reset possible 110291293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step3-videos success yes idsc-rudolf-183282018-11-19 13:53:55+00:00 2018-11-19 13:55:27+00:00 0:01:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110201293Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation success no idsc-rudolf-183282018-11-19 13:47:40+00:00 2018-11-19 13:52:04+00:00 0:04:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110111292Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-19 13:32:02+00:00 2018-11-19 13:32:36+00:00 0:00:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 280, in __init__
self.cur_pos = self._env.cur_pos
AttributeError: 'TimeLimit' object has no attribute 'cur_pos'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 110091291Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-19 13:29:36+00:00 2018-11-19 13:30:18+00:00 0:00:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 124, in run
solve(params, cis)
File "solution.py", line 69, in solve
env = make_env(config, debug=debug)
File "solution.py", line 40, in make_env
env = BaseWrapper(env)
File "/workspace/wrappers.py", line 278, in __init__
super().__init__(env)
TypeError: super() takes at least 1 argument (0 given)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109791288Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-19 09:36:36+00:00 2018-11-19 09:47:02+00:00 0:10:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109751286Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-19 09:21:27+00:00 2018-11-19 09:22:03+00:00 0:00:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 120, in run
solve(params, cis)
File "solution.py", line 68, in solve
env = make_env(config, debug=debug)
File "solution.py", line 37, in make_env
env = FrameStackWrappper(env=env, k=3, config=config)
File "/workspace/wrappers.py", line 89, in __init__
self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'],
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
return _load(f, map_location, pickle_module)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
result = unpickler.load()
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
data_type(size), location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
result = fn(storage, location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109701285Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-19 09:18:46+00:00 2018-11-19 09:19:23+00:00 0:00:37 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 120, in run
solve(params, cis)
File "solution.py", line 68, in solve
env = make_env(config, debug=debug)
File "solution.py", line 37, in make_env
env = FrameStackWrappper(env=env, k=3, config=config)
File "/workspace/wrappers.py", line 89, in __init__
self.seg_model.load_state_dict(torch.load(config['use_segmentation_weight'])['state_dict'])
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 358, in load
return _load(f, map_location, pickle_module)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 542, in _load
result = unpickler.load()
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 508, in persistent_load
data_type(size), location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 104, in default_restore_location
result = fn(storage, location)
File "/opt/conda/lib/python2.7/site-packages/torch/serialization.py", line 75, in _cuda_deserialize
raise RuntimeError('Attempting to deserialize object on a CUDA '
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location='cpu' to map your storages to the CPU.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 109571282Yun Chen PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-19 04:31:19+00:00 2018-11-19 04:36:25+00:00 0:05:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -1.05985247177248 deviation-center-line_median 0.32463013910329175 in-drivable-lane_median 8.23333333333332
other stats deviation-center-line_max 1.2229848197846576 deviation-center-line_mean 0.5013585011463242 deviation-center-line_min 0.18421462158296809 deviation-heading_max 6.639256027638261 deviation-heading_mean 6.130316773672168 deviation-heading_median 6.587348625790274 deviation-heading_min 4.253182461720226 driven_any_max 3.317636741607105 driven_any_mean 3.31763674160709 driven_any_median 3.317636741607098 driven_any_min 3.3176367416070653 driven_lanedir_max -0.8727849850798894 driven_lanedir_mean -1.0237415377242507 driven_lanedir_min -1.0652501105207834 in-drivable-lane_max 10.466666666666663 in-drivable-lane_mean 8.686666666666657 in-drivable-lane_min 8.233333333333318 per-episodes details {"ep000": {"driven_any": 3.317636741607105, "driven_lanedir": -0.8727849850798894, "in-drivable-lane": 10.466666666666663, "deviation-heading": 4.253182461720226, "deviation-center-line": 1.2229848197846576}, "ep001": {"driven_any": 3.3176367416070653, "driven_lanedir": -1.0585760658647092, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.639256027638261, "deviation-center-line": 0.4939995088117161}, "ep002": {"driven_any": 3.317636741607098, "driven_lanedir": -1.0622440553833916, "in-drivable-lane": 8.23333333333332, "deviation-heading": 6.60795448532735, "deviation-center-line": 0.28096341644898776}, "ep003": {"driven_any": 3.317636741607083, "driven_lanedir": -1.05985247177248, "in-drivable-lane": 8.266666666666653, "deviation-heading": 6.563842267884727, "deviation-center-line": 0.18421462158296809}, "ep004": {"driven_any": 3.3176367416071, "driven_lanedir": -1.0652501105207834, "in-drivable-lane": 8.233333333333318, "deviation-heading": 6.587348625790274, "deviation-center-line": 0.32463013910329175}}
No reset possible 109461282Yun Chen PyTorch template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-19 04:26:43+00:00 2018-11-19 04:29:12+00:00 0:02:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.966810409963131, "good_angle": 47.08330822850749, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 14.233333333333322}, "ep001": {"nsteps": 500, "reward": -1.300191262960434, "good_angle": 13.8317262841996, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.099999999999993}, "ep002": {"nsteps": 500, "reward": -1.117795492440462, "good_angle": 13.808909540839275, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.933333333333326}, "ep003": {"nsteps": 500, "reward": -0.9294596527849426, "good_angle": 13.819737231108473, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.96666666666666}, "ep004": {"nsteps": 500, "reward": -1.163820459574461, "good_angle": 13.824014957850544, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 13.09999999999999}}good_angle_max 47.08330822850749 good_angle_mean 20.473539248501076 good_angle_median 13.824014957850544 good_angle_min 13.808909540839275 reward_max -0.9294596527849426 reward_mean -1.0956154555446862 reward_median -1.117795492440462 reward_min -1.300191262960434 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 14.233333333333322 valid_direction_mean 13.266666666666657 valid_direction_median 13.09999999999999 valid_direction_min 12.933333333333326
No reset possible 109361281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-19 04:22:16+00:00 2018-11-19 04:25:13+00:00 0:02:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -0.1277084947325524 deviation-center-line_median 0.21813380591001513 in-drivable-lane_median 4.899999999999988
other stats deviation-center-line_max 0.380914912819748 deviation-center-line_mean 0.2305222638710954 deviation-center-line_min 0.08042209529634169 deviation-heading_max 6.695251918755404 deviation-heading_mean 2.968397790615076 deviation-heading_median 2.3803439804106667 deviation-heading_min 0.7340334522927733 driven_any_max 1.147514414161098 driven_any_mean 0.6321277046803103 driven_any_median 0.6292780798715786 driven_any_min 0.1451745708877611 driven_lanedir_max -0.03062263736441606 driven_lanedir_mean -0.16399291768892374 driven_lanedir_min -0.38661333766655104 in-drivable-lane_max 13.69999999999998 in-drivable-lane_mean 5.933333333333326 in-drivable-lane_min 1.0333333333333348 per-episodes details {"ep000": {"driven_any": 1.147514414161098, "driven_lanedir": -0.1277084947325524, "in-drivable-lane": 13.69999999999998, "deviation-heading": 2.3803439804106667, "deviation-center-line": 0.380914912819748}, "ep001": {"driven_any": 0.24250416908067615, "driven_lanedir": -0.0847419274714194, "in-drivable-lane": 1.9333333333333311, "deviation-heading": 1.408962372196319, "deviation-center-line": 0.1930310368565834}, "ep002": {"driven_any": 0.9961672894004376, "driven_lanedir": -0.38661333766655104, "in-drivable-lane": 8.099999999999996, "deviation-heading": 6.695251918755404, "deviation-center-line": 0.2801094684727889}, "ep003": {"driven_any": 0.6292780798715786, "driven_lanedir": -0.1902781912096798, "in-drivable-lane": 4.899999999999988, "deviation-heading": 3.6233972294202177, "deviation-center-line": 0.21813380591001513}, "ep004": {"driven_any": 0.1451745708877611, "driven_lanedir": -0.03062263736441606, "in-drivable-lane": 1.0333333333333348, "deviation-heading": 0.7340334522927733, "deviation-center-line": 0.08042209529634169}}
No reset possible 109211281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-19 04:11:11+00:00 2018-11-19 04:20:51+00:00 0:09:40 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108861280Yun Chen Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-19 03:47:25+00:00 2018-11-19 03:49:42+00:00 0:02:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 108771279Yun Chen ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-19 03:29:04+00:00 2018-11-19 03:30:48+00:00 0:01:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.2332896871989636 deviation-center-line_median 0.2116792544883902 in-drivable-lane_median 0
other stats deviation-center-line_max 0.6323564732185519 deviation-center-line_mean 0.2912504656486582 deviation-center-line_min 0.12670548452775535 deviation-heading_max 1.728976789403258 deviation-heading_mean 0.8194124233994693 deviation-heading_median 0.582523377361064 deviation-heading_min 0.4668112744530743 driven_any_max 1.0714883694442423 driven_any_mean 0.39858127916586666 driven_any_median 0.25000443206491196 driven_any_min 0.14641855465317552 driven_lanedir_max 0.8388467814636376 driven_lanedir_mean 0.33922668007033285 driven_lanedir_min 0.129237910180789 in-drivable-lane_max 1.9000000000000024 in-drivable-lane_mean 0.3800000000000005 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0714883694442423, "driven_lanedir": 0.8388467814636376, "in-drivable-lane": 1.9000000000000024, "deviation-heading": 1.728976789403258, "deviation-center-line": 0.6323564732185519}, "ep001": {"driven_any": 0.3250077317230347, "driven_lanedir": 0.31702584203169426, "in-drivable-lane": 0, "deviation-heading": 0.4668112744530743, "deviation-center-line": 0.35258484316877714}, "ep002": {"driven_any": 0.14641855465317552, "driven_lanedir": 0.129237910180789, "in-drivable-lane": 0, "deviation-heading": 0.582523377361064, "deviation-center-line": 0.12670548452775535}, "ep003": {"driven_any": 0.1999873079439689, "driven_lanedir": 0.17773317947657974, "in-drivable-lane": 0, "deviation-heading": 0.742904646059641, "deviation-center-line": 0.13292627283981628}, "ep004": {"driven_any": 0.25000443206491196, "driven_lanedir": 0.2332896871989636, "in-drivable-lane": 0, "deviation-heading": 0.5758460297203092, "deviation-center-line": 0.2116792544883902}}
No reset possible 108181271Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 13:52:23+00:00 2018-11-18 13:55:18+00:00 0:02:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1317915302969372 deviation-center-line_median 0.6743512715176876 in-drivable-lane_median 0.1999999999999993
other stats deviation-center-line_max 0.7762408815258576 deviation-center-line_mean 0.5626846477112066 deviation-center-line_min 0.20970474862945557 deviation-heading_max 4.509761849749127 deviation-heading_mean 2.4032842730881687 deviation-heading_median 1.9722356045778031 deviation-heading_min 0.46119004706021777 driven_any_max 1.6784777980539975 driven_any_mean 1.1794130246561294 driven_any_median 1.1774835000531658 driven_any_min 0.3715917677008975 driven_lanedir_max 1.6765159288409108 driven_lanedir_mean 0.9841876945010644 driven_lanedir_min 0.1602152995236219 in-drivable-lane_max 0.7666666666666639 in-drivable-lane_mean 0.3199999999999993 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3715917677008975, "driven_lanedir": 0.1602152995236219, "in-drivable-lane": 0.6333333333333332, "deviation-heading": 1.9722356045778031, "deviation-center-line": 0.20970474862945557}, "ep001": {"driven_any": 1.0636571696641892, "driven_lanedir": 0.6917513213822795, "in-drivable-lane": 0.1999999999999993, "deviation-heading": 4.509761849749127, "deviation-center-line": 0.7561787083427819}, "ep002": {"driven_any": 1.1774835000531658, "driven_lanedir": 1.1317915302969372, "in-drivable-lane": 0, "deviation-heading": 1.159371319469394, "deviation-center-line": 0.3969476285402502}, "ep003": {"driven_any": 1.6784777980539975, "driven_lanedir": 1.6765159288409108, "in-drivable-lane": 0, "deviation-heading": 0.46119004706021777, "deviation-center-line": 0.7762408815258576}, "ep004": {"driven_any": 1.6058548878083976, "driven_lanedir": 1.2606643924615717, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 3.913862544584301, "deviation-center-line": 0.6743512715176876}}
No reset possible 108121271Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 13:50:59+00:00 2018-11-18 13:51:20+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.49999999999998
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.594963072856634, "good_angle": 1.179753153433826, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 230, "reward": -5.431255984695062, "good_angle": 16.109426524471456, "survival_time": 7.666666666666649, "traveled_tiles": 2, "valid_direction": 3.9333333333333194}, "ep002": {"nsteps": 255, "reward": -4.346870108328614, "good_angle": 1.0142558554378145, "survival_time": 8.49999999999998, "traveled_tiles": 3, "valid_direction": 2.0999999999999934}, "ep003": {"nsteps": 361, "reward": -3.0704857812487516, "good_angle": 0.034109257356551625, "survival_time": 12.0333333333333, "traveled_tiles": 4, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.565080447820505, "good_angle": 21.142156874080055, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.9666666666666535}}good_angle_max 21.142156874080055 good_angle_mean 7.8959403329559406 good_angle_median 1.179753153433826 good_angle_min 0.034109257356551625 reward_max -3.0704857812487516 reward_mean -5.8017310789899135 reward_median -4.346870108328614 reward_min -12.594963072856634 survival_time_max 12.0333333333333 survival_time_mean 8.486666666666647 survival_time_min 2.7 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.9666666666666535 valid_direction_mean 2.4466666666666597 valid_direction_median 2.2333333333333334 valid_direction_min 0
No reset possible 108021271Andrea Censi Random execution aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 13:48:32+00:00 2018-11-18 13:50:44+00:00 0:02:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 107981270Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 13:45:23+00:00 2018-11-18 13:47:47+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.9394202467524176 deviation-center-line_median 0.5005461180613384 in-drivable-lane_median 0
other stats deviation-center-line_max 0.8019762026714526 deviation-center-line_mean 0.46453888385325126 deviation-center-line_min 0.21054410665275972 deviation-heading_max 3.827263075148643 deviation-heading_mean 1.494999243689109 deviation-heading_median 0.9923897161178532 deviation-heading_min 0.17098922103056 driven_any_max 1.6105203163952195 driven_any_mean 0.8935799240412866 driven_any_median 0.9415373933628172 driven_any_min 0.3657972991350469 driven_lanedir_max 1.2454280154214263 driven_lanedir_mean 0.7705575447787474 driven_lanedir_min 0.15506621419634292 in-drivable-lane_max 0.9999999999999964 in-drivable-lane_mean 0.3199999999999993 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3657972991350469, "driven_lanedir": 0.15506621419634292, "in-drivable-lane": 0.6, "deviation-heading": 2.0441369547682884, "deviation-center-line": 0.21054410665275972}, "ep001": {"driven_any": 0.37268928175592897, "driven_lanedir": 0.37189411852472865, "in-drivable-lane": 0, "deviation-heading": 0.17098922103056, "deviation-center-line": 0.2916484846388874}, "ep002": {"driven_any": 1.1773553295574206, "driven_lanedir": 1.1409791289988214, "in-drivable-lane": 0, "deviation-heading": 0.9923897161178532, "deviation-center-line": 0.5005461180613384}, "ep003": {"driven_any": 0.9415373933628172, "driven_lanedir": 0.9394202467524176, "in-drivable-lane": 0, "deviation-heading": 0.4402172513802, "deviation-center-line": 0.5179795072418177}, "ep004": {"driven_any": 1.6105203163952195, "driven_lanedir": 1.2454280154214263, "in-drivable-lane": 0.9999999999999964, "deviation-heading": 3.827263075148643, "deviation-center-line": 0.8019762026714526}}
No reset possible 107931270Andrea Censi Random execution aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 13:44:23+00:00 2018-11-18 13:45:14+00:00 0:00:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 107851270Andrea Censi Random execution aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 13:43:47+00:00 2018-11-18 13:44:07+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.799999999999986
other stats episodes details {"ep000": {"nsteps": 81, "reward": -12.59392248302767, "good_angle": 1.2156126068944273, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 2.2333333333333334}, "ep001": {"nsteps": 81, "reward": -12.911595400836733, "good_angle": 0.011156086737876828, "survival_time": 2.7, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 254, "reward": -4.437077517995215, "good_angle": 0.8658368839697798, "survival_time": 8.466666666666647, "traveled_tiles": 3, "valid_direction": 2.033333333333327}, "ep003": {"nsteps": 204, "reward": -5.272974844510649, "good_angle": 0.03033246554319256, "survival_time": 6.799999999999986, "traveled_tiles": 2, "valid_direction": 0}, "ep004": {"nsteps": 346, "reward": -3.655747907953468, "good_angle": 21.771657353630022, "survival_time": 11.533333333333305, "traveled_tiles": 3, "valid_direction": 3.93333333333332}}good_angle_max 21.771657353630022 good_angle_mean 4.77891907935506 good_angle_median 0.8658368839697798 good_angle_min 0.011156086737876828 reward_max -3.655747907953468 reward_mean -7.7742636308647475 reward_median -5.272974844510649 reward_min -12.911595400836733 survival_time_max 11.533333333333305 survival_time_mean 6.439999999999986 survival_time_min 2.7 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.93333333333332 valid_direction_mean 1.6399999999999963 valid_direction_median 2.033333333333327 valid_direction_min 0
No reset possible 10776356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 12:27:06+00:00 2018-11-18 12:29:00+00:00 0:01:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.481042290524149 deviation-center-line_median 0.2339370288761713 in-drivable-lane_median 3.1666666666666554
other stats deviation-center-line_max 0.3887111922952009 deviation-center-line_mean 0.2586161601601217 deviation-center-line_min 0.18135154954873856 deviation-heading_max 2.50309613217222 deviation-heading_mean 1.2944517420712691 deviation-heading_median 0.9876146032429244 deviation-heading_min 0.22282122232957288 driven_any_max 1.2789432717800575 driven_any_mean 0.8078205932391744 driven_any_median 1.0186256472933577 driven_any_min 0.2568548411010332 driven_lanedir_max 0.6886799360751179 driven_lanedir_mean 0.4077758085758731 driven_lanedir_min 0.12255962906563632 in-drivable-lane_max 4.366666666666651 in-drivable-lane_mean 2.3533333333333255 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3451086440022018, "driven_lanedir": 0.12255962906563632, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 1.845635471935517, "deviation-center-line": 0.18135154954873856}, "ep001": {"driven_any": 0.2568548411010332, "driven_lanedir": 0.25402061296093104, "in-drivable-lane": 0, "deviation-heading": 0.22282122232957288, "deviation-center-line": 0.2339370288761713}, "ep002": {"driven_any": 1.2789432717800575, "driven_lanedir": 0.6886799360751179, "in-drivable-lane": 3.1666666666666554, "deviation-heading": 2.50309613217222, "deviation-center-line": 0.3887111922952009}, "ep003": {"driven_any": 1.1395705620192222, "driven_lanedir": 0.4925765742535315, "in-drivable-lane": 4.366666666666651, "deviation-heading": 0.913091280676112, "deviation-center-line": 0.25652286886349257}, "ep004": {"driven_any": 1.0186256472933577, "driven_lanedir": 0.481042290524149, "in-drivable-lane": 3.566666666666654, "deviation-heading": 0.9876146032429244, "deviation-center-line": 0.232558161217005}}
No reset possible 10772356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 12:25:33+00:00 2018-11-18 12:26:54+00:00 0:01:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10768356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 12:25:05+00:00 2018-11-18 12:25:25+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.1666666666666545
other stats episodes details {"ep000": {"nsteps": 73, "reward": -13.967838363830408, "good_angle": 1.1348289113064052, "survival_time": 2.4333333333333345, "traveled_tiles": 1, "valid_direction": 1.966666666666668}, "ep001": {"nsteps": 64, "reward": -16.202794682234526, "good_angle": 0.02641407510084338, "survival_time": 2.1333333333333355, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 236, "reward": -4.795201715855401, "good_angle": 2.6918874701801223, "survival_time": 7.866666666666648, "traveled_tiles": 3, "valid_direction": 4.799999999999985}, "ep003": {"nsteps": 211, "reward": -6.0455723037704345, "good_angle": 1.1701484093436572, "survival_time": 7.033333333333318, "traveled_tiles": 3, "valid_direction": 5.899999999999984}, "ep004": {"nsteps": 185, "reward": -6.662634145226833, "good_angle": 1.516460368667395, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 5.066666666666654}}good_angle_max 2.6918874701801223 good_angle_mean 1.3079478469196846 good_angle_median 1.1701484093436572 good_angle_min 0.02641407510084338 reward_max -4.795201715855401 reward_mean -9.53480824218352 reward_median -6.662634145226833 reward_min -16.202794682234526 survival_time_max 7.866666666666648 survival_time_mean 5.126666666666658 survival_time_min 2.1333333333333355 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.899999999999984 valid_direction_mean 3.5466666666666584 valid_direction_median 4.799999999999985 valid_direction_min 0
No reset possible 10761356Bhairav Mehta PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 12:21:07+00:00 2018-11-18 12:24:50+00:00 0:03:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10758477Jonathan Plante JP pipeline aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 12:20:13+00:00 2018-11-18 12:20:58+00:00 0:00:45 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 59, in run
raise InvalidSubmission(str(e))
InvalidSubmission: local variable 'a' referenced before assignment
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 107531146Martin Weiss PyTorch template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 12:18:28+00:00 2018-11-18 12:20:05+00:00 0:01:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1244940250770317 deviation-center-line_median 0.1702985030340966 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.2291035934160819 deviation-center-line_mean 0.15104091265992872 deviation-center-line_min 0.07084844041760953 deviation-heading_max 1.2760765640740437 deviation-heading_mean 0.5466497354728592 deviation-heading_median 0.35171107009370006 deviation-heading_min 0.06092138286581164 driven_any_max 2.1066666666666567 driven_any_mean 1.1093333333333295 driven_any_median 1.1599999999999824 driven_any_min 0.3466666666666718 driven_lanedir_max 2.066698089009994 driven_lanedir_mean 0.9871748479623343 driven_lanedir_min 0.14089729353622693 in-drivable-lane_max 0.2666666666666657 in-drivable-lane_mean 0.09999999999999978 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.3466666666666718, "driven_lanedir": 0.14089729353622693, "in-drivable-lane": 0.2, "deviation-heading": 0.7098822712947942, "deviation-center-line": 0.07084844041760953}, "ep001": {"driven_any": 0.34666666666667245, "driven_lanedir": 0.3458718774424743, "in-drivable-lane": 0, "deviation-heading": 0.06092138286581164, "deviation-center-line": 0.09897289157693905}, "ep002": {"driven_any": 1.1599999999999824, "driven_lanedir": 1.1244940250770317, "in-drivable-lane": 0, "deviation-heading": 0.35171107009370006, "deviation-center-line": 0.1702985030340966}, "ep003": {"driven_any": 2.1066666666666567, "driven_lanedir": 2.066698089009994, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.33465738903594666, "deviation-center-line": 0.2291035934160819}, "ep004": {"driven_any": 1.5866666666666656, "driven_lanedir": 1.2579129547459444, "in-drivable-lane": 0.2666666666666657, "deviation-heading": 1.2760765640740437, "deviation-center-line": 0.1859811348549165}}
No reset possible 107451251Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 12:07:42+00:00 2018-11-18 12:18:18+00:00 0:10:36 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10739487Siyan Zheng ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 12:05:37+00:00 2018-11-18 12:07:06+00:00 0:01:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.23619054777077464 deviation-center-line_median 0.2122992984388151 in-drivable-lane_median 0
other stats deviation-center-line_max 0.3435802749394205 deviation-center-line_mean 0.22146211871814572 deviation-center-line_min 0.06876149486487504 deviation-heading_max 1.7672340193440526 deviation-heading_mean 0.7765651471097197 deviation-heading_median 0.5784709230855607 deviation-heading_min 0.37515426849188127 driven_any_max 0.7893180670859401 driven_any_mean 0.33143018638787475 driven_any_median 0.24999481945130073 driven_any_min 0.06427740553989783 driven_lanedir_max 0.5524173493881528 driven_lanedir_mean 0.2737050879933765 driven_lanedir_min 0.049781715934269055 in-drivable-lane_max 1.8666666666666691 in-drivable-lane_mean 0.37333333333333385 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.7893180670859401, "driven_lanedir": 0.5524173493881528, "in-drivable-lane": 1.8666666666666691, "deviation-heading": 1.7672340193440526, "deviation-center-line": 0.3435802749394205}, "ep001": {"driven_any": 0.06427740553989783, "driven_lanedir": 0.049781715934269055, "in-drivable-lane": 0, "deviation-heading": 0.37515426849188127, "deviation-center-line": 0.06876149486487504}, "ep002": {"driven_any": 0.1821229485410456, "driven_lanedir": 0.16801875360919505, "in-drivable-lane": 0, "deviation-heading": 0.5784709230855607, "deviation-center-line": 0.1570102915200551}, "ep003": {"driven_any": 0.3714376913211896, "driven_lanedir": 0.36211707326449094, "in-drivable-lane": 0, "deviation-heading": 0.5854056945652605, "deviation-center-line": 0.32565923382756284}, "ep004": {"driven_any": 0.24999481945130073, "driven_lanedir": 0.23619054777077464, "in-drivable-lane": 0, "deviation-heading": 0.5765608300618432, "deviation-center-line": 0.2122992984388151}}
No reset possible 107141253Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation failed no idsc-rudolf-183282018-11-18 11:54:48+00:00 2018-11-18 12:05:30+00:00 0:10:42 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 477, in wrap_evaluator
cie.wait_for_solution()
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 270, in wait_for_solution
raise InvalidSubmission(msg)
InvalidSubmission: Time out: Timeout of 600 while waiting for /challenge-solution-output/output-solution.yaml.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 107131143Krishna Murthy Jatavallabhula gym_duckietown + opencv aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 11:54:15+00:00 2018-11-18 11:54:37+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 188, "reward": -5.581093331109089, "good_angle": 2.8853886837868123, "survival_time": 6.266666666666654, "traveled_tiles": 1, "valid_direction": 5.13333333333332}, "ep001": {"nsteps": 184, "reward": -6.006585545190003, "good_angle": 0.027950161519413434, "survival_time": 6.133333333333321, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 500, "reward": -0.28698273333907126, "good_angle": 0.5037599778514814, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 1.7000000000000297}, "ep003": {"nsteps": 500, "reward": -0.09759001524746418, "good_angle": 0.00037922062684382017, "survival_time": 16.666666666666654, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 500, "reward": 0.026040908180526456, "good_angle": 0.07595671165358207, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 0}}good_angle_max 2.8853886837868123 good_angle_mean 0.6986869510876267 good_angle_median 0.07595671165358207 good_angle_min 0.00037922062684382017 reward_max 0.026040908180526456 reward_mean -2.38924214334102 reward_median -0.28698273333907126 reward_min -6.006585545190003 survival_time_max 16.666666666666654 survival_time_mean 12.479999999999986 survival_time_min 6.133333333333321 traveled_tiles_max 3 traveled_tiles_mean 2 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 5.13333333333332 valid_direction_mean 1.36666666666667 valid_direction_median 0 valid_direction_min 0
No reset possible 106961143Krishna Murthy Jatavallabhula gym_duckietown + opencv aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 11:50:39+00:00 2018-11-18 11:54:08+00:00 0:03:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 10693308Andrea Censi PyTorch DDPG template aido1_LF1_r3-v3step1-simulation error no idsc-rudolf-183282018-11-18 11:49:58+00:00 2018-11-18 11:50:30+00:00 0:00:32 The result file is n [...] The result file is not found. This usually means that the evaluator did not finish
and some times that there was an import error.
Check the evaluator log to see what happened.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106821269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step4-viz success yes idsc-rudolf-183282018-11-18 11:02:22+00:00 2018-11-18 11:05:50+00:00 0:03:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.1858751062372497 deviation-center-line_median 0.563832971626301 in-drivable-lane_median 0
other stats deviation-center-line_max 1.171904084883277 deviation-center-line_mean 0.6539107884903486 deviation-center-line_min 0.24020081309801997 deviation-heading_max 3.0057576388028675 deviation-heading_mean 1.5424166222765243 deviation-heading_median 1.7568368852682044 deviation-heading_min 0.2120145709685025 driven_any_max 2.881829737813101 driven_any_mean 1.5227547131437291 driven_any_median 1.3207264084194723 driven_any_min 0.3081525678993841 driven_lanedir_max 2.566276890528922 driven_lanedir_mean 1.353809568945074 driven_lanedir_min 0.30220264994404955 in-drivable-lane_max 0.7666666666666639 in-drivable-lane_mean 0.2999999999999995 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 2.2732605836701687, "driven_lanedir": 1.899170232720776, "in-drivable-lane": 0.7333333333333333, "deviation-heading": 3.0057576388028675, "deviation-center-line": 0.7382793824375652}, "ep001": {"driven_any": 0.3081525678993841, "driven_lanedir": 0.30220264994404955, "in-drivable-lane": 0, "deviation-heading": 0.2120145709685025, "deviation-center-line": 0.24020081309801997}, "ep002": {"driven_any": 1.3207264084194723, "driven_lanedir": 1.1858751062372497, "in-drivable-lane": 0, "deviation-heading": 2.2534935478285467, "deviation-center-line": 0.5553366904065802}, "ep003": {"driven_any": 2.881829737813101, "driven_lanedir": 2.566276890528922, "in-drivable-lane": 0.7666666666666639, "deviation-heading": 1.7568368852682044, "deviation-center-line": 1.171904084883277}, "ep004": {"driven_any": 0.8298042679165203, "driven_lanedir": 0.8155229652943727, "in-drivable-lane": 0, "deviation-heading": 0.4839804685145004, "deviation-center-line": 0.563832971626301}}
No reset possible 106771269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step3-videos success yes idsc-rudolf-183282018-11-18 11:00:59+00:00 2018-11-18 11:02:06+00:00 0:01:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 106671269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step2-scoring success yes idsc-rudolf-183282018-11-18 11:00:09+00:00 2018-11-18 11:00:29+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.066666666666649
other stats episodes details {"ep000": {"nsteps": 366, "reward": -2.8605892974333647, "good_angle": 1.0505563586293576, "survival_time": 12.199999999999967, "traveled_tiles": 4, "valid_direction": 1.5999999999999943}, "ep001": {"nsteps": 68, "reward": -15.262957413845202, "good_angle": 0.07264626603606153, "survival_time": 2.2666666666666684, "traveled_tiles": 1, "valid_direction": 0.13333333333333286}, "ep002": {"nsteps": 242, "reward": -4.316510446161111, "good_angle": 0.7448688903986106, "survival_time": 8.066666666666649, "traveled_tiles": 3, "valid_direction": 1.1333333333333302}, "ep003": {"nsteps": 500, "reward": -0.28015136850846467, "good_angle": 0.36737863546305544, "survival_time": 16.666666666666654, "traveled_tiles": 6, "valid_direction": 0.8333333333333304}, "ep004": {"nsteps": 185, "reward": -5.872051970217679, "good_angle": 0.12052446599570546, "survival_time": 6.1666666666666545, "traveled_tiles": 2, "valid_direction": 0.2333333333333325}}good_angle_max 1.0505563586293576 good_angle_mean 0.47119492330455814 good_angle_median 0.36737863546305544 good_angle_min 0.07264626603606153 reward_max -0.28015136850846467 reward_mean -5.718452099233165 reward_median -4.316510446161111 reward_min -15.262957413845202 survival_time_max 16.666666666666654 survival_time_mean 9.07333333333332 survival_time_min 2.2666666666666684 traveled_tiles_max 6 traveled_tiles_mean 3.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 1.5999999999999943 valid_direction_mean 0.7866666666666641 valid_direction_median 0.8333333333333304 valid_direction_min 0.13333333333333286
No reset possible 106611269Anton Mashikhin Tensorflow template aido1_LF1_r3-v3step1-simulation success no idsc-rudolf-183282018-11-18 10:57:22+00:00 2018-11-18 10:59:52+00:00 0:02:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
Andrea Censi 🇨🇭
