Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 117651289Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:56:23+00:00 2018-11-22 18:02:53+00:00 0:06:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11761768Dzenan Lapandic Random execution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:55:39+00:00 2018-11-22 17:56:17+00:00 0:00:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 117591288Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 17:50:23+00:00 2018-11-22 17:55:33+00:00 0:05:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 11.83382427542871 deviation-center-line_median 0.9440035008510208 in-drivable-lane_median 1.999999999999994
other stats deviation-center-line_max 1.0154196500670571 deviation-center-line_mean 0.9621229903620956 deviation-center-line_min 0.9025841805736712 deviation-heading_max 3.86159066739961 deviation-heading_mean 3.626558947749939 deviation-heading_median 3.5964884459155355 deviation-heading_min 3.349673247195551 driven_any_max 13.636500503315869 driven_any_mean 13.37921074863793 driven_any_median 13.47649671170403 driven_any_min 12.98781501210361 driven_lanedir_max 11.874773573243296 driven_lanedir_mean 11.385963235820208 driven_lanedir_min 10.6312651978041 in-drivable-lane_max 3.1333333333333293 in-drivable-lane_mean 2.2399999999999993 in-drivable-lane_min 1.666666666666662 per-episodes details {"ep000": {"driven_any": 13.244204013073627, "driven_lanedir": 10.751419080760488, "in-drivable-lane": 3.1333333333333293, "deviation-heading": 3.349673247195551, "deviation-center-line": 0.9025841805736712}, "ep001": {"driven_any": 13.636500503315869, "driven_lanedir": 11.83382427542871, "in-drivable-lane": 1.999999999999994, "deviation-heading": 3.5710837347907978, "deviation-center-line": 1.0106450859756009}, "ep002": {"driven_any": 13.55103750299252, "driven_lanedir": 11.874773573243296, "in-drivable-lane": 1.6999999999999946, "deviation-heading": 3.5964884459155355, "deviation-center-line": 0.9379625343431292}, "ep003": {"driven_any": 13.47649671170403, "driven_lanedir": 11.838534051864434, "in-drivable-lane": 1.666666666666662, "deviation-heading": 3.7539586434482017, "deviation-center-line": 0.9440035008510208}, "ep004": {"driven_any": 12.98781501210361, "driven_lanedir": 10.6312651978041, "in-drivable-lane": 2.700000000000017, "deviation-heading": 3.86159066739961, "deviation-center-line": 1.0154196500670571}}
No reset possible 117561288Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:48:01+00:00 2018-11-22 17:50:16+00:00 0:02:15 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 117501288Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 17:45:45+00:00 2018-11-22 17:47:52+00:00 0:02:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": 0.5682614612355829, "good_angle": 1.3916450954072732, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.933333333333328}, "ep001": {"nsteps": 500, "reward": 0.6678114020749927, "good_angle": 1.3726810328150192, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.96666666666666}, "ep002": {"nsteps": 500, "reward": 0.612774882139638, "good_angle": 1.391473625991504, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.033333333333326}, "ep003": {"nsteps": 500, "reward": 0.6060276078572496, "good_angle": 1.4378725544376918, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.199999999999994}, "ep004": {"nsteps": 500, "reward": 0.5643969809673727, "good_angle": 1.7585167069632226, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.9000000000000083}}good_angle_max 1.7585167069632226 good_angle_mean 1.470437803122942 good_angle_median 1.3916450954072732 good_angle_min 1.3726810328150192 reward_max 0.6678114020749927 reward_mean 0.6038544668549671 reward_median 0.6060276078572496 reward_min 0.5643969809673727 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 18 traveled_tiles_mean 18 traveled_tiles_median 18 traveled_tiles_min 18 valid_direction_max 2.9000000000000083 valid_direction_mean 2.206666666666663 valid_direction_median 2.033333333333326 valid_direction_min 1.933333333333328
No reset possible 11746769Benson Kuan AMOD18-AIDO not that random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 17:44:11+00:00 2018-11-22 17:45:39+00:00 0:01:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7583624342945385 deviation-center-line_median 0.05856940306194948 in-drivable-lane_median 0.033333333333333326
other stats deviation-center-line_max 0.0848318451919554 deviation-center-line_mean 0.046692309596965104 deviation-center-line_min 0.00493459316827017 deviation-heading_max 0.17871954277822616 deviation-heading_mean 0.12290238968183878 deviation-heading_median 0.1404921816205833 deviation-heading_min 0.043767648089746966 driven_any_max 1.12 driven_any_mean 0.9520000000000014 driven_any_median 1.0400000000000025 driven_any_min 0.7599999999999976 driven_lanedir_max 1.0891907711875215 driven_lanedir_mean 0.7157737741226108 driven_lanedir_min 0.00431907202387416 in-drivable-lane_max 0.7999999999999999 in-drivable-lane_mean 0.1733333333333333 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0400000000000025, "driven_lanedir": 0.00431907202387416, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.1516782451032673, "deviation-center-line": 0.00493459316827017}, "ep001": {"driven_any": 0.760000000000006, "driven_lanedir": 0.7583624342945385, "in-drivable-lane": 0, "deviation-heading": 0.043767648089746966, "deviation-center-line": 0.05856940306194948}, "ep002": {"driven_any": 0.7599999999999976, "driven_lanedir": 0.6711343097180644, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.17871954277822616, "deviation-center-line": 0.02298492709392346}, "ep003": {"driven_any": 1.0800000000000007, "driven_lanedir": 1.0558622833890554, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.09985433081737012, "deviation-center-line": 0.0848318451919554}, "ep004": {"driven_any": 1.12, "driven_lanedir": 1.0891907711875215, "in-drivable-lane": 0, "deviation-heading": 0.1404921816205833, "deviation-center-line": 0.062140779468727016}}
No reset possible 11744769Benson Kuan AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:43:31+00:00 2018-11-22 17:44:03+00:00 0:00:32 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11742769Benson Kuan AMOD18-AIDO not that random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 17:41:46+00:00 2018-11-22 17:43:24+00:00 0:01:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 0.9333333333333332
other stats episodes details {"ep000": {"nsteps": 28, "reward": -36.6421162430197, "good_angle": 0.5231223188267838, "survival_time": 0.9333333333333332, "traveled_tiles": 2, "valid_direction": 0.3666666666666666}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 21, "reward": -47.253679474549635, "good_angle": 0.15423356340546784, "survival_time": 0.7, "traveled_tiles": 2, "valid_direction": 0.26666666666666666}, "ep003": {"nsteps": 29, "reward": -34.48776989465515, "good_angle": 0.13377976232358335, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.29999999999999993}, "ep004": {"nsteps": 30, "reward": -33.12740348378817, "good_angle": 0.13484239023230782, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.2666666666666666}}good_angle_max 0.5231223188267838 good_angle_mean 0.18979987683516303 good_angle_median 0.13484239023230782 good_angle_min 0.0030213493876724944 reward_max -33.12740348378817 reward_mean -39.758097890022654 reward_median -36.6421162430197 reward_min -47.27952035410063 survival_time_max 1 survival_time_mean 0.86 survival_time_min 0.7 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 0.3666666666666666 valid_direction_mean 0.2399999999999999 valid_direction_median 0.26666666666666666 valid_direction_min 0
No reset possible 117371287Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 17:36:19+00:00 2018-11-22 17:41:38+00:00 0:05:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 11.60704208642625 deviation-center-line_median 0.9359485996416274 in-drivable-lane_median 2.0666666666666607
other stats deviation-center-line_max 0.9795336517607108 deviation-center-line_mean 0.9447144053252206 deviation-center-line_min 0.921623040929288 deviation-heading_max 3.9844257672779415 deviation-heading_mean 3.67712006740764 deviation-heading_median 3.650310087518895 deviation-heading_min 3.502650002734451 driven_any_max 13.46557450266916 driven_any_mean 13.304253301726964 driven_any_median 13.305570711057456 driven_any_min 13.077613174809564 driven_lanedir_max 11.68093028873297 driven_lanedir_mean 11.331459640053849 driven_lanedir_min 10.749106051439291 in-drivable-lane_max 2.699999999999995 in-drivable-lane_mean 2.206666666666667 in-drivable-lane_min 1.899999999999994 per-episodes details {"ep000": {"driven_any": 13.077613174809564, "driven_lanedir": 10.749106051439291, "in-drivable-lane": 2.699999999999995, "deviation-heading": 3.591278956476307, "deviation-center-line": 0.9795336517607108}, "ep001": {"driven_any": 13.366937409041205, "driven_lanedir": 11.60704208642625, "in-drivable-lane": 1.933333333333327, "deviation-heading": 3.650310087518895, "deviation-center-line": 0.921623040929288}, "ep002": {"driven_any": 13.305570711057456, "driven_lanedir": 11.68093028873297, "in-drivable-lane": 1.899999999999994, "deviation-heading": 3.656935523030609, "deviation-center-line": 0.9359485996416274}, "ep003": {"driven_any": 13.46557450266916, "driven_lanedir": 11.62000580523804, "in-drivable-lane": 2.0666666666666607, "deviation-heading": 3.502650002734451, "deviation-center-line": 0.934573369009403}, "ep004": {"driven_any": 13.305570711057443, "driven_lanedir": 11.000213968432696, "in-drivable-lane": 2.43333333333336, "deviation-heading": 3.9844257672779415, "deviation-center-line": 0.951893365285074}}
No reset possible 117331287Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:34:27+00:00 2018-11-22 17:36:12+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 117311287Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 17:33:58+00:00 2018-11-22 17:34:21+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": 0.5483723348099738, "good_angle": 1.487769654135165, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.16666666666666}, "ep001": {"nsteps": 500, "reward": 0.6415602920986712, "good_angle": 1.3363424855972788, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.9333333333333271}, "ep002": {"nsteps": 500, "reward": 0.5923784675952047, "good_angle": 1.3553526744957485, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.199999999999992}, "ep003": {"nsteps": 500, "reward": 0.6281203108206391, "good_angle": 1.3129546767337152, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 1.933333333333328}, "ep004": {"nsteps": 500, "reward": 0.5229932260876522, "good_angle": 1.9342070395288191, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.8000000000000007}}good_angle_max 1.9342070395288191 good_angle_mean 1.4853253060981453 good_angle_median 1.3553526744957485 good_angle_min 1.3129546767337152 reward_max 0.6415602920986712 reward_mean 0.5866849262824282 reward_median 0.5923784675952047 reward_min 0.5229932260876522 survival_time_max 16.666666666666654 survival_time_mean 16.666666666666654 survival_time_min 16.666666666666654 traveled_tiles_max 18 traveled_tiles_mean 18 traveled_tiles_median 18 traveled_tiles_min 18 valid_direction_max 2.8000000000000007 valid_direction_mean 2.2066666666666617 valid_direction_median 2.16666666666666 valid_direction_min 1.9333333333333271
No reset possible 117251287Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 17:26:33+00:00 2018-11-22 17:33:52+00:00 0:07:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11718774Gianmarco Bernasconi Not Random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 17:24:36+00:00 2018-11-22 17:26:26+00:00 0:01:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.0078449389765414 deviation-center-line_median 0.24331809231882287 in-drivable-lane_median 0.033333333333333215
other stats deviation-center-line_max 0.2841842256010143 deviation-center-line_mean 0.1869704695167239 deviation-center-line_min 0.01703584406252417 deviation-heading_max 0.8085987238819564 deviation-heading_mean 0.4118119184035173 deviation-heading_median 0.3642296679713092 deviation-heading_min 0.136602639175856 driven_any_max 1.3247760271262663 driven_any_mean 1.0722096532306782 driven_any_median 1.1025098951579495 driven_any_min 0.8029339328728307 driven_lanedir_max 1.2881911532339625 driven_lanedir_mean 0.8079534159184296 driven_lanedir_min 0.0008362187108992281 in-drivable-lane_max 2.4666666666666677 in-drivable-lane_mean 0.5200000000000002 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.1025098951579495, "driven_lanedir": 0.0008362187108992281, "in-drivable-lane": 2.4666666666666677, "deviation-heading": 0.3642296679713092, "deviation-center-line": 0.01703584406252417}, "ep001": {"driven_any": 1.3247760271262663, "driven_lanedir": 1.2881911532339625, "in-drivable-lane": 0, "deviation-heading": 0.421658086451745, "deviation-center-line": 0.24331809231882287}, "ep002": {"driven_any": 0.8029339328728307, "driven_lanedir": 0.6441728675036283, "in-drivable-lane": 0.10000000000000007, "deviation-heading": 0.8085987238819564, "deviation-center-line": 0.12703752184624523}, "ep003": {"driven_any": 1.119693250125831, "driven_lanedir": 1.0987219011671174, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.3279704745367198, "deviation-center-line": 0.2841842256010143}, "ep004": {"driven_any": 1.0111351608705137, "driven_lanedir": 1.0078449389765414, "in-drivable-lane": 0, "deviation-heading": 0.136602639175856, "deviation-center-line": 0.2632766637550129}}
No reset possible 11717774Gianmarco Bernasconi Not Random execution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:23:48+00:00 2018-11-22 17:24:30+00:00 0:00:42 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 117141029Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 17:23:09+00:00 2018-11-22 17:23:32+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.866666666666659
other stats episodes details {"ep000": {"nsteps": 146, "reward": -6.944060701915152, "good_angle": 4.6959923152245855, "survival_time": 4.866666666666659, "traveled_tiles": 5, "valid_direction": 2.133333333333332}, "ep001": {"nsteps": 21, "reward": -47.27952035410063, "good_angle": 0.0030213493876724944, "survival_time": 0.7, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 341, "reward": -2.923175538709808, "good_angle": 7.627173026082674, "survival_time": 11.366666666666635, "traveled_tiles": 14, "valid_direction": 4.333333333333325}, "ep003": {"nsteps": 134, "reward": -7.110664295136873, "good_angle": 0.6595626757874886, "survival_time": 4.466666666666661, "traveled_tiles": 8, "valid_direction": 0.9666666666666646}, "ep004": {"nsteps": 174, "reward": -5.7002788174103936, "good_angle": 3.831213087765633, "survival_time": 5.799999999999989, "traveled_tiles": 6, "valid_direction": 2.466666666666663}}good_angle_max 7.627173026082674 good_angle_mean 3.3633924908496104 good_angle_median 3.831213087765633 good_angle_min 0.0030213493876724944 reward_max -2.923175538709808 reward_mean -13.991539941454572 reward_median -6.944060701915152 reward_min -47.27952035410063 survival_time_max 11.366666666666635 survival_time_mean 5.439999999999989 survival_time_min 0.7 traveled_tiles_max 14 traveled_tiles_mean 7.2 traveled_tiles_median 6 traveled_tiles_min 3 valid_direction_max 4.333333333333325 valid_direction_mean 1.9799999999999969 valid_direction_median 2.133333333333332 valid_direction_min 0
No reset possible 117101029Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 17:16:24+00:00 2018-11-22 17:23:02+00:00 0:06:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11706772Tomasz Firynowicz AMOD18-AIDO not that random execution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 17:15:45+00:00 2018-11-22 17:16:18+00:00 0:00:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11705772Tomasz Firynowicz AMOD18-AIDO not that random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 17:15:15+00:00 2018-11-22 17:15:39+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.8666666666666691
other stats episodes details {"ep000": {"nsteps": 56, "reward": -18.801444864565777, "good_angle": 1.0163992328464693, "survival_time": 1.8666666666666691, "traveled_tiles": 2, "valid_direction": 0.7000000000000022}, "ep001": {"nsteps": 41, "reward": -24.03603506269978, "good_angle": 0.00579980220315226, "survival_time": 1.3666666666666676, "traveled_tiles": 3, "valid_direction": 0}, "ep002": {"nsteps": 41, "reward": -23.988571963023123, "good_angle": 0.2649658884005068, "survival_time": 1.3666666666666676, "traveled_tiles": 2, "valid_direction": 0.500000000000001}, "ep003": {"nsteps": 57, "reward": -17.52574976100668, "good_angle": 0.229551202468404, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.533333333333335}, "ep004": {"nsteps": 59, "reward": -16.72157261646905, "good_angle": 0.229542941296041, "survival_time": 1.9666666666666697, "traveled_tiles": 2, "valid_direction": 0.5000000000000016}}good_angle_max 1.0163992328464693 good_angle_mean 0.34925181344291467 good_angle_median 0.229551202468404 good_angle_min 0.00579980220315226 reward_max -16.72157261646905 reward_mean -20.21467485355288 reward_median -18.801444864565777 reward_min -24.03603506269978 survival_time_max 1.9666666666666697 survival_time_mean 1.6933333333333351 survival_time_min 1.3666666666666676 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 0.7000000000000022 valid_direction_mean 0.44666666666666793 valid_direction_median 0.5000000000000016 valid_direction_min 0
No reset possible 11703772Tomasz Firynowicz AMOD18-AIDO not that random execution aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 17:11:49+00:00 2018-11-22 17:15:09+00:00 0:03:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 117001024Ruixiang Zhang stay young aido1_LF1_r3-v3step1-simulation failed yes nutonomy-P50-21102018-11-22 17:08:00+00:00 2018-11-22 17:11:43+00:00 0:03:43 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 590, in wrap_solution
raise InvalidSubmission(msg)
InvalidSubmission: Uncaught exception in solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 127, in run
solve(params, cis)
File "solution.py", line 89, in solve
observation, reward, done, info = env.step(action)
File "/workspace/wrappers.py", line 252, in step
return self.step_wait()
File "/workspace/wrappers.py", line 271, in step_wait
results = [env.step(a) for (a,env) in zip(self.actions, self.envs)]
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 304, in step
observation, reward, done, info = self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/core.py", line 332, in step
return self.env.step(action)
File "/opt/conda/lib/python2.7/site-packages/gym/wrappers/time_limit.py", line 31, in step
observation, reward, done, info = self.env.step(action)
File "/workspace/src/gym-duckietown-agent/gym_duckietown_agent/envs/simplesimagent_env.py", line 109, in step
obs, rew, done, misc = self.sim.step(action, with_observation=True)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 55, in step
return self._failsafe_observe(msg)
File "/workspace/src/duckietown-slimremote/duckietown_slimremote/pc/robot.py", line 86, in _failsafe_observe
raise Exception(msg)
Exception: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116961027Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed yes nutonomy-P50-21102018-11-22 16:57:42+00:00 2018-11-22 17:05:34+00:00 0:07:52 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116941280Yun Chen Random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 16:55:28+00:00 2018-11-22 16:57:36+00:00 0:02:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 0.7461249398233414 deviation-center-line_median 0.12383217401737778 in-drivable-lane_median 0.033333333333333326
other stats deviation-center-line_max 0.1409774849121483 deviation-center-line_mean 0.09661320400414368 deviation-center-line_min 0 deviation-heading_max 0.5840290661099709 deviation-heading_mean 0.28407476450764646 deviation-heading_median 0.1569023353568939 deviation-heading_min 0 driven_any_max 1.1509790229945742 driven_any_mean 0.9322383998754616 driven_any_median 0.885191789225165 driven_any_min 0.7492786053140181 driven_lanedir_max 1.0674598269300748 driven_lanedir_mean 0.6777594474863033 driven_lanedir_min 0 in-drivable-lane_max 2.6333333333333337 in-drivable-lane_mean 0.5466666666666667 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.0962767520174626, "driven_lanedir": 0, "in-drivable-lane": 2.6333333333333337, "deviation-heading": 0, "deviation-center-line": 0}, "ep001": {"driven_any": 0.7492786053140181, "driven_lanedir": 0.7461249398233414, "in-drivable-lane": 0, "deviation-heading": 0.13343816891181698, "deviation-center-line": 0.12994005190831326}, "ep002": {"driven_any": 0.7794658298260877, "driven_lanedir": 0.6937008806042875, "in-drivable-lane": 0.033333333333333326, "deviation-heading": 0.5840290661099709, "deviation-center-line": 0.08831630918287894}, "ep003": {"driven_any": 0.885191789225165, "driven_lanedir": 0.8815115900738129, "in-drivable-lane": 0, "deviation-heading": 0.1569023353568939, "deviation-center-line": 0.1409774849121483}, "ep004": {"driven_any": 1.1509790229945742, "driven_lanedir": 1.0674598269300748, "in-drivable-lane": 0.06666666666666687, "deviation-heading": 0.5460042521595504, "deviation-center-line": 0.12383217401737778}}
No reset possible 116931280Yun Chen Random execution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 16:54:35+00:00 2018-11-22 16:55:22+00:00 0:00:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116921280Yun Chen Random execution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 16:54:07+00:00 2018-11-22 16:54:28+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 2.1666666666666687
other stats episodes details {"ep000": {"nsteps": 80, "reward": -13.261786422459409, "good_angle": 1.293101382907263, "survival_time": 2.666666666666667, "traveled_tiles": 2, "valid_direction": 1.066666666666665}, "ep001": {"nsteps": 55, "reward": -17.740518289668994, "good_angle": 0.01662705284145628, "survival_time": 1.8333333333333357, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 57, "reward": -16.956493169265357, "good_angle": 0.374164941094724, "survival_time": 1.9000000000000024, "traveled_tiles": 2, "valid_direction": 0.6666666666666687}, "ep003": {"nsteps": 65, "reward": -14.989395172120286, "good_angle": 0.11620524905837214, "survival_time": 2.1666666666666687, "traveled_tiles": 2, "valid_direction": 0.3666666666666665}, "ep004": {"nsteps": 84, "reward": -11.470352215115868, "good_angle": 0.3663126748695752, "survival_time": 2.8, "traveled_tiles": 3, "valid_direction": 0.6999999999999975}}good_angle_max 1.293101382907263 good_angle_mean 0.4332822601542781 good_angle_median 0.3663126748695752 good_angle_min 0.01662705284145628 reward_max -11.470352215115868 reward_mean -14.883709053725983 reward_median -14.989395172120286 reward_min -17.740518289668994 survival_time_max 2.8 survival_time_mean 2.2733333333333348 survival_time_min 1.8333333333333357 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 2 traveled_tiles_min 2 valid_direction_max 1.066666666666665 valid_direction_mean 0.5599999999999996 valid_direction_median 0.6666666666666687 valid_direction_min 0
No reset possible 116901280Yun Chen Random execution aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 16:50:13+00:00 2018-11-22 16:53:40+00:00 0:03:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116881281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 16:46:09+00:00 2018-11-22 16:50:07+00:00 0:03:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median -1.0277407795398488 deviation-center-line_median 0.8103782753157632 in-drivable-lane_median 8.233333333333327
other stats deviation-center-line_max 1.4912616810953376 deviation-center-line_mean 0.819190560335511 deviation-center-line_min 0.082568156132267 deviation-heading_max 6.521792676074736 deviation-heading_mean 5.190426851309774 deviation-heading_median 6.397358497300516 deviation-heading_min 0.6601971322237846 driven_any_max 3.384244093019618 driven_any_mean 2.547397257312696 driven_any_median 3.013418490921552 driven_any_min 0.31492317328826913 driven_lanedir_max -0.06312762219487023 driven_lanedir_mean -0.8120989990451679 driven_lanedir_min -1.0673592512216736 in-drivable-lane_max 8.499999999999996 in-drivable-lane_mean 6.819999999999996 in-drivable-lane_min 0.8000000000000009 per-episodes details {"ep000": {"driven_any": 3.384244093019618, "driven_lanedir": -1.0673592512216736, "in-drivable-lane": 8.499999999999996, "deviation-heading": 5.928571821023837, "deviation-center-line": 1.4912616810953376}, "ep001": {"driven_any": 3.002654504842632, "driven_lanedir": -1.037952106602518, "in-drivable-lane": 8.16666666666666, "deviation-heading": 6.521792676074736, "deviation-center-line": 0.8103782753157632}, "ep002": {"driven_any": 3.0217460244914083, "driven_lanedir": -1.0277407795398488, "in-drivable-lane": 8.233333333333327, "deviation-heading": 6.444214129925996, "deviation-center-line": 0.9672756952208724}, "ep003": {"driven_any": 0.31492317328826913, "driven_lanedir": -0.06312762219487023, "in-drivable-lane": 0.8000000000000009, "deviation-heading": 0.6601971322237846, "deviation-center-line": 0.082568156132267}, "ep004": {"driven_any": 3.013418490921552, "driven_lanedir": -0.8643152356669286, "in-drivable-lane": 8.399999999999993, "deviation-heading": 6.397358497300516, "deviation-center-line": 0.7444689939133149}}
No reset possible 116861281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 16:44:33+00:00 2018-11-22 16:46:03+00:00 0:01:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116851281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 16:44:03+00:00 2018-11-22 16:44:26+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 16.666666666666654
other stats episodes details {"ep000": {"nsteps": 500, "reward": -0.39378913562488743, "good_angle": 13.848054495847878, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.79999999999999}, "ep001": {"nsteps": 500, "reward": -0.5056900928516407, "good_angle": 13.645798105494023, "survival_time": 16.666666666666654, "traveled_tiles": 2, "valid_direction": 12.69999999999999}, "ep002": {"nsteps": 500, "reward": -0.45138720066752286, "good_angle": 13.701411166051669, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.866666666666656}, "ep003": {"nsteps": 48, "reward": -22.205154928318127, "good_angle": 1.437021091019893, "survival_time": 1.6000000000000016, "traveled_tiles": 1, "valid_direction": 1.2333333333333345}, "ep004": {"nsteps": 500, "reward": -0.5823607941255905, "good_angle": 13.756371640864312, "survival_time": 16.666666666666654, "traveled_tiles": 1, "valid_direction": 12.733333333333324}}good_angle_max 13.848054495847878 good_angle_mean 11.277731299855557 good_angle_median 13.701411166051669 good_angle_min 1.437021091019893 reward_max -0.39378913562488743 reward_mean -4.827676430317554 reward_median -0.5056900928516407 reward_min -22.205154928318127 survival_time_max 16.666666666666654 survival_time_mean 13.653333333333322 survival_time_min 1.6000000000000016 traveled_tiles_max 2 traveled_tiles_mean 1.2 traveled_tiles_median 1 traveled_tiles_min 1 valid_direction_max 12.866666666666656 valid_direction_mean 10.466666666666658 valid_direction_median 12.733333333333324 valid_direction_min 1.2333333333333345
No reset possible 116821281Yun Chen PyTorch DDPG template aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 16:35:58+00:00 2018-11-22 16:43:49+00:00 0:07:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116801145Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 16:32:45+00:00 2018-11-22 16:35:51+00:00 0:03:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 6.787089416922454 deviation-center-line_median 0.7566220400698854 in-drivable-lane_median 2.7999999999999945
other stats deviation-center-line_max 1.4717368598822878 deviation-center-line_mean 0.7119533913814788 deviation-center-line_min 0.013288857926734477 deviation-heading_max 2.481807297508241 deviation-heading_mean 1.5584706228027043 deviation-heading_median 1.7414746392817158 deviation-heading_min 0.214248053993524 driven_any_max 18.861397359920655 driven_any_mean 9.937773165205302 driven_any_median 10.443612499625496 driven_any_min 1.0903699593617775 driven_lanedir_max 14.579130559232643 driven_lanedir_mean 6.953284053804895 driven_lanedir_min 0.032188573277893706 in-drivable-lane_max 3.4666666666666575 in-drivable-lane_mean 2.339999999999994 in-drivable-lane_min 0.7999999999999999 per-episodes details {"ep000": {"driven_any": 1.0903699593617775, "driven_lanedir": 0.032188573277893706, "in-drivable-lane": 0.7999999999999999, "deviation-heading": 0.214248053993524, "deviation-center-line": 0.013288857926734477}, "ep001": {"driven_any": 18.861397359920655, "driven_lanedir": 14.579130559232643, "in-drivable-lane": 3.4666666666666575, "deviation-heading": 2.481807297508241, "deviation-center-line": 1.4717368598822878}, "ep002": {"driven_any": 12.11527218292017, "driven_lanedir": 8.536659181973958, "in-drivable-lane": 2.866666666666658, "deviation-heading": 1.7414746392817158, "deviation-center-line": 0.7919295501310231}, "ep003": {"driven_any": 7.1782138241984095, "driven_lanedir": 4.831352537617522, "in-drivable-lane": 1.7666666666666615, "deviation-heading": 1.4251668542227238, "deviation-center-line": 0.5261896488974638}, "ep004": {"driven_any": 10.443612499625496, "driven_lanedir": 6.787089416922454, "in-drivable-lane": 2.7999999999999945, "deviation-heading": 1.9296562690073171, "deviation-center-line": 0.7566220400698854}}
No reset possible 116791145Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 16:31:13+00:00 2018-11-22 16:32:38+00:00 0:01:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116781145Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 16:30:44+00:00 2018-11-22 16:31:07+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.399999999999975
other stats episodes details {"ep000": {"nsteps": 30, "reward": -34.21919490372141, "good_angle": 0.5216049088861134, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.4333333333333333}, "ep001": {"nsteps": 500, "reward": 0.46920116420648994, "good_angle": 1.038579159022044, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.666666666666669}, "ep002": {"nsteps": 324, "reward": -2.671259534911017, "good_angle": 0.8164375675894268, "survival_time": 10.799999999999972, "traveled_tiles": 18, "valid_direction": 2.2999999999999923}, "ep003": {"nsteps": 194, "reward": -4.783337153867607, "good_angle": 0.7835842565982784, "survival_time": 6.4666666666666535, "traveled_tiles": 12, "valid_direction": 1.999999999999996}, "ep004": {"nsteps": 282, "reward": -3.230295630324638, "good_angle": 1.1008803049608988, "survival_time": 9.399999999999975, "traveled_tiles": 17, "valid_direction": 2.4999999999999973}}good_angle_max 1.1008803049608988 good_angle_mean 0.8522172394113522 good_angle_median 0.8164375675894268 good_angle_min 0.5216049088861134 reward_max 0.46920116420648994 reward_mean -8.886977211723636 reward_median -3.230295630324638 reward_min -34.21919490372141 survival_time_max 16.666666666666654 survival_time_mean 8.866666666666651 survival_time_min 1 traveled_tiles_max 18 traveled_tiles_mean 13.4 traveled_tiles_median 17 traveled_tiles_min 2 valid_direction_max 2.666666666666669 valid_direction_mean 1.9799999999999975 valid_direction_median 2.2999999999999923 valid_direction_min 0.4333333333333333
No reset possible 116741145Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 16:23:01+00:00 2018-11-22 16:30:37+00:00 0:07:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116721141Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 16:20:05+00:00 2018-11-22 16:22:53+00:00 0:02:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 7.1079948868631835 deviation-center-line_median 0.6780000356923697 in-drivable-lane_median 2.6333333333333253
other stats deviation-center-line_max 0.9176117040617467 deviation-center-line_mean 0.5684658815315539 deviation-center-line_min 0.0062578227279053555 deviation-heading_max 2.4400762165433467 deviation-heading_mean 1.492248372892265 deviation-heading_median 1.5131089957711696 deviation-heading_min 0.13473706936197322 driven_any_max 12.794905418845843 driven_any_mean 8.499723503300086 driven_any_median 10.32614406718679 driven_any_min 1.0636461670867805 driven_lanedir_max 8.543814082240008 driven_lanedir_mean 5.560074327057659 driven_lanedir_min 0.015310975229611223 in-drivable-lane_max 3.699999999999992 in-drivable-lane_mean 2.2799999999999945 in-drivable-lane_min 0.8333333333333333 per-episodes details {"ep000": {"driven_any": 1.0636461670867805, "driven_lanedir": 0.015310975229611223, "in-drivable-lane": 0.8333333333333333, "deviation-heading": 0.13473706936197322, "deviation-center-line": 0.0062578227279053555}, "ep001": {"driven_any": 10.32614406718679, "driven_lanedir": 7.1079948868631835, "in-drivable-lane": 2.6333333333333253, "deviation-heading": 1.5131089957711696, "deviation-center-line": 0.6780000356923697}, "ep002": {"driven_any": 12.117951326362991, "driven_lanedir": 8.543814082240008, "in-drivable-lane": 2.799999999999992, "deviation-heading": 2.0004023683247403, "deviation-center-line": 0.9176117040617467}, "ep003": {"driven_any": 6.1959705370180265, "driven_lanedir": 4.207543977006413, "in-drivable-lane": 1.4333333333333296, "deviation-heading": 1.3729172144600954, "deviation-center-line": 0.40350628882627687}, "ep004": {"driven_any": 12.794905418845843, "driven_lanedir": 7.925707713949081, "in-drivable-lane": 3.699999999999992, "deviation-heading": 2.4400762165433467, "deviation-center-line": 0.8369535563494706}}
No reset possible 116711141Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 16:18:35+00:00 2018-11-22 16:19:58+00:00 0:01:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116701141Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 16:18:07+00:00 2018-11-22 16:18:29+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 9.199999999999978
other stats episodes details {"ep000": {"nsteps": 29, "reward": -35.37664484104206, "good_angle": 0.5114915912986825, "survival_time": 0.9666666666666666, "traveled_tiles": 2, "valid_direction": 0.3999999999999999}, "ep001": {"nsteps": 276, "reward": -3.240260654304765, "good_angle": 0.9167618003399668, "survival_time": 9.199999999999978, "traveled_tiles": 18, "valid_direction": 2.433333333333328}, "ep002": {"nsteps": 325, "reward": -2.68029732119817, "good_angle": 0.9574565005822604, "survival_time": 10.833333333333306, "traveled_tiles": 18, "valid_direction": 2.4666666666666597}, "ep003": {"nsteps": 169, "reward": -5.6148724648798405, "good_angle": 1.4578398075667751, "survival_time": 5.633333333333323, "traveled_tiles": 10, "valid_direction": 1.999999999999996}, "ep004": {"nsteps": 344, "reward": -2.6680862060693893, "good_angle": 2.288685589904092, "survival_time": 11.466666666666637, "traveled_tiles": 18, "valid_direction": 3.4666666666666597}}good_angle_max 2.288685589904092 good_angle_mean 1.2264470579383553 good_angle_median 0.9574565005822604 good_angle_min 0.5114915912986825 reward_max -2.6680862060693893 reward_mean -9.916032297498845 reward_median -3.240260654304765 reward_min -35.37664484104206 survival_time_max 11.466666666666637 survival_time_mean 7.619999999999981 survival_time_min 0.9666666666666666 traveled_tiles_max 18 traveled_tiles_mean 13.2 traveled_tiles_median 18 traveled_tiles_min 2 valid_direction_max 3.4666666666666597 valid_direction_mean 2.153333333333329 valid_direction_median 2.433333333333328 valid_direction_min 0.3999999999999999
No reset possible 116661141Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 16:10:06+00:00 2018-11-22 16:18:00+00:00 0:07:54 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11665350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 16:07:40+00:00 2018-11-22 16:10:00+00:00 0:02:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 5.395475202712161 deviation-center-line_median 0.2959546354987483 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 0.4498660376660492 deviation-center-line_mean 0.2825728293853767 deviation-center-line_min 0.08998681126349695 deviation-heading_max 1.4128782067782513 deviation-heading_mean 0.9337761557326252 deviation-heading_median 1.0813383077482182 deviation-heading_min 0.3564579734081657 driven_any_max 9.203898428133009 driven_any_mean 5.582675355918754 driven_any_median 5.856658489354631 driven_any_min 1.3393709136878815 driven_lanedir_max 8.907353154537361 driven_lanedir_mean 5.341686219375335 driven_lanedir_min 1.2699929161154695 in-drivable-lane_max 0.29999999999999993 in-drivable-lane_mean 0.09333333333333324 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 5.856658489354631, "driven_lanedir": 5.395475202712161, "in-drivable-lane": 0.29999999999999993, "deviation-heading": 1.0813383077482182, "deviation-center-line": 0.2959546354987483}, "ep001": {"driven_any": 9.203898428133009, "driven_lanedir": 8.907353154537361, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 1.4128782067782513, "deviation-center-line": 0.4498660376660492}, "ep002": {"driven_any": 7.583956436730906, "driven_lanedir": 7.326049214046058, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.2117759589502977, "deviation-center-line": 0.3847538356308714}, "ep003": {"driven_any": 3.929492511687342, "driven_lanedir": 3.809560609465623, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.6064303317781938, "deviation-center-line": 0.19230282686771755}, "ep004": {"driven_any": 1.3393709136878815, "driven_lanedir": 1.2699929161154695, "in-drivable-lane": 0, "deviation-heading": 0.3564579734081657, "deviation-center-line": 0.08998681126349695}}
No reset possible 11664350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 16:06:42+00:00 2018-11-22 16:07:34+00:00 0:00:52 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11663350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 16:06:12+00:00 2018-11-22 16:06:34+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.133333333333321
other stats episodes details {"ep000": {"nsteps": 184, "reward": -4.7244524529274, "good_angle": 0.29873951808741794, "survival_time": 6.133333333333321, "traveled_tiles": 9, "valid_direction": 0.4333333333333329}, "ep001": {"nsteps": 286, "reward": -2.8072072125945264, "good_angle": 0.12169887351288114, "survival_time": 9.53333333333331, "traveled_tiles": 15, "valid_direction": 0.06666666666666643}, "ep002": {"nsteps": 241, "reward": -3.444026603063238, "good_angle": 0.1110344139693269, "survival_time": 8.033333333333315, "traveled_tiles": 13, "valid_direction": 0.09999999999999964}, "ep003": {"nsteps": 125, "reward": -7.366681019887328, "good_angle": 0.04435552354435385, "survival_time": 4.166666666666662, "traveled_tiles": 6, "valid_direction": 0}, "ep004": {"nsteps": 43, "reward": -22.77357815318676, "good_angle": 0.07759205360533021, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.10000000000000032}}good_angle_max 0.29873951808741794 good_angle_mean 0.130684076543862 good_angle_median 0.1110344139693269 good_angle_min 0.04435552354435385 reward_max -2.8072072125945264 reward_mean -8.22318908833185 reward_median -4.7244524529274 reward_min -22.77357815318676 survival_time_max 9.53333333333331 survival_time_mean 5.859999999999988 survival_time_min 1.4333333333333345 traveled_tiles_max 15 traveled_tiles_mean 9 traveled_tiles_median 9 traveled_tiles_min 2 valid_direction_max 0.4333333333333329 valid_direction_mean 0.13999999999999985 valid_direction_median 0.09999999999999964 valid_direction_min 0
No reset possible 11661350Manfred Diaz Tensorflow template aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 16:00:58+00:00 2018-11-22 16:06:06+00:00 0:05:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11659372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 15:58:24+00:00 2018-11-22 16:00:52+00:00 0:02:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 5.395475202712161 deviation-center-line_median 0.2959546354987483 in-drivable-lane_median 0.06666666666666643
other stats deviation-center-line_max 0.4498660376660492 deviation-center-line_mean 0.2825728293853767 deviation-center-line_min 0.08998681126349695 deviation-heading_max 1.4128782067782513 deviation-heading_mean 0.9337761557326252 deviation-heading_median 1.0813383077482182 deviation-heading_min 0.3564579734081657 driven_any_max 9.203898428133009 driven_any_mean 5.582675355918754 driven_any_median 5.856658489354631 driven_any_min 1.3393709136878815 driven_lanedir_max 8.907353154537361 driven_lanedir_mean 5.341686219375335 driven_lanedir_min 1.2699929161154695 in-drivable-lane_max 0.29999999999999993 in-drivable-lane_mean 0.09333333333333324 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 5.856658489354631, "driven_lanedir": 5.395475202712161, "in-drivable-lane": 0.29999999999999993, "deviation-heading": 1.0813383077482182, "deviation-center-line": 0.2959546354987483}, "ep001": {"driven_any": 9.203898428133009, "driven_lanedir": 8.907353154537361, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 1.4128782067782513, "deviation-center-line": 0.4498660376660492}, "ep002": {"driven_any": 7.583956436730906, "driven_lanedir": 7.326049214046058, "in-drivable-lane": 0.06666666666666643, "deviation-heading": 1.2117759589502977, "deviation-center-line": 0.3847538356308714}, "ep003": {"driven_any": 3.929492511687342, "driven_lanedir": 3.809560609465623, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 0.6064303317781938, "deviation-center-line": 0.19230282686771755}, "ep004": {"driven_any": 1.3393709136878815, "driven_lanedir": 1.2699929161154695, "in-drivable-lane": 0, "deviation-heading": 0.3564579734081657, "deviation-center-line": 0.08998681126349695}}
No reset possible 11658372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 15:57:22+00:00 2018-11-22 15:58:18+00:00 0:00:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11657372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 15:56:44+00:00 2018-11-22 15:57:07+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 6.133333333333321
other stats episodes details {"ep000": {"nsteps": 184, "reward": -4.7244524529274, "good_angle": 0.29873951808741794, "survival_time": 6.133333333333321, "traveled_tiles": 9, "valid_direction": 0.4333333333333329}, "ep001": {"nsteps": 286, "reward": -2.8072072125945264, "good_angle": 0.12169887351288114, "survival_time": 9.53333333333331, "traveled_tiles": 15, "valid_direction": 0.06666666666666643}, "ep002": {"nsteps": 241, "reward": -3.444026603063238, "good_angle": 0.1110344139693269, "survival_time": 8.033333333333315, "traveled_tiles": 13, "valid_direction": 0.09999999999999964}, "ep003": {"nsteps": 125, "reward": -7.366681019887328, "good_angle": 0.04435552354435385, "survival_time": 4.166666666666662, "traveled_tiles": 6, "valid_direction": 0}, "ep004": {"nsteps": 43, "reward": -22.77357815318676, "good_angle": 0.07759205360533021, "survival_time": 1.4333333333333345, "traveled_tiles": 2, "valid_direction": 0.10000000000000032}}good_angle_max 0.29873951808741794 good_angle_mean 0.130684076543862 good_angle_median 0.1110344139693269 good_angle_min 0.04435552354435385 reward_max -2.8072072125945264 reward_mean -8.22318908833185 reward_median -4.7244524529274 reward_min -22.77357815318676 survival_time_max 9.53333333333331 survival_time_mean 5.859999999999988 survival_time_min 1.4333333333333345 traveled_tiles_max 15 traveled_tiles_mean 9 traveled_tiles_median 9 traveled_tiles_min 2 valid_direction_max 0.4333333333333329 valid_direction_mean 0.13999999999999985 valid_direction_median 0.09999999999999964 valid_direction_min 0
No reset possible 11654372Samuel Lavoie Tensorflow template aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 15:51:05+00:00 2018-11-22 15:56:29+00:00 0:05:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 11652989Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step1-simulation failed yes nutonomy-P50-21102018-11-22 15:41:33+00:00 2018-11-22 15:50:59+00:00 0:09:26 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "./solution.py", line 93, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Giving up to connect to the gym duckietown server at host: evaluator
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116511066Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 15:39:29+00:00 2018-11-22 15:41:24+00:00 0:01:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 2.278588854052452 deviation-center-line_median 0.21809241589802017 in-drivable-lane_median 0.33333333333333326
other stats deviation-center-line_max 0.3766938063307367 deviation-center-line_mean 0.22210026888604265 deviation-center-line_min 0.06830812164886425 deviation-heading_max 0.8718584951275211 deviation-heading_mean 0.4340042753329514 deviation-heading_median 0.3513325120712383 deviation-heading_min 0.08722157294989812 driven_any_max 5.0157770657010925 driven_any_mean 2.6089478760228886 driven_any_median 2.8537915662645896 driven_any_min 0.8138328642320951 driven_lanedir_max 4.990305519526771 driven_lanedir_mean 2.2491412071611414 driven_lanedir_min 0.6712037561417175 in-drivable-lane_max 0.8333333333333337 in-drivable-lane_mean 0.3666666666666667 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.3971250211990682, "driven_lanedir": 0.6712037561417175, "in-drivable-lane": 0.8333333333333337, "deviation-heading": 0.3513325120712383, "deviation-center-line": 0.11763384424826236}, "ep001": {"driven_any": 5.0157770657010925, "driven_lanedir": 4.990305519526771, "in-drivable-lane": 0, "deviation-heading": 0.3321772922741839, "deviation-center-line": 0.32977315630432974}, "ep002": {"driven_any": 2.8537915662645896, "driven_lanedir": 2.498192182595096, "in-drivable-lane": 0.33333333333333326, "deviation-heading": 0.5274315042419152, "deviation-center-line": 0.21809241589802017}, "ep003": {"driven_any": 0.8138328642320951, "driven_lanedir": 0.8074157234896729, "in-drivable-lane": 0, "deviation-heading": 0.08722157294989812, "deviation-center-line": 0.06830812164886425}, "ep004": {"driven_any": 2.9642128627175963, "driven_lanedir": 2.278588854052452, "in-drivable-lane": 0.6666666666666664, "deviation-heading": 0.8718584951275211, "deviation-center-line": 0.3766938063307367}}
No reset possible 116491066Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 15:38:34+00:00 2018-11-22 15:39:23+00:00 0:00:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116481066Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 15:38:04+00:00 2018-11-22 15:38:28+00:00 0:00:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 3.3666666666666645
other stats episodes details {"ep000": {"nsteps": 54, "reward": -18.40805944461479, "good_angle": 0.1964972342312447, "survival_time": 1.8000000000000025, "traveled_tiles": 3, "valid_direction": 0.7000000000000013}, "ep001": {"nsteps": 168, "reward": -5.554499223734075, "good_angle": 0.07652576541354807, "survival_time": 5.59999999999999, "traveled_tiles": 9, "valid_direction": 0}, "ep002": {"nsteps": 101, "reward": -9.388138811159326, "good_angle": 0.19265134197742137, "survival_time": 3.3666666666666645, "traveled_tiles": 6, "valid_direction": 0.6333333333333331}, "ep003": {"nsteps": 30, "reward": -32.962174254407486, "good_angle": 0.06665154713390387, "survival_time": 1, "traveled_tiles": 2, "valid_direction": 0.23333333333333328}, "ep004": {"nsteps": 114, "reward": -8.315416145089426, "good_angle": 0.4515251378455981, "survival_time": 3.799999999999996, "traveled_tiles": 6, "valid_direction": 1.0333333333333332}}good_angle_max 0.4515251378455981 good_angle_mean 0.19677020532034323 good_angle_median 0.19265134197742137 good_angle_min 0.06665154713390387 reward_max -5.554499223734075 reward_mean -14.92565757580102 reward_median -9.388138811159326 reward_min -32.962174254407486 survival_time_max 5.59999999999999 survival_time_mean 3.1133333333333306 survival_time_min 1 traveled_tiles_max 9 traveled_tiles_mean 5.2 traveled_tiles_median 6 traveled_tiles_min 2 valid_direction_max 1.0333333333333332 valid_direction_mean 0.5200000000000002 valid_direction_median 0.6333333333333331 valid_direction_min 0
No reset possible 116461066Benjamin Ramtoula My ROS solution aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 15:32:53+00:00 2018-11-22 15:37:57+00:00 0:05:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116441218Jonathan Plante JP pipeline aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 15:29:19+00:00 2018-11-22 15:32:47+00:00 0:03:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 5.516332344618734 deviation-center-line_median 0.41730864456122463 in-drivable-lane_median 0.8666666666666638
other stats deviation-center-line_max 1.183996685872265 deviation-center-line_mean 0.5595783761753557 deviation-center-line_min 0.021055182344907677 deviation-heading_max 2.83484736798613 deviation-heading_mean 1.3428293434425411 deviation-heading_median 0.972205421064388 deviation-heading_min 0.18342956864139295 driven_any_max 18.941215905863785 driven_any_mean 9.227443930130388 driven_any_median 6.136877245145523 driven_any_min 1.1964750359211365 driven_lanedir_max 16.49764953509191 driven_lanedir_mean 7.993530563285452 driven_lanedir_min 0.19805673514931765 in-drivable-lane_max 1.566666666666661 in-drivable-lane_mean 0.8066666666666649 in-drivable-lane_min 0.3666666666666658 per-episodes details {"ep000": {"driven_any": 1.1964750359211365, "driven_lanedir": 0.19805673514931765, "in-drivable-lane": 0.8666666666666666, "deviation-heading": 0.18342956864139295, "deviation-center-line": 0.021055182344907677}, "ep001": {"driven_any": 6.136877245145523, "driven_lanedir": 5.516332344618734, "in-drivable-lane": 0.3666666666666666, "deviation-heading": 0.7897143012744152, "deviation-center-line": 0.41730864456122463}, "ep002": {"driven_any": 14.44854344507617, "driven_lanedir": 12.996832639225907, "in-drivable-lane": 0.8666666666666638, "deviation-heading": 1.9339500582463804, "deviation-center-line": 0.8569148276208011}, "ep003": {"driven_any": 18.941215905863785, "driven_lanedir": 16.49764953509191, "in-drivable-lane": 1.566666666666661, "deviation-heading": 2.83484736798613, "deviation-center-line": 1.183996685872265}, "ep004": {"driven_any": 5.414108018645329, "driven_lanedir": 4.758781562341394, "in-drivable-lane": 0.3666666666666658, "deviation-heading": 0.972205421064388, "deviation-center-line": 0.31861654047757987}}
No reset possible 116421218Jonathan Plante JP pipeline aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 15:27:26+00:00 2018-11-22 15:29:13+00:00 0:01:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116401218Jonathan Plante JP pipeline aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 15:23:18+00:00 2018-11-22 15:27:19+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 5.399999999999991
other stats episodes details {"ep000": {"nsteps": 35, "reward": -29.15053927249142, "good_angle": 0.34486177249544686, "survival_time": 1.166666666666667, "traveled_tiles": 3, "valid_direction": 0.5333333333333337}, "ep001": {"nsteps": 162, "reward": -5.599635734326309, "good_angle": 0.17519793560250463, "survival_time": 5.399999999999991, "traveled_tiles": 11, "valid_direction": 0.4999999999999991}, "ep002": {"nsteps": 379, "reward": -1.9871136692394369, "good_angle": 0.4523153475328166, "survival_time": 12.6333333333333, "traveled_tiles": 18, "valid_direction": 1.199999999999996}, "ep003": {"nsteps": 500, "reward": 0.6010044494001194, "good_angle": 0.92725251733234, "survival_time": 16.666666666666654, "traveled_tiles": 18, "valid_direction": 2.2999999999999927}, "ep004": {"nsteps": 146, "reward": -6.197705786126628, "good_angle": 0.27483451760132255, "survival_time": 4.866666666666659, "traveled_tiles": 10, "valid_direction": 0.7666666666666673}}good_angle_max 0.92725251733234 good_angle_mean 0.4348924181128861 good_angle_median 0.34486177249544686 good_angle_min 0.17519793560250463 reward_max 0.6010044494001194 reward_mean -8.466798002556732 reward_median -5.599635734326309 reward_min -29.15053927249142 survival_time_max 16.666666666666654 survival_time_mean 8.146666666666654 survival_time_min 1.166666666666667 traveled_tiles_max 18 traveled_tiles_mean 12 traveled_tiles_median 11 traveled_tiles_min 3 valid_direction_max 2.2999999999999927 valid_direction_mean 1.0599999999999978 valid_direction_median 0.7666666666666673 valid_direction_min 0.4999999999999991
No reset possible 116391188Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 15:21:21+00:00 2018-11-22 15:23:06+00:00 0:01:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.5534791234164032 deviation-center-line_median 0.10983112498742968 in-drivable-lane_median 0.09999999999999964
other stats deviation-center-line_max 0.2583606073645018 deviation-center-line_mean 0.16186698572548514 deviation-center-line_min 0.08021330825732947 deviation-heading_max 1.2465163115152682 deviation-heading_mean 0.5062205703227058 deviation-heading_median 0.291276387317167 deviation-heading_min 0.2094652068147559 driven_any_max 5.038123399839069 driven_any_mean 2.8405639852079467 driven_any_median 1.816381128405938 driven_any_min 1.413415413306914 driven_lanedir_max 4.820803802702431 driven_lanedir_mean 2.4633836614831166 driven_lanedir_min 1.0092440067216246 in-drivable-lane_max 0.6666666666666666 in-drivable-lane_mean 0.23333333333333303 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 1.816381128405938, "driven_lanedir": 1.0092440067216246, "in-drivable-lane": 0.6666666666666666, "deviation-heading": 0.2094652068147559, "deviation-center-line": 0.08021330825732947}, "ep001": {"driven_any": 5.038123399839069, "driven_lanedir": 4.820803802702431, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 0.5449342941754828, "deviation-center-line": 0.2573428680194661}, "ep002": {"driven_any": 1.413415413306914, "driven_lanedir": 1.2888993987261592, "in-drivable-lane": 0.06666666666666665, "deviation-heading": 0.291276387317167, "deviation-center-line": 0.10983112498742968}, "ep003": {"driven_any": 1.602741182796589, "driven_lanedir": 1.5534791234164032, "in-drivable-lane": 0, "deviation-heading": 0.23891065179085552, "deviation-center-line": 0.10358701999869872}, "ep004": {"driven_any": 4.332158801691224, "driven_lanedir": 3.6444919758489625, "in-drivable-lane": 0.33333333333333237, "deviation-heading": 1.2465163115152682, "deviation-center-line": 0.2583606073645018}}
No reset possible 116371188Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step3-videos success yes nutonomy-P50-21102018-11-22 15:20:12+00:00 2018-11-22 15:21:15+00:00 0:01:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 116361188Vincent Mai ROS-based Lane Following aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 15:16:17+00:00 2018-11-22 15:20:06+00:00 0:03:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 1.6666666666666683
other stats episodes details {"ep000": {"nsteps": 50, "reward": -19.82314567837864, "good_angle": 0.11999343169731796, "survival_time": 1.6666666666666683, "traveled_tiles": 3, "valid_direction": 0.29999999999999993}, "ep001": {"nsteps": 132, "reward": -6.8563389602508815, "good_angle": 0.07770522542696086, "survival_time": 4.399999999999994, "traveled_tiles": 9, "valid_direction": 0.09999999999999998}, "ep002": {"nsteps": 39, "reward": -24.93063542934565, "good_angle": 0.0494181665288904, "survival_time": 1.3000000000000007, "traveled_tiles": 3, "valid_direction": 0.033333333333333326}, "ep003": {"nsteps": 44, "reward": -22.398545466194097, "good_angle": 0.022946883765564953, "survival_time": 1.466666666666668, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 122, "reward": -8.039429325396654, "good_angle": 3.143366972397766, "survival_time": 4.066666666666662, "traveled_tiles": 4, "valid_direction": 1.8333333333333308}}good_angle_max 3.143366972397766 good_angle_mean 0.6826861359633001 good_angle_median 0.07770522542696086 good_angle_min 0.022946883765564953 reward_max -6.8563389602508815 reward_mean -16.409618971913183 reward_median -19.82314567837864 reward_min -24.93063542934565 survival_time_max 4.399999999999994 survival_time_mean 2.579999999999999 survival_time_min 1.3000000000000007 traveled_tiles_max 9 traveled_tiles_mean 4.4 traveled_tiles_median 3 traveled_tiles_min 3 valid_direction_max 1.8333333333333308 valid_direction_mean 0.4533333333333328 valid_direction_median 0.09999999999999998 valid_direction_min 0
No reset possible 115011304Anton Mashikhin SAIC MOSCOW MML aido1_LF1_r3-v3step1-simulation success yes nutonomy-P50-21102018-11-22 14:26:13+00:00 2018-11-22 14:29:14+00:00 0:03:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 114841314Andrea Censi Random execution aido1_LF1_r3-v3step4-viz success yes nutonomy-P50-21102018-11-22 14:11:23+00:00 2018-11-22 14:15:24+00:00 0:04:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_median 1.134830639523888 deviation-center-line_median 0.3977702682886593 in-drivable-lane_median 0.6
other stats deviation-center-line_max 0.5899696953743233 deviation-center-line_mean 0.4008934334344922 deviation-center-line_min 0.20197253315778643 deviation-heading_max 3.1331040616830927 deviation-heading_mean 1.973470152067882 deviation-heading_median 2.021289976445161 deviation-heading_min 1.3201031253611382 driven_any_max 2.114709727395646 driven_any_mean 1.263684732190949 driven_any_median 1.18171691154002 driven_any_min 0.36019277066593236 driven_lanedir_max 2.054235738822748 driven_lanedir_mean 1.0556245088221436 driven_lanedir_min 0.1463738480159249 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.679999999999998 in-drivable-lane_min 0 per-episodes details {"ep000": {"driven_any": 0.36019277066593236, "driven_lanedir": 0.1463738480159249, "in-drivable-lane": 0.6, "deviation-heading": 2.022055670789819, "deviation-center-line": 0.20197253315778643}, "ep001": {"driven_any": 1.063421008336482, "driven_lanedir": 0.6906321399289206, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 2.021289976445161, "deviation-center-line": 0.5899696953743233}, "ep002": {"driven_any": 1.18171691154002, "driven_lanedir": 1.134830639523888, "in-drivable-lane": 0, "deviation-heading": 1.3201031253611382, "deviation-center-line": 0.3977702682886593}, "ep003": {"driven_any": 2.114709727395646, "driven_lanedir": 2.054235738822748, "in-drivable-lane": 0.033333333333333215, "deviation-heading": 1.3707979260601992, "deviation-center-line": 0.3533142034516957}, "ep004": {"driven_any": 1.5983832430166651, "driven_lanedir": 1.2520501778192366, "in-drivable-lane": 0.9666666666666632, "deviation-heading": 3.1331040616830927, "deviation-center-line": 0.461440466899996}}
No reset possible 114821315Andrea Censi Random execution aido1_LFV_r1-v3step2-scoring success yes nutonomy-P50-21102018-11-22 14:10:44+00:00 2018-11-22 14:11:04+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 12.299999999999969
other stats episodes details {"ep000": {"nsteps": 114, "reward": -9.954338063239817, "good_angle": 4.548696140516476, "survival_time": 3.799999999999996, "traveled_tiles": 1, "valid_direction": 2.9999999999999964}, "ep001": {"nsteps": 125, "reward": -8.400953475594521, "good_angle": 0.04312893387319344, "survival_time": 4.166666666666662, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 369, "reward": -3.634705633773067, "good_angle": 18.740089410934033, "survival_time": 12.299999999999969, "traveled_tiles": 3, "valid_direction": 3.966666666666653}, "ep003": {"nsteps": 425, "reward": -2.822804708265535, "good_angle": 20.72937602356365, "survival_time": 14.166666666666629, "traveled_tiles": 4, "valid_direction": 3.9333333333333194}, "ep004": {"nsteps": 411, "reward": -2.8215370733073377, "good_angle": 20.467376118387193, "survival_time": 13.699999999999962, "traveled_tiles": 4, "valid_direction": 3.9333333333333194}}good_angle_max 20.72937602356365 good_angle_mean 12.905733325454907 good_angle_median 18.740089410934033 good_angle_min 0.04312893387319344 reward_max -2.8215370733073377 reward_mean -5.5268677908360555 reward_median -3.634705633773067 reward_min -9.954338063239817 survival_time_max 14.166666666666629 survival_time_mean 9.626666666666642 survival_time_min 3.799999999999996 traveled_tiles_max 4 traveled_tiles_mean 2.8 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 3.966666666666653 valid_direction_mean 2.9666666666666575 valid_direction_median 3.9333333333333194 valid_direction_min 0
No reset possible 114701315Andrea Censi Random execution aido1_LFV_r1-v3step1-simulation success no nutonomy-P50-21102018-11-22 14:06:28+00:00 2018-11-22 14:10:38+00:00 0:04:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 114641313Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation error no nutonomy-P50-21102018-11-22 10:04:03+00:00 2018-11-22 10:04:37+00:00 0:00:34 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 488, in wrap_evaluator
evaluator.score(cie)
File "eval.py", line 97, in score
raise dc.InvalidEvaluator(msg)
InvalidEvaluator: Gym exited with code 2
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 114601312Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step1-simulation failed no nutonomy-P50-21102018-11-22 09:58:11+00:00 2018-11-22 09:58:43+00:00 0:00:32 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/workspace/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 486, in wrap_evaluator
raise InvalidSubmission(out[SPECIAL_INVALID_SUBMISSION])
InvalidSubmission: Invalid solution:
Traceback (most recent call last):
File "/notebooks/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 585, in wrap_solution
solution.run(cis)
File "solution.py", line 135, in run
raise InvalidSubmission(str(e))
InvalidSubmission: Cannot feed value of shape (69120,) for Tensor u'prefix/x:0', which has shape '(?, 69120)'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 114331311Eric Lu Baseline solution using imitation learning from logs aido1_LF1_r3-v3step2-scoring success yes nutonomy-P50-21102018-11-22 07:12:27+00:00 2018-11-22 07:14:06+00:00 0:01:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 8.166666666666648
other stats episodes details {"ep000": {"nsteps": 94, "reward": -10.901446696190025, "good_angle": 1.5535384000988208, "survival_time": 3.133333333333332, "traveled_tiles": 1, "valid_direction": 2.633333333333332}, "ep001": {"nsteps": 76, "reward": -13.723119527101517, "good_angle": 0.021566788071447456, "survival_time": 2.533333333333334, "traveled_tiles": 1, "valid_direction": 0}, "ep002": {"nsteps": 245, "reward": -4.524834315630854, "good_angle": 0.2689719162688768, "survival_time": 8.166666666666648, "traveled_tiles": 3, "valid_direction": 0.9333333333333308}, "ep003": {"nsteps": 262, "reward": -4.10099546995213, "good_angle": 0.05018420306392457, "survival_time": 8.733333333333313, "traveled_tiles": 3, "valid_direction": 0}, "ep004": {"nsteps": 414, "reward": -3.058105362804183, "good_angle": 22.692844975675257, "survival_time": 13.799999999999962, "traveled_tiles": 3, "valid_direction": 4.7333333333333165}}good_angle_max 22.692844975675257 good_angle_mean 4.917421256635665 good_angle_median 0.2689719162688768 good_angle_min 0.021566788071447456 reward_max -3.058105362804183 reward_mean -7.261700274335742 reward_median -4.524834315630854 reward_min -13.723119527101517 survival_time_max 13.799999999999962 survival_time_mean 7.273333333333317 survival_time_min 2.533333333333334 traveled_tiles_max 3 traveled_tiles_mean 2.2 traveled_tiles_median 3 traveled_tiles_min 1 valid_direction_max 4.7333333333333165 valid_direction_mean 1.659999999999996 valid_direction_median 0.9333333333333308 valid_direction_min 0
No reset possible 114071310Dzenan Lapandic LFV bd test aido1_LFV_r1-v3step2-scoring success yes nutonomy-P50-21102018-11-21 22:26:13+00:00 2018-11-21 22:28:11+00:00 0:01:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median 4.866666666666659
other stats episodes details {"ep000": {"nsteps": 113, "reward": -10.039470491098422, "good_angle": 4.572765004719664, "survival_time": 3.766666666666663, "traveled_tiles": 1, "valid_direction": 2.93333333333333}, "ep001": {"nsteps": 125, "reward": -8.37514194059372, "good_angle": 0.050831405786390504, "survival_time": 4.166666666666662, "traveled_tiles": 2, "valid_direction": 0}, "ep002": {"nsteps": 146, "reward": -7.364661927092565, "good_angle": 0.011630850000797582, "survival_time": 4.866666666666659, "traveled_tiles": 2, "valid_direction": 0}, "ep003": {"nsteps": 424, "reward": -2.919593949011474, "good_angle": 17.87609837106009, "survival_time": 14.133333333333294, "traveled_tiles": 4, "valid_direction": 3.9333333333333194}, "ep004": {"nsteps": 411, "reward": -2.993244393444858, "good_angle": 19.231702686932355, "survival_time": 13.699999999999962, "traveled_tiles": 4, "valid_direction": 3.999999999999986}}good_angle_max 19.231702686932355 good_angle_mean 8.34860566369986 good_angle_median 4.572765004719664 good_angle_min 0.011630850000797582 reward_max -2.919593949011474 reward_mean -6.338422540248208 reward_median -7.364661927092565 reward_min -10.039470491098422 survival_time_max 14.133333333333294 survival_time_mean 8.126666666666647 survival_time_min 3.766666666666663 traveled_tiles_max 4 traveled_tiles_mean 2.6 traveled_tiles_median 2 traveled_tiles_min 1 valid_direction_max 3.999999999999986 valid_direction_mean 2.173333333333327 valid_direction_median 2.93333333333333 valid_direction_min 0
No reset possible
Andrea Censi 🇨🇭
