Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 216393259Sean Lu Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation error no ip-172-31-40-253-321252019-05-07 17:53:16+00:00 2019-05-07 17:54:32+00:00 0:01:16 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 216383258Anastasiya Nikolskaya JetBrains Research aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-07 17:32:41+00:00 2019-05-07 17:48:34+00:00 0:15:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0028188314418163 survival_time_median 10.050000000000008 deviation-center-line_median 0.8304897516479959 in-drivable-lane_median 0.350000000000005
other stats agent_compute-ego_max 0.3513626886244437 agent_compute-ego_mean 0.31237640428058744 agent_compute-ego_median 0.31669753074645995 agent_compute-ego_min 0.2598567905426025 deviation-center-line_max 1.0954803093347607 deviation-center-line_mean 0.7870882202763906 deviation-center-line_min 0.3045136618883586 deviation-heading_max 4.023757241391299 deviation-heading_mean 2.0734621393413675 deviation-heading_median 1.297310027549018 deviation-heading_min 0.5043091725408647 driven_any_max 3.054015714885717 driven_any_mean 2.0411347762641077 driven_any_median 2.0368595147486515 driven_any_min 1.0410894468868106 driven_lanedir_consec_max 2.572113214023684 driven_lanedir_consec_mean 1.792445143786503 driven_lanedir_consec_min 0.7063718830922456 driven_lanedir_max 2.572113214023684 driven_lanedir_mean 1.792445143786503 driven_lanedir_median 2.0028188314418163 driven_lanedir_min 0.7063718830922456 in-drivable-lane_max 2.050000000000029 in-drivable-lane_mean 0.7700000000000058 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.054015714885717, "sim_physics": 0.07482904036839803, "survival_time": 14.950000000000076, "driven_lanedir": 2.4836510808035626, "sim_render-ego": 0.04459848324457805, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.31669753074645995, "deviation-heading": 3.3062545481990253, "set_robot_commands": 0.0681283942858378, "deviation-center-line": 1.0954803093347607, "driven_lanedir_consec": 2.4836510808035626, "sim_compute_sim_state": 0.028672178586324055, "sim_compute_performance-ego": 0.04772636254628499, "sim_compute_robot_state-ego": 0.05133612632751465}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0410894468868106, "sim_physics": 0.07530921810078171, "survival_time": 5.299999999999989, "driven_lanedir": 0.7063718830922456, "sim_render-ego": 0.04252467515333643, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.3303393710334346, "deviation-heading": 1.235679707026631, "set_robot_commands": 0.06797568303234172, "deviation-center-line": 0.3045136618883586, "driven_lanedir_consec": 0.7063718830922456, "sim_compute_sim_state": 0.02864720011657139, "sim_compute_performance-ego": 0.049340675461967035, "sim_compute_robot_state-ego": 0.051566962925892953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2402653420571874, "sim_physics": 0.0731226749420166, "survival_time": 6.249999999999986, "driven_lanedir": 1.1972707095712058, "sim_render-ego": 0.04303042221069336, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2598567905426025, "deviation-heading": 0.5043091725408647, "set_robot_commands": 0.06759013557434082, "deviation-center-line": 0.6516327494535189, "driven_lanedir_consec": 1.1972707095712058, "sim_compute_sim_state": 0.028902721405029298, "sim_compute_performance-ego": 0.04920940208435059, "sim_compute_robot_state-ego": 0.05218078994750976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.8334438627421727, "sim_physics": 0.07943537261081517, "survival_time": 13.850000000000062, "driven_lanedir": 2.572113214023684, "sim_render-ego": 0.04412201595650683, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.3036256404559965, "deviation-heading": 4.023757241391299, "set_robot_commands": 0.06847135168550678, "deviation-center-line": 1.0533246290573193, "driven_lanedir_consec": 2.572113214023684, "sim_compute_sim_state": 0.029034115347190883, "sim_compute_performance-ego": 0.04930232406092895, "sim_compute_robot_state-ego": 0.05228535018673012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0368595147486515, "sim_physics": 0.07710724564927135, "survival_time": 10.050000000000008, "driven_lanedir": 2.0028188314418163, "sim_render-ego": 0.04362700234598188, "in-drivable-lane": 0, "agent_compute-ego": 0.3513626886244437, "deviation-heading": 1.297310027549018, "set_robot_commands": 0.06742957812636646, "deviation-center-line": 0.8304897516479959, "driven_lanedir_consec": 2.0028188314418163, "sim_compute_sim_state": 0.02805222682098844, "sim_compute_performance-ego": 0.04828473940417541, "sim_compute_robot_state-ego": 0.05142080961768307}}set_robot_commands_max 0.06847135168550678 set_robot_commands_mean 0.06791902854087871 set_robot_commands_median 0.06797568303234172 set_robot_commands_min 0.06742957812636646 sim_compute_performance-ego_max 0.049340675461967035 sim_compute_performance-ego_mean 0.0487727007115414 sim_compute_performance-ego_median 0.04920940208435059 sim_compute_performance-ego_min 0.04772636254628499 sim_compute_robot_state-ego_max 0.05228535018673012 sim_compute_robot_state-ego_mean 0.05175800780106611 sim_compute_robot_state-ego_median 0.051566962925892953 sim_compute_robot_state-ego_min 0.05133612632751465 sim_compute_sim_state_max 0.029034115347190883 sim_compute_sim_state_mean 0.028661688455220817 sim_compute_sim_state_median 0.028672178586324055 sim_compute_sim_state_min 0.02805222682098844 sim_physics_max 0.07943537261081517 sim_physics_mean 0.07596071033425658 sim_physics_median 0.07530921810078171 sim_physics_min 0.0731226749420166 sim_render-ego_max 0.04459848324457805 sim_render-ego_mean 0.043580519782219315 sim_render-ego_median 0.04362700234598188 sim_render-ego_min 0.04252467515333643 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.080000000000023 survival_time_min 5.299999999999989
No reset possible 215963230Sheng-Cheng, Lee PredictorLast aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-06 19:22:18+00:00 2019-05-06 19:22:44+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.118305623929192 error_L2 0.021572225640801305
No reset possible 215723228Jerry Su PredictorLast aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-06 14:15:54+00:00 2019-05-06 14:16:20+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10188172424998168 error_L2 0.017770022237729676
No reset possible 215713227Artem Ioselevskii challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-06 13:41:18+00:00 2019-05-06 13:48:56+00:00 0:07:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9658101023157206 survival_time_median 8.399999999999984 deviation-center-line_median 0.4853062696584811 in-drivable-lane_median 0.3500000000000003
other stats agent_compute-ego_max 0.05475472879933787 agent_compute-ego_mean 0.05387761633921687 agent_compute-ego_median 0.05394804318745931 agent_compute-ego_min 0.052803390166338754 deviation-center-line_max 1.003048881305438 deviation-center-line_mean 0.5927975878674203 deviation-center-line_min 0.4038988674704947 deviation-heading_max 4.056518502675438 deviation-heading_mean 2.30397550013119 deviation-heading_median 2.376219802547203 deviation-heading_min 0.486893857057569 driven_any_max 2.3413330819722824 driven_any_mean 1.2594306951785583 driven_any_median 1.296333411068631 driven_any_min 0.6294180752476466 driven_lanedir_consec_max 1.2092274960498304 driven_lanedir_consec_mean 0.8585617234198409 driven_lanedir_consec_min 0.3052833450106686 driven_lanedir_max 1.839149956633663 driven_lanedir_mean 1.0686893323712785 driven_lanedir_median 1.1874828643954105 driven_lanedir_min 0.4825815354499132 in-drivable-lane_max 2.1000000000000085 in-drivable-lane_mean 0.570000000000003 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.3413330819722824, "sim_physics": 0.06077896515528361, "survival_time": 14.950000000000076, "driven_lanedir": 1.839149956633663, "sim_render-ego": 0.03613765796025594, "in-drivable-lane": 2.1000000000000085, "agent_compute-ego": 0.05394804318745931, "deviation-heading": 4.056518502675438, "set_robot_commands": 0.05472390572230021, "deviation-center-line": 1.003048881305438, "driven_lanedir_consec": 0.9658101023157206, "sim_compute_sim_state": 0.02337336301803589, "sim_compute_performance-ego": 0.03972062985102336, "sim_compute_robot_state-ego": 0.04168492078781128}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6775083823261613, "sim_physics": 0.061976527119730854, "survival_time": 4.549999999999992, "driven_lanedir": 0.4825815354499132, "sim_render-ego": 0.03620922172462547, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.05475472879933787, "deviation-heading": 2.2022952726616984, "set_robot_commands": 0.05683305761316321, "deviation-center-line": 0.4038988674704947, "driven_lanedir_consec": 0.3052833450106686, "sim_compute_sim_state": 0.02376505568787292, "sim_compute_performance-ego": 0.04025875605069674, "sim_compute_robot_state-ego": 0.041844420380644745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6294180752476466, "sim_physics": 0.060155851700726674, "survival_time": 4.249999999999993, "driven_lanedir": 0.625004809327574, "sim_render-ego": 0.03605639794293572, "in-drivable-lane": 0, "agent_compute-ego": 0.052803390166338754, "deviation-heading": 0.486893857057569, "set_robot_commands": 0.05495050654691808, "deviation-center-line": 0.4853062696584811, "driven_lanedir_consec": 0.625004809327574, "sim_compute_sim_state": 0.023679413514978747, "sim_compute_performance-ego": 0.03964962117812213, "sim_compute_robot_state-ego": 0.0422879695892334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3525605252780706, "sim_physics": 0.059342662266322545, "survival_time": 8.74999999999999, "driven_lanedir": 1.2092274960498304, "sim_render-ego": 0.03627553258623395, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.05354175567626953, "deviation-heading": 2.376219802547203, "set_robot_commands": 0.05477718625749861, "deviation-center-line": 0.6430325160090528, "driven_lanedir_consec": 1.2092274960498304, "sim_compute_sim_state": 0.023424064091273716, "sim_compute_performance-ego": 0.03966968127659389, "sim_compute_robot_state-ego": 0.04135355949401855}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.296333411068631, "sim_physics": 0.0604143100125449, "survival_time": 8.399999999999984, "driven_lanedir": 1.1874828643954105, "sim_render-ego": 0.03620835712977818, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.05434016386667887, "deviation-heading": 2.397950065714043, "set_robot_commands": 0.05414013067881266, "deviation-center-line": 0.42870140489363445, "driven_lanedir_consec": 1.1874828643954105, "sim_compute_sim_state": 0.02290757355235872, "sim_compute_performance-ego": 0.03949191314833505, "sim_compute_robot_state-ego": 0.041192376897448583}}set_robot_commands_max 0.05683305761316321 set_robot_commands_mean 0.05508495736373855 set_robot_commands_median 0.05477718625749861 set_robot_commands_min 0.05414013067881266 sim_compute_performance-ego_max 0.04025875605069674 sim_compute_performance-ego_mean 0.039758120300954235 sim_compute_performance-ego_median 0.03966968127659389 sim_compute_performance-ego_min 0.03949191314833505 sim_compute_robot_state-ego_max 0.0422879695892334 sim_compute_robot_state-ego_mean 0.04167264942983131 sim_compute_robot_state-ego_median 0.04168492078781128 sim_compute_robot_state-ego_min 0.041192376897448583 sim_compute_sim_state_max 0.02376505568787292 sim_compute_sim_state_mean 0.023429893972903997 sim_compute_sim_state_median 0.023424064091273716 sim_compute_sim_state_min 0.02290757355235872 sim_physics_max 0.061976527119730854 sim_physics_mean 0.06053366325092171 sim_physics_median 0.0604143100125449 sim_physics_min 0.059342662266322545 sim_render-ego_max 0.03627553258623395 sim_render-ego_mean 0.036177433468765854 sim_render-ego_median 0.03620835712977818 sim_render-ego_min 0.03605639794293572 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.180000000000009 survival_time_min 4.249999999999993
No reset possible 215673225Anastasiya Nikolskaya JetBrains Research aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-06 12:46:08+00:00 2019-05-06 12:55:51+00:00 0:09:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.9782623306369904 survival_time_median 8.549999999999986 deviation-center-line_median 0.8016247097350858 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.060374549954955344 agent_compute-ego_mean 0.05852191090637232 agent_compute-ego_median 0.058258102263933347 agent_compute-ego_min 0.05731755495071411 deviation-center-line_max 1.1213441979503076 deviation-center-line_mean 0.7890130144886229 deviation-center-line_min 0.26649050068327435 deviation-heading_max 3.564619592510244 deviation-heading_mean 1.965213244944783 deviation-heading_median 2.2531194081647694 deviation-heading_min 0.31408828644768993 driven_any_max 3.5629919583326375 driven_any_mean 2.1978869108395154 driven_any_median 2.0094678514720266 driven_any_min 0.5175617196303349 driven_lanedir_consec_max 2.768243751189576 driven_lanedir_consec_mean 1.9425222482826503 driven_lanedir_consec_min 0.5137110938633018 driven_lanedir_max 2.768243751189576 driven_lanedir_mean 1.9425222482826503 driven_lanedir_median 1.9782623306369904 driven_lanedir_min 0.5137110938633018 in-drivable-lane_max 2.450000000000026 in-drivable-lane_mean 0.6800000000000045 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5629919583326375, "sim_physics": 0.05783464431762695, "survival_time": 14.950000000000076, "driven_lanedir": 2.768243751189576, "sim_render-ego": 0.03664820114771525, "in-drivable-lane": 2.450000000000026, "agent_compute-ego": 0.05883222500483195, "deviation-heading": 3.564619592510244, "set_robot_commands": 0.055900693734486896, "deviation-center-line": 1.1213441979503076, "driven_lanedir_consec": 2.768243751189576, "sim_compute_sim_state": 0.024947668711344403, "sim_compute_performance-ego": 0.03991728067398071, "sim_compute_robot_state-ego": 0.041851040522257486}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.000015798376075, "sim_physics": 0.05826169441616724, "survival_time": 12.600000000000044, "driven_lanedir": 2.66411167283408, "sim_render-ego": 0.036314197949000766, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05731755495071411, "deviation-heading": 2.6511352212067067, "set_robot_commands": 0.055841979526338126, "deviation-center-line": 1.0042308128247657, "driven_lanedir_consec": 2.66411167283408, "sim_compute_sim_state": 0.023669213529617067, "sim_compute_performance-ego": 0.04004480157579694, "sim_compute_robot_state-ego": 0.041744246369316465}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5175617196303349, "sim_physics": 0.05702814763906051, "survival_time": 2.4499999999999993, "driven_lanedir": 0.5137110938633018, "sim_render-ego": 0.03624786162862973, "in-drivable-lane": 0, "agent_compute-ego": 0.05782712235742686, "deviation-heading": 0.31408828644768993, "set_robot_commands": 0.055111719637501, "deviation-center-line": 0.26649050068327435, "driven_lanedir_consec": 0.5137110938633018, "sim_compute_sim_state": 0.02356687370611697, "sim_compute_performance-ego": 0.0400042825815629, "sim_compute_robot_state-ego": 0.04216909408569336}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.899397226386504, "sim_physics": 0.05804473382455331, "survival_time": 8.09999999999998, "driven_lanedir": 1.7882823928893044, "sim_render-ego": 0.03639001610838337, "in-drivable-lane": 0, "agent_compute-ego": 0.058258102263933347, "deviation-heading": 2.2531194081647694, "set_robot_commands": 0.055325948161843386, "deviation-center-line": 0.751374851249681, "driven_lanedir_consec": 1.7882823928893044, "sim_compute_sim_state": 0.023690727021959092, "sim_compute_performance-ego": 0.03985250290529228, "sim_compute_robot_state-ego": 0.04164232736752357}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0094678514720266, "sim_physics": 0.05629488459804602, "survival_time": 8.549999999999986, "driven_lanedir": 1.9782623306369904, "sim_render-ego": 0.03619718133357533, "in-drivable-lane": 0, "agent_compute-ego": 0.060374549954955344, "deviation-heading": 1.0431037163945052, "set_robot_commands": 0.056576674444633615, "deviation-center-line": 0.8016247097350858, "driven_lanedir_consec": 1.9782623306369904, "sim_compute_sim_state": 0.023648344285306874, "sim_compute_performance-ego": 0.03980126018412629, "sim_compute_robot_state-ego": 0.04172466372885899}}set_robot_commands_max 0.056576674444633615 set_robot_commands_mean 0.055751403100960606 set_robot_commands_median 0.055841979526338126 set_robot_commands_min 0.055111719637501 sim_compute_performance-ego_max 0.04004480157579694 sim_compute_performance-ego_mean 0.039924025584151826 sim_compute_performance-ego_median 0.03991728067398071 sim_compute_performance-ego_min 0.03980126018412629 sim_compute_robot_state-ego_max 0.04216909408569336 sim_compute_robot_state-ego_mean 0.041826274414729976 sim_compute_robot_state-ego_median 0.041744246369316465 sim_compute_robot_state-ego_min 0.04164232736752357 sim_compute_sim_state_max 0.024947668711344403 sim_compute_sim_state_mean 0.023904565450868883 sim_compute_sim_state_median 0.023669213529617067 sim_compute_sim_state_min 0.02356687370611697 sim_physics_max 0.05826169441616724 sim_physics_mean 0.05749282095909081 sim_physics_median 0.05783464431762695 sim_physics_min 0.05629488459804602 sim_render-ego_max 0.03664820114771525 sim_render-ego_mean 0.03635949163346089 sim_render-ego_median 0.036314197949000766 sim_render-ego_min 0.03619718133357533 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.330000000000018 survival_time_min 2.4499999999999993
No reset possible 215663224jiang peng First test - TH -hhk aido2-LF-sim-validationstep1-simulation error no ip-172-31-40-253-321252019-05-06 12:35:54+00:00 2019-05-06 12:36:20+00:00 0:00:26 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 215493217Amaury Camus challenge-aido_LF-template-random aido2-LFV-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-06 12:07:36+00:00 2019-05-06 12:13:09+00:00 0:05:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.1233394912311009 agent_compute-ego_mean 0.10025218177134793 agent_compute-ego_median 0.08736415285813182 agent_compute-ego_min 0.08686990737915039 deviation-center-line_max 0.1743913456502906 deviation-center-line_mean 0.12651756552531995 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599273 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811214 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589035 driven_any_mean 1.0272530755098266 driven_any_median 1.0243289631429708 driven_any_min 0.4119037580118998 driven_lanedir_consec_max 1.2433038249708377 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708377 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.08440551934418855, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03566251419208668, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08730833177213315, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05426166675708912, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0225330149685895, "sim_compute_performance-ego": 0.038227708251387986, "sim_compute_robot_state-ego": 0.04092406343530725, "sim_compute_robot_state-npc0": 0.0399655059531883, "sim_compute_robot_state-npc1": 0.03914793332417806, "sim_compute_robot_state-npc2": 0.03896839971895571, "sim_compute_robot_state-npc3": 0.03898383069921423}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.10188376426696776, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.03473267555236816, "in-drivable-lane": 0, "agent_compute-ego": 0.08686990737915039, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.05423690795898437, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02265371322631836, "sim_compute_performance-ego": 0.03823484420776367, "sim_compute_robot_state-ego": 0.04065492630004883, "sim_compute_robot_state-npc0": 0.039712743759155275, "sim_compute_robot_state-npc1": 0.039299030303955075, "sim_compute_robot_state-npc2": 0.03909253120422363, "sim_compute_robot_state-npc3": 0.038723297119140625}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.09131047913902685, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.035347154265955874, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08736415285813182, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.05597071271193655, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02235829202752364, "sim_compute_performance-ego": 0.03909820004513389, "sim_compute_robot_state-ego": 0.04064767925362838, "sim_compute_robot_state-npc0": 0.040169047681908855, "sim_compute_robot_state-npc1": 0.039268703837143745, "sim_compute_robot_state-npc2": 0.039389105219590034, "sim_compute_robot_state-npc3": 0.039094504557157815}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.12858891185325913, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.04470996313457248, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1163790256162233, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.07086732417722291, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.027695305739776997, "sim_compute_performance-ego": 0.05499658101721655, "sim_compute_robot_state-ego": 0.051289000088655494, "sim_compute_robot_state-npc0": 0.052545861352848104, "sim_compute_robot_state-npc1": 0.05021125455445881, "sim_compute_robot_state-npc2": 0.049523199660868586, "sim_compute_robot_state-npc3": 0.048788158199455166}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12681833335331508, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04486843517848423, "in-drivable-lane": 0, "agent_compute-ego": 0.1233394912311009, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07222112587520055, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.030300864151545932, "sim_compute_performance-ego": 0.04853348221097674, "sim_compute_robot_state-ego": 0.05098875079836164, "sim_compute_robot_state-npc0": 0.05407180956431797, "sim_compute_robot_state-npc1": 0.05453216178076608, "sim_compute_robot_state-npc2": 0.05589925391333444, "sim_compute_robot_state-npc3": 0.05119750329426357}}set_robot_commands_max 0.07222112587520055 set_robot_commands_mean 0.06151154749608669 set_robot_commands_median 0.05597071271193655 set_robot_commands_min 0.05423690795898437 sim_compute_performance-ego_max 0.05499658101721655 sim_compute_performance-ego_mean 0.04381816314649577 sim_compute_performance-ego_median 0.03909820004513389 sim_compute_performance-ego_min 0.038227708251387986 sim_compute_robot_state-ego_max 0.051289000088655494 sim_compute_robot_state-ego_mean 0.044900883975200326 sim_compute_robot_state-ego_median 0.04092406343530725 sim_compute_robot_state-ego_min 0.04064767925362838 sim_compute_robot_state-npc0_max 0.05407180956431797 sim_compute_robot_state-npc0_mean 0.045292993662283704 sim_compute_robot_state-npc0_median 0.040169047681908855 sim_compute_robot_state-npc0_min 0.039712743759155275 sim_compute_robot_state-npc1_max 0.05453216178076608 sim_compute_robot_state-npc1_mean 0.044491816760100354 sim_compute_robot_state-npc1_median 0.039299030303955075 sim_compute_robot_state-npc1_min 0.03914793332417806 sim_compute_robot_state-npc2_max 0.05589925391333444 sim_compute_robot_state-npc2_mean 0.04457449794339448 sim_compute_robot_state-npc2_median 0.039389105219590034 sim_compute_robot_state-npc2_min 0.03896839971895571 sim_compute_robot_state-npc3_max 0.05119750329426357 sim_compute_robot_state-npc3_mean 0.04335745877384628 sim_compute_robot_state-npc3_median 0.039094504557157815 sim_compute_robot_state-npc3_min 0.038723297119140625 sim_compute_sim_state_max 0.030300864151545932 sim_compute_sim_state_mean 0.025108238022750883 sim_compute_sim_state_median 0.02265371322631836 sim_compute_sim_state_min 0.02235829202752364 sim_physics_max 0.12858891185325913 sim_physics_mean 0.10660140159135148 sim_physics_median 0.10188376426696776 sim_physics_min 0.08440551934418855 sim_render-ego_max 0.04486843517848423 sim_render-ego_mean 0.039064148464693485 sim_render-ego_median 0.03566251419208668 sim_render-ego_min 0.03473267555236816 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 215193206Masaya Kambara challenge-aido_LF-template-random aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-05-06 06:38:28+00:00 2019-05-06 06:47:21+00:00 0:08:53 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.10099507669212504 in-drivable-lane_median 0.4499999999999984
other stats agent_compute-ego_max 0.09064842224121092 agent_compute-ego_mean 0.08702034494566296 agent_compute-ego_median 0.08668539887767727 agent_compute-ego_min 0.08540130148128587 deviation-center-line_max 0.2838635700333795 deviation-center-line_mean 0.12786165368054708 deviation-center-line_min 0.07112529346797256 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3391682685652287 deviation-heading_median 0.32928385103533875 deviation-heading_min 0.19401296908406307 driven_any_max 2.1706243860917107 driven_any_mean 0.9759490378276146 driven_any_median 1.0117660515775693 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 1.919400421063832 driven_lanedir_consec_mean 0.6896171461819246 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 1.919400421063832 driven_lanedir_mean 0.6896171461819246 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.5899999999999982 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.056425920239201295, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03517651116406476, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08692781571988706, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05558054976993137, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02310973626595956, "sim_compute_performance-ego": 0.03892815996099402, "sim_compute_robot_state-ego": 0.04021934226707176}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05792920729693245, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.0350193743612252, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0876325532501819, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.053472617093254536, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.02281980888516295, "sim_compute_performance-ego": 0.0384212054458319, "sim_compute_robot_state-ego": 0.03950618295108571}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.060298919677734375, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.035487974391264075, "in-drivable-lane": 0, "agent_compute-ego": 0.08618534312528722, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.05350627618677476, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02267778621000402, "sim_compute_performance-ego": 0.03839403040268842, "sim_compute_robot_state-ego": 0.04015532661886776}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0599085521697998, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03494874000549317, "in-drivable-lane": 0, "agent_compute-ego": 0.09064842224121092, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05553386688232422, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.022261028289794923, "sim_compute_performance-ego": 0.0382135009765625, "sim_compute_robot_state-ego": 0.03945148468017578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05386753021916257, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03644791132287134, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08628668060785608, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05468318733987929, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.022615082656280903, "sim_compute_performance-ego": 0.03805747213242929, "sim_compute_robot_state-ego": 0.04044878331920768}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.05674837560069805, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03496910114677585, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08540130148128587, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.05349469671444017, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02239574704851423, "sim_compute_performance-ego": 0.03783220174361249, "sim_compute_robot_state-ego": 0.04041932067092584}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.05390101671218872, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03520919169698443, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.08644539969308036, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05391163059643337, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.023079007863998413, "sim_compute_performance-ego": 0.03850451111793518, "sim_compute_robot_state-ego": 0.039824647562844415}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.05938914843967983, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03493336268833706, "in-drivable-lane": 0, "agent_compute-ego": 0.08702831041245233, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05345414933704194, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.022688945134480793, "sim_compute_performance-ego": 0.03791089284987677, "sim_compute_robot_state-ego": 0.04026666141691662}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.05918775978734938, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03537977752038988, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08668539887767727, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.05536130323248394, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.022681676735312253, "sim_compute_performance-ego": 0.03819343195123188, "sim_compute_robot_state-ego": 0.04051910820653883}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.05628644336353649, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03514898040077903, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.08722311366688121, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.06229767799377441, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.02277674674987793, "sim_compute_performance-ego": 0.03795765529979359, "sim_compute_robot_state-ego": 0.0395657019181685}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.054436692943820704, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03586848370440594, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08747243881225586, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.05571926104557979, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.0226191081009902, "sim_compute_performance-ego": 0.037787805904041634, "sim_compute_robot_state-ego": 0.04020633325948344}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06215711150850568, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03578491721834455, "in-drivable-lane": 0, "agent_compute-ego": 0.08869777406964983, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.05360605887004307, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02271468298775809, "sim_compute_performance-ego": 0.03924099888120379, "sim_compute_robot_state-ego": 0.04028819288526263}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.05499418576558431, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03510016086054783, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08612123190187941, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.053551070830401254, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.022785233516319125, "sim_compute_performance-ego": 0.03847090403238932, "sim_compute_robot_state-ego": 0.04042982120139926}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.05971797307332357, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.034889291833948205, "in-drivable-lane": 0, "agent_compute-ego": 0.08594679832458496, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.053295506371392146, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0230814086066352, "sim_compute_performance-ego": 0.03848109421906648, "sim_compute_robot_state-ego": 0.04045775201585558}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05532192950155221, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03502183100756477, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0866025920007743, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.053966648438397574, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.022785270915311927, "sim_compute_performance-ego": 0.038343532412659885, "sim_compute_robot_state-ego": 0.0401309378006879}}set_robot_commands_max 0.06229767799377441 set_robot_commands_mean 0.054762300046810125 set_robot_commands_median 0.05391163059643337 set_robot_commands_min 0.053295506371392146 sim_compute_performance-ego_max 0.03924099888120379 sim_compute_performance-ego_mean 0.03831582648868781 sim_compute_performance-ego_median 0.038343532412659885 sim_compute_performance-ego_min 0.037787805904041634 sim_compute_robot_state-ego_max 0.04051910820653883 sim_compute_robot_state-ego_mean 0.04012597311829944 sim_compute_robot_state-ego_median 0.04021934226707176 sim_compute_robot_state-ego_min 0.03945148468017578 sim_compute_sim_state_max 0.02310973626595956 sim_compute_sim_state_mean 0.022739417997760032 sim_compute_sim_state_median 0.02271468298775809 sim_compute_sim_state_min 0.022261028289794923 sim_physics_max 0.06215711150850568 sim_physics_mean 0.05737138441993797 sim_physics_median 0.05674837560069805 sim_physics_min 0.05386753021916257 sim_render-ego_max 0.03644791132287134 sim_render-ego_mean 0.0352923739548664 sim_render-ego_median 0.03514898040077903 sim_render-ego_min 0.034889291833948205 simulation-passed 1 survival_time_max 5.09999999999999 survival_time_mean 2.503333333333331 survival_time_min 0.8500000000000002
No reset possible 215153203Masaya Kambara PredictorLast aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-06 03:07:58+00:00 2019-05-06 03:08:24+00:00 0:00:26 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10995335568937406 error_L2 0.01971069870015279
No reset possible 215143202Masaya Kambara PredictorRandom aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-06 02:10:07+00:00 2019-05-06 02:10:38+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.330506646976108 error_L2 0.15781734167880324
No reset possible 215083196Anastasiya Nikolskaya NN Solution aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-05 16:01:13+00:00 2019-05-05 16:15:30+00:00 0:14:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.7098934119249545 survival_time_median 9.45 deviation-center-line_median 0.7828047210856152 in-drivable-lane_median 1.099999999999996
other stats agent_compute-ego_max 0.08913849433263143 agent_compute-ego_mean 0.0848787602784368 agent_compute-ego_median 0.084484649082971 agent_compute-ego_min 0.08252910524606705 deviation-center-line_max 1.183923610779011 deviation-center-line_mean 0.7715737452518807 deviation-center-line_min 0.35193473963001465 deviation-heading_max 2.527239814062579 deviation-heading_mean 1.9793078532409416 deviation-heading_median 2.224373670817728 deviation-heading_min 1.3913777043976423 driven_any_max 3.268393383894944 driven_any_mean 2.0877892989534548 driven_any_median 2.038483225036007 driven_any_min 1.065741776732354 driven_lanedir_consec_max 2.753611706542738 driven_lanedir_consec_mean 1.761650864394665 driven_lanedir_consec_min 0.7405040880358319 driven_lanedir_max 2.753611706542738 driven_lanedir_mean 1.761650864394665 driven_lanedir_median 1.7098934119249545 driven_lanedir_min 0.7405040880358319 in-drivable-lane_max 1.949999999999993 in-drivable-lane_mean 1.050000000000001 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.061381658125849, "sim_physics": 0.0903021829823653, "survival_time": 9.6, "driven_lanedir": 1.6402983068104502, "sim_render-ego": 0.04921050121386846, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.08252910524606705, "deviation-heading": 2.2711453469368075, "set_robot_commands": 0.08437768121560414, "deviation-center-line": 0.7828047210856152, "driven_lanedir_consec": 1.6402983068104502, "sim_compute_sim_state": 0.034541779508193336, "sim_compute_performance-ego": 0.057125513752301536, "sim_compute_robot_state-ego": 0.05794728298981985}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.065741776732354, "sim_physics": 0.08516460540247899, "survival_time": 5.09999999999999, "driven_lanedir": 0.7405040880358319, "sim_render-ego": 0.05084300508686141, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.08349296158435297, "deviation-heading": 1.3913777043976423, "set_robot_commands": 0.07957327833362654, "deviation-center-line": 0.35193473963001465, "driven_lanedir_consec": 0.7405040880358319, "sim_compute_sim_state": 0.032743402555877085, "sim_compute_performance-ego": 0.05756651420219272, "sim_compute_robot_state-ego": 0.05944874941133985}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.268393383894944, "sim_physics": 0.09213305393854776, "survival_time": 14.950000000000076, "driven_lanedir": 2.753611706542738, "sim_render-ego": 0.054846441745758055, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.08913849433263143, "deviation-heading": 2.224373670817728, "set_robot_commands": 0.08044467290242513, "deviation-center-line": 1.183923610779011, "driven_lanedir_consec": 2.753611706542738, "sim_compute_sim_state": 0.033975061575571695, "sim_compute_performance-ego": 0.05694780508677165, "sim_compute_robot_state-ego": 0.061581357320149736}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.038483225036007, "sim_physics": 0.0919755640484038, "survival_time": 9.45, "driven_lanedir": 1.7098934119249545, "sim_render-ego": 0.05522381565558217, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.084484649082971, "deviation-heading": 2.527239814062579, "set_robot_commands": 0.08293758246003005, "deviation-center-line": 0.6911479241561814, "driven_lanedir_consec": 1.7098934119249545, "sim_compute_sim_state": 0.03343404159344063, "sim_compute_performance-ego": 0.06059976986476353, "sim_compute_robot_state-ego": 0.06356600478843406}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0049464509781196, "sim_physics": 0.09790150580867645, "survival_time": 9.299999999999995, "driven_lanedir": 1.9639468086593503, "sim_render-ego": 0.05333636653038763, "in-drivable-lane": 0, "agent_compute-ego": 0.08474859114616148, "deviation-heading": 1.4824027299899492, "set_robot_commands": 0.08124048094595632, "deviation-center-line": 0.8480577306085817, "driven_lanedir_consec": 1.9639468086593503, "sim_compute_sim_state": 0.03390604578038697, "sim_compute_performance-ego": 0.06015638638568181, "sim_compute_robot_state-ego": 0.0652473831689486}}set_robot_commands_max 0.08437768121560414 set_robot_commands_mean 0.08171473917152844 set_robot_commands_median 0.08124048094595632 set_robot_commands_min 0.07957327833362654 sim_compute_performance-ego_max 0.06059976986476353 sim_compute_performance-ego_mean 0.05847919785834225 sim_compute_performance-ego_median 0.05756651420219272 sim_compute_performance-ego_min 0.05694780508677165 sim_compute_robot_state-ego_max 0.0652473831689486 sim_compute_robot_state-ego_mean 0.06155815553573842 sim_compute_robot_state-ego_median 0.061581357320149736 sim_compute_robot_state-ego_min 0.05794728298981985 sim_compute_sim_state_max 0.034541779508193336 sim_compute_sim_state_mean 0.033720066202693945 sim_compute_sim_state_median 0.03390604578038697 sim_compute_sim_state_min 0.032743402555877085 sim_physics_max 0.09790150580867645 sim_physics_mean 0.09149538243609448 sim_physics_median 0.0919755640484038 sim_physics_min 0.08516460540247899 sim_render-ego_max 0.05522381565558217 sim_render-ego_mean 0.05269202604649155 sim_render-ego_median 0.05333636653038763 sim_render-ego_min 0.04921050121386846 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.680000000000012 survival_time_min 5.09999999999999
No reset possible 215033193Shalom-David Anifowoshe Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-05-05 15:00:35+00:00 2019-05-05 15:15:43+00:00 0:15:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.06980524512540254 survival_time_median 1.5500000000000007 deviation-center-line_median 0.08586370480446592 in-drivable-lane_median 0.4500000000000004
other stats agent_compute-ego_max 0.09857012945062972 agent_compute-ego_mean 0.09536775444410854 agent_compute-ego_median 0.09480193809226709 agent_compute-ego_min 0.09374431046572598 deviation-center-line_max 0.571518318590104 deviation-center-line_mean 0.1308307585384611 deviation-center-line_min 0.030946864809572112 deviation-heading_max 6.067414080112272 deviation-heading_mean 1.8688219466158875 deviation-heading_median 0.684548285318732 deviation-heading_min 0.633966266246339 driven_any_max 1.774849517395357 driven_any_mean 0.4866998173132527 driven_any_median 0.1543883517144386 driven_any_min 0.07928388812532788 driven_lanedir_consec_max 0.5406753969711007 driven_lanedir_consec_mean 0.16677144098092975 driven_lanedir_consec_min 0.04511985672948393 driven_lanedir_max 0.5406753969711007 driven_lanedir_mean 0.16677144098092975 driven_lanedir_median 0.06980524512540254 driven_lanedir_min 0.04511985672948393 in-drivable-lane_max 7.500000000000041 in-drivable-lane_mean 1.8766666666666736 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.710546608723542, "sim_physics": 0.05424078385035197, "survival_time": 14.950000000000076, "driven_lanedir": 0.512506191744261, "sim_render-ego": 0.03564428249994914, "in-drivable-lane": 7.150000000000035, "agent_compute-ego": 0.0956700571378072, "deviation-heading": 6.022600498987341, "set_robot_commands": 0.05376973072687785, "deviation-center-line": 0.2938531404542163, "driven_lanedir_consec": 0.512506191744261, "sim_compute_sim_state": 0.02292245070139567, "sim_compute_performance-ego": 0.03862938006718954, "sim_compute_robot_state-ego": 0.04027862230936686}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17750447435791783, "sim_physics": 0.05296812337987563, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06980524512540254, "sim_render-ego": 0.034772550358491784, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09857012945062972, "deviation-heading": 0.684548285318732, "set_robot_commands": 0.05288014692418715, "deviation-center-line": 0.030946864809572112, "driven_lanedir_consec": 0.06980524512540254, "sim_compute_sim_state": 0.02238110233755673, "sim_compute_performance-ego": 0.038302197175867414, "sim_compute_robot_state-ego": 0.0395127955605002}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11977670531773876, "sim_physics": 0.05531154738532172, "survival_time": 1.3500000000000003, "driven_lanedir": 0.05044131847858635, "sim_render-ego": 0.03419224421183268, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.09470615563569246, "deviation-heading": 0.6755692955404784, "set_robot_commands": 0.05325407452053494, "deviation-center-line": 0.08586370480446592, "driven_lanedir_consec": 0.05044131847858635, "sim_compute_sim_state": 0.022512903919926396, "sim_compute_performance-ego": 0.03822036142702456, "sim_compute_robot_state-ego": 0.04098289101212113}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.774849517395357, "sim_physics": 0.05388464609781901, "survival_time": 14.950000000000076, "driven_lanedir": 0.5406753969711007, "sim_render-ego": 0.03602773110071818, "in-drivable-lane": 7.500000000000041, "agent_compute-ego": 0.09500465393066408, "deviation-heading": 6.067414080112272, "set_robot_commands": 0.0541370685895284, "deviation-center-line": 0.571518318590104, "driven_lanedir_consec": 0.5406753969711007, "sim_compute_sim_state": 0.02275920073191325, "sim_compute_performance-ego": 0.038130338191986086, "sim_compute_robot_state-ego": 0.040363503297170006}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19889576520263333, "sim_physics": 0.0596805497219688, "survival_time": 1.900000000000001, "driven_lanedir": 0.08806033215374942, "sim_render-ego": 0.03523992237291838, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.0947204075361553, "deviation-heading": 0.6674548722675231, "set_robot_commands": 0.053838447520607395, "deviation-center-line": 0.03959867243553948, "driven_lanedir_consec": 0.08806033215374942, "sim_compute_sim_state": 0.02235869984877737, "sim_compute_performance-ego": 0.03779536799380654, "sim_compute_robot_state-ego": 0.040038384889301504}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1965311626477088, "sim_physics": 0.0592841625213623, "survival_time": 1.7500000000000009, "driven_lanedir": 0.06042176118594611, "sim_render-ego": 0.03541855812072754, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.09682644435337612, "deviation-heading": 0.7290845016264413, "set_robot_commands": 0.05392850467136928, "deviation-center-line": 0.05172646614555911, "driven_lanedir_consec": 0.06042176118594611, "sim_compute_sim_state": 0.022852836336408344, "sim_compute_performance-ego": 0.03855445044381278, "sim_compute_robot_state-ego": 0.040147011620657785}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13043002263617903, "sim_physics": 0.059701354415328416, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08297965879908631, "sim_render-ego": 0.034693506028917104, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09480193809226709, "deviation-heading": 0.7249589716660613, "set_robot_commands": 0.05364999947724519, "deviation-center-line": 0.09285252503753526, "driven_lanedir_consec": 0.08297965879908631, "sim_compute_sim_state": 0.02268573972913954, "sim_compute_performance-ego": 0.03845614857143826, "sim_compute_robot_state-ego": 0.04019288663510923}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09827549859799284, "sim_physics": 0.05785622804061226, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05065158416309323, "sim_render-ego": 0.03492284857708475, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.09393576953722084, "deviation-heading": 0.6601867054684332, "set_robot_commands": 0.053822071655936866, "deviation-center-line": 0.08117286252088282, "driven_lanedir_consec": 0.05065158416309323, "sim_compute_sim_state": 0.02245305932086447, "sim_compute_performance-ego": 0.03821836347165315, "sim_compute_robot_state-ego": 0.04465684683426567}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1543883517144386, "sim_physics": 0.05663277256873346, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06384583585164005, "sim_render-ego": 0.03525727795016381, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09762893953631, "deviation-heading": 0.7112425516561256, "set_robot_commands": 0.05376325884172993, "deviation-center-line": 0.0357278416133998, "driven_lanedir_consec": 0.06384583585164005, "sim_compute_sim_state": 0.02270901587701613, "sim_compute_performance-ego": 0.03818276620680286, "sim_compute_robot_state-ego": 0.03973254080741636}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11124235176607458, "sim_physics": 0.0646086714484475, "survival_time": 1.1000000000000003, "driven_lanedir": 0.06157219506913503, "sim_render-ego": 0.03538214076649059, "in-drivable-lane": 0, "agent_compute-ego": 0.09562612663615834, "deviation-heading": 0.6731944682021823, "set_robot_commands": 0.05364862355318936, "deviation-center-line": 0.07674734000172846, "driven_lanedir_consec": 0.06157219506913503, "sim_compute_sim_state": 0.02203081954609264, "sim_compute_performance-ego": 0.038514354012229225, "sim_compute_robot_state-ego": 0.04053643616763028}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.09592050441340176, "sim_physics": 0.059543972430021866, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05828955287070914, "sim_render-ego": 0.038892932560132897, "in-drivable-lane": 0, "agent_compute-ego": 0.09621610848799995, "deviation-heading": 0.633966266246339, "set_robot_commands": 0.05326768626337466, "deviation-center-line": 0.09852648096233106, "driven_lanedir_consec": 0.05828955287070914, "sim_compute_sim_state": 0.02297043800354004, "sim_compute_performance-ego": 0.03737961727639903, "sim_compute_robot_state-ego": 0.03977577582649563}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.128064910419813, "sim_physics": 0.0604628866369074, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08316036070971178, "sim_render-ego": 0.0354532545263117, "in-drivable-lane": 0, "agent_compute-ego": 0.09374431046572598, "deviation-heading": 0.6549473053530714, "set_robot_commands": 0.054024154489690605, "deviation-center-line": 0.06685861396320575, "driven_lanedir_consec": 0.08316036070971178, "sim_compute_sim_state": 0.022759654305197975, "sim_compute_performance-ego": 0.03906511176716198, "sim_compute_robot_state-ego": 0.04403080723502419}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7587367596288805, "sim_physics": 0.05099421096362656, "survival_time": 6.949999999999983, "driven_lanedir": 0.2600742369932155, "sim_render-ego": 0.034760526615938696, "in-drivable-lane": 3.1499999999999924, "agent_compute-ego": 0.09450000481639836, "deviation-heading": 2.7125103326876943, "set_robot_commands": 0.05471327321992504, "deviation-center-line": 0.11958759671716364, "driven_lanedir_consec": 0.2600742369932155, "sim_compute_sim_state": 0.02244574732060055, "sim_compute_performance-ego": 0.03774203499444097, "sim_compute_robot_state-ego": 0.040042146504354136}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5660507387517844, "sim_physics": 0.050668049653371176, "survival_time": 14.950000000000076, "driven_lanedir": 0.4739680878688248, "sim_render-ego": 0.03473807017008464, "in-drivable-lane": 7.450000000000038, "agent_compute-ego": 0.09434040625890096, "deviation-heading": 5.780354158697877, "set_robot_commands": 0.05409467856089274, "deviation-center-line": 0.20744291315332497, "driven_lanedir_consec": 0.4739680878688248, "sim_compute_sim_state": 0.022713961601257323, "sim_compute_performance-ego": 0.03793715159098307, "sim_compute_robot_state-ego": 0.03963622411092122}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.07928388812532788, "sim_physics": 0.05891184373335405, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04511985672948393, "sim_render-ego": 0.03418770703402432, "in-drivable-lane": 0, "agent_compute-ego": 0.09422486478632149, "deviation-heading": 0.6342969054077402, "set_robot_commands": 0.05346849831667813, "deviation-center-line": 0.11003803686788824, "driven_lanedir_consec": 0.04511985672948393, "sim_compute_sim_state": 0.022288019006902523, "sim_compute_performance-ego": 0.03768018158999356, "sim_compute_robot_state-ego": 0.04003596305847168}}set_robot_commands_max 0.05471327321992504 set_robot_commands_mean 0.05375068115545116 set_robot_commands_median 0.05376973072687785 set_robot_commands_min 0.05288014692418715 sim_compute_performance-ego_max 0.03906511176716198 sim_compute_performance-ego_mean 0.03818718831871927 sim_compute_performance-ego_median 0.03821836347165315 sim_compute_performance-ego_min 0.03737961727639903 sim_compute_robot_state-ego_max 0.04465684683426567 sim_compute_robot_state-ego_mean 0.04066418905792039 sim_compute_robot_state-ego_median 0.040147011620657785 sim_compute_robot_state-ego_min 0.0395127955605002 sim_compute_sim_state_max 0.02297043800354004 sim_compute_sim_state_mean 0.022589576572439263 sim_compute_sim_state_median 0.02268573972913954 sim_compute_sim_state_min 0.02203081954609264 sim_physics_max 0.0646086714484475 sim_physics_mean 0.0569833201898068 sim_physics_median 0.05785622804061226 sim_physics_min 0.050668049653371176 sim_render-ego_max 0.038892932560132897 sim_render-ego_mean 0.035305570192919085 sim_render-ego_median 0.03523992237291838 sim_render-ego_min 0.03418770703402432 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 4.466666666666681 survival_time_min 1.1000000000000003
No reset possible 214993190Anastasiya Nikolskaya NN Solution aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-05-05 14:00:43+00:00 2019-05-05 14:11:16+00:00 0:10:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 2.0096368514757823 survival_time_median 11.500000000000028 deviation-center-line_median 0.9222028429987708 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.06206277453381082 agent_compute-ego_mean 0.06040884276354304 agent_compute-ego_median 0.061561539967854816 agent_compute-ego_min 0.05574692646662394 deviation-center-line_max 1.2809593311596688 deviation-center-line_mean 0.9931619772367696 deviation-center-line_min 0.6077957145702887 deviation-heading_max 3.843336238733628 deviation-heading_mean 1.881123677761953 deviation-heading_median 1.4015774707169977 deviation-heading_min 0.957723749734539 driven_any_max 3.0641146819014704 driven_any_mean 2.3912601002466927 driven_any_median 2.3408557906934404 driven_any_min 1.4503852994932436 driven_lanedir_consec_max 2.9080900586559726 driven_lanedir_consec_mean 2.17962879520145 driven_lanedir_consec_min 1.428387288482544 driven_lanedir_max 2.9080900586559726 driven_lanedir_mean 2.17962879520145 driven_lanedir_median 2.0096368514757823 driven_lanedir_min 1.428387288482544 in-drivable-lane_max 1.7499999999999938 in-drivable-lane_mean 0.6899999999999981 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4503852994932436, "sim_physics": 0.061919859010879305, "survival_time": 7.299999999999982, "driven_lanedir": 1.428387288482544, "sim_render-ego": 0.037105153684746726, "in-drivable-lane": 0, "agent_compute-ego": 0.061577089845317685, "deviation-heading": 0.957723749734539, "set_robot_commands": 0.05598988108438988, "deviation-center-line": 0.6077957145702887, "driven_lanedir_consec": 1.428387288482544, "sim_compute_sim_state": 0.02424602639185239, "sim_compute_performance-ego": 0.04033666930786551, "sim_compute_robot_state-ego": 0.04228740359005863}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.0641146819014704, "sim_physics": 0.05670181433359782, "survival_time": 14.950000000000076, "driven_lanedir": 2.618564120212993, "sim_render-ego": 0.03656819423039754, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05574692646662394, "deviation-heading": 2.0388310749790293, "set_robot_commands": 0.055452980995178223, "deviation-center-line": 1.2704174646304611, "driven_lanedir_consec": 2.618564120212993, "sim_compute_sim_state": 0.024507408142089845, "sim_compute_performance-ego": 0.04040131092071533, "sim_compute_robot_state-ego": 0.04231821616490682}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3408557906934404, "sim_physics": 0.05837993932806927, "survival_time": 11.500000000000028, "driven_lanedir": 1.9334656571799596, "sim_render-ego": 0.037054336589315666, "in-drivable-lane": 1.6999999999999966, "agent_compute-ego": 0.06206277453381082, "deviation-heading": 1.4015774707169977, "set_robot_commands": 0.05509617121323295, "deviation-center-line": 0.9222028429987708, "driven_lanedir_consec": 1.9334656571799596, "sim_compute_sim_state": 0.0244426675464796, "sim_compute_performance-ego": 0.04023374992868175, "sim_compute_robot_state-ego": 0.04277153844418733}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.064073475933625, "sim_physics": 0.06201379140218099, "survival_time": 14.950000000000076, "driven_lanedir": 2.9080900586559726, "sim_render-ego": 0.03716214021046956, "in-drivable-lane": 0, "agent_compute-ego": 0.061561539967854816, "deviation-heading": 3.843336238733628, "set_robot_commands": 0.055506645043691, "deviation-center-line": 1.2809593311596688, "driven_lanedir_consec": 2.9080900586559726, "sim_compute_sim_state": 0.024112961292266845, "sim_compute_performance-ego": 0.039834404786427816, "sim_compute_robot_state-ego": 0.04203800280888875}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0368712532116846, "sim_physics": 0.06293465248980926, "survival_time": 10.050000000000008, "driven_lanedir": 2.0096368514757823, "sim_render-ego": 0.03692129713978933, "in-drivable-lane": 0, "agent_compute-ego": 0.06109588300410788, "deviation-heading": 1.1641498546455715, "set_robot_commands": 0.0560628739162464, "deviation-center-line": 0.8844345328246576, "driven_lanedir_consec": 2.0096368514757823, "sim_compute_sim_state": 0.024229536009072072, "sim_compute_performance-ego": 0.040153167734098674, "sim_compute_robot_state-ego": 0.042373259862264}}set_robot_commands_max 0.0560628739162464 set_robot_commands_mean 0.0556217104505477 set_robot_commands_median 0.055506645043691 set_robot_commands_min 0.05509617121323295 sim_compute_performance-ego_max 0.04040131092071533 sim_compute_performance-ego_mean 0.04019186053555781 sim_compute_performance-ego_median 0.04023374992868175 sim_compute_performance-ego_min 0.039834404786427816 sim_compute_robot_state-ego_max 0.04277153844418733 sim_compute_robot_state-ego_mean 0.042357684174061105 sim_compute_robot_state-ego_median 0.04231821616490682 sim_compute_robot_state-ego_min 0.04203800280888875 sim_compute_sim_state_max 0.024507408142089845 sim_compute_sim_state_mean 0.024307719876352153 sim_compute_sim_state_median 0.02424602639185239 sim_compute_sim_state_min 0.024112961292266845 sim_physics_max 0.06293465248980926 sim_physics_mean 0.06039001131290733 sim_physics_median 0.061919859010879305 sim_physics_min 0.05670181433359782 sim_render-ego_max 0.03716214021046956 sim_render-ego_mean 0.03696222437094377 sim_render-ego_median 0.037054336589315666 sim_render-ego_min 0.03656819423039754 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.750000000000034 survival_time_min 7.299999999999982
No reset possible 214833178Shen Yu Chia PredictorLast aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-03 17:54:21+00:00 2019-05-03 17:54:40+00:00 0:00:19 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1027535846252089 error_L2 0.01659368186287734
No reset possible 214823177Shen Yu Chia PredictorLast aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-03 17:48:45+00:00 2019-05-03 17:49:16+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.09919429663918372 error_L2 0.014890870610588584
No reset possible 214673163Andy Ser PredictorRandom aido2-PREDstep1-simulation success no ip-172-31-40-253-321252019-05-01 18:47:47+00:00 2019-05-01 18:48:18+00:00 0:00:31 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.30468912771752676 error_L2 0.13750611037833088
No reset possible 214633159Alexander Kleban Python template aido2-AMOD-efficiencystep2-scoring success yes ip-172-31-40-253-321252019-05-01 17:51:09+00:00 2019-05-01 17:51:18+00:00 0:00:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
efficiency -64.79732051809536
other stats fleet_size -1000000000 service_quality -33.25468012952383
No reset possible 214593159Alexander Kleban Python template aido2-AMOD-efficiencystep1-simulation success yes ip-172-31-40-253-321252019-05-01 17:47:53+00:00 2019-05-01 17:50:55+00:00 0:03:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 214533154Andy Ser challenge-aido_LF-baseline-duckietown aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-05-01 16:00:50+00:00 2019-05-01 16:25:15+00:00 0:24:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0874953498285516 survival_time_median 8.499999999999986 deviation-center-line_median 0.6775754948603098 in-drivable-lane_median 0.20000000000000284
other stats agent_compute-ego_max 0.057246366580883105 agent_compute-ego_mean 0.05534856336121719 agent_compute-ego_median 0.055441413262877805 agent_compute-ego_min 0.05272213901792254 deviation-center-line_max 1.266408456034012 deviation-center-line_mean 0.7077970918660087 deviation-center-line_min 0.24427614770312625 deviation-heading_max 7.40659085341576 deviation-heading_mean 3.1116263949539156 deviation-heading_median 2.4018441978321103 deviation-heading_min 0.5069530932734827 driven_any_max 2.3489816433576283 driven_any_mean 1.4505546079737195 driven_any_median 1.3123926255128189 driven_any_min 0.6213783024269937 driven_lanedir_consec_max 2.1380026680989213 driven_lanedir_consec_mean 1.0944021024294337 driven_lanedir_consec_min 0.2449162184624352 driven_lanedir_max 2.1380026680989213 driven_lanedir_mean 1.2099805152350385 driven_lanedir_median 1.1907266169321975 driven_lanedir_min 0.4300493442755444 in-drivable-lane_max 4.3000000000000185 in-drivable-lane_mean 0.5966666666666695 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1440240549282847, "sim_physics": 0.06295570214589437, "survival_time": 7.499999999999981, "driven_lanedir": 1.0874953498285516, "sim_render-ego": 0.03720317363739014, "in-drivable-lane": 0, "agent_compute-ego": 0.056913326581319174, "deviation-heading": 1.8393813469594888, "set_robot_commands": 0.05649649461110433, "deviation-center-line": 0.6267187335496259, "driven_lanedir_consec": 1.0874953498285516, "sim_compute_sim_state": 0.023709295590718587, "sim_compute_performance-ego": 0.040954570770263675, "sim_compute_robot_state-ego": 0.04184265613555909}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348885405536934, "sim_physics": 0.05870802323023478, "survival_time": 14.950000000000076, "driven_lanedir": 2.0692528475941536, "sim_render-ego": 0.036731416384379066, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05400358756383261, "deviation-heading": 5.659075809672068, "set_robot_commands": 0.055883492628733315, "deviation-center-line": 0.9391176579801188, "driven_lanedir_consec": 1.9476837878031423, "sim_compute_sim_state": 0.02382442792256673, "sim_compute_performance-ego": 0.039949816862742106, "sim_compute_robot_state-ego": 0.0421230959892273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6213783024269937, "sim_physics": 0.0583705050604684, "survival_time": 4.199999999999993, "driven_lanedir": 0.6158276455273297, "sim_render-ego": 0.036041024185362314, "in-drivable-lane": 0, "agent_compute-ego": 0.05272213901792254, "deviation-heading": 0.5069530932734827, "set_robot_commands": 0.05594920544397263, "deviation-center-line": 0.46902546598113687, "driven_lanedir_consec": 0.6158276455273297, "sim_compute_sim_state": 0.023370104176657545, "sim_compute_performance-ego": 0.04039773486909412, "sim_compute_robot_state-ego": 0.04475206704366775}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3847080672211938, "sim_physics": 0.06189421168918716, "survival_time": 8.949999999999992, "driven_lanedir": 1.2890073965245503, "sim_render-ego": 0.03652374970846336, "in-drivable-lane": 0, "agent_compute-ego": 0.05414756050322975, "deviation-heading": 2.6462792292335124, "set_robot_commands": 0.05570773705423877, "deviation-center-line": 0.6775754948603098, "driven_lanedir_consec": 1.2890073965245503, "sim_compute_sim_state": 0.023576216990721297, "sim_compute_performance-ego": 0.04011655519794485, "sim_compute_robot_state-ego": 0.04282639146517109}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3484981342040667, "sim_physics": 0.05825595458348592, "survival_time": 14.950000000000076, "driven_lanedir": 1.2911757326352429, "sim_render-ego": 0.03678280353546143, "in-drivable-lane": 4.3000000000000185, "agent_compute-ego": 0.05525623401006063, "deviation-heading": 5.899318609324921, "set_robot_commands": 0.056374477545420326, "deviation-center-line": 0.7866822994150611, "driven_lanedir_consec": 1.0101278760749826, "sim_compute_sim_state": 0.023307785987854004, "sim_compute_performance-ego": 0.04044756174087524, "sim_compute_robot_state-ego": 0.04203380505243937}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3489816433576283, "sim_physics": 0.05889836708704631, "survival_time": 14.950000000000076, "driven_lanedir": 2.033451582994377, "sim_render-ego": 0.03737505833307902, "in-drivable-lane": 0.7000000000000055, "agent_compute-ego": 0.05560791174570719, "deviation-heading": 4.9423531913952266, "set_robot_commands": 0.05575815200805664, "deviation-center-line": 1.1099127006867926, "driven_lanedir_consec": 1.4051020800978162, "sim_compute_sim_state": 0.02396272341410319, "sim_compute_performance-ego": 0.04086394786834717, "sim_compute_robot_state-ego": 0.04225742101669312}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.741861318691023, "sim_physics": 0.06248454373292248, "survival_time": 4.94999999999999, "driven_lanedir": 0.683600090781124, "sim_render-ego": 0.037005277595134695, "in-drivable-lane": 0, "agent_compute-ego": 0.055441413262877805, "deviation-heading": 1.5178163897506032, "set_robot_commands": 0.055486667035806056, "deviation-center-line": 0.24427614770312625, "driven_lanedir_consec": 0.683600090781124, "sim_compute_sim_state": 0.024087602441961117, "sim_compute_performance-ego": 0.04050922152971981, "sim_compute_robot_state-ego": 0.04245277607079708}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.4972223680494146, "sim_physics": 0.060573850888662385, "survival_time": 9.650000000000002, "driven_lanedir": 1.2309685631219234, "sim_render-ego": 0.036968701861682954, "in-drivable-lane": 1.0000000000000018, "agent_compute-ego": 0.05582151017658451, "deviation-heading": 2.5384304430789513, "set_robot_commands": 0.0552073735647251, "deviation-center-line": 0.8109250205915368, "driven_lanedir_consec": 1.2309685631219234, "sim_compute_sim_state": 0.0239287386286444, "sim_compute_performance-ego": 0.04036676945463981, "sim_compute_robot_state-ego": 0.04228809089858297}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3486146329737956, "sim_physics": 0.05619236946105957, "survival_time": 14.950000000000076, "driven_lanedir": 1.645386548604022, "sim_render-ego": 0.036539475917816165, "in-drivable-lane": 1.5500000000000125, "agent_compute-ego": 0.05461994647979736, "deviation-heading": 7.40659085341576, "set_robot_commands": 0.05494614998499552, "deviation-center-line": 1.266408456034012, "driven_lanedir_consec": 1.1278099015808911, "sim_compute_sim_state": 0.02324203570683797, "sim_compute_performance-ego": 0.039912397861480715, "sim_compute_robot_state-ego": 0.04246810674667358}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7337864345275469, "sim_physics": 0.06046248942005391, "survival_time": 4.899999999999991, "driven_lanedir": 0.6102226220340236, "sim_render-ego": 0.036997799970665754, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.055716621632478674, "deviation-heading": 1.5788649343419348, "set_robot_commands": 0.05523376562157456, "deviation-center-line": 0.2952268737321295, "driven_lanedir_consec": 0.6102226220340236, "sim_compute_sim_state": 0.02332658427102225, "sim_compute_performance-ego": 0.039761251332808514, "sim_compute_robot_state-ego": 0.04148218583087532}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.3123926255128189, "sim_physics": 0.06219642162322998, "survival_time": 8.499999999999986, "driven_lanedir": 1.1907266169321975, "sim_render-ego": 0.036538166158339554, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.055199715670417336, "deviation-heading": 2.3011508201113937, "set_robot_commands": 0.05446390544666963, "deviation-center-line": 0.8182674622917375, "driven_lanedir_consec": 1.1907266169321975, "sim_compute_sim_state": 0.02301335615270278, "sim_compute_performance-ego": 0.04011042959549848, "sim_compute_robot_state-ego": 0.04183565448312199}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.34888915445369, "sim_physics": 0.059219666322072345, "survival_time": 14.950000000000076, "driven_lanedir": 2.1380026680989213, "sim_render-ego": 0.03672391891479492, "in-drivable-lane": 0, "agent_compute-ego": 0.05717218160629273, "deviation-heading": 5.123113633223664, "set_robot_commands": 0.05543702522913615, "deviation-center-line": 0.8306701260167592, "driven_lanedir_consec": 2.1380026680989213, "sim_compute_sim_state": 0.023354233105977375, "sim_compute_performance-ego": 0.03973984400431315, "sim_compute_robot_state-ego": 0.0414612889289856}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7015197241630409, "sim_physics": 0.05620940695417688, "survival_time": 4.699999999999991, "driven_lanedir": 0.4300493442755444, "sim_render-ego": 0.03630495578684705, "in-drivable-lane": 0.6499999999999988, "agent_compute-ego": 0.056645236116774536, "deviation-heading": 2.4018441978321103, "set_robot_commands": 0.05504875487469612, "deviation-center-line": 0.4856084601721544, "driven_lanedir_consec": 0.2449162184624352, "sim_compute_sim_state": 0.02315648819537873, "sim_compute_performance-ego": 0.039600818715196974, "sim_compute_robot_state-ego": 0.04130571446520217}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.095477001090349, "sim_physics": 0.05410313272809649, "survival_time": 7.149999999999983, "driven_lanedir": 1.0664382913801704, "sim_render-ego": 0.03561048407654662, "in-drivable-lane": 0, "agent_compute-ego": 0.057246366580883105, "deviation-heading": 1.4744502406469315, "set_robot_commands": 0.0546482593029529, "deviation-center-line": 0.6599442508477962, "driven_lanedir_consec": 1.0664382913801704, "sim_compute_sim_state": 0.023035728014432467, "sim_compute_performance-ego": 0.04007242109392073, "sim_compute_robot_state-ego": 0.04137058358092408}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7820802524690168, "sim_physics": 0.05469017533155588, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7681024281934423, "sim_render-ego": 0.03619584211936363, "in-drivable-lane": 0, "agent_compute-ego": 0.05371469947007986, "deviation-heading": 0.8387731320486855, "set_robot_commands": 0.055514005514291614, "deviation-center-line": 0.5965972281278327, "driven_lanedir_consec": 0.7681024281934423, "sim_compute_sim_state": 0.02247648284985469, "sim_compute_performance-ego": 0.039209918333933905, "sim_compute_robot_state-ego": 0.04091624800975506}}set_robot_commands_max 0.05649649461110433 set_robot_commands_mean 0.055477031057758246 set_robot_commands_median 0.055486667035806056 set_robot_commands_min 0.05446390544666963 sim_compute_performance-ego_max 0.040954570770263675 sim_compute_performance-ego_mean 0.04013421728205195 sim_compute_performance-ego_median 0.04011042959549848 sim_compute_performance-ego_min 0.039209918333933905 sim_compute_robot_state-ego_max 0.04475206704366775 sim_compute_robot_state-ego_mean 0.0420944057145117 sim_compute_robot_state-ego_median 0.04203380505243937 sim_compute_robot_state-ego_min 0.04091624800975506 sim_compute_sim_state_max 0.024087602441961117 sim_compute_sim_state_mean 0.02342478689662888 sim_compute_sim_state_median 0.023354233105977375 sim_compute_sim_state_min 0.02247648284985469 sim_physics_max 0.06295570214589437 sim_physics_mean 0.05901432135054312 sim_physics_median 0.05889836708704631 sim_physics_min 0.05410313272809649 sim_render-ego_max 0.03737505833307902 sim_render-ego_mean 0.03663612321235511 sim_render-ego_median 0.03672391891479492 sim_render-ego_min 0.03561048407654662 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.363333333333353 survival_time_min 4.199999999999993
No reset possible 214273129Peter Almasi Baseline solution using reinforcement learning aido2-LFV-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 16:38:23+00:00 2019-04-29 16:54:48+00:00 0:16:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2872797000944898 survival_time_median 7.249999999999982 deviation-center-line_median 0.31200153599533953 in-drivable-lane_median 1.3499999999999952
other stats agent_compute-ego_max 0.1535188325246175 agent_compute-ego_mean 0.15294685100560482 agent_compute-ego_median 0.15309914391616294 agent_compute-ego_min 0.1518989125887553 deviation-center-line_max 1.0383678079972791 deviation-center-line_mean 0.54625712969991 deviation-center-line_min 0.194413034722958 deviation-heading_max 3.8862989480174104 deviation-heading_mean 2.0486078177109515 deviation-heading_median 1.2716111571030262 deviation-heading_min 0.5698110015665175 driven_any_max 3.556254756904185 driven_any_mean 2.3232939975049245 driven_any_median 1.849585683074088 driven_any_min 1.0854412899421635 driven_lanedir_consec_max 3.396226256698142 driven_lanedir_consec_mean 2.000847134272317 driven_lanedir_consec_min 0.7614835870569683 driven_lanedir_max 3.396226256698142 driven_lanedir_mean 2.011556809767187 driven_lanedir_median 1.3052469219363634 driven_lanedir_min 0.7614835870569683 in-drivable-lane_max 1.949999999999993 in-drivable-lane_mean 0.9699999999999964 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0854412899421635, "sim_physics": 0.091204924053616, "survival_time": 4.499999999999992, "driven_lanedir": 0.7614835870569683, "sim_render-ego": 0.03589842319488525, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15343308448791504, "deviation-heading": 0.6358986278955125, "set_robot_commands": 0.05545299318101671, "deviation-center-line": 0.194413034722958, "driven_lanedir_consec": 0.7614835870569683, "sim_compute_sim_state": 0.022201723522610135, "sim_compute_performance-ego": 0.038362431526184085, "sim_compute_robot_state-ego": 0.039844746059841576, "sim_compute_robot_state-npc0": 0.03976173135969374, "sim_compute_robot_state-npc1": 0.03896921475728353, "sim_compute_robot_state-npc2": 0.038969829347398545, "sim_compute_robot_state-npc3": 0.03862154483795166}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.556254756904185, "sim_physics": 0.0950602388381958, "survival_time": 14.950000000000076, "driven_lanedir": 3.396226256698142, "sim_render-ego": 0.03510506947835287, "in-drivable-lane": 0, "agent_compute-ego": 0.1535188325246175, "deviation-heading": 3.879419353972291, "set_robot_commands": 0.05528343598047892, "deviation-center-line": 0.8919811582529173, "driven_lanedir_consec": 3.396226256698142, "sim_compute_sim_state": 0.02208284060160319, "sim_compute_performance-ego": 0.03824999729792277, "sim_compute_robot_state-ego": 0.03990812937418619, "sim_compute_robot_state-npc0": 0.03951115846633911, "sim_compute_robot_state-npc1": 0.03880787928899129, "sim_compute_robot_state-npc2": 0.03869231621424357, "sim_compute_robot_state-npc3": 0.03865521748860677}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.849585683074088, "sim_physics": 0.08753195631092993, "survival_time": 7.249999999999982, "driven_lanedir": 1.3052469219363634, "sim_render-ego": 0.03480000824763857, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.15309914391616294, "deviation-heading": 1.2716111571030262, "set_robot_commands": 0.054474166343952045, "deviation-center-line": 0.31200153599533953, "driven_lanedir_consec": 1.251698544462012, "sim_compute_sim_state": 0.022201921199930124, "sim_compute_performance-ego": 0.03780157155004041, "sim_compute_robot_state-ego": 0.039957819313838565, "sim_compute_robot_state-npc0": 0.03954851380709944, "sim_compute_robot_state-npc1": 0.03859334485284213, "sim_compute_robot_state-npc2": 0.038328833415590485, "sim_compute_robot_state-npc3": 0.03813968526905981}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6569022159046043, "sim_physics": 0.08948045327113224, "survival_time": 6.499999999999985, "driven_lanedir": 1.2872797000944898, "sim_render-ego": 0.034487995734581584, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.15278428151057316, "deviation-heading": 0.5698110015665175, "set_robot_commands": 0.05428021504328801, "deviation-center-line": 0.29452211153105606, "driven_lanedir_consec": 1.2872797000944898, "sim_compute_sim_state": 0.021901435118455152, "sim_compute_performance-ego": 0.037625597073481634, "sim_compute_robot_state-ego": 0.03959780106177697, "sim_compute_robot_state-npc0": 0.03941261951739971, "sim_compute_robot_state-npc1": 0.038677398975078874, "sim_compute_robot_state-npc2": 0.03816246069394625, "sim_compute_robot_state-npc3": 0.03782013379610502}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.4682860416995815, "sim_physics": 0.08204107681910197, "survival_time": 14.950000000000076, "driven_lanedir": 3.3075475830499736, "sim_render-ego": 0.034457657337188724, "in-drivable-lane": 0, "agent_compute-ego": 0.1518989125887553, "deviation-heading": 3.8862989480174104, "set_robot_commands": 0.05366824547449748, "deviation-center-line": 1.0383678079972791, "driven_lanedir_consec": 3.3075475830499736, "sim_compute_sim_state": 0.02161667585372925, "sim_compute_performance-ego": 0.037848328749338786, "sim_compute_robot_state-ego": 0.03940272808074951, "sim_compute_robot_state-npc0": 0.03901203076044719, "sim_compute_robot_state-npc1": 0.03793244520823161, "sim_compute_robot_state-npc2": 0.03800941705703735, "sim_compute_robot_state-npc3": 0.03857602834701538}}set_robot_commands_max 0.05545299318101671 set_robot_commands_mean 0.05463181120464663 set_robot_commands_median 0.054474166343952045 set_robot_commands_min 0.05366824547449748 sim_compute_performance-ego_max 0.038362431526184085 sim_compute_performance-ego_mean 0.03797758523939354 sim_compute_performance-ego_median 0.037848328749338786 sim_compute_performance-ego_min 0.037625597073481634 sim_compute_robot_state-ego_max 0.039957819313838565 sim_compute_robot_state-ego_mean 0.03974224477807856 sim_compute_robot_state-ego_median 0.039844746059841576 sim_compute_robot_state-ego_min 0.03940272808074951 sim_compute_robot_state-npc0_max 0.03976173135969374 sim_compute_robot_state-npc0_mean 0.039449210782195834 sim_compute_robot_state-npc0_median 0.03951115846633911 sim_compute_robot_state-npc0_min 0.03901203076044719 sim_compute_robot_state-npc1_max 0.03896921475728353 sim_compute_robot_state-npc1_mean 0.03859605661648549 sim_compute_robot_state-npc1_median 0.038677398975078874 sim_compute_robot_state-npc1_min 0.03793244520823161 sim_compute_robot_state-npc2_max 0.038969829347398545 sim_compute_robot_state-npc2_mean 0.03843257134564324 sim_compute_robot_state-npc2_median 0.038328833415590485 sim_compute_robot_state-npc2_min 0.03800941705703735 sim_compute_robot_state-npc3_max 0.03865521748860677 sim_compute_robot_state-npc3_mean 0.03836252194774773 sim_compute_robot_state-npc3_median 0.03857602834701538 sim_compute_robot_state-npc3_min 0.03782013379610502 sim_compute_sim_state_max 0.022201921199930124 sim_compute_sim_state_mean 0.02200091925926557 sim_compute_sim_state_median 0.02208284060160319 sim_compute_sim_state_min 0.02161667585372925 sim_physics_max 0.0950602388381958 sim_physics_mean 0.08906372985859519 sim_physics_median 0.08948045327113224 sim_physics_min 0.08204107681910197 sim_render-ego_max 0.03589842319488525 sim_render-ego_mean 0.0349498307985294 sim_render-ego_median 0.03480000824763857 sim_render-ego_min 0.034457657337188724 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.630000000000024 survival_time_min 4.499999999999992
No reset possible 214263128Rami Al-Naim modified configs aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 15:32:52+00:00 2019-04-29 15:44:09+00:00 0:11:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.8954854324521555 survival_time_median 10.95000000000002 deviation-center-line_median 0.7241320686019458 in-drivable-lane_median 0.05000000000000071
other stats agent_compute-ego_max 0.07728104613143015 agent_compute-ego_mean 0.07595085047599395 agent_compute-ego_median 0.07626651796165872 agent_compute-ego_min 0.07298235893249512 deviation-center-line_max 1.1207093766246232 deviation-center-line_mean 0.8432593688469844 deviation-center-line_min 0.5901368178363506 deviation-heading_max 2.915333004457847 deviation-heading_mean 2.3041297101378966 deviation-heading_median 2.3530315339051677 deviation-heading_min 1.371560141057926 driven_any_max 2.7577094476555084 driven_any_mean 2.2540149555866065 driven_any_median 1.99397647931988 driven_any_min 1.8897724183761175 driven_lanedir_consec_max 2.459063761785585 driven_lanedir_consec_mean 2.086916470784427 driven_lanedir_consec_min 1.8176294928325083 driven_lanedir_max 2.459063761785585 driven_lanedir_mean 2.086916470784427 driven_lanedir_median 1.8954854324521555 driven_lanedir_min 1.8176294928325083 in-drivable-lane_max 1.4000000000000092 in-drivable-lane_mean 0.5300000000000011 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.99397647931988, "sim_physics": 0.060437818640443286, "survival_time": 10.95000000000002, "driven_lanedir": 1.8954854324521555, "sim_render-ego": 0.03668170432521872, "in-drivable-lane": 0, "agent_compute-ego": 0.07728104613143015, "deviation-heading": 2.915333004457847, "set_robot_commands": 0.05578294410008818, "deviation-center-line": 0.6705890520166451, "driven_lanedir_consec": 1.8954854324521555, "sim_compute_sim_state": 0.023487732290677285, "sim_compute_performance-ego": 0.039599956442776335, "sim_compute_robot_state-ego": 0.0417623922705106}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7577094476555084, "sim_physics": 0.05864855686823527, "survival_time": 14.950000000000076, "driven_lanedir": 2.459063761785585, "sim_render-ego": 0.03637747049331665, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.07298235893249512, "deviation-heading": 2.3530315339051677, "set_robot_commands": 0.056268247763315835, "deviation-center-line": 1.1107295291553576, "driven_lanedir_consec": 2.459063761785585, "sim_compute_sim_state": 0.023826955954233807, "sim_compute_performance-ego": 0.04014947811762492, "sim_compute_robot_state-ego": 0.042394079367319745}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.7388392657507294, "sim_physics": 0.0603791543530294, "survival_time": 14.850000000000076, "driven_lanedir": 2.4013809602775416, "sim_render-ego": 0.03632567707537, "in-drivable-lane": 1.4000000000000092, "agent_compute-ego": 0.0759582190401225, "deviation-heading": 2.5469058507502873, "set_robot_commands": 0.05567989606247205, "deviation-center-line": 1.1207093766246232, "driven_lanedir_consec": 2.4013809602775416, "sim_compute_sim_state": 0.023881238719028256, "sim_compute_performance-ego": 0.039943683027016993, "sim_compute_robot_state-ego": 0.04282487121093956}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8897724183761175, "sim_physics": 0.058205058609229934, "survival_time": 10.350000000000012, "driven_lanedir": 1.8176294928325083, "sim_render-ego": 0.03656301636626755, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.07626651796165872, "deviation-heading": 2.3338180205182537, "set_robot_commands": 0.05567007709816458, "deviation-center-line": 0.5901368178363506, "driven_lanedir_consec": 1.8176294928325083, "sim_compute_sim_state": 0.02390767180401346, "sim_compute_performance-ego": 0.039850914535891034, "sim_compute_robot_state-ego": 0.04214600203693777}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8897771668307977, "sim_physics": 0.05997506892623533, "survival_time": 10.350000000000012, "driven_lanedir": 1.8610227065743477, "sim_render-ego": 0.036532435440210904, "in-drivable-lane": 0, "agent_compute-ego": 0.07726611031426324, "deviation-heading": 1.371560141057926, "set_robot_commands": 0.05508996783823207, "deviation-center-line": 0.7241320686019458, "driven_lanedir_consec": 1.8610227065743477, "sim_compute_sim_state": 0.02409811526680914, "sim_compute_performance-ego": 0.03992746532827184, "sim_compute_robot_state-ego": 0.04194400045606825}}set_robot_commands_max 0.056268247763315835 set_robot_commands_mean 0.05569822657245453 set_robot_commands_median 0.05567989606247205 set_robot_commands_min 0.05508996783823207 sim_compute_performance-ego_max 0.04014947811762492 sim_compute_performance-ego_mean 0.03989429949031622 sim_compute_performance-ego_median 0.03992746532827184 sim_compute_performance-ego_min 0.039599956442776335 sim_compute_robot_state-ego_max 0.04282487121093956 sim_compute_robot_state-ego_mean 0.04221426906835519 sim_compute_robot_state-ego_median 0.04214600203693777 sim_compute_robot_state-ego_min 0.0417623922705106 sim_compute_sim_state_max 0.02409811526680914 sim_compute_sim_state_mean 0.02384034280695239 sim_compute_sim_state_median 0.023881238719028256 sim_compute_sim_state_min 0.023487732290677285 sim_physics_max 0.060437818640443286 sim_physics_mean 0.05952913147943465 sim_physics_median 0.05997506892623533 sim_physics_min 0.058205058609229934 sim_render-ego_max 0.03668170432521872 sim_render-ego_mean 0.03649606074007676 sim_render-ego_median 0.036532435440210904 sim_render-ego_min 0.03632567707537 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.290000000000038 survival_time_min 10.350000000000012
No reset possible 214223124Rami Al-Naim [0.4;0.7] aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 13:38:16+00:00 2019-04-29 13:43:19+00:00 0:05:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7388667800380149 survival_time_median 4.249999999999993 deviation-center-line_median 0.27064306249974446 in-drivable-lane_median 1.2499999999999956
other stats agent_compute-ego_max 0.07658474585589241 agent_compute-ego_mean 0.07373806117521949 agent_compute-ego_median 0.07294255978352315 agent_compute-ego_min 0.070786052942276 deviation-center-line_max 0.5632825005277673 deviation-center-line_mean 0.33179196896866314 deviation-center-line_min 0.13098570298288575 deviation-heading_max 1.0350568790506964 deviation-heading_mean 0.5906824655880591 deviation-heading_median 0.5782205186030633 deviation-heading_min 0.3141344878882786 driven_any_max 1.6536629517558206 driven_any_mean 1.161842819722756 driven_any_median 1.0813143679316164 driven_any_min 0.4237886499070739 driven_lanedir_consec_max 1.2589004124707714 driven_lanedir_consec_mean 0.8614054004551971 driven_lanedir_consec_min 0.40225311395183727 driven_lanedir_max 1.2589004124707714 driven_lanedir_mean 0.8614054004551971 driven_lanedir_median 0.7388667800380149 driven_lanedir_min 0.40225311395183727 in-drivable-lane_max 1.499999999999995 in-drivable-lane_mean 0.9799999999999964 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0813143679316164, "sim_physics": 0.05695799659280216, "survival_time": 4.249999999999993, "driven_lanedir": 0.6542763131321268, "sim_render-ego": 0.03619309313157026, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.07658474585589241, "deviation-heading": 0.3141344878882786, "set_robot_commands": 0.05595428522895364, "deviation-center-line": 0.2583771117023696, "driven_lanedir_consec": 0.6542763131321268, "sim_compute_sim_state": 0.023897891886094036, "sim_compute_performance-ego": 0.0393286059884464, "sim_compute_robot_state-ego": 0.0416629061979406}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0247359962730656, "sim_physics": 0.0571469396352768, "survival_time": 3.999999999999994, "driven_lanedir": 0.7388667800380149, "sim_render-ego": 0.03586563169956207, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.070786052942276, "deviation-heading": 1.0350568790506964, "set_robot_commands": 0.05519036948680878, "deviation-center-line": 0.27064306249974446, "driven_lanedir_consec": 0.7388667800380149, "sim_compute_sim_state": 0.023697522282600404, "sim_compute_performance-ego": 0.039162549376487735, "sim_compute_robot_state-ego": 0.0424014151096344}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6536629517558206, "sim_physics": 0.0581944522857666, "survival_time": 6.249999999999986, "driven_lanedir": 1.252730382683235, "sim_render-ego": 0.035573217391967775, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.07217015075683594, "deviation-heading": 0.44358013155805526, "set_robot_commands": 0.05515672492980957, "deviation-center-line": 0.5632825005277673, "driven_lanedir_consec": 1.252730382683235, "sim_compute_sim_state": 0.02331989860534668, "sim_compute_performance-ego": 0.039341386795043946, "sim_compute_robot_state-ego": 0.042087011337280274}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4237886499070739, "sim_physics": 0.060741985166395035, "survival_time": 1.850000000000001, "driven_lanedir": 0.40225311395183727, "sim_render-ego": 0.03613821880237477, "in-drivable-lane": 0, "agent_compute-ego": 0.07294255978352315, "deviation-heading": 0.5782205186030633, "set_robot_commands": 0.05416902980288944, "deviation-center-line": 0.13098570298288575, "driven_lanedir_consec": 0.40225311395183727, "sim_compute_sim_state": 0.02312499123650628, "sim_compute_performance-ego": 0.03991293907165527, "sim_compute_robot_state-ego": 0.04142669729284338}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6257121327462036, "sim_physics": 0.05940555363166623, "survival_time": 6.149999999999986, "driven_lanedir": 1.2589004124707714, "sim_render-ego": 0.03578184096793818, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.07620679653756987, "deviation-heading": 0.582420310840202, "set_robot_commands": 0.055416917413230835, "deviation-center-line": 0.43567146713054866, "driven_lanedir_consec": 1.2589004124707714, "sim_compute_sim_state": 0.02351161910266411, "sim_compute_performance-ego": 0.03892153259215316, "sim_compute_robot_state-ego": 0.0416653059362396}}set_robot_commands_max 0.05595428522895364 set_robot_commands_mean 0.055177465372338454 set_robot_commands_median 0.05519036948680878 set_robot_commands_min 0.05416902980288944 sim_compute_performance-ego_max 0.03991293907165527 sim_compute_performance-ego_mean 0.03933340276475731 sim_compute_performance-ego_median 0.0393286059884464 sim_compute_performance-ego_min 0.03892153259215316 sim_compute_robot_state-ego_max 0.0424014151096344 sim_compute_robot_state-ego_mean 0.04184866717478765 sim_compute_robot_state-ego_median 0.0416653059362396 sim_compute_robot_state-ego_min 0.04142669729284338 sim_compute_sim_state_max 0.023897891886094036 sim_compute_sim_state_mean 0.0235103846226423 sim_compute_sim_state_median 0.02351161910266411 sim_compute_sim_state_min 0.02312499123650628 sim_physics_max 0.060741985166395035 sim_physics_mean 0.058489385462381374 sim_physics_median 0.0581944522857666 sim_physics_min 0.05695799659280216 sim_render-ego_max 0.03619309313157026 sim_render-ego_mean 0.03591040039868261 sim_render-ego_median 0.03586563169956207 sim_render-ego_min 0.035573217391967775 simulation-passed 1 survival_time_max 6.249999999999986 survival_time_mean 4.499999999999991 survival_time_min 1.850000000000001
No reset possible 214203122Rami Al-Naim v_d_1_K_t_-0.75_no_cache aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 13:02:03+00:00 2019-04-29 13:13:26+00:00 0:11:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.778071124385467 survival_time_median 12.35000000000004 deviation-center-line_median 0.6579373294737557 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07685380619064516 agent_compute-ego_mean 0.07481372502443064 agent_compute-ego_median 0.07499203217768036 agent_compute-ego_min 0.07213806470235189 deviation-center-line_max 1.1364708206711327 deviation-center-line_mean 0.8051550615846989 deviation-center-line_min 0.6027014650048295 deviation-heading_max 2.5706462667615284 deviation-heading_mean 2.05403915822261 deviation-heading_median 2.2998349324731984 deviation-heading_min 1.4194135887920531 driven_any_max 2.3491663846982007 driven_any_mean 1.9650925857535049 driven_any_median 1.9235971500722369 driven_any_min 1.7303644151331272 driven_lanedir_consec_max 2.115559554636649 driven_lanedir_consec_mean 1.833607425074784 driven_lanedir_consec_min 1.6972169412436608 driven_lanedir_max 2.115559554636649 driven_lanedir_mean 1.833607425074784 driven_lanedir_median 1.778071124385467 driven_lanedir_min 1.6972169412436608 in-drivable-lane_max 1.3000000000000185 in-drivable-lane_mean 0.47000000000000297 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9235971500722369, "sim_physics": 0.05924545318974175, "survival_time": 12.35000000000004, "driven_lanedir": 1.8773195261127105, "sim_render-ego": 0.03654783746974189, "in-drivable-lane": 0, "agent_compute-ego": 0.07685380619064516, "deviation-heading": 1.5225377531271218, "set_robot_commands": 0.055130330174558075, "deviation-center-line": 0.6264864393782784, "driven_lanedir_consec": 1.8773195261127105, "sim_compute_sim_state": 0.0237746769600069, "sim_compute_performance-ego": 0.03971669065807512, "sim_compute_robot_state-ego": 0.04210063706525424}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3491663846982007, "sim_physics": 0.058489381472269696, "survival_time": 14.950000000000076, "driven_lanedir": 2.115559554636649, "sim_render-ego": 0.03603874762852987, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.07213806470235189, "deviation-heading": 2.457763249959146, "set_robot_commands": 0.05514680862426758, "deviation-center-line": 1.1364708206711327, "driven_lanedir_consec": 2.115559554636649, "sim_compute_sim_state": 0.023936378955841064, "sim_compute_performance-ego": 0.039474030335744224, "sim_compute_robot_state-ego": 0.04210757335027059}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.059841684583114, "sim_physics": 0.060088375222093704, "survival_time": 13.150000000000052, "driven_lanedir": 1.778071124385467, "sim_render-ego": 0.0364093390707734, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.073372131971352, "deviation-heading": 2.2998349324731984, "set_robot_commands": 0.05528751162975007, "deviation-center-line": 1.0021792533954976, "driven_lanedir_consec": 1.778071124385467, "sim_compute_sim_state": 0.023824132440661297, "sim_compute_performance-ego": 0.04077544593085808, "sim_compute_robot_state-ego": 0.042174236856032686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7624932942808438, "sim_physics": 0.05946880631742224, "survival_time": 11.300000000000026, "driven_lanedir": 1.6972169412436608, "sim_render-ego": 0.03639928535022567, "in-drivable-lane": 0, "agent_compute-ego": 0.07499203217768036, "deviation-heading": 2.5706462667615284, "set_robot_commands": 0.0551341160208778, "deviation-center-line": 0.6027014650048295, "driven_lanedir_consec": 1.6972169412436608, "sim_compute_sim_state": 0.02380866498018788, "sim_compute_performance-ego": 0.03977772197892181, "sim_compute_robot_state-ego": 0.04217117339108897}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7303644151331272, "sim_physics": 0.06150210977674605, "survival_time": 11.100000000000025, "driven_lanedir": 1.699869978995434, "sim_render-ego": 0.03660557184133443, "in-drivable-lane": 0, "agent_compute-ego": 0.07671259008012377, "deviation-heading": 1.4194135887920531, "set_robot_commands": 0.055142395131222835, "deviation-center-line": 0.6579373294737557, "driven_lanedir_consec": 1.699869978995434, "sim_compute_sim_state": 0.02382390885739713, "sim_compute_performance-ego": 0.03975701976466824, "sim_compute_robot_state-ego": 0.04167312544745368}}set_robot_commands_max 0.05528751162975007 set_robot_commands_mean 0.05516823231613527 set_robot_commands_median 0.055142395131222835 set_robot_commands_min 0.055130330174558075 sim_compute_performance-ego_max 0.04077544593085808 sim_compute_performance-ego_mean 0.03990018173365349 sim_compute_performance-ego_median 0.03975701976466824 sim_compute_performance-ego_min 0.039474030335744224 sim_compute_robot_state-ego_max 0.042174236856032686 sim_compute_robot_state-ego_mean 0.04204534922202004 sim_compute_robot_state-ego_median 0.04210757335027059 sim_compute_robot_state-ego_min 0.04167312544745368 sim_compute_sim_state_max 0.023936378955841064 sim_compute_sim_state_mean 0.023833552438818857 sim_compute_sim_state_median 0.02382390885739713 sim_compute_sim_state_min 0.0237746769600069 sim_physics_max 0.06150210977674605 sim_physics_mean 0.05975882519565469 sim_physics_median 0.05946880631742224 sim_physics_min 0.058489381472269696 sim_render-ego_max 0.03660557184133443 sim_render-ego_mean 0.03640015627212105 sim_render-ego_median 0.0364093390707734 sim_render-ego_min 0.03603874762852987 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 12.570000000000045 survival_time_min 11.100000000000025
No reset possible 214183120Rami Al-Naim v_d_1.75_no_cache aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 12:00:52+00:00 2019-04-29 12:11:21+00:00 0:10:29 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.213131375505139 survival_time_median 14.050000000000065 deviation-center-line_median 1.2328430354624882 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07989981590216694 agent_compute-ego_mean 0.07416409208669736 agent_compute-ego_median 0.07223779678344727 agent_compute-ego_min 0.06914390312446343 deviation-center-line_max 1.3027940136004752 deviation-center-line_mean 0.9990568771051942 deviation-center-line_min 0.29818277176866104 deviation-heading_max 3.7039619381013695 deviation-heading_mean 2.3128164983530737 deviation-heading_median 2.6233600628470173 deviation-heading_min 0.7622536480255855 driven_any_max 1.3423807628699915 driven_any_mean 1.0026084336054495 driven_any_median 1.255352327126642 driven_any_min 0.38721506308021486 driven_lanedir_consec_max 1.2961310951458191 driven_lanedir_consec_mean 0.963357923561196 driven_lanedir_consec_min 0.3461363447515411 driven_lanedir_max 1.2961310951458191 driven_lanedir_mean 0.963357923561196 driven_lanedir_median 1.213131375505139 driven_lanedir_min 0.3461363447515411 in-drivable-lane_max 0.04999999999999982 in-drivable-lane_mean 0.009999999999999964 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.255352327126642, "sim_physics": 0.058702694563679, "survival_time": 14.050000000000065, "driven_lanedir": 1.213131375505139, "sim_render-ego": 0.03691355443934104, "in-drivable-lane": 0, "agent_compute-ego": 0.07989981590216694, "deviation-heading": 2.6811890421671385, "set_robot_commands": 0.05605535914465202, "deviation-center-line": 1.2328430354624882, "driven_lanedir_consec": 1.213131375505139, "sim_compute_sim_state": 0.02396704633040785, "sim_compute_performance-ego": 0.04031667081486712, "sim_compute_robot_state-ego": 0.04229217576810898}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3423805510763036, "sim_physics": 0.0605668314297994, "survival_time": 14.950000000000076, "driven_lanedir": 1.2793940348159958, "sim_render-ego": 0.03672286828358968, "in-drivable-lane": 0, "agent_compute-ego": 0.07223779678344727, "deviation-heading": 3.7039619381013695, "set_robot_commands": 0.05599450667699178, "deviation-center-line": 1.2531704210291064, "driven_lanedir_consec": 1.2793940348159958, "sim_compute_sim_state": 0.023990004062652587, "sim_compute_performance-ego": 0.04024308363596598, "sim_compute_robot_state-ego": 0.04236165920893351}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6857134638740964, "sim_physics": 0.05994473206691253, "survival_time": 7.79999999999998, "driven_lanedir": 0.6819967675874845, "sim_render-ego": 0.036438920559027255, "in-drivable-lane": 0, "agent_compute-ego": 0.07046319888188289, "deviation-heading": 0.7622536480255855, "set_robot_commands": 0.05599733652212681, "deviation-center-line": 0.9082941436652402, "driven_lanedir_consec": 0.6819967675874845, "sim_compute_sim_state": 0.023708786719884627, "sim_compute_performance-ego": 0.040261529959165133, "sim_compute_robot_state-ego": 0.0424032639234494}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.38721506308021486, "sim_physics": 0.06510360686333624, "survival_time": 4.549999999999992, "driven_lanedir": 0.3461363447515411, "sim_render-ego": 0.03655552078079391, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.06914390312446343, "deviation-heading": 1.7933178006242605, "set_robot_commands": 0.05568548611232212, "deviation-center-line": 0.29818277176866104, "driven_lanedir_consec": 0.3461363447515411, "sim_compute_sim_state": 0.02377407105414422, "sim_compute_performance-ego": 0.03993897909646506, "sim_compute_robot_state-ego": 0.04263117549183605}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3423807628699915, "sim_physics": 0.0561372979482015, "survival_time": 14.950000000000076, "driven_lanedir": 1.2961310951458191, "sim_render-ego": 0.03650420745213827, "in-drivable-lane": 0, "agent_compute-ego": 0.07907574574152629, "deviation-heading": 2.6233600628470173, "set_robot_commands": 0.05574906269709269, "deviation-center-line": 1.3027940136004752, "driven_lanedir_consec": 1.2961310951458191, "sim_compute_sim_state": 0.023807555039723715, "sim_compute_performance-ego": 0.040180594126383466, "sim_compute_robot_state-ego": 0.04215040922164917}}set_robot_commands_max 0.05605535914465202 set_robot_commands_mean 0.05589635023063709 set_robot_commands_median 0.05599450667699178 set_robot_commands_min 0.05568548611232212 sim_compute_performance-ego_max 0.04031667081486712 sim_compute_performance-ego_mean 0.04018817152656935 sim_compute_performance-ego_median 0.04024308363596598 sim_compute_performance-ego_min 0.03993897909646506 sim_compute_robot_state-ego_max 0.04263117549183605 sim_compute_robot_state-ego_mean 0.04236773672279542 sim_compute_robot_state-ego_median 0.04236165920893351 sim_compute_robot_state-ego_min 0.04215040922164917 sim_compute_sim_state_max 0.023990004062652587 sim_compute_sim_state_mean 0.0238494926413626 sim_compute_sim_state_median 0.023807555039723715 sim_compute_sim_state_min 0.023708786719884627 sim_physics_max 0.06510360686333624 sim_physics_mean 0.060091032574385736 sim_physics_median 0.05994473206691253 sim_physics_min 0.0561372979482015 sim_render-ego_max 0.03691355443934104 sim_render-ego_mean 0.03662701430297803 sim_render-ego_median 0.03655552078079391 sim_render-ego_min 0.036438920559027255 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.26000000000004 survival_time_min 4.549999999999992
No reset possible 214163119Rami Al-Naim v_d_3/2_no_cache aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-29 11:39:22+00:00 2019-04-29 11:48:19+00:00 0:08:57 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8614341996181967 survival_time_median 8.549999999999986 deviation-center-line_median 0.6947336916309468 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07922447081839684 agent_compute-ego_mean 0.07433882535617219 agent_compute-ego_median 0.0730766511102866 agent_compute-ego_min 0.07026496330897013 deviation-center-line_max 0.9450136436588084 deviation-center-line_mean 0.6821145901230058 deviation-center-line_min 0.5069577084137371 deviation-heading_max 4.029828899422327 deviation-heading_mean 2.3723362928414327 deviation-heading_median 2.2678450359266886 deviation-heading_min 0.6816957065703657 driven_any_max 1.566095891619742 driven_any_mean 0.9714678859683972 driven_any_median 0.8803552445398766 driven_any_min 0.6285570251624578 driven_lanedir_consec_max 1.4815342515538412 driven_lanedir_consec_mean 0.9072656788729448 driven_lanedir_consec_min 0.6245948502269494 driven_lanedir_max 1.4815342515538412 driven_lanedir_mean 0.9072656788729448 driven_lanedir_median 0.8614341996181967 driven_lanedir_min 0.6245948502269494 in-drivable-lane_max 0.4499999999999984 in-drivable-lane_mean 0.08999999999999968 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.735924106971015, "sim_physics": 0.0604800454501448, "survival_time": 7.249999999999982, "driven_lanedir": 0.6283771734655069, "sim_render-ego": 0.03751423769983752, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.07817195366168844, "deviation-heading": 2.2678450359266886, "set_robot_commands": 0.055905097106407425, "deviation-center-line": 0.5069577084137371, "driven_lanedir_consec": 0.6283771734655069, "sim_compute_sim_state": 0.02415814235292632, "sim_compute_performance-ego": 0.04056070590841359, "sim_compute_robot_state-ego": 0.04208880786238046}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.566095891619742, "sim_physics": 0.05656184355417888, "survival_time": 14.950000000000076, "driven_lanedir": 1.4815342515538412, "sim_render-ego": 0.036607712109883624, "in-drivable-lane": 0, "agent_compute-ego": 0.07026496330897013, "deviation-heading": 4.029828899422327, "set_robot_commands": 0.055614749590555825, "deviation-center-line": 0.9450136436588084, "driven_lanedir_consec": 1.4815342515538412, "sim_compute_sim_state": 0.02395933389663696, "sim_compute_performance-ego": 0.039792342980702715, "sim_compute_robot_state-ego": 0.041950987180074055}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6285570251624578, "sim_physics": 0.05774907527431365, "survival_time": 6.199999999999986, "driven_lanedir": 0.6245948502269494, "sim_render-ego": 0.03599882125854492, "in-drivable-lane": 0, "agent_compute-ego": 0.07095608788151894, "deviation-heading": 0.6816957065703657, "set_robot_commands": 0.05589797804432531, "deviation-center-line": 0.6947336916309468, "driven_lanedir_consec": 0.6245948502269494, "sim_compute_sim_state": 0.02392305289545367, "sim_compute_performance-ego": 0.03964428747853925, "sim_compute_robot_state-ego": 0.04200089362359816}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8803552445398766, "sim_physics": 0.05878431336921558, "survival_time": 8.549999999999986, "driven_lanedir": 0.8614341996181967, "sim_render-ego": 0.0364020902510972, "in-drivable-lane": 0, "agent_compute-ego": 0.0730766511102866, "deviation-heading": 1.4275576677830877, "set_robot_commands": 0.05473119334170693, "deviation-center-line": 0.7248101218802838, "driven_lanedir_consec": 0.8614341996181967, "sim_compute_sim_state": 0.023902246129443073, "sim_compute_performance-ego": 0.03980869995920282, "sim_compute_robot_state-ego": 0.041941923007630465}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.046407161548895, "sim_physics": 0.06051661590538403, "survival_time": 10.100000000000009, "driven_lanedir": 0.94038791950023, "sim_render-ego": 0.036733065501298054, "in-drivable-lane": 0, "agent_compute-ego": 0.07922447081839684, "deviation-heading": 3.4547541545046943, "set_robot_commands": 0.05517285058994104, "deviation-center-line": 0.5390577850312531, "driven_lanedir_consec": 0.94038791950023, "sim_compute_sim_state": 0.023686211888152776, "sim_compute_performance-ego": 0.04000981609420021, "sim_compute_robot_state-ego": 0.042575039485893626}}set_robot_commands_max 0.055905097106407425 set_robot_commands_mean 0.055464373734587305 set_robot_commands_median 0.055614749590555825 set_robot_commands_min 0.05473119334170693 sim_compute_performance-ego_max 0.04056070590841359 sim_compute_performance-ego_mean 0.03996317048421171 sim_compute_performance-ego_median 0.03980869995920282 sim_compute_performance-ego_min 0.03964428747853925 sim_compute_robot_state-ego_max 0.042575039485893626 sim_compute_robot_state-ego_mean 0.04211153023191535 sim_compute_robot_state-ego_median 0.04200089362359816 sim_compute_robot_state-ego_min 0.041941923007630465 sim_compute_sim_state_max 0.02415814235292632 sim_compute_sim_state_mean 0.02392579743252256 sim_compute_sim_state_median 0.02392305289545367 sim_compute_sim_state_min 0.023686211888152776 sim_physics_max 0.06051661590538403 sim_physics_mean 0.05881837871064739 sim_physics_median 0.05878431336921558 sim_physics_min 0.05656184355417888 sim_render-ego_max 0.03751423769983752 sim_render-ego_mean 0.03665118536413227 sim_render-ego_median 0.036607712109883624 sim_render-ego_min 0.03599882125854492 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.410000000000007 survival_time_min 6.199999999999986
No reset possible 214123117Peter Almasi Baseline solution using reinforcement learning aido2-LF-sim-validationstep1-simulation host-error no ip-172-31-40-253-321252019-04-29 05:54:01+00:00 2019-04-29 06:00:07+00:00 0:06:06 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3117/step1-simulation-ip-172-31-40-253-32125-job21412/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 213932412jiang peng Baseline solution using reinforcement learning aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-28 03:00:28+00:00 2019-04-28 04:00:08+00:00 0:59:40 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-40-253-32125-job21393/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 213802448Nicky Eichmann Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-28 02:00:19+00:00 2019-04-28 03:00:10+00:00 0:59:51 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2448/step1-simulation-ip-172-31-40-253-32125-job21380/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 213692450Nicky Eichmann Baseline solution using reinforcement learning aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-28 01:12:25+00:00 2019-04-28 02:00:11+00:00 0:47:46 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-40-253-32125-job21369/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 213552370Liam Paull minimal_agent (Python 3) aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-28 01:00:35+00:00 2019-04-28 01:11:37+00:00 0:11:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6257610897668884 survival_time_median 6.949999999999983 deviation-center-line_median 0.36802347786147127 in-drivable-lane_median 0.34999999999999876
other stats agent_compute-ego_max 0.1516088326772054 agent_compute-ego_mean 0.1465039146873302 agent_compute-ego_median 0.14618242564408676 agent_compute-ego_min 0.14152116569683706 deviation-center-line_max 0.49658151961950325 deviation-center-line_mean 0.37927296243083847 deviation-center-line_min 0.23430699853227116 deviation-heading_max 1.7338651399303977 deviation-heading_mean 0.9312492766179612 deviation-heading_median 0.801279189692507 deviation-heading_min 0.5056416838713088 driven_any_max 1.5927758413436612 driven_any_mean 0.9016551802808824 driven_any_median 0.9900915586687412 driven_any_min 0.278862430643389 driven_lanedir_consec_max 0.8945129127998346 driven_lanedir_consec_mean 0.6133119330362337 driven_lanedir_consec_min 0.2720172605900939 driven_lanedir_max 0.8945129127998346 driven_lanedir_mean 0.6133119330362337 driven_lanedir_median 0.6257610897668884 driven_lanedir_min 0.2720172605900939 in-drivable-lane_max 6.400000000000029 in-drivable-lane_mean 1.7500000000000042 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.10269584415627898, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05859257505952026, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14152116569683706, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.09065488431093505, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.035809660987030686, "sim_compute_performance-ego": 0.06643757202642427, "sim_compute_robot_state-ego": 0.06720209293228259}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.09852274485996793, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.057476769174848286, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.14335217475891113, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.09123517104557582, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.03507423400878906, "sim_compute_performance-ego": 0.06410768713269915, "sim_compute_robot_state-ego": 0.07019664730344499}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.11010482046339248, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.06449891726175944, "in-drivable-lane": 0, "agent_compute-ego": 0.1516088326772054, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.08953906695048014, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.03587956428527832, "sim_compute_performance-ego": 0.06961519983079699, "sim_compute_robot_state-ego": 0.07507796817355686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11611596138580986, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.060181698073511536, "in-drivable-lane": 0, "agent_compute-ego": 0.14618242564408676, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.09499551679777064, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03717668937600177, "sim_compute_performance-ego": 0.06602180781571762, "sim_compute_robot_state-ego": 0.07219863715379135}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.10909207988547408, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.060623717634645226, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.14985497465961056, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.09445121299186254, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.03808541929340798, "sim_compute_performance-ego": 0.06866756748391069, "sim_compute_robot_state-ego": 0.07370833719157738}}set_robot_commands_max 0.09499551679777064 set_robot_commands_mean 0.09217517041932484 set_robot_commands_median 0.09123517104557582 set_robot_commands_min 0.08953906695048014 sim_compute_performance-ego_max 0.06961519983079699 sim_compute_performance-ego_mean 0.06696996685790975 sim_compute_performance-ego_median 0.06643757202642427 sim_compute_performance-ego_min 0.06410768713269915 sim_compute_robot_state-ego_max 0.07507796817355686 sim_compute_robot_state-ego_mean 0.07167673655093063 sim_compute_robot_state-ego_median 0.07219863715379135 sim_compute_robot_state-ego_min 0.06720209293228259 sim_compute_sim_state_max 0.03808541929340798 sim_compute_sim_state_mean 0.03640511359010156 sim_compute_sim_state_median 0.03587956428527832 sim_compute_sim_state_min 0.03507423400878906 sim_physics_max 0.11611596138580986 sim_physics_mean 0.10730629015018468 sim_physics_median 0.10909207988547408 sim_physics_min 0.09852274485996793 sim_render-ego_max 0.06449891726175944 sim_render-ego_mean 0.06027473544085695 sim_render-ego_median 0.060181698073511536 sim_render-ego_min 0.057476769174848286 simulation-passed 1 survival_time_max 10.95000000000002 survival_time_mean 6.349999999999996 survival_time_min 2.25
No reset possible 213462385Andrea Censi Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-28 00:30:52+00:00 2019-04-28 01:00:09+00:00 0:29:17 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2385/step1-simulation-ip-172-31-40-253-32125-job21346/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 213342399Liam Paull random_agent aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-28 00:00:31+00:00 2019-04-28 00:30:12+00:00 0:29:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6537162971975778 survival_time_median 2.5999999999999988 deviation-center-line_median 0.14884708769804722 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.15114989647498497 agent_compute-ego_mean 0.13482675077292233 agent_compute-ego_median 0.13291018486022949 agent_compute-ego_min 0.12109562415110914 deviation-center-line_max 0.5141120095458062 deviation-center-line_mean 0.1769000227005324 deviation-center-line_min 0.06216029860587694 deviation-heading_max 1.9929437250081896 deviation-heading_mean 0.692977823395608 deviation-heading_median 0.4928440244444201 deviation-heading_min 0.24234723632033853 driven_any_max 3.5343244022418343 driven_any_mean 1.3470385992234175 driven_any_median 1.001633421251194 driven_any_min 0.3412551960104244 driven_lanedir_consec_max 2.494308053441959 driven_lanedir_consec_mean 0.881391085527715 driven_lanedir_consec_min 0.3199180625488627 driven_lanedir_max 2.494308053441959 driven_lanedir_mean 0.8962528018383226 driven_lanedir_median 0.7206363324756615 driven_lanedir_min 0.3199180625488627 in-drivable-lane_max 3.549999999999991 in-drivable-lane_mean 0.839999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.17561349084105674, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06398229055766817, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.12109562415110914, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.08108053629911399, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03300768212427067, "sim_compute_performance-ego": 0.059969500650333456, "sim_compute_robot_state-ego": 0.06808197951015038, "sim_compute_robot_state-npc0": 0.05924034722243683, "sim_compute_robot_state-npc1": 0.059071450293818606, "sim_compute_robot_state-npc2": 0.060856755775741386, "sim_compute_robot_state-npc3": 0.06164677233635625}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.18581350360597884, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05794180291039603, "in-drivable-lane": 0, "agent_compute-ego": 0.1320920671735491, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0962593640599932, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03649822303227016, "sim_compute_performance-ego": 0.0649383578981672, "sim_compute_robot_state-ego": 0.06834919112069267, "sim_compute_robot_state-npc0": 0.0718993970326015, "sim_compute_robot_state-npc1": 0.06867398534502302, "sim_compute_robot_state-npc2": 0.06595449788229805, "sim_compute_robot_state-npc3": 0.06802350282669067}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19280323241520853, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.059508089880341467, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.132220050663624, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09340933225687267, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03794466639028012, "sim_compute_performance-ego": 0.06675911412655729, "sim_compute_robot_state-ego": 0.07230917921344053, "sim_compute_robot_state-npc0": 0.07071140900398921, "sim_compute_robot_state-npc1": 0.07105851173400879, "sim_compute_robot_state-npc2": 0.06921356164135979, "sim_compute_robot_state-npc3": 0.06843996973871028}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2089587201674779, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06374443074067433, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.12971621751785278, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0917343298594157, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03756953279177347, "sim_compute_performance-ego": 0.07101211945215861, "sim_compute_robot_state-ego": 0.07669590910275777, "sim_compute_robot_state-npc0": 0.0699125627676646, "sim_compute_robot_state-npc1": 0.0679185042778651, "sim_compute_robot_state-npc2": 0.06717832883199056, "sim_compute_robot_state-npc3": 0.06666436791419983}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.19741393270946683, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06301366715204149, "in-drivable-lane": 0, "agent_compute-ego": 0.1353632609049479, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09028853688921248, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.036341281164260136, "sim_compute_performance-ego": 0.07046403203691755, "sim_compute_robot_state-ego": 0.06909851800827753, "sim_compute_robot_state-npc0": 0.0635295141310919, "sim_compute_robot_state-npc1": 0.06662592433747791, "sim_compute_robot_state-npc2": 0.07086787905011858, "sim_compute_robot_state-npc3": 0.06918013663518996}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.19323989588343457, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06289618315097101, "in-drivable-lane": 2, "agent_compute-ego": 0.13569683086372422, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09453382035215456, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.0387260571211398, "sim_compute_performance-ego": 0.0698616518945751, "sim_compute_robot_state-ego": 0.0761165633173046, "sim_compute_robot_state-npc0": 0.06806127325503412, "sim_compute_robot_state-npc1": 0.07064292530813616, "sim_compute_robot_state-npc2": 0.0696133439412374, "sim_compute_robot_state-npc3": 0.0686379549746028}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.21628674488623165, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06279193313376417, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14011706657780026, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09138664227087522, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03992162630395982, "sim_compute_performance-ego": 0.06968509340749203, "sim_compute_robot_state-ego": 0.07614261664233161, "sim_compute_robot_state-npc0": 0.07010190926709221, "sim_compute_robot_state-npc1": 0.07023997677182689, "sim_compute_robot_state-npc2": 0.0680023373909367, "sim_compute_robot_state-npc3": 0.07121008808173022}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20790924072265624, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06300198078155518, "in-drivable-lane": 0, "agent_compute-ego": 0.1322020959854126, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.08698347091674805, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03789256095886231, "sim_compute_performance-ego": 0.06789017200469971, "sim_compute_robot_state-ego": 0.07237288475036621, "sim_compute_robot_state-npc0": 0.06497250080108642, "sim_compute_robot_state-npc1": 0.06536226749420165, "sim_compute_robot_state-npc2": 0.06784489631652832, "sim_compute_robot_state-npc3": 0.07006743431091308}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.18567900015757635, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06029587525587816, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12837364581915048, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.0902456732896658, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03814481313412006, "sim_compute_performance-ego": 0.0703737735748291, "sim_compute_robot_state-ego": 0.07445109807527982, "sim_compute_robot_state-npc0": 0.07192967029718253, "sim_compute_robot_state-npc1": 0.06668791404137245, "sim_compute_robot_state-npc2": 0.06565371843484732, "sim_compute_robot_state-npc3": 0.06862121361952561}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.27070430608896107, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.07141716663654034, "in-drivable-lane": 0, "agent_compute-ego": 0.15114989647498497, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.10418718594771165, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.042035038654620833, "sim_compute_performance-ego": 0.08003764886122483, "sim_compute_robot_state-ego": 0.08677478020007794, "sim_compute_robot_state-npc0": 0.07525769563821647, "sim_compute_robot_state-npc1": 0.07667909218714787, "sim_compute_robot_state-npc2": 0.07365601796370286, "sim_compute_robot_state-npc3": 0.07547548184028038}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.22193823077461936, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.0686413049697876, "in-drivable-lane": 0, "agent_compute-ego": 0.14683689854361795, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.1001435626636852, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04097941788760098, "sim_compute_performance-ego": 0.0736833702434193, "sim_compute_robot_state-ego": 0.0764123418114402, "sim_compute_robot_state-npc0": 0.0748552842573686, "sim_compute_robot_state-npc1": 0.0682172341780229, "sim_compute_robot_state-npc2": 0.0691551837054166, "sim_compute_robot_state-npc3": 0.07013238560069691}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1918519926071167, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06179065704345703, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13291018486022949, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0976619338989258, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.039887094497680665, "sim_compute_performance-ego": 0.06981547355651856, "sim_compute_robot_state-ego": 0.07466034412384033, "sim_compute_robot_state-npc0": 0.06846713066101075, "sim_compute_robot_state-npc1": 0.07562778949737549, "sim_compute_robot_state-npc2": 0.06987014770507813, "sim_compute_robot_state-npc3": 0.07006383419036866}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.19389288983446487, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06110055142260613, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.13671383451908192, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09215442677761644, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04025637849848321, "sim_compute_performance-ego": 0.06705159836627067, "sim_compute_robot_state-ego": 0.07207837003342649, "sim_compute_robot_state-npc0": 0.0663407914181973, "sim_compute_robot_state-npc1": 0.06527008908860227, "sim_compute_robot_state-npc2": 0.06798809893587802, "sim_compute_robot_state-npc3": 0.06886858889397154}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.18844950199127197, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.062709968823653, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.12988098768087533, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0925736381457402, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03967026105293861, "sim_compute_performance-ego": 0.07024165758719811, "sim_compute_robot_state-ego": 0.07111872618014996, "sim_compute_robot_state-npc0": 0.06728297013502854, "sim_compute_robot_state-npc1": 0.07008628203318669, "sim_compute_robot_state-npc2": 0.0714947168643658, "sim_compute_robot_state-npc3": 0.07062290265009953}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1933207738967169, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06496306373959496, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.13803259985787528, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09735635802859352, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03869100979396275, "sim_compute_performance-ego": 0.07095450219653901, "sim_compute_robot_state-ego": 0.07447023391723633, "sim_compute_robot_state-npc0": 0.0719163145337786, "sim_compute_robot_state-npc1": 0.07196256546747117, "sim_compute_robot_state-npc2": 0.07059694017682756, "sim_compute_robot_state-npc3": 0.07027126720973424}}set_robot_commands_max 0.10418718594771165 set_robot_commands_mean 0.09333325411042163 set_robot_commands_median 0.0925736381457402 set_robot_commands_min 0.08108053629911399 sim_compute_performance-ego_max 0.08003764886122483 sim_compute_performance-ego_mean 0.0695158710571267 sim_compute_performance-ego_median 0.0698616518945751 sim_compute_performance-ego_min 0.059969500650333456 sim_compute_robot_state-ego_max 0.08677478020007794 sim_compute_robot_state-ego_mean 0.0739421824004515 sim_compute_robot_state-ego_median 0.07445109807527982 sim_compute_robot_state-ego_min 0.06808197951015038 sim_compute_robot_state-npc0_max 0.07525769563821647 sim_compute_robot_state-npc0_mean 0.06896525136145198 sim_compute_robot_state-npc0_median 0.0699125627676646 sim_compute_robot_state-npc0_min 0.05924034722243683 sim_compute_robot_state-npc1_max 0.07667909218714787 sim_compute_robot_state-npc1_mean 0.06894163413703579 sim_compute_robot_state-npc1_median 0.06867398534502302 sim_compute_robot_state-npc1_min 0.059071450293818606 sim_compute_robot_state-npc2_max 0.07365601796370286 sim_compute_robot_state-npc2_mean 0.06852976164108847 sim_compute_robot_state-npc2_median 0.0691551837054166 sim_compute_robot_state-npc2_min 0.060856755775741386 sim_compute_robot_state-npc3_max 0.07547548184028038 sim_compute_robot_state-npc3_mean 0.06919506005487133 sim_compute_robot_state-npc3_median 0.06918013663518996 sim_compute_robot_state-npc3_min 0.06164677233635625 sim_compute_sim_state_max 0.042035038654620833 sim_compute_sim_state_mean 0.03850437622708157 sim_compute_sim_state_median 0.03869100979396275 sim_compute_sim_state_min 0.03300768212427067 sim_physics_max 0.27070430608896107 sim_physics_mean 0.20159169710548255 sim_physics_median 0.1933207738967169 sim_physics_min 0.17561349084105674 sim_render-ego_max 0.07141716663654034 sim_render-ego_mean 0.06318659774659527 sim_render-ego_median 0.06289618315097101 sim_render-ego_min 0.05794180291039603 simulation-passed 1 survival_time_max 8.349999999999984 survival_time_mean 3.3333333333333286 survival_time_min 1.0500000000000005
No reset possible 213102410jiang peng Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 23:00:17+00:00 2019-04-28 00:00:08+00:00 0:59:51 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2410/step1-simulation-ip-172-31-40-253-32125-job21310/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 212972420Andrea Censi random_agent aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 22:39:58+00:00 2019-04-27 23:00:03+00:00 0:20:05 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1179, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1226, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2420/step1-simulation-ip-172-31-40-253-32125-job21297/tmp/tmpr62x9gak/episodes/ETHZ_autolab_technical_track-0-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 212772451Nicky Eichmann Baseline solution using reinforcement learning aido2-LFVI-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 22:00:35+00:00 2019-04-27 22:39:13+00:00 0:38:38 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.339803295303147 survival_time_median 14.950000000000076 deviation-center-line_median 1.0021347592871723 in-drivable-lane_median 4.050000000000024
other stats agent_compute-ego_max 0.17758076747258503 agent_compute-ego_mean 0.172267670472463 agent_compute-ego_median 0.17029441833496095 agent_compute-ego_min 0.16879486163457236 deviation-center-line_max 1.5296442281508644 deviation-center-line_mean 0.9253718574185378 deviation-center-line_min 0.2826196070981827 deviation-heading_max 8.558153948461719 deviation-heading_mean 7.098260242116498 deviation-heading_median 7.090641611385008 deviation-heading_min 5.695926383403844 driven_any_max 4.3785064440528245 driven_any_mean 4.378506444052816 driven_any_median 4.378506444052819 driven_any_min 4.378506444052804 driven_lanedir_consec_max -1.272834629261013 driven_lanedir_consec_mean -1.3313573411979192 driven_lanedir_consec_min -1.3670060414727203 driven_lanedir_max -1.366266842110191 driven_lanedir_mean -2.078204689886424 driven_lanedir_median -2.260643253811775 driven_lanedir_min -2.710754983563031 in-drivable-lane_max 7.400000000000039 in-drivable-lane_mean 4.620000000000026 in-drivable-lane_min 2.150000000000011 per-episodes details {"udem1-0-0": {"driven_any": 4.378506444052811, "sim_physics": 0.203141983350118, "survival_time": 14.950000000000076, "driven_lanedir": -2.710754983563031, "sim_render-ego": 0.06208456516265869, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.16879486163457236, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09466029485066732, "deviation-center-line": 1.5195321584534802, "driven_lanedir_consec": -1.3108758978425243, "sim_compute_sim_state": 0.037478826840718585, "sim_compute_performance-ego": 0.06770330746968588, "sim_compute_robot_state-ego": 0.07313406626383463, "sim_compute_robot_state-npc0": 0.06960581382115683, "sim_compute_robot_state-npc1": 0.06809587399164836, "sim_compute_robot_state-npc2": 0.06767730951309205, "sim_compute_robot_state-npc3": 0.06636643091837566}, "udem1-1-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.203884060382843, "survival_time": 14.950000000000076, "driven_lanedir": -2.686352328474403, "sim_render-ego": 0.06407248099644978, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.17006123622258504, "deviation-heading": 8.558153948461719, "set_robot_commands": 0.09518556753794352, "deviation-center-line": 1.5296442281508644, "driven_lanedir_consec": -1.272834629261013, "sim_compute_sim_state": 0.03788942019144694, "sim_compute_performance-ego": 0.0678753678003947, "sim_compute_robot_state-ego": 0.07465665737787883, "sim_compute_robot_state-npc0": 0.06761240720748901, "sim_compute_robot_state-npc1": 0.06746689478556316, "sim_compute_robot_state-npc2": 0.06767552455266317, "sim_compute_robot_state-npc3": 0.06802085320154826}, "udem1-2-0": {"driven_any": 4.378506444052804, "sim_physics": 0.20752505222956336, "survival_time": 14.950000000000076, "driven_lanedir": -1.366266842110191, "sim_render-ego": 0.06365104993184408, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.1746070686976115, "deviation-heading": 5.773684892471283, "set_robot_commands": 0.09430215120315552, "deviation-center-line": 0.29292853410298886, "driven_lanedir_consec": -1.366266842110191, "sim_compute_sim_state": 0.038837127685546875, "sim_compute_performance-ego": 0.07072963078816731, "sim_compute_robot_state-ego": 0.07656989494959514, "sim_compute_robot_state-npc0": 0.06843528906504313, "sim_compute_robot_state-npc1": 0.06917525370915731, "sim_compute_robot_state-npc2": 0.06873882452646891, "sim_compute_robot_state-npc3": 0.06913760185241699}, "udem1-3-0": {"driven_any": 4.3785064440528245, "sim_physics": 0.21079436620076497, "survival_time": 14.950000000000076, "driven_lanedir": -1.3670060414727203, "sim_render-ego": 0.06595102707544963, "in-drivable-lane": 7.400000000000039, "agent_compute-ego": 0.17758076747258503, "deviation-heading": 5.695926383403844, "set_robot_commands": 0.09798405170440674, "deviation-center-line": 0.2826196070981827, "driven_lanedir_consec": -1.3670060414727203, "sim_compute_sim_state": 0.03944645484288534, "sim_compute_performance-ego": 0.0706774107615153, "sim_compute_robot_state-ego": 0.07665729920069377, "sim_compute_robot_state-npc0": 0.07009818871816, "sim_compute_robot_state-npc1": 0.07105316400527954, "sim_compute_robot_state-npc2": 0.06973730166753134, "sim_compute_robot_state-npc3": 0.0698374080657959}, "udem1-4-0": {"driven_any": 4.378506444052819, "sim_physics": 0.20174871603647868, "survival_time": 14.950000000000076, "driven_lanedir": -2.260643253811775, "sim_render-ego": 0.06294791062672933, "in-drivable-lane": 4.050000000000024, "agent_compute-ego": 0.17029441833496095, "deviation-heading": 7.090641611385008, "set_robot_commands": 0.09753276109695434, "deviation-center-line": 1.0021347592871723, "driven_lanedir_consec": -1.339803295303147, "sim_compute_sim_state": 0.04025226593017578, "sim_compute_performance-ego": 0.06899211883544921, "sim_compute_robot_state-ego": 0.07599391222000122, "sim_compute_robot_state-npc0": 0.06871889352798462, "sim_compute_robot_state-npc1": 0.06976297775904337, "sim_compute_robot_state-npc2": 0.07100912809371948, "sim_compute_robot_state-npc3": 0.07048407793045045}}set_robot_commands_max 0.09798405170440674 set_robot_commands_mean 0.09593296527862548 set_robot_commands_median 0.09518556753794352 set_robot_commands_min 0.09430215120315552 sim_compute_performance-ego_max 0.07072963078816731 sim_compute_performance-ego_mean 0.06919556713104248 sim_compute_performance-ego_median 0.06899211883544921 sim_compute_performance-ego_min 0.06770330746968588 sim_compute_robot_state-ego_max 0.07665729920069377 sim_compute_robot_state-ego_mean 0.07540236600240072 sim_compute_robot_state-ego_median 0.07599391222000122 sim_compute_robot_state-ego_min 0.07313406626383463 sim_compute_robot_state-npc0_max 0.07009818871816 sim_compute_robot_state-npc0_mean 0.06889411846796671 sim_compute_robot_state-npc0_median 0.06871889352798462 sim_compute_robot_state-npc0_min 0.06761240720748901 sim_compute_robot_state-npc1_max 0.07105316400527954 sim_compute_robot_state-npc1_mean 0.06911083285013835 sim_compute_robot_state-npc1_median 0.06917525370915731 sim_compute_robot_state-npc1_min 0.06746689478556316 sim_compute_robot_state-npc2_max 0.07100912809371948 sim_compute_robot_state-npc2_mean 0.068967617670695 sim_compute_robot_state-npc2_median 0.06873882452646891 sim_compute_robot_state-npc2_min 0.06767552455266317 sim_compute_robot_state-npc3_max 0.07048407793045045 sim_compute_robot_state-npc3_mean 0.06876927439371745 sim_compute_robot_state-npc3_median 0.06913760185241699 sim_compute_robot_state-npc3_min 0.06636643091837566 sim_compute_sim_state_max 0.04025226593017578 sim_compute_sim_state_mean 0.0387808190981547 sim_compute_sim_state_median 0.038837127685546875 sim_compute_sim_state_min 0.037478826840718585 sim_physics_max 0.21079436620076497 sim_physics_mean 0.2054188356399536 sim_physics_median 0.203884060382843 sim_physics_min 0.20174871603647868 sim_render-ego_max 0.06595102707544963 sim_render-ego_mean 0.0637414067586263 sim_render-ego_median 0.06365104993184408 sim_render-ego_min 0.06208456516265869 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 212692446Nicky Eichmann Baseline solution using reinforcement learning aido2-LF-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 21:50:53+00:00 2019-04-27 22:00:05+00:00 0:09:12 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-32125-job21269/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 212142698Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 21:02:57+00:00 2019-04-27 21:50:33+00:00 0:47:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4878975189904211 survival_time_median 3.699999999999995 deviation-center-line_median 0.2792429083881596 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.09743229618156532 agent_compute-ego_mean 0.08101935793871223 agent_compute-ego_median 0.08110137232418718 agent_compute-ego_min 0.07168565710929975 deviation-center-line_max 1.0747264973139123 deviation-center-line_mean 0.4240960541601113 deviation-center-line_min 0.12752675513551276 deviation-heading_max 7.077108283739539 deviation-heading_mean 2.169556983940427 deviation-heading_median 1.1318560642289706 deviation-heading_min 0.4652867569783595 driven_any_max 2.3485836140930574 driven_any_mean 0.8746172920577286 driven_any_median 0.5410011518959885 driven_any_min 0.22759295601088403 driven_lanedir_consec_max 1.390931506293643 driven_lanedir_consec_mean 0.5412214513570281 driven_lanedir_consec_min 0.17808928546947866 driven_lanedir_max 1.7259898823655082 driven_lanedir_mean 0.6682432423273608 driven_lanedir_median 0.4878975189904211 driven_lanedir_min 0.19901987486126593 in-drivable-lane_max 4.400000000000036 in-drivable-lane_mean 0.5633333333333357 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 0.6847010777030386, "sim_physics": 0.23024836246003497, "survival_time": 4.699999999999991, "driven_lanedir": 0.41342648224236744, "sim_render-ego": 0.0666137604003257, "in-drivable-lane": 0.6999999999999986, "agent_compute-ego": 0.08202886074147325, "deviation-heading": 2.2885615805360615, "set_robot_commands": 0.100890540062113, "deviation-center-line": 0.372561255360072, "driven_lanedir_consec": 0.17808928546947866, "sim_compute_sim_state": 0.04190477665434492, "sim_compute_performance-ego": 0.07214814551333164, "sim_compute_robot_state-ego": 0.07691531485699593, "sim_compute_robot_state-npc0": 0.07344888879897747, "sim_compute_robot_state-npc1": 0.07094835727772814, "sim_compute_robot_state-npc2": 0.07355243094423984, "sim_compute_robot_state-npc3": 0.07270910131170395}, "udem1-1-0": {"driven_any": 0.27580289776644235, "sim_physics": 0.2042763872844417, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2154561828969488, "sim_render-ego": 0.06925706165592845, "in-drivable-lane": 0, "agent_compute-ego": 0.0796183144173971, "deviation-heading": 1.1318560642289706, "set_robot_commands": 0.09611747323012934, "deviation-center-line": 0.12752675513551276, "driven_lanedir_consec": 0.2154561828969488, "sim_compute_sim_state": 0.041061552559457176, "sim_compute_performance-ego": 0.07018593462502085, "sim_compute_robot_state-ego": 0.07749863368708913, "sim_compute_robot_state-npc0": 0.07217432231437869, "sim_compute_robot_state-npc1": 0.06903917615006609, "sim_compute_robot_state-npc2": 0.06621800980916838, "sim_compute_robot_state-npc3": 0.06753489447803032}, "udem1-2-0": {"driven_any": 0.7338432667233183, "sim_physics": 0.23415969829170072, "survival_time": 4.899999999999991, "driven_lanedir": 0.7129389700771076, "sim_render-ego": 0.0674019176132825, "in-drivable-lane": 0, "agent_compute-ego": 0.08011274921650789, "deviation-heading": 0.9364955169078832, "set_robot_commands": 0.09838234891696852, "deviation-center-line": 0.5309100765129598, "driven_lanedir_consec": 0.7129389700771076, "sim_compute_sim_state": 0.040153544776293695, "sim_compute_performance-ego": 0.07513873674431626, "sim_compute_robot_state-ego": 0.08100939770134127, "sim_compute_robot_state-npc0": 0.07054049141552983, "sim_compute_robot_state-npc1": 0.07149874920747717, "sim_compute_robot_state-npc2": 0.06979912397812824, "sim_compute_robot_state-npc3": 0.07321757199812909}, "udem1-3-0": {"driven_any": 0.4124261213163431, "sim_physics": 0.22550912972154288, "survival_time": 2.8999999999999977, "driven_lanedir": 0.40303745482711584, "sim_render-ego": 0.06853432901974382, "in-drivable-lane": 0, "agent_compute-ego": 0.08110137232418718, "deviation-heading": 0.4652867569783595, "set_robot_commands": 0.09852720951211864, "deviation-center-line": 0.29709848498943614, "driven_lanedir_consec": 0.40303745482711584, "sim_compute_sim_state": 0.04112464395062677, "sim_compute_performance-ego": 0.07221249876351192, "sim_compute_robot_state-ego": 0.07914929554380219, "sim_compute_robot_state-npc0": 0.0698011168118181, "sim_compute_robot_state-npc1": 0.07125834349928231, "sim_compute_robot_state-npc2": 0.07002738837538094, "sim_compute_robot_state-npc3": 0.06973575312515785}, "udem1-4-0": {"driven_any": 2.0756965818282698, "sim_physics": 0.2089327983136447, "survival_time": 13.250000000000052, "driven_lanedir": 1.7259898823655082, "sim_render-ego": 0.06676686304920125, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08192581680585753, "deviation-heading": 5.716646459298363, "set_robot_commands": 0.10312750564431244, "deviation-center-line": 1.0747264973139123, "driven_lanedir_consec": 1.390931506293643, "sim_compute_sim_state": 0.04151124234469432, "sim_compute_performance-ego": 0.07530648753328144, "sim_compute_robot_state-ego": 0.08027364173025456, "sim_compute_robot_state-npc0": 0.07406804696568903, "sim_compute_robot_state-npc1": 0.07425896356690605, "sim_compute_robot_state-npc2": 0.07489817997194687, "sim_compute_robot_state-npc3": 0.07425760323146605}, "udem1-5-0": {"driven_any": 1.770242733833722, "sim_physics": 0.22024351174610823, "survival_time": 11.350000000000026, "driven_lanedir": 1.3374757899894223, "sim_render-ego": 0.06749584181193213, "in-drivable-lane": 0.9000000000000041, "agent_compute-ego": 0.09743229618156532, "deviation-heading": 4.797079472159773, "set_robot_commands": 0.1023301647623205, "deviation-center-line": 0.8785614475115767, "driven_lanedir_consec": 0.6067178855192505, "sim_compute_sim_state": 0.0410834009951957, "sim_compute_performance-ego": 0.0729565988028102, "sim_compute_robot_state-ego": 0.08183330481272962, "sim_compute_robot_state-npc0": 0.07312928422432113, "sim_compute_robot_state-npc1": 0.07340182921959965, "sim_compute_robot_state-npc2": 0.07307280212772051, "sim_compute_robot_state-npc3": 0.08229317329003422}, "udem1-6-0": {"driven_any": 1.4088213721703489, "sim_physics": 0.22226279646485717, "survival_time": 9.099999999999994, "driven_lanedir": 1.312748034545511, "sim_render-ego": 0.06436505553486584, "in-drivable-lane": 0, "agent_compute-ego": 0.07774692184322483, "deviation-heading": 2.66850745102207, "set_robot_commands": 0.09948031980912764, "deviation-center-line": 0.7353242781678043, "driven_lanedir_consec": 1.3077571851546488, "sim_compute_sim_state": 0.04125065724928301, "sim_compute_performance-ego": 0.0729157308955769, "sim_compute_robot_state-ego": 0.07777958649855393, "sim_compute_robot_state-npc0": 0.07260989749824608, "sim_compute_robot_state-npc1": 0.07217727781652095, "sim_compute_robot_state-npc2": 0.07370614874493944, "sim_compute_robot_state-npc3": 0.07130238774058582}, "udem1-7-0": {"driven_any": 0.5329699785722835, "sim_physics": 0.19352059494959165, "survival_time": 3.649999999999995, "driven_lanedir": 0.4715320639823852, "sim_render-ego": 0.06097483308347937, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07168565710929975, "deviation-heading": 1.214087374854396, "set_robot_commands": 0.08447069337923233, "deviation-center-line": 0.15761774120379077, "driven_lanedir_consec": 0.4715320639823852, "sim_compute_sim_state": 0.035931211628326, "sim_compute_performance-ego": 0.06309993299719406, "sim_compute_robot_state-ego": 0.06560191389632551, "sim_compute_robot_state-npc0": 0.06363397755034983, "sim_compute_robot_state-npc1": 0.06194218217510067, "sim_compute_robot_state-npc2": 0.06194051977706282, "sim_compute_robot_state-npc3": 0.06570638042606719}, "udem1-8-0": {"driven_any": 2.3485836140930574, "sim_physics": 0.20504639943440756, "survival_time": 14.950000000000076, "driven_lanedir": 1.1813184935985008, "sim_render-ego": 0.06448144992192587, "in-drivable-lane": 4.400000000000036, "agent_compute-ego": 0.08861807743708293, "deviation-heading": 7.077108283739539, "set_robot_commands": 0.0982005794843038, "deviation-center-line": 0.932604892324344, "driven_lanedir_consec": 0.6430264862986768, "sim_compute_sim_state": 0.04185766776402791, "sim_compute_performance-ego": 0.06870257139205932, "sim_compute_robot_state-ego": 0.07789751132329305, "sim_compute_robot_state-npc0": 0.06985198179880778, "sim_compute_robot_state-npc1": 0.06937778393427531, "sim_compute_robot_state-npc2": 0.07045893828074137, "sim_compute_robot_state-npc3": 0.07128286918004353}, "udem1-9-0": {"driven_any": 0.5410011518959885, "sim_physics": 0.2622815016153696, "survival_time": 3.699999999999995, "driven_lanedir": 0.5165952647151523, "sim_render-ego": 0.06977129626918484, "in-drivable-lane": 0, "agent_compute-ego": 0.08299991891190812, "deviation-heading": 0.9622578067474432, "set_robot_commands": 0.1035729098964382, "deviation-center-line": 0.2792429083881596, "driven_lanedir_consec": 0.5165952647151523, "sim_compute_sim_state": 0.04271176054671004, "sim_compute_performance-ego": 0.07477204219715015, "sim_compute_robot_state-ego": 0.08483413747839026, "sim_compute_robot_state-npc0": 0.07357322203146445, "sim_compute_robot_state-npc1": 0.07385774560876794, "sim_compute_robot_state-npc2": 0.07576874784521155, "sim_compute_robot_state-npc3": 0.07212566040657661}, "udem1-10-0": {"driven_any": 0.5088702393806737, "sim_physics": 0.20343189239501952, "survival_time": 3.4999999999999956, "driven_lanedir": 0.49456213701977225, "sim_render-ego": 0.06432121481214251, "in-drivable-lane": 0, "agent_compute-ego": 0.07430761541639055, "deviation-heading": 0.8023629772469781, "set_robot_commands": 0.09523625033242362, "deviation-center-line": 0.24904394601214777, "driven_lanedir_consec": 0.49456213701977225, "sim_compute_sim_state": 0.04024928637913295, "sim_compute_performance-ego": 0.07034611361367361, "sim_compute_robot_state-ego": 0.07542426926749093, "sim_compute_robot_state-npc0": 0.06890828609466552, "sim_compute_robot_state-npc1": 0.06923983778272357, "sim_compute_robot_state-npc2": 0.07001099245888846, "sim_compute_robot_state-npc3": 0.07193687302725656}, "udem1-11-0": {"driven_any": 0.267764688010751, "sim_physics": 0.20121302008628844, "survival_time": 2.000000000000001, "driven_lanedir": 0.2494100006579436, "sim_render-ego": 0.06813135743141174, "in-drivable-lane": 0, "agent_compute-ego": 0.08233171105384826, "deviation-heading": 0.5036417042654908, "set_robot_commands": 0.09897263646125794, "deviation-center-line": 0.1767387359669518, "driven_lanedir_consec": 0.2494100006579436, "sim_compute_sim_state": 0.04000703692436218, "sim_compute_performance-ego": 0.07230669856071473, "sim_compute_robot_state-ego": 0.07589067816734314, "sim_compute_robot_state-npc0": 0.07130052447319031, "sim_compute_robot_state-npc1": 0.06831561923027038, "sim_compute_robot_state-npc2": 0.0687574326992035, "sim_compute_robot_state-npc3": 0.07369110584259034}, "udem1-12-0": {"driven_any": 0.5249380226866707, "sim_physics": 0.21770279275046456, "survival_time": 3.599999999999995, "driven_lanedir": 0.4878975189904211, "sim_render-ego": 0.06583684351709154, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07736744814448887, "deviation-heading": 1.0545271198156572, "set_robot_commands": 0.10518177019225226, "deviation-center-line": 0.2450545113059586, "driven_lanedir_consec": 0.4878975189904211, "sim_compute_sim_state": 0.039982000986735024, "sim_compute_performance-ego": 0.06964347428745693, "sim_compute_robot_state-ego": 0.0746235450108846, "sim_compute_robot_state-npc0": 0.0705259342988332, "sim_compute_robot_state-npc1": 0.07125816080305311, "sim_compute_robot_state-npc2": 0.0725919140709771, "sim_compute_robot_state-npc3": 0.07223990890714857}, "udem1-13-0": {"driven_any": 0.22759295601088403, "sim_physics": 0.19038219451904295, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19901987486126593, "sim_render-ego": 0.06160041264125279, "in-drivable-lane": 0, "agent_compute-ego": 0.07652619225638253, "deviation-heading": 0.5573709084582352, "set_robot_commands": 0.0970571654183524, "deviation-center-line": 0.1369421233443076, "driven_lanedir_consec": 0.19901987486126593, "sim_compute_sim_state": 0.03473574774605887, "sim_compute_performance-ego": 0.06877775192260742, "sim_compute_robot_state-ego": 0.06772114889962333, "sim_compute_robot_state-npc0": 0.06461094447544642, "sim_compute_robot_state-npc1": 0.06406654630388532, "sim_compute_robot_state-npc2": 0.0643542902810233, "sim_compute_robot_state-npc3": 0.06178030286516462}, "udem1-14-0": {"driven_any": 0.8060046788741394, "sim_physics": 0.2129626407801548, "survival_time": 5.349999999999989, "driven_lanedir": 0.30224048414099025, "sim_render-ego": 0.0636466663574504, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.08148741722106934, "deviation-heading": 2.367565282847181, "set_robot_commands": 0.09795792303352711, "deviation-center-line": 0.16748715886473503, "driven_lanedir_consec": 0.24134995359161304, "sim_compute_sim_state": 0.037074933542269414, "sim_compute_performance-ego": 0.06841133242455598, "sim_compute_robot_state-ego": 0.07790180678679565, "sim_compute_robot_state-npc0": 0.06680453826333875, "sim_compute_robot_state-npc1": 0.06771811815065758, "sim_compute_robot_state-npc2": 0.08412372063253527, "sim_compute_robot_state-npc3": 0.06953450229680427}}set_robot_commands_max 0.10518177019225226 set_robot_commands_mean 0.09863369934232516 set_robot_commands_median 0.09852720951211864 set_robot_commands_min 0.08447069337923233 sim_compute_performance-ego_max 0.07530648753328144 sim_compute_performance-ego_mean 0.07112827001821742 sim_compute_performance-ego_median 0.07214814551333164 sim_compute_performance-ego_min 0.06309993299719406 sim_compute_robot_state-ego_max 0.08483413747839026 sim_compute_robot_state-ego_mean 0.07695694571072755 sim_compute_robot_state-ego_median 0.07777958649855393 sim_compute_robot_state-ego_min 0.06560191389632551 sim_compute_robot_state-npc0_max 0.07406804696568903 sim_compute_robot_state-npc0_mean 0.07033209713433711 sim_compute_robot_state-npc0_median 0.07054049141552983 sim_compute_robot_state-npc0_min 0.06363397755034983 sim_compute_robot_state-npc1_max 0.07425896356690605 sim_compute_robot_state-npc1_mean 0.06989057938175429 sim_compute_robot_state-npc1_median 0.07094835727772814 sim_compute_robot_state-npc1_min 0.06194218217510067 sim_compute_robot_state-npc2_max 0.08412372063253527 sim_compute_robot_state-npc2_mean 0.07128537599981118 sim_compute_robot_state-npc2_median 0.07045893828074137 sim_compute_robot_state-npc2_min 0.06194051977706282 sim_compute_robot_state-npc3_max 0.08229317329003422 sim_compute_robot_state-npc3_mean 0.07128987254178394 sim_compute_robot_state-npc3_median 0.07193687302725656 sim_compute_robot_state-npc3_min 0.06178030286516462 sim_compute_sim_state_max 0.04271176054671004 sim_compute_sim_state_mean 0.0400426309365012 sim_compute_sim_state_median 0.041061552559457176 sim_compute_sim_state_min 0.03473574774605887 sim_physics_max 0.2622815016153696 sim_physics_mean 0.21547824805417795 sim_physics_median 0.2129626407801548 sim_physics_min 0.19038219451904295 sim_render-ego_max 0.06977129626918484 sim_render-ego_mean 0.06594659354128125 sim_render-ego_median 0.0666137604003257 sim_render-ego_min 0.06097483308347937 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 5.78333333333334 survival_time_min 1.7500000000000009
No reset possible 212002533Liam Paull baseline-IL-sim-tensorflow aido2-LFV-sim-validationstep1-simulation error no ip-172-31-40-253-321252019-04-27 21:00:18+00:00 2019-04-27 21:02:42+00:00 0:02:24 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 211952544Liam Paull challenge-aido_LF-template-ros aido2-LF-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 20:57:39+00:00 2019-04-27 21:00:10+00:00 0:02:31 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2544/step1-simulation-ip-172-31-40-253-32125-job21195/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 211812568Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 20:31:42+00:00 2019-04-27 20:57:25+00:00 0:25:43 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.07516327610722294 agent_compute-ego_mean 0.06944613232240525 agent_compute-ego_median 0.06998421986897786 agent_compute-ego_min 0.05878916452097338 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.1778366824230516, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.058051396565264965, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07025953947779644, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09006071952452142, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03462670222822442, "sim_compute_performance-ego": 0.0642927813242717, "sim_compute_robot_state-ego": 0.06745608743414822, "sim_compute_robot_state-npc0": 0.06512317600020442, "sim_compute_robot_state-npc1": 0.0650381237627512, "sim_compute_robot_state-npc2": 0.06421341666256089, "sim_compute_robot_state-npc3": 0.06159572141716279}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.21800829746105052, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06314805701926902, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07516327610722294, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10348930182280364, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03677875024301035, "sim_compute_performance-ego": 0.07009347279866536, "sim_compute_robot_state-ego": 0.07405438246550383, "sim_compute_robot_state-npc0": 0.06878553496466742, "sim_compute_robot_state-npc1": 0.07185418517501266, "sim_compute_robot_state-npc2": 0.06788604347794144, "sim_compute_robot_state-npc3": 0.06782841682434082}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.2111583275672717, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06451690808320656, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.0699384243060381, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.09720684320498736, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.03801664633628649, "sim_compute_performance-ego": 0.06799541681240766, "sim_compute_robot_state-ego": 0.07338137504382011, "sim_compute_robot_state-npc0": 0.07065566686483529, "sim_compute_robot_state-npc1": 0.06970349947611491, "sim_compute_robot_state-npc2": 0.06819346317878136, "sim_compute_robot_state-npc3": 0.06647991828429393}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.19607995267499956, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06249915507801792, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.06871585678635982, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.09465073284349944, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.037917877498425935, "sim_compute_performance-ego": 0.06126130254645096, "sim_compute_robot_state-ego": 0.06911852485255192, "sim_compute_robot_state-npc0": 0.06796082279138398, "sim_compute_robot_state-npc1": 0.06419058849937037, "sim_compute_robot_state-npc2": 0.06340808617441278, "sim_compute_robot_state-npc3": 0.06868322272049754}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.214000069576761, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06348683523095172, "in-drivable-lane": 0, "agent_compute-ego": 0.07478640390479047, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.10515645275945248, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04054763006127399, "sim_compute_performance-ego": 0.07914295403853706, "sim_compute_robot_state-ego": 0.0781245231628418, "sim_compute_robot_state-npc0": 0.07465172850567361, "sim_compute_robot_state-npc1": 0.07596727039503015, "sim_compute_robot_state-npc2": 0.07281839329263438, "sim_compute_robot_state-npc3": 0.0699805902398151}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.1911764378641166, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.057851251433877385, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.06727716969508751, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.08837540944417317, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.03574155358707204, "sim_compute_performance-ego": 0.06232998417873008, "sim_compute_robot_state-ego": 0.0676960875006283, "sim_compute_robot_state-npc0": 0.06513627837685977, "sim_compute_robot_state-npc1": 0.06395907729279761, "sim_compute_robot_state-npc2": 0.06431380907694499, "sim_compute_robot_state-npc3": 0.06347448919333663}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20287751810891289, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.061665102413722445, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07013575179236275, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09532738413129534, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03923343420028687, "sim_compute_performance-ego": 0.0678489123071943, "sim_compute_robot_state-ego": 0.07108981949942453, "sim_compute_robot_state-npc0": 0.06749692133494786, "sim_compute_robot_state-npc1": 0.06623344251087733, "sim_compute_robot_state-npc2": 0.06941651616777693, "sim_compute_robot_state-npc3": 0.07019482169832503}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.21807143786182143, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06572569886299029, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07361415314347777, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.09985033126726542, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.03905106570622693, "sim_compute_performance-ego": 0.0736852084120659, "sim_compute_robot_state-ego": 0.07619051410727305, "sim_compute_robot_state-npc0": 0.07135466680134812, "sim_compute_robot_state-npc1": 0.07226336818851836, "sim_compute_robot_state-npc2": 0.07120356167832466, "sim_compute_robot_state-npc3": 0.0711505021134468}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.16042550774507744, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.05374200399531875, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.05878916452097338, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.0765298743580663, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03343914830407431, "sim_compute_performance-ego": 0.05800333688425463, "sim_compute_robot_state-ego": 0.06524485488270604, "sim_compute_robot_state-npc0": 0.058503938275714255, "sim_compute_robot_state-npc1": 0.057945140572481374, "sim_compute_robot_state-npc2": 0.05708814776220987, "sim_compute_robot_state-npc3": 0.05903860025627669}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.230415023290194, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06625453325418326, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07320336195138785, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09951390669896051, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.037497713015629694, "sim_compute_performance-ego": 0.07102431700779842, "sim_compute_robot_state-ego": 0.08024488045619084, "sim_compute_robot_state-npc0": 0.06416840736682598, "sim_compute_robot_state-npc1": 0.06966193822713998, "sim_compute_robot_state-npc2": 0.06608796119689941, "sim_compute_robot_state-npc3": 0.07045992521139291}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.20701380093892416, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06337348937988281, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06998421986897786, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09598930676778156, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.04068425178527832, "sim_compute_performance-ego": 0.0695060380299886, "sim_compute_robot_state-ego": 0.07691895484924316, "sim_compute_robot_state-npc0": 0.0693368371327718, "sim_compute_robot_state-npc1": 0.06851851145426432, "sim_compute_robot_state-npc2": 0.06976066907246907, "sim_compute_robot_state-npc3": 0.07081933657328288}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.19055200758434476, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06278739656720843, "in-drivable-lane": 0, "agent_compute-ego": 0.07231921241396949, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.0999572617667062, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03700310843331473, "sim_compute_performance-ego": 0.06536852745782762, "sim_compute_robot_state-ego": 0.07002249218168713, "sim_compute_robot_state-npc0": 0.06686052821931385, "sim_compute_robot_state-npc1": 0.0654668580918085, "sim_compute_robot_state-npc2": 0.06840384574163527, "sim_compute_robot_state-npc3": 0.06399265925089519}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.20458396645479424, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.05979873413263365, "in-drivable-lane": 1.15, "agent_compute-ego": 0.06925243555113327, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09370598127675613, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.03792488297750784, "sim_compute_performance-ego": 0.06506408092587493, "sim_compute_robot_state-ego": 0.06899731103764024, "sim_compute_robot_state-npc0": 0.06787627242332281, "sim_compute_robot_state-npc1": 0.06469404420187307, "sim_compute_robot_state-npc2": 0.06803439938744833, "sim_compute_robot_state-npc3": 0.06745602918225665}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.19613816056932723, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06112116575241089, "in-drivable-lane": 0, "agent_compute-ego": 0.059424357754843574, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.08437738248280116, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.03557331221444266, "sim_compute_performance-ego": 0.06547806092670985, "sim_compute_robot_state-ego": 0.07163257258278984, "sim_compute_robot_state-npc0": 0.06677985191345215, "sim_compute_robot_state-npc1": 0.06543761491775513, "sim_compute_robot_state-npc2": 0.06171413830348423, "sim_compute_robot_state-npc3": 0.06619954109191895}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.23277911952897615, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06353894401999081, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.06882865756165747, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.09472211201985677, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04047778073479147, "sim_compute_performance-ego": 0.06714645086550246, "sim_compute_robot_state-ego": 0.07622837085349887, "sim_compute_robot_state-npc0": 0.07187895681343827, "sim_compute_robot_state-npc1": 0.07101863505793553, "sim_compute_robot_state-npc2": 0.07158695950227625, "sim_compute_robot_state-npc3": 0.07008717574325263}}set_robot_commands_max 0.10515645275945248 set_robot_commands_mean 0.09459420002459512 set_robot_commands_median 0.09532738413129534 set_robot_commands_min 0.0765298743580663 sim_compute_performance-ego_max 0.07914295403853706 sim_compute_performance-ego_mean 0.06721605630108529 sim_compute_performance-ego_median 0.06714645086550246 sim_compute_performance-ego_min 0.05800333688425463 sim_compute_robot_state-ego_max 0.08024488045619084 sim_compute_robot_state-ego_mean 0.07242671672732985 sim_compute_robot_state-ego_median 0.07163257258278984 sim_compute_robot_state-ego_min 0.06524485488270604 sim_compute_robot_state-npc0_max 0.07465172850567361 sim_compute_robot_state-npc0_mean 0.0677713058523173 sim_compute_robot_state-npc0_median 0.06787627242332281 sim_compute_robot_state-npc0_min 0.058503938275714255 sim_compute_robot_state-npc1_max 0.07596727039503015 sim_compute_robot_state-npc1_mean 0.06746348652158203 sim_compute_robot_state-npc1_median 0.06623344251087733 sim_compute_robot_state-npc1_min 0.057945140572481374 sim_compute_robot_state-npc2_max 0.07281839329263438 sim_compute_robot_state-npc2_mean 0.06694196071172 sim_compute_robot_state-npc2_median 0.06803439938744833 sim_compute_robot_state-npc2_min 0.05708814776220987 sim_compute_robot_state-npc3_max 0.0711505021134468 sim_compute_robot_state-npc3_mean 0.06716272998669964 sim_compute_robot_state-npc3_median 0.06782841682434082 sim_compute_robot_state-npc3_min 0.05903860025627669 sim_compute_sim_state_max 0.04068425178527832 sim_compute_sim_state_mean 0.0376342571550564 sim_compute_sim_state_median 0.037917877498425935 sim_compute_sim_state_min 0.03343914830407431 sim_physics_max 0.23277911952897615 sim_physics_mean 0.20340775397664151 sim_physics_median 0.20458396645479424 sim_physics_min 0.16042550774507744 sim_render-ego_max 0.06625453325418326 sim_render-ego_mean 0.06183737811926194 sim_render-ego_median 0.06278739656720843 sim_render-ego_min 0.05374200399531875 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 211762612Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 20:04:33+00:00 2019-04-27 20:31:28+00:00 0:26:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2875407694053156 survival_time_median 2.849999999999998 deviation-center-line_median 0.11031194850197353 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.0829768914442796 agent_compute-ego_mean 0.07306662797083742 agent_compute-ego_median 0.07203093596867152 agent_compute-ego_min 0.06457571650660315 deviation-center-line_max 0.2701922695523504 deviation-center-line_mean 0.13746050030700233 deviation-center-line_min 0.07113819587235681 deviation-heading_max 1.4854398920276677 deviation-heading_mean 0.7236995121312619 deviation-heading_median 0.6953408166028192 deviation-heading_min 0.3118646573709166 driven_any_max 1.934434121703833 driven_any_mean 0.806757806634148 driven_any_median 0.8072381933001392 driven_any_min 0.20912585880423715 driven_lanedir_consec_max 0.7222251056746308 driven_lanedir_consec_mean 0.3962831867516217 driven_lanedir_consec_min 0.1917983424483971 driven_lanedir_max 0.7287863177121016 driven_lanedir_mean 0.3975640776898326 driven_lanedir_median 0.2875407694053156 driven_lanedir_min 0.1917983424483971 in-drivable-lane_max 4.04999999999999 in-drivable-lane_mean 1.2133333333333305 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.20525830337800177, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0649242544748697, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07496489386960685, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.099097665533962, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03841584274567753, "sim_compute_performance-ego": 0.07281778519412122, "sim_compute_robot_state-ego": 0.08003812812897096, "sim_compute_robot_state-npc0": 0.06959141306130283, "sim_compute_robot_state-npc1": 0.06981821232531445, "sim_compute_robot_state-npc2": 0.07000365889216044, "sim_compute_robot_state-npc3": 0.0702007506267134}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.1971661161493372, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06700476010640462, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0768051853886357, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09403618176778156, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03634436925252279, "sim_compute_performance-ego": 0.0668035348256429, "sim_compute_robot_state-ego": 0.06368276807996961, "sim_compute_robot_state-npc0": 0.06337803381460684, "sim_compute_robot_state-npc1": 0.06251113503067582, "sim_compute_robot_state-npc2": 0.06486794683668348, "sim_compute_robot_state-npc3": 0.062324727023089374}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21503965059916175, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06560092094617012, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07183672525943854, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10103803414564866, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.038712434279613, "sim_compute_performance-ego": 0.06992217821952625, "sim_compute_robot_state-ego": 0.07429367151015843, "sim_compute_robot_state-npc0": 0.06916567606803699, "sim_compute_robot_state-npc1": 0.06848619534419133, "sim_compute_robot_state-npc2": 0.06867516957796536, "sim_compute_robot_state-npc3": 0.06854476072849372}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2175045557189406, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06380590221338105, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07260079551161382, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.0964723637229518, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.039071735582853616, "sim_compute_performance-ego": 0.0701315026534231, "sim_compute_robot_state-ego": 0.07263744504828203, "sim_compute_robot_state-npc0": 0.08024600095916212, "sim_compute_robot_state-npc1": 0.06963949454458136, "sim_compute_robot_state-npc2": 0.06970028709947017, "sim_compute_robot_state-npc3": 0.06504438634504352}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.20603777014690897, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.058851801830789315, "in-drivable-lane": 0, "agent_compute-ego": 0.06815491551938264, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.08795288334722104, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.03883106812186863, "sim_compute_performance-ego": 0.0659705348636793, "sim_compute_robot_state-ego": 0.07170343399047852, "sim_compute_robot_state-npc0": 0.0731972715129023, "sim_compute_robot_state-npc1": 0.06778860092163086, "sim_compute_robot_state-npc2": 0.06713278397269871, "sim_compute_robot_state-npc3": 0.06959625949030337}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.19894504780862848, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06149097517424939, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07223045358470842, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.09342670908161238, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.03880057381648643, "sim_compute_performance-ego": 0.07032310962677002, "sim_compute_robot_state-ego": 0.07505206968270096, "sim_compute_robot_state-npc0": 0.07195623715718587, "sim_compute_robot_state-npc1": 0.06807636279685825, "sim_compute_robot_state-npc2": 0.0705272216422885, "sim_compute_robot_state-npc3": 0.06980611997492173}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.1956130981445313, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06268494640077864, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07203093596867152, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09424625635147096, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03844012362616403, "sim_compute_performance-ego": 0.06892654384885516, "sim_compute_robot_state-ego": 0.07298352888652257, "sim_compute_robot_state-npc0": 0.06935481854847499, "sim_compute_robot_state-npc1": 0.07099829571587699, "sim_compute_robot_state-npc2": 0.06932555607386998, "sim_compute_robot_state-npc3": 0.0691992231777736}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.2143859667320774, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06348282996922323, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07007341842128806, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.0968600331920467, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.03767137984706931, "sim_compute_performance-ego": 0.06464016600830914, "sim_compute_robot_state-ego": 0.07249652849484796, "sim_compute_robot_state-npc0": 0.06907260581238629, "sim_compute_robot_state-npc1": 0.06946001640737873, "sim_compute_robot_state-npc2": 0.0698751978678246, "sim_compute_robot_state-npc3": 0.06965727348850198}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.20292713198550913, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06276844268621401, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07068960333979407, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.10003256243328716, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03822408166042594, "sim_compute_performance-ego": 0.07069612381070159, "sim_compute_robot_state-ego": 0.07533340121424476, "sim_compute_robot_state-npc0": 0.06743214019509249, "sim_compute_robot_state-npc1": 0.07000854957935422, "sim_compute_robot_state-npc2": 0.07022949706676394, "sim_compute_robot_state-npc3": 0.06858058585677036}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.26157116889953613, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06977513203254113, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0829768914442796, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10281328971569356, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.04143459063309889, "sim_compute_performance-ego": 0.07876126582805927, "sim_compute_robot_state-ego": 0.07861446417295016, "sim_compute_robot_state-npc0": 0.07575139632591835, "sim_compute_robot_state-npc1": 0.07229079649998592, "sim_compute_robot_state-npc2": 0.07258738921238826, "sim_compute_robot_state-npc3": 0.07474258312812218}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2109255218505859, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06188778241475423, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07200909932454427, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09637484868367512, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.039382127126057945, "sim_compute_performance-ego": 0.07308300018310547, "sim_compute_robot_state-ego": 0.0752943483988444, "sim_compute_robot_state-npc0": 0.06814497947692871, "sim_compute_robot_state-npc1": 0.06781685511271159, "sim_compute_robot_state-npc2": 0.06823300361633301, "sim_compute_robot_state-npc3": 0.07020174980163574}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.22304541724068777, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06911474182492211, "in-drivable-lane": 0, "agent_compute-ego": 0.08022148268563407, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.10567190533592588, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03835671288626535, "sim_compute_performance-ego": 0.06927468663170225, "sim_compute_robot_state-ego": 0.07600866045270648, "sim_compute_robot_state-npc0": 0.07144546508789062, "sim_compute_robot_state-npc1": 0.06919378326052711, "sim_compute_robot_state-npc2": 0.07259233792622884, "sim_compute_robot_state-npc3": 0.07142563093276251}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.21037737158841863, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.061175956282504766, "in-drivable-lane": 1.15, "agent_compute-ego": 0.06457571650660315, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.09697478871012843, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.03771501363709916, "sim_compute_performance-ego": 0.06738716502522313, "sim_compute_robot_state-ego": 0.08081208827883699, "sim_compute_robot_state-npc0": 0.06877888080685637, "sim_compute_robot_state-npc1": 0.07109973596972088, "sim_compute_robot_state-npc2": 0.07047357670096464, "sim_compute_robot_state-npc3": 0.07231873689695846}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.2056118505341666, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.060000402586800713, "in-drivable-lane": 0, "agent_compute-ego": 0.07199824707848686, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.09343983445848736, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.03826125179018293, "sim_compute_performance-ego": 0.06443576301847186, "sim_compute_robot_state-ego": 0.07108765840530396, "sim_compute_robot_state-npc0": 0.06947233847209386, "sim_compute_robot_state-npc1": 0.07279390096664429, "sim_compute_robot_state-npc2": 0.06990041051592145, "sim_compute_robot_state-npc3": 0.07228405135018486}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.22972624909644032, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06576974251691033, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07483105565987382, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0976417111415489, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.041389661676743454, "sim_compute_performance-ego": 0.06804515333736644, "sim_compute_robot_state-ego": 0.07603703760633282, "sim_compute_robot_state-npc0": 0.06981145634370692, "sim_compute_robot_state-npc1": 0.06872726889217601, "sim_compute_robot_state-npc2": 0.07118041375104119, "sim_compute_robot_state-npc3": 0.07078112807928347}}set_robot_commands_max 0.10567190533592588 set_robot_commands_mean 0.09707193784142944 set_robot_commands_median 0.0968600331920467 set_robot_commands_min 0.08795288334722104 sim_compute_performance-ego_max 0.07876126582805927 sim_compute_performance-ego_mean 0.06941456753833046 sim_compute_performance-ego_median 0.06927468663170225 sim_compute_performance-ego_min 0.06443576301847186 sim_compute_robot_state-ego_max 0.08081208827883699 sim_compute_robot_state-ego_mean 0.0744050154900767 sim_compute_robot_state-ego_median 0.07505206968270096 sim_compute_robot_state-ego_min 0.06368276807996961 sim_compute_robot_state-npc0_max 0.08024600095916212 sim_compute_robot_state-npc0_mean 0.07045324757616969 sim_compute_robot_state-npc0_median 0.06947233847209386 sim_compute_robot_state-npc0_min 0.06337803381460684 sim_compute_robot_state-npc1_max 0.07279390096664429 sim_compute_robot_state-npc1_mean 0.06924728022450852 sim_compute_robot_state-npc1_median 0.06946001640737873 sim_compute_robot_state-npc1_min 0.06251113503067582 sim_compute_robot_state-npc2_max 0.07259233792622884 sim_compute_robot_state-npc2_mean 0.06968696338350684 sim_compute_robot_state-npc2_median 0.06990041051592145 sim_compute_robot_state-npc2_min 0.06486794683668348 sim_compute_robot_state-npc3_max 0.07474258312812218 sim_compute_robot_state-npc3_mean 0.06964719779337056 sim_compute_robot_state-npc3_median 0.06980611997492173 sim_compute_robot_state-npc3_min 0.062324727023089374 sim_compute_sim_state_max 0.04143459063309889 sim_compute_sim_state_mean 0.03873673111214193 sim_compute_sim_state_median 0.03844012362616403 sim_compute_sim_state_min 0.03634436925252279 sim_physics_max 0.26157116889953613 sim_physics_mean 0.21294234799152875 sim_physics_median 0.21037737158841863 sim_physics_min 0.1956130981445313 sim_render-ego_max 0.06977513203254113 sim_render-ego_mean 0.06388923943070088 sim_render-ego_median 0.06348282996922323 sim_render-ego_min 0.058851801830789315 simulation-passed 1 survival_time_max 6.999999999999983 survival_time_mean 3.043333333333329 survival_time_min 1.0500000000000005
No reset possible 211582578Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validationstep1-simulation error no ip-172-31-40-253-321252019-04-27 20:00:27+00:00 2019-04-27 20:04:08+00:00 0:03:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 211242770Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 19:07:09+00:00 2019-04-27 20:00:11+00:00 0:53:02 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-40-253-32125-job21124/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 211162629Andrea Censi challenge-aido_LF-template-random aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 19:00:20+00:00 2019-04-27 19:06:47+00:00 0:06:27 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.13005513204193506 in-drivable-lane_median 0.29999999999999893
other stats agent_compute-ego_max 0.20243817347067375 agent_compute-ego_mean 0.1540018751663787 agent_compute-ego_median 0.14559807656686516 agent_compute-ego_min 0.12943532887627096 deviation-center-line_max 0.2072381278624381 deviation-center-line_mean 0.13189395308989768 deviation-center-line_min 0.0788839760023766 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3206717506075888 deviation-heading_median 0.23606825392187256 deviation-heading_min 0.19401296908406307 driven_any_max 1.618214457700942 driven_any_mean 0.8613785859332687 driven_any_median 0.9933867744747804 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 0.8010406009604816 driven_lanedir_consec_mean 0.5597645764431625 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 0.8010406009604816 driven_lanedir_mean 0.5597645764431625 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.619999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.15783564249674478, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.07681811297381366, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.20243817347067375, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1288353337181939, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.048113606594226976, "sim_compute_performance-ego": 0.09307180069111012, "sim_compute_robot_state-ego": 0.1129384438196818}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10287717276928472, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06173438184401568, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14737448972814224, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0889887202019785, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03539140084210564, "sim_compute_performance-ego": 0.06815125895481483, "sim_compute_robot_state-ego": 0.07089853754230574}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1033646639655618, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05591450018041274, "in-drivable-lane": 0, "agent_compute-ego": 0.12943532887627096, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07397821370293112, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.031039714813232425, "sim_compute_performance-ego": 0.055527813294354605, "sim_compute_robot_state-ego": 0.0666348653681138}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11524757385253906, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06462519645690917, "in-drivable-lane": 0, "agent_compute-ego": 0.14516330718994142, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0895625114440918, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03765688896179199, "sim_compute_performance-ego": 0.06977616310119629, "sim_compute_robot_state-ego": 0.07434260368347168}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1041287440287916, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06038933464243442, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14559807656686516, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09177772908271112, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03841936739185189, "sim_compute_performance-ego": 0.06447795976566363, "sim_compute_robot_state-ego": 0.07382696187948878}}set_robot_commands_max 0.1288353337181939 set_robot_commands_mean 0.0946285016299813 set_robot_commands_median 0.0895625114440918 set_robot_commands_min 0.07397821370293112 sim_compute_performance-ego_max 0.09307180069111012 sim_compute_performance-ego_mean 0.07020099916142788 sim_compute_performance-ego_median 0.06815125895481483 sim_compute_performance-ego_min 0.055527813294354605 sim_compute_robot_state-ego_max 0.1129384438196818 sim_compute_robot_state-ego_mean 0.07972828245861237 sim_compute_robot_state-ego_median 0.07382696187948878 sim_compute_robot_state-ego_min 0.0666348653681138 sim_compute_sim_state_max 0.048113606594226976 sim_compute_sim_state_mean 0.03812419572064178 sim_compute_sim_state_median 0.03765688896179199 sim_compute_sim_state_min 0.031039714813232425 sim_physics_max 0.15783564249674478 sim_physics_mean 0.1166907594225844 sim_physics_median 0.1041287440287916 sim_physics_min 0.10287717276928472 sim_render-ego_max 0.07681811297381366 sim_render-ego_mean 0.06389630521951714 sim_render-ego_median 0.06173438184401568 sim_render-ego_min 0.05591450018041274 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2599999999999985 survival_time_min 0.8500000000000002
No reset possible 211062653Egor Zamotaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 18:42:34+00:00 2019-04-27 19:00:04+00:00 0:17:30 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 486, in get_cr
uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1024, in upload_files
uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
File "/project/src/duckietown_challenges_runner/runner.py", line 1179, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1226, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2653/step1-simulation-ip-172-31-40-253-32125-job21106/tmp/tmpo7yfxcq8/episodes/ETHZ_autolab_technical_track-2-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 210962677Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 18:25:31+00:00 2019-04-27 18:41:55+00:00 0:16:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9984547042238968 survival_time_median 7.399999999999982 deviation-center-line_median 0.41708329254168464 in-drivable-lane_median 0.30000000000000426
other stats agent_compute-ego_max 0.09174753846348944 agent_compute-ego_mean 0.08924519018327234 agent_compute-ego_median 0.08898645083109538 agent_compute-ego_min 0.08559167991250248 deviation-center-line_max 0.8448372204011708 deviation-center-line_mean 0.5125430814627356 deviation-center-line_min 0.30626033712704764 deviation-heading_max 6.941353775420849 deviation-heading_mean 2.9480628693828046 deviation-heading_median 2.4067364000430027 deviation-heading_min 0.425158246926593 driven_any_max 2.3485700861714243 driven_any_mean 1.1996338547729586 driven_any_median 1.1187198251719266 driven_any_min 0.4204731206332856 driven_lanedir_consec_max 1.237401182287409 driven_lanedir_consec_mean 0.7764464651379918 driven_lanedir_consec_min 0.1883524889602182 driven_lanedir_max 1.361604700245779 driven_lanedir_mean 0.8984026909675211 driven_lanedir_median 1.0418260763732108 driven_lanedir_min 0.4161978738452241 in-drivable-lane_max 3.4000000000000092 in-drivable-lane_mean 0.8400000000000025 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1187198251719266, "sim_physics": 0.1409085811795415, "survival_time": 7.399999999999982, "driven_lanedir": 1.0418260763732108, "sim_render-ego": 0.0732232461104522, "in-drivable-lane": 0, "agent_compute-ego": 0.09174753846348944, "deviation-heading": 2.1040390428495748, "set_robot_commands": 0.11545856256742736, "deviation-center-line": 0.6009336954854709, "driven_lanedir_consec": 1.0418260763732108, "sim_compute_sim_state": 0.04508738582198684, "sim_compute_performance-ego": 0.08064657288628656, "sim_compute_robot_state-ego": 0.094856634333327}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7257007544415573, "sim_physics": 0.1498461482451134, "survival_time": 4.849999999999991, "driven_lanedir": 0.4349836220859829, "sim_render-ego": 0.07533319955019607, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.09112419541349116, "deviation-heading": 2.8630268816740028, "set_robot_commands": 0.11873298084612974, "deviation-center-line": 0.41708329254168464, "driven_lanedir_consec": 0.1883524889602182, "sim_compute_sim_state": 0.04638482860683166, "sim_compute_performance-ego": 0.08402270140107145, "sim_compute_robot_state-ego": 0.09306450480038356}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4204731206332856, "sim_physics": 0.14921065508309056, "survival_time": 2.9499999999999975, "driven_lanedir": 0.4161978738452241, "sim_render-ego": 0.07098288859351207, "in-drivable-lane": 0, "agent_compute-ego": 0.08559167991250248, "deviation-heading": 0.425158246926593, "set_robot_commands": 0.1165000664985786, "deviation-center-line": 0.30626033712704764, "driven_lanedir_consec": 0.4161978738452241, "sim_compute_sim_state": 0.04324178776498568, "sim_compute_performance-ego": 0.08031061948355982, "sim_compute_robot_state-ego": 0.09317753274561996}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485700861714243, "sim_physics": 0.13903249820073446, "survival_time": 14.950000000000076, "driven_lanedir": 1.361604700245779, "sim_render-ego": 0.0719643799463908, "in-drivable-lane": 3.4000000000000092, "agent_compute-ego": 0.08898645083109538, "deviation-heading": 6.941353775420849, "set_robot_commands": 0.11567037026087444, "deviation-center-line": 0.8448372204011708, "driven_lanedir_consec": 0.9984547042238968, "sim_compute_sim_state": 0.04467760801315307, "sim_compute_performance-ego": 0.08005373239517212, "sim_compute_robot_state-ego": 0.09314269622166951}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.384705487446599, "sim_physics": 0.1509270188528732, "survival_time": 8.949999999999992, "driven_lanedir": 1.237401182287409, "sim_render-ego": 0.07310077464780328, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.0887760862957832, "deviation-heading": 2.4067364000430027, "set_robot_commands": 0.1179319586833762, "deviation-center-line": 0.3936008617583044, "driven_lanedir_consec": 1.237401182287409, "sim_compute_sim_state": 0.04480211028839623, "sim_compute_performance-ego": 0.08073686487847866, "sim_compute_robot_state-ego": 0.09587152843368786}}set_robot_commands_max 0.11873298084612974 set_robot_commands_mean 0.11685878777127728 set_robot_commands_median 0.1165000664985786 set_robot_commands_min 0.11545856256742736 sim_compute_performance-ego_max 0.08402270140107145 sim_compute_performance-ego_mean 0.08115409820891371 sim_compute_performance-ego_median 0.08064657288628656 sim_compute_performance-ego_min 0.08005373239517212 sim_compute_robot_state-ego_max 0.09587152843368786 sim_compute_robot_state-ego_mean 0.09402257930693758 sim_compute_robot_state-ego_median 0.09317753274561996 sim_compute_robot_state-ego_min 0.09306450480038356 sim_compute_sim_state_max 0.04638482860683166 sim_compute_sim_state_mean 0.044838744099070696 sim_compute_sim_state_median 0.04480211028839623 sim_compute_sim_state_min 0.04324178776498568 sim_physics_max 0.1509270188528732 sim_physics_mean 0.14598498031227064 sim_physics_median 0.14921065508309056 sim_physics_min 0.13903249820073446 sim_render-ego_max 0.07533319955019607 sim_render-ego_mean 0.07292089776967088 sim_render-ego_median 0.07310077464780328 sim_render-ego_min 0.07098288859351207 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.820000000000007 survival_time_min 2.9499999999999975
No reset possible 210822691Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 18:01:57+00:00 2019-04-27 18:23:56+00:00 0:21:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9991440368012025 survival_time_median 13.80000000000006 deviation-center-line_median 0.7624850631356785 in-drivable-lane_median 0.2500000000000002
other stats agent_compute-ego_max 0.09473899766510609 agent_compute-ego_mean 0.09085531211920712 agent_compute-ego_median 0.0918247972925504 agent_compute-ego_min 0.08625502824783325 deviation-center-line_max 1.0966554824424024 deviation-center-line_mean 0.7238898349301097 deviation-center-line_min 0.3604565092661053 deviation-heading_max 6.327222497744768 deviation-heading_mean 3.724673410539097 deviation-heading_median 3.5907267557486966 deviation-heading_min 1.4456623211672686 driven_any_max 2.3490152942082556 driven_any_mean 1.6657317937737617 driven_any_median 2.1641457114709888 driven_any_min 0.7176784903835042 driven_lanedir_consec_max 1.986265161020517 driven_lanedir_consec_mean 1.155481129195336 driven_lanedir_consec_min 0.29609283571187744 driven_lanedir_max 1.986265161020517 driven_lanedir_mean 1.3044748316904664 driven_lanedir_median 1.5308997554388544 driven_lanedir_min 0.5093056295498772 in-drivable-lane_max 3.0000000000000213 in-drivable-lane_mean 1.190000000000012 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7490811776101854, "sim_physics": 0.15731458804186652, "survival_time": 5.09999999999999, "driven_lanedir": 0.694966810941015, "sim_render-ego": 0.07216970359577853, "in-drivable-lane": 0, "agent_compute-ego": 0.09473899766510609, "deviation-heading": 1.4456623211672686, "set_robot_commands": 0.11811291470247157, "deviation-center-line": 0.3604565092661053, "driven_lanedir_consec": 0.694966810941015, "sim_compute_sim_state": 0.04599424904468013, "sim_compute_performance-ego": 0.0815427537057914, "sim_compute_robot_state-ego": 0.09240544309803084}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7176784903835042, "sim_physics": 0.14705111334721246, "survival_time": 4.799999999999991, "driven_lanedir": 0.5093056295498772, "sim_render-ego": 0.0727477843562762, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.0918247972925504, "deviation-heading": 2.6621116479954963, "set_robot_commands": 0.11576726535956064, "deviation-center-line": 0.4359970764890202, "driven_lanedir_consec": 0.29609283571187744, "sim_compute_sim_state": 0.04338757445414861, "sim_compute_performance-ego": 0.08022365222374599, "sim_compute_robot_state-ego": 0.09157135585943858}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3490152942082556, "sim_physics": 0.1453989322980245, "survival_time": 14.950000000000076, "driven_lanedir": 1.8009368015020684, "sim_render-ego": 0.07318824927012126, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.09203808307647704, "deviation-heading": 3.5907267557486966, "set_robot_commands": 0.11688478151957192, "deviation-center-line": 1.0966554824424024, "driven_lanedir_consec": 1.8009368015020684, "sim_compute_sim_state": 0.04482638518015544, "sim_compute_performance-ego": 0.08009345054626466, "sim_compute_robot_state-ego": 0.0893970282872518}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348738295195875, "sim_physics": 0.13779151757558186, "survival_time": 14.950000000000076, "driven_lanedir": 1.5308997554388544, "sim_render-ego": 0.06941759983698527, "in-drivable-lane": 3.0000000000000213, "agent_compute-ego": 0.08625502824783325, "deviation-heading": 6.327222497744768, "set_robot_commands": 0.11469563007354736, "deviation-center-line": 0.9638550433173416, "driven_lanedir_consec": 0.9991440368012025, "sim_compute_sim_state": 0.04294899622599284, "sim_compute_performance-ego": 0.07815030097961426, "sim_compute_robot_state-ego": 0.09166423082351684}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1641457114709888, "sim_physics": 0.13715570733167123, "survival_time": 13.80000000000006, "driven_lanedir": 1.986265161020517, "sim_render-ego": 0.07144642826439677, "in-drivable-lane": 0, "agent_compute-ego": 0.08941965431406879, "deviation-heading": 4.597643830039255, "set_robot_commands": 0.11710730324620786, "deviation-center-line": 0.7624850631356785, "driven_lanedir_consec": 1.986265161020517, "sim_compute_sim_state": 0.04450622935225998, "sim_compute_performance-ego": 0.08117424664290054, "sim_compute_robot_state-ego": 0.09256019885989204}}set_robot_commands_max 0.11811291470247157 set_robot_commands_mean 0.11651357898027188 set_robot_commands_median 0.11688478151957192 set_robot_commands_min 0.11469563007354736 sim_compute_performance-ego_max 0.0815427537057914 sim_compute_performance-ego_mean 0.08023688081966336 sim_compute_performance-ego_median 0.08022365222374599 sim_compute_performance-ego_min 0.07815030097961426 sim_compute_robot_state-ego_max 0.09256019885989204 sim_compute_robot_state-ego_mean 0.09151965138562602 sim_compute_robot_state-ego_median 0.09166423082351684 sim_compute_robot_state-ego_min 0.0893970282872518 sim_compute_sim_state_max 0.04599424904468013 sim_compute_sim_state_mean 0.044332686851447395 sim_compute_sim_state_median 0.04450622935225998 sim_compute_sim_state_min 0.04294899622599284 sim_physics_max 0.15731458804186652 sim_physics_mean 0.1449423717188713 sim_physics_median 0.1453989322980245 sim_physics_min 0.13715570733167123 sim_render-ego_max 0.07318824927012126 sim_render-ego_mean 0.0717939530647116 sim_render-ego_median 0.07216970359577853 sim_render-ego_min 0.06941759983698527 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.72000000000004 survival_time_min 4.799999999999991
No reset possible 210152884Andrea Daniele minimal_agent (Python 3) aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 17:01:32+00:00 2019-04-27 18:00:04+00:00 0:58:32 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-40-253-32125-job21015/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 209613058Andrea Censi rotation aido2-LFV-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 16:00:41+00:00 2019-04-27 17:00:10+00:00 0:59:29 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-40-253-32125-job20961/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 209482885Andrea Daniele minimal_agent (Python 3) aido2-LFVI-sim-validationstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 15:48:21+00:00 2019-04-27 16:00:11+00:00 0:11:50 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2885/step1-simulation-ip-172-31-40-253-32125-job20948/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 209372924Bhairav Mehta challenge-aido_LF-template-pytorch aido2-LFV-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 15:30:20+00:00 2019-04-27 15:48:04+00:00 0:17:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1524214138614719 survival_time_median 1.5000000000000009 deviation-center-line_median 0.0993228287727276 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.18102509219472 agent_compute-ego_mean 0.16317981001297194 agent_compute-ego_median 0.16100061416625977 agent_compute-ego_min 0.14736510316530865 deviation-center-line_max 0.13507996434973452 deviation-center-line_mean 0.09752852437480668 deviation-center-line_min 0.05290502943298214 deviation-heading_max 1.0879582700676087 deviation-heading_mean 0.8056796228066122 deviation-heading_median 0.8767117193297685 deviation-heading_min 0.4677268528758848 driven_any_max 0.26148693183898625 driven_any_mean 0.20101491639335184 driven_any_median 0.20064537250879377 driven_any_min 0.13768091967354057 driven_lanedir_consec_max 0.20258992351991756 driven_lanedir_consec_mean 0.14124231614077523 driven_lanedir_consec_min 0.05522409847704246 driven_lanedir_max 0.20258992351991756 driven_lanedir_mean 0.14124231614077523 driven_lanedir_median 0.1524214138614719 driven_lanedir_min 0.05522409847704246 in-drivable-lane_max 0.2999999999999998 in-drivable-lane_mean 0.07666666666666666 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.25720233072847976, "sim_physics": 0.18819769620895385, "survival_time": 2.000000000000001, "driven_lanedir": 0.16604985658529214, "sim_render-ego": 0.0618935227394104, "in-drivable-lane": 0.25, "agent_compute-ego": 0.17272306084632874, "deviation-heading": 0.9677204762404, "set_robot_commands": 0.09574243426322936, "deviation-center-line": 0.09760203526407302, "driven_lanedir_consec": 0.16604985658529214, "sim_compute_sim_state": 0.03814783096313477, "sim_compute_performance-ego": 0.0682349979877472, "sim_compute_robot_state-ego": 0.07833622097969055, "sim_compute_robot_state-npc0": 0.06810685396194457, "sim_compute_robot_state-npc1": 0.07353265285491943, "sim_compute_robot_state-npc2": 0.06922453045845031, "sim_compute_robot_state-npc3": 0.06815266013145446}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17547577091809333, "sim_physics": 0.17164621353149415, "survival_time": 1.5000000000000009, "driven_lanedir": 0.05522409847704246, "sim_render-ego": 0.057755017280578615, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.16125147342681884, "deviation-heading": 1.0586445801701576, "set_robot_commands": 0.09673652648925782, "deviation-center-line": 0.07183367297137389, "driven_lanedir_consec": 0.05522409847704246, "sim_compute_sim_state": 0.03998003800710042, "sim_compute_performance-ego": 0.0666391928990682, "sim_compute_robot_state-ego": 0.06874622503916422, "sim_compute_robot_state-npc0": 0.06797985235850017, "sim_compute_robot_state-npc1": 0.07169594764709472, "sim_compute_robot_state-npc2": 0.06346306006113688, "sim_compute_robot_state-npc3": 0.06925870577494303}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18850293975175983, "sim_physics": 0.17447177295027108, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16223643534972565, "sim_render-ego": 0.06092688132976663, "in-drivable-lane": 0, "agent_compute-ego": 0.1634869411073882, "deviation-heading": 0.5082555136978036, "set_robot_commands": 0.08875541029305294, "deviation-center-line": 0.13261196138201595, "driven_lanedir_consec": 0.16223643534972565, "sim_compute_sim_state": 0.03764475625136803, "sim_compute_performance-ego": 0.06628082538473196, "sim_compute_robot_state-ego": 0.0712016122094516, "sim_compute_robot_state-npc0": 0.06990607031460466, "sim_compute_robot_state-npc1": 0.07358575689381566, "sim_compute_robot_state-npc2": 0.06873233564968767, "sim_compute_robot_state-npc3": 0.06561143644924822}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2250912503117271, "sim_physics": 0.1888602625939154, "survival_time": 1.5500000000000007, "driven_lanedir": 0.20258992351991756, "sim_render-ego": 0.055162245227444555, "in-drivable-lane": 0, "agent_compute-ego": 0.15756988525390625, "deviation-heading": 0.4677268528758848, "set_robot_commands": 0.09334071220890168, "deviation-center-line": 0.13507996434973452, "driven_lanedir_consec": 0.20258992351991756, "sim_compute_sim_state": 0.03740096092224121, "sim_compute_performance-ego": 0.06250732175765498, "sim_compute_robot_state-ego": 0.06589758780694777, "sim_compute_robot_state-npc0": 0.06544740738407258, "sim_compute_robot_state-npc1": 0.06417818223276446, "sim_compute_robot_state-npc2": 0.06139452995792512, "sim_compute_robot_state-npc3": 0.06773062675229964}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15173550697772636, "sim_physics": 0.16219258308410645, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09825231494425768, "sim_render-ego": 0.05766187264369084, "in-drivable-lane": 0, "agent_compute-ego": 0.1633821175648616, "deviation-heading": 0.8767117193297685, "set_robot_commands": 0.0878752561715933, "deviation-center-line": 0.07095142336780168, "driven_lanedir_consec": 0.09825231494425768, "sim_compute_sim_state": 0.03682062259087196, "sim_compute_performance-ego": 0.06230096633617695, "sim_compute_robot_state-ego": 0.07329169603494498, "sim_compute_robot_state-npc0": 0.06582051974076492, "sim_compute_robot_state-npc1": 0.06613671779632568, "sim_compute_robot_state-npc2": 0.06406643757453331, "sim_compute_robot_state-npc3": 0.061336709902836725}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.26148693183898625, "sim_physics": 0.17464303970336914, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1719456095331955, "sim_render-ego": 0.06379096100970012, "in-drivable-lane": 0.1499999999999997, "agent_compute-ego": 0.18102509219472, "deviation-heading": 1.0496499633697087, "set_robot_commands": 0.10085421073727492, "deviation-center-line": 0.08997079709787928, "driven_lanedir_consec": 0.1719456095331955, "sim_compute_sim_state": 0.038846609069079885, "sim_compute_performance-ego": 0.07443511195299102, "sim_compute_robot_state-ego": 0.07844216067616533, "sim_compute_robot_state-npc0": 0.0710075715693032, "sim_compute_robot_state-npc1": 0.07078152168087842, "sim_compute_robot_state-npc2": 0.06921968808988245, "sim_compute_robot_state-npc3": 0.07419066894345167}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2092803667814454, "sim_physics": 0.17157798608144123, "survival_time": 1.5000000000000009, "driven_lanedir": 0.17361053044876773, "sim_render-ego": 0.06304063002268473, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15606870651245117, "deviation-heading": 0.540204008092206, "set_robot_commands": 0.0930542786916097, "deviation-center-line": 0.11691196837118518, "driven_lanedir_consec": 0.17361053044876773, "sim_compute_sim_state": 0.03591201305389404, "sim_compute_performance-ego": 0.07284176349639893, "sim_compute_robot_state-ego": 0.07324750423431396, "sim_compute_robot_state-npc0": 0.06712009112040201, "sim_compute_robot_state-npc1": 0.06731715202331542, "sim_compute_robot_state-npc2": 0.0637101968129476, "sim_compute_robot_state-npc3": 0.06613310972849527}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1979070373977356, "sim_physics": 0.1940087656820974, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1652675230083016, "sim_render-ego": 0.06564389505693989, "in-drivable-lane": 0, "agent_compute-ego": 0.17910179784221034, "deviation-heading": 0.638598859165004, "set_robot_commands": 0.09792539381211804, "deviation-center-line": 0.10959595828294016, "driven_lanedir_consec": 0.1652675230083016, "sim_compute_sim_state": 0.03885697549389255, "sim_compute_performance-ego": 0.0728888665476153, "sim_compute_robot_state-ego": 0.07984813567130797, "sim_compute_robot_state-npc0": 0.07091571438697077, "sim_compute_robot_state-npc1": 0.06476643777662708, "sim_compute_robot_state-npc2": 0.07038083384113927, "sim_compute_robot_state-npc3": 0.07163218528993669}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2464648414129437, "sim_physics": 0.20864944081557424, "survival_time": 1.900000000000001, "driven_lanedir": 0.1760507868125436, "sim_render-ego": 0.06188029364535683, "in-drivable-lane": 0, "agent_compute-ego": 0.18081761661328768, "deviation-heading": 1.0879582700676087, "set_robot_commands": 0.09764743478674638, "deviation-center-line": 0.08638462234041229, "driven_lanedir_consec": 0.1760507868125436, "sim_compute_sim_state": 0.04172815147199129, "sim_compute_performance-ego": 0.07069455322466399, "sim_compute_robot_state-ego": 0.077254991782339, "sim_compute_robot_state-npc0": 0.07009923458099365, "sim_compute_robot_state-npc1": 0.0753546953201294, "sim_compute_robot_state-npc2": 0.07368023144571405, "sim_compute_robot_state-npc3": 0.07077502576928389}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.20830498556739216, "sim_physics": 0.17148785591125487, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14594249776948764, "sim_render-ego": 0.0627224047978719, "in-drivable-lane": 0, "agent_compute-ego": 0.1566589911778768, "deviation-heading": 0.9494567310206808, "set_robot_commands": 0.0916980266571045, "deviation-center-line": 0.08158270723532507, "driven_lanedir_consec": 0.14594249776948764, "sim_compute_sim_state": 0.03730715910593669, "sim_compute_performance-ego": 0.0676607370376587, "sim_compute_robot_state-ego": 0.0743018388748169, "sim_compute_robot_state-npc0": 0.06372576554616292, "sim_compute_robot_state-npc1": 0.06417195796966553, "sim_compute_robot_state-npc2": 0.061357768376668294, "sim_compute_robot_state-npc3": 0.06543598175048829}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.14953805933147463, "sim_physics": 0.20018448999949864, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07087762769487416, "sim_render-ego": 0.0616698009627206, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1562035850116185, "deviation-heading": 0.9633588145096688, "set_robot_commands": 0.08808405910219465, "deviation-center-line": 0.05290502943298214, "driven_lanedir_consec": 0.07087762769487416, "sim_compute_sim_state": 0.03766360453196934, "sim_compute_performance-ego": 0.06471480642046247, "sim_compute_robot_state-ego": 0.0690027219908578, "sim_compute_robot_state-npc0": 0.06269229309899467, "sim_compute_robot_state-npc1": 0.05828338009970529, "sim_compute_robot_state-npc2": 0.0642121434211731, "sim_compute_robot_state-npc3": 0.06684935092926025}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13768091967354057, "sim_physics": 0.1499603589375814, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10838329772792175, "sim_render-ego": 0.05275998512903849, "in-drivable-lane": 0, "agent_compute-ego": 0.14736510316530865, "deviation-heading": 0.5775134754407852, "set_robot_commands": 0.09323480725288393, "deviation-center-line": 0.11266555167963294, "driven_lanedir_consec": 0.10838329772792175, "sim_compute_sim_state": 0.03896711270014445, "sim_compute_performance-ego": 0.06365143259366353, "sim_compute_robot_state-ego": 0.07182737191518147, "sim_compute_robot_state-npc0": 0.06642876068751018, "sim_compute_robot_state-npc1": 0.07112087806065877, "sim_compute_robot_state-npc2": 0.06931824485460918, "sim_compute_robot_state-npc3": 0.06490445137023926}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2552278257123719, "sim_physics": 0.16710444194514576, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1524214138614719, "sim_render-ego": 0.05989445128091952, "in-drivable-lane": 0.2999999999999998, "agent_compute-ego": 0.15959233772463916, "deviation-heading": 0.9701281549895816, "set_robot_commands": 0.09177823764521902, "deviation-center-line": 0.0993228287727276, "driven_lanedir_consec": 0.1524214138614719, "sim_compute_sim_state": 0.03811067488135361, "sim_compute_performance-ego": 0.06511964449068396, "sim_compute_robot_state-ego": 0.06818165430208532, "sim_compute_robot_state-npc0": 0.06679233690587486, "sim_compute_robot_state-npc1": 0.06788808543507646, "sim_compute_robot_state-npc2": 0.06766100046111316, "sim_compute_robot_state-npc3": 0.06755432849977075}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1506796069878074, "sim_physics": 0.19010454177856445, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11814838513603744, "sim_render-ego": 0.05829011917114258, "in-drivable-lane": 0, "agent_compute-ego": 0.16100061416625977, "deviation-heading": 0.5561302426163124, "set_robot_commands": 0.08819026947021484, "deviation-center-line": 0.10322708672855428, "driven_lanedir_consec": 0.11814838513603744, "sim_compute_sim_state": 0.03761570930480957, "sim_compute_performance-ego": 0.0673374080657959, "sim_compute_robot_state-ego": 0.07122360229492188, "sim_compute_robot_state-npc0": 0.0651070785522461, "sim_compute_robot_state-npc1": 0.06334083557128906, "sim_compute_robot_state-npc2": 0.06714358329772949, "sim_compute_robot_state-npc3": 0.06283339500427246}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.20064537250879377, "sim_physics": 0.16915502968956442, "survival_time": 1.7000000000000008, "driven_lanedir": 0.15163444124279124, "sim_render-ego": 0.058490907444673425, "in-drivable-lane": 0, "agent_compute-ego": 0.15144982758690329, "deviation-heading": 0.873136680513612, "set_robot_commands": 0.08465888219721177, "deviation-center-line": 0.10228225834546228, "driven_lanedir_consec": 0.15163444124279124, "sim_compute_sim_state": 0.03626360612757066, "sim_compute_performance-ego": 0.06540898715748507, "sim_compute_robot_state-ego": 0.07178977657766904, "sim_compute_robot_state-npc0": 0.06247434195350198, "sim_compute_robot_state-npc1": 0.06472399655510397, "sim_compute_robot_state-npc2": 0.06519363908206716, "sim_compute_robot_state-npc3": 0.0661704189637128}}set_robot_commands_max 0.10085421073727492 set_robot_commands_mean 0.09263839598524086 set_robot_commands_median 0.0930542786916097 set_robot_commands_min 0.08465888219721177 sim_compute_performance-ego_max 0.07443511195299102 sim_compute_performance-ego_mean 0.06738110769018654 sim_compute_performance-ego_median 0.0666391928990682 sim_compute_performance-ego_min 0.06230096633617695 sim_compute_robot_state-ego_max 0.07984813567130797 sim_compute_robot_state-ego_mean 0.07283954002599051 sim_compute_robot_state-ego_median 0.07182737191518147 sim_compute_robot_state-ego_min 0.06589758780694777 sim_compute_robot_state-npc0_max 0.0710075715693032 sim_compute_robot_state-npc0_mean 0.06690825947745647 sim_compute_robot_state-npc0_median 0.06679233690587486 sim_compute_robot_state-npc0_min 0.06247434195350198 sim_compute_robot_state-npc1_max 0.0753546953201294 sim_compute_robot_state-npc1_mean 0.06779187986115795 sim_compute_robot_state-npc1_median 0.06731715202331542 sim_compute_robot_state-npc1_min 0.05828338009970529 sim_compute_robot_state-npc2_max 0.07368023144571405 sim_compute_robot_state-npc2_mean 0.06658388155898513 sim_compute_robot_state-npc2_median 0.06714358329772949 sim_compute_robot_state-npc2_min 0.061357768376668294 sim_compute_robot_state-npc3_max 0.07419066894345167 sim_compute_robot_state-npc3_mean 0.06723793701731288 sim_compute_robot_state-npc3_median 0.06684935092926025 sim_compute_robot_state-npc3_min 0.061336709902836725 sim_compute_sim_state_max 0.04172815147199129 sim_compute_sim_state_mean 0.03808438829835723 sim_compute_sim_state_median 0.03766360453196934 sim_compute_sim_state_min 0.03591201305389404 sim_physics_max 0.20864944081557424 sim_physics_mean 0.17881629859418885 sim_physics_median 0.17447177295027108 sim_physics_min 0.1499603589375814 sim_render-ego_max 0.06564389505693989 sim_render-ego_mean 0.060105532516129274 sim_render-ego_median 0.06092688132976663 sim_render-ego_min 0.05275998512903849 simulation-passed 1 survival_time_max 2.0500000000000007 survival_time_mean 1.593333333333334 survival_time_min 1.2000000000000004
No reset possible 209182978Julian Zilly Baseline-IL-logs-tensorflow aido2-LFV-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 15:00:55+00:00 2019-04-27 15:29:39+00:00 0:28:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.060923585888819 survival_time_median 11.100000000000025 deviation-center-line_median 0.6453263141194884 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2240725820128982 agent_compute-ego_mean 0.21179698421033993 agent_compute-ego_median 0.2187564942213866 agent_compute-ego_min 0.18628677580091688 deviation-center-line_max 0.8903241684307236 deviation-center-line_mean 0.6654993445841111 deviation-center-line_min 0.5222447262880785 deviation-heading_max 4.843844361384104 deviation-heading_mean 1.8672756075626824 deviation-heading_median 1.0819021207955215 deviation-heading_min 0.8677924365467492 driven_any_max 1.3637319148965203 driven_any_mean 1.1347182039486043 driven_any_median 1.0905640525577418 driven_any_min 1.0481894493727832 driven_lanedir_consec_max 1.3556799073141308 driven_lanedir_consec_mean 1.0448476797875563 driven_lanedir_consec_min 0.6579627619015498 driven_lanedir_max 1.3556799073141308 driven_lanedir_mean 1.0458413096108186 driven_lanedir_median 1.060923585888819 driven_lanedir_min 0.6629309110178585 in-drivable-lane_max 2.1500000000000306 in-drivable-lane_mean 0.4600000000000065 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0481894493727832, "sim_physics": 0.1483206738366021, "survival_time": 11.250000000000025, "driven_lanedir": 0.6629309110178585, "sim_render-ego": 0.050730545255872936, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18628677580091688, "deviation-heading": 4.843844361384104, "set_robot_commands": 0.08074303415086534, "deviation-center-line": 0.6453263141194884, "driven_lanedir_consec": 0.6579627619015498, "sim_compute_sim_state": 0.0325592835744222, "sim_compute_performance-ego": 0.057190703286064994, "sim_compute_robot_state-ego": 0.060601482391357424, "sim_compute_robot_state-npc0": 0.0576732783847385, "sim_compute_robot_state-npc1": 0.05736761411031088, "sim_compute_robot_state-npc2": 0.05681360032823351, "sim_compute_robot_state-npc3": 0.0575874392191569}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3637319148965203, "sim_physics": 0.1746740460395813, "survival_time": 14.950000000000076, "driven_lanedir": 1.3556799073141308, "sim_render-ego": 0.06401532808939615, "in-drivable-lane": 0, "agent_compute-ego": 0.22233824570973715, "deviation-heading": 1.0358603174026726, "set_robot_commands": 0.09512877623240153, "deviation-center-line": 0.6148703450385942, "driven_lanedir_consec": 1.3556799073141308, "sim_compute_sim_state": 0.038533652623494466, "sim_compute_performance-ego": 0.06928354183832805, "sim_compute_robot_state-ego": 0.07327213764190674, "sim_compute_robot_state-npc0": 0.06771150430043539, "sim_compute_robot_state-npc1": 0.06838337500890096, "sim_compute_robot_state-npc2": 0.06739596128463746, "sim_compute_robot_state-npc3": 0.06664639949798584}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0695153807130042, "sim_physics": 0.160997722459876, "survival_time": 10.350000000000012, "driven_lanedir": 1.060923585888819, "sim_render-ego": 0.05975757359306593, "in-drivable-lane": 0, "agent_compute-ego": 0.20753082330676093, "deviation-heading": 0.8677924365467492, "set_robot_commands": 0.09569876896586396, "deviation-center-line": 0.8903241684307236, "driven_lanedir_consec": 1.060923585888819, "sim_compute_sim_state": 0.03836646172159536, "sim_compute_performance-ego": 0.0659013727436895, "sim_compute_robot_state-ego": 0.06957164593940772, "sim_compute_robot_state-npc0": 0.06833332402694628, "sim_compute_robot_state-npc1": 0.06914646153288763, "sim_compute_robot_state-npc2": 0.06816261171718727, "sim_compute_robot_state-npc3": 0.067257945664263}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1015902222029723, "sim_physics": 0.1755492655006615, "survival_time": 11.100000000000025, "driven_lanedir": 1.089398066737926, "sim_render-ego": 0.06222968702917701, "in-drivable-lane": 0, "agent_compute-ego": 0.2187564942213866, "deviation-heading": 1.0819021207955215, "set_robot_commands": 0.0956454577746692, "deviation-center-line": 0.6547311690436711, "driven_lanedir_consec": 1.089398066737926, "sim_compute_sim_state": 0.03830818442611007, "sim_compute_performance-ego": 0.06880999041033221, "sim_compute_robot_state-ego": 0.07342293885377077, "sim_compute_robot_state-npc0": 0.0678481067623104, "sim_compute_robot_state-npc1": 0.06851398944854736, "sim_compute_robot_state-npc2": 0.06740132001069216, "sim_compute_robot_state-npc3": 0.06817142598263852}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0905640525577418, "sim_physics": 0.17415079018017193, "survival_time": 11.100000000000025, "driven_lanedir": 1.0602740770953571, "sim_render-ego": 0.061150357529923725, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.2240725820128982, "deviation-heading": 1.5069788016843646, "set_robot_commands": 0.09550375229603536, "deviation-center-line": 0.5222447262880785, "driven_lanedir_consec": 1.0602740770953571, "sim_compute_sim_state": 0.039470972241582095, "sim_compute_performance-ego": 0.06840553047420743, "sim_compute_robot_state-ego": 0.07615164700929108, "sim_compute_robot_state-npc0": 0.06705503420786815, "sim_compute_robot_state-npc1": 0.06755166010813671, "sim_compute_robot_state-npc2": 0.06895615818264249, "sim_compute_robot_state-npc3": 0.06990543356886855}}set_robot_commands_max 0.09569876896586396 set_robot_commands_mean 0.09254395788396708 set_robot_commands_median 0.09550375229603536 set_robot_commands_min 0.08074303415086534 sim_compute_performance-ego_max 0.06928354183832805 sim_compute_performance-ego_mean 0.06591822775052444 sim_compute_performance-ego_median 0.06840553047420743 sim_compute_performance-ego_min 0.057190703286064994 sim_compute_robot_state-ego_max 0.07615164700929108 sim_compute_robot_state-ego_mean 0.07060397036714675 sim_compute_robot_state-ego_median 0.07327213764190674 sim_compute_robot_state-ego_min 0.060601482391357424 sim_compute_robot_state-npc0_max 0.06833332402694628 sim_compute_robot_state-npc0_mean 0.06572424953645975 sim_compute_robot_state-npc0_median 0.06771150430043539 sim_compute_robot_state-npc0_min 0.0576732783847385 sim_compute_robot_state-npc1_max 0.06914646153288763 sim_compute_robot_state-npc1_mean 0.0661926200417567 sim_compute_robot_state-npc1_median 0.06838337500890096 sim_compute_robot_state-npc1_min 0.05736761411031088 sim_compute_robot_state-npc2_max 0.06895615818264249 sim_compute_robot_state-npc2_mean 0.06574593030467858 sim_compute_robot_state-npc2_median 0.06740132001069216 sim_compute_robot_state-npc2_min 0.05681360032823351 sim_compute_robot_state-npc3_max 0.06990543356886855 sim_compute_robot_state-npc3_mean 0.06591372878658257 sim_compute_robot_state-npc3_median 0.067257945664263 sim_compute_robot_state-npc3_min 0.0575874392191569 sim_compute_sim_state_max 0.039470972241582095 sim_compute_sim_state_mean 0.037447710917440834 sim_compute_sim_state_median 0.03836646172159536 sim_compute_sim_state_min 0.0325592835744222 sim_physics_max 0.1755492655006615 sim_physics_mean 0.16673849960337858 sim_physics_median 0.17415079018017193 sim_physics_min 0.1483206738366021 sim_render-ego_max 0.06401532808939615 sim_render-ego_mean 0.059576698299487155 sim_render-ego_median 0.061150357529923725 sim_render-ego_min 0.050730545255872936 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.750000000000032 survival_time_min 10.350000000000012
No reset possible 209082956Julian Zilly Baseline-IL-logs-tensorflow aido2-LF-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 14:58:27+00:00 2019-04-27 15:00:08+00:00 0:01:41 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2956/step1-simulation-ip-172-31-40-253-32125-job20908/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 208633094Angel Woo Baseline-IL-logs-tensorflow aido2-LF-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 14:00:32+00:00 2019-04-27 14:58:05+00:00 0:57:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.652255150972466 survival_time_median 12.700000000000044 deviation-center-line_median 0.5943657288271308 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2320159429640282 agent_compute-ego_mean 0.21135994987175735 agent_compute-ego_median 0.2072378178541573 agent_compute-ego_min 0.19647876898447672 deviation-center-line_max 1.2181863263529389 deviation-center-line_mean 0.6892383378628318 deviation-center-line_min 0.39643612401470296 deviation-heading_max 3.729066692860827 deviation-heading_mean 1.7391871930770029 deviation-heading_median 1.8018560795984804 deviation-heading_min 0.17215996026845026 driven_any_max 1.2199806443789412 driven_any_mean 0.8859284972630836 driven_any_median 0.9969059772208292 driven_any_min 0.2748826817340306 driven_lanedir_consec_max 1.217271625895482 driven_lanedir_consec_mean 0.7629735122232281 driven_lanedir_consec_min 0.26697291786930677 driven_lanedir_max 1.217271625895482 driven_lanedir_mean 0.7629735122232281 driven_lanedir_median 0.652255150972466 driven_lanedir_min 0.26697291786930677 in-drivable-lane_max 4.4000000000000625 in-drivable-lane_mean 1.120000000000016 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0201669667648516, "sim_physics": 0.1184430867433548, "survival_time": 12.800000000000049, "driven_lanedir": 0.6627720815820519, "sim_render-ego": 0.0651656948029995, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.2288930658251047, "deviation-heading": 3.729066692860827, "set_robot_commands": 0.10320324171334504, "deviation-center-line": 0.5792094112502033, "driven_lanedir_consec": 0.6627720815820519, "sim_compute_sim_state": 0.039981553331017494, "sim_compute_performance-ego": 0.07258726470172405, "sim_compute_robot_state-ego": 0.07866801414638758}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9941770199714104, "sim_physics": 0.11479715474947232, "survival_time": 12.700000000000044, "driven_lanedir": 0.8074185113640052, "sim_render-ego": 0.06307201310405582, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2320159429640282, "deviation-heading": 2.827465464835728, "set_robot_commands": 0.09936835634426808, "deviation-center-line": 0.7844092783452012, "driven_lanedir_consec": 0.8074185113640052, "sim_compute_sim_state": 0.03957696036091001, "sim_compute_performance-ego": 0.06951928044867328, "sim_compute_robot_state-ego": 0.07784934306707908}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2748826817340306, "sim_physics": 0.10753151257832844, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2681315282026988, "sim_render-ego": 0.060503390630086265, "in-drivable-lane": 0, "agent_compute-ego": 0.20063360214233397, "deviation-heading": 0.824721480245467, "set_robot_commands": 0.0921766757965088, "deviation-center-line": 0.41208278787592406, "driven_lanedir_consec": 0.2681315282026988, "sim_compute_sim_state": 0.03598797162373861, "sim_compute_performance-ego": 0.0647342300415039, "sim_compute_robot_state-ego": 0.06912945111592611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4685728698403183, "sim_physics": 0.10374456397758045, "survival_time": 6.0499999999999865, "driven_lanedir": 0.44779928188363494, "sim_render-ego": 0.0580448513188638, "in-drivable-lane": 0, "agent_compute-ego": 0.19841904876645933, "deviation-heading": 1.8018560795984804, "set_robot_commands": 0.09040370657424296, "deviation-center-line": 0.45016597316138546, "driven_lanedir_consec": 0.44779928188363494, "sim_compute_sim_state": 0.03735212058075203, "sim_compute_performance-ego": 0.0656654677115196, "sim_compute_robot_state-ego": 0.06904468457560894}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2024656934674065, "sim_physics": 0.11652849912643432, "survival_time": 14.950000000000076, "driven_lanedir": 1.177550943827185, "sim_render-ego": 0.06258933464686076, "in-drivable-lane": 0, "agent_compute-ego": 0.2271674370765686, "deviation-heading": 1.8107245511094463, "set_robot_commands": 0.09731629133224488, "deviation-center-line": 0.7387680017097676, "driven_lanedir_consec": 1.177550943827185, "sim_compute_sim_state": 0.03917797883351644, "sim_compute_performance-ego": 0.07058555444081624, "sim_compute_robot_state-ego": 0.07755951166152954}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4809549524743351, "sim_physics": 0.11657123717050703, "survival_time": 6.299999999999986, "driven_lanedir": 0.4577779763941332, "sim_render-ego": 0.05678807743011959, "in-drivable-lane": 0, "agent_compute-ego": 0.19867401085202657, "deviation-heading": 1.939313216933653, "set_robot_commands": 0.09143074921199254, "deviation-center-line": 0.49326262669181176, "driven_lanedir_consec": 0.4577779763941332, "sim_compute_sim_state": 0.038215192537459114, "sim_compute_performance-ego": 0.0651724414219932, "sim_compute_robot_state-ego": 0.06635513002910311}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.998269077074832, "sim_physics": 0.11948437108768252, "survival_time": 12.700000000000044, "driven_lanedir": 0.615917012450867, "sim_render-ego": 0.06314179653257836, "in-drivable-lane": 4.4000000000000625, "agent_compute-ego": 0.22863367598826492, "deviation-heading": 1.8538379616604452, "set_robot_commands": 0.09883517918624277, "deviation-center-line": 0.5019883499777812, "driven_lanedir_consec": 0.615917012450867, "sim_compute_sim_state": 0.040591695177273485, "sim_compute_performance-ego": 0.07164035162587803, "sim_compute_robot_state-ego": 0.07745359826275683}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2749736369825207, "sim_physics": 0.10338249524434408, "survival_time": 3.7499999999999942, "driven_lanedir": 0.26697291786930677, "sim_render-ego": 0.058799765904744464, "in-drivable-lane": 0, "agent_compute-ego": 0.202016814549764, "deviation-heading": 0.8975090875142229, "set_robot_commands": 0.09088573137919108, "deviation-center-line": 0.39643612401470296, "driven_lanedir_consec": 0.26697291786930677, "sim_compute_sim_state": 0.0364789358774821, "sim_compute_performance-ego": 0.06382635116577148, "sim_compute_robot_state-ego": 0.07043227513631185}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.205281109718533, "sim_physics": 0.12100523789723716, "survival_time": 14.950000000000076, "driven_lanedir": 1.2028575181014998, "sim_render-ego": 0.06413018862406412, "in-drivable-lane": 0, "agent_compute-ego": 0.2307079823811849, "deviation-heading": 0.7095458329423281, "set_robot_commands": 0.09809263388315836, "deviation-center-line": 0.9600869493681972, "driven_lanedir_consec": 1.2028575181014998, "sim_compute_sim_state": 0.039794812202453615, "sim_compute_performance-ego": 0.07149607181549072, "sim_compute_robot_state-ego": 0.07917014042536417}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9969059772208292, "sim_physics": 0.11099631947825156, "survival_time": 12.550000000000043, "driven_lanedir": 0.6467338351540284, "sim_render-ego": 0.060813433620559264, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.20732438611794277, "deviation-heading": 2.955391341360599, "set_robot_commands": 0.09175865013760874, "deviation-center-line": 0.670951210760338, "driven_lanedir_consec": 0.6467338351540284, "sim_compute_sim_state": 0.03833502982242174, "sim_compute_performance-ego": 0.06691440073142489, "sim_compute_robot_state-ego": 0.07056484184417117}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.2065131329376906, "sim_physics": 0.1073916761080424, "survival_time": 14.950000000000076, "driven_lanedir": 1.181511992560742, "sim_render-ego": 0.05711821635564168, "in-drivable-lane": 0, "agent_compute-ego": 0.19712116479873656, "deviation-heading": 1.2734616012296878, "set_robot_commands": 0.08727649768193563, "deviation-center-line": 1.052830292075256, "driven_lanedir_consec": 1.181511992560742, "sim_compute_sim_state": 0.03614063342412313, "sim_compute_performance-ego": 0.06259420474370321, "sim_compute_robot_state-ego": 0.06924530824025472}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9935781905505376, "sim_physics": 0.10640755776436098, "survival_time": 12.40000000000004, "driven_lanedir": 0.652255150972466, "sim_render-ego": 0.059939111432721535, "in-drivable-lane": 3.1500000000000448, "agent_compute-ego": 0.2007487666222357, "deviation-heading": 2.900605902152334, "set_robot_commands": 0.08920814914088096, "deviation-center-line": 0.5943657288271308, "driven_lanedir_consec": 0.652255150972466, "sim_compute_sim_state": 0.03718135337675771, "sim_compute_performance-ego": 0.06420587243572358, "sim_compute_robot_state-ego": 0.06835123415916197}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7528689410570975, "sim_physics": 0.1099923755485974, "survival_time": 9.55, "driven_lanedir": 0.6404451449597168, "sim_render-ego": 0.060958481583919824, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.2072378178541573, "deviation-heading": 1.6950173132973425, "set_robot_commands": 0.09223665991378704, "deviation-center-line": 0.4787678830209627, "driven_lanedir_consec": 0.6404451449597168, "sim_compute_sim_state": 0.03924020422690826, "sim_compute_performance-ego": 0.06608385939872702, "sim_compute_robot_state-ego": 0.07318432418463743}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.2199806443789412, "sim_physics": 0.09899160782496134, "survival_time": 14.950000000000076, "driven_lanedir": 1.217271625895482, "sim_render-ego": 0.05874826192855835, "in-drivable-lane": 0, "agent_compute-ego": 0.19647876898447672, "deviation-heading": 0.6971314101460321, "set_robot_commands": 0.08844446897506714, "deviation-center-line": 1.0070641245108762, "driven_lanedir_consec": 1.217271625895482, "sim_compute_sim_state": 0.03724103848139445, "sim_compute_performance-ego": 0.0651290202140808, "sim_compute_robot_state-ego": 0.06884069840113322}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.199336564772919, "sim_physics": 0.10606984376907348, "survival_time": 14.950000000000076, "driven_lanedir": 1.1991871621306025, "sim_render-ego": 0.060599629084269205, "in-drivable-lane": 0, "agent_compute-ego": 0.21432676315307617, "deviation-heading": 0.17215996026845026, "set_robot_commands": 0.09620875835418702, "deviation-center-line": 1.2181863263529389, "driven_lanedir_consec": 1.1991871621306025, "sim_compute_sim_state": 0.03831042846043905, "sim_compute_performance-ego": 0.06761361360549926, "sim_compute_robot_state-ego": 0.07320789734522502}}set_robot_commands_max 0.10320324171334504 set_robot_commands_mean 0.09378971664164408 set_robot_commands_median 0.0921766757965088 set_robot_commands_min 0.08727649768193563 sim_compute_performance-ego_max 0.07258726470172405 sim_compute_performance-ego_mean 0.06718453230016862 sim_compute_performance-ego_median 0.06608385939872702 sim_compute_performance-ego_min 0.06259420474370321 sim_compute_robot_state-ego_max 0.07917014042536417 sim_compute_robot_state-ego_mean 0.07260376350631007 sim_compute_robot_state-ego_median 0.07056484184417117 sim_compute_robot_state-ego_min 0.06635513002910311 sim_compute_sim_state_max 0.040591695177273485 sim_compute_sim_state_mean 0.03824039388777649 sim_compute_sim_state_median 0.03831042846043905 sim_compute_sim_state_min 0.03598797162373861 sim_physics_max 0.12100523789723716 sim_physics_mean 0.1107558359378819 sim_physics_median 0.1099923755485974 sim_physics_min 0.09899160782496134 sim_render-ego_max 0.0651656948029995 sim_render-ego_mean 0.06069414980000284 sim_render-ego_median 0.060599629084269205 sim_render-ego_min 0.05678807743011959 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.15333333333337 survival_time_min 3.7499999999999942
No reset possible 208253103Angel Woo HKU Duckietown Project aido2-LFVI-sim-validationstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 13:20:46+00:00 2019-04-27 14:00:11+00:00 0:39:25 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission3103/step1-simulation-ip-172-31-40-253-32125-job20825/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 208143098Angel Woo Baseline-IL-logs-tensorflow aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 13:02:47+00:00 2019-04-27 13:20:23+00:00 0:17:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6598371424985265 survival_time_median 12.700000000000044 deviation-center-line_median 0.5590522799667327 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.2225304551011934 agent_compute-ego_mean 0.1968691551071597 agent_compute-ego_median 0.19717985299917368 agent_compute-ego_min 0.16965189933776856 deviation-center-line_max 0.7872862890280112 deviation-center-line_mean 0.5986334526877457 deviation-center-line_min 0.41204056126990873 deviation-heading_max 3.640376753824344 deviation-heading_mean 2.161012834280368 deviation-heading_median 1.7991292024025216 deviation-heading_min 0.8259550698828816 driven_any_max 1.2028082364111887 driven_any_mean 0.7977203411626179 driven_any_median 0.9942557138612448 driven_any_min 0.27465538527993477 driven_lanedir_consec_max 1.1780475662129564 driven_lanedir_consec_mean 0.6797150309900397 driven_lanedir_consec_min 0.2678934561890487 driven_lanedir_max 1.1780475662129564 driven_lanedir_mean 0.6797150309900397 driven_lanedir_median 0.6598371424985265 driven_lanedir_min 0.2678934561890487 in-drivable-lane_max 3.2000000000000455 in-drivable-lane_mean 0.9700000000000136 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.01337397690204, "sim_physics": 0.11392380496648354, "survival_time": 12.700000000000044, "driven_lanedir": 0.6598371424985265, "sim_render-ego": 0.0623000963466374, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.2225304551011934, "deviation-heading": 3.640376753824344, "set_robot_commands": 0.09774027565332848, "deviation-center-line": 0.5590522799667327, "driven_lanedir_consec": 0.6598371424985265, "sim_compute_sim_state": 0.03960118519039604, "sim_compute_performance-ego": 0.07236295140634372, "sim_compute_robot_state-ego": 0.07659012783230759}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9942557138612448, "sim_physics": 0.10600093969209928, "survival_time": 12.700000000000044, "driven_lanedir": 0.807276422439798, "sim_render-ego": 0.06132972428179163, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.2066578029647587, "deviation-heading": 2.8351837675368405, "set_robot_commands": 0.09298288822174072, "deviation-center-line": 0.7872862890280112, "driven_lanedir_consec": 0.807276422439798, "sim_compute_sim_state": 0.0383803309418085, "sim_compute_performance-ego": 0.07094417500683642, "sim_compute_robot_state-ego": 0.07299999927911233}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.27465538527993477, "sim_physics": 0.08686061223347982, "survival_time": 3.7499999999999942, "driven_lanedir": 0.2678934561890487, "sim_render-ego": 0.05090576171875, "in-drivable-lane": 0, "agent_compute-ego": 0.16965189933776856, "deviation-heading": 0.8259550698828816, "set_robot_commands": 0.07160767237345378, "deviation-center-line": 0.41204056126990873, "driven_lanedir_consec": 0.2678934561890487, "sim_compute_sim_state": 0.03366891225179036, "sim_compute_performance-ego": 0.05505241394042969, "sim_compute_robot_state-ego": 0.05897941589355469}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.503508393358682, "sim_physics": 0.10991576818319468, "survival_time": 6.499999999999985, "driven_lanedir": 0.48552056760986906, "sim_render-ego": 0.058120153500483586, "in-drivable-lane": 0, "agent_compute-ego": 0.19717985299917368, "deviation-heading": 1.7044193777552517, "set_robot_commands": 0.08809543756338266, "deviation-center-line": 0.5044204827108707, "driven_lanedir_consec": 0.48552056760986906, "sim_compute_sim_state": 0.03652212069584773, "sim_compute_performance-ego": 0.0643525270315317, "sim_compute_robot_state-ego": 0.0707814179933988}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2028082364111887, "sim_physics": 0.09796469926834106, "survival_time": 14.950000000000076, "driven_lanedir": 1.1780475662129564, "sim_render-ego": 0.05450901349385579, "in-drivable-lane": 0, "agent_compute-ego": 0.18832576513290403, "deviation-heading": 1.7991292024025216, "set_robot_commands": 0.0808334485689799, "deviation-center-line": 0.7303676504632048, "driven_lanedir_consec": 1.1780475662129564, "sim_compute_sim_state": 0.03503521283467611, "sim_compute_performance-ego": 0.0607208251953125, "sim_compute_robot_state-ego": 0.06447539885838827}}set_robot_commands_max 0.09774027565332848 set_robot_commands_mean 0.08625194447617711 set_robot_commands_median 0.08809543756338266 set_robot_commands_min 0.07160767237345378 sim_compute_performance-ego_max 0.07236295140634372 sim_compute_performance-ego_mean 0.0646865785160908 sim_compute_performance-ego_median 0.0643525270315317 sim_compute_performance-ego_min 0.05505241394042969 sim_compute_robot_state-ego_max 0.07659012783230759 sim_compute_robot_state-ego_mean 0.06876527197135233 sim_compute_robot_state-ego_median 0.0707814179933988 sim_compute_robot_state-ego_min 0.05897941589355469 sim_compute_sim_state_max 0.03960118519039604 sim_compute_sim_state_mean 0.03664155238290375 sim_compute_sim_state_median 0.03652212069584773 sim_compute_sim_state_min 0.03366891225179036 sim_physics_max 0.11392380496648354 sim_physics_mean 0.10293316486871967 sim_physics_median 0.10600093969209928 sim_physics_min 0.08686061223347982 sim_render-ego_max 0.0623000963466374 sim_render-ego_mean 0.05743294986830368 sim_render-ego_median 0.058120153500483586 sim_render-ego_min 0.05090576171875 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.12000000000003 survival_time_min 3.7499999999999942
No reset possible 207922711Rami Al-Naim challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testingstep1-simulation host-error no ip-172-31-40-253-321252019-04-27 12:17:32+00:00 2019-04-27 13:00:11+00:00 0:42:39 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2711/step1-simulation-ip-172-31-40-253-32125-job20792/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 207832948Bhairav Mehta Baseline solution using reinforcement learning aido2-LFV-sim-testingstep1-simulation success no ip-172-31-40-253-321252019-04-27 12:01:37+00:00 2019-04-27 12:17:25+00:00 0:15:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.07336884822093293 survival_time_median 1.4000000000000006 deviation-center-line_median 0.0732871370133959 in-drivable-lane_median 0.15000000000000013
other stats agent_compute-ego_max 0.2054191082715988 agent_compute-ego_mean 0.17042379751882183 agent_compute-ego_median 0.1674383735656738 agent_compute-ego_min 0.15852483419271615 deviation-center-line_max 0.09927559900980888 deviation-center-line_mean 0.06883283127434418 deviation-center-line_min 0.02984780938027378 deviation-heading_max 0.8403546411494442 deviation-heading_mean 0.713675317570529 deviation-heading_median 0.7127266116702192 deviation-heading_min 0.5859166488737421 driven_any_max 0.25976669683285925 driven_any_mean 0.16195883875875125 driven_any_median 0.1612170316471997 driven_any_min 0.09164340014056983 driven_lanedir_consec_max 0.14880946860988287 driven_lanedir_consec_mean 0.0819097162362669 driven_lanedir_consec_min 0.05072700220150361 driven_lanedir_max 0.14880946860988287 driven_lanedir_mean 0.0819097162362669 driven_lanedir_median 0.07336884822093293 driven_lanedir_min 0.05072700220150361 in-drivable-lane_max 0.5500000000000005 in-drivable-lane_mean 0.2133333333333335 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21051028050498505, "sim_physics": 0.16633456200361252, "survival_time": 1.6000000000000008, "driven_lanedir": 0.0963425936883926, "sim_render-ego": 0.0645846500992775, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.2054191082715988, "deviation-heading": 0.80550285007791, "set_robot_commands": 0.11682388931512833, "deviation-center-line": 0.07236174745674463, "driven_lanedir_consec": 0.0963425936883926, "sim_compute_sim_state": 0.04015665501356125, "sim_compute_performance-ego": 0.07366325706243515, "sim_compute_robot_state-ego": 0.08264992386102676, "sim_compute_robot_state-npc0": 0.07471173256635666, "sim_compute_robot_state-npc1": 0.07551795989274979, "sim_compute_robot_state-npc2": 0.07312508672475815, "sim_compute_robot_state-npc3": 0.0695357546210289}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2203880496612171, "sim_physics": 0.15231763232838025, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08427062679418329, "sim_render-ego": 0.05944902969129158, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16193174593376392, "deviation-heading": 0.8403546411494442, "set_robot_commands": 0.10058883464697636, "deviation-center-line": 0.0612900800920389, "driven_lanedir_consec": 0.08427062679418329, "sim_compute_sim_state": 0.03970965472134677, "sim_compute_performance-ego": 0.0677167357820453, "sim_compute_robot_state-ego": 0.08318624351963852, "sim_compute_robot_state-npc0": 0.06779555118445194, "sim_compute_robot_state-npc1": 0.06834076390121922, "sim_compute_robot_state-npc2": 0.0686325232187907, "sim_compute_robot_state-npc3": 0.06857726790688255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10613853499021232, "sim_physics": 0.13537915893222974, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06396634751537045, "sim_render-ego": 0.06299128739730171, "in-drivable-lane": 0, "agent_compute-ego": 0.16092376087022864, "deviation-heading": 0.6344723107144671, "set_robot_commands": 0.09477081506148628, "deviation-center-line": 0.09927559900980888, "driven_lanedir_consec": 0.06396634751537045, "sim_compute_sim_state": 0.037165289339811905, "sim_compute_performance-ego": 0.06332438925038213, "sim_compute_robot_state-ego": 0.07294202887493631, "sim_compute_robot_state-npc0": 0.0700441547062086, "sim_compute_robot_state-npc1": 0.06505175258802331, "sim_compute_robot_state-npc2": 0.06656365809233292, "sim_compute_robot_state-npc3": 0.06687510531881581}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.0974878218929462, "sim_physics": 0.151317430579144, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05417911680147869, "sim_render-ego": 0.06250050793523373, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16443399761034094, "deviation-heading": 0.6101214557687102, "set_robot_commands": 0.0940440323041833, "deviation-center-line": 0.08686164342757771, "driven_lanedir_consec": 0.05417911680147869, "sim_compute_sim_state": 0.04066746131233547, "sim_compute_performance-ego": 0.06296098750570546, "sim_compute_robot_state-ego": 0.07556292285089908, "sim_compute_robot_state-npc0": 0.06105033211086107, "sim_compute_robot_state-npc1": 0.06476829362952191, "sim_compute_robot_state-npc2": 0.06700925205064856, "sim_compute_robot_state-npc3": 0.06903785207997197}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13752311256913655, "sim_physics": 0.14432857513427735, "survival_time": 1.2500000000000004, "driven_lanedir": 0.05786806377695575, "sim_render-ego": 0.0625808048248291, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1674383735656738, "deviation-heading": 0.7687805796792904, "set_robot_commands": 0.0909904670715332, "deviation-center-line": 0.04117156285120275, "driven_lanedir_consec": 0.05786806377695575, "sim_compute_sim_state": 0.03550129890441894, "sim_compute_performance-ego": 0.06949165344238281, "sim_compute_robot_state-ego": 0.07608709335327149, "sim_compute_robot_state-npc0": 0.06754276275634766, "sim_compute_robot_state-npc1": 0.06270689010620117, "sim_compute_robot_state-npc2": 0.06710735321044922, "sim_compute_robot_state-npc3": 0.06328781127929688}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.22416469398745703, "sim_physics": 0.15242879920535618, "survival_time": 1.800000000000001, "driven_lanedir": 0.10717809538602908, "sim_render-ego": 0.060624380906422935, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1663951145278083, "deviation-heading": 0.8068043332951751, "set_robot_commands": 0.09407791164186266, "deviation-center-line": 0.06023510197645899, "driven_lanedir_consec": 0.10717809538602908, "sim_compute_sim_state": 0.04030623700883654, "sim_compute_performance-ego": 0.06722021102905273, "sim_compute_robot_state-ego": 0.07264224025938246, "sim_compute_robot_state-npc0": 0.06982033120261298, "sim_compute_robot_state-npc1": 0.06496633423699273, "sim_compute_robot_state-npc2": 0.07418561644024319, "sim_compute_robot_state-npc3": 0.06843414571550158}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12325169386004514, "sim_physics": 0.13839645819230514, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08218386800002253, "sim_render-ego": 0.06469035148620605, "in-drivable-lane": 0, "agent_compute-ego": 0.17232257669622247, "deviation-heading": 0.5859166488737421, "set_robot_commands": 0.08945060860026967, "deviation-center-line": 0.07718980767164355, "driven_lanedir_consec": 0.08218386800002253, "sim_compute_sim_state": 0.03541482578624378, "sim_compute_performance-ego": 0.06771005283702504, "sim_compute_robot_state-ego": 0.07400864904577081, "sim_compute_robot_state-npc0": 0.0670571977441961, "sim_compute_robot_state-npc1": 0.0650386160070246, "sim_compute_robot_state-npc2": 0.06298741427334872, "sim_compute_robot_state-npc3": 0.06621949239210649}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1400466022073499, "sim_physics": 0.14211932512430045, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09956581797234998, "sim_render-ego": 0.05974249656383808, "in-drivable-lane": 0, "agent_compute-ego": 0.15852483419271615, "deviation-heading": 0.6644532476315568, "set_robot_commands": 0.08986346538250263, "deviation-center-line": 0.09873360836728098, "driven_lanedir_consec": 0.09956581797234998, "sim_compute_sim_state": 0.03896515186016376, "sim_compute_performance-ego": 0.06692642431992751, "sim_compute_robot_state-ego": 0.07288177196796124, "sim_compute_robot_state-npc0": 0.06460335621467003, "sim_compute_robot_state-npc1": 0.06951280740591195, "sim_compute_robot_state-npc2": 0.07169834467080924, "sim_compute_robot_state-npc3": 0.06883712915273812}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1612170316471997, "sim_physics": 0.1523604052407401, "survival_time": 1.4000000000000006, "driven_lanedir": 0.07336884822093293, "sim_render-ego": 0.05799331835338047, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17838817834854126, "deviation-heading": 0.7698789733603542, "set_robot_commands": 0.0985828297478812, "deviation-center-line": 0.04157525376988617, "driven_lanedir_consec": 0.07336884822093293, "sim_compute_sim_state": 0.03599071502685547, "sim_compute_performance-ego": 0.06697362661361694, "sim_compute_robot_state-ego": 0.06678639139447894, "sim_compute_robot_state-npc0": 0.06761880431856428, "sim_compute_robot_state-npc1": 0.06269233567374093, "sim_compute_robot_state-npc2": 0.06590077706745692, "sim_compute_robot_state-npc3": 0.06532543046133858}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1697873881619318, "sim_physics": 0.14261201120192005, "survival_time": 1.5500000000000007, "driven_lanedir": 0.05072700220150361, "sim_render-ego": 0.056172001746393016, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1766384417010892, "deviation-heading": 0.7044519204322229, "set_robot_commands": 0.09795713424682616, "deviation-center-line": 0.031953343451368625, "driven_lanedir_consec": 0.05072700220150361, "sim_compute_sim_state": 0.03893840697503859, "sim_compute_performance-ego": 0.06452805765213505, "sim_compute_robot_state-ego": 0.0721176593534408, "sim_compute_robot_state-npc0": 0.06976044562555128, "sim_compute_robot_state-npc1": 0.07142766060367707, "sim_compute_robot_state-npc2": 0.07192680912633095, "sim_compute_robot_state-npc3": 0.06907743792380056}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.17578804771209616, "sim_physics": 0.1730941851933797, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06053104045808455, "sim_render-ego": 0.07036693890889485, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1747828722000122, "deviation-heading": 0.7127266116702192, "set_robot_commands": 0.1000562032063802, "deviation-center-line": 0.02984780938027378, "driven_lanedir_consec": 0.06053104045808455, "sim_compute_sim_state": 0.04100948174794515, "sim_compute_performance-ego": 0.07461055914560953, "sim_compute_robot_state-ego": 0.08141412734985351, "sim_compute_robot_state-npc0": 0.06758159796396891, "sim_compute_robot_state-npc1": 0.07090198993682861, "sim_compute_robot_state-npc2": 0.06758381525675455, "sim_compute_robot_state-npc3": 0.07160505453745523}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09164340014056983, "sim_physics": 0.1303141951560974, "survival_time": 1.0000000000000002, "driven_lanedir": 0.05144946345821699, "sim_render-ego": 0.06189124584197998, "in-drivable-lane": 0, "agent_compute-ego": 0.16693544387817383, "deviation-heading": 0.6229540685221542, "set_robot_commands": 0.10379698276519776, "deviation-center-line": 0.08438683824082889, "driven_lanedir_consec": 0.05144946345821699, "sim_compute_sim_state": 0.040281486511230466, "sim_compute_performance-ego": 0.07045433521270753, "sim_compute_robot_state-ego": 0.07771904468536377, "sim_compute_robot_state-npc0": 0.07220423221588135, "sim_compute_robot_state-npc1": 0.07226500511169434, "sim_compute_robot_state-npc2": 0.0745496392250061, "sim_compute_robot_state-npc3": 0.07752554416656494}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.25976669683285925, "sim_physics": 0.16448379174256936, "survival_time": 1.950000000000001, "driven_lanedir": 0.126854357664394, "sim_render-ego": 0.060164219293838896, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16935187119704026, "deviation-heading": 0.7367450418714607, "set_robot_commands": 0.09552159064855333, "deviation-center-line": 0.0732871370133959, "driven_lanedir_consec": 0.126854357664394, "sim_compute_sim_state": 0.037775339224399664, "sim_compute_performance-ego": 0.06383678240653796, "sim_compute_robot_state-ego": 0.06877852097535744, "sim_compute_robot_state-npc0": 0.06860972673465045, "sim_compute_robot_state-npc1": 0.06871603696774213, "sim_compute_robot_state-npc2": 0.06807153041546161, "sim_compute_robot_state-npc3": 0.06336234777401654}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.110695936196308, "sim_physics": 0.14271215959028763, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07135103299620615, "sim_render-ego": 0.0627175352790139, "in-drivable-lane": 0, "agent_compute-ego": 0.16949028318578546, "deviation-heading": 0.6220573442431828, "set_robot_commands": 0.08941971171985973, "deviation-center-line": 0.08592848657170857, "driven_lanedir_consec": 0.07135103299620615, "sim_compute_sim_state": 0.039582469246604225, "sim_compute_performance-ego": 0.06669584187594327, "sim_compute_robot_state-ego": 0.07525601170279762, "sim_compute_robot_state-npc0": 0.06756622141057794, "sim_compute_robot_state-npc1": 0.066169489513744, "sim_compute_robot_state-npc2": 0.06917135281996294, "sim_compute_robot_state-npc3": 0.06831638379530473}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.20097329101695496, "sim_physics": 0.14240445295969645, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14880946860988287, "sim_render-ego": 0.060965681076049806, "in-drivable-lane": 0, "agent_compute-ego": 0.16338036060333253, "deviation-heading": 0.819909736268047, "set_robot_commands": 0.09483475685119629, "deviation-center-line": 0.08839444983494438, "driven_lanedir_consec": 0.14880946860988287, "sim_compute_sim_state": 0.03727382024129232, "sim_compute_performance-ego": 0.06303073565165201, "sim_compute_robot_state-ego": 0.07095150947570801, "sim_compute_robot_state-npc0": 0.06690742174784342, "sim_compute_robot_state-npc1": 0.06642405986785889, "sim_compute_robot_state-npc2": 0.06611153284708658, "sim_compute_robot_state-npc3": 0.06401472091674805}}set_robot_commands_max 0.11682388931512833 set_robot_commands_mean 0.09671861554732249 set_robot_commands_median 0.09483475685119629 set_robot_commands_min 0.08941971171985973 sim_compute_performance-ego_max 0.07461055914560953 sim_compute_performance-ego_mean 0.06727624331914389 sim_compute_performance-ego_median 0.06697362661361694 sim_compute_performance-ego_min 0.06296098750570546 sim_compute_robot_state-ego_max 0.08318624351963852 sim_compute_robot_state-ego_mean 0.07486560924465913 sim_compute_robot_state-ego_median 0.07400864904577081 sim_compute_robot_state-ego_min 0.06678639139447894 sim_compute_robot_state-npc0_max 0.07471173256635666 sim_compute_robot_state-npc0_mean 0.06819159123351617 sim_compute_robot_state-npc0_median 0.06761880431856428 sim_compute_robot_state-npc0_min 0.06105033211086107 sim_compute_robot_state-npc1_max 0.07551795989274979 sim_compute_robot_state-npc1_mean 0.0676333330295287 sim_compute_robot_state-npc1_median 0.06642405986785889 sim_compute_robot_state-npc1_min 0.06269233567374093 sim_compute_robot_state-npc2_max 0.0745496392250061 sim_compute_robot_state-npc2_mean 0.06897498036262936 sim_compute_robot_state-npc2_median 0.06807153041546161 sim_compute_robot_state-npc2_min 0.06298741427334872 sim_compute_robot_state-npc3_max 0.07752554416656494 sim_compute_robot_state-npc3_mean 0.06800209853610473 sim_compute_robot_state-npc3_median 0.06843414571550158 sim_compute_robot_state-npc3_min 0.06328781127929688 sim_compute_sim_state_max 0.04100948174794515 sim_compute_sim_state_mean 0.03858255286133896 sim_compute_sim_state_median 0.03896515186016376 sim_compute_sim_state_min 0.03541482578624378 sim_physics_max 0.1730941851933797 sim_physics_mean 0.14870687617228642 sim_physics_median 0.14432857513427735 sim_physics_min 0.1303141951560974 sim_render-ego_max 0.07036693890889485 sim_render-ego_mean 0.06182896329359678 sim_render-ego_median 0.06189124584197998 sim_render-ego_min 0.056172001746393016 simulation-passed 1 survival_time_max 1.950000000000001 survival_time_mean 1.4000000000000006 survival_time_min 1.0000000000000002
No reset possible 207623102Angel Woo HKU Duckietown Project aido2-LF-sim-validationstep1-simulation success no ip-172-31-40-253-321252019-04-27 11:19:03+00:00 2019-04-27 11:49:14+00:00 0:30:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.36791156234879674 survival_time_median 14.950000000000076 deviation-center-line_median 0.6472548626904036 in-drivable-lane_median 5.80000000000004
other stats agent_compute-ego_max 0.2814123217264811 agent_compute-ego_mean 0.273858667955052 agent_compute-ego_median 0.27630531694740057 agent_compute-ego_min 0.2636148675282796 deviation-center-line_max 1.0090124703417471 deviation-center-line_mean 0.6680155709191 deviation-center-line_min 0.5013052448207894 deviation-heading_max 3.2918678922153752 deviation-heading_mean 2.089899194433809 deviation-heading_median 1.723438920462811 deviation-heading_min 1.183306541036224 driven_any_max 0.9413353686956848 driven_any_mean 0.8631389341589726 driven_any_median 0.9284267868522184 driven_any_min 0.7023037940363579 driven_lanedir_consec_max 0.8172007618583774 driven_lanedir_consec_mean 0.5169365903594216 driven_lanedir_consec_min 0.31759607477162977 driven_lanedir_max 0.8172007618583774 driven_lanedir_mean 0.5169365903594216 driven_lanedir_median 0.36791156234879674 driven_lanedir_min 0.31759607477162977 in-drivable-lane_max 9.150000000000093 in-drivable-lane_mean 5.050000000000049 in-drivable-lane_min 1.500000000000021 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8073308460441609, "sim_physics": 0.15549463592469692, "survival_time": 12.800000000000049, "driven_lanedir": 0.36791156234879674, "sim_render-ego": 0.07092324271798134, "in-drivable-lane": 6.700000000000061, "agent_compute-ego": 0.27630531694740057, "deviation-heading": 1.183306541036224, "set_robot_commands": 0.11382975056767464, "deviation-center-line": 0.6472548626904036, "driven_lanedir_consec": 0.36791156234879674, "sim_compute_sim_state": 0.04432407207787037, "sim_compute_performance-ego": 0.08007594756782055, "sim_compute_robot_state-ego": 0.093303800560534}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9284267868522184, "sim_physics": 0.15397507031758623, "survival_time": 14.950000000000076, "driven_lanedir": 0.3204657462001923, "sim_render-ego": 0.07152517477671305, "in-drivable-lane": 9.150000000000093, "agent_compute-ego": 0.26828678766886394, "deviation-heading": 1.723438920462811, "set_robot_commands": 0.11492041110992432, "deviation-center-line": 0.5013052448207894, "driven_lanedir_consec": 0.3204657462001923, "sim_compute_sim_state": 0.04395975589752197, "sim_compute_performance-ego": 0.07962816953659058, "sim_compute_robot_state-ego": 0.0892376716931661}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9362978751664404, "sim_physics": 0.15637959400812784, "survival_time": 14.950000000000076, "driven_lanedir": 0.7615088066181119, "sim_render-ego": 0.07134719212849935, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.2636148675282796, "deviation-heading": 3.2918678922153752, "set_robot_commands": 0.1117558232943217, "deviation-center-line": 1.0090124703417471, "driven_lanedir_consec": 0.7615088066181119, "sim_compute_sim_state": 0.04333494106928507, "sim_compute_performance-ego": 0.07876633803049723, "sim_compute_robot_state-ego": 0.08977546532948812}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9413353686956848, "sim_physics": 0.17478206475575764, "survival_time": 14.950000000000076, "driven_lanedir": 0.8172007618583774, "sim_render-ego": 0.07268193403879801, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.2814123217264811, "deviation-heading": 2.7588748142312776, "set_robot_commands": 0.11744006315867106, "deviation-center-line": 0.6557362223239055, "driven_lanedir_consec": 0.8172007618583774, "sim_compute_sim_state": 0.04596936782201131, "sim_compute_performance-ego": 0.08196083068847657, "sim_compute_robot_state-ego": 0.0927257784207662}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7023037940363579, "sim_physics": 0.15366557487754323, "survival_time": 11.450000000000028, "driven_lanedir": 0.31759607477162977, "sim_render-ego": 0.0713103390156442, "in-drivable-lane": 5.80000000000004, "agent_compute-ego": 0.2796740459042345, "deviation-heading": 1.4920078042233549, "set_robot_commands": 0.11506162043742216, "deviation-center-line": 0.5267690544186545, "driven_lanedir_consec": 0.31759607477162977, "sim_compute_sim_state": 0.043948968945632334, "sim_compute_performance-ego": 0.08098043520898278, "sim_compute_robot_state-ego": 0.09118191019416376}}set_robot_commands_max 0.11744006315867106 set_robot_commands_mean 0.11460153371360278 set_robot_commands_median 0.11492041110992432 set_robot_commands_min 0.1117558232943217 sim_compute_performance-ego_max 0.08196083068847657 sim_compute_performance-ego_mean 0.08028234420647354 sim_compute_performance-ego_median 0.08007594756782055 sim_compute_performance-ego_min 0.07876633803049723 sim_compute_robot_state-ego_max 0.093303800560534 sim_compute_robot_state-ego_mean 0.09124492523962364 sim_compute_robot_state-ego_median 0.09118191019416376 sim_compute_robot_state-ego_min 0.0892376716931661 sim_compute_sim_state_max 0.04596936782201131 sim_compute_sim_state_mean 0.04430742116246421 sim_compute_sim_state_median 0.04395975589752197 sim_compute_sim_state_min 0.04333494106928507 sim_physics_max 0.17478206475575764 sim_physics_mean 0.15885938797674237 sim_physics_median 0.15549463592469692 sim_physics_min 0.15366557487754323 sim_render-ego_max 0.07268193403879801 sim_render-ego_mean 0.07155757653552719 sim_render-ego_median 0.07134719212849935 sim_render-ego_min 0.07092324271798134 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 13.82000000000006 survival_time_min 11.450000000000028
No reset possible
Sean Lu
Anastasiya Nikolskaya 🇷🇺
Sheng-Cheng, Lee 🇹🇼
Jerry Su
Artem Ioselevskii
jiang peng
Amaury Camus 🇨ðŸ‡
Masaya Kambara 🇯🇵
Shalom-David Anifowoshe
Shen Yu Chia 🇹🇼
Andy Ser
Alexander Kleban
Peter Almasi ðŸ‡ðŸ‡º
Rami Al-Naim 🇷🇺
Nicky Eichmann
Liam Paull 🇨🇦
Andrea Censi 🇨ðŸ‡
Konstantin Chaika
Alexander Karavaev
Bhairav Mehta
Egor Zamotaev
Andrea Daniele 🇮🇹
Julian Zilly
Angel Woo ðŸ‡ðŸ‡°