Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 25131
4396
András Kalapos exp2217 aido3-LF-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-08 07:12:35+00:00 2019-11-08 07:19:14+00:00 0:06:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.96402943056696 survival_time_median 8.199999999999982 deviation-center-line_median 0.40884227625640424 in-drivable-lane_median 0.8999999999999992
other stats agent_compute-ego_max 0.0241066624478596 agent_compute-ego_mean 0.02370951071844762 agent_compute-ego_median 0.02376268126747825 agent_compute-ego_min 0.023304226351719276 deviation-center-line_max 0.8016027884613596 deviation-center-line_mean 0.4426082597122091 deviation-center-line_min 0.11387337689118215 deviation-heading_max 4.348700758353462 deviation-heading_mean 2.1605366279730216 deviation-heading_median 2.1472627277145953 deviation-heading_min 0.4653347402174019 driven_any_max 5.506521859741974 driven_any_mean 2.9004855687050264 driven_any_median 3.046841819046561 driven_any_min 0.49095053686880347 driven_lanedir_consec_max 4.909115309232991 driven_lanedir_consec_mean 2.330071930152753 driven_lanedir_consec_min 0.46338607771909546 driven_lanedir_max 4.909115309232991 driven_lanedir_mean 2.330071930152753 driven_lanedir_median 1.96402943056696 driven_lanedir_min 0.46338607771909546 in-drivable-lane_max 2.099999999999995 in-drivable-lane_mean 1.0100000000000031 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.652424130024583, "sim_physics": 0.056274647640092726, "survival_time": 9.850000000000003, "driven_lanedir": 2.972210652195905, "sim_render-ego": 0.007066333354427125, "in-drivable-lane": 1.3000000000000105, "agent_compute-ego": 0.024020781976922513, "deviation-heading": 2.278678557386131, "set_robot_commands": 0.005040259530701613, "deviation-center-line": 0.5258387000410243, "driven_lanedir_consec": 2.972210652195905, "sim_compute_sim_state": 0.002897868906785994, "sim_compute_performance-ego": 0.004135175404814899, "sim_compute_robot_state-ego": 0.004989908431387189}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 5.506521859741974, "sim_physics": 0.056155826250712075, "survival_time": 14.950000000000076, "driven_lanedir": 4.909115309232991, "sim_render-ego": 0.007084428469340006, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.023353201548258463, "deviation-heading": 4.348700758353462, "set_robot_commands": 0.005111117362976075, "deviation-center-line": 0.8016027884613596, "driven_lanedir_consec": 4.909115309232991, "sim_compute_sim_state": 0.0029123648007710777, "sim_compute_performance-ego": 0.0040408929189046225, "sim_compute_robot_state-ego": 0.00501887559890747}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8056894978432088, "sim_physics": 0.05643777286305147, "survival_time": 5.09999999999999, "driven_lanedir": 1.3416181810488137, "sim_render-ego": 0.0070884157629574045, "in-drivable-lane": 0.8999999999999992, "agent_compute-ego": 0.023304226351719276, "deviation-heading": 1.562706356193517, "set_robot_commands": 0.005010689006132238, "deviation-center-line": 0.40884227625640424, "driven_lanedir_consec": 1.3416181810488137, "sim_compute_sim_state": 0.0029116074244181314, "sim_compute_performance-ego": 0.003993022675607719, "sim_compute_robot_state-ego": 0.00496818738825181}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.49095053686880347, "sim_physics": 0.05890023347103235, "survival_time": 1.6500000000000008, "driven_lanedir": 0.46338607771909546, "sim_render-ego": 0.007358016389789003, "in-drivable-lane": 0, "agent_compute-ego": 0.02376268126747825, "deviation-heading": 0.4653347402174019, "set_robot_commands": 0.005042574622414329, "deviation-center-line": 0.11387337689118215, "driven_lanedir_consec": 0.46338607771909546, "sim_compute_sim_state": 0.0029715552474513197, "sim_compute_performance-ego": 0.0040691332383589315, "sim_compute_robot_state-ego": 0.0050693280769116954}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.046841819046561, "sim_physics": 0.0574341125604583, "survival_time": 8.199999999999982, "driven_lanedir": 1.96402943056696, "sim_render-ego": 0.007273431231335896, "in-drivable-lane": 2.099999999999995, "agent_compute-ego": 0.0241066624478596, "deviation-heading": 2.1472627277145953, "set_robot_commands": 0.0051559689568310245, "deviation-center-line": 0.3628841569110752, "driven_lanedir_consec": 1.96402943056696, "sim_compute_sim_state": 0.002995546271161335, "sim_compute_performance-ego": 0.004088317475667814, "sim_compute_robot_state-ego": 0.0051082794259234175}}set_robot_commands_max 0.0051559689568310245 set_robot_commands_mean 0.005072121895811056 set_robot_commands_median 0.005042574622414329 set_robot_commands_min 0.005010689006132238 sim_compute_performance-ego_max 0.004135175404814899 sim_compute_performance-ego_mean 0.004065308342670797 sim_compute_performance-ego_median 0.0040691332383589315 sim_compute_performance-ego_min 0.003993022675607719 sim_compute_robot_state-ego_max 0.0051082794259234175 sim_compute_robot_state-ego_mean 0.005030915784276316 sim_compute_robot_state-ego_median 0.00501887559890747 sim_compute_robot_state-ego_min 0.00496818738825181 sim_compute_sim_state_max 0.002995546271161335 sim_compute_sim_state_mean 0.0029377885301175716 sim_compute_sim_state_median 0.0029123648007710777 sim_compute_sim_state_min 0.002897868906785994 sim_physics_max 0.05890023347103235 sim_physics_mean 0.057040518557069375 sim_physics_median 0.05643777286305147 sim_physics_min 0.056155826250712075 sim_render-ego_max 0.007358016389789003 sim_render-ego_mean 0.007174125041569887 sim_render-ego_median 0.0070884157629574045 sim_render-ego_min 0.007066333354427125 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 7.950000000000012 survival_time_min 1.6500000000000008
No reset possible 25120
4392
Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-ros - Template solution using ROS aido3-LFV-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-07 14:23:22+00:00 2019-11-07 14:36:45+00:00 0:13:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.30314311735235044 survival_time_median 2.6499999999999986 deviation-center-line_median 0.1192462800776758 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.02668465559299175 agent_compute-ego_mean 0.01787917528096487 agent_compute-ego_median 0.014455349645882009 agent_compute-ego_min 0.013295555114746092 deviation-center-line_max 0.2294363663374862 deviation-center-line_mean 0.12653708755488868 deviation-center-line_min 0.06426934298501713 deviation-heading_max 0.6986268167330367 deviation-heading_mean 0.44799520296706863 deviation-heading_median 0.41847631252347706 deviation-heading_min 0.2596285487829773 driven_any_max 1.5997333541177865 driven_any_mean 0.8095342605803051 driven_any_median 0.7336463183586179 driven_any_min 0.26903550091980144 driven_lanedir_consec_max 1.021002447119848 driven_lanedir_consec_mean 0.4489048090243791 driven_lanedir_consec_min 0.2407721645627201 driven_lanedir_max 1.021002447119848 driven_lanedir_mean 0.4489048090243791 driven_lanedir_median 0.30314311735235044 driven_lanedir_min 0.2407721645627201 in-drivable-lane_max 4.799999999999986 in-drivable-lane_mean 1.1466666666666634 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.17295599319565463, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.013178378763333174, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.023571427439300106, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.010634469314360283, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0056310472354083, "sim_compute_performance-ego": 0.007496867381351095, "sim_compute_robot_state-ego": 0.009094379317592566, "sim_compute_robot_state-npc0": 0.009444015126832772, "sim_compute_robot_state-npc1": 0.009255365586616625, "sim_compute_robot_state-npc2": 0.009140934742672342, "sim_compute_robot_state-npc3": 0.009381448718863476}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.2188508063554764, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.012728683650493622, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02360215038061142, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.010690771043300629, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.005271323025226593, "sim_compute_performance-ego": 0.007619015872478485, "sim_compute_robot_state-ego": 0.009482309222221376, "sim_compute_robot_state-npc0": 0.00900566577911377, "sim_compute_robot_state-npc1": 0.008544079959392548, "sim_compute_robot_state-npc2": 0.008628740906715393, "sim_compute_robot_state-npc3": 0.008459456264972687}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.198090700002817, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.013229338022378774, "in-drivable-lane": 0, "agent_compute-ego": 0.02668465559299175, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.009963902143331677, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.004879561754373403, "sim_compute_performance-ego": 0.007650884298177866, "sim_compute_robot_state-ego": 0.009433595033792349, "sim_compute_robot_state-npc0": 0.008920660385718713, "sim_compute_robot_state-npc1": 0.008873127973996676, "sim_compute_robot_state-npc2": 0.008442255166860728, "sim_compute_robot_state-npc3": 0.008449554443359375}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.19507250990918887, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.012499173482259115, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.023642222086588543, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.009441347532374885, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.004965279691962785, "sim_compute_performance-ego": 0.00708424916831396, "sim_compute_robot_state-ego": 0.009063792485062797, "sim_compute_robot_state-npc0": 0.008827296636437857, "sim_compute_robot_state-npc1": 0.00878680649624076, "sim_compute_robot_state-npc2": 0.008619321289882865, "sim_compute_robot_state-npc3": 0.008754086750809865}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.22534329550606863, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.013640562693277994, "in-drivable-lane": 0, "agent_compute-ego": 0.023113409678141277, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.011150530406406949, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.005680061521984282, "sim_compute_performance-ego": 0.00755287352062407, "sim_compute_robot_state-ego": 0.009663445608956472, "sim_compute_robot_state-npc0": 0.008766469501313708, "sim_compute_robot_state-npc1": 0.009273370107014976, "sim_compute_robot_state-npc2": 0.008979104814075288, "sim_compute_robot_state-npc3": 0.009486073539370582}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5997333541177865, "sim_physics": 0.1470138888713742, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.01059456305070357, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.02046288537585046, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.008215157453678856, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.004265237445673667, "sim_compute_performance-ego": 0.006224035231535099, "sim_compute_robot_state-ego": 0.007534767970565922, "sim_compute_robot_state-npc0": 0.007344929639958153, "sim_compute_robot_state-npc1": 0.007310674210225255, "sim_compute_robot_state-npc2": 0.007257565979130012, "sim_compute_robot_state-npc3": 0.007423079703464981}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085552, "sim_physics": 0.08764818736485072, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231916, "sim_render-ego": 0.007113380091530936, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.01370776551110404, "deviation-heading": 0.5971215168818821, "set_robot_commands": 0.004890771139235724, "deviation-center-line": 0.11288019725884532, "driven_lanedir_consec": 0.5659790827231916, "sim_compute_sim_state": 0.002816134975070045, "sim_compute_performance-ego": 0.003959783485957554, "sim_compute_robot_state-ego": 0.004965739590781075, "sim_compute_robot_state-npc0": 0.004740476608276367, "sim_compute_robot_state-npc1": 0.004639250891549247, "sim_compute_robot_state-npc2": 0.004593866212027413, "sim_compute_robot_state-npc3": 0.004584953898475284}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.045244117645196, "sim_physics": 0.1092532357654056, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.007100105285644531, "in-drivable-lane": 0, "agent_compute-ego": 0.013978394302161964, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.004887999715031804, "deviation-center-line": 0.143630204236955, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.0028370812132551865, "sim_compute_performance-ego": 0.003942470292787294, "sim_compute_robot_state-ego": 0.005039965784227526, "sim_compute_robot_state-npc0": 0.0048200923043328365, "sim_compute_robot_state-npc1": 0.004700618821221429, "sim_compute_robot_state-npc2": 0.004589345004107501, "sim_compute_robot_state-npc3": 0.004579937135851061}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576203, "sim_physics": 0.08921337127685547, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.007175604502360026, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.01416690813170539, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.004899640878041585, "deviation-center-line": 0.10907487511555888, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.002881679270002577, "sim_compute_performance-ego": 0.003987365298800998, "sim_compute_robot_state-ego": 0.005023863580491807, "sim_compute_robot_state-npc0": 0.004846162266201443, "sim_compute_robot_state-npc1": 0.0046462515989939375, "sim_compute_robot_state-npc2": 0.004657619529300266, "sim_compute_robot_state-npc3": 0.004646788040796916}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.479979900188255, "sim_physics": 0.1355413610690108, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.007120114620600905, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.014455349645882009, "deviation-heading": 0.551444452143596, "set_robot_commands": 0.004900974648021092, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.00288478013511016, "sim_compute_performance-ego": 0.003974493418898538, "sim_compute_robot_state-ego": 0.00501871331829891, "sim_compute_robot_state-npc0": 0.004860648484987633, "sim_compute_robot_state-npc1": 0.004642564559651312, "sim_compute_robot_state-npc2": 0.004614157097361913, "sim_compute_robot_state-npc3": 0.004618105487288715}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.12284282401756004, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.007231791814168294, "in-drivable-lane": 0, "agent_compute-ego": 0.014577618351689092, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.005128251181708442, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.0028781007837366175, "sim_compute_performance-ego": 0.003924546418366609, "sim_compute_robot_state-ego": 0.005009024231522171, "sim_compute_robot_state-npc0": 0.0048845697332311555, "sim_compute_robot_state-npc1": 0.004687856744836878, "sim_compute_robot_state-npc2": 0.00470166736178928, "sim_compute_robot_state-npc3": 0.004697022614655671}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.2779147140642616, "sim_physics": 0.09142422676086426, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.007253274917602539, "in-drivable-lane": 0, "agent_compute-ego": 0.013295555114746092, "deviation-heading": 0.31056899459809534, "set_robot_commands": 0.00503082275390625, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.0029090595245361327, "sim_compute_performance-ego": 0.003960723876953125, "sim_compute_robot_state-ego": 0.005038652420043945, "sim_compute_robot_state-npc0": 0.004858474731445312, "sim_compute_robot_state-npc1": 0.004675350189208984, "sim_compute_robot_state-npc2": 0.004652566909790039, "sim_compute_robot_state-npc3": 0.004730310440063477}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727134, "sim_physics": 0.09144400650600218, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.007146309006888911, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.01420211342145812, "deviation-heading": 0.31225938815789966, "set_robot_commands": 0.004997257916432507, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.002904950447802274, "sim_compute_performance-ego": 0.00401222031071501, "sim_compute_robot_state-ego": 0.0050500968717179205, "sim_compute_robot_state-npc0": 0.004875988330481187, "sim_compute_robot_state-npc1": 0.00464544656141749, "sim_compute_robot_state-npc2": 0.004631321385221661, "sim_compute_robot_state-npc3": 0.004614726552423442}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101933, "sim_physics": 0.1157381534576416, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.006999654154623708, "in-drivable-lane": 0, "agent_compute-ego": 0.0143544981556554, "deviation-heading": 0.299628345931933, "set_robot_commands": 0.004703621710500409, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.0029295721361714024, "sim_compute_performance-ego": 0.003878378099010837, "sim_compute_robot_state-ego": 0.0048389434814453125, "sim_compute_robot_state-npc0": 0.004663636607508506, "sim_compute_robot_state-npc1": 0.004594095291629914, "sim_compute_robot_state-npc2": 0.004510671861710087, "sim_compute_robot_state-npc3": 0.00464850087319651}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522841, "sim_physics": 0.11673043288436592, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.0069949767168830425, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.014372676026587391, "deviation-heading": 0.5504810423056019, "set_robot_commands": 0.004803816477457683, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.0027805029177198222, "sim_compute_performance-ego": 0.0038765972735835055, "sim_compute_robot_state-ego": 0.0048853883556291165, "sim_compute_robot_state-npc0": 0.004689810322780235, "sim_compute_robot_state-npc1": 0.004548474854114009, "sim_compute_robot_state-npc2": 0.004567702611287435, "sim_compute_robot_state-npc3": 0.004508514030306947}}set_robot_commands_max 0.011150530406406949 set_robot_commands_mean 0.006955955620919251 set_robot_commands_median 0.00503082275390625 set_robot_commands_min 0.004703621710500409 sim_compute_performance-ego_max 0.007650884298177866 sim_compute_performance-ego_mean 0.00527630026317027 sim_compute_performance-ego_median 0.003987365298800998 sim_compute_performance-ego_min 0.0038765972735835055 sim_compute_robot_state-ego_max 0.009663445608956472 sim_compute_robot_state-ego_mean 0.006609511818156619 sim_compute_robot_state-ego_median 0.005039965784227526 sim_compute_robot_state-ego_min 0.0048389434814453125 sim_compute_robot_state-npc0_max 0.009444015126832772 sim_compute_robot_state-npc0_mean 0.0063699264305746425 sim_compute_robot_state-npc0_median 0.004875988330481187 sim_compute_robot_state-npc0_min 0.004663636607508506 sim_compute_robot_state-npc1_max 0.009273370107014976 sim_compute_robot_state-npc1_mean 0.0062548889230740045 sim_compute_robot_state-npc1_median 0.004687856744836878 sim_compute_robot_state-npc1_min 0.004548474854114009 sim_compute_robot_state-npc2_max 0.009140934742672342 sim_compute_robot_state-npc2_mean 0.006172456058128816 sim_compute_robot_state-npc2_median 0.004657619529300266 sim_compute_robot_state-npc2_min 0.004510671861710087 sim_compute_robot_state-npc3_max 0.009486073539370582 sim_compute_robot_state-npc3_mean 0.0062388372329266 sim_compute_robot_state-npc3_median 0.004697022614655671 sim_compute_robot_state-npc3_min 0.004508514030306947 sim_compute_sim_state_max 0.005680061521984282 sim_compute_sim_state_mean 0.003767624805202216 sim_compute_sim_state_median 0.0029090595245361327 sim_compute_sim_state_min 0.0027805029177198222 sim_physics_max 0.22534329550606863 sim_physics_mean 0.1411441995295424 sim_physics_median 0.12284282401756004 sim_physics_min 0.08764818736485072 sim_render-ego_max 0.013640562693277994 sim_render-ego_mean 0.009333727384849942 sim_render-ego_median 0.007231791814168294 sim_render-ego_min 0.0069949767168830425 simulation-passed 1 survival_time_max 6.0499999999999865 survival_time_mean 3.046666666666663 survival_time_min 1.0500000000000005
No reset possible 25108
4386
Soroush Saryazdi 🇨🇦bluejay aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-11-06 19:56:25+00:00 2019-11-06 20:00:25+00:00 0:04:00 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 25100
4381
Soroush Saryazdi 🇨🇦bluejay aido3-LF-sim-validation
step1-simulation failed no ip-172-31-35-218-10491
2019-11-06 18:40:00+00:00 2019-11-06 18:44:10+00:00 0:04:10 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 299, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 68 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
yield cie
File "experiment_manager.py", line 444, in <module>
wrap(cie)
File "experiment_manager.py", line 432, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 303, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 25087
4373
Peter Almasi 🇭🇺reinforcement-learning-submission aido3-LF-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-05 18:38:37+00:00 2019-11-05 18:59:48+00:00 0:21:11 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.969290041368174 survival_time_median 10.20000000000001 deviation-center-line_median 0.4270857082595348 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.02384787033765744 agent_compute-ego_mean 0.023301675135482963 agent_compute-ego_median 0.02330914198183546 agent_compute-ego_min 0.022784122065001845 deviation-center-line_max 1.0445074629268372 deviation-center-line_mean 0.5003002689396436 deviation-center-line_min 0.22682496726954032 deviation-heading_max 4.433232773657423 deviation-heading_mean 2.4851838582253696 deviation-heading_median 2.441685521538835 deviation-heading_min 0.9865179544867272 driven_any_max 1.6773075644829878 driven_any_mean 1.1886678353157056 driven_any_median 1.099456640423864 driven_any_min 0.3639287415998651 driven_lanedir_consec_max 1.6330060337993926 driven_lanedir_consec_mean 1.1129587214094354 driven_lanedir_consec_min 0.33726438274657644 driven_lanedir_max 1.6330060337993926 driven_lanedir_mean 1.1272332401534189 driven_lanedir_median 0.969290041368174 driven_lanedir_min 0.33726438274657644 in-drivable-lane_max 0.6000000000000032 in-drivable-lane_mean 0.07666666666666729 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.722402905309275, "sim_physics": 0.057351971348972186, "survival_time": 7.049999999999983, "driven_lanedir": 0.657753956318957, "sim_render-ego": 0.007262950247906624, "in-drivable-lane": 0, "agent_compute-ego": 0.023698838890021577, "deviation-heading": 2.18422858497121, "set_robot_commands": 0.005275178462901014, "deviation-center-line": 0.5619999217800294, "driven_lanedir_consec": 0.657753956318957, "sim_compute_sim_state": 0.00310914398085141, "sim_compute_performance-ego": 0.004253076323380707, "sim_compute_robot_state-ego": 0.005096892093090301}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6773075644829878, "sim_physics": 0.05737930138905843, "survival_time": 14.950000000000076, "driven_lanedir": 1.6330060337993926, "sim_render-ego": 0.0070822421709696454, "in-drivable-lane": 0, "agent_compute-ego": 0.02297247648239136, "deviation-heading": 2.71497195103323, "set_robot_commands": 0.0051810693740844726, "deviation-center-line": 0.7325395641594101, "driven_lanedir_consec": 1.6330060337993926, "sim_compute_sim_state": 0.003147914409637451, "sim_compute_performance-ego": 0.004031674861907959, "sim_compute_robot_state-ego": 0.005053029855092366}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5872052673770078, "sim_physics": 0.058066975275675455, "survival_time": 14.950000000000076, "driven_lanedir": 1.5438270997895749, "sim_render-ego": 0.0071116328239440914, "in-drivable-lane": 0, "agent_compute-ego": 0.023427050908406577, "deviation-heading": 2.903855176519504, "set_robot_commands": 0.005171438058217366, "deviation-center-line": 0.39301490306098186, "driven_lanedir_consec": 1.5438270997895749, "sim_compute_sim_state": 0.0030934890111287434, "sim_compute_performance-ego": 0.004059536457061768, "sim_compute_robot_state-ego": 0.005076472759246826}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.021466420877054, "sim_physics": 0.06025164260476979, "survival_time": 9.850000000000003, "driven_lanedir": 0.9444846778406296, "sim_render-ego": 0.007207621172599986, "in-drivable-lane": 0.15000000000000213, "agent_compute-ego": 0.023263202705964214, "deviation-heading": 2.441685521538835, "set_robot_commands": 0.0051487859735634125, "deviation-center-line": 0.4324427303155387, "driven_lanedir_consec": 0.9444846778406296, "sim_compute_sim_state": 0.003183224479559109, "sim_compute_performance-ego": 0.004078203046382381, "sim_compute_robot_state-ego": 0.005078164454038978}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0401972878260992, "sim_physics": 0.059649861326404645, "survival_time": 10.20000000000001, "driven_lanedir": 0.9691355543446064, "sim_render-ego": 0.007158113460914761, "in-drivable-lane": 0, "agent_compute-ego": 0.02330914198183546, "deviation-heading": 2.888599403462638, "set_robot_commands": 0.0051623489342483815, "deviation-center-line": 0.38629135666944775, "driven_lanedir_consec": 0.9691355543446064, "sim_compute_sim_state": 0.003166721147649428, "sim_compute_performance-ego": 0.00401918327107149, "sim_compute_robot_state-ego": 0.005037305401820762}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6559356291301148, "sim_physics": 0.058086901505788165, "survival_time": 14.950000000000076, "driven_lanedir": 1.6156294430933775, "sim_render-ego": 0.007182522614796957, "in-drivable-lane": 0, "agent_compute-ego": 0.023183096249898276, "deviation-heading": 2.769374450200744, "set_robot_commands": 0.0051824442545572915, "deviation-center-line": 1.0445074629268372, "driven_lanedir_consec": 1.6156294430933775, "sim_compute_sim_state": 0.003181938330332438, "sim_compute_performance-ego": 0.004082489013671875, "sim_compute_robot_state-ego": 0.005098444620768229}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0548305333664327, "sim_physics": 0.057141457118240056, "survival_time": 10.20000000000001, "driven_lanedir": 0.8311077831876008, "sim_render-ego": 0.007118050958596024, "in-drivable-lane": 0.6000000000000032, "agent_compute-ego": 0.022784122065001845, "deviation-heading": 4.433232773657423, "set_robot_commands": 0.005123022724600399, "deviation-center-line": 0.6318440676891176, "driven_lanedir_consec": 0.6169900020278511, "sim_compute_sim_state": 0.0031100862166460823, "sim_compute_performance-ego": 0.004025006995481604, "sim_compute_robot_state-ego": 0.005030827195036645}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.099456640423864, "sim_physics": 0.05928348536467432, "survival_time": 9.950000000000006, "driven_lanedir": 0.969290041368174, "sim_render-ego": 0.007084587710586625, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.02303181820778391, "deviation-heading": 3.1991569065840713, "set_robot_commands": 0.005101256634122762, "deviation-center-line": 0.4126629507053513, "driven_lanedir_consec": 0.969290041368174, "sim_compute_sim_state": 0.003168079721268697, "sim_compute_performance-ego": 0.004014096667419127, "sim_compute_robot_state-ego": 0.005038335694739567}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.545873626377811, "sim_physics": 0.06052709102630615, "survival_time": 14.950000000000076, "driven_lanedir": 1.52074143811147, "sim_render-ego": 0.007808655897776286, "in-drivable-lane": 0, "agent_compute-ego": 0.02324408769607544, "deviation-heading": 2.3739896276072914, "set_robot_commands": 0.005254034201304118, "deviation-center-line": 0.40803601401669337, "driven_lanedir_consec": 1.52074143811147, "sim_compute_sim_state": 0.0031522663434346517, "sim_compute_performance-ego": 0.004074242909749349, "sim_compute_robot_state-ego": 0.005077222983042399}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.3744376509887631, "sim_physics": 0.06266968983870286, "survival_time": 3.899999999999994, "driven_lanedir": 0.3374757294483133, "sim_render-ego": 0.007271033066969652, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.02384787033765744, "deviation-heading": 0.9865179544867272, "set_robot_commands": 0.005189247620411408, "deviation-center-line": 0.2533540374048445, "driven_lanedir_consec": 0.3374757294483133, "sim_compute_sim_state": 0.0030846718030098155, "sim_compute_performance-ego": 0.004047234853108724, "sim_compute_robot_state-ego": 0.0050565799077351885}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9609214616133924, "sim_physics": 0.05769064691331652, "survival_time": 9.45, "driven_lanedir": 0.9135231871897012, "sim_render-ego": 0.007211236095933056, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.023403243413047184, "deviation-heading": 1.997616458722406, "set_robot_commands": 0.005210995043396319, "deviation-center-line": 0.3742007008378713, "driven_lanedir_consec": 0.9135231871897012, "sim_compute_sim_state": 0.003098983613271562, "sim_compute_performance-ego": 0.0040852102653059375, "sim_compute_robot_state-ego": 0.005075964347395317}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.3639287415998651, "sim_physics": 0.06181192711779946, "survival_time": 3.7999999999999945, "driven_lanedir": 0.33726438274657644, "sim_render-ego": 0.007296458670967503, "in-drivable-lane": 0, "agent_compute-ego": 0.023135332684767872, "deviation-heading": 1.0839269337215451, "set_robot_commands": 0.005284350169332404, "deviation-center-line": 0.22682496726954032, "driven_lanedir_consec": 0.33726438274657644, "sim_compute_sim_state": 0.0030271661909003007, "sim_compute_performance-ego": 0.004048115328738564, "sim_compute_robot_state-ego": 0.0051081149201644095}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.60871685448673, "sim_physics": 0.05759851535161336, "survival_time": 14.950000000000076, "driven_lanedir": 1.5724473691324825, "sim_render-ego": 0.007231406370798747, "in-drivable-lane": 0, "agent_compute-ego": 0.02351611057917277, "deviation-heading": 2.4263565580387234, "set_robot_commands": 0.005228120485941569, "deviation-center-line": 0.7920687539171162, "driven_lanedir_consec": 1.5724473691324825, "sim_compute_sim_state": 0.0031488561630249024, "sim_compute_performance-ego": 0.004046899477640788, "sim_compute_robot_state-ego": 0.00511133352915446}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5424923715065475, "sim_physics": 0.05817605972290039, "survival_time": 14.950000000000076, "driven_lanedir": 1.51911328659684, "sim_render-ego": 0.00713950236638387, "in-drivable-lane": 0, "agent_compute-ego": 0.023371858596801756, "deviation-heading": 2.299477166859734, "set_robot_commands": 0.00524554173151652, "deviation-center-line": 0.42763089508233953, "driven_lanedir_consec": 1.51911328659684, "sim_compute_sim_state": 0.003141681353251139, "sim_compute_performance-ego": 0.004026397069295248, "sim_compute_robot_state-ego": 0.005063983599344889}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.5748445743696438, "sim_physics": 0.05971516768137614, "survival_time": 14.950000000000076, "driven_lanedir": 1.543698619333585, "sim_render-ego": 0.007125912507375081, "in-drivable-lane": 0, "agent_compute-ego": 0.023336876233418784, "deviation-heading": 2.5747684059764606, "set_robot_commands": 0.0052633317311604816, "deviation-center-line": 0.4270857082595348, "driven_lanedir_consec": 1.543698619333585, "sim_compute_sim_state": 0.003152867158253988, "sim_compute_performance-ego": 0.004041841030120849, "sim_compute_robot_state-ego": 0.005030825138092041}}set_robot_commands_max 0.005284350169332404 set_robot_commands_mean 0.005201411026623861 set_robot_commands_median 0.005189247620411408 set_robot_commands_min 0.005101256634122762 sim_compute_performance-ego_max 0.004253076323380707 sim_compute_performance-ego_mean 0.004062213838022425 sim_compute_performance-ego_median 0.004047234853108724 sim_compute_performance-ego_min 0.004014096667419127 sim_compute_robot_state-ego_max 0.00511133352915446 sim_compute_robot_state-ego_mean 0.005068899766584158 sim_compute_robot_state-ego_median 0.005075964347395317 sim_compute_robot_state-ego_min 0.005030825138092041 sim_compute_sim_state_max 0.003183224479559109 sim_compute_sim_state_mean 0.0031311393281479812 sim_compute_sim_state_median 0.003147914409637451 sim_compute_sim_state_min 0.0030271661909003007 sim_physics_max 0.06266968983870286 sim_physics_mean 0.05902671290570653 sim_physics_median 0.05817605972290039 sim_physics_min 0.057141457118240056 sim_render-ego_max 0.007808655897776286 sim_render-ego_mean 0.007219461742434595 sim_render-ego_median 0.007182522614796957 sim_render-ego_min 0.0070822421709696454 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.270000000000037 survival_time_min 3.7999999999999945
No reset possible 25073
4368
Jeick Hincapie Barrera 🇨🇴challenge-aido_LF-template-tensorflow aido3-LFV-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-05 15:16:22+00:00 2019-11-05 15:29:08+00:00 0:12:46 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.20053062743998273 survival_time_median 1.4500000000000006 deviation-center-line_median 0.10029507485278658 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.03124226056612455 agent_compute-ego_mean 0.023291036026538876 agent_compute-ego_median 0.023424989298770304 agent_compute-ego_min 0.015726902268149635 deviation-center-line_max 0.20618389498304607 deviation-center-line_mean 0.10726217203780213 deviation-center-line_min 0.05639744833568416 deviation-heading_max 1.4611958535441456 deviation-heading_mean 0.6832880646569669 deviation-heading_median 0.6522380933158527 deviation-heading_min 0.26165524762672404 driven_any_max 0.808300317598023 driven_any_mean 0.3686250096578973 driven_any_median 0.2674442206508112 driven_any_min 0.19204533286327044 driven_lanedir_consec_max 0.5717152341776583 driven_lanedir_consec_mean 0.2551781771427683 driven_lanedir_consec_min 0.105220918036121 driven_lanedir_max 0.5717152341776583 driven_lanedir_mean 0.2551781771427683 driven_lanedir_median 0.20053062743998273 driven_lanedir_min 0.105220918036121 in-drivable-lane_max 1.0499999999999965 in-drivable-lane_mean 0.14333333333333312 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2330551045594355, "sim_physics": 0.22125133184286264, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15859254325737604, "sim_render-ego": 0.013067804850064792, "in-drivable-lane": 0, "agent_compute-ego": 0.03124226056612455, "deviation-heading": 0.806746999201126, "set_robot_commands": 0.010888182199918307, "deviation-center-line": 0.10262966986628122, "driven_lanedir_consec": 0.15859254325737604, "sim_compute_sim_state": 0.005405407685499925, "sim_compute_performance-ego": 0.007474798422593337, "sim_compute_robot_state-ego": 0.010511985191932091, "sim_compute_robot_state-npc0": 0.009206781020531287, "sim_compute_robot_state-npc1": 0.009062702839191144, "sim_compute_robot_state-npc2": 0.009253859519958496, "sim_compute_robot_state-npc3": 0.009189899151141826}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.47733358601342446, "sim_physics": 0.19514732360839843, "survival_time": 2.25, "driven_lanedir": 0.4485862383694736, "sim_render-ego": 0.012600506676567926, "in-drivable-lane": 0, "agent_compute-ego": 0.026037571165296765, "deviation-heading": 0.6858742448105529, "set_robot_commands": 0.009612719217936196, "deviation-center-line": 0.15142491487247595, "driven_lanedir_consec": 0.4485862383694736, "sim_compute_sim_state": 0.00529123412238227, "sim_compute_performance-ego": 0.0073416021135118276, "sim_compute_robot_state-ego": 0.008887953228420682, "sim_compute_robot_state-npc0": 0.008666335211859808, "sim_compute_robot_state-npc1": 0.008097192976209852, "sim_compute_robot_state-npc2": 0.008364041646321615, "sim_compute_robot_state-npc3": 0.008377345403035481}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22349491735916935, "sim_physics": 0.17471963480899208, "survival_time": 0.9500000000000004, "driven_lanedir": 0.20044131568344303, "sim_render-ego": 0.010582258826807925, "in-drivable-lane": 0, "agent_compute-ego": 0.023424989298770304, "deviation-heading": 0.2704731749274404, "set_robot_commands": 0.008871944327103464, "deviation-center-line": 0.08595136325932723, "driven_lanedir_consec": 0.20044131568344303, "sim_compute_sim_state": 0.004250877781918174, "sim_compute_performance-ego": 0.005929808867605109, "sim_compute_robot_state-ego": 0.007296875903480931, "sim_compute_robot_state-npc0": 0.0075336631975675885, "sim_compute_robot_state-npc1": 0.006956464365908974, "sim_compute_robot_state-npc2": 0.007014889466135125, "sim_compute_robot_state-npc3": 0.006942736475091232}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19443823161601692, "sim_physics": 0.26197704515959086, "survival_time": 0.9500000000000004, "driven_lanedir": 0.14770045738585935, "sim_render-ego": 0.014169266349390933, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.029957896784732214, "deviation-heading": 0.3077906234188462, "set_robot_commands": 0.010565481687846935, "deviation-center-line": 0.07601945164099867, "driven_lanedir_consec": 0.14770045738585935, "sim_compute_sim_state": 0.005232949005930047, "sim_compute_performance-ego": 0.007584007162796824, "sim_compute_robot_state-ego": 0.010720491409301758, "sim_compute_robot_state-npc0": 0.009590186570820057, "sim_compute_robot_state-npc1": 0.009173154830932615, "sim_compute_robot_state-npc2": 0.008273513693558542, "sim_compute_robot_state-npc3": 0.008790555753205953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.808300317598023, "sim_physics": 0.17919047062213606, "survival_time": 3.2499999999999964, "driven_lanedir": 0.3744263247453107, "sim_render-ego": 0.012892539684589092, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.02755915935222919, "deviation-heading": 1.1667493263499342, "set_robot_commands": 0.010194661067082332, "deviation-center-line": 0.13981953235214378, "driven_lanedir_consec": 0.3744263247453107, "sim_compute_sim_state": 0.0053380819467397835, "sim_compute_performance-ego": 0.007646560668945312, "sim_compute_robot_state-ego": 0.0091949279491718, "sim_compute_robot_state-npc0": 0.008915006197415865, "sim_compute_robot_state-npc1": 0.008838162055382362, "sim_compute_robot_state-npc2": 0.008714136710533728, "sim_compute_robot_state-npc3": 0.008876481423011192}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.45469802056019126, "sim_physics": 0.1743150211515881, "survival_time": 2.1000000000000005, "driven_lanedir": 0.38627921480585536, "sim_render-ego": 0.01295014222462972, "in-drivable-lane": 0, "agent_compute-ego": 0.027451600347246443, "deviation-heading": 0.8054326720626284, "set_robot_commands": 0.010885363533383324, "deviation-center-line": 0.13457814638048243, "driven_lanedir_consec": 0.38627921480585536, "sim_compute_sim_state": 0.005623965036301385, "sim_compute_performance-ego": 0.007965212776547386, "sim_compute_robot_state-ego": 0.00934688817887079, "sim_compute_robot_state-npc0": 0.009182407742454893, "sim_compute_robot_state-npc1": 0.009450418608529227, "sim_compute_robot_state-npc2": 0.008993489401681083, "sim_compute_robot_state-npc3": 0.008941587947663806}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19204533286327044, "sim_physics": 0.19959947797987196, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1424973228484121, "sim_render-ego": 0.014935784869723847, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.03044956260257297, "deviation-heading": 0.30242844865351914, "set_robot_commands": 0.01146611902448866, "deviation-center-line": 0.05887030460450043, "driven_lanedir_consec": 0.1424973228484121, "sim_compute_sim_state": 0.0050466060638427734, "sim_compute_performance-ego": 0.007860342661539713, "sim_compute_robot_state-ego": 0.010116100311279295, "sim_compute_robot_state-npc0": 0.010233720143636068, "sim_compute_robot_state-npc1": 0.009174068768819174, "sim_compute_robot_state-npc2": 0.008610632684495714, "sim_compute_robot_state-npc3": 0.008823037147521973}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2195066076339944, "sim_physics": 0.2036619597467883, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1819595054539649, "sim_render-ego": 0.012368670825300543, "in-drivable-lane": 0, "agent_compute-ego": 0.026205589031351024, "deviation-heading": 0.5004249909075597, "set_robot_commands": 0.008972644805908203, "deviation-center-line": 0.10129325610156564, "driven_lanedir_consec": 0.1819595054539649, "sim_compute_sim_state": 0.005010004701285526, "sim_compute_performance-ego": 0.007276987207346949, "sim_compute_robot_state-ego": 0.009476546583504513, "sim_compute_robot_state-npc0": 0.009311133417589912, "sim_compute_robot_state-npc1": 0.00965111831138874, "sim_compute_robot_state-npc2": 0.00856370761476714, "sim_compute_robot_state-npc3": 0.008939652607358736}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.49740114205697195, "sim_physics": 0.13881817162036897, "survival_time": 3.999999999999994, "driven_lanedir": 0.2826018514032853, "sim_render-ego": 0.010151708126068117, "in-drivable-lane": 0, "agent_compute-ego": 0.02270921766757965, "deviation-heading": 1.4611958535441456, "set_robot_commands": 0.007974833250045776, "deviation-center-line": 0.20618389498304607, "driven_lanedir_consec": 0.2826018514032853, "sim_compute_sim_state": 0.004131531715393067, "sim_compute_performance-ego": 0.005676451325416565, "sim_compute_robot_state-ego": 0.00736238956451416, "sim_compute_robot_state-npc0": 0.007400742173194886, "sim_compute_robot_state-npc1": 0.0073596805334091185, "sim_compute_robot_state-npc2": 0.006879442930221557, "sim_compute_robot_state-npc3": 0.0068963408470153805}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2674442206508112, "sim_physics": 0.12786982173011416, "survival_time": 1.0500000000000005, "driven_lanedir": 0.20053062743998273, "sim_render-ego": 0.010068700427100771, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020364761352539062, "deviation-heading": 0.4946918890522781, "set_robot_commands": 0.006794407254173642, "deviation-center-line": 0.0570714863837531, "driven_lanedir_consec": 0.20053062743998273, "sim_compute_sim_state": 0.0035424913678850445, "sim_compute_performance-ego": 0.005357106526692708, "sim_compute_robot_state-ego": 0.006530239468529111, "sim_compute_robot_state-npc0": 0.006041231609526135, "sim_compute_robot_state-npc1": 0.0058558327811104914, "sim_compute_robot_state-npc2": 0.005751439503261021, "sim_compute_robot_state-npc3": 0.006083658763340541}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.718337346320073, "sim_physics": 0.13319046050310135, "survival_time": 3.1999999999999966, "driven_lanedir": 0.5717152341776583, "sim_render-ego": 0.008458856493234634, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.018906675279140472, "deviation-heading": 1.4025178070071356, "set_robot_commands": 0.006315603852272034, "deviation-center-line": 0.15704369885205854, "driven_lanedir_consec": 0.5717152341776583, "sim_compute_sim_state": 0.0034224987030029297, "sim_compute_performance-ego": 0.0049363113939762115, "sim_compute_robot_state-ego": 0.005912028253078461, "sim_compute_robot_state-npc0": 0.005883932113647461, "sim_compute_robot_state-npc1": 0.005565322935581207, "sim_compute_robot_state-npc2": 0.0056927502155303955, "sim_compute_robot_state-npc3": 0.00568731501698494}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.19305655754758572, "sim_physics": 0.10552160306410356, "survival_time": 1.1000000000000003, "driven_lanedir": 0.17136527999941276, "sim_render-ego": 0.008901010860096325, "in-drivable-lane": 0, "agent_compute-ego": 0.017764124003323643, "deviation-heading": 0.37344882528115186, "set_robot_commands": 0.005643855441700329, "deviation-center-line": 0.10029507485278658, "driven_lanedir_consec": 0.17136527999941276, "sim_compute_sim_state": 0.003303040157664906, "sim_compute_performance-ego": 0.005245252089066939, "sim_compute_robot_state-ego": 0.00607609748840332, "sim_compute_robot_state-npc0": 0.00577855110168457, "sim_compute_robot_state-npc1": 0.005544955080205744, "sim_compute_robot_state-npc2": 0.005558241497386585, "sim_compute_robot_state-npc3": 0.005564375357194381}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.3269034450661553, "sim_physics": 0.10596402760209708, "survival_time": 1.4500000000000006, "driven_lanedir": 0.25487713383035504, "sim_render-ego": 0.007247036901013604, "in-drivable-lane": 0, "agent_compute-ego": 0.0157299699454472, "deviation-heading": 0.6522380933158527, "set_robot_commands": 0.005078973441288389, "deviation-center-line": 0.09396643203300344, "driven_lanedir_consec": 0.25487713383035504, "sim_compute_sim_state": 0.0028692771648538523, "sim_compute_performance-ego": 0.0039563836722538385, "sim_compute_robot_state-ego": 0.005047896812702048, "sim_compute_robot_state-npc0": 0.004902412151468211, "sim_compute_robot_state-npc1": 0.004680781528867525, "sim_compute_robot_state-npc2": 0.004646317712191878, "sim_compute_robot_state-npc3": 0.004629052918532799}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.21218419907112748, "sim_physics": 0.11731268059123648, "survival_time": 1.1000000000000003, "driven_lanedir": 0.20087868970501388, "sim_render-ego": 0.007343834096735174, "in-drivable-lane": 0, "agent_compute-ego": 0.015726902268149635, "deviation-heading": 0.26165524762672404, "set_robot_commands": 0.005004189231178977, "deviation-center-line": 0.08738790604892421, "driven_lanedir_consec": 0.20087868970501388, "sim_compute_sim_state": 0.0028529275547374377, "sim_compute_performance-ego": 0.004014578732577237, "sim_compute_robot_state-ego": 0.005031867460771041, "sim_compute_robot_state-npc0": 0.004916570403359153, "sim_compute_robot_state-npc1": 0.004693963310935281, "sim_compute_robot_state-npc2": 0.004614515738053756, "sim_compute_robot_state-npc3": 0.004610841924493963}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5111761159522099, "sim_physics": 0.11690052961691833, "survival_time": 1.950000000000001, "driven_lanedir": 0.105220918036121, "sim_render-ego": 0.007244305732922676, "in-drivable-lane": 0.9000000000000008, "agent_compute-ego": 0.01583526073357998, "deviation-heading": 0.7576527736956076, "set_robot_commands": 0.004892281996898162, "deviation-center-line": 0.05639744833568416, "driven_lanedir_consec": 0.105220918036121, "sim_compute_sim_state": 0.002843661186022636, "sim_compute_performance-ego": 0.003962260026198167, "sim_compute_robot_state-ego": 0.0050017038981119795, "sim_compute_robot_state-npc0": 0.00482793343372834, "sim_compute_robot_state-npc1": 0.004568576812744141, "sim_compute_robot_state-npc2": 0.0045629220131116035, "sim_compute_robot_state-npc3": 0.004569414334419446}}set_robot_commands_max 0.01146611902448866 set_robot_commands_mean 0.008210750688748316 set_robot_commands_median 0.008871944327103464 set_robot_commands_min 0.004892281996898162 sim_compute_performance-ego_max 0.007965212776547386 sim_compute_performance-ego_mean 0.006148510909804542 sim_compute_performance-ego_median 0.005929808867605109 sim_compute_performance-ego_min 0.0039563836722538385 sim_compute_robot_state-ego_max 0.010720491409301758 sim_compute_robot_state-ego_mean 0.0077675994468048 sim_compute_robot_state-ego_median 0.00736238956451416 sim_compute_robot_state-ego_min 0.0050017038981119795 sim_compute_robot_state-npc0_max 0.010233720143636068 sim_compute_robot_state-npc0_mean 0.007492707099232282 sim_compute_robot_state-npc0_median 0.0075336631975675885 sim_compute_robot_state-npc0_min 0.00482793343372834 sim_compute_robot_state-npc1_max 0.00965111831138874 sim_compute_robot_state-npc1_mean 0.007244826382614374 sim_compute_robot_state-npc1_median 0.0073596805334091185 sim_compute_robot_state-npc1_min 0.004568576812744141 sim_compute_robot_state-npc2_max 0.009253859519958496 sim_compute_robot_state-npc2_mean 0.007032926689813882 sim_compute_robot_state-npc2_median 0.007014889466135125 sim_compute_robot_state-npc2_min 0.0045629220131116035 sim_compute_robot_state-npc3_max 0.009189899151141826 sim_compute_robot_state-npc3_mean 0.007128153004667443 sim_compute_robot_state-npc3_median 0.006942736475091232 sim_compute_robot_state-npc3_min 0.004569414334419446 sim_compute_sim_state_max 0.005623965036301385 sim_compute_sim_state_mean 0.00427763694623065 sim_compute_sim_state_median 0.004250877781918174 sim_compute_sim_state_min 0.002843661186022636 sim_physics_max 0.26197704515959086 sim_physics_mean 0.1636959706432112 sim_physics_median 0.1743150211515881 sim_physics_min 0.10552160306410356 sim_render-ego_max 0.014935784869723847 sim_render-ego_mean 0.010865495129616404 sim_render-ego_median 0.010582258826807925 sim_render-ego_min 0.007244305732922676 simulation-passed 1 survival_time_max 3.999999999999994 survival_time_mean 1.7999999999999996 survival_time_min 0.9000000000000002
No reset possible 25022
4362
Soroush Saryazdi 🇨🇦bluejay aido3-LFVI-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 15:17:42+00:00 2019-11-04 15:18:48+00:00 0:01:06 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 25001
4128
Andrea Censi 🇨🇭rotation aido3-LFV-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 09:24:16+00:00 2019-11-04 09:47:24+00:00 0:23:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.00031446221011421915 survival_time_median 14.950000000000076 deviation-center-line_median 0.4891048530415207 in-drivable-lane_median 7.600000000000043
other stats agent_compute-ego_max 0.10532257239023844 agent_compute-ego_mean 0.09953829034169516 agent_compute-ego_median 0.10272166649500528 agent_compute-ego_min 0.08258579651514689 deviation-center-line_max 0.6113242374220981 deviation-center-line_mean 0.422546032853888 deviation-center-line_min 0.020737127615471695 deviation-heading_max 5.830135897709593 deviation-heading_mean 5.6845705507076865 deviation-heading_median 5.657649106857694 deviation-heading_min 5.536662996854859 driven_any_max 0.026478672834058543 driven_any_mean 0.02486423959225546 driven_any_median 0.025930195541210208 driven_any_min 0.022165452661382513 driven_lanedir_consec_max 0.0021599934447711355 driven_lanedir_consec_mean -0.0004859282560538025 driven_lanedir_consec_min -0.003645956811333395 driven_lanedir_max 0.0021599934447711355 driven_lanedir_mean -0.0004859282560538025 driven_lanedir_median 0.00031446221011421915 driven_lanedir_min -0.003645956811333395 in-drivable-lane_max 7.650000000000043 in-drivable-lane_mean 7.600000000000042 in-drivable-lane_min 7.550000000000044 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834058543, "sim_physics": 0.18326583464940388, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.012239761352539062, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.10532257239023844, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.009607036908467611, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.00497359037399292, "sim_compute_performance-ego": 0.00742319901784261, "sim_compute_robot_state-ego": 0.009360865751902262, "sim_compute_robot_state-npc0": 0.008712097803751628, "sim_compute_robot_state-npc1": 0.008421087265014648, "sim_compute_robot_state-npc2": 0.008603216807047526, "sim_compute_robot_state-npc3": 0.008377297719319662}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.025930195541210208, "sim_physics": 0.16820766687393188, "survival_time": 14.950000000000076, "driven_lanedir": -0.003645956811333395, "sim_render-ego": 0.01193625291188558, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.10509859641393024, "deviation-heading": 5.795316370396739, "set_robot_commands": 0.009559356371561686, "deviation-center-line": 0.6113242374220981, "driven_lanedir_consec": -0.003645956811333395, "sim_compute_sim_state": 0.005000279744466146, "sim_compute_performance-ego": 0.007179756959279378, "sim_compute_robot_state-ego": 0.009180161952972412, "sim_compute_robot_state-npc0": 0.00873213291168213, "sim_compute_robot_state-npc1": 0.008272241751352946, "sim_compute_robot_state-npc2": 0.008168537616729737, "sim_compute_robot_state-npc3": 0.008033588727315267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672443435, "sim_physics": 0.17492976347605388, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017527010091673567, "sim_render-ego": 0.012321910858154296, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.10272166649500528, "deviation-heading": 5.603088381719547, "set_robot_commands": 0.009052234490712484, "deviation-center-line": 0.4891048530415207, "driven_lanedir_consec": 0.0017527010091673567, "sim_compute_sim_state": 0.005182320276896159, "sim_compute_performance-ego": 0.007562305132548014, "sim_compute_robot_state-ego": 0.009524368445078531, "sim_compute_robot_state-npc0": 0.008556431134541829, "sim_compute_robot_state-npc1": 0.008465760548909506, "sim_compute_robot_state-npc2": 0.008665785789489747, "sim_compute_robot_state-npc3": 0.008794041474660237}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661382513, "sim_physics": 0.17165109237035114, "survival_time": 14.950000000000076, "driven_lanedir": -0.003010841132988329, "sim_render-ego": 0.011523542404174804, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.10196281989415489, "deviation-heading": 5.536662996854859, "set_robot_commands": 0.008973665237426758, "deviation-center-line": 0.4305506258687733, "driven_lanedir_consec": -0.003010841132988329, "sim_compute_sim_state": 0.004783617655436198, "sim_compute_performance-ego": 0.007048606872558594, "sim_compute_robot_state-ego": 0.008804656664530437, "sim_compute_robot_state-npc0": 0.00835223913192749, "sim_compute_robot_state-npc1": 0.008277901808420817, "sim_compute_robot_state-npc2": 0.008129688103993733, "sim_compute_robot_state-npc3": 0.008213566144307455}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.02594247225218261, "sim_physics": 0.1349743930498759, "survival_time": 14.950000000000076, "driven_lanedir": 0.00031446221011421915, "sim_render-ego": 0.00996581554412842, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.08258579651514689, "deviation-heading": 5.830135897709593, "set_robot_commands": 0.007593216101328532, "deviation-center-line": 0.020737127615471695, "driven_lanedir_consec": 0.00031446221011421915, "sim_compute_sim_state": 0.004139641920725505, "sim_compute_performance-ego": 0.005835136572519938, "sim_compute_robot_state-ego": 0.007236727078755696, "sim_compute_robot_state-npc0": 0.0069833000500996905, "sim_compute_robot_state-npc1": 0.006679545243581136, "sim_compute_robot_state-npc2": 0.006660831769307454, "sim_compute_robot_state-npc3": 0.00664189338684082}}set_robot_commands_max 0.009607036908467611 set_robot_commands_mean 0.008957101821899413 set_robot_commands_median 0.009052234490712484 set_robot_commands_min 0.007593216101328532 sim_compute_performance-ego_max 0.007562305132548014 sim_compute_performance-ego_mean 0.007009800910949706 sim_compute_performance-ego_median 0.007179756959279378 sim_compute_performance-ego_min 0.005835136572519938 sim_compute_robot_state-ego_max 0.009524368445078531 sim_compute_robot_state-ego_mean 0.008821355978647867 sim_compute_robot_state-ego_median 0.009180161952972412 sim_compute_robot_state-ego_min 0.007236727078755696 sim_compute_robot_state-npc0_max 0.00873213291168213 sim_compute_robot_state-npc0_mean 0.008267240206400555 sim_compute_robot_state-npc0_median 0.008556431134541829 sim_compute_robot_state-npc0_min 0.0069833000500996905 sim_compute_robot_state-npc1_max 0.008465760548909506 sim_compute_robot_state-npc1_mean 0.008023307323455811 sim_compute_robot_state-npc1_median 0.008277901808420817 sim_compute_robot_state-npc1_min 0.006679545243581136 sim_compute_robot_state-npc2_max 0.008665785789489747 sim_compute_robot_state-npc2_mean 0.00804561201731364 sim_compute_robot_state-npc2_median 0.008168537616729737 sim_compute_robot_state-npc2_min 0.006660831769307454 sim_compute_robot_state-npc3_max 0.008794041474660237 sim_compute_robot_state-npc3_mean 0.008012077490488687 sim_compute_robot_state-npc3_median 0.008213566144307455 sim_compute_robot_state-npc3_min 0.00664189338684082 sim_compute_sim_state_max 0.005182320276896159 sim_compute_sim_state_mean 0.004815889994303386 sim_compute_sim_state_median 0.00497359037399292 sim_compute_sim_state_min 0.004139641920725505 sim_physics_max 0.18326583464940388 sim_physics_mean 0.16660575008392337 sim_physics_median 0.17165109237035114 sim_physics_min 0.1349743930498759 sim_render-ego_max 0.012321910858154296 sim_render-ego_mean 0.011597456614176433 sim_render-ego_median 0.01193625291188558 sim_render-ego_min 0.00996581554412842 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 24984
4157
Andrea Censi 🇨🇭minimal_agent_python2 (Python 2) aido3-LFVI-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 09:00:42+00:00 2019-11-04 09:23:48+00:00 0:23:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4674075261701268 survival_time_median 3.699999999999995 deviation-center-line_median 0.2037212999690195 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.010617283257571134 agent_compute-ego_mean 0.009460766770979257 agent_compute-ego_median 0.009910727992202295 agent_compute-ego_min 0.007155373289778426 deviation-center-line_max 0.5183621890690367 deviation-center-line_mean 0.2365365432439713 deviation-center-line_min 0.1001276403534276 deviation-heading_max 1.8192903310562811 deviation-heading_mean 0.7195980419067693 deviation-heading_median 0.5070424162880826 deviation-heading_min 0.2495279988048577 driven_any_max 2.764827318571964 driven_any_mean 1.0818349506618754 driven_any_median 1.0098273192909006 driven_any_min 0.3648701917101222 driven_lanedir_consec_max 1.9044523873117627 driven_lanedir_consec_mean 0.759860328609196 driven_lanedir_consec_min 0.3272146444894328 driven_lanedir_max 1.9045033171069223 driven_lanedir_mean 0.7732651243581526 driven_lanedir_median 0.6173586051289615 driven_lanedir_min 0.3272146444894328 in-drivable-lane_max 3.7999999999999887 in-drivable-lane_mean 0.8633333333333326 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.13558700063207127, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.008938937573819547, "in-drivable-lane": 0, "agent_compute-ego": 0.007414504214450046, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.006962585019635725, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.003658356967273059, "sim_compute_performance-ego": 0.005222140131769954, "sim_compute_robot_state-ego": 0.006464953895087715, "sim_compute_robot_state-npc0": 0.006182213087339659, "sim_compute_robot_state-npc1": 0.006158351898193359, "sim_compute_robot_state-npc2": 0.00624006073754113, "sim_compute_robot_state-npc3": 0.0062245119799364795}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.1857692550968479, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.0119362650690852, "in-drivable-lane": 0, "agent_compute-ego": 0.010083546509613862, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.008515125996357686, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.004840915267531936, "sim_compute_performance-ego": 0.007263138487532332, "sim_compute_robot_state-ego": 0.008717234070236618, "sim_compute_robot_state-npc0": 0.008287236497208878, "sim_compute_robot_state-npc1": 0.00822494481060956, "sim_compute_robot_state-npc2": 0.008357731071678368, "sim_compute_robot_state-npc3": 0.008002590488743138}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.2038245911629784, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.012206862304384345, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.010394532159464249, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.01015504938087716, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.005130990451534852, "sim_compute_performance-ego": 0.007401949522511059, "sim_compute_robot_state-ego": 0.009281515285668784, "sim_compute_robot_state-npc0": 0.009006170247564253, "sim_compute_robot_state-npc1": 0.008713169603158306, "sim_compute_robot_state-npc2": 0.008495643438882386, "sim_compute_robot_state-npc3": 0.008504632292993811}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.18521582893052027, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.012273829644887236, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.0098443842683163, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.009254160975910608, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.004713873588601957, "sim_compute_performance-ego": 0.006932132531211014, "sim_compute_robot_state-ego": 0.008918974412049299, "sim_compute_robot_state-npc0": 0.008099533500471665, "sim_compute_robot_state-npc1": 0.008083184976228244, "sim_compute_robot_state-npc2": 0.00809718052130095, "sim_compute_robot_state-npc3": 0.007994264832341858}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.17362292110919952, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.011800497770309448, "in-drivable-lane": 0, "agent_compute-ego": 0.00926164537668228, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.008747845888137817, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.00448039174079895, "sim_compute_performance-ego": 0.006564214825630188, "sim_compute_robot_state-ego": 0.008525319397449493, "sim_compute_robot_state-npc0": 0.007743813097476959, "sim_compute_robot_state-npc1": 0.00787198543548584, "sim_compute_robot_state-npc2": 0.007593028247356415, "sim_compute_robot_state-npc3": 0.007271207869052887}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.2029352807379388, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.012287251361004718, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.010569234947105507, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.010809613512707997, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.004783305254849521, "sim_compute_performance-ego": 0.007240063184267515, "sim_compute_robot_state-ego": 0.009388000934154955, "sim_compute_robot_state-npc0": 0.008784767869230988, "sim_compute_robot_state-npc1": 0.008645630502081537, "sim_compute_robot_state-npc2": 0.008386379712587827, "sim_compute_robot_state-npc3": 0.008405035192316229}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.2264948216351596, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.012106256051497026, "in-drivable-lane": 0, "agent_compute-ego": 0.009910727992202295, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.009018283901792584, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.004560448906638406, "sim_compute_performance-ego": 0.007118785020076867, "sim_compute_robot_state-ego": 0.008806846358559349, "sim_compute_robot_state-npc0": 0.00810038320945971, "sim_compute_robot_state-npc1": 0.008125131780450994, "sim_compute_robot_state-npc2": 0.007959170774980024, "sim_compute_robot_state-npc3": 0.007893020456487482}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.2591646361995388, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.013370153066274282, "in-drivable-lane": 0, "agent_compute-ego": 0.010239414266637851, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.009875861374107568, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.005306656296188767, "sim_compute_performance-ego": 0.007383678410504316, "sim_compute_robot_state-ego": 0.009273200421719936, "sim_compute_robot_state-npc0": 0.008624234715023556, "sim_compute_robot_state-npc1": 0.008642679936177022, "sim_compute_robot_state-npc2": 0.00869188759777997, "sim_compute_robot_state-npc3": 0.008633342949119775}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.18457607587178548, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.012390324274698892, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.010469732284545898, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.009933404922485352, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.004702167510986328, "sim_compute_performance-ego": 0.007453187306722005, "sim_compute_robot_state-ego": 0.009002431233723959, "sim_compute_robot_state-npc0": 0.008886311848958333, "sim_compute_robot_state-npc1": 0.008719555536905925, "sim_compute_robot_state-npc2": 0.008905658721923828, "sim_compute_robot_state-npc3": 0.008054154713948568}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.18374304513673528, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.009370816720498576, "in-drivable-lane": 0, "agent_compute-ego": 0.007155373289778426, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.006862627493368613, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.003848378722732131, "sim_compute_performance-ego": 0.00519297574017499, "sim_compute_robot_state-ego": 0.0065826918627764726, "sim_compute_robot_state-npc0": 0.006527365864934148, "sim_compute_robot_state-npc1": 0.006136546263823638, "sim_compute_robot_state-npc2": 0.006146720937780432, "sim_compute_robot_state-npc3": 0.006200178249462231}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.14810682881262996, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.00983769662918583, "in-drivable-lane": 0, "agent_compute-ego": 0.007688391593194777, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.0072202605585898125, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.004147022001204952, "sim_compute_performance-ego": 0.005325432746641098, "sim_compute_robot_state-ego": 0.00628692873062626, "sim_compute_robot_state-npc0": 0.007055113392491494, "sim_compute_robot_state-npc1": 0.006772064393566501, "sim_compute_robot_state-npc2": 0.006805581431235036, "sim_compute_robot_state-npc3": 0.006699969691614951}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.17666720642763026, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.01238375551560346, "in-drivable-lane": 0, "agent_compute-ego": 0.008766854510587804, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.008069185649647433, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.004927522995892693, "sim_compute_performance-ego": 0.007233381271362305, "sim_compute_robot_state-ego": 0.008188394939198214, "sim_compute_robot_state-npc0": 0.008230931618634392, "sim_compute_robot_state-npc1": 0.008460598833420697, "sim_compute_robot_state-npc2": 0.008751146933611701, "sim_compute_robot_state-npc3": 0.008788445416618796}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.240355802717663, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.012236738204956054, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.009990637642996653, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.009443637302943638, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.004662854330880302, "sim_compute_performance-ego": 0.007265395209902809, "sim_compute_robot_state-ego": 0.008885633377801804, "sim_compute_robot_state-npc0": 0.00843783560253325, "sim_compute_robot_state-npc1": 0.008151701518467494, "sim_compute_robot_state-npc2": 0.0081736269451323, "sim_compute_robot_state-npc3": 0.008128118515014649}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.18004374634729672, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.011941723627586888, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.009505239251541764, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.008600956773104733, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.004580409559485031, "sim_compute_performance-ego": 0.006949365955509552, "sim_compute_robot_state-ego": 0.00898482374948998, "sim_compute_robot_state-npc0": 0.008146393789003973, "sim_compute_robot_state-npc1": 0.007639630200111703, "sim_compute_robot_state-npc2": 0.008101861770838907, "sim_compute_robot_state-npc3": 0.007719278335571289}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.20810855789618057, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.01206152547489513, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.010617283257571134, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.009837172248146751, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.004776355895129117, "sim_compute_performance-ego": 0.006992413239045577, "sim_compute_robot_state-ego": 0.008941620588302612, "sim_compute_robot_state-npc0": 0.008809200742027977, "sim_compute_robot_state-npc1": 0.008337977257641878, "sim_compute_robot_state-npc2": 0.008285389705137773, "sim_compute_robot_state-npc3": 0.008286318995735863}}set_robot_commands_max 0.010809613512707997 set_robot_commands_mean 0.008887051399854231 set_robot_commands_median 0.009018283901792584 set_robot_commands_min 0.006862627493368613 sim_compute_performance-ego_max 0.007453187306722005 sim_compute_performance-ego_mean 0.006769216905524106 sim_compute_performance-ego_median 0.007118785020076867 sim_compute_performance-ego_min 0.00519297574017499 sim_compute_robot_state-ego_max 0.009388000934154955 sim_compute_robot_state-ego_mean 0.008416571283789698 sim_compute_robot_state-ego_median 0.008885633377801804 sim_compute_robot_state-ego_min 0.00628692873062626 sim_compute_robot_state-npc0_max 0.009006170247564253 sim_compute_robot_state-npc0_mean 0.008061433672157283 sim_compute_robot_state-npc0_median 0.008230931618634392 sim_compute_robot_state-npc0_min 0.006182213087339659 sim_compute_robot_state-npc1_max 0.008719555536905925 sim_compute_robot_state-npc1_mean 0.007912210196421512 sim_compute_robot_state-npc1_median 0.008151701518467494 sim_compute_robot_state-npc1_min 0.006136546263823638 sim_compute_robot_state-npc2_max 0.008905658721923828 sim_compute_robot_state-npc2_mean 0.00793273790318447 sim_compute_robot_state-npc2_median 0.0081736269451323 sim_compute_robot_state-npc2_min 0.006146720937780432 sim_compute_robot_state-npc3_max 0.008788445416618796 sim_compute_robot_state-npc3_mean 0.007787004665263868 sim_compute_robot_state-npc3_median 0.008002590488743138 sim_compute_robot_state-npc3_min 0.006200178249462231 sim_compute_sim_state_max 0.005306656296188767 sim_compute_sim_state_mean 0.004607976632648533 sim_compute_sim_state_median 0.004702167510986328 sim_compute_sim_state_min 0.003658356967273059 sim_physics_max 0.2591646361995388 sim_physics_mean 0.1929477065809451 sim_physics_median 0.18521582893052027 sim_physics_min 0.13558700063207127 sim_render-ego_max 0.013370153066274282 sim_render-ego_mean 0.01167617555257911 sim_render-ego_median 0.012106256051497026 sim_render-ego_min 0.008938937573819547 simulation-passed 1 survival_time_max 9.55 survival_time_mean 3.939999999999995 survival_time_min 1.5500000000000007
No reset possible 24979
4165
Tanli Chou 🇹🇼challenge-aido_LF-template-random aido3-LFV-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 08:58:50+00:00 2019-11-04 09:00:14+00:00 0:01:24 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24973
4171
Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LF-sim-validation
step1-simulation failed no ip-172-31-35-218-10491
2019-11-04 08:56:52+00:00 2019-11-04 08:58:16+00:00 0:01:24 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 298, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "observations".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 36, in on_received_observations
|| self.current_image = self.preprocessor.preprocess(obs)
|| File "/workspace/wrappers.py", line 9, in preprocess
|| from scipy.misc import imresize
|| ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
yield cie
File "experiment_manager.py", line 444, in <module>
wrap(cie)
File "experiment_manager.py", line 432, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 303, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24954
4190
Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROS aido3-LFV-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 08:50:27+00:00 2019-11-04 08:56:37+00:00 0:06:10 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.36592094708219225 survival_time_median 2.5999999999999988 deviation-center-line_median 0.16987818035809085 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.026281523448164743 agent_compute-ego_mean 0.023363268283855498 agent_compute-ego_median 0.0232236310839653 agent_compute-ego_min 0.02082446595312844 deviation-center-line_max 0.2294363663374862 deviation-center-line_mean 0.14972083567701736 deviation-center-line_min 0.06426934298501713 deviation-heading_max 0.6986268167330367 deviation-heading_mean 0.4280304166285302 deviation-heading_median 0.41847631252347706 deviation-heading_min 0.2596285487829773 driven_any_max 1.2972979671834337 driven_any_mean 0.7173901327940223 driven_any_median 0.7336463183586179 driven_any_min 0.26903550091980144 driven_lanedir_consec_max 0.97716132702229 driven_lanedir_consec_mean 0.5227475277218055 driven_lanedir_consec_min 0.2407721645627201 driven_lanedir_max 0.97716132702229 driven_lanedir_mean 0.5227475277218055 driven_lanedir_median 0.36592094708219225 driven_lanedir_min 0.2407721645627201 in-drivable-lane_max 1.8999999999999944 in-drivable-lane_mean 0.5799999999999983 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.1183325169791638, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.009764631029585715, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.02082446595312844, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.007254462846567933, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0043112929438201475, "sim_compute_performance-ego": 0.0057386143106809805, "sim_compute_robot_state-ego": 0.007066552068146182, "sim_compute_robot_state-npc0": 0.006692503539609237, "sim_compute_robot_state-npc1": 0.006513672815242284, "sim_compute_robot_state-npc2": 0.006748390869355537, "sim_compute_robot_state-npc3": 0.006567894572943029}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.18925592303276065, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.01913231611251831, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0232236310839653, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.008659668266773224, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.004802152514457703, "sim_compute_performance-ego": 0.007533945143222809, "sim_compute_robot_state-ego": 0.009189851582050323, "sim_compute_robot_state-npc0": 0.008822299540042877, "sim_compute_robot_state-npc1": 0.008514009416103363, "sim_compute_robot_state-npc2": 0.008380092680454254, "sim_compute_robot_state-npc3": 0.008665233850479126}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.1952024331459632, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.013512817712930532, "in-drivable-lane": 0, "agent_compute-ego": 0.02401284071115347, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.00913894634980422, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.005255722082578219, "sim_compute_performance-ego": 0.007141470909118652, "sim_compute_robot_state-ego": 0.009057764823620137, "sim_compute_robot_state-npc0": 0.00886391676389254, "sim_compute_robot_state-npc1": 0.008672512494600736, "sim_compute_robot_state-npc2": 0.009073569224430963, "sim_compute_robot_state-npc3": 0.008719861507415771}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.22799147841750936, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.013114703598842826, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.026281523448164743, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.010484649289038871, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.005595578942247616, "sim_compute_performance-ego": 0.007731663283481393, "sim_compute_robot_state-ego": 0.00966556097871514, "sim_compute_robot_state-npc0": 0.009513555034514396, "sim_compute_robot_state-npc1": 0.00918939805799915, "sim_compute_robot_state-npc2": 0.009308099746704102, "sim_compute_robot_state-npc3": 0.009242675637686123}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.1432046549660819, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.010896750858851842, "in-drivable-lane": 0, "agent_compute-ego": 0.022473880222865512, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.00909235363914853, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.004520234607514881, "sim_compute_performance-ego": 0.0063486553373790925, "sim_compute_robot_state-ego": 0.007789396104358491, "sim_compute_robot_state-npc0": 0.007546209153674897, "sim_compute_robot_state-npc1": 0.007253124600365048, "sim_compute_robot_state-npc2": 0.007365169979277111, "sim_compute_robot_state-npc3": 0.007351909364972796}}set_robot_commands_max 0.010484649289038871 set_robot_commands_mean 0.008926016078266557 set_robot_commands_median 0.00909235363914853 set_robot_commands_min 0.007254462846567933 sim_compute_performance-ego_max 0.007731663283481393 sim_compute_performance-ego_mean 0.006898869796776586 sim_compute_performance-ego_median 0.007141470909118652 sim_compute_performance-ego_min 0.0057386143106809805 sim_compute_robot_state-ego_max 0.00966556097871514 sim_compute_robot_state-ego_mean 0.008553825111378054 sim_compute_robot_state-ego_median 0.009057764823620137 sim_compute_robot_state-ego_min 0.007066552068146182 sim_compute_robot_state-npc0_max 0.009513555034514396 sim_compute_robot_state-npc0_mean 0.00828769680634679 sim_compute_robot_state-npc0_median 0.008822299540042877 sim_compute_robot_state-npc0_min 0.006692503539609237 sim_compute_robot_state-npc1_max 0.00918939805799915 sim_compute_robot_state-npc1_mean 0.008028543476862117 sim_compute_robot_state-npc1_median 0.008514009416103363 sim_compute_robot_state-npc1_min 0.006513672815242284 sim_compute_robot_state-npc2_max 0.009308099746704102 sim_compute_robot_state-npc2_mean 0.008175064500044394 sim_compute_robot_state-npc2_median 0.008380092680454254 sim_compute_robot_state-npc2_min 0.006748390869355537 sim_compute_robot_state-npc3_max 0.009242675637686123 sim_compute_robot_state-npc3_mean 0.00810951498669937 sim_compute_robot_state-npc3_median 0.008665233850479126 sim_compute_robot_state-npc3_min 0.006567894572943029 sim_compute_sim_state_max 0.005595578942247616 sim_compute_sim_state_mean 0.004896996218123713 sim_compute_sim_state_median 0.004802152514457703 sim_compute_sim_state_min 0.0043112929438201475 sim_physics_max 0.22799147841750936 sim_physics_mean 0.17479740130829577 sim_physics_median 0.18925592303276065 sim_physics_min 0.1183325169791638 sim_render-ego_max 0.01913231611251831 sim_render-ego_mean 0.013284243862545848 sim_render-ego_median 0.013114703598842826 sim_render-ego_min 0.009764631029585715 simulation-passed 1 survival_time_max 4.6499999999999915 survival_time_mean 2.6899999999999973 survival_time_min 1.0500000000000005
No reset possible 24942
4210
Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFV-sim-validation
step1-simulation failed no ip-172-31-35-218-10491
2019-11-04 08:46:15+00:00 2019-11-04 08:50:13+00:00 0:03:58 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 298, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
yield cie
File "experiment_manager.py", line 444, in <module>
wrap(cie)
File "experiment_manager.py", line 432, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 303, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24912
4237
Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROS aido3-LF-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 08:33:45+00:00 2019-11-04 08:45:44+00:00 0:11:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.4126113388371666 survival_time_median 2.6999999999999984 deviation-center-line_median 0.1187177598523136 in-drivable-lane_median 0.9499999999999976
other stats agent_compute-ego_max 0.025997209548950195 agent_compute-ego_mean 0.02429119243571757 agent_compute-ego_median 0.024318540599984183 agent_compute-ego_min 0.020958671203026406 deviation-center-line_max 0.2616199012603187 deviation-center-line_mean 0.12663752615997417 deviation-center-line_min 0.07143676193760398 deviation-heading_max 1.4563581054906 deviation-heading_mean 0.5551840294909584 deviation-heading_median 0.55940705176748 deviation-heading_min 0.2596285487829773 driven_any_max 1.6839250134630204 driven_any_mean 0.7327294413370019 driven_any_median 0.7309130538792374 driven_any_min 0.2364518949491652 driven_lanedir_consec_max 0.9416535020294268 driven_lanedir_consec_mean 0.4469104002974222 driven_lanedir_consec_min 0.2221238695940002 driven_lanedir_max 0.9416535020294268 driven_lanedir_mean 0.4469104002974222 driven_lanedir_median 0.4126113388371666 driven_lanedir_min 0.2221238695940002 in-drivable-lane_max 2.1499999999999924 in-drivable-lane_mean 0.8233333333333307 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.102070496115886, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.012282398385061344, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.024318540599984183, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.009160129117294096, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.004918746545281209, "sim_compute_performance-ego": 0.007479080012146856, "sim_compute_robot_state-ego": 0.009052387425597283}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811183, "sim_physics": 0.12183967034022011, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572033, "sim_render-ego": 0.013287075360616048, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.024950738747914633, "deviation-heading": 0.5809378480871985, "set_robot_commands": 0.010534199078877766, "deviation-center-line": 0.11667593935453972, "driven_lanedir_consec": 0.6632135184572033, "sim_compute_sim_state": 0.005605260531107585, "sim_compute_performance-ego": 0.007553033034006755, "sim_compute_robot_state-ego": 0.009548449516296386}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13725125789642334, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.012127020142295143, "in-drivable-lane": 0, "agent_compute-ego": 0.023370081728154964, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.009512955492193048, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.004827651110562411, "sim_compute_performance-ego": 0.00698222897269509, "sim_compute_robot_state-ego": 0.009566838091070002}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.1320295731226603, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.012916609644889832, "in-drivable-lane": 0, "agent_compute-ego": 0.024631539980570476, "deviation-heading": 0.568524016017798, "set_robot_commands": 0.010580907265345257, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.004973158240318298, "sim_compute_performance-ego": 0.007389679551124573, "sim_compute_robot_state-ego": 0.009387393792470297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6091462024047467, "sim_physics": 0.12077524351037068, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.012914092644401218, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.025256467902142067, "deviation-heading": 0.33908617460335944, "set_robot_commands": 0.010277665179708729, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.005142341489377229, "sim_compute_performance-ego": 0.007343986760015073, "sim_compute_robot_state-ego": 0.00929087141285772}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3217723172279551, "sim_physics": 0.10724002122879028, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.01233630379041036, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.024056464433670044, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.009042719999949137, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.004564762115478516, "sim_compute_performance-ego": 0.007222851117451985, "sim_compute_robot_state-ego": 0.008143375317255655}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466092, "sim_physics": 0.10167405238518348, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.012764851252237955, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.024883190790812176, "deviation-heading": 0.6586708623908945, "set_robot_commands": 0.009503309543316182, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.005001327930352626, "sim_compute_performance-ego": 0.007377398319733448, "sim_compute_robot_state-ego": 0.008640503272032127}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048737, "sim_physics": 0.10584901486124312, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.012834842715944563, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.024060449429920742, "deviation-heading": 0.6465417997696937, "set_robot_commands": 0.008730679750442505, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.0050255400793893, "sim_compute_performance-ego": 0.007197469472885132, "sim_compute_robot_state-ego": 0.008862180369240897}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0820250408860437, "sim_physics": 0.1028118791251347, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.013941277032611011, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.022388913165563823, "deviation-heading": 0.613751936282656, "set_robot_commands": 0.008346505548762179, "deviation-center-line": 0.1187177598523136, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.004388970890264401, "sim_compute_performance-ego": 0.007082911743514839, "sim_compute_robot_state-ego": 0.008400316896109745}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630204, "sim_physics": 0.12967492233623157, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.012540830265391956, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.02555159005251798, "deviation-heading": 1.4563581054906, "set_robot_commands": 0.009860855882818048, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.005055243318731134, "sim_compute_performance-ego": 0.007410049438476563, "sim_compute_robot_state-ego": 0.009401258555325595}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.26677752846248903, "sim_physics": 0.1327558159828186, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.013588170210520426, "in-drivable-lane": 0, "agent_compute-ego": 0.02572178840637207, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.010818978150685629, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.00515069564183553, "sim_compute_performance-ego": 0.007587134838104248, "sim_compute_robot_state-ego": 0.010235538085301718}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387629, "sim_physics": 0.10723806356454824, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.012316877191716974, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.02425304945413168, "deviation-heading": 0.5216992361385433, "set_robot_commands": 0.009752954755510603, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.005018410744605127, "sim_compute_performance-ego": 0.007219032807783647, "sim_compute_robot_state-ego": 0.009664092745099748}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.10451084613800048, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.012086987495422363, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.025997209548950195, "deviation-heading": 0.4739455376152245, "set_robot_commands": 0.010556774139404297, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.005422134399414063, "sim_compute_performance-ego": 0.0069923210144042965, "sim_compute_robot_state-ego": 0.008656635284423828}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.0805417666068444, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.010220876106849084, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.020958671203026406, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.007579620067889874, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.004555830588707557, "sim_compute_performance-ego": 0.005514254936805138, "sim_compute_robot_state-ego": 0.007090293444119967}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792374, "sim_physics": 0.102464583184984, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.011735496697602448, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.023969191092031973, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.008589903513590494, "deviation-center-line": 0.12406277512673572, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.004662447505527073, "sim_compute_performance-ego": 0.006806020383481626, "sim_compute_robot_state-ego": 0.008054071002536349}}set_robot_commands_max 0.010818978150685629 set_robot_commands_mean 0.009523210499052522 set_robot_commands_median 0.009512955492193048 set_robot_commands_min 0.007579620067889874 sim_compute_performance-ego_max 0.007587134838104248 sim_compute_performance-ego_mean 0.007143830160175285 sim_compute_performance-ego_median 0.007222851117451985 sim_compute_performance-ego_min 0.005514254936805138 sim_compute_robot_state-ego_max 0.010235538085301718 sim_compute_robot_state-ego_mean 0.008932947013982487 sim_compute_robot_state-ego_median 0.009052387425597283 sim_compute_robot_state-ego_min 0.007090293444119967 sim_compute_sim_state_max 0.005605260531107585 sim_compute_sim_state_mean 0.004954168075396804 sim_compute_sim_state_median 0.005001327930352626 sim_compute_sim_state_min 0.004388970890264401 sim_physics_max 0.13725125789642334 sim_physics_mean 0.11258181375995592 sim_physics_median 0.10723806356454824 sim_physics_min 0.0805417666068444 sim_render-ego_max 0.013941277032611011 sim_render-ego_mean 0.012526247262398049 sim_render-ego_median 0.012540830265391956 sim_render-ego_min 0.010220876106849084 simulation-passed 1 survival_time_max 5.4999999999999885 survival_time_mean 2.7766666666666637 survival_time_min 1.1000000000000003
No reset possible 24887
4261
Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LF-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 08:00:31+00:00 2019-11-04 08:33:07+00:00 0:32:36 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.043723040631585 survival_time_median 10.95000000000002 deviation-center-line_median 0.5365579504967247 in-drivable-lane_median 0.3500000000000032
other stats agent_compute-ego_max 0.08522682364394026 agent_compute-ego_mean 0.0501307295336677 agent_compute-ego_median 0.050892727715628486 agent_compute-ego_min 0.02457580016209529 deviation-center-line_max 1.2188676588919043 deviation-center-line_mean 0.6188780045605459 deviation-center-line_min 0.1508374093216363 deviation-heading_max 5.685680173860553 deviation-heading_mean 2.4682024524941877 deviation-heading_median 2.5113793344784185 deviation-heading_min 0.6298686799702061 driven_any_max 2.349155174919098 driven_any_mean 1.5191650741655809 driven_any_median 1.7060006819163087 driven_any_min 0.45258338264198766 driven_lanedir_consec_max 2.325241449185567 driven_lanedir_consec_mean 1.1176403026778938 driven_lanedir_consec_min 0.4238445211188213 driven_lanedir_max 2.325241449185567 driven_lanedir_mean 1.1623999280438482 driven_lanedir_median 1.043723040631585 driven_lanedir_min 0.4238445211188213 in-drivable-lane_max 6.100000000000052 in-drivable-lane_mean 1.5200000000000111 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5494162896394557, "sim_physics": 0.12687729220641286, "survival_time": 3.7999999999999945, "driven_lanedir": 0.49494992736889953, "sim_render-ego": 0.013285207120995773, "in-drivable-lane": 0, "agent_compute-ego": 0.03258775096190603, "deviation-heading": 1.237551741247981, "set_robot_commands": 0.011425357115896125, "deviation-center-line": 0.2945997576463044, "driven_lanedir_consec": 0.49494992736889953, "sim_compute_sim_state": 0.006416292567002146, "sim_compute_performance-ego": 0.008423786414297004, "sim_compute_robot_state-ego": 0.010546282718056127}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.0352503957071857, "sim_physics": 0.07330601031963642, "survival_time": 13.00000000000005, "driven_lanedir": 1.349541915750465, "sim_render-ego": 0.008783250588637131, "in-drivable-lane": 2.2500000000000115, "agent_compute-ego": 0.02457580016209529, "deviation-heading": 5.685680173860553, "set_robot_commands": 0.008339958007519062, "deviation-center-line": 0.863284298044201, "driven_lanedir_consec": 1.0841415237865282, "sim_compute_sim_state": 0.004373046985039345, "sim_compute_performance-ego": 0.005063016598041241, "sim_compute_robot_state-ego": 0.0066962113747229945}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.8427647543297512, "sim_physics": 0.11781629869493387, "survival_time": 11.800000000000033, "driven_lanedir": 1.280179188390144, "sim_render-ego": 0.013216038881722144, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.04603272171343787, "deviation-heading": 2.914831077689947, "set_robot_commands": 0.010674174559318413, "deviation-center-line": 0.42919845322062866, "driven_lanedir_consec": 1.280179188390144, "sim_compute_sim_state": 0.0063823047330824, "sim_compute_performance-ego": 0.007796627990270065, "sim_compute_robot_state-ego": 0.010122010263346007}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.2681940346451266, "sim_physics": 0.10929829356579632, "survival_time": 14.45000000000007, "driven_lanedir": 1.0365549578831303, "sim_render-ego": 0.012940436498516571, "in-drivable-lane": 5.450000000000048, "agent_compute-ego": 0.04954379900104034, "deviation-heading": 5.320290185641131, "set_robot_commands": 0.009872290502370025, "deviation-center-line": 0.5365579504967247, "driven_lanedir_consec": 0.9052346933291352, "sim_compute_sim_state": 0.005300752844364998, "sim_compute_performance-ego": 0.00791890233445745, "sim_compute_robot_state-ego": 0.00941462335289556}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2802077973556132, "sim_physics": 0.10865419169506396, "survival_time": 8.299999999999983, "driven_lanedir": 1.0874844088372169, "sim_render-ego": 0.013072446168187151, "in-drivable-lane": 0.3500000000000032, "agent_compute-ego": 0.05297661689390619, "deviation-heading": 2.777029792419968, "set_robot_commands": 0.009189233722456967, "deviation-center-line": 0.6036799242423788, "driven_lanedir_consec": 1.0874844088372169, "sim_compute_sim_state": 0.005524992942810059, "sim_compute_performance-ego": 0.0074911534068096116, "sim_compute_robot_state-ego": 0.009756010698984904}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348969861068425, "sim_physics": 0.13033366918563843, "survival_time": 14.950000000000076, "driven_lanedir": 1.2421900252598417, "sim_render-ego": 0.013035720984141031, "in-drivable-lane": 6.100000000000052, "agent_compute-ego": 0.0527520473798116, "deviation-heading": 2.9425624272801634, "set_robot_commands": 0.010780553023020426, "deviation-center-line": 0.7796414421052108, "driven_lanedir_consec": 1.2421900252598417, "sim_compute_sim_state": 0.005675628185272217, "sim_compute_performance-ego": 0.007928099632263184, "sim_compute_robot_state-ego": 0.009844292004903155}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5088287154453232, "sim_physics": 0.1253878355026245, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45261889461514615, "sim_render-ego": 0.014013143948146276, "in-drivable-lane": 0, "agent_compute-ego": 0.05755559716905866, "deviation-heading": 1.16072496088325, "set_robot_commands": 0.010542586871555874, "deviation-center-line": 0.1508374093216363, "driven_lanedir_consec": 0.45261889461514615, "sim_compute_sim_state": 0.005696303503853934, "sim_compute_performance-ego": 0.008030567850385393, "sim_compute_robot_state-ego": 0.00961237975529262}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.2641264233833371, "sim_physics": 0.1439748202882162, "survival_time": 8.199999999999982, "driven_lanedir": 1.043723040631585, "sim_render-ego": 0.014589724017352592, "in-drivable-lane": 0.5999999999999996, "agent_compute-ego": 0.08522682364394026, "deviation-heading": 2.4386101402325533, "set_robot_commands": 0.012747388060499982, "deviation-center-line": 0.5101657375112428, "driven_lanedir_consec": 1.043723040631585, "sim_compute_sim_state": 0.0060783348432401334, "sim_compute_performance-ego": 0.008484077162858917, "sim_compute_robot_state-ego": 0.011299586877590272}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3491399547737934, "sim_physics": 0.08626500129699707, "survival_time": 14.950000000000076, "driven_lanedir": 2.295906102709081, "sim_render-ego": 0.01024328629175822, "in-drivable-lane": 0, "agent_compute-ego": 0.043805445035298665, "deviation-heading": 2.5113793344784185, "set_robot_commands": 0.007535929679870605, "deviation-center-line": 1.1674591318172447, "driven_lanedir_consec": 2.295906102709081, "sim_compute_sim_state": 0.0041316509246826175, "sim_compute_performance-ego": 0.00592191219329834, "sim_compute_robot_state-ego": 0.007440577348073324}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.45258338264198766, "sim_physics": 0.10787408692496164, "survival_time": 3.149999999999997, "driven_lanedir": 0.4238445211188213, "sim_render-ego": 0.01292238159785195, "in-drivable-lane": 0, "agent_compute-ego": 0.050892727715628486, "deviation-heading": 0.6298686799702061, "set_robot_commands": 0.00944904675559392, "deviation-center-line": 0.21850366573057245, "driven_lanedir_consec": 0.4238445211188213, "sim_compute_sim_state": 0.00517227536156064, "sim_compute_performance-ego": 0.007242918014526367, "sim_compute_robot_state-ego": 0.00938868901086232}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.023151912404619, "sim_physics": 0.14060568809509277, "survival_time": 6.699999999999984, "driven_lanedir": 0.9947697563345907, "sim_render-ego": 0.01374202166030656, "in-drivable-lane": 0, "agent_compute-ego": 0.05569945164580843, "deviation-heading": 1.0289105809764196, "set_robot_commands": 0.0109585737114522, "deviation-center-line": 0.6431605461220412, "driven_lanedir_consec": 0.9947697563345907, "sim_compute_sim_state": 0.0056951419631047035, "sim_compute_performance-ego": 0.008269770821528648, "sim_compute_robot_state-ego": 0.010574173571458505}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606296914942887, "sim_physics": 0.12705952674150467, "survival_time": 3.1999999999999966, "driven_lanedir": 0.43784370460383226, "sim_render-ego": 0.012492775917053224, "in-drivable-lane": 0, "agent_compute-ego": 0.05324351415038109, "deviation-heading": 0.6424090959582407, "set_robot_commands": 0.010260626673698424, "deviation-center-line": 0.22593016856591996, "driven_lanedir_consec": 0.43784370460383226, "sim_compute_sim_state": 0.005081355571746826, "sim_compute_performance-ego": 0.007117606699466705, "sim_compute_robot_state-ego": 0.009041979908943176}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7060006819163087, "sim_physics": 0.11272841501453695, "survival_time": 10.95000000000002, "driven_lanedir": 0.9659276267102456, "sim_render-ego": 0.013154647121690724, "in-drivable-lane": 3.7999999999999927, "agent_compute-ego": 0.05127329586847732, "deviation-heading": 2.737556758783904, "set_robot_commands": 0.009972011661965008, "deviation-center-line": 0.441829240251344, "driven_lanedir_consec": 0.8502868978890528, "sim_compute_sim_state": 0.005446171651692151, "sim_compute_performance-ego": 0.008038974788090954, "sim_compute_robot_state-ego": 0.009744937017083712}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.349155174919098, "sim_physics": 0.11270177205403646, "survival_time": 14.950000000000076, "driven_lanedir": 2.325241449185567, "sim_render-ego": 0.012270816167195638, "in-drivable-lane": 0, "agent_compute-ego": 0.046414484977722166, "deviation-heading": 1.8333135887820275, "set_robot_commands": 0.00982846180597941, "deviation-center-line": 1.1994546844408336, "driven_lanedir_consec": 2.325241449185567, "sim_compute_sim_state": 0.0051720937093098955, "sim_compute_performance-ego": 0.007370376586914062, "sim_compute_robot_state-ego": 0.009293887615203856}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349057042759396, "sim_physics": 0.10899268627166749, "survival_time": 14.950000000000076, "driven_lanedir": 2.0052234012591565, "sim_render-ego": 0.01246097485224406, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.04938086668650309, "deviation-heading": 3.1623182492080533, "set_robot_commands": 0.009707536697387695, "deviation-center-line": 1.2188676588919043, "driven_lanedir_consec": 1.8461904061089665, "sim_compute_sim_state": 0.0051787662506103515, "sim_compute_performance-ego": 0.007674617767333984, "sim_compute_robot_state-ego": 0.009244943459828694}}set_robot_commands_max 0.012747388060499982 set_robot_commands_mean 0.010085581923238942 set_robot_commands_median 0.009972011661965008 set_robot_commands_min 0.007535929679870605 sim_compute_performance-ego_max 0.008484077162858917 sim_compute_performance-ego_mean 0.007518160550702794 sim_compute_performance-ego_median 0.007796627990270065 sim_compute_performance-ego_min 0.005063016598041241 sim_compute_robot_state-ego_max 0.011299586877590272 sim_compute_robot_state-ego_mean 0.009468038998483017 sim_compute_robot_state-ego_median 0.00961237975529262 sim_compute_robot_state-ego_min 0.0066962113747229945 sim_compute_sim_state_max 0.006416292567002146 sim_compute_sim_state_mean 0.0054216741358248275 sim_compute_sim_state_median 0.005446171651692151 sim_compute_sim_state_min 0.0041316509246826175 sim_physics_max 0.1439748202882162 sim_physics_mean 0.115458372523808 sim_physics_median 0.11272841501453695 sim_physics_min 0.07330601031963642 sim_render-ego_max 0.014589724017352592 sim_render-ego_mean 0.012681524787719936 sim_render-ego_median 0.013035720984141031 sim_render-ego_min 0.008783250588637131 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.790000000000028 survival_time_min 3.149999999999997
No reset possible 24881
4265
Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LFV-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 07:57:46+00:00 2019-11-04 08:00:14+00:00 0:02:28 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24877
4272
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LFV-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 07:56:51+00:00 2019-11-04 07:57:17+00:00 0:00:26 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24873
4273
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LFV-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 07:55:49+00:00 2019-11-04 07:56:24+00:00 0:00:35 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24872
4276
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 07:54:30+00:00 2019-11-04 07:55:23+00:00 0:00:53 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24866
4285
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LFV-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 07:48:58+00:00 2019-11-04 07:53:56+00:00 0:04:58 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.01938955307006836 agent_compute-ego_mean 0.017693908948202348 agent_compute-ego_median 0.017848899092855332 agent_compute-ego_min 0.015596416261461046 deviation-center-line_max 0.17439134565029044 deviation-center-line_mean 0.1265175655253199 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599271 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811225 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589055 driven_any_mean 1.0272530755098268 driven_any_median 1.0243289631429704 driven_any_min 0.4119037580118985 driven_lanedir_consec_max 1.2433038249708372 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708372 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10095771595283792, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.008428251301800763, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.015596416261461046, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006555155471519187, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.00325522157880995, "sim_compute_performance-ego": 0.00487965566140634, "sim_compute_robot_state-ego": 0.005974645967836733, "sim_compute_robot_state-npc0": 0.005835082795884874, "sim_compute_robot_state-npc1": 0.005521827273898655, "sim_compute_robot_state-npc2": 0.005572129178930212, "sim_compute_robot_state-npc3": 0.0054136161450986505}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.15724183082580567, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.010830907821655274, "in-drivable-lane": 0, "agent_compute-ego": 0.01938955307006836, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008154983520507813, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003858671188354492, "sim_compute_performance-ego": 0.006213607788085937, "sim_compute_robot_state-ego": 0.007716970443725586, "sim_compute_robot_state-npc0": 0.006859340667724609, "sim_compute_robot_state-npc1": 0.006763086318969726, "sim_compute_robot_state-npc2": 0.006659917831420899, "sim_compute_robot_state-npc3": 0.006804132461547851}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.13352255131068982, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009166692432604338, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017516848288084332, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006776405008215653, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003762176162318179, "sim_compute_performance-ego": 0.005241161898562783, "sim_compute_robot_state-ego": 0.006748409647690623, "sim_compute_robot_state-npc0": 0.006312699694382517, "sim_compute_robot_state-npc1": 0.0061083373270536725, "sim_compute_robot_state-npc2": 0.0060019085281773615, "sim_compute_robot_state-npc3": 0.005991292627234208}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.14312518699259696, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.00961667676515217, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.017848899092855332, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007167704497711568, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.003899876075454905, "sim_compute_performance-ego": 0.00545438030098058, "sim_compute_robot_state-ego": 0.006845528566384617, "sim_compute_robot_state-npc0": 0.006641384921496427, "sim_compute_robot_state-npc1": 0.00642646113528481, "sim_compute_robot_state-npc2": 0.00632681122309045, "sim_compute_robot_state-npc3": 0.0063678131827825234}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.10174920729228427, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.008583128452301025, "in-drivable-lane": 0, "agent_compute-ego": 0.018117828028542653, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006681927612849644, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0032811505453927176, "sim_compute_performance-ego": 0.0048029763357979914, "sim_compute_robot_state-ego": 0.005918587957109723, "sim_compute_robot_state-npc0": 0.005712849753243583, "sim_compute_robot_state-npc1": 0.00558347361428397, "sim_compute_robot_state-npc2": 0.005550001348767962, "sim_compute_robot_state-npc3": 0.005626678466796875}}set_robot_commands_max 0.008154983520507813 set_robot_commands_mean 0.007067235222160772 set_robot_commands_median 0.006776405008215653 set_robot_commands_min 0.006555155471519187 sim_compute_performance-ego_max 0.006213607788085937 sim_compute_performance-ego_mean 0.005318356396966726 sim_compute_performance-ego_median 0.005241161898562783 sim_compute_performance-ego_min 0.0048029763357979914 sim_compute_robot_state-ego_max 0.007716970443725586 sim_compute_robot_state-ego_mean 0.006640828516549456 sim_compute_robot_state-ego_median 0.006748409647690623 sim_compute_robot_state-ego_min 0.005918587957109723 sim_compute_robot_state-npc0_max 0.006859340667724609 sim_compute_robot_state-npc0_mean 0.006272271566546403 sim_compute_robot_state-npc0_median 0.006312699694382517 sim_compute_robot_state-npc0_min 0.005712849753243583 sim_compute_robot_state-npc1_max 0.006763086318969726 sim_compute_robot_state-npc1_mean 0.006080637133898167 sim_compute_robot_state-npc1_median 0.0061083373270536725 sim_compute_robot_state-npc1_min 0.005521827273898655 sim_compute_robot_state-npc2_max 0.006659917831420899 sim_compute_robot_state-npc2_mean 0.006022153622077377 sim_compute_robot_state-npc2_median 0.0060019085281773615 sim_compute_robot_state-npc2_min 0.005550001348767962 sim_compute_robot_state-npc3_max 0.006804132461547851 sim_compute_robot_state-npc3_mean 0.006040706576692022 sim_compute_robot_state-npc3_median 0.005991292627234208 sim_compute_robot_state-npc3_min 0.0054136161450986505 sim_compute_sim_state_max 0.003899876075454905 sim_compute_sim_state_mean 0.003611419110066049 sim_compute_sim_state_median 0.003762176162318179 sim_compute_sim_state_min 0.00325522157880995 sim_physics_max 0.15724183082580567 sim_physics_mean 0.12731929847484294 sim_physics_median 0.13352255131068982 sim_physics_min 0.10095771595283792 sim_render-ego_max 0.010830907821655274 sim_render-ego_mean 0.009325131354702714 sim_render-ego_median 0.009166692432604338 sim_render-ego_min 0.008428251301800763 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 24861
4294
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LF-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 07:45:23+00:00 2019-11-04 07:48:35+00:00 0:03:12 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.13005513204193506 in-drivable-lane_median 0.29999999999999893
other stats agent_compute-ego_max 0.01819678197933149 agent_compute-ego_mean 0.016432929451258297 agent_compute-ego_median 0.017371261821073646 agent_compute-ego_min 0.014261960983276367 deviation-center-line_max 0.2072381278624381 deviation-center-line_mean 0.13189395308989765 deviation-center-line_min 0.0788839760023766 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3206717506075888 deviation-heading_median 0.23606825392187256 deviation-heading_min 0.19401296908406307 driven_any_max 1.6182144577009443 driven_any_mean 0.861378585933269 driven_any_median 0.9933867744747804 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 0.8010406009604816 driven_lanedir_consec_mean 0.5597645764431625 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 0.8010406009604816 driven_lanedir_mean 0.5597645764431625 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.619999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07062402036454943, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.007725424236721463, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.014484617445203992, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.005875552142107928, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003296966905947085, "sim_compute_performance-ego": 0.004542487638968008, "sim_compute_robot_state-ego": 0.00552438806604456}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06449640965929218, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.00790118703655168, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017850025027405982, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00605619654935949, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0031741880903057022, "sim_compute_performance-ego": 0.004399299621582031, "sim_compute_robot_state-ego": 0.0057404649023916204}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.07884477166568532, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.010545099482816808, "in-drivable-lane": 0, "agent_compute-ego": 0.017371261821073646, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.00755914519814884, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0041239261627197266, "sim_compute_performance-ego": 0.005286118563483743, "sim_compute_robot_state-ego": 0.006808841929716223}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0698995590209961, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.007654619216918945, "in-drivable-lane": 0, "agent_compute-ego": 0.014261960983276367, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0057850837707519535, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0032087993621826173, "sim_compute_performance-ego": 0.0042564296722412106, "sim_compute_robot_state-ego": 0.005469760894775391}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.07458898689173445, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.009707637980014464, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01819678197933149, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.007084436054471173, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.003961022896102712, "sim_compute_performance-ego": 0.00552681729763369, "sim_compute_robot_state-ego": 0.00669033014321629}}set_robot_commands_max 0.00755914519814884 set_robot_commands_mean 0.006472082742967876 set_robot_commands_median 0.00605619654935949 set_robot_commands_min 0.0057850837707519535 sim_compute_performance-ego_max 0.00552681729763369 sim_compute_performance-ego_mean 0.004802230558781736 sim_compute_performance-ego_median 0.004542487638968008 sim_compute_performance-ego_min 0.0042564296722412106 sim_compute_robot_state-ego_max 0.006808841929716223 sim_compute_robot_state-ego_mean 0.006046757187228817 sim_compute_robot_state-ego_median 0.0057404649023916204 sim_compute_robot_state-ego_min 0.005469760894775391 sim_compute_sim_state_max 0.0041239261627197266 sim_compute_sim_state_mean 0.003552980683451568 sim_compute_sim_state_median 0.003296966905947085 sim_compute_sim_state_min 0.0031741880903057022 sim_physics_max 0.07884477166568532 sim_physics_mean 0.07169074952045149 sim_physics_median 0.07062402036454943 sim_physics_min 0.06449640965929218 sim_render-ego_max 0.010545099482816808 sim_render-ego_mean 0.00870679359060467 sim_render-ego_median 0.00790118703655168 sim_render-ego_min 0.007654619216918945 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2599999999999985 survival_time_min 0.8500000000000002
No reset possible 24858
4297
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LFV-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 07:40:40+00:00 2019-11-04 07:45:10+00:00 0:04:30 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.022947950363159175 agent_compute-ego_mean 0.018347660310485507 agent_compute-ego_median 0.017188872609819685 agent_compute-ego_min 0.016998767852783203 deviation-center-line_max 0.17439134565029044 deviation-center-line_mean 0.1265175655253199 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599271 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811225 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589055 driven_any_mean 1.0272530755098268 driven_any_median 1.0243289631429704 driven_any_min 0.4119037580118985 driven_lanedir_consec_max 1.2433038249708372 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708372 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.10430832262392398, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.00831700254369665, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01714532905154758, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006255136595831977, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003437788398177535, "sim_compute_performance-ego": 0.004710135636506257, "sim_compute_robot_state-ego": 0.005969550874498155, "sim_compute_robot_state-npc0": 0.006000351022790979, "sim_compute_robot_state-npc1": 0.005829806681032534, "sim_compute_robot_state-npc2": 0.005709352316679778, "sim_compute_robot_state-npc3": 0.005619472927517361}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.18026962280273437, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.011897850036621091, "in-drivable-lane": 0, "agent_compute-ego": 0.022947950363159175, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.00986618995666504, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.004618644714355469, "sim_compute_performance-ego": 0.006656780242919922, "sim_compute_robot_state-ego": 0.008297910690307617, "sim_compute_robot_state-npc0": 0.008298091888427735, "sim_compute_robot_state-npc1": 0.00803257942199707, "sim_compute_robot_state-npc2": 0.007959604263305664, "sim_compute_robot_state-npc3": 0.008026466369628907}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12646005655589856, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009097754955291748, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017457381675117893, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006912607895700555, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003572533005162289, "sim_compute_performance-ego": 0.005247655667756733, "sim_compute_robot_state-ego": 0.006485857461628161, "sim_compute_robot_state-npc0": 0.006156497880032188, "sim_compute_robot_state-npc1": 0.005912994083605315, "sim_compute_robot_state-npc2": 0.005985859193299946, "sim_compute_robot_state-npc3": 0.005969047546386719}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.13602697396580177, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.009037736095959628, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.016998767852783203, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007087936884240259, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0035761549502988403, "sim_compute_performance-ego": 0.005019703997841365, "sim_compute_robot_state-ego": 0.006219906142995327, "sim_compute_robot_state-npc0": 0.006179800516442407, "sim_compute_robot_state-npc1": 0.0060706108431272865, "sim_compute_robot_state-npc2": 0.005992177166516268, "sim_compute_robot_state-npc3": 0.005986231791822216}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.11953999314989362, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.00941600969859532, "in-drivable-lane": 0, "agent_compute-ego": 0.017188872609819685, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006747935499463763, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.0038009796823774062, "sim_compute_performance-ego": 0.005677487168993268, "sim_compute_robot_state-ego": 0.007085451057979039, "sim_compute_robot_state-npc0": 0.006251692771911621, "sim_compute_robot_state-npc1": 0.006229511329105922, "sim_compute_robot_state-npc2": 0.006091679845537458, "sim_compute_robot_state-npc3": 0.006173499992915562}}set_robot_commands_max 0.00986618995666504 set_robot_commands_mean 0.00737396136638032 set_robot_commands_median 0.006912607895700555 set_robot_commands_min 0.006255136595831977 sim_compute_performance-ego_max 0.006656780242919922 sim_compute_performance-ego_mean 0.005462352542803509 sim_compute_performance-ego_median 0.005247655667756733 sim_compute_performance-ego_min 0.004710135636506257 sim_compute_robot_state-ego_max 0.008297910690307617 sim_compute_robot_state-ego_mean 0.00681173524548166 sim_compute_robot_state-ego_median 0.006485857461628161 sim_compute_robot_state-ego_min 0.005969550874498155 sim_compute_robot_state-npc0_max 0.008298091888427735 sim_compute_robot_state-npc0_mean 0.006577286815920987 sim_compute_robot_state-npc0_median 0.006179800516442407 sim_compute_robot_state-npc0_min 0.006000351022790979 sim_compute_robot_state-npc1_max 0.00803257942199707 sim_compute_robot_state-npc1_mean 0.006415100471773625 sim_compute_robot_state-npc1_median 0.0060706108431272865 sim_compute_robot_state-npc1_min 0.005829806681032534 sim_compute_robot_state-npc2_max 0.007959604263305664 sim_compute_robot_state-npc2_mean 0.006347734557067821 sim_compute_robot_state-npc2_median 0.005992177166516268 sim_compute_robot_state-npc2_min 0.005709352316679778 sim_compute_robot_state-npc3_max 0.008026466369628907 sim_compute_robot_state-npc3_mean 0.006354943725654154 sim_compute_robot_state-npc3_median 0.005986231791822216 sim_compute_robot_state-npc3_min 0.005619472927517361 sim_compute_sim_state_max 0.004618644714355469 sim_compute_sim_state_mean 0.003801220150074308 sim_compute_sim_state_median 0.0035761549502988403 sim_compute_sim_state_min 0.003437788398177535 sim_physics_max 0.18026962280273437 sim_physics_mean 0.13332099381965046 sim_physics_median 0.12646005655589856 sim_physics_min 0.10430832262392398 sim_render-ego_max 0.011897850036621091 sim_render-ego_mean 0.009553270666032888 sim_render-ego_median 0.009097754955291748 sim_render-ego_min 0.00831700254369665 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 24831
4341
Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LFV-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-11-04 07:00:21+00:00 2019-11-04 07:40:25+00:00 0:40:04 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.0300933560601888 survival_time_median 8.449999999999985 deviation-center-line_median 0.6066190538121987 in-drivable-lane_median 1.599999999999998
other stats agent_compute-ego_max 0.0473327214738964 agent_compute-ego_mean 0.039672424559358446 agent_compute-ego_median 0.04033486922581991 agent_compute-ego_min 0.02150596512688531 deviation-center-line_max 1.1760525122231231 deviation-center-line_mean 0.698239416337745 deviation-center-line_min 0.26687664832029573 deviation-heading_max 6.399100781489687 deviation-heading_mean 3.297695010468314 deviation-heading_median 3.478617507553511 deviation-heading_min 0.6130596291767865 driven_any_max 2.349015083614392 driven_any_mean 1.6717642551237115 driven_any_median 1.304313840286803 driven_any_min 0.52492185129474 driven_lanedir_consec_max 2.0793561120369577 driven_lanedir_consec_mean 1.0824216584996025 driven_lanedir_consec_min 0.20292743529165905 driven_lanedir_max 2.0793561120369577 driven_lanedir_mean 1.2515616866370955 driven_lanedir_median 1.1770434661325686 driven_lanedir_min 0.3086848450424089 in-drivable-lane_max 4.200000000000033 in-drivable-lane_mean 1.6000000000000094 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.240486905639207, "sim_physics": 0.12762224232708966, "survival_time": 8.09999999999998, "driven_lanedir": 1.1770434661325686, "sim_render-ego": 0.00934682657689224, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.02150596512688531, "deviation-heading": 1.7865455316584953, "set_robot_commands": 0.008859192883526837, "deviation-center-line": 0.6251319633096136, "driven_lanedir_consec": 1.1770434661325686, "sim_compute_sim_state": 0.003685221259976611, "sim_compute_performance-ego": 0.005476954542560342, "sim_compute_robot_state-ego": 0.006878256797790527, "sim_compute_robot_state-npc0": 0.007387560090900939, "sim_compute_robot_state-npc1": 0.006721087443975754, "sim_compute_robot_state-npc2": 0.006406814963729294, "sim_compute_robot_state-npc3": 0.006343788570827908}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3488603417791407, "sim_physics": 0.1393704930941264, "survival_time": 14.950000000000076, "driven_lanedir": 2.0793561120369577, "sim_render-ego": 0.009682233333587647, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.035126713116963706, "deviation-heading": 5.402995847813094, "set_robot_commands": 0.007841235001881917, "deviation-center-line": 0.956592919382955, "driven_lanedir_consec": 2.0793561120369577, "sim_compute_sim_state": 0.00382698933283488, "sim_compute_performance-ego": 0.005636390844980876, "sim_compute_robot_state-ego": 0.007046999931335449, "sim_compute_robot_state-npc0": 0.007031492392222087, "sim_compute_robot_state-npc1": 0.006655870278676351, "sim_compute_robot_state-npc2": 0.006655564308166504, "sim_compute_robot_state-npc3": 0.006509539286295573}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.1517279137086178, "sim_physics": 0.1528984022140503, "survival_time": 7.499999999999981, "driven_lanedir": 1.1209582727621896, "sim_render-ego": 0.010804696083068848, "in-drivable-lane": 0, "agent_compute-ego": 0.04234602292378743, "deviation-heading": 1.33678887295443, "set_robot_commands": 0.00768640677134196, "deviation-center-line": 0.6066190538121987, "driven_lanedir_consec": 1.1209582727621896, "sim_compute_sim_state": 0.004061209360758464, "sim_compute_performance-ego": 0.006123630205790201, "sim_compute_robot_state-ego": 0.007888886133829752, "sim_compute_robot_state-npc0": 0.007275648117065429, "sim_compute_robot_state-npc1": 0.00720823605855306, "sim_compute_robot_state-npc2": 0.0071379470825195315, "sim_compute_robot_state-npc3": 0.007201371192932129}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.348604451538812, "sim_physics": 0.15327285448710123, "survival_time": 14.950000000000076, "driven_lanedir": 1.437641116286254, "sim_render-ego": 0.010809353987375895, "in-drivable-lane": 3.2000000000000126, "agent_compute-ego": 0.04268963654836019, "deviation-heading": 6.399100781489687, "set_robot_commands": 0.008259527683258057, "deviation-center-line": 1.113045743673044, "driven_lanedir_consec": 0.8475279902296471, "sim_compute_sim_state": 0.004290790557861328, "sim_compute_performance-ego": 0.006417940457661947, "sim_compute_robot_state-ego": 0.008017374674479166, "sim_compute_robot_state-npc0": 0.007598146597544353, "sim_compute_robot_state-npc1": 0.007451703548431396, "sim_compute_robot_state-npc2": 0.007496937115987142, "sim_compute_robot_state-npc3": 0.007398167451222738}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1838480635174229, "sim_physics": 0.1368483490758128, "survival_time": 7.699999999999981, "driven_lanedir": 1.0594964263966, "sim_render-ego": 0.011472051793878729, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.044631300034461086, "deviation-heading": 1.5252523761356471, "set_robot_commands": 0.008793572326759239, "deviation-center-line": 0.45174236328874, "driven_lanedir_consec": 1.0594964263966, "sim_compute_sim_state": 0.004442475058815696, "sim_compute_performance-ego": 0.006590937639211679, "sim_compute_robot_state-ego": 0.008231300812262993, "sim_compute_robot_state-npc0": 0.007911251736925794, "sim_compute_robot_state-npc1": 0.007765821048191616, "sim_compute_robot_state-npc2": 0.007872764166299399, "sim_compute_robot_state-npc3": 0.007641185413707386}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.8541781985968041, "sim_physics": 0.17290880827777153, "survival_time": 5.649999999999988, "driven_lanedir": 0.3086848450424089, "sim_render-ego": 0.012335665458071549, "in-drivable-lane": 2.5999999999999925, "agent_compute-ego": 0.0473327214738964, "deviation-heading": 2.007393934195606, "set_robot_commands": 0.00908991931814008, "deviation-center-line": 0.30914575937626576, "driven_lanedir_consec": 0.20292743529165905, "sim_compute_sim_state": 0.004611779103236915, "sim_compute_performance-ego": 0.006917527291627056, "sim_compute_robot_state-ego": 0.008829127370783714, "sim_compute_robot_state-npc0": 0.008131449201465708, "sim_compute_robot_state-npc1": 0.007849362044207818, "sim_compute_robot_state-npc2": 0.00783703812455709, "sim_compute_robot_state-npc3": 0.007817361207134955}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.52492185129474, "sim_physics": 0.14125860730806986, "survival_time": 3.599999999999995, "driven_lanedir": 0.4329700358780447, "sim_render-ego": 0.010525935226016574, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.04358437988493177, "deviation-heading": 0.6130596291767865, "set_robot_commands": 0.007784982522328694, "deviation-center-line": 0.26687664832029573, "driven_lanedir_consec": 0.4329700358780447, "sim_compute_sim_state": 0.004141949945025974, "sim_compute_performance-ego": 0.006070984734429253, "sim_compute_robot_state-ego": 0.007541037268108792, "sim_compute_robot_state-npc0": 0.0076369742552439375, "sim_compute_robot_state-npc1": 0.007393125030729506, "sim_compute_robot_state-npc2": 0.007305178377363417, "sim_compute_robot_state-npc3": 0.007214807801776462}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.3485532114284653, "sim_physics": 0.1430394713083903, "survival_time": 14.950000000000076, "driven_lanedir": 1.3278074419568853, "sim_render-ego": 0.00967368205388387, "in-drivable-lane": 4.200000000000033, "agent_compute-ego": 0.04079364458719889, "deviation-heading": 5.794908729142199, "set_robot_commands": 0.007489821116129557, "deviation-center-line": 0.5742248550532094, "driven_lanedir_consec": 0.7391871443907383, "sim_compute_sim_state": 0.003970387776692708, "sim_compute_performance-ego": 0.005768756071726481, "sim_compute_robot_state-ego": 0.007283204396565755, "sim_compute_robot_state-npc0": 0.00705949068069458, "sim_compute_robot_state-npc1": 0.006677733262379964, "sim_compute_robot_state-npc2": 0.006992313861846924, "sim_compute_robot_state-npc3": 0.006733215649922688}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3485423741144555, "sim_physics": 0.1242024048169454, "survival_time": 14.950000000000076, "driven_lanedir": 1.4247012840290243, "sim_render-ego": 0.009364147186279296, "in-drivable-lane": 3.550000000000021, "agent_compute-ego": 0.03918247620264689, "deviation-heading": 6.358177683629962, "set_robot_commands": 0.007517124017079671, "deviation-center-line": 0.994295533142114, "driven_lanedir_consec": 0.823600667491593, "sim_compute_sim_state": 0.003900370597839355, "sim_compute_performance-ego": 0.005478703180948894, "sim_compute_robot_state-ego": 0.00685062328974406, "sim_compute_robot_state-npc0": 0.006776628494262696, "sim_compute_robot_state-npc1": 0.006535624663035075, "sim_compute_robot_state-npc2": 0.00642230749130249, "sim_compute_robot_state-npc3": 0.006386906305948893}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.3489357715034367, "sim_physics": 0.1489913026491801, "survival_time": 14.950000000000076, "driven_lanedir": 1.8197806344477208, "sim_render-ego": 0.009646983941396075, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.03974537054697672, "deviation-heading": 3.723542434418729, "set_robot_commands": 0.0070013093948364255, "deviation-center-line": 1.1068972041236105, "driven_lanedir_consec": 1.294220649079814, "sim_compute_sim_state": 0.003664599259694417, "sim_compute_performance-ego": 0.005559633572896322, "sim_compute_robot_state-ego": 0.0069857152303059895, "sim_compute_robot_state-npc0": 0.006571857929229736, "sim_compute_robot_state-npc1": 0.006282704671223958, "sim_compute_robot_state-npc2": 0.006212275028228759, "sim_compute_robot_state-npc3": 0.006130862236022949}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.304313840286803, "sim_physics": 0.12236253185385078, "survival_time": 8.449999999999985, "driven_lanedir": 0.9001917595950185, "sim_render-ego": 0.009342261320035131, "in-drivable-lane": 1.599999999999998, "agent_compute-ego": 0.04078560326931745, "deviation-heading": 2.678234601413158, "set_robot_commands": 0.007264968206191204, "deviation-center-line": 0.4167929549132132, "driven_lanedir_consec": 0.9001917595950185, "sim_compute_sim_state": 0.003797629881187303, "sim_compute_performance-ego": 0.005520864351261297, "sim_compute_robot_state-ego": 0.006807608011911607, "sim_compute_robot_state-npc0": 0.006686790455022507, "sim_compute_robot_state-npc1": 0.006194344639072757, "sim_compute_robot_state-npc2": 0.006239988394742887, "sim_compute_robot_state-npc3": 0.006305320728460007}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.3489966369960404, "sim_physics": 0.12997207482655845, "survival_time": 14.950000000000076, "driven_lanedir": 1.8571341874453977, "sim_render-ego": 0.009215292930603029, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.04033486922581991, "deviation-heading": 3.597170687261103, "set_robot_commands": 0.00749178409576416, "deviation-center-line": 1.1760525122231231, "driven_lanedir_consec": 1.8571341874453977, "sim_compute_sim_state": 0.003719764550526937, "sim_compute_performance-ego": 0.005296141306559245, "sim_compute_robot_state-ego": 0.006779593626658122, "sim_compute_robot_state-npc0": 0.0068725665410359705, "sim_compute_robot_state-npc1": 0.006515602270762126, "sim_compute_robot_state-npc2": 0.006476341088612874, "sim_compute_robot_state-npc3": 0.006395734945933024}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.296057005578486, "sim_physics": 0.13238317058199928, "survival_time": 8.399999999999984, "driven_lanedir": 0.8310124371314359, "sim_render-ego": 0.009524654774438769, "in-drivable-lane": 1.5000000000000022, "agent_compute-ego": 0.040011728093737646, "deviation-heading": 3.768391827634808, "set_robot_commands": 0.007097447202319191, "deviation-center-line": 0.5713808176934332, "driven_lanedir_consec": 0.7469847436836395, "sim_compute_sim_state": 0.003592919735681443, "sim_compute_performance-ego": 0.0054798708075568785, "sim_compute_robot_state-ego": 0.006553488118307931, "sim_compute_robot_state-npc0": 0.006340537752423968, "sim_compute_robot_state-npc1": 0.006142173494611468, "sim_compute_robot_state-npc2": 0.00612704526810419, "sim_compute_robot_state-npc3": 0.006043378795896258}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.079422177258848, "sim_physics": 0.1241087998058779, "survival_time": 7.049999999999983, "driven_lanedir": 1.0300933560601888, "sim_render-ego": 0.009236384790839878, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.03947002667907282, "deviation-heading": 0.9952447125474816, "set_robot_commands": 0.00717914527189647, "deviation-center-line": 0.6045890316413975, "driven_lanedir_consec": 1.0300933560601888, "sim_compute_sim_state": 0.003951316184185921, "sim_compute_performance-ego": 0.005392967386448637, "sim_compute_robot_state-ego": 0.0069817262338408344, "sim_compute_robot_state-npc0": 0.006592777603906943, "sim_compute_robot_state-npc1": 0.00635986125215571, "sim_compute_robot_state-npc2": 0.006518675080427886, "sim_compute_robot_state-npc3": 0.006632613797559805}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.349015083614392, "sim_physics": 0.1319904629389445, "survival_time": 14.950000000000076, "driven_lanedir": 1.9665539243557373, "sim_render-ego": 0.008826978206634521, "in-drivable-lane": 1.6000000000000227, "agent_compute-ego": 0.0375459106763204, "deviation-heading": 3.478617507553511, "set_robot_commands": 0.007190457185109456, "deviation-center-line": 0.700203885112961, "driven_lanedir_consec": 1.924632631019973, "sim_compute_sim_state": 0.003659130732218424, "sim_compute_performance-ego": 0.005123436450958252, "sim_compute_robot_state-ego": 0.006438345114390055, "sim_compute_robot_state-npc0": 0.0066400400797526045, "sim_compute_robot_state-npc1": 0.006385788122812907, "sim_compute_robot_state-npc2": 0.006341358820597331, "sim_compute_robot_state-npc3": 0.006387191613515218}}set_robot_commands_max 0.00908991931814008 set_robot_commands_mean 0.007769792866437529 set_robot_commands_median 0.007517124017079671 set_robot_commands_min 0.0070013093948364255 sim_compute_performance-ego_max 0.006917527291627056 sim_compute_performance-ego_mean 0.005790315922974491 sim_compute_performance-ego_median 0.005559633572896322 sim_compute_performance-ego_min 0.005123436450958252 sim_compute_robot_state-ego_max 0.008829127370783714 sim_compute_robot_state-ego_mean 0.007274219134020982 sim_compute_robot_state-ego_median 0.0069857152303059895 sim_compute_robot_state-ego_min 0.006438345114390055 sim_compute_robot_state-npc0_max 0.008131449201465708 sim_compute_robot_state-npc0_mean 0.0071008807951798165 sim_compute_robot_state-npc0_median 0.007031492392222087 sim_compute_robot_state-npc0_min 0.006340537752423968 sim_compute_robot_state-npc1_max 0.007849362044207818 sim_compute_robot_state-npc1_mean 0.0068092691885879636 sim_compute_robot_state-npc1_median 0.006655870278676351 sim_compute_robot_state-npc1_min 0.006142173494611468 sim_compute_robot_state-npc2_max 0.007872764166299399 sim_compute_robot_state-npc2_mean 0.006802836611499048 sim_compute_robot_state-npc2_median 0.006518675080427886 sim_compute_robot_state-npc2_min 0.00612704526810419 sim_compute_robot_state-npc3_max 0.007817361207134955 sim_compute_robot_state-npc3_mean 0.0067427629998104 sim_compute_robot_state-npc3_median 0.006509539286295573 sim_compute_robot_state-npc3_min 0.006043378795896258 sim_compute_sim_state_max 0.004611779103236915 sim_compute_sim_state_mean 0.003954435555769091 sim_compute_sim_state_median 0.003900370597839355 sim_compute_sim_state_min 0.003592919735681443 sim_physics_max 0.17290880827777153 sim_physics_mean 0.1387486650377179 sim_physics_median 0.1368483490758128 sim_physics_min 0.12236253185385078 sim_render-ego_max 0.012335665458071549 sim_render-ego_mean 0.00998714317753347 sim_render-ego_median 0.009646983941396075 sim_render-ego_min 0.008826978206634521 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.740000000000029 survival_time_min 3.599999999999995
No reset possible 24815
4321
Riza Velioglu 🇩🇪UniBielefeld-test aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-11-04 06:54:13+00:00 2019-11-04 07:00:14+00:00 0:06:01 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24802
4344
Soroush Saryazdi 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LFVI-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-02 17:34:00+00:00 2019-11-02 17:51:28+00:00 0:17:28 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.49255102316626087 survival_time_median 3.599999999999995 deviation-center-line_median 0.29790524821897285 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.07600790389040683 agent_compute-ego_mean 0.06689747620158279 agent_compute-ego_median 0.06471687473662913 agent_compute-ego_min 0.06316670184860582 deviation-center-line_max 0.4812646795372727 deviation-center-line_mean 0.30005026789152256 deviation-center-line_min 0.14139099170245206 deviation-heading_max 2.4873590797031215 deviation-heading_mean 1.365344299517938 deviation-heading_median 1.166649027879229 deviation-heading_min 0.5135901026162242 driven_any_max 1.6899707657984495 driven_any_mean 0.8222510784854371 driven_any_median 0.5249324663275781 driven_any_min 0.32400957480368947 driven_lanedir_consec_max 0.9634801042850364 driven_lanedir_consec_mean 0.53258198051457 driven_lanedir_consec_min 0.2572963447912615 driven_lanedir_max 0.9634801042850364 driven_lanedir_mean 0.5685333816420262 driven_lanedir_median 0.5101265218549711 driven_lanedir_min 0.2572963447912615 in-drivable-lane_max 3.900000000000033 in-drivable-lane_mean 1.1500000000000052 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.1117155571726205, "sim_physics": 0.2437632982045004, "survival_time": 7.299999999999982, "driven_lanedir": 0.6723080288035419, "sim_render-ego": 0.015736788919527237, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.06471687473662913, "deviation-heading": 2.4873590797031215, "set_robot_commands": 0.011986018860176818, "deviation-center-line": 0.3101543591559555, "driven_lanedir_consec": 0.49255102316626087, "sim_compute_sim_state": 0.006602738001575209, "sim_compute_performance-ego": 0.009404985872033525, "sim_compute_robot_state-ego": 0.011457779636121776, "sim_compute_robot_state-npc0": 0.011266902701495446, "sim_compute_robot_state-npc1": 0.011462980753754915, "sim_compute_robot_state-npc2": 0.011049100797470304, "sim_compute_robot_state-npc3": 0.01136973786027464}, "udem1-1-0": {"driven_any": 0.32400957480368947, "sim_physics": 0.2331205885461036, "survival_time": 2.3499999999999996, "driven_lanedir": 0.2572963447912615, "sim_render-ego": 0.016385808904120263, "in-drivable-lane": 0, "agent_compute-ego": 0.07600790389040683, "deviation-heading": 1.166649027879229, "set_robot_commands": 0.011046166115618766, "deviation-center-line": 0.14139099170245206, "driven_lanedir_consec": 0.2572963447912615, "sim_compute_sim_state": 0.005802671960059633, "sim_compute_performance-ego": 0.009106357046898376, "sim_compute_robot_state-ego": 0.011377045448790203, "sim_compute_robot_state-npc0": 0.01057554305867946, "sim_compute_robot_state-npc1": 0.010731752882612512, "sim_compute_robot_state-npc2": 0.010775916119839284, "sim_compute_robot_state-npc3": 0.010054573099663917}, "udem1-2-0": {"driven_any": 0.4606270283248484, "sim_physics": 0.2570389695465565, "survival_time": 3.1999999999999966, "driven_lanedir": 0.43945590847532, "sim_render-ego": 0.015416938811540604, "in-drivable-lane": 0, "agent_compute-ego": 0.0659862570464611, "deviation-heading": 0.5135901026162242, "set_robot_commands": 0.0117824524641037, "deviation-center-line": 0.2695360608429596, "driven_lanedir_consec": 0.43945590847532, "sim_compute_sim_state": 0.006752625107765198, "sim_compute_performance-ego": 0.009162191301584244, "sim_compute_robot_state-ego": 0.01145719364285469, "sim_compute_robot_state-npc0": 0.01064162328839302, "sim_compute_robot_state-npc1": 0.011073432862758636, "sim_compute_robot_state-npc2": 0.011606741696596146, "sim_compute_robot_state-npc3": 0.011259850114583967}, "udem1-3-0": {"driven_any": 0.5249324663275781, "sim_physics": 0.2503042651547326, "survival_time": 3.599999999999995, "driven_lanedir": 0.5101265218549711, "sim_render-ego": 0.016133427619934082, "in-drivable-lane": 0, "agent_compute-ego": 0.06460964348581102, "deviation-heading": 0.6070650268782053, "set_robot_commands": 0.011263045999738906, "deviation-center-line": 0.29790524821897285, "driven_lanedir_consec": 0.5101265218549711, "sim_compute_sim_state": 0.005944937467575073, "sim_compute_performance-ego": 0.00922751095559862, "sim_compute_robot_state-ego": 0.010924693610933092, "sim_compute_robot_state-npc0": 0.009854478968514336, "sim_compute_robot_state-npc1": 0.01072824001312256, "sim_compute_robot_state-npc2": 0.01070824596616957, "sim_compute_robot_state-npc3": 0.010451363192664253}, "udem1-4-0": {"driven_any": 1.6899707657984495, "sim_physics": 0.23068059204910207, "survival_time": 10.85000000000002, "driven_lanedir": 0.9634801042850364, "sim_render-ego": 0.01438448725757511, "in-drivable-lane": 3.900000000000033, "agent_compute-ego": 0.06316670184860582, "deviation-heading": 2.05205826051291, "set_robot_commands": 0.01090918048735588, "deviation-center-line": 0.4812646795372727, "driven_lanedir_consec": 0.9634801042850364, "sim_compute_sim_state": 0.006080738410422329, "sim_compute_performance-ego": 0.008662780858404625, "sim_compute_robot_state-ego": 0.010681871994299822, "sim_compute_robot_state-npc0": 0.010273065435172226, "sim_compute_robot_state-npc1": 0.010381586540679229, "sim_compute_robot_state-npc2": 0.010349517593735374, "sim_compute_robot_state-npc3": 0.010293563939459313}}set_robot_commands_max 0.011986018860176818 set_robot_commands_mean 0.011397372785398811 set_robot_commands_median 0.011263045999738906 set_robot_commands_min 0.01090918048735588 sim_compute_performance-ego_max 0.009404985872033525 sim_compute_performance-ego_mean 0.009112765206903878 sim_compute_performance-ego_median 0.009162191301584244 sim_compute_performance-ego_min 0.008662780858404625 sim_compute_robot_state-ego_max 0.011457779636121776 sim_compute_robot_state-ego_mean 0.011179716866599918 sim_compute_robot_state-ego_median 0.011377045448790203 sim_compute_robot_state-ego_min 0.010681871994299822 sim_compute_robot_state-npc0_max 0.011266902701495446 sim_compute_robot_state-npc0_mean 0.010522322690450897 sim_compute_robot_state-npc0_median 0.01057554305867946 sim_compute_robot_state-npc0_min 0.009854478968514336 sim_compute_robot_state-npc1_max 0.011462980753754915 sim_compute_robot_state-npc1_mean 0.01087559861058557 sim_compute_robot_state-npc1_median 0.010731752882612512 sim_compute_robot_state-npc1_min 0.010381586540679229 sim_compute_robot_state-npc2_max 0.011606741696596146 sim_compute_robot_state-npc2_mean 0.010897904434762136 sim_compute_robot_state-npc2_median 0.010775916119839284 sim_compute_robot_state-npc2_min 0.010349517593735374 sim_compute_robot_state-npc3_max 0.01136973786027464 sim_compute_robot_state-npc3_mean 0.01068581764132922 sim_compute_robot_state-npc3_median 0.010451363192664253 sim_compute_robot_state-npc3_min 0.010054573099663917 sim_compute_sim_state_max 0.006752625107765198 sim_compute_sim_state_mean 0.0062367421894794885 sim_compute_sim_state_median 0.006080738410422329 sim_compute_sim_state_min 0.005802671960059633 sim_physics_max 0.2570389695465565 sim_physics_mean 0.24298154270019903 sim_physics_median 0.2437632982045004 sim_physics_min 0.23068059204910207 sim_render-ego_max 0.016385808904120263 sim_render-ego_mean 0.01561149030253946 sim_render-ego_median 0.015736788919527237 sim_render-ego_min 0.01438448725757511 simulation-passed 1 survival_time_max 10.85000000000002 survival_time_mean 5.459999999999998 survival_time_min 2.3499999999999996
No reset possible 24794
4333
Soroush Saryazdi 🇨🇦challenge-aido_LF-template-random aido3-LFV-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-11-02 16:25:26+00:00 2019-11-02 16:33:13+00:00 0:07:47 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.6999999999999984 deviation-center-line_median 0.11519544839797546 in-drivable-lane_median 0.5999999999999979
other stats agent_compute-ego_max 0.024036872236034536 agent_compute-ego_mean 0.021510848469964115 agent_compute-ego_median 0.023505506692109285 agent_compute-ego_min 0.013873929977416991 deviation-center-line_max 0.17439134565029044 deviation-center-line_mean 0.1265175655253199 deviation-center-line_min 0.09047885846140293 deviation-heading_max 0.5020407942599271 deviation-heading_mean 0.3641979127291371 deviation-heading_median 0.34764983431811225 deviation-heading_min 0.19401296908406307 driven_any_max 1.6169932854589055 driven_any_mean 1.0272530755098268 driven_any_median 1.0243289631429704 driven_any_min 0.4119037580118985 driven_lanedir_consec_max 1.2433038249708372 driven_lanedir_consec_mean 0.7800316850006626 driven_lanedir_consec_min 0.3792793194470208 driven_lanedir_max 1.2433038249708372 driven_lanedir_mean 0.7800316850006626 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.3792793194470208 in-drivable-lane_max 0.9999999999999976 in-drivable-lane_mean 0.4899999999999984 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.17784962830720125, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.013503997414200396, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.023505506692109285, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.00922862688700358, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0058473436920731155, "sim_compute_performance-ego": 0.007884038819207085, "sim_compute_robot_state-ego": 0.009526420522619176, "sim_compute_robot_state-npc0": 0.009338983783015498, "sim_compute_robot_state-npc1": 0.009552147653367784, "sim_compute_robot_state-npc2": 0.009520389415599682, "sim_compute_robot_state-npc3": 0.008927508636757179}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.1043244743347168, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.007661714553833008, "in-drivable-lane": 0, "agent_compute-ego": 0.013873929977416991, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.005467281341552734, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003140077590942383, "sim_compute_performance-ego": 0.004070634841918945, "sim_compute_robot_state-ego": 0.005358600616455078, "sim_compute_robot_state-npc0": 0.0050611114501953125, "sim_compute_robot_state-npc1": 0.0048920631408691405, "sim_compute_robot_state-npc2": 0.004951324462890625, "sim_compute_robot_state-npc3": 0.004887046813964843}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1787138863613731, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.012423951374857047, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023707317678551925, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.009160311598526804, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.0051953823942887155, "sim_compute_performance-ego": 0.0071688231668974225, "sim_compute_robot_state-ego": 0.00911296668805574, "sim_compute_robot_state-npc0": 0.008810309987319144, "sim_compute_robot_state-npc1": 0.008126723138909591, "sim_compute_robot_state-npc2": 0.008174133928198563, "sim_compute_robot_state-npc3": 0.008284145279934532}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.19302988957755177, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.012653930277764043, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.024036872236034536, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.009278454358064675, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.005303298370747627, "sim_compute_performance-ego": 0.007264677482315257, "sim_compute_robot_state-ego": 0.00943495653852632, "sim_compute_robot_state-npc0": 0.008593830881239493, "sim_compute_robot_state-npc1": 0.008337790452981298, "sim_compute_robot_state-npc2": 0.008304580857482138, "sim_compute_robot_state-npc3": 0.00835357436650916}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.14350943905966623, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.0121977584702628, "in-drivable-lane": 0, "agent_compute-ego": 0.022430615765707835, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.007855994360787528, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.004673702376229423, "sim_compute_performance-ego": 0.007034957408905029, "sim_compute_robot_state-ego": 0.00840461254119873, "sim_compute_robot_state-npc0": 0.00745751176561628, "sim_compute_robot_state-npc1": 0.007934587342398507, "sim_compute_robot_state-npc2": 0.0080572281564985, "sim_compute_robot_state-npc3": 0.007685542106628418}}set_robot_commands_max 0.009278454358064675 set_robot_commands_mean 0.008198133709187063 set_robot_commands_median 0.009160311598526804 set_robot_commands_min 0.005467281341552734 sim_compute_performance-ego_max 0.007884038819207085 sim_compute_performance-ego_mean 0.006684626343848749 sim_compute_performance-ego_median 0.0071688231668974225 sim_compute_performance-ego_min 0.004070634841918945 sim_compute_robot_state-ego_max 0.009526420522619176 sim_compute_robot_state-ego_mean 0.008367511381371009 sim_compute_robot_state-ego_median 0.00911296668805574 sim_compute_robot_state-ego_min 0.005358600616455078 sim_compute_robot_state-npc0_max 0.009338983783015498 sim_compute_robot_state-npc0_mean 0.007852349573477146 sim_compute_robot_state-npc0_median 0.008593830881239493 sim_compute_robot_state-npc0_min 0.0050611114501953125 sim_compute_robot_state-npc1_max 0.009552147653367784 sim_compute_robot_state-npc1_mean 0.007768662345705264 sim_compute_robot_state-npc1_median 0.008126723138909591 sim_compute_robot_state-npc1_min 0.0048920631408691405 sim_compute_robot_state-npc2_max 0.009520389415599682 sim_compute_robot_state-npc2_mean 0.007801531364133902 sim_compute_robot_state-npc2_median 0.008174133928198563 sim_compute_robot_state-npc2_min 0.004951324462890625 sim_compute_robot_state-npc3_max 0.008927508636757179 sim_compute_robot_state-npc3_mean 0.007627563440758827 sim_compute_robot_state-npc3_median 0.008284145279934532 sim_compute_robot_state-npc3_min 0.004887046813964843 sim_compute_sim_state_max 0.0058473436920731155 sim_compute_sim_state_mean 0.004831960884856252 sim_compute_sim_state_median 0.0051953823942887155 sim_compute_sim_state_min 0.003140077590942383 sim_physics_max 0.19302988957755177 sim_physics_mean 0.15948546352810183 sim_physics_median 0.17784962830720125 sim_physics_min 0.1043244743347168 sim_render-ego_max 0.013503997414200396 sim_render-ego_mean 0.011688270418183455 sim_render-ego_median 0.012423951374857047 sim_render-ego_min 0.007661714553833008 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.6199999999999974 survival_time_min 1.2500000000000004
No reset possible 24780
4323
Riza Velioglu 🇩🇪UniBielefeld aido3-LF-sim-validation
step1-simulation aborted no ip-172-31-35-218-10491
2019-11-02 13:30:16+00:00 2019-11-02 13:36:41+00:00 0:06:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5199541836131956 survival_time_median 7.99999999999998 deviation-center-line_median 0.3483518809373187 in-drivable-lane_median 1.399999999999995
other stats agent_compute-ego_max 0.0258639641390502 agent_compute-ego_mean 0.023654304453356048 agent_compute-ego_median 0.023125359950921475 agent_compute-ego_min 0.02246134728193283 deviation-center-line_max 0.37290320844877345 deviation-center-line_mean 0.33185873766115226 deviation-center-line_min 0.27717202789485784 deviation-heading_max 6.855090196628479 deviation-heading_mean 3.541479733043346 deviation-heading_median 3.20424527405465 deviation-heading_min 1.544196168595377 driven_any_max 1.5491169564701608 driven_any_mean 1.1329645404349329 driven_any_median 1.028622165063508 driven_any_min 0.639985032193232 driven_lanedir_consec_max 1.2966690415910411 driven_lanedir_consec_mean 0.5160544282480969 driven_lanedir_consec_min 0.014581392793340251 driven_lanedir_max 1.2966690415910411 driven_lanedir_mean 0.5160544282480969 driven_lanedir_median 0.5199541836131956 driven_lanedir_min 0.014581392793340251 in-drivable-lane_max 6.400000000000035 in-drivable-lane_mean 2.5000000000000044 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.028622165063508, "sim_physics": 0.06740921093867375, "survival_time": 9.750000000000004, "driven_lanedir": 0.13991313889573487, "sim_render-ego": 0.009508466720581057, "in-drivable-lane": 4.099999999999994, "agent_compute-ego": 0.023125359950921475, "deviation-heading": 3.895028373843125, "set_robot_commands": 0.006385293373694786, "deviation-center-line": 0.3483518809373187, "driven_lanedir_consec": 0.13991313889573487, "sim_compute_sim_state": 0.004049230233216897, "sim_compute_performance-ego": 0.005609862009684245, "sim_compute_robot_state-ego": 0.006806339361728766}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5491169564701608, "sim_physics": 0.060954001545906064, "survival_time": 7.99999999999998, "driven_lanedir": 1.2966690415910411, "sim_render-ego": 0.00925123393535614, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.02246134728193283, "deviation-heading": 3.20424527405465, "set_robot_commands": 0.006368955969810486, "deviation-center-line": 0.3699347951892102, "driven_lanedir_consec": 1.2966690415910411, "sim_compute_sim_state": 0.003816048800945282, "sim_compute_performance-ego": 0.005166766047477722, "sim_compute_robot_state-ego": 0.006483261287212372}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.639985032193232, "sim_physics": 0.05984368389599944, "survival_time": 3.649999999999995, "driven_lanedir": 0.5199541836131956, "sim_render-ego": 0.007543491990598914, "in-drivable-lane": 0, "agent_compute-ego": 0.02292134337229271, "deviation-heading": 1.544196168595377, "set_robot_commands": 0.005430038661172945, "deviation-center-line": 0.27717202789485784, "driven_lanedir_consec": 0.5199541836131956, "sim_compute_sim_state": 0.0031997994200824056, "sim_compute_performance-ego": 0.004082895305058728, "sim_compute_robot_state-ego": 0.005246423695185413}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.951535431483562, "sim_physics": 0.07911731632611224, "survival_time": 6.549999999999985, "driven_lanedir": 0.6091543843471725, "sim_render-ego": 0.01007446441941589, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.0258639641390502, "deviation-heading": 2.208838652095096, "set_robot_commands": 0.007170082048605417, "deviation-center-line": 0.37290320844877345, "driven_lanedir_consec": 0.6091543843471725, "sim_compute_sim_state": 0.004248244161824234, "sim_compute_performance-ego": 0.0055853483331112464, "sim_compute_robot_state-ego": 0.006985726247306998}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4955631169642003, "sim_physics": 0.06667188088099162, "survival_time": 14.950000000000076, "driven_lanedir": 0.014581392793340251, "sim_render-ego": 0.010218247572580974, "in-drivable-lane": 6.400000000000035, "agent_compute-ego": 0.02389950752258301, "deviation-heading": 6.855090196628479, "set_robot_commands": 0.006403415203094482, "deviation-center-line": 0.29093177583560104, "driven_lanedir_consec": 0.014581392793340251, "sim_compute_sim_state": 0.0038035098711649575, "sim_compute_performance-ego": 0.005082370440165202, "sim_compute_robot_state-ego": 0.006394541263580323}}set_robot_commands_max 0.007170082048605417 set_robot_commands_mean 0.006351557051275623 set_robot_commands_median 0.006385293373694786 set_robot_commands_min 0.005430038661172945 sim_compute_performance-ego_max 0.005609862009684245 sim_compute_performance-ego_mean 0.005105448427099429 sim_compute_performance-ego_median 0.005166766047477722 sim_compute_performance-ego_min 0.004082895305058728 sim_compute_robot_state-ego_max 0.006985726247306998 sim_compute_robot_state-ego_mean 0.006383258371002775 sim_compute_robot_state-ego_median 0.006483261287212372 sim_compute_robot_state-ego_min 0.005246423695185413 sim_compute_sim_state_max 0.004248244161824234 sim_compute_sim_state_mean 0.0038233664974467543 sim_compute_sim_state_median 0.003816048800945282 sim_compute_sim_state_min 0.0031997994200824056 sim_physics_max 0.07911731632611224 sim_physics_mean 0.06679921871753662 sim_physics_median 0.06667188088099162 sim_physics_min 0.05984368389599944 sim_render-ego_max 0.010218247572580974 sim_render-ego_mean 0.009319180927706595 sim_render-ego_median 0.009508466720581057 sim_render-ego_min 0.007543491990598914 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 8.580000000000007 survival_time_min 3.649999999999995
No reset possible 24777
4322
Gianmarco Bernasconi baseline-IL-sim-tensorflow aido3-LF-sim-validation
step1-simulation host-error no ip-172-31-35-218-10491
2019-11-02 12:59:24+00:00 2019-11-02 13:02:17+00:00 0:02:53 Uncaught exception w [...] Uncaught exception while running Docker Compose:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 887, in run_one
run_docker(wd, project, cmd)
File "/project/src/duckietown_challenges_runner/runner.py", line 1269, in run_docker
subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
File "/usr/lib/python3.6/subprocess.py", line 306, in check_call
retcode = call(*popenargs, **kwargs)
File "/usr/lib/python3.6/subprocess.py", line 287, in call
with Popen(*popenargs, **kwargs) as p:
File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
restore_signals, start_new_session)
File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4322/step1-simulation-ip-172-31-35-218-10491-job24777': '/tmp/duckietown/DT18/evaluator/executions/aido3-LF-sim-validation/submission4322/step1-simulation-ip-172-31-35-218-10491-job24777'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24772
4319
Tanli Chou 🇹🇼challenge-aido_LF-template-random aido3-LFVI-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-11-02 06:49:27+00:00 2019-11-02 07:00:10+00:00 0:10:43 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24755
3257
Liu Sam 🇹🇼PredictorLast aido2-PRED
step1-simulation host-error yes ip-172-31-35-218-10491
2019-10-31 14:15:25+00:00 2019-10-31 14:15:30+00:00 0:00:05 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24744
4307
Frank (Chude) Qian 🇨🇦Frank test submission aido3-LFVI-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-10-31 14:05:27+00:00 2019-10-31 14:15:17+00:00 0:09:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.5636399177084477 survival_time_median 2.9499999999999975 deviation-center-line_median 0.19417316650714284 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.029295682907104492 agent_compute-ego_mean 0.02726112560067494 agent_compute-ego_median 0.027288820170149015 agent_compute-ego_min 0.024469208717346192 deviation-center-line_max 0.27212935355303575 deviation-center-line_mean 0.1659879300685689 deviation-center-line_min 0.060733287044270105 deviation-heading_max 0.3681646786246837 deviation-heading_mean 0.2857346549044181 deviation-heading_median 0.2652784439875202 deviation-heading_min 0.2528567413804248 driven_any_max 2.7696546371463566 driven_any_mean 1.474111788433791 driven_any_median 1.5696547037668402 driven_any_min 0.4010834948810282 driven_lanedir_consec_max 1.9242206205397283 driven_lanedir_consec_mean 1.2102809057090995 driven_lanedir_consec_min 0.38720104799654376 driven_lanedir_max 1.924267585170248 driven_lanedir_mean 1.2103413601562374 driven_lanedir_median 1.5638383114510817 driven_lanedir_min 0.38720104799654376 in-drivable-lane_max 1.399999999999995 in-drivable-lane_mean 0.4199999999999985 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.5696547037668402, "sim_physics": 0.20047688888291185, "survival_time": 2.9499999999999975, "driven_lanedir": 1.5638383114510817, "sim_render-ego": 0.013351614192380745, "in-drivable-lane": 0, "agent_compute-ego": 0.028995627063815876, "deviation-heading": 0.2528567413804248, "set_robot_commands": 0.009209325758077333, "deviation-center-line": 0.19417316650714284, "driven_lanedir_consec": 1.5636399177084477, "sim_compute_sim_state": 0.005122803025326486, "sim_compute_performance-ego": 0.0075613038014557404, "sim_compute_robot_state-ego": 0.009265879453238797, "sim_compute_robot_state-npc0": 0.009313397488351596, "sim_compute_robot_state-npc1": 0.008527872926097805, "sim_compute_robot_state-npc2": 0.008327302286180399, "sim_compute_robot_state-npc3": 0.008640519643233995}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.21468364108692517, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.013597932728854092, "in-drivable-lane": 0, "agent_compute-ego": 0.029295682907104492, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.009859984571283514, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.005976286801424893, "sim_compute_performance-ego": 0.006946899674155496, "sim_compute_robot_state-ego": 0.009759263558821243, "sim_compute_robot_state-npc0": 0.008767463944175026, "sim_compute_robot_state-npc1": 0.009312250397422096, "sim_compute_robot_state-npc2": 0.008281035856767134, "sim_compute_robot_state-npc3": 0.008957266807556152}, "udem1-2-0": {"driven_any": 2.1696546375441614, "sim_physics": 0.17972950995722903, "survival_time": 3.949999999999994, "driven_lanedir": 1.7414407758715231, "sim_render-ego": 0.012440171422837655, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.027288820170149015, "deviation-heading": 0.2785063205851342, "set_robot_commands": 0.008810308915150316, "deviation-center-line": 0.22563902167216496, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.0047669501244267335, "sim_compute_performance-ego": 0.007141179676297345, "sim_compute_robot_state-ego": 0.008994371076173421, "sim_compute_robot_state-npc0": 0.008356006839607336, "sim_compute_robot_state-npc1": 0.008341415018974981, "sim_compute_robot_state-npc2": 0.008130040349839609, "sim_compute_robot_state-npc3": 0.007986286018468156}, "udem1-3-0": {"driven_any": 2.7696546371463566, "sim_physics": 0.17177411040874443, "survival_time": 4.94999999999999, "driven_lanedir": 1.924267585170248, "sim_render-ego": 0.0122109278283938, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.026256289144959113, "deviation-heading": 0.2652784439875202, "set_robot_commands": 0.008360255848277699, "deviation-center-line": 0.27212935355303575, "driven_lanedir_consec": 1.9242206205397283, "sim_compute_sim_state": 0.004736259730175288, "sim_compute_performance-ego": 0.006488508648342556, "sim_compute_robot_state-ego": 0.008272968157373294, "sim_compute_robot_state-npc0": 0.0075544299501361266, "sim_compute_robot_state-npc1": 0.007886667444248392, "sim_compute_robot_state-npc2": 0.0077439582709110145, "sim_compute_robot_state-npc3": 0.007458352079295149}, "udem1-4-0": {"driven_any": 0.4010834948810282, "sim_physics": 0.18931636810302735, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38720104799654376, "sim_render-ego": 0.011887621879577636, "in-drivable-lane": 0, "agent_compute-ego": 0.024469208717346192, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.007688581943511963, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38720104799654376, "sim_compute_sim_state": 0.005046296119689942, "sim_compute_performance-ego": 0.006579685211181641, "sim_compute_robot_state-ego": 0.009588265419006347, "sim_compute_robot_state-npc0": 0.00735853910446167, "sim_compute_robot_state-npc1": 0.007738435268402099, "sim_compute_robot_state-npc2": 0.007989764213562012, "sim_compute_robot_state-npc3": 0.007611870765686035}}set_robot_commands_max 0.009859984571283514 set_robot_commands_mean 0.008785691407260165 set_robot_commands_median 0.008810308915150316 set_robot_commands_min 0.007688581943511963 sim_compute_performance-ego_max 0.0075613038014557404 sim_compute_performance-ego_mean 0.0069435154022865556 sim_compute_performance-ego_median 0.006946899674155496 sim_compute_performance-ego_min 0.006488508648342556 sim_compute_robot_state-ego_max 0.009759263558821243 sim_compute_robot_state-ego_mean 0.00917614953292262 sim_compute_robot_state-ego_median 0.009265879453238797 sim_compute_robot_state-ego_min 0.008272968157373294 sim_compute_robot_state-npc0_max 0.009313397488351596 sim_compute_robot_state-npc0_mean 0.008269967465346351 sim_compute_robot_state-npc0_median 0.008356006839607336 sim_compute_robot_state-npc0_min 0.00735853910446167 sim_compute_robot_state-npc1_max 0.009312250397422096 sim_compute_robot_state-npc1_mean 0.008361328211029074 sim_compute_robot_state-npc1_median 0.008341415018974981 sim_compute_robot_state-npc1_min 0.007738435268402099 sim_compute_robot_state-npc2_max 0.008327302286180399 sim_compute_robot_state-npc2_mean 0.008094420195452035 sim_compute_robot_state-npc2_median 0.008130040349839609 sim_compute_robot_state-npc2_min 0.0077439582709110145 sim_compute_robot_state-npc3_max 0.008957266807556152 sim_compute_robot_state-npc3_mean 0.008130859062847898 sim_compute_robot_state-npc3_median 0.007986286018468156 sim_compute_robot_state-npc3_min 0.007458352079295149 sim_compute_sim_state_max 0.005976286801424893 sim_compute_sim_state_mean 0.005129719160208669 sim_compute_sim_state_median 0.005046296119689942 sim_compute_sim_state_min 0.004736259730175288 sim_physics_max 0.21468364108692517 sim_physics_mean 0.19119610368776757 sim_physics_median 0.18931636810302735 sim_physics_min 0.17177411040874443 sim_render-ego_max 0.013597932728854092 sim_render-ego_mean 0.012697653610408786 sim_render-ego_median 0.012440171422837655 sim_render-ego_min 0.011887621879577636 simulation-passed 1 survival_time_max 4.94999999999999 survival_time_mean 2.7899999999999965 survival_time_min 1.0000000000000002
No reset possible 24722
2686
Maxim Scherbakov PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:04:12+00:00 2019-10-31 14:04:47+00:00 0:00:35 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1056329505228273 error_L2 0.017186127240682313
No reset possible 24717
2887
Diego Charrez 🇵🇪PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:03:48+00:00 2019-10-31 14:04:04+00:00 0:00:16 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.09981573838922685 error_L2 0.017077890140506036
No reset possible 24705
3067
Lei Chen PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:03:06+00:00 2019-10-31 14:03:27+00:00 0:00:21 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12123615325060594 error_L2 0.02270492675267548
No reset possible 24692
3171
Chao-Chun Hsu 🇹🇼PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:02:31+00:00 2019-10-31 14:02:45+00:00 0:00:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.10060273309701089 error_L2 0.016727857446851888
No reset possible 24689
3265
Liu Sam 🇹🇼challenge-aido_LF-template-random aido2-PRED
step1-simulation host-error yes ip-172-31-35-218-10491
2019-10-31 14:02:19+00:00 2019-10-31 14:02:23+00:00 0:00:04 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24683
3265
Liu Sam 🇹🇼challenge-aido_LF-template-random aido2-PRED
step1-simulation host-error yes ip-172-31-35-218-10491
2019-10-31 14:02:06+00:00 2019-10-31 14:02:10+00:00 0:00:04 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24671
3181
Pokai Chang PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:01:36+00:00 2019-10-31 14:01:50+00:00 0:00:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.097718386399328 error_L2 0.014701255610926082
No reset possible 24651
3245
Shen Yu Chia 🇹🇼PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 14:00:04+00:00 2019-10-31 14:01:28+00:00 0:01:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.12226140650570153 error_L2 0.022663471117563855
No reset possible 24647
3264
Liu Sam 🇹🇼challenge-aido_LF-template-random aido2-PRED
step1-simulation host-error yes ip-172-31-35-218-10491
2019-10-31 13:59:44+00:00 2019-10-31 13:59:49+00:00 0:00:05 Error while running [...]
stderr | Pulling solution ...
stderr | Pulling evaluation ... done
stderr |
stderr | ERROR: for solution pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24638
3279
Tony Hsiao PredictorRandom aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 13:59:09+00:00 2019-10-31 13:59:29+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.32436324990483056 error_L2 0.15677682201451518
No reset possible 24630
3583
Karthikk Subramanian 🇸🇬PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 13:58:36+00:00 2019-10-31 13:59:01+00:00 0:00:25 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.09699792927592885 error_L2 0.014373336438548445
No reset possible 24622
3819
Philippe Laferriere PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 13:58:09+00:00 2019-10-31 13:58:29+00:00 0:00:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11614092250742793 error_L2 0.02065579153822581
No reset possible 24611
3836
Philippe Laferriere PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 13:57:18+00:00 2019-10-31 13:57:41+00:00 0:00:23 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1199478702046252 error_L2 0.023546337630569993
No reset possible 24550
4294
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LF-sim-validation
step1-simulation success no ip-172-31-35-218-10491
2019-10-31 13:51:20+00:00 2019-10-31 13:57:09+00:00 0:05:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.13005513204193506 in-drivable-lane_median 0.29999999999999893
other stats agent_compute-ego_max 0.021018667221069334 agent_compute-ego_mean 0.0169147952169904 agent_compute-ego_median 0.01669814013227632 agent_compute-ego_min 0.013699924244600184 deviation-center-line_max 0.2072381278624381 deviation-center-line_mean 0.13189395308989765 deviation-center-line_min 0.0788839760023766 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3206717506075888 deviation-heading_median 0.23606825392187256 deviation-heading_min 0.19401296908406307 driven_any_max 1.6182144577009443 driven_any_mean 0.861378585933269 driven_any_median 0.9933867744747804 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 0.8010406009604816 driven_lanedir_consec_mean 0.5597645764431625 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 0.8010406009604816 driven_lanedir_mean 0.5597645764431625 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.619999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07345646840554697, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010251817879853424, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.018793366573475027, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.005940265125698513, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004083584856103968, "sim_compute_performance-ego": 0.005861141063548901, "sim_compute_robot_state-ego": 0.007395969496832954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05967118225845637, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.008064288719027651, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.014363877913531137, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00551308837591433, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0033943653106689453, "sim_compute_performance-ego": 0.0043639902975045, "sim_compute_robot_state-ego": 0.0055313203849044505}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06543841081507065, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.007735715192906997, "in-drivable-lane": 0, "agent_compute-ego": 0.013699924244600184, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.005152772454654469, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.003313892027911018, "sim_compute_performance-ego": 0.004322935553158031, "sim_compute_robot_state-ego": 0.005500947727876551}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0907347011566162, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.012570953369140624, "in-drivable-lane": 0, "agent_compute-ego": 0.021018667221069334, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.007925701141357423, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004772872924804688, "sim_compute_performance-ego": 0.007446651458740235, "sim_compute_robot_state-ego": 0.009009037017822264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.06745746165891237, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.009248624874066705, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.01669814013227632, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.006663449202911763, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.003810294066803365, "sim_compute_performance-ego": 0.005141065090517455, "sim_compute_robot_state-ego": 0.006440367879746835}}set_robot_commands_max 0.007925701141357423 set_robot_commands_mean 0.0062390552601073 set_robot_commands_median 0.005940265125698513 set_robot_commands_min 0.005152772454654469 sim_compute_performance-ego_max 0.007446651458740235 sim_compute_performance-ego_mean 0.005427156692693824 sim_compute_performance-ego_median 0.005141065090517455 sim_compute_performance-ego_min 0.004322935553158031 sim_compute_robot_state-ego_max 0.009009037017822264 sim_compute_robot_state-ego_mean 0.00677552850143661 sim_compute_robot_state-ego_median 0.006440367879746835 sim_compute_robot_state-ego_min 0.005500947727876551 sim_compute_sim_state_max 0.004772872924804688 sim_compute_sim_state_mean 0.0038750018372583966 sim_compute_sim_state_median 0.003810294066803365 sim_compute_sim_state_min 0.003313892027911018 sim_physics_max 0.0907347011566162 sim_physics_mean 0.07135164485892051 sim_physics_median 0.06745746165891237 sim_physics_min 0.05967118225845637 sim_render-ego_max 0.012570953369140624 sim_render-ego_mean 0.00957428000699908 sim_render-ego_median 0.009248624874066705 sim_render-ego_min 0.007735715192906997 simulation-passed 1 survival_time_max 3.949999999999994 survival_time_mean 2.2599999999999985 survival_time_min 0.8500000000000002
No reset possible 24530
4115
Simone Arreghini 🇮🇹PredictorLast aido2-PRED
step1-simulation success yes ip-172-31-35-218-10491
2019-10-31 13:50:12+00:00 2019-10-31 13:50:45+00:00 0:00:33 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11427126176521545 error_L2 0.020217678744320875
No reset possible 24528
4289
Frank (Chude) Qian 🇨🇦PredictorLast aido2-PRED
step1-simulation error no ip-172-31-35-218-10491
2019-10-31 13:33:45+00:00 2019-10-31 13:34:54+00:00 0:01:09 Unexpected exception [...] Unexpected exception:
Traceback (most recent call last):
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
return deserialize_Dict(K, mj, global_symbols, encountered)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
return schema_to_type(schema, global_symbols, encountered)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
res = schema_to_type_(schema0, global_symbols, encountered)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
assert False, schema # pragma: no cover
AssertionError: {'title': 'Any'}
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
return deserialize_dataclass(K, mj, global_symbols, encountered)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
raise Exception(msg) from e
Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}
| Traceback (most recent call last):
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| return deserialize_Dict(K, mj, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| return schema_to_type(schema, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| res = schema_to_type_(schema0, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| assert False, schema # pragma: no cover
| AssertionError: {'title': 'Any'}
|
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 75, in <module>
main(cie)
File "experiment_manager.py", line 26, in main
agent_ci._get_node_protocol()
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 79, in _get_node_protocol
timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 211, in read_one
data = ipce_to_object(msg[FIELD_DATA], {}, expect_type=klass)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
return deserialize_dataclass(K, mj, global_symbols, encountered)
File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
raise Exception(msg) from e
Exception: Cannot deserialize attribute meta (expect: <class 'zuper_nodes.language.InteractionProtocol'>)
value: {'inputs': {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'outputs': {'logs': {'type': 'array', 'items': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'title': 'List[str]', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'aborted': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_description': {'$id': 'http://invalid.json-schema.org/NodeDescription#', 'type': 'object', 'order': ['description'], 'title': 'NodeDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'NodeDescription(description: str)', '__qualname__': 'NodeDescription'}, 'set_config_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'build_description': {'$id': 'http://invalid.json-schema.org/BuildDescription#', 'type': 'object', 'order': [], 'title': 'BuildDescription', '$schema': 'http://json-schema.org/draft-07/schema#', '__module__': 'zuper_nodes_wrapper.meta_protocol', 'description': 'BuildDescription()', '__qualname__': 'BuildDescription'}, 'config_description': {'$id': 'http://invalid.json-schema.org/ConfigDescription#', 'type': 'object', 'order': ['config', 'current'], 'title': 'ConfigDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['config', 'current'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'config': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}, 'current': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'ConfigDescription(config: type, current: Any)', '__qualname__': 'ConfigDescription'}, 'protocol_description': {'$id': 'http://invalid.json-schema.org/ProtocolDescription#', 'type': 'object', 'order': ['data', 'meta'], 'title': 'ProtocolDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['data', 'meta'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'data': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}, 'meta': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}}, 'description': 'ProtocolDescription(data: zuper_nodes.language.InteractionProtocol, meta: zuper_nodes.language.InteractionProtocol)', '__qualname__': 'ProtocolDescription'}}, 'language': '((in:describe_config ; out:config_description) | (in:set_config ; (out:set_config_ack | out:set_config_error)) | (in:describe_protocol ; out:protocol_description) | (in:describe_node ; out:node_description) | (in:describe_build ; out:build_description) | (in:get_state ; out:node_state) | (in:set_state ; (out:set_state_ack | out:set_state_error)) | (in:get_logs ; out:logs) | out:aborted)*', 'description': '\nBasic interaction protocol for nodes spoken by the node wrapper.\n\n '}
| Traceback (most recent call last):
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| return deserialize_Dict(K, mj, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| return schema_to_type(schema, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| res = schema_to_type_(schema0, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| assert False, schema # pragma: no cover
| AssertionError: {'title': 'Any'}
|
| The above exception was the direct cause of the following exception:
|
| Traceback (most recent call last):
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
| return deserialize_dataclass(K, mj, global_symbols, encountered)
| File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
| raise Exception(msg) from e
| Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
| value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}
|
| | Traceback (most recent call last):
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| | attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| | return deserialize_Dict(K, mj, global_symbols, encountered)
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| | attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| | return schema_to_type(schema, global_symbols, encountered)
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| | res = schema_to_type_(schema0, global_symbols, encountered)
| | File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| | assert False, schema # pragma: no cover
| | AssertionError: {'title': 'Any'}
| |
|
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24517
4281
Liam Paull 🇨🇦challenge-aido_LF-template-random aido3-LF-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-10-31 12:29:42+00:00 2019-10-31 12:39:51+00:00 0:10:09 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5723310224856362 survival_time_median 2.549999999999999 deviation-center-line_median 0.10099507669212504 in-drivable-lane_median 0.4499999999999984
other stats agent_compute-ego_max 0.019612897800493845 agent_compute-ego_mean 0.017106946548126833 agent_compute-ego_median 0.017444448471069338 agent_compute-ego_min 0.013527842128978056 deviation-center-line_max 0.28386357003337986 deviation-center-line_mean 0.12786165368054708 deviation-center-line_min 0.07112529346797256 deviation-heading_max 0.5289022616823588 deviation-heading_mean 0.3391682685652288 deviation-heading_median 0.3292838510353387 deviation-heading_min 0.19401296908406307 driven_any_max 2.1706243860917107 driven_any_mean 0.975949037827615 driven_any_median 1.0117660515775695 driven_any_min 0.23626560261560617 driven_lanedir_consec_max 1.919400421063861 driven_lanedir_consec_mean 0.6896171461819268 driven_lanedir_consec_min 0.2264965947033466 driven_lanedir_max 1.919400421063861 driven_lanedir_mean 0.6896171461819268 driven_lanedir_median 0.5723310224856362 driven_lanedir_min 0.2264965947033466 in-drivable-lane_max 1.7999999999999936 in-drivable-lane_mean 0.5899999999999982 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.07467835037796586, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010226121655216924, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0184983147515191, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006553292274475098, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004086286933333786, "sim_compute_performance-ego": 0.005931518695972584, "sim_compute_robot_state-ego": 0.006850896058259187}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05510797220117906, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.007813392900953106, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.017213653115665212, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.00557712480133655, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0030877356435738356, "sim_compute_performance-ego": 0.0042266705456902, "sim_compute_robot_state-ego": 0.005499101152607039}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.059962104348575365, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.007538318634033203, "in-drivable-lane": 0, "agent_compute-ego": 0.013527842128978056, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.005214845432954676, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0030724441303926356, "sim_compute_performance-ego": 0.0039722779217888325, "sim_compute_robot_state-ego": 0.005324966767254998}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06950467109680175, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.009847650527954102, "in-drivable-lane": 0, "agent_compute-ego": 0.017444448471069338, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.006321353912353516, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.004287319183349609, "sim_compute_performance-ego": 0.0055457019805908205, "sim_compute_robot_state-ego": 0.006936836242675781}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6182144577009443, "sim_physics": 0.0786283016204834, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.01017494443096692, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.019612897800493845, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0073355662671825556, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.004059562200232398, "sim_compute_performance-ego": 0.00562598735471315, "sim_compute_robot_state-ego": 0.007202021683318706}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.003851495683299, "sim_physics": 0.062251168854382574, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735949, "sim_render-ego": 0.009022070437061543, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01723548830771933, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.006214628414231904, "deviation-center-line": 0.08968283443958694, "driven_lanedir_consec": 0.7531703123735949, "sim_compute_sim_state": 0.003908308184876734, "sim_compute_performance-ego": 0.004770609797263632, "sim_compute_robot_state-ego": 0.006458983129384566}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504386, "sim_physics": 0.0769568043095725, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.010015628167561122, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.018677869013377597, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0070811765534537175, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.004074211631502424, "sim_compute_performance-ego": 0.005418155874524798, "sim_compute_robot_state-ego": 0.006967633962631226}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.07753467559814453, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.01008584385826474, "in-drivable-lane": 0, "agent_compute-ego": 0.018867594855172292, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.007061776660737537, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.00439536003839402, "sim_compute_performance-ego": 0.005571354003179641, "sim_compute_robot_state-ego": 0.007054533277239118}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510794, "sim_physics": 0.056277561995942714, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.007516270976955608, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.01382938886092881, "deviation-heading": 0.3292838510353387, "set_robot_commands": 0.005282507104388738, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.0031596846499685515, "sim_compute_performance-ego": 0.004137920121015128, "sim_compute_robot_state-ego": 0.005383790549585375}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.043548155325732, "sim_physics": 0.07434545863758434, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.009661964936689898, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.018348689512772992, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.0071140809492631395, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.003802806680852717, "sim_compute_performance-ego": 0.005348504673350941, "sim_compute_robot_state-ego": 0.0068232796408913355}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193285, "sim_physics": 0.06256593047798455, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848785, "sim_render-ego": 0.009140116827828544, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0180413970699558, "deviation-heading": 0.35668107106767694, "set_robot_commands": 0.006302870713271104, "deviation-center-line": 0.2251391443608223, "driven_lanedir_consec": 1.1042463557848785, "sim_compute_sim_state": 0.003616472343345741, "sim_compute_performance-ego": 0.004958694631403143, "sim_compute_robot_state-ego": 0.006205654763556146}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06629621982574463, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.007982935224260603, "in-drivable-lane": 0, "agent_compute-ego": 0.01461372205189296, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.005329115050179618, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.003176791327340262, "sim_compute_performance-ego": 0.004409313201904297, "sim_compute_robot_state-ego": 0.005681088992527553}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775695, "sim_physics": 0.06176132781832826, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.010536591211954752, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.017605243944654278, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.008005679822435566, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.003926380007874732, "sim_compute_performance-ego": 0.0059401194254557295, "sim_compute_robot_state-ego": 0.0072022466098561}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.06268349400273075, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.008310423956976997, "in-drivable-lane": 0, "agent_compute-ego": 0.016555830284401222, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.006047760998761213, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0033580373834680628, "sim_compute_performance-ego": 0.004317839940388997, "sim_compute_robot_state-ego": 0.00556732107091833}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05536184123918122, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063861, "sim_render-ego": 0.00788407699734557, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.016531818053301645, "deviation-heading": 0.5178939525116448, "set_robot_commands": 0.00572815829632329, "deviation-center-line": 0.28386357003337986, "driven_lanedir_consec": 1.919400421063861, "sim_compute_sim_state": 0.0032800880132936965, "sim_compute_performance-ego": 0.004417122579088398, "sim_compute_robot_state-ego": 0.005751958080366546}}set_robot_commands_max 0.008005679822435566 set_robot_commands_mean 0.006344662483423216 set_robot_commands_median 0.006302870713271104 set_robot_commands_min 0.005214845432954676 sim_compute_performance-ego_max 0.0059401194254557295 sim_compute_performance-ego_mean 0.004972786049755353 sim_compute_performance-ego_median 0.004958694631403143 sim_compute_performance-ego_min 0.0039722779217888325 sim_compute_robot_state-ego_max 0.0072022466098561 sim_compute_robot_state-ego_mean 0.006327354132071468 sim_compute_robot_state-ego_median 0.006458983129384566 sim_compute_robot_state-ego_min 0.005324966767254998 sim_compute_sim_state_max 0.00439536003839402 sim_compute_sim_state_mean 0.00368609922345328 sim_compute_sim_state_median 0.003802806680852717 sim_compute_sim_state_min 0.0030724441303926356 sim_physics_max 0.0786283016204834 sim_physics_mean 0.06626105882697343 sim_physics_median 0.06268349400273075 sim_physics_min 0.05510797220117906 sim_render-ego_max 0.010536591211954752 sim_render-ego_mean 0.00905042338293491 sim_render-ego_median 0.009140116827828544 sim_render-ego_min 0.007516270976955608 simulation-passed 1 survival_time_max 5.09999999999999 survival_time_mean 2.503333333333331 survival_time_min 0.8500000000000002
No reset possible 24505
4276
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-29 18:44:53+00:00 2019-10-29 18:46:50+00:00 0:01:57 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24499
4270
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-29 18:07:56+00:00 2019-10-29 18:09:55+00:00 0:01:59 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24490
4267
Gianmarco Bernasconi challenge-aido_LF-baseline-duckietown aido3-LFVI-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-29 17:53:48+00:00 2019-10-29 18:00:10+00:00 0:06:22 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24488
4259
Riza Velioglu 🇩🇪Uni Bielefeld aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-29 17:42:26+00:00 2019-10-29 17:46:02+00:00 0:03:36 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24487
4258
Anastasiya Nikolskaya 🇷🇺beta aido3-LF-sim-testing
step1-simulation success no ip-172-31-35-218-10491
2019-10-28 12:15:50+00:00 2019-10-28 12:39:12+00:00 0:23:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7682830990812033 survival_time_median 13.400000000000055 deviation-center-line_median 0.5992304149874592 in-drivable-lane_median 1.999999999999993
other stats agent_compute-ego_max 0.04775888919830322 agent_compute-ego_mean 0.047127585148084614 agent_compute-ego_median 0.047152678991101454 agent_compute-ego_min 0.04622697830200195 deviation-center-line_max 1.1320867856256165 deviation-center-line_mean 0.6501628090102274 deviation-center-line_min 0.22585045001834453 deviation-heading_max 4.394769159225656 deviation-heading_mean 2.3560209596115818 deviation-heading_median 2.2813505105951473 deviation-heading_min 0.6330306279218182 driven_any_max 1.9779260927364972 driven_any_mean 1.454109139703781 driven_any_median 1.6662665960601095 driven_any_min 0.4737620395428482 driven_lanedir_consec_max 1.9461447636461848 driven_lanedir_consec_mean 1.017482491525696 driven_lanedir_consec_min 0.46054384366544143 driven_lanedir_max 1.9461447636461848 driven_lanedir_mean 1.1100755806526137 driven_lanedir_median 1.2329481856844553 driven_lanedir_min 0.46054384366544143 in-drivable-lane_max 8.550000000000093 in-drivable-lane_mean 2.2033333333333474 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.5950196112021284, "sim_physics": 0.04822915077209473, "survival_time": 14.950000000000076, "driven_lanedir": 1.421907339806391, "sim_render-ego": 0.006682670911153157, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.04753945509592692, "deviation-heading": 3.189077596704791, "set_robot_commands": 0.004510773817698161, "deviation-center-line": 0.7782425235084787, "driven_lanedir_consec": 0.605770244512791, "sim_compute_sim_state": 0.0027677003542582192, "sim_compute_performance-ego": 0.0038031975428263346, "sim_compute_robot_state-ego": 0.004692803223927816}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.964692711353324, "sim_physics": 0.04650168657302856, "survival_time": 14.950000000000076, "driven_lanedir": 1.923187177350548, "sim_render-ego": 0.007457722028096517, "in-drivable-lane": 0, "agent_compute-ego": 0.04707299868265788, "deviation-heading": 2.1419821740862286, "set_robot_commands": 0.004546384811401367, "deviation-center-line": 0.953669485194954, "driven_lanedir_consec": 1.923187177350548, "sim_compute_sim_state": 0.0027802348136901855, "sim_compute_performance-ego": 0.003734941482543945, "sim_compute_robot_state-ego": 0.0046808513005574546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0332893588787009, "sim_physics": 0.04956927684822468, "survival_time": 9.900000000000006, "driven_lanedir": 0.6226777285751108, "sim_render-ego": 0.006878985299004449, "in-drivable-lane": 3.2000000000000215, "agent_compute-ego": 0.04662203909170748, "deviation-heading": 1.6389239175417738, "set_robot_commands": 0.004614471185086954, "deviation-center-line": 0.6005997162895127, "driven_lanedir_consec": 0.6226777285751108, "sim_compute_sim_state": 0.0027981225890342637, "sim_compute_performance-ego": 0.0037360046849106297, "sim_compute_robot_state-ego": 0.0046724394114330565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7217044876656875, "sim_physics": 0.04489726519239121, "survival_time": 13.80000000000006, "driven_lanedir": 1.2329481856844553, "sim_render-ego": 0.006796758244003075, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.04683287247367527, "deviation-heading": 4.394769159225656, "set_robot_commands": 0.004583665426226629, "deviation-center-line": 1.0239650607588229, "driven_lanedir_consec": 1.1836947640680189, "sim_compute_sim_state": 0.002798214338827824, "sim_compute_performance-ego": 0.0037427941958109536, "sim_compute_robot_state-ego": 0.00471300923306009}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6662665960601095, "sim_physics": 0.04561045952141285, "survival_time": 12.800000000000049, "driven_lanedir": 1.264678574915095, "sim_render-ego": 0.006809067912399769, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.04768192954361439, "deviation-heading": 2.2813505105951473, "set_robot_commands": 0.0044700875878334045, "deviation-center-line": 0.5673105035879952, "driven_lanedir_consec": 1.209389128044509, "sim_compute_sim_state": 0.002830992452800274, "sim_compute_performance-ego": 0.0037262849509716034, "sim_compute_robot_state-ego": 0.0047439271584153175}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.8439940398715065, "sim_physics": 0.04470690568288167, "survival_time": 14.950000000000076, "driven_lanedir": 1.6821174621239878, "sim_render-ego": 0.0067376438776652016, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.04770254850387573, "deviation-heading": 2.3536561398055516, "set_robot_commands": 0.004519905249277751, "deviation-center-line": 0.958275452068856, "driven_lanedir_consec": 1.6821174621239878, "sim_compute_sim_state": 0.002802442709604899, "sim_compute_performance-ego": 0.003723467191060384, "sim_compute_robot_state-ego": 0.004697428544362386}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.1372002430950952, "sim_physics": 0.04439496839201296, "survival_time": 7.699999999999981, "driven_lanedir": 0.6874997318910254, "sim_render-ego": 0.006753416804524211, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.046550357496583615, "deviation-heading": 2.452664031168391, "set_robot_commands": 0.004486474123868075, "deviation-center-line": 0.22585045001834453, "driven_lanedir_consec": 0.6330604194303624, "sim_compute_sim_state": 0.002779615389836299, "sim_compute_performance-ego": 0.003717944219514921, "sim_compute_robot_state-ego": 0.00467860543882692}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.8311987723733951, "sim_physics": 0.045090573937145634, "survival_time": 13.400000000000055, "driven_lanedir": 1.3067819125520876, "sim_render-ego": 0.007309942992765512, "in-drivable-lane": 2.350000000000013, "agent_compute-ego": 0.0472973318242315, "deviation-heading": 3.3197205856054555, "set_robot_commands": 0.004568951343422506, "deviation-center-line": 1.1320867856256165, "driven_lanedir_consec": 1.2904915795202017, "sim_compute_sim_state": 0.002784644489857688, "sim_compute_performance-ego": 0.003747739009003141, "sim_compute_robot_state-ego": 0.0047182823295023905}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.6854088564619476, "sim_physics": 0.04640557686487834, "survival_time": 14.950000000000076, "driven_lanedir": 0.5712033126717624, "sim_render-ego": 0.006760397752126058, "in-drivable-lane": 8.550000000000093, "agent_compute-ego": 0.04752743482589722, "deviation-heading": 1.281249037215461, "set_robot_commands": 0.00455283006032308, "deviation-center-line": 0.5655880550526432, "driven_lanedir_consec": 0.5712033126717624, "sim_compute_sim_state": 0.0027849904696146646, "sim_compute_performance-ego": 0.003718123435974121, "sim_compute_robot_state-ego": 0.00467589537302653}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9833669224418566, "sim_physics": 0.04403412026703042, "survival_time": 9.45, "driven_lanedir": 0.5393208280331521, "sim_render-ego": 0.006809544941735646, "in-drivable-lane": 3.700000000000012, "agent_compute-ego": 0.04653857372425221, "deviation-heading": 1.854751712324951, "set_robot_commands": 0.004537384346048668, "deviation-center-line": 0.35995839183640066, "driven_lanedir_consec": 0.5372733379392138, "sim_compute_sim_state": 0.00278251259415238, "sim_compute_performance-ego": 0.00371516192400897, "sim_compute_robot_state-ego": 0.004688256632083308}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.8032627334136937, "sim_physics": 0.04641284147898357, "survival_time": 14.950000000000076, "driven_lanedir": 1.5846432975767266, "sim_render-ego": 0.006862466335296631, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.04775888919830322, "deviation-heading": 3.7423232821219874, "set_robot_commands": 0.004501646359761556, "deviation-center-line": 0.5992304149874592, "driven_lanedir_consec": 1.2264714523216158, "sim_compute_sim_state": 0.0027881773312886556, "sim_compute_performance-ego": 0.003712822596232096, "sim_compute_robot_state-ego": 0.004706851641337077}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0831874744282437, "sim_physics": 0.04424171595229316, "survival_time": 9.700000000000005, "driven_lanedir": 0.6391964522160318, "sim_render-ego": 0.006674228255281744, "in-drivable-lane": 3.3500000000000174, "agent_compute-ego": 0.047152678991101454, "deviation-heading": 3.1953387990074393, "set_robot_commands": 0.004458735898597953, "deviation-center-line": 0.5069894275076379, "driven_lanedir_consec": 0.6019290599344902, "sim_compute_sim_state": 0.0027279841531183302, "sim_compute_performance-ego": 0.003664821693577718, "sim_compute_robot_state-ego": 0.004603459662997846}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.011357156031686, "sim_physics": 0.04352053960164388, "survival_time": 7.499999999999981, "driven_lanedir": 0.7682830990812033, "sim_render-ego": 0.006728019714355469, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.04622697830200195, "deviation-heading": 1.021499396689066, "set_robot_commands": 0.004574275016784668, "deviation-center-line": 0.3934222136649902, "driven_lanedir_consec": 0.7682830990812033, "sim_compute_sim_state": 0.002768691380818685, "sim_compute_performance-ego": 0.0036762030919392902, "sim_compute_robot_state-ego": 0.004638772010803222}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4737620395428482, "sim_physics": 0.047722497294026035, "survival_time": 3.099999999999997, "driven_lanedir": 0.46054384366544143, "sim_render-ego": 0.006833707132647114, "in-drivable-lane": 0, "agent_compute-ego": 0.04713257666557066, "deviation-heading": 0.6330306279218182, "set_robot_commands": 0.004394077485607517, "deviation-center-line": 0.26856448321547716, "driven_lanedir_consec": 0.46054384366544143, "sim_compute_sim_state": 0.002677932862312563, "sim_compute_performance-ego": 0.0036263927336662046, "sim_compute_robot_state-ego": 0.0045492764442197735}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.9779260927364972, "sim_physics": 0.042209981282552086, "survival_time": 14.950000000000076, "driven_lanedir": 1.9461447636461848, "sim_render-ego": 0.006614000002543132, "in-drivable-lane": 0, "agent_compute-ego": 0.04727711280186971, "deviation-heading": 1.839977424160003, "set_robot_commands": 0.0045161692301432296, "deviation-center-line": 0.8186891718362214, "driven_lanedir_consec": 1.9461447636461848, "sim_compute_sim_state": 0.002733598550160726, "sim_compute_performance-ego": 0.003669304052988688, "sim_compute_robot_state-ego": 0.00459523598353068}}set_robot_commands_max 0.004614471185086954 set_robot_commands_mean 0.004522388796138767 set_robot_commands_median 0.004519905249277751 set_robot_commands_min 0.004394077485607517 sim_compute_performance-ego_max 0.0038031975428263346 sim_compute_performance-ego_mean 0.0037143468536686 sim_compute_performance-ego_median 0.003718123435974121 sim_compute_performance-ego_min 0.0036263927336662046 sim_compute_robot_state-ego_max 0.0047439271584153175 sim_compute_robot_state-ego_mean 0.0046703396258722584 sim_compute_robot_state-ego_median 0.0046808513005574546 sim_compute_robot_state-ego_min 0.0045492764442197735 sim_compute_sim_state_max 0.002830992452800274 sim_compute_sim_state_mean 0.0027737236319583776 sim_compute_sim_state_median 0.00278251259415238 sim_compute_sim_state_min 0.002677932862312563 sim_physics_max 0.04956927684822468 sim_physics_mean 0.04556983731070665 sim_physics_median 0.045090573937145634 sim_physics_min 0.042209981282552086 sim_render-ego_max 0.007457722028096517 sim_render-ego_mean 0.0068472381469065115 sim_render-ego_median 0.006796758244003075 sim_render-ego_min 0.006614000002543132 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 11.803333333333374 survival_time_min 3.099999999999997
No reset possible 24443
4240
Manfred Diaz Baseline-IL-logs-tensorflow aido3-LF-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-24 23:55:55+00:00 2019-10-25 00:00:31+00:00 0:04:36 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24424
4226
Manfred Diaz Baseline-IL-logs-tensorflow aido3-LFV-sim-validation
step1-simulation failed no ip-172-31-35-218-10491
2019-10-24 06:36:51+00:00 2019-10-24 06:37:50+00:00 0:00:59 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 299, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "get_commands".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
|| return fn(*args)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
|| options, feed_dict, fetch_list, target_list, run_metadata)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
|| run_metadata)
|| tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
|| [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
||
|| During handling of the above exception, another exception occurred:
||
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "imitation_agent.py", line 71, in on_received_get_commands
|| pwm_left, pwm_right = self.compute_action(self.config.current_image)
|| File "imitation_agent.py", line 60, in compute_action
|| x: observation
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
|| run_metadata_ptr)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
|| feed_dict_tensor, options, run_metadata)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
|| run_metadata)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
|| raise type(e)(node_def, op, message)
|| tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
|| [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
||
|| Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
|| File "imitation_agent.py", line 136, in <module>
|| main()
|| File "imitation_agent.py", line 132, in main
|| wrap_direct(node=node, protocol=protocol)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
|| run_loop(node, protocol, args)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
|| config=config)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "imitation_agent.py", line 71, in on_received_get_commands
|| pwm_left, pwm_right = self.compute_action(self.config.current_image)
|| File "imitation_agent.py", line 43, in compute_action
|| graph = load_graph(frozen_model_filename)
|| File "/workspace/graph_utils.py", line 14, in load_graph
|| tf.import_graph_def(graph_def, name="prefix")
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
|| return func(*args, **kwargs)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
|| _ProcessNewOps(graph)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
|| for new_op in graph._add_new_tf_operations(compute_devices=False): # pylint: disable=protected-access
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
|| for c_op in c_api_util.new_tf_operations(self)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
|| for c_op in c_api_util.new_tf_operations(self)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
|| ret = Operation(c_op, self)
|| File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
|| self._traceback = tf_stack.extract_stack()
||
|| FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
|| [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
yield cie
File "experiment_manager.py", line 444, in <module>
wrap(cie)
File "experiment_manager.py", line 432, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 303, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24386
4193
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LF-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-10-23 20:45:53+00:00 2019-10-23 20:46:20+00:00 0:00:27 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24376
4191
Liam Paull 🇨🇦challenge-aido_LF-template-ros - Template solution using ROS aido3-LFVI-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-10-23 19:50:39+00:00 2019-10-23 20:00:16+00:00 0:09:37 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24370
4182
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido3-LFV-sim-validation
step1-simulation error no ip-172-31-35-218-10491
2019-10-23 16:54:26+00:00 2019-10-23 16:56:45+00:00 0:02:19 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24360
4175
Bhairav Mehta challenge-aido_LF-template-pytorch aido3-LFVI-sim-testing
step1-simulation failed no ip-172-31-35-218-10491
2019-10-21 23:19:25+00:00 2019-10-21 23:21:59+00:00 0:02:34 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "experiment_manager.py", line 298, in run_episode
agent.write_topic_and_expect_zero('observations', recv.data.observations)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
nickname=self.nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:
error in agent |Exception while handling a message on topic "observations".
|
|| Traceback (most recent call last):
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
|| f(**kwargs)
|| File "solution.py", line 36, in on_received_observations
|| self.current_image = self.preprocessor.preprocess(obs)
|| File "/workspace/wrappers.py", line 9, in preprocess
|| from scipy.misc import imresize
|| ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
yield cie
File "experiment_manager.py", line 444, in <module>
wrap(cie)
File "experiment_manager.py", line 432, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 303, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 24346
4167
Tanli Chou 🇹🇼challenge-aido_LF-template-random aido3-LFVI-sim-testing
step1-simulation error no ip-172-31-35-218-10491
2019-10-21 14:47:14+00:00 2019-10-21 15:00:19+00:00 0:13:05 The container "evalu [...] The container "evaluator" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible