Job ID submission user user label challenge step status up to date evaluator date started date completed duration message 18386
2605
Konstantin Chaika challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validation
step1-simulation success no uberduck2
2019-04-19 13:52:54+00:00 2019-04-19 13:56:54+00:00 0:04:00 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.04328562663151668 agent_compute-ego_mean 0.04252308378056213 agent_compute-ego_median 0.04233201006625561 agent_compute-ego_min 0.04210790192208639 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.011782122821342654, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03421379880207341, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04210790192208639, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.05152568584535181, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02319198992194199, "sim_compute_performance-ego": 0.036025875952185656, "sim_compute_robot_state-ego": 0.04084354784430527}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010361267970158504, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.03533707215235783, "in-drivable-lane": 0, "agent_compute-ego": 0.04328562663151668, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05074150745685284, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.02332912041590764, "sim_compute_performance-ego": 0.03644929482386662, "sim_compute_robot_state-ego": 0.04205798185788668}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.010584095691112762, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03463638589737263, "in-drivable-lane": 0, "agent_compute-ego": 0.04233201006625561, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.0505934421052324, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.022966780561081902, "sim_compute_performance-ego": 0.03658145032030471, "sim_compute_robot_state-ego": 0.042214028378750414}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.011685664837176982, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03436108211894612, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0427717638539744, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.050505334204369846, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02389929582784464, "sim_compute_performance-ego": 0.036742527406294266, "sim_compute_robot_state-ego": 0.041133458797748275}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.010439000631633558, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03590498472514905, "in-drivable-lane": 0, "agent_compute-ego": 0.042118116428977566, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.050348181473581416, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.023177090444062885, "sim_compute_performance-ego": 0.03562037568343313, "sim_compute_robot_state-ego": 0.04247268877531353}}set_robot_commands_max 0.05152568584535181 set_robot_commands_mean 0.050742830217077664 set_robot_commands_median 0.0505934421052324 set_robot_commands_min 0.050348181473581416 sim_compute_performance-ego_max 0.036742527406294266 sim_compute_performance-ego_mean 0.03628390483721688 sim_compute_performance-ego_median 0.03644929482386662 sim_compute_performance-ego_min 0.03562037568343313 sim_compute_robot_state-ego_max 0.04247268877531353 sim_compute_robot_state-ego_mean 0.04174434113080083 sim_compute_robot_state-ego_median 0.04205798185788668 sim_compute_robot_state-ego_min 0.04084354784430527 sim_compute_sim_state_max 0.02389929582784464 sim_compute_sim_state_mean 0.023312855434167813 sim_compute_sim_state_median 0.02319198992194199 sim_compute_sim_state_min 0.022966780561081902 sim_physics_max 0.011782122821342654 sim_physics_mean 0.010970430390284893 sim_physics_median 0.010584095691112762 sim_physics_min 0.010361267970158504 sim_render-ego_max 0.03590498472514905 sim_render-ego_mean 0.03489066473917981 sim_render-ego_median 0.03463638589737263 sim_render-ego_min 0.03421379880207341 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18381
2617
Andrea Censi 🇨🇭challenge-aido_LF-template-random aido2-LF-sim-validation
step1-simulation success no uberduck2
2019-04-19 13:48:25+00:00 2019-04-19 13:52:15+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.08647616854253805 agent_compute-ego_mean 0.08537657191224718 agent_compute-ego_median 0.08569270723006304 agent_compute-ego_min 0.08411348407918756 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010004812816403946, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03493065204260484, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08647616854253805, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05161354676732477, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.023562521304724353, "sim_compute_performance-ego": 0.036950552238608304, "sim_compute_robot_state-ego": 0.04173443902213619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009932675144889136, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03468706391074441, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08411348407918756, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.05028783191334118, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.02313707633451982, "sim_compute_performance-ego": 0.036630451679229736, "sim_compute_robot_state-ego": 0.041488587856292725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.00962143474155002, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.0347036255730523, "in-drivable-lane": 0, "agent_compute-ego": 0.08467961947123209, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.050453869501749675, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02267717785305447, "sim_compute_performance-ego": 0.03645413716634115, "sim_compute_robot_state-ego": 0.04152143266465929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.00982131560643514, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03549582759539286, "in-drivable-lane": 0, "agent_compute-ego": 0.08592088023821513, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.0508022407690684, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.023313164710998535, "sim_compute_performance-ego": 0.03646679719289144, "sim_compute_robot_state-ego": 0.04184998571872711}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.01077182503307567, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.035028843318714815, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08569270723006304, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05208446699030259, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.02342435542274924, "sim_compute_performance-ego": 0.03689518746207742, "sim_compute_robot_state-ego": 0.04164917328778435}}set_robot_commands_max 0.05208446699030259 set_robot_commands_mean 0.05104839118835732 set_robot_commands_median 0.0508022407690684 set_robot_commands_min 0.05028783191334118 sim_compute_performance-ego_max 0.036950552238608304 sim_compute_performance-ego_mean 0.03667942514782961 sim_compute_performance-ego_median 0.036630451679229736 sim_compute_performance-ego_min 0.03645413716634115 sim_compute_robot_state-ego_max 0.04184998571872711 sim_compute_robot_state-ego_mean 0.041648723709919934 sim_compute_robot_state-ego_median 0.04164917328778435 sim_compute_robot_state-ego_min 0.041488587856292725 sim_compute_sim_state_max 0.023562521304724353 sim_compute_sim_state_mean 0.02322285912520928 sim_compute_sim_state_median 0.023313164710998535 sim_compute_sim_state_min 0.02267717785305447 sim_physics_max 0.01077182503307567 sim_physics_mean 0.010030412668470785 sim_physics_median 0.009932675144889136 sim_physics_min 0.00962143474155002 sim_render-ego_max 0.03549582759539286 sim_render-ego_mean 0.03496920248810185 sim_render-ego_median 0.03493065204260484 sim_render-ego_min 0.03468706391074441 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18371
2636
Andrea Censi 🇨🇭challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no uberduck2
2019-04-19 13:40:08+00:00 2019-04-19 13:47:56+00:00 0:07:48 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.08645755904061454 agent_compute-ego_mean 0.0848698206276353 agent_compute-ego_median 0.08463226210686468 agent_compute-ego_min 0.0839183101287255 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.022019291680956645, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.034930263246808736, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08645755904061454, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.04983620416550409, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.022131280293540348, "sim_compute_performance-ego": 0.03526128284514896, "sim_compute_robot_state-ego": 0.04209756094311911, "sim_compute_robot_state-npc0": 0.0379845036400689, "sim_compute_robot_state-npc1": 0.037519125711350215, "sim_compute_robot_state-npc2": 0.03754558260478671, "sim_compute_robot_state-npc3": 0.037710886152963786}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.01938942366955327, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03520506036047842, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.0851278164807488, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05236315259746477, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021886965807746437, "sim_compute_performance-ego": 0.03563786955440745, "sim_compute_robot_state-ego": 0.04148059265286315, "sim_compute_robot_state-npc0": 0.03725282351175944, "sim_compute_robot_state-npc1": 0.03797776558819939, "sim_compute_robot_state-npc2": 0.03661170192793304, "sim_compute_robot_state-npc3": 0.03743408708011403}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.0210429314644106, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.035565630082161195, "in-drivable-lane": 0, "agent_compute-ego": 0.08463226210686468, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.050161180957671136, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.02177628778642224, "sim_compute_performance-ego": 0.03544080641961867, "sim_compute_robot_state-ego": 0.040959208242354855, "sim_compute_robot_state-npc0": 0.037050462538196195, "sim_compute_robot_state-npc1": 0.03791001535231067, "sim_compute_robot_state-npc2": 0.037424364397602695, "sim_compute_robot_state-npc3": 0.03770831707985171}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.021651970579269084, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03524621750446076, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.084213155381223, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.050090695949310954, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.02271701934489798, "sim_compute_performance-ego": 0.03510731585482334, "sim_compute_robot_state-ego": 0.04274351546104918, "sim_compute_robot_state-npc0": 0.03907214073424644, "sim_compute_robot_state-npc1": 0.03838842473131545, "sim_compute_robot_state-npc2": 0.03725247433845033, "sim_compute_robot_state-npc3": 0.039017601216093024}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.019507756600013144, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.034830180498269886, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0839183101287255, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05029548131502592, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.021680891513824463, "sim_compute_performance-ego": 0.03513526458006639, "sim_compute_robot_state-ego": 0.041339640433971696, "sim_compute_robot_state-npc0": 0.038755760743067816, "sim_compute_robot_state-npc1": 0.038079908260932334, "sim_compute_robot_state-npc2": 0.03707666121996366, "sim_compute_robot_state-npc3": 0.038316625815171465}}set_robot_commands_max 0.05236315259746477 set_robot_commands_mean 0.05054934299699537 set_robot_commands_median 0.050161180957671136 set_robot_commands_min 0.04983620416550409 sim_compute_performance-ego_max 0.03563786955440745 sim_compute_performance-ego_mean 0.03531650785081296 sim_compute_performance-ego_median 0.03526128284514896 sim_compute_performance-ego_min 0.03510731585482334 sim_compute_robot_state-ego_max 0.04274351546104918 sim_compute_robot_state-ego_mean 0.041724103546671595 sim_compute_robot_state-ego_median 0.04148059265286315 sim_compute_robot_state-ego_min 0.040959208242354855 sim_compute_robot_state-npc0_max 0.03907214073424644 sim_compute_robot_state-npc0_mean 0.03802313823346776 sim_compute_robot_state-npc0_median 0.0379845036400689 sim_compute_robot_state-npc0_min 0.037050462538196195 sim_compute_robot_state-npc1_max 0.03838842473131545 sim_compute_robot_state-npc1_mean 0.03797504792882161 sim_compute_robot_state-npc1_median 0.03797776558819939 sim_compute_robot_state-npc1_min 0.037519125711350215 sim_compute_robot_state-npc2_max 0.03754558260478671 sim_compute_robot_state-npc2_mean 0.03718215689774729 sim_compute_robot_state-npc2_median 0.03725247433845033 sim_compute_robot_state-npc2_min 0.03661170192793304 sim_compute_robot_state-npc3_max 0.039017601216093024 sim_compute_robot_state-npc3_mean 0.038037503468838794 sim_compute_robot_state-npc3_median 0.037710886152963786 sim_compute_robot_state-npc3_min 0.03743408708011403 sim_compute_sim_state_max 0.02271701934489798 sim_compute_sim_state_mean 0.02203848894928629 sim_compute_sim_state_median 0.021886965807746437 sim_compute_sim_state_min 0.021680891513824463 sim_physics_max 0.022019291680956645 sim_physics_mean 0.020722274798840545 sim_physics_median 0.0210429314644106 sim_physics_min 0.01938942366955327 sim_render-ego_max 0.035565630082161195 sim_render-ego_mean 0.0351554703384358 sim_render-ego_median 0.03520506036047842 sim_render-ego_min 0.034830180498269886 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18367
2644
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation success no uberduck2
2019-04-19 13:33:12+00:00 2019-04-19 13:39:46+00:00 0:06:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487132829419987 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041400208354252 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.04328705909404349 agent_compute-ego_mean 0.04210509277254528 agent_compute-ego_median 0.04231869257413424 agent_compute-ego_min 0.04035933424786824 deviation-center-line_max 0.1279102488429998 deviation-center-line_mean 0.10518151035257096 deviation-center-line_min 0.06917270915638028 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550057 deviation-heading_median 0.36368201628851926 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903464 driven_any_median 0.6642785413159032 driven_any_min 0.3059207793076613 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.588039443394122 driven_lanedir_consec_min 0.28022225990343186 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.588039443394122 driven_lanedir_median 0.5487132829419987 driven_lanedir_min 0.28022225990343186 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.018008336788270532, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.03512828815274122, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04035933424786824, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.050494130064801475, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02193595141899295, "sim_compute_performance-ego": 0.03478572136018335, "sim_compute_robot_state-ego": 0.04230305334416831, "sim_compute_robot_state-npc0": 0.03797119710503555, "sim_compute_robot_state-npc1": 0.03893822867695878, "sim_compute_robot_state-npc2": 0.037195071941468774, "sim_compute_robot_state-npc3": 0.03792484213666218}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076613, "sim_physics": 0.018127991602971003, "survival_time": 1.3000000000000005, "driven_lanedir": 0.28022225990343186, "sim_render-ego": 0.03570154080024132, "in-drivable-lane": 0, "agent_compute-ego": 0.04231869257413424, "deviation-heading": 0.36368201628851926, "set_robot_commands": 0.05054791157062237, "deviation-center-line": 0.06917270915638028, "driven_lanedir_consec": 0.28022225990343186, "sim_compute_sim_state": 0.022101310583261344, "sim_compute_performance-ego": 0.03549732611729549, "sim_compute_robot_state-ego": 0.04245339907132662, "sim_compute_robot_state-npc0": 0.03793937426346999, "sim_compute_robot_state-npc1": 0.03874536661001352, "sim_compute_robot_state-npc2": 0.03699155037219708, "sim_compute_robot_state-npc3": 0.0380549064049354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413159032, "sim_physics": 0.017538648970583652, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504171082047745, "sim_render-ego": 0.033964263631942423, "in-drivable-lane": 0, "agent_compute-ego": 0.04328705909404349, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.050355104689902445, "deviation-center-line": 0.1279102488429998, "driven_lanedir_consec": 0.6504171082047745, "sim_compute_sim_state": 0.021167638454031436, "sim_compute_performance-ego": 0.03480527248788387, "sim_compute_robot_state-ego": 0.040614944823244785, "sim_compute_robot_state-npc0": 0.03628718092086467, "sim_compute_robot_state-npc1": 0.03779100864491564, "sim_compute_robot_state-npc2": 0.03644883886296699, "sim_compute_robot_state-npc3": 0.03759819903272264}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.017690807908445925, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.034599398518656635, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04176968270605737, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.050575623145470254, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.021674418187403417, "sim_compute_performance-ego": 0.03571067537580218, "sim_compute_robot_state-ego": 0.04110039983476911, "sim_compute_robot_state-npc0": 0.037828880351978345, "sim_compute_robot_state-npc1": 0.03779295250609681, "sim_compute_robot_state-npc2": 0.036783616621415695, "sim_compute_robot_state-npc3": 0.037860477363670264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355635, "sim_physics": 0.016726638141431306, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487132829419987, "sim_render-ego": 0.03442200234061793, "in-drivable-lane": 0, "agent_compute-ego": 0.042790695240623074, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.05047589854190224, "deviation-center-line": 0.11041400208354252, "driven_lanedir_consec": 0.5487132829419987, "sim_compute_sim_state": 0.02240139559695595, "sim_compute_performance-ego": 0.03563811277088366, "sim_compute_robot_state-ego": 0.04235142783114785, "sim_compute_robot_state-npc0": 0.03783840254733437, "sim_compute_robot_state-npc1": 0.03871770908958033, "sim_compute_robot_state-npc2": 0.03715663207204718, "sim_compute_robot_state-npc3": 0.03879493788668984}}set_robot_commands_max 0.050575623145470254 set_robot_commands_mean 0.05048973360253976 set_robot_commands_median 0.050494130064801475 set_robot_commands_min 0.050355104689902445 sim_compute_performance-ego_max 0.03571067537580218 sim_compute_performance-ego_mean 0.035287421622409706 sim_compute_performance-ego_median 0.03549732611729549 sim_compute_performance-ego_min 0.03478572136018335 sim_compute_robot_state-ego_max 0.04245339907132662 sim_compute_robot_state-ego_mean 0.04176464498093134 sim_compute_robot_state-ego_median 0.04230305334416831 sim_compute_robot_state-ego_min 0.040614944823244785 sim_compute_robot_state-npc0_max 0.03797119710503555 sim_compute_robot_state-npc0_mean 0.03757300703773658 sim_compute_robot_state-npc0_median 0.03783840254733437 sim_compute_robot_state-npc0_min 0.03628718092086467 sim_compute_robot_state-npc1_max 0.03893822867695878 sim_compute_robot_state-npc1_mean 0.038397053105513015 sim_compute_robot_state-npc1_median 0.03871770908958033 sim_compute_robot_state-npc1_min 0.03779100864491564 sim_compute_robot_state-npc2_max 0.037195071941468774 sim_compute_robot_state-npc2_mean 0.03691514197401914 sim_compute_robot_state-npc2_median 0.03699155037219708 sim_compute_robot_state-npc2_min 0.03644883886296699 sim_compute_robot_state-npc3_max 0.03879493788668984 sim_compute_robot_state-npc3_mean 0.03804667256493606 sim_compute_robot_state-npc3_median 0.03792484213666218 sim_compute_robot_state-npc3_min 0.03759819903272264 sim_compute_sim_state_max 0.02240139559695595 sim_compute_sim_state_mean 0.021856142848129017 sim_compute_sim_state_median 0.02193595141899295 sim_compute_sim_state_min 0.021167638454031436 sim_physics_max 0.018127991602971003 sim_physics_mean 0.017618484682340486 sim_physics_median 0.017690807908445925 sim_physics_min 0.016726638141431306 sim_render-ego_max 0.03570154080024132 sim_render-ego_mean 0.03476309868883991 sim_render-ego_median 0.034599398518656635 sim_render-ego_min 0.033964263631942423 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18364
2649
Egor Zamotaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-validation
step1-simulation success no uberduck2
2019-04-19 13:25:28+00:00 2019-04-19 13:32:27+00:00 0:06:59 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6013276121655571 survival_time_median 2.2 deviation-center-line_median 0.11994879786730762 in-drivable-lane_median 0.09999999999999964
other stats agent_compute-ego_max 0.04439541415164345 agent_compute-ego_mean 0.04362818506042375 agent_compute-ego_median 0.04393953398654336 agent_compute-ego_min 0.04254768111489036 deviation-center-line_max 0.31602167939174997 deviation-center-line_mean 0.15029477661273552 deviation-center-line_min 0.08465176242372947 deviation-heading_max 1.298091820230251 deviation-heading_mean 0.5590872679348118 deviation-heading_median 0.39186075366845463 deviation-heading_min 0.29133071980288444 driven_any_max 1.2345099137442228 driven_any_mean 0.7773148514182241 driven_any_median 0.6489566174251553 driven_any_min 0.47625793140583145 driven_lanedir_consec_max 0.923268763707114 driven_lanedir_consec_mean 0.634114415404596 driven_lanedir_consec_min 0.4596280139000144 driven_lanedir_max 0.923268763707114 driven_lanedir_mean 0.6342515685671332 driven_lanedir_median 0.6013276121655571 driven_lanedir_min 0.4596280139000144 in-drivable-lane_max 0.9499999999999966 in-drivable-lane_mean 0.3599999999999987 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2345099137442228, "sim_physics": 0.021712875366210936, "survival_time": 4.749999999999991, "driven_lanedir": 0.923268763707114, "sim_render-ego": 0.03580837500722785, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.04439541415164345, "deviation-heading": 1.298091820230251, "set_robot_commands": 0.051538053311799704, "deviation-center-line": 0.31602167939174997, "driven_lanedir_consec": 0.923268763707114, "sim_compute_sim_state": 0.022357074837935597, "sim_compute_performance-ego": 0.03660252721686112, "sim_compute_robot_state-ego": 0.04249859860068873, "sim_compute_robot_state-npc0": 0.03860466354771664, "sim_compute_robot_state-npc1": 0.038578811444734275, "sim_compute_robot_state-npc2": 0.03791550084164269, "sim_compute_robot_state-npc3": 0.03816884191412675}, "udem1-1-0": {"driven_any": 0.5114621661231735, "sim_physics": 0.018979078844973917, "survival_time": 1.900000000000001, "driven_lanedir": 0.49928522044265344, "sim_render-ego": 0.03577120680558054, "in-drivable-lane": 0, "agent_compute-ego": 0.04393953398654336, "deviation-heading": 0.29133071980288444, "set_robot_commands": 0.05121554199017977, "deviation-center-line": 0.08465176242372947, "driven_lanedir_consec": 0.49928522044265344, "sim_compute_sim_state": 0.022264894686247177, "sim_compute_performance-ego": 0.03671457265552722, "sim_compute_robot_state-ego": 0.04278282742751272, "sim_compute_robot_state-npc0": 0.03844267443606728, "sim_compute_robot_state-npc1": 0.03719038712350946, "sim_compute_robot_state-npc2": 0.03851007160387541, "sim_compute_robot_state-npc3": 0.03806439198945698}, "udem1-2-0": {"driven_any": 0.47625793140583145, "sim_physics": 0.019361495971679688, "survival_time": 1.950000000000001, "driven_lanedir": 0.4596280139000144, "sim_render-ego": 0.0358580503708277, "in-drivable-lane": 0, "agent_compute-ego": 0.04398930989778959, "deviation-heading": 0.39186075366845463, "set_robot_commands": 0.05130154658586551, "deviation-center-line": 0.10378004828632456, "driven_lanedir_consec": 0.4596280139000144, "sim_compute_sim_state": 0.021969379522861578, "sim_compute_performance-ego": 0.036492182658268854, "sim_compute_robot_state-ego": 0.04189567076854217, "sim_compute_robot_state-npc0": 0.03846301787938827, "sim_compute_robot_state-npc1": 0.03851117843236679, "sim_compute_robot_state-npc2": 0.03722127889975523, "sim_compute_robot_state-npc3": 0.0381927245702499}, "udem1-3-0": {"driven_any": 1.0153876283927372, "sim_physics": 0.021705744971691723, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6877482326203274, "sim_render-ego": 0.03569095571276168, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04326898615125199, "deviation-heading": 0.47721720082170194, "set_robot_commands": 0.051285797441509406, "deviation-center-line": 0.11994879786730762, "driven_lanedir_consec": 0.6870624668076413, "sim_compute_sim_state": 0.02270185779517805, "sim_compute_performance-ego": 0.035981906971461336, "sim_compute_robot_state-ego": 0.04264806022106762, "sim_compute_robot_state-npc0": 0.03922974559622751, "sim_compute_robot_state-npc1": 0.038811381434051086, "sim_compute_robot_state-npc2": 0.03867073797843826, "sim_compute_robot_state-npc3": 0.038533056286019336}, "udem1-4-0": {"driven_any": 0.6489566174251553, "sim_physics": 0.018262987787073307, "survival_time": 2.2, "driven_lanedir": 0.6013276121655571, "sim_render-ego": 0.03536064516414295, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.04254768111489036, "deviation-heading": 0.3369358451507671, "set_robot_commands": 0.051319328221407806, "deviation-center-line": 0.12707159509456606, "driven_lanedir_consec": 0.6013276121655571, "sim_compute_sim_state": 0.022219917990944603, "sim_compute_performance-ego": 0.03588924624703147, "sim_compute_robot_state-ego": 0.04244269024242054, "sim_compute_robot_state-npc0": 0.038507131013003265, "sim_compute_robot_state-npc1": 0.039201622659509834, "sim_compute_robot_state-npc2": 0.03727634386582808, "sim_compute_robot_state-npc3": 0.03887590495022861}}set_robot_commands_max 0.051538053311799704 set_robot_commands_mean 0.05133205351015245 set_robot_commands_median 0.05130154658586551 set_robot_commands_min 0.05121554199017977 sim_compute_performance-ego_max 0.03671457265552722 sim_compute_performance-ego_mean 0.03633608714983 sim_compute_performance-ego_median 0.036492182658268854 sim_compute_performance-ego_min 0.03588924624703147 sim_compute_robot_state-ego_max 0.04278282742751272 sim_compute_robot_state-ego_mean 0.042453569452046355 sim_compute_robot_state-ego_median 0.04249859860068873 sim_compute_robot_state-ego_min 0.04189567076854217 sim_compute_robot_state-npc0_max 0.03922974559622751 sim_compute_robot_state-npc0_mean 0.03864944649448059 sim_compute_robot_state-npc0_median 0.038507131013003265 sim_compute_robot_state-npc0_min 0.03844267443606728 sim_compute_robot_state-npc1_max 0.039201622659509834 sim_compute_robot_state-npc1_mean 0.03845867621883429 sim_compute_robot_state-npc1_median 0.038578811444734275 sim_compute_robot_state-npc1_min 0.03719038712350946 sim_compute_robot_state-npc2_max 0.03867073797843826 sim_compute_robot_state-npc2_mean 0.03791878663790793 sim_compute_robot_state-npc2_median 0.03791550084164269 sim_compute_robot_state-npc2_min 0.03722127889975523 sim_compute_robot_state-npc3_max 0.03887590495022861 sim_compute_robot_state-npc3_mean 0.03836698394201631 sim_compute_robot_state-npc3_median 0.0381927245702499 sim_compute_robot_state-npc3_min 0.03806439198945698 sim_compute_sim_state_max 0.02270185779517805 sim_compute_sim_state_mean 0.0223026249666334 sim_compute_sim_state_median 0.022264894686247177 sim_compute_sim_state_min 0.021969379522861578 sim_physics_max 0.021712875366210936 sim_physics_mean 0.020004436588325913 sim_physics_median 0.019361495971679688 sim_physics_min 0.018262987787073307 sim_render-ego_max 0.0358580503708277 sim_render-ego_mean 0.03569784661210814 sim_render-ego_median 0.03577120680558054 sim_render-ego_min 0.03536064516414295 simulation-passed 1 survival_time_max 4.749999999999991 survival_time_mean 2.8699999999999983 survival_time_min 1.900000000000001
No reset possible 18346
2681
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation success no uberduck2
2019-04-19 13:05:57+00:00 2019-04-19 13:24:52+00:00 0:18:55 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1099178216504757 survival_time_median 9.4 deviation-center-line_median 0.6891850501480127 in-drivable-lane_median 0.34999999999999876
other stats agent_compute-ego_max 0.04579476912816365 agent_compute-ego_mean 0.045258548409244766 agent_compute-ego_median 0.04534661374385888 agent_compute-ego_min 0.04450549826716745 deviation-center-line_max 1.094628842665842 deviation-center-line_mean 0.6545654322508427 deviation-center-line_min 0.2569150387489945 deviation-heading_max 4.721511817928979 deviation-heading_mean 2.706393786088841 deviation-heading_median 2.1806889868169073 deviation-heading_min 1.4022927119026225 driven_any_max 2.3555294183517015 driven_any_mean 1.469508400409695 driven_any_median 1.4636647597625811 driven_any_min 0.713613268734168 driven_lanedir_consec_max 1.8340473946900513 driven_lanedir_consec_mean 1.2122662729683198 driven_lanedir_consec_min 0.6599278909573126 driven_lanedir_max 1.8340473946900513 driven_lanedir_mean 1.2574605952788829 driven_lanedir_median 1.3358894332032905 driven_lanedir_min 0.6599278909573126 in-drivable-lane_max 1.6500000000000234 in-drivable-lane_mean 0.5600000000000052 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.713613268734168, "sim_physics": 0.01851624498764674, "survival_time": 4.799999999999991, "driven_lanedir": 0.6599278909573126, "sim_render-ego": 0.0360946257909139, "in-drivable-lane": 0, "agent_compute-ego": 0.04561645785967509, "deviation-heading": 1.4022927119026225, "set_robot_commands": 0.05256840089956919, "deviation-center-line": 0.2569150387489945, "driven_lanedir_consec": 0.6599278909573126, "sim_compute_sim_state": 0.022585158546765644, "sim_compute_performance-ego": 0.03729526946942011, "sim_compute_robot_state-ego": 0.04336390147606531, "sim_compute_robot_state-npc0": 0.04030268142620722, "sim_compute_robot_state-npc1": 0.03920900324980418, "sim_compute_robot_state-npc2": 0.03852697958548864, "sim_compute_robot_state-npc3": 0.039198197424411774}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6483609851898042, "sim_physics": 0.01765415114814071, "survival_time": 10.550000000000017, "driven_lanedir": 1.3358894332032905, "sim_render-ego": 0.0365279127636227, "in-drivable-lane": 0.8000000000000034, "agent_compute-ego": 0.04534661374385888, "deviation-heading": 3.5101866226493437, "set_robot_commands": 0.052120989532832285, "deviation-center-line": 0.6891850501480127, "driven_lanedir_consec": 1.1099178216504757, "sim_compute_sim_state": 0.022813438804228724, "sim_compute_performance-ego": 0.0373716569059833, "sim_compute_robot_state-ego": 0.04393601530536091, "sim_compute_robot_state-npc0": 0.040678261580625416, "sim_compute_robot_state-npc1": 0.03936681363254927, "sim_compute_robot_state-npc2": 0.039079926025245994, "sim_compute_robot_state-npc3": 0.03953034504894962}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555294183517015, "sim_physics": 0.016871001720428467, "survival_time": 14.950000000000076, "driven_lanedir": 1.8340473946900513, "sim_render-ego": 0.035764563083648684, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.04579476912816365, "deviation-heading": 4.721511817928979, "set_robot_commands": 0.05217934449513753, "deviation-center-line": 1.094628842665842, "driven_lanedir_consec": 1.8340473946900513, "sim_compute_sim_state": 0.02270143429438273, "sim_compute_performance-ego": 0.0372372031211853, "sim_compute_robot_state-ego": 0.04262589454650879, "sim_compute_robot_state-npc0": 0.04053692976633707, "sim_compute_robot_state-npc1": 0.03920315345128377, "sim_compute_robot_state-npc2": 0.03860588709513346, "sim_compute_robot_state-npc3": 0.03903048515319824}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.4636647597625811, "sim_physics": 0.017992143935345588, "survival_time": 9.4, "driven_lanedir": 1.3992453660332962, "sim_render-ego": 0.03614132581873143, "in-drivable-lane": 0, "agent_compute-ego": 0.04502940304735874, "deviation-heading": 2.1806889868169073, "set_robot_commands": 0.051850984705255385, "deviation-center-line": 0.7914825498926447, "driven_lanedir_consec": 1.3992453660332962, "sim_compute_sim_state": 0.0227378378523157, "sim_compute_performance-ego": 0.0373641366654254, "sim_compute_robot_state-ego": 0.04299791569405414, "sim_compute_robot_state-npc0": 0.04101489579423945, "sim_compute_robot_state-npc1": 0.03911208725990133, "sim_compute_robot_state-npc2": 0.0390538344991968, "sim_compute_robot_state-npc3": 0.03945530348635735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1663735700102198, "sim_physics": 0.017463286191422418, "survival_time": 7.549999999999981, "driven_lanedir": 1.058192891510463, "sim_render-ego": 0.03657416476319168, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.04450549826716745, "deviation-heading": 1.7172887911463517, "set_robot_commands": 0.051746930507634646, "deviation-center-line": 0.44061567979872, "driven_lanedir_consec": 1.058192891510463, "sim_compute_sim_state": 0.02284563929829377, "sim_compute_performance-ego": 0.03776296085079774, "sim_compute_robot_state-ego": 0.04293792610926344, "sim_compute_robot_state-npc0": 0.04048167001332669, "sim_compute_robot_state-npc1": 0.039403024888196525, "sim_compute_robot_state-npc2": 0.03896521574614064, "sim_compute_robot_state-npc3": 0.039079884030171576}}set_robot_commands_max 0.05256840089956919 set_robot_commands_mean 0.052093330028085805 set_robot_commands_median 0.052120989532832285 set_robot_commands_min 0.051746930507634646 sim_compute_performance-ego_max 0.03776296085079774 sim_compute_performance-ego_mean 0.03740624540256237 sim_compute_performance-ego_median 0.0373641366654254 sim_compute_performance-ego_min 0.0372372031211853 sim_compute_robot_state-ego_max 0.04393601530536091 sim_compute_robot_state-ego_mean 0.04317233062625052 sim_compute_robot_state-ego_median 0.04299791569405414 sim_compute_robot_state-ego_min 0.04262589454650879 sim_compute_robot_state-npc0_max 0.04101489579423945 sim_compute_robot_state-npc0_mean 0.040602887716147174 sim_compute_robot_state-npc0_median 0.04053692976633707 sim_compute_robot_state-npc0_min 0.04030268142620722 sim_compute_robot_state-npc1_max 0.039403024888196525 sim_compute_robot_state-npc1_mean 0.039258816496347014 sim_compute_robot_state-npc1_median 0.03920900324980418 sim_compute_robot_state-npc1_min 0.03911208725990133 sim_compute_robot_state-npc2_max 0.039079926025245994 sim_compute_robot_state-npc2_mean 0.03884636859024111 sim_compute_robot_state-npc2_median 0.03896521574614064 sim_compute_robot_state-npc2_min 0.03852697958548864 sim_compute_robot_state-npc3_max 0.03953034504894962 sim_compute_robot_state-npc3_mean 0.03925884302861771 sim_compute_robot_state-npc3_median 0.039198197424411774 sim_compute_robot_state-npc3_min 0.03903048515319824 sim_compute_sim_state_max 0.02284563929829377 sim_compute_sim_state_mean 0.02273670175919731 sim_compute_sim_state_median 0.0227378378523157 sim_compute_sim_state_min 0.022585158546765644 sim_physics_max 0.01851624498764674 sim_physics_mean 0.017699365596596787 sim_physics_median 0.01765415114814071 sim_physics_min 0.016871001720428467 sim_render-ego_max 0.03657416476319168 sim_render-ego_mean 0.036220518444021674 sim_render-ego_median 0.03614132581873143 sim_render-ego_min 0.035764563083648684 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.450000000000014 survival_time_min 4.799999999999991
No reset possible 18336
2707
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation success no uberduck2
2019-04-19 12:46:41+00:00 2019-04-19 13:05:42+00:00 0:19:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.7913973283713115 survival_time_median 8.14999999999998 deviation-center-line_median 0.4771767758800493 in-drivable-lane_median 0.4500000000000002
other stats agent_compute-ego_max 0.046005647961455995 agent_compute-ego_mean 0.04542925644710137 agent_compute-ego_median 0.045531790680680535 agent_compute-ego_min 0.044881705726896017 deviation-center-line_max 0.8605097120228962 deviation-center-line_mean 0.5507122852935121 deviation-center-line_min 0.34581067631051454 deviation-heading_max 6.110307944646417 deviation-heading_mean 2.888495431126587 deviation-heading_median 2.481128690063512 deviation-heading_min 0.7934900967294212 driven_any_max 2.3552529581289097 driven_any_mean 1.4855455318820605 driven_any_median 1.2627878576133904 driven_any_min 0.7645941809436542 driven_lanedir_consec_max 1.088809422668986 driven_lanedir_consec_mean 0.8851793863797706 driven_lanedir_consec_min 0.7493107776620294 driven_lanedir_max 1.3515777317207136 driven_lanedir_mean 1.0470658995077096 driven_lanedir_median 1.088809422668986 driven_lanedir_min 0.7493107776620294 in-drivable-lane_max 4.80000000000003 in-drivable-lane_mean 1.8400000000000076 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8421811223254343, "sim_physics": 0.018480935267039707, "survival_time": 5.599999999999988, "driven_lanedir": 0.7913973283713115, "sim_render-ego": 0.03566482237407139, "in-drivable-lane": 0, "agent_compute-ego": 0.045756908399718146, "deviation-heading": 1.492252001456641, "set_robot_commands": 0.05257931777409145, "deviation-center-line": 0.34581067631051454, "driven_lanedir_consec": 0.7913973283713115, "sim_compute_sim_state": 0.02255328212465559, "sim_compute_performance-ego": 0.037081064922469, "sim_compute_robot_state-ego": 0.04315558075904846, "sim_compute_robot_state-npc0": 0.04069348105362484, "sim_compute_robot_state-npc1": 0.039814140115465434, "sim_compute_robot_state-npc2": 0.038925230503082275, "sim_compute_robot_state-npc3": 0.03966248674052102}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.202911540398914, "sim_physics": 0.017596278871808733, "survival_time": 14.000000000000064, "driven_lanedir": 1.2542342371155075, "sim_render-ego": 0.03639324392591204, "in-drivable-lane": 4.80000000000003, "agent_compute-ego": 0.044881705726896017, "deviation-heading": 3.5652984227369453, "set_robot_commands": 0.05318761723382132, "deviation-center-line": 0.6425309060853074, "driven_lanedir_consec": 1.0102067008408224, "sim_compute_sim_state": 0.023000939403261457, "sim_compute_performance-ego": 0.037400591373443606, "sim_compute_robot_state-ego": 0.04324178695678711, "sim_compute_robot_state-npc0": 0.04114596503121512, "sim_compute_robot_state-npc1": 0.03980989371027265, "sim_compute_robot_state-npc2": 0.03924528700964791, "sim_compute_robot_state-npc3": 0.039641943999699183}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.2627878576133904, "sim_physics": 0.0177597326735046, "survival_time": 8.14999999999998, "driven_lanedir": 1.088809422668986, "sim_render-ego": 0.03596691119890272, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.045531790680680535, "deviation-heading": 2.481128690063512, "set_robot_commands": 0.05288857185036127, "deviation-center-line": 0.4771767758800493, "driven_lanedir_consec": 1.088809422668986, "sim_compute_sim_state": 0.02274052350798999, "sim_compute_performance-ego": 0.037485881817121446, "sim_compute_robot_state-ego": 0.04326398972353321, "sim_compute_robot_state-npc0": 0.04106782111653521, "sim_compute_robot_state-npc1": 0.03947863842080707, "sim_compute_robot_state-npc2": 0.03881926478052432, "sim_compute_robot_state-npc3": 0.03972684386317715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3552529581289097, "sim_physics": 0.017274043560028075, "survival_time": 14.950000000000076, "driven_lanedir": 1.3515777317207136, "sim_render-ego": 0.03613660494486491, "in-drivable-lane": 3.950000000000008, "agent_compute-ego": 0.04497022946675618, "deviation-heading": 6.110307944646417, "set_robot_commands": 0.05244232257207235, "deviation-center-line": 0.8605097120228962, "driven_lanedir_consec": 0.7861727023557044, "sim_compute_sim_state": 0.022957525253295898, "sim_compute_performance-ego": 0.03802459398905436, "sim_compute_robot_state-ego": 0.04338470300038656, "sim_compute_robot_state-npc0": 0.04133031368255615, "sim_compute_robot_state-npc1": 0.03998137553532918, "sim_compute_robot_state-npc2": 0.03900428533554077, "sim_compute_robot_state-npc3": 0.03948255062103272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.7645941809436542, "sim_physics": 0.018279111031258465, "survival_time": 5.04999999999999, "driven_lanedir": 0.7493107776620294, "sim_render-ego": 0.03654914091129114, "in-drivable-lane": 0, "agent_compute-ego": 0.046005647961455995, "deviation-heading": 0.7934900967294212, "set_robot_commands": 0.05441086363084245, "deviation-center-line": 0.42753335616879307, "driven_lanedir_consec": 0.7493107776620294, "sim_compute_sim_state": 0.02276564116525178, "sim_compute_performance-ego": 0.03732231583925757, "sim_compute_robot_state-ego": 0.04274892807006836, "sim_compute_robot_state-npc0": 0.040144474199502775, "sim_compute_robot_state-npc1": 0.039136990462199296, "sim_compute_robot_state-npc2": 0.03889859076773766, "sim_compute_robot_state-npc3": 0.039352147886068514}}set_robot_commands_max 0.05441086363084245 set_robot_commands_mean 0.05310173861223777 set_robot_commands_median 0.05288857185036127 set_robot_commands_min 0.05244232257207235 sim_compute_performance-ego_max 0.03802459398905436 sim_compute_performance-ego_mean 0.0374628895882692 sim_compute_performance-ego_median 0.037400591373443606 sim_compute_performance-ego_min 0.037081064922469 sim_compute_robot_state-ego_max 0.04338470300038656 sim_compute_robot_state-ego_mean 0.04315899770196474 sim_compute_robot_state-ego_median 0.04324178695678711 sim_compute_robot_state-ego_min 0.04274892807006836 sim_compute_robot_state-npc0_max 0.04133031368255615 sim_compute_robot_state-npc0_mean 0.04087641101668682 sim_compute_robot_state-npc0_median 0.04106782111653521 sim_compute_robot_state-npc0_min 0.040144474199502775 sim_compute_robot_state-npc1_max 0.03998137553532918 sim_compute_robot_state-npc1_mean 0.039644207648814725 sim_compute_robot_state-npc1_median 0.03980989371027265 sim_compute_robot_state-npc1_min 0.039136990462199296 sim_compute_robot_state-npc2_max 0.03924528700964791 sim_compute_robot_state-npc2_mean 0.03897853167930659 sim_compute_robot_state-npc2_median 0.038925230503082275 sim_compute_robot_state-npc2_min 0.03881926478052432 sim_compute_robot_state-npc3_max 0.03972684386317715 sim_compute_robot_state-npc3_mean 0.03957319462209972 sim_compute_robot_state-npc3_median 0.039641943999699183 sim_compute_robot_state-npc3_min 0.039352147886068514 sim_compute_sim_state_max 0.023000939403261457 sim_compute_sim_state_mean 0.022803582290890943 sim_compute_sim_state_median 0.02276564116525178 sim_compute_sim_state_min 0.02255328212465559 sim_physics_max 0.018480935267039707 sim_physics_mean 0.017878020280727915 sim_physics_median 0.0177597326735046 sim_physics_min 0.017274043560028075 sim_render-ego_max 0.03654914091129114 sim_render-ego_mean 0.03614214467100844 sim_render-ego_median 0.03613660494486491 sim_render-ego_min 0.03566482237407139 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 9.55000000000002 survival_time_min 5.04999999999999
No reset possible 18303
2775
Bhairav Mehta challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation success no uberduck2
2019-04-19 12:26:23+00:00 2019-04-19 12:46:26+00:00 0:20:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6604108528489878 survival_time_median 11.200000000000024 deviation-center-line_median 0.6739622424307645 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.07598353201343168 agent_compute-ego_mean 0.0682665103795547 agent_compute-ego_median 0.06611142258195511 agent_compute-ego_min 0.06535031965800694 deviation-center-line_max 1.405974511761293 deviation-center-line_mean 0.7177307940958095 deviation-center-line_min 0.06551451591721544 deviation-heading_max 3.1827494263780953 deviation-heading_mean 1.9757818155087044 deviation-heading_median 2.0949369990768756 deviation-heading_min 0.6994114023305026 driven_any_max 2.259303753407064 driven_any_mean 1.4873005389106688 driven_any_median 1.752860665244429 driven_any_min 0.2020509243848191 driven_lanedir_consec_max 2.140610694414847 driven_lanedir_consec_mean 0.9366228526335492 driven_lanedir_consec_min 0.15653224658354836 driven_lanedir_max 2.140610694414847 driven_lanedir_mean 1.211174049413283 driven_lanedir_median 1.253159178194606 driven_lanedir_min 0.15653224658354836 in-drivable-lane_max 5.000000000000059 in-drivable-lane_mean 1.2200000000000109 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.0194181996643454, "sim_physics": 0.020415931716001125, "survival_time": 6.649999999999984, "driven_lanedir": 1.0054134435525848, "sim_render-ego": 0.03581620876054119, "in-drivable-lane": 0, "agent_compute-ego": 0.06559966919117403, "deviation-heading": 0.8218782718860602, "set_robot_commands": 0.051791248464942874, "deviation-center-line": 0.6190581832395162, "driven_lanedir_consec": 0.6604108528489878, "sim_compute_sim_state": 0.022297434340742297, "sim_compute_performance-ego": 0.03686062554667767, "sim_compute_robot_state-ego": 0.042311356479960274, "sim_compute_robot_state-npc0": 0.04055178792853104, "sim_compute_robot_state-npc1": 0.03934192836732793, "sim_compute_robot_state-npc2": 0.038669430223622715, "sim_compute_robot_state-npc3": 0.0383886018193754}, "udem1-1-0": {"driven_any": 2.202869151852686, "sim_physics": 0.019610758338655745, "survival_time": 14.000000000000064, "driven_lanedir": 1.253159178194606, "sim_render-ego": 0.035959333181381226, "in-drivable-lane": 5.000000000000059, "agent_compute-ego": 0.06828760845320565, "deviation-heading": 3.079932977871989, "set_robot_commands": 0.05259883659226554, "deviation-center-line": 0.6739622424307645, "driven_lanedir_consec": 0.6599449088013329, "sim_compute_sim_state": 0.022635066509246828, "sim_compute_performance-ego": 0.03717899577958243, "sim_compute_robot_state-ego": 0.04283248782157898, "sim_compute_robot_state-npc0": 0.04046733123915536, "sim_compute_robot_state-npc1": 0.03940165979521615, "sim_compute_robot_state-npc2": 0.039110379559653144, "sim_compute_robot_state-npc3": 0.03928235258374895}, "udem1-2-0": {"driven_any": 1.752860665244429, "sim_physics": 0.0206162514431136, "survival_time": 11.200000000000024, "driven_lanedir": 1.5001546843208289, "sim_render-ego": 0.03622591921261379, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.06535031965800694, "deviation-heading": 3.1827494263780953, "set_robot_commands": 0.05205531631197248, "deviation-center-line": 0.8241445171302585, "driven_lanedir_consec": 1.0656155605190296, "sim_compute_sim_state": 0.02256034846816744, "sim_compute_performance-ego": 0.03715144736426217, "sim_compute_robot_state-ego": 0.04285562889916556, "sim_compute_robot_state-npc0": 0.040264156247888296, "sim_compute_robot_state-npc1": 0.03895432608468192, "sim_compute_robot_state-npc2": 0.038767955132893155, "sim_compute_robot_state-npc3": 0.03928567681993757}, "udem1-3-0": {"driven_any": 0.2020509243848191, "sim_physics": 0.020212542626165578, "survival_time": 1.5500000000000007, "driven_lanedir": 0.15653224658354836, "sim_render-ego": 0.03697659892420615, "in-drivable-lane": 0, "agent_compute-ego": 0.07598353201343168, "deviation-heading": 0.6994114023305026, "set_robot_commands": 0.05193623419730894, "deviation-center-line": 0.06551451591721544, "driven_lanedir_consec": 0.15653224658354836, "sim_compute_sim_state": 0.02335036954572124, "sim_compute_performance-ego": 0.036673984219951015, "sim_compute_robot_state-ego": 0.04333363809893208, "sim_compute_robot_state-npc0": 0.04074116676084457, "sim_compute_robot_state-npc1": 0.03918926177486297, "sim_compute_robot_state-npc2": 0.03944785364212528, "sim_compute_robot_state-npc3": 0.04028854062480311}, "udem1-4-0": {"driven_any": 2.259303753407064, "sim_physics": 0.019073021951868142, "survival_time": 14.350000000000067, "driven_lanedir": 2.140610694414847, "sim_render-ego": 0.035947263863859276, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.06611142258195511, "deviation-heading": 2.0949369990768756, "set_robot_commands": 0.0521064145224435, "deviation-center-line": 1.405974511761293, "driven_lanedir_consec": 2.140610694414847, "sim_compute_sim_state": 0.02267458879158472, "sim_compute_performance-ego": 0.03718241249642721, "sim_compute_robot_state-ego": 0.04278894251647311, "sim_compute_robot_state-npc0": 0.040873761791800786, "sim_compute_robot_state-npc1": 0.03973966525406788, "sim_compute_robot_state-npc2": 0.03987726434182622, "sim_compute_robot_state-npc3": 0.03942183999649739}}set_robot_commands_max 0.05259883659226554 set_robot_commands_mean 0.052097610017786664 set_robot_commands_median 0.05205531631197248 set_robot_commands_min 0.051791248464942874 sim_compute_performance-ego_max 0.03718241249642721 sim_compute_performance-ego_mean 0.0370094930813801 sim_compute_performance-ego_median 0.03715144736426217 sim_compute_performance-ego_min 0.036673984219951015 sim_compute_robot_state-ego_max 0.04333363809893208 sim_compute_robot_state-ego_mean 0.04282441076322201 sim_compute_robot_state-ego_median 0.04283248782157898 sim_compute_robot_state-ego_min 0.042311356479960274 sim_compute_robot_state-npc0_max 0.040873761791800786 sim_compute_robot_state-npc0_mean 0.04057964079364401 sim_compute_robot_state-npc0_median 0.04055178792853104 sim_compute_robot_state-npc0_min 0.040264156247888296 sim_compute_robot_state-npc1_max 0.03973966525406788 sim_compute_robot_state-npc1_mean 0.03932536825523137 sim_compute_robot_state-npc1_median 0.03934192836732793 sim_compute_robot_state-npc1_min 0.03895432608468192 sim_compute_robot_state-npc2_max 0.03987726434182622 sim_compute_robot_state-npc2_mean 0.03917457658002411 sim_compute_robot_state-npc2_median 0.039110379559653144 sim_compute_robot_state-npc2_min 0.038669430223622715 sim_compute_robot_state-npc3_max 0.04028854062480311 sim_compute_robot_state-npc3_mean 0.039333402368872485 sim_compute_robot_state-npc3_median 0.03928567681993757 sim_compute_robot_state-npc3_min 0.0383886018193754 sim_compute_sim_state_max 0.02335036954572124 sim_compute_sim_state_mean 0.022703561531092507 sim_compute_sim_state_median 0.022635066509246828 sim_compute_sim_state_min 0.022297434340742297 sim_physics_max 0.0206162514431136 sim_physics_mean 0.01998570121516084 sim_physics_median 0.020212542626165578 sim_physics_min 0.019073021951868142 sim_render-ego_max 0.03697659892420615 sim_render-ego_mean 0.03618506478852033 sim_render-ego_median 0.035959333181381226 sim_render-ego_min 0.03581620876054119 simulation-passed 1 survival_time_max 14.350000000000067 survival_time_mean 9.55000000000003 survival_time_min 1.5500000000000007
No reset possible 18299
2782
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation error no uberduck2
2019-04-19 12:25:48+00:00 2019-04-19 12:26:16+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18297
2786
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROS aido2-LFVI-sim-testing
step1-simulation error no uberduck2
2019-04-19 12:25:13+00:00 2019-04-19 12:25:41+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18294
2796
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation failed no uberduck2
2019-04-19 12:23:18+00:00 2019-04-19 12:24:41+00:00 0:01:23 InvalidSubmission:
T [...] InvalidSubmission:
Traceback (most recent call last):
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "experiment_manager.py", line 293, in run_episode
r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 435, in <module>
wrap(cie)
File "experiment_manager.py", line 423, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 136, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 297, in run_episode
raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18283
2826
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LFVI-sim-testing
step1-simulation success no uberduck2
2019-04-19 12:14:47+00:00 2019-04-19 12:22:32+00:00 0:07:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.9585846921942625 survival_time_median 3.099999999999997 deviation-center-line_median 0.13094298490844536 in-drivable-lane_median 0.4999999999999982
other stats agent_compute-ego_max 0.08602508421867125 agent_compute-ego_mean 0.08461485803825167 agent_compute-ego_median 0.08468936098382827 agent_compute-ego_min 0.08266322285521265 deviation-center-line_max 0.1934674474960452 deviation-center-line_mean 0.10884100878338444 deviation-center-line_min 0.032459786530846635 deviation-heading_max 0.7356226190209126 deviation-heading_mean 0.3809403978290703 deviation-heading_median 0.2855944786164235 deviation-heading_min 0.22149655353610215 driven_any_max 2.029872313755146 driven_any_mean 1.3151025945779695 driven_any_median 1.2614050434743518 driven_any_min 1.0057903566516673 driven_lanedir_consec_max 1.454438818080216 driven_lanedir_consec_mean 1.0334629747873598 driven_lanedir_consec_min 0.6769768591939229 driven_lanedir_max 1.4545895120774182 driven_lanedir_mean 1.0334931135868004 driven_lanedir_median 0.9585846921942625 driven_lanedir_min 0.6769768591939229 in-drivable-lane_max 1.149999999999996 in-drivable-lane_mean 0.539999999999998 in-drivable-lane_min 0 per-episodes details {"udem1-0-0": {"driven_any": 1.2614050434743518, "sim_physics": 0.02164846374875023, "survival_time": 3.149999999999997, "driven_lanedir": 0.9585846921942625, "sim_render-ego": 0.03531705387054928, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.08595912040226043, "deviation-heading": 0.7356226190209126, "set_robot_commands": 0.05121903570871505, "deviation-center-line": 0.1934674474960452, "driven_lanedir_consec": 0.9585846921942625, "sim_compute_sim_state": 0.021254531920902313, "sim_compute_performance-ego": 0.035256083049471414, "sim_compute_robot_state-ego": 0.04098145545475067, "sim_compute_robot_state-npc0": 0.03706470368400453, "sim_compute_robot_state-npc1": 0.037072620694599455, "sim_compute_robot_state-npc2": 0.03647649098956396, "sim_compute_robot_state-npc3": 0.037284499122982935}, "udem1-1-0": {"driven_any": 1.0057903566516673, "sim_physics": 0.019753488839841356, "survival_time": 2.549999999999999, "driven_lanedir": 0.6769768591939229, "sim_render-ego": 0.03507386936860926, "in-drivable-lane": 0.6499999999999979, "agent_compute-ego": 0.08266322285521265, "deviation-heading": 0.2594067356428278, "set_robot_commands": 0.05061664300806382, "deviation-center-line": 0.032459786530846635, "driven_lanedir_consec": 0.6769768591939229, "sim_compute_sim_state": 0.021834382823869295, "sim_compute_performance-ego": 0.03537153262718051, "sim_compute_robot_state-ego": 0.04263019561767578, "sim_compute_robot_state-npc0": 0.0375521603752585, "sim_compute_robot_state-npc1": 0.039387871237362135, "sim_compute_robot_state-npc2": 0.03815403171614105, "sim_compute_robot_state-npc3": 0.03858512990614947}, "udem1-2-0": {"driven_any": 1.272156782174927, "sim_physics": 0.02127795450149044, "survival_time": 3.099999999999997, "driven_lanedir": 1.2659672450373072, "sim_render-ego": 0.034746889145143574, "in-drivable-lane": 0, "agent_compute-ego": 0.08602508421867125, "deviation-heading": 0.22149655353610215, "set_robot_commands": 0.05040396413495464, "deviation-center-line": 0.13094298490844536, "driven_lanedir_consec": 1.2659672450373072, "sim_compute_sim_state": 0.021375833019133535, "sim_compute_performance-ego": 0.035539761666328676, "sim_compute_robot_state-ego": 0.03960112987026092, "sim_compute_robot_state-npc0": 0.03686849532588836, "sim_compute_robot_state-npc1": 0.03678329913846908, "sim_compute_robot_state-npc2": 0.03616361464223554, "sim_compute_robot_state-npc3": 0.03758761190599011}, "udem1-3-0": {"driven_any": 2.029872313755146, "sim_physics": 0.021838675154016374, "survival_time": 4.699999999999991, "driven_lanedir": 1.4545895120774182, "sim_render-ego": 0.03503375104133119, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08468936098382827, "deviation-heading": 0.40258160232908535, "set_robot_commands": 0.05060076967198798, "deviation-center-line": 0.1370465252692341, "driven_lanedir_consec": 1.454438818080216, "sim_compute_sim_state": 0.0223143126102204, "sim_compute_performance-ego": 0.03537895831655949, "sim_compute_robot_state-ego": 0.04155517892634615, "sim_compute_robot_state-npc0": 0.03894725251705088, "sim_compute_robot_state-npc1": 0.03855452131717763, "sim_compute_robot_state-npc2": 0.03684178311774071, "sim_compute_robot_state-npc3": 0.03905117004475695}, "udem1-4-0": {"driven_any": 1.0062884768337566, "sim_physics": 0.018856777594639704, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8113472594310909, "sim_render-ego": 0.03710884772814237, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08373750173128568, "deviation-heading": 0.2855944786164235, "set_robot_commands": 0.05071347493391771, "deviation-center-line": 0.050288299712350874, "driven_lanedir_consec": 0.8113472594310909, "sim_compute_sim_state": 0.02270242801079383, "sim_compute_performance-ego": 0.03612182232049795, "sim_compute_robot_state-ego": 0.04125226002473097, "sim_compute_robot_state-npc0": 0.03845461973777184, "sim_compute_robot_state-npc1": 0.0375372079702524, "sim_compute_robot_state-npc2": 0.037439433427957386, "sim_compute_robot_state-npc3": 0.03784330074603741}}set_robot_commands_max 0.05121903570871505 set_robot_commands_mean 0.050710777491527845 set_robot_commands_median 0.05061664300806382 set_robot_commands_min 0.05040396413495464 sim_compute_performance-ego_max 0.03612182232049795 sim_compute_performance-ego_mean 0.035533631596007614 sim_compute_performance-ego_median 0.03537895831655949 sim_compute_performance-ego_min 0.035256083049471414 sim_compute_robot_state-ego_max 0.04263019561767578 sim_compute_robot_state-ego_mean 0.0412040439787529 sim_compute_robot_state-ego_median 0.04125226002473097 sim_compute_robot_state-ego_min 0.03960112987026092 sim_compute_robot_state-npc0_max 0.03894725251705088 sim_compute_robot_state-npc0_mean 0.03777744632799482 sim_compute_robot_state-npc0_median 0.0375521603752585 sim_compute_robot_state-npc0_min 0.03686849532588836 sim_compute_robot_state-npc1_max 0.039387871237362135 sim_compute_robot_state-npc1_mean 0.037867104071572136 sim_compute_robot_state-npc1_median 0.0375372079702524 sim_compute_robot_state-npc1_min 0.03678329913846908 sim_compute_robot_state-npc2_max 0.03815403171614105 sim_compute_robot_state-npc2_mean 0.037015070778727725 sim_compute_robot_state-npc2_median 0.03684178311774071 sim_compute_robot_state-npc2_min 0.03616361464223554 sim_compute_robot_state-npc3_max 0.03905117004475695 sim_compute_robot_state-npc3_mean 0.038070342345183375 sim_compute_robot_state-npc3_median 0.03784330074603741 sim_compute_robot_state-npc3_min 0.037284499122982935 sim_compute_sim_state_max 0.02270242801079383 sim_compute_sim_state_mean 0.021896297676983877 sim_compute_sim_state_median 0.021834382823869295 sim_compute_sim_state_min 0.021254531920902313 sim_physics_max 0.021838675154016374 sim_physics_mean 0.020675071967747614 sim_physics_median 0.02127795450149044 sim_physics_min 0.018856777594639704 sim_render-ego_max 0.03710884772814237 sim_render-ego_mean 0.03545608223075514 sim_render-ego_median 0.03507386936860926 sim_render-ego_min 0.034746889145143574 simulation-passed 1 survival_time_max 4.699999999999991 survival_time_mean 3.2199999999999966 survival_time_min 2.549999999999999
No reset possible 18281
2839
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation error no uberduck2
2019-04-19 12:13:41+00:00 2019-04-19 12:14:10+00:00 0:00:29 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18280
2851
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation error no uberduck2
2019-04-19 12:12:45+00:00 2019-04-19 12:13:12+00:00 0:00:27 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18270
2828
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 12:08:40+00:00 2019-04-19 12:12:30+00:00 0:03:50 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.08571613331635793 agent_compute-ego_mean 0.08456432861154992 agent_compute-ego_median 0.08415814963254062 agent_compute-ego_min 0.08365142080518935 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010342782398439804, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.03458843591078272, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08388007811780246, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.05099597067203162, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.022721452533074143, "sim_compute_performance-ego": 0.03627618753685141, "sim_compute_robot_state-ego": 0.03979921340942383}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009916646914048628, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.03433947129683061, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08415814963254062, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.049856250936334785, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022746476260098545, "sim_compute_performance-ego": 0.035998317328366364, "sim_compute_robot_state-ego": 0.041533405130559746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.009914726681179473, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.03408313327365452, "in-drivable-lane": 0, "agent_compute-ego": 0.08365142080518935, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05051325692070855, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.02223265435960558, "sim_compute_performance-ego": 0.035895490646362306, "sim_compute_robot_state-ego": 0.040299050013224286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.010079696774482729, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.03462637464205424, "in-drivable-lane": 0, "agent_compute-ego": 0.08571613331635793, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.050014227628707886, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02268088360627492, "sim_compute_performance-ego": 0.036012555162111916, "sim_compute_robot_state-ego": 0.04057615498701731}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.010761050616993624, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.0347257046138539, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08541586118585923, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.05161702282288495, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.02278832127066219, "sim_compute_performance-ego": 0.03697220718159395, "sim_compute_robot_state-ego": 0.040427383254556096}}set_robot_commands_max 0.05161702282288495 set_robot_commands_mean 0.05059934579613355 set_robot_commands_median 0.05051325692070855 set_robot_commands_min 0.049856250936334785 sim_compute_performance-ego_max 0.03697220718159395 sim_compute_performance-ego_mean 0.036230951571057185 sim_compute_performance-ego_median 0.036012555162111916 sim_compute_performance-ego_min 0.035895490646362306 sim_compute_robot_state-ego_max 0.041533405130559746 sim_compute_robot_state-ego_mean 0.04052704135895625 sim_compute_robot_state-ego_median 0.040427383254556096 sim_compute_robot_state-ego_min 0.03979921340942383 sim_compute_sim_state_max 0.02278832127066219 sim_compute_sim_state_mean 0.022633957605943077 sim_compute_sim_state_median 0.022721452533074143 sim_compute_sim_state_min 0.02223265435960558 sim_physics_max 0.010761050616993624 sim_physics_mean 0.010202980677028852 sim_physics_median 0.010079696774482729 sim_physics_min 0.009914726681179473 sim_render-ego_max 0.0347257046138539 sim_render-ego_mean 0.0344726239474352 sim_render-ego_median 0.03458843591078272 sim_render-ego_min 0.03408313327365452 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18268
2843
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 12:07:42+00:00 2019-04-19 12:08:10+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18267
2852
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error no uberduck2
2019-04-19 12:07:00+00:00 2019-04-19 12:07:27+00:00 0:00:27 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18265
2836
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no uberduck2
2019-04-19 12:06:17+00:00 2019-04-19 12:06:45+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18261
2716
jiang peng test for ppo aido2-LF-sim-validation
step1-simulation error no uberduck2
2019-04-19 12:04:48+00:00 2019-04-19 12:05:54+00:00 0:01:06 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18252
2844
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-validation
step1-simulation error no uberduck2
2019-04-19 12:03:51+00:00 2019-04-19 12:04:33+00:00 0:00:42 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18242
2408
jiang peng Baseline solution using reinforcement learning aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 11:01:40+00:00 2019-04-19 11:16:54+00:00 0:15:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median -1.3614583993086016 survival_time_median 14.950000000000076 deviation-center-line_median 1.011969887428033 in-drivable-lane_median 4.050000000000022
other stats agent_compute-ego_max 0.09465670188268026 agent_compute-ego_mean 0.0936401720046997 agent_compute-ego_median 0.09326562722524008 agent_compute-ego_min 0.09255512237548828 deviation-center-line_max 1.0119709059919424 deviation-center-line_mean 1.0119700704341597 deviation-center-line_min 1.0119697838947566 deviation-heading_max 6.81542792438532 deviation-heading_mean 6.815427924385318 deviation-heading_median 6.815427924385319 deviation-heading_min 6.815427924385317 driven_any_max 4.390824152784936 driven_any_mean 4.390824152784928 driven_any_median 4.390824152784926 driven_any_min 4.390824152784922 driven_lanedir_consec_max -1.361452200425545 driven_lanedir_consec_mean -1.3614594960339783 driven_lanedir_consec_min -1.3614696049818191 driven_lanedir_max -2.315814608416598 driven_lanedir_mean -2.3158178509092298 driven_lanedir_median -2.3158179462767055 driven_lanedir_min -2.315821760973971 in-drivable-lane_max 4.050000000000022 in-drivable-lane_mean 4.050000000000022 in-drivable-lane_min 4.050000000000022 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.39082415278493, "sim_physics": 0.00983591079711914, "survival_time": 14.950000000000076, "driven_lanedir": -2.3158179462767055, "sim_render-ego": 0.03428708553314209, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09465670188268026, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05098353226979573, "deviation-center-line": 1.0119698874280334, "driven_lanedir_consec": -1.3614583993086016, "sim_compute_sim_state": 0.022849481105804443, "sim_compute_performance-ego": 0.036598768234252926, "sim_compute_robot_state-ego": 0.04079390605290731}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.390824152784936, "sim_physics": 0.009968449274698893, "survival_time": 14.950000000000076, "driven_lanedir": -2.315820330462275, "sim_render-ego": 0.034949417114257815, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09313456694285074, "deviation-heading": 6.815427924385317, "set_robot_commands": 0.051686991850535074, "deviation-center-line": 1.0119709059919424, "driven_lanedir_consec": -1.3614650750283808, "sim_compute_sim_state": 0.02273496866226196, "sim_compute_performance-ego": 0.03607688029607137, "sim_compute_robot_state-ego": 0.041315283775329587}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.390824152784926, "sim_physics": 0.009666412671407065, "survival_time": 14.950000000000076, "driven_lanedir": -2.315821760973971, "sim_render-ego": 0.034832774003346764, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09255512237548828, "deviation-heading": 6.81542792438532, "set_robot_commands": 0.05029426256815592, "deviation-center-line": 1.0119697838947566, "driven_lanedir_consec": -1.3614696049818191, "sim_compute_sim_state": 0.022994649410247803, "sim_compute_performance-ego": 0.03649616400400797, "sim_compute_robot_state-ego": 0.04103114048639933}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.390824152784922, "sim_physics": 0.010055814584096273, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.034900094668070474, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09326562722524008, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05064382235209147, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.023178947766621907, "sim_compute_performance-ego": 0.03716924111048381, "sim_compute_robot_state-ego": 0.04138567129770915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.390824152784922, "sim_physics": 0.010112621784210206, "survival_time": 14.950000000000076, "driven_lanedir": -2.315814608416598, "sim_render-ego": 0.03473737160364787, "in-drivable-lane": 4.050000000000022, "agent_compute-ego": 0.09458884159723918, "deviation-heading": 6.815427924385319, "set_robot_commands": 0.05044980605443319, "deviation-center-line": 1.011969887428033, "driven_lanedir_consec": -1.361452200425545, "sim_compute_sim_state": 0.02315916061401367, "sim_compute_performance-ego": 0.036499502658844, "sim_compute_robot_state-ego": 0.04142152627309163}}set_robot_commands_max 0.051686991850535074 set_robot_commands_mean 0.050811683019002275 set_robot_commands_median 0.05064382235209147 set_robot_commands_min 0.05029426256815592 sim_compute_performance-ego_max 0.03716924111048381 sim_compute_performance-ego_mean 0.03656811126073202 sim_compute_performance-ego_median 0.036499502658844 sim_compute_performance-ego_min 0.03607688029607137 sim_compute_robot_state-ego_max 0.04142152627309163 sim_compute_robot_state-ego_mean 0.04118950557708741 sim_compute_robot_state-ego_median 0.041315283775329587 sim_compute_robot_state-ego_min 0.04079390605290731 sim_compute_sim_state_max 0.023178947766621907 sim_compute_sim_state_mean 0.02298344151178996 sim_compute_sim_state_median 0.022994649410247803 sim_compute_sim_state_min 0.02273496866226196 sim_physics_max 0.010112621784210206 sim_physics_mean 0.009927841822306317 sim_physics_median 0.009968449274698893 sim_physics_min 0.009666412671407065 sim_render-ego_max 0.034949417114257815 sim_render-ego_mean 0.034741348584493 sim_render-ego_median 0.034832774003346764 sim_render-ego_min 0.03428708553314209 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 14.950000000000076 survival_time_min 14.950000000000076
No reset possible 18240
2428
Andrea Censi 🇨🇭random_agent aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 11:00:36+00:00 2019-04-19 11:01:03+00:00 0:00:27 The container "solut [...] The container "solution" exited with code 2.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18235
2455
Liam Paull 🇨🇦challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 11:00:01+00:00 2019-04-19 11:00:29+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18230
2479
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 10:58:57+00:00 2019-04-19 10:59:25+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18228
2508
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 10:58:00+00:00 2019-04-19 10:58:27+00:00 0:00:27 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18221
2543
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 10:53:59+00:00 2019-04-19 10:57:44+00:00 0:03:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.909759304183658 survival_time_median 2.3999999999999995 deviation-center-line_median 0.0985043663838993 in-drivable-lane_median 0.3499999999999992
other stats agent_compute-ego_max 0.08546171548231593 agent_compute-ego_mean 0.08418092655990421 agent_compute-ego_median 0.0838476022084554 agent_compute-ego_min 0.08306560733101585 deviation-center-line_max 0.13882443387861454 deviation-center-line_mean 0.10001813696907735 deviation-center-line_min 0.06219077976537568 deviation-heading_max 0.26115230540596424 deviation-heading_mean 0.2318832073723368 deviation-heading_median 0.23893895947579852 deviation-heading_min 0.1984807025035912 driven_any_max 1.4367438864906803 driven_any_mean 1.030907091561231 driven_any_median 0.9157141892899948 driven_any_min 0.8462726558162896 driven_lanedir_consec_max 0.9542197633771314 driven_lanedir_consec_mean 0.795970343519684 driven_lanedir_consec_min 0.5348503251906886 driven_lanedir_max 0.9542197633771314 driven_lanedir_mean 0.795970343519684 driven_lanedir_median 0.909759304183658 driven_lanedir_min 0.5348503251906886 in-drivable-lane_max 1.099999999999998 in-drivable-lane_mean 0.4899999999999987 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0405624261079018, "sim_physics": 0.010114179467255216, "survival_time": 2.6499999999999986, "driven_lanedir": 0.5348503251906886, "sim_render-ego": 0.034419320664315856, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.08546171548231593, "deviation-heading": 0.24579559783100224, "set_robot_commands": 0.050885276974372146, "deviation-center-line": 0.07952733817751276, "driven_lanedir_consec": 0.5348503251906886, "sim_compute_sim_state": 0.022548949943398528, "sim_compute_performance-ego": 0.03603215937344533, "sim_compute_robot_state-ego": 0.04090785530378234}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8462726558162896, "sim_physics": 0.009613069620999422, "survival_time": 2.2, "driven_lanedir": 0.6707200449851557, "sim_render-ego": 0.034346249970522796, "in-drivable-lane": 0.3499999999999992, "agent_compute-ego": 0.08306560733101585, "deviation-heading": 0.23893895947579852, "set_robot_commands": 0.04973122748461637, "deviation-center-line": 0.06219077976537568, "driven_lanedir_consec": 0.6707200449851557, "sim_compute_sim_state": 0.022986997257579456, "sim_compute_performance-ego": 0.036177505146373405, "sim_compute_robot_state-ego": 0.0420735315843062}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9152423001012878, "sim_physics": 0.01050124168395996, "survival_time": 2.25, "driven_lanedir": 0.909759304183658, "sim_render-ego": 0.034106037351820204, "in-drivable-lane": 0, "agent_compute-ego": 0.08318031628926595, "deviation-heading": 0.1984807025035912, "set_robot_commands": 0.05000752872890896, "deviation-center-line": 0.1210437666399845, "driven_lanedir_consec": 0.909759304183658, "sim_compute_sim_state": 0.022738287183973523, "sim_compute_performance-ego": 0.03565211296081543, "sim_compute_robot_state-ego": 0.03963168462117513}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9157141892899948, "sim_physics": 0.01062577466169993, "survival_time": 2.3999999999999995, "driven_lanedir": 0.910302279861786, "sim_render-ego": 0.033822014927864075, "in-drivable-lane": 0, "agent_compute-ego": 0.0838476022084554, "deviation-heading": 0.2150484716453277, "set_robot_commands": 0.05058298508326212, "deviation-center-line": 0.13882443387861454, "driven_lanedir_consec": 0.910302279861786, "sim_compute_sim_state": 0.02220703661441803, "sim_compute_performance-ego": 0.036506970723470054, "sim_compute_robot_state-ego": 0.04118643204371134}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4367438864906803, "sim_physics": 0.010915724670185764, "survival_time": 3.399999999999996, "driven_lanedir": 0.9542197633771314, "sim_render-ego": 0.034699229633106905, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08534939148846794, "deviation-heading": 0.26115230540596424, "set_robot_commands": 0.051231142352609074, "deviation-center-line": 0.0985043663838993, "driven_lanedir_consec": 0.9542197633771314, "sim_compute_sim_state": 0.023142691920785344, "sim_compute_performance-ego": 0.036124239949619066, "sim_compute_robot_state-ego": 0.041390124489279354}}set_robot_commands_max 0.051231142352609074 set_robot_commands_mean 0.05048763212475373 set_robot_commands_median 0.05058298508326212 set_robot_commands_min 0.04973122748461637 sim_compute_performance-ego_max 0.036506970723470054 sim_compute_performance-ego_mean 0.036098597630744654 sim_compute_performance-ego_median 0.036124239949619066 sim_compute_performance-ego_min 0.03565211296081543 sim_compute_robot_state-ego_max 0.0420735315843062 sim_compute_robot_state-ego_mean 0.04103792560845088 sim_compute_robot_state-ego_median 0.04118643204371134 sim_compute_robot_state-ego_min 0.03963168462117513 sim_compute_sim_state_max 0.023142691920785344 sim_compute_sim_state_mean 0.022724792584030977 sim_compute_sim_state_median 0.022738287183973523 sim_compute_sim_state_min 0.02220703661441803 sim_physics_max 0.010915724670185764 sim_physics_mean 0.010353998020820055 sim_physics_median 0.01050124168395996 sim_physics_min 0.009613069620999422 sim_render-ego_max 0.034699229633106905 sim_render-ego_mean 0.034278570509525964 sim_render-ego_median 0.034346249970522796 sim_render-ego_min 0.033822014927864075 simulation-passed 1 survival_time_max 3.399999999999996 survival_time_mean 2.579999999999999 survival_time_min 2.2
No reset possible 18217
2560
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 10:49:33+00:00 2019-04-19 10:53:36+00:00 0:04:03 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.04427974040691669 agent_compute-ego_mean 0.042824103768884514 agent_compute-ego_median 0.04273115961175216 agent_compute-ego_min 0.04186610477726634 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.01168143458482696, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.034155060605304995, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04186610477726634, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.052060880312105505, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.023260910336564227, "sim_compute_performance-ego": 0.03645173224007211, "sim_compute_robot_state-ego": 0.04089122574503829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010365587014418382, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.034078350433936484, "in-drivable-lane": 0, "agent_compute-ego": 0.04236359779651348, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05122467187734751, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.024181897823627178, "sim_compute_performance-ego": 0.036648961213918835, "sim_compute_robot_state-ego": 0.04185785697056697}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.010462350033699198, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03423843485243777, "in-drivable-lane": 0, "agent_compute-ego": 0.042879916251973904, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.05138852748465031, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.023962264365338264, "sim_compute_performance-ego": 0.0368972788465784, "sim_compute_robot_state-ego": 0.04179328553220059}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.0111999695117657, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03473921660538558, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.04427974040691669, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.05218751351911943, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.023488139058207416, "sim_compute_performance-ego": 0.03650803618378692, "sim_compute_robot_state-ego": 0.04128412099984976}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.010080161847566304, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03522222920467979, "in-drivable-lane": 0, "agent_compute-ego": 0.04273115961175216, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.051757360759534334, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.022493011073062296, "sim_compute_performance-ego": 0.036846436952289785, "sim_compute_robot_state-ego": 0.04124276888997931}}set_robot_commands_max 0.05218751351911943 set_robot_commands_mean 0.051723790790551415 set_robot_commands_median 0.051757360759534334 set_robot_commands_min 0.05122467187734751 sim_compute_performance-ego_max 0.0368972788465784 sim_compute_performance-ego_mean 0.036670489087329214 sim_compute_performance-ego_median 0.036648961213918835 sim_compute_performance-ego_min 0.03645173224007211 sim_compute_robot_state-ego_max 0.04185785697056697 sim_compute_robot_state-ego_mean 0.04141385162752699 sim_compute_robot_state-ego_median 0.04128412099984976 sim_compute_robot_state-ego_min 0.04089122574503829 sim_compute_sim_state_max 0.024181897823627178 sim_compute_sim_state_mean 0.02347724453135987 sim_compute_sim_state_median 0.023488139058207416 sim_compute_sim_state_min 0.022493011073062296 sim_physics_max 0.01168143458482696 sim_physics_mean 0.01075790059845531 sim_physics_median 0.010462350033699198 sim_physics_min 0.010080161847566304 sim_render-ego_max 0.03522222920467979 sim_render-ego_mean 0.034486658340348926 sim_render-ego_median 0.03423843485243777 sim_render-ego_min 0.034078350433936484 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18215
2573
Alexander Karavaev challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 10:48:29+00:00 2019-04-19 10:48:57+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18211
2596
Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-19 10:47:39+00:00 2019-04-19 10:48:20+00:00 0:00:41 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18207
2600
Liam Paull 🇨🇦challenge-aido_LF-template-tensorflow aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 10:42:26+00:00 2019-04-19 10:47:10+00:00 0:04:44 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.8986297848351752 survival_time_median 4.199999999999993 deviation-center-line_median 0.1737277070277045 in-drivable-lane_median 0.14999999999999947
other stats agent_compute-ego_max 0.0811685553768225 agent_compute-ego_mean 0.07934902802935523 agent_compute-ego_median 0.07919326395091444 agent_compute-ego_min 0.07750352392805383 deviation-center-line_max 0.33297240400755673 deviation-center-line_mean 0.2012749276249906 deviation-center-line_min 0.07198849695349571 deviation-heading_max 2.120555986395429 deviation-heading_mean 1.3535644080533515 deviation-heading_median 1.2613548731202808 deviation-heading_min 0.32407950273728403 driven_any_max 1.3870338070945685 driven_any_mean 1.0184411329928484 driven_any_median 1.2467159459034582 driven_any_min 0.3933305442582112 driven_lanedir_consec_max 1.1995314792743788 driven_lanedir_consec_mean 0.7801780797354769 driven_lanedir_consec_min 0.3668828007345852 driven_lanedir_max 1.1995314792743788 driven_lanedir_mean 0.7805629925269285 driven_lanedir_median 0.8986297848351752 driven_lanedir_min 0.3668828007345852 in-drivable-lane_max 0.7999999999999972 in-drivable-lane_mean 0.289999999999999 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.743280823601232, "sim_physics": 0.010485352131358363, "survival_time": 2.849999999999998, "driven_lanedir": 0.3971767138826672, "sim_render-ego": 0.03465606455217328, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0811685553768225, "deviation-heading": 1.2613548731202808, "set_robot_commands": 0.05041469607436866, "deviation-center-line": 0.11019237882257996, "driven_lanedir_consec": 0.3952521499254096, "sim_compute_sim_state": 0.022771609456915604, "sim_compute_performance-ego": 0.036246764032464275, "sim_compute_robot_state-ego": 0.040595205206620064}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3870338070945685, "sim_physics": 0.011666130311418287, "survival_time": 5.04999999999999, "driven_lanedir": 1.1995314792743788, "sim_render-ego": 0.034370065915702595, "in-drivable-lane": 0, "agent_compute-ego": 0.07919326395091444, "deviation-heading": 2.120555986395429, "set_robot_commands": 0.04970437229269802, "deviation-center-line": 0.33297240400755673, "driven_lanedir_consec": 1.1995314792743788, "sim_compute_sim_state": 0.0230639122500278, "sim_compute_performance-ego": 0.036190358719023145, "sim_compute_robot_state-ego": 0.041012922135910186}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3933305442582112, "sim_physics": 0.009801645278930664, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3668828007345852, "sim_render-ego": 0.03452240943908692, "in-drivable-lane": 0, "agent_compute-ego": 0.08075645446777344, "deviation-heading": 0.32407950273728403, "set_robot_commands": 0.04969894409179688, "deviation-center-line": 0.07198849695349571, "driven_lanedir_consec": 0.3668828007345852, "sim_compute_sim_state": 0.02293044090270996, "sim_compute_performance-ego": 0.03704183578491211, "sim_compute_robot_state-ego": 0.04103785514831543}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3218445441067717, "sim_physics": 0.011196732521057127, "survival_time": 4.199999999999993, "driven_lanedir": 0.8986297848351752, "sim_render-ego": 0.034776012102762856, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07812334242321196, "deviation-heading": 1.171220708589202, "set_robot_commands": 0.04970561890375046, "deviation-center-line": 0.1737277070277045, "driven_lanedir_consec": 0.8986297848351752, "sim_compute_sim_state": 0.02299365827015468, "sim_compute_performance-ego": 0.03641740481058756, "sim_compute_robot_state-ego": 0.04092654443922497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2467159459034582, "sim_physics": 0.011805514071850067, "survival_time": 4.699999999999991, "driven_lanedir": 1.040594183907836, "sim_render-ego": 0.034978382130886644, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07750352392805383, "deviation-heading": 1.8906109694245616, "set_robot_commands": 0.04977976768574816, "deviation-center-line": 0.3174936513136161, "driven_lanedir_consec": 1.040594183907836, "sim_compute_sim_state": 0.02279545398468667, "sim_compute_performance-ego": 0.036193578801256544, "sim_compute_robot_state-ego": 0.04112308836997824}}set_robot_commands_max 0.05041469607436866 set_robot_commands_mean 0.04986067980967244 set_robot_commands_median 0.04970561890375046 set_robot_commands_min 0.04969894409179688 sim_compute_performance-ego_max 0.03704183578491211 sim_compute_performance-ego_mean 0.036417988429648725 sim_compute_performance-ego_median 0.036246764032464275 sim_compute_performance-ego_min 0.036190358719023145 sim_compute_robot_state-ego_max 0.04112308836997824 sim_compute_robot_state-ego_mean 0.04093912306000978 sim_compute_robot_state-ego_median 0.041012922135910186 sim_compute_robot_state-ego_min 0.040595205206620064 sim_compute_sim_state_max 0.0230639122500278 sim_compute_sim_state_mean 0.022911014972898942 sim_compute_sim_state_median 0.02293044090270996 sim_compute_sim_state_min 0.022771609456915604 sim_physics_max 0.011805514071850067 sim_physics_mean 0.010991074862922903 sim_physics_median 0.011196732521057127 sim_physics_min 0.009801645278930664 sim_render-ego_max 0.034978382130886644 sim_render-ego_mean 0.03466058682812245 sim_render-ego_median 0.03465606455217328 sim_render-ego_min 0.034370065915702595 simulation-passed 1 survival_time_max 5.04999999999999 survival_time_mean 3.6099999999999945 survival_time_min 1.2500000000000004
No reset possible 18196
2690
Konstantin Chaika challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 10:32:04+00:00 2019-04-19 10:42:18+00:00 0:10:14 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.1736396062747143 survival_time_median 10.90000000000002 deviation-center-line_median 0.6223760158424115 in-drivable-lane_median 0.549999999999998
other stats agent_compute-ego_max 0.04532951719305488 agent_compute-ego_mean 0.044733881493630105 agent_compute-ego_median 0.04448314746220906 agent_compute-ego_min 0.04435051253082555 deviation-center-line_max 1.0952052770511216 deviation-center-line_mean 0.6713523141032698 deviation-center-line_min 0.18051433084287577 deviation-heading_max 5.969780927486059 deviation-heading_mean 3.1201388390311795 deviation-heading_median 2.5975014741646967 deviation-heading_min 0.6841211228731245 driven_any_max 2.3555684722913126 driven_any_mean 1.5643410657714043 driven_any_median 1.7047482493801278 driven_any_min 0.6573844748514421 driven_lanedir_consec_max 1.6224875942105037 driven_lanedir_consec_mean 1.0509570759590727 driven_lanedir_consec_min 0.4879956695875416 driven_lanedir_max 1.8752330929188763 driven_lanedir_mean 1.2947339294278182 driven_lanedir_median 1.6224875942105037 driven_lanedir_min 0.4879956695875416 in-drivable-lane_max 2.2500000000000067 in-drivable-lane_mean 0.7800000000000005 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.6573844748514421, "sim_physics": 0.012015211448240816, "survival_time": 4.449999999999992, "driven_lanedir": 0.4879956695875416, "sim_render-ego": 0.03613138198852539, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.04532951719305488, "deviation-heading": 1.5151009399067246, "set_robot_commands": 0.05209636956118466, "deviation-center-line": 0.18051433084287577, "driven_lanedir_consec": 0.4879956695875416, "sim_compute_sim_state": 0.02486937769343344, "sim_compute_performance-ego": 0.0379096952716956, "sim_compute_robot_state-ego": 0.041540657536367355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.355473458682705, "sim_physics": 0.010044220288594564, "survival_time": 14.950000000000076, "driven_lanedir": 1.8752330929188763, "sim_render-ego": 0.036541613737742104, "in-drivable-lane": 1.0999999999999972, "agent_compute-ego": 0.04435365279515584, "deviation-heading": 5.969780927486059, "set_robot_commands": 0.05225282271703084, "deviation-center-line": 0.9948686111860808, "driven_lanedir_consec": 1.1736396062747143, "sim_compute_sim_state": 0.024438060919443765, "sim_compute_performance-ego": 0.03722197771072388, "sim_compute_robot_state-ego": 0.041646220684051515}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3555684722913126, "sim_physics": 0.010406290690104169, "survival_time": 14.950000000000076, "driven_lanedir": 1.7512099247794932, "sim_render-ego": 0.03573849121729533, "in-drivable-lane": 2.2500000000000067, "agent_compute-ego": 0.04448314746220906, "deviation-heading": 4.834189730725294, "set_robot_commands": 0.05209734916687011, "deviation-center-line": 1.0952052770511216, "driven_lanedir_consec": 1.233919144079928, "sim_compute_sim_state": 0.024702511628468832, "sim_compute_performance-ego": 0.03784877061843872, "sim_compute_robot_state-ego": 0.041723997592926027}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7485306736514343, "sim_physics": 0.011391422965309836, "survival_time": 4.94999999999999, "driven_lanedir": 0.7367433656426763, "sim_render-ego": 0.03598049915198124, "in-drivable-lane": 0, "agent_compute-ego": 0.04515257748690518, "deviation-heading": 0.6841211228731245, "set_robot_commands": 0.052257699195784754, "deviation-center-line": 0.4637973355938595, "driven_lanedir_consec": 0.7367433656426763, "sim_compute_sim_state": 0.02413961381623239, "sim_compute_performance-ego": 0.0373695402434378, "sim_compute_robot_state-ego": 0.04151260732400297}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7047482493801278, "sim_physics": 0.010524429312539756, "survival_time": 10.90000000000002, "driven_lanedir": 1.6224875942105037, "sim_render-ego": 0.03618890539221807, "in-drivable-lane": 0, "agent_compute-ego": 0.04435051253082555, "deviation-heading": 2.5975014741646967, "set_robot_commands": 0.05233864281155647, "deviation-center-line": 0.6223760158424115, "driven_lanedir_consec": 1.6224875942105037, "sim_compute_sim_state": 0.024310510092919027, "sim_compute_performance-ego": 0.03748115596421268, "sim_compute_robot_state-ego": 0.04138699802783651}}set_robot_commands_max 0.05233864281155647 set_robot_commands_mean 0.05220857669048538 set_robot_commands_median 0.05225282271703084 set_robot_commands_min 0.05209636956118466 sim_compute_performance-ego_max 0.0379096952716956 sim_compute_performance-ego_mean 0.03756622796170173 sim_compute_performance-ego_median 0.03748115596421268 sim_compute_performance-ego_min 0.03722197771072388 sim_compute_robot_state-ego_max 0.041723997592926027 sim_compute_robot_state-ego_mean 0.041562096233036874 sim_compute_robot_state-ego_median 0.041540657536367355 sim_compute_robot_state-ego_min 0.04138699802783651 sim_compute_sim_state_max 0.02486937769343344 sim_compute_sim_state_mean 0.02449201483009949 sim_compute_sim_state_median 0.024438060919443765 sim_compute_sim_state_min 0.02413961381623239 sim_physics_max 0.012015211448240816 sim_physics_mean 0.010876314940957829 sim_physics_median 0.010524429312539756 sim_physics_min 0.010044220288594564 sim_render-ego_max 0.036541613737742104 sim_render-ego_mean 0.036116178297552426 sim_render-ego_median 0.03613138198852539 sim_render-ego_min 0.03573849121729533 simulation-passed 1 survival_time_max 14.950000000000076 survival_time_mean 10.040000000000031 survival_time_min 4.449999999999992
No reset possible 18182
2754
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-testing
step1-simulation success no uberduck2
2019-04-19 10:27:51+00:00 2019-04-19 10:31:57+00:00 0:04:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.5487126868955534 survival_time_median 2.3499999999999996 deviation-center-line_median 0.11041377901227004 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.043048394905341854 agent_compute-ego_mean 0.04177349414823946 agent_compute-ego_median 0.041765845738924466 agent_compute-ego_min 0.04097582431549721 deviation-center-line_max 0.12791029264553877 deviation-center-line_mean 0.10518143804729678 deviation-center-line_min 0.06917252689874298 deviation-heading_max 0.4712184191829178 deviation-heading_mean 0.3828337640550056 deviation-heading_median 0.3636820162885191 deviation-heading_min 0.3257229985354382 driven_any_max 1.259664216011687 driven_any_mean 0.7702827269903463 driven_any_median 0.6642785413158997 driven_any_min 0.3059207793076624 driven_lanedir_consec_max 0.9402632878459154 driven_lanedir_consec_mean 0.5880385612453785 driven_lanedir_consec_min 0.2802213062291129 driven_lanedir_max 0.9402632878459154 driven_lanedir_mean 0.5880385612453785 driven_lanedir_median 0.5487126868955534 driven_lanedir_min 0.2802213062291129 in-drivable-lane_max 1.8499999999999936 in-drivable-lane_mean 0.559999999999998 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0590446751809168, "sim_physics": 0.011814632066866247, "survival_time": 4.099999999999993, "driven_lanedir": 0.5205812780744896, "sim_render-ego": 0.034180362050126235, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.04114834273733744, "deviation-heading": 0.4069710981449338, "set_robot_commands": 0.05148787614775867, "deviation-center-line": 0.105230017637756, "driven_lanedir_consec": 0.5205812780744896, "sim_compute_sim_state": 0.02232175629313399, "sim_compute_performance-ego": 0.03656776649195973, "sim_compute_robot_state-ego": 0.04050456896060851}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3059207793076624, "sim_physics": 0.010541741664593035, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2802213062291129, "sim_render-ego": 0.035202668263362005, "in-drivable-lane": 0, "agent_compute-ego": 0.041765845738924466, "deviation-heading": 0.3636820162885191, "set_robot_commands": 0.05049686248485859, "deviation-center-line": 0.06917252689874298, "driven_lanedir_consec": 0.2802213062291129, "sim_compute_sim_state": 0.024671114408052884, "sim_compute_performance-ego": 0.036135425934424766, "sim_compute_robot_state-ego": 0.0421753663283128}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6642785413158997, "sim_physics": 0.0105368583760363, "survival_time": 2.3499999999999996, "driven_lanedir": 0.6504142471818213, "sim_render-ego": 0.03479000355334992, "in-drivable-lane": 0, "agent_compute-ego": 0.04097582431549721, "deviation-heading": 0.34657428812321933, "set_robot_commands": 0.050651159692317885, "deviation-center-line": 0.12791029264553877, "driven_lanedir_consec": 0.6504142471818213, "sim_compute_sim_state": 0.02315370072709753, "sim_compute_performance-ego": 0.03675734743158868, "sim_compute_robot_state-ego": 0.04129575668497289}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.259664216011687, "sim_physics": 0.012383903775896344, "survival_time": 4.549999999999992, "driven_lanedir": 0.9402632878459154, "sim_render-ego": 0.03469682525802445, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.043048394905341854, "deviation-heading": 0.4712184191829178, "set_robot_commands": 0.05116311534420474, "deviation-center-line": 0.1131805740421762, "driven_lanedir_consec": 0.9402632878459154, "sim_compute_sim_state": 0.02339811901469807, "sim_compute_performance-ego": 0.036551632723965485, "sim_compute_robot_state-ego": 0.041535998438740826}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5625054231355648, "sim_physics": 0.01027322442908036, "survival_time": 1.900000000000001, "driven_lanedir": 0.5487126868955534, "sim_render-ego": 0.03508107913167853, "in-drivable-lane": 0, "agent_compute-ego": 0.04192906304409629, "deviation-heading": 0.3257229985354382, "set_robot_commands": 0.05067202919407895, "deviation-center-line": 0.11041377901227004, "driven_lanedir_consec": 0.5487126868955534, "sim_compute_sim_state": 0.022672069700140705, "sim_compute_performance-ego": 0.036115985167653936, "sim_compute_robot_state-ego": 0.0416173119294016}}set_robot_commands_max 0.05148787614775867 set_robot_commands_mean 0.05089420857264376 set_robot_commands_median 0.05067202919407895 set_robot_commands_min 0.05049686248485859 sim_compute_performance-ego_max 0.03675734743158868 sim_compute_performance-ego_mean 0.03642563154991852 sim_compute_performance-ego_median 0.036551632723965485 sim_compute_performance-ego_min 0.036115985167653936 sim_compute_robot_state-ego_max 0.0421753663283128 sim_compute_robot_state-ego_mean 0.041425800468407326 sim_compute_robot_state-ego_median 0.041535998438740826 sim_compute_robot_state-ego_min 0.04050456896060851 sim_compute_sim_state_max 0.024671114408052884 sim_compute_sim_state_mean 0.023243352028624636 sim_compute_sim_state_median 0.02315370072709753 sim_compute_sim_state_min 0.02232175629313399 sim_physics_max 0.012383903775896344 sim_physics_mean 0.011110072062494456 sim_physics_median 0.010541741664593035 sim_physics_min 0.01027322442908036 sim_render-ego_max 0.035202668263362005 sim_render-ego_mean 0.03479018765130822 sim_render-ego_median 0.03479000355334992 sim_render-ego_min 0.034180362050126235 simulation-passed 1 survival_time_max 4.549999999999992 survival_time_mean 2.839999999999997 survival_time_min 1.3000000000000005
No reset possible 18180
2852
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-validation
step1-simulation error no uberduck2
2019-04-18 15:13:17+00:00 2019-04-18 15:13:45+00:00 0:00:28 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18174
2831
Alexander Karavaev challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-18 15:09:16+00:00 2019-04-18 15:09:46+00:00 0:00:30 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18163
2823
Liam Paull 🇨🇦challenge-aido_LF-template-random aido2-LFV-sim-validation
step1-simulation success no uberduck2
2019-04-18 13:44:05+00:00 2019-04-18 13:49:10+00:00 0:05:05 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2342705027983982 survival_time_median 1.7500000000000009 deviation-center-line_median 0.10801953665034704 in-drivable-lane_median 0.7000000000000004
other stats agent_compute-ego_max 0.08899333166039508 agent_compute-ego_mean 0.08601553312463968 agent_compute-ego_median 0.08576604298182897 agent_compute-ego_min 0.08413670909020209 deviation-center-line_max 0.17768774509810673 deviation-center-line_mean 0.08758489727910898 deviation-center-line_min 0.019005533143064354 deviation-heading_max 0.759385645220147 deviation-heading_mean 0.3195081252333424 deviation-heading_median 0.1806788823983304 deviation-heading_min 0.118601117425238 driven_any_max 2.812198352312563 driven_any_mean 1.6891781761410722 driven_any_median 1.608242001486626 driven_any_min 0.3130680825984642 driven_lanedir_consec_max 1.7389031534183392 driven_lanedir_consec_mean 0.9694700664283822 driven_lanedir_consec_min 0.28316071129320397 driven_lanedir_max 1.7389031534183392 driven_lanedir_mean 0.9694700664283822 driven_lanedir_median 1.2342705027983982 driven_lanedir_min 0.28316071129320397 in-drivable-lane_max 1.5999999999999988 in-drivable-lane_mean 0.7299999999999995 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.014764879060828169, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.03436524971671726, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08899333166039508, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05064289466194485, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.02163269208825153, "sim_compute_performance-ego": 0.035947499067887016, "sim_compute_robot_state-ego": 0.04170811694601308, "sim_compute_robot_state-npc0": 0.03767297578894574, "sim_compute_robot_state-npc1": 0.036474445591802185, "sim_compute_robot_state-npc2": 0.03658063515372898, "sim_compute_robot_state-npc3": 0.03649252393971319}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.01728135539639381, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.03459252080609722, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.08413670909020209, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.0522885053388534, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.02214167194981729, "sim_compute_performance-ego": 0.03563720949234501, "sim_compute_robot_state-ego": 0.041979393651408535, "sim_compute_robot_state-npc0": 0.03778017720868511, "sim_compute_robot_state-npc1": 0.03761274968424151, "sim_compute_robot_state-npc2": 0.03716028505756009, "sim_compute_robot_state-npc3": 0.03789524878225019}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.01559608323233468, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.03523782321384975, "in-drivable-lane": 0, "agent_compute-ego": 0.08576604298182897, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.05055560384477888, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.021604095186506, "sim_compute_performance-ego": 0.03459194728306362, "sim_compute_robot_state-ego": 0.04230976104736328, "sim_compute_robot_state-npc0": 0.03695406232561384, "sim_compute_robot_state-npc1": 0.03916008131844657, "sim_compute_robot_state-npc2": 0.03655978611537388, "sim_compute_robot_state-npc3": 0.03825439725603376}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.014532177788870676, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.0354466370173863, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08454580307006836, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.05060359409877232, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.021875960486275808, "sim_compute_performance-ego": 0.03566808700561523, "sim_compute_robot_state-ego": 0.04241298948015485, "sim_compute_robot_state-npc0": 0.037980243137904574, "sim_compute_robot_state-npc1": 0.03777270998273577, "sim_compute_robot_state-npc2": 0.03709837368556431, "sim_compute_robot_state-npc3": 0.03812567847115653}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.01574841756669302, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03541715939839681, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.0866357788207039, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.050418142288450214, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.02235138605511378, "sim_compute_performance-ego": 0.03556686734396314, "sim_compute_robot_state-ego": 0.04252884123060438, "sim_compute_robot_state-npc0": 0.03800150704762292, "sim_compute_robot_state-npc1": 0.038265515887548056, "sim_compute_robot_state-npc2": 0.03780873994978647, "sim_compute_robot_state-npc3": 0.03881539995708163}}set_robot_commands_max 0.0522885053388534 set_robot_commands_mean 0.05090174804655993 set_robot_commands_median 0.05060359409877232 set_robot_commands_min 0.050418142288450214 sim_compute_performance-ego_max 0.035947499067887016 sim_compute_performance-ego_mean 0.0354823220385748 sim_compute_performance-ego_median 0.03563720949234501 sim_compute_performance-ego_min 0.03459194728306362 sim_compute_robot_state-ego_max 0.04252884123060438 sim_compute_robot_state-ego_mean 0.04218782047110882 sim_compute_robot_state-ego_median 0.04230976104736328 sim_compute_robot_state-ego_min 0.04170811694601308 sim_compute_robot_state-npc0_max 0.03800150704762292 sim_compute_robot_state-npc0_mean 0.03767779310175444 sim_compute_robot_state-npc0_median 0.03778017720868511 sim_compute_robot_state-npc0_min 0.03695406232561384 sim_compute_robot_state-npc1_max 0.03916008131844657 sim_compute_robot_state-npc1_mean 0.03785710049295482 sim_compute_robot_state-npc1_median 0.03777270998273577 sim_compute_robot_state-npc1_min 0.036474445591802185 sim_compute_robot_state-npc2_max 0.03780873994978647 sim_compute_robot_state-npc2_mean 0.03704156399240275 sim_compute_robot_state-npc2_median 0.03709837368556431 sim_compute_robot_state-npc2_min 0.03655978611537388 sim_compute_robot_state-npc3_max 0.03881539995708163 sim_compute_robot_state-npc3_mean 0.037916649681247055 sim_compute_robot_state-npc3_median 0.03812567847115653 sim_compute_robot_state-npc3_min 0.03649252393971319 sim_compute_sim_state_max 0.02235138605511378 sim_compute_sim_state_mean 0.02192116115319288 sim_compute_sim_state_median 0.021875960486275808 sim_compute_sim_state_min 0.021604095186506 sim_physics_max 0.01728135539639381 sim_physics_mean 0.015584582609024072 sim_physics_median 0.01559608323233468 sim_physics_min 0.014532177788870676 sim_render-ego_max 0.0354466370173863 sim_render-ego_mean 0.03501187803048947 sim_render-ego_median 0.03523782321384975 sim_render-ego_min 0.03436524971671726 simulation-passed 1 survival_time_max 3.149999999999997 survival_time_mean 1.899999999999999 survival_time_min 0.35
No reset possible 18148
2808
Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agent aido2-LFV-sim-testing
step1-simulation success no uberduck2
2019-04-18 12:41:06+00:00 2019-04-18 12:46:14+00:00 0:05:08 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 1.2342705027983982 survival_time_median 1.7500000000000009 deviation-center-line_median 0.10801953665034704 in-drivable-lane_median 0.7000000000000004
other stats agent_compute-ego_max 0.08666071684464165 agent_compute-ego_mean 0.08452497098772796 agent_compute-ego_median 0.08494278362819127 agent_compute-ego_min 0.08222549983433315 deviation-center-line_max 0.17768774509810673 deviation-center-line_mean 0.08758489727910898 deviation-center-line_min 0.019005533143064354 deviation-heading_max 0.759385645220147 deviation-heading_mean 0.3195081252333424 deviation-heading_median 0.1806788823983304 deviation-heading_min 0.118601117425238 driven_any_max 2.812198352312563 driven_any_mean 1.6891781761410722 driven_any_median 1.608242001486626 driven_any_min 0.3130680825984642 driven_lanedir_consec_max 1.7389031534183392 driven_lanedir_consec_mean 0.9694700664283822 driven_lanedir_consec_min 0.28316071129320397 driven_lanedir_max 1.7389031534183392 driven_lanedir_mean 0.9694700664283822 driven_lanedir_median 1.2342705027983982 driven_lanedir_min 0.28316071129320397 in-drivable-lane_max 1.5999999999999988 in-drivable-lane_mean 0.7299999999999995 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.956358012875939, "sim_physics": 0.014948171118031378, "survival_time": 1.1500000000000004, "driven_lanedir": 0.32939421125240065, "sim_render-ego": 0.0350567568903384, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.08666071684464165, "deviation-heading": 0.118601117425238, "set_robot_commands": 0.05176569067913553, "deviation-center-line": 0.02280708605632212, "driven_lanedir_consec": 0.32939421125240065, "sim_compute_sim_state": 0.021578228991964588, "sim_compute_performance-ego": 0.036398213842640754, "sim_compute_robot_state-ego": 0.04115191749904467, "sim_compute_robot_state-npc0": 0.03847350244936736, "sim_compute_robot_state-npc1": 0.03683167955149775, "sim_compute_robot_state-npc2": 0.03682860084201978, "sim_compute_robot_state-npc3": 0.03674717571424401}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.756024431431769, "sim_physics": 0.01723170280456543, "survival_time": 3.099999999999997, "driven_lanedir": 1.2342705027983982, "sim_render-ego": 0.03527683211911109, "in-drivable-lane": 1.5999999999999988, "agent_compute-ego": 0.08377363220337898, "deviation-heading": 0.4185133321358317, "set_robot_commands": 0.04973336958116101, "deviation-center-line": 0.11040458544770476, "driven_lanedir_consec": 1.2342705027983982, "sim_compute_sim_state": 0.02246917063190091, "sim_compute_performance-ego": 0.035289241421607234, "sim_compute_robot_state-ego": 0.04246312956656179, "sim_compute_robot_state-npc0": 0.03999678934774091, "sim_compute_robot_state-npc1": 0.03847676707852271, "sim_compute_robot_state-npc2": 0.037798004765664375, "sim_compute_robot_state-npc3": 0.03826552821743873}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3130680825984642, "sim_physics": 0.01633296694074358, "survival_time": 0.35, "driven_lanedir": 0.28316071129320397, "sim_render-ego": 0.03542733192443848, "in-drivable-lane": 0, "agent_compute-ego": 0.08494278362819127, "deviation-heading": 0.1203616489871648, "set_robot_commands": 0.050002949578421454, "deviation-center-line": 0.019005533143064354, "driven_lanedir_consec": 0.28316071129320397, "sim_compute_sim_state": 0.02193706376211984, "sim_compute_performance-ego": 0.034765379769461494, "sim_compute_robot_state-ego": 0.04229170935494559, "sim_compute_robot_state-npc0": 0.03708229746137347, "sim_compute_robot_state-npc1": 0.03872169767107282, "sim_compute_robot_state-npc2": 0.0392826965876988, "sim_compute_robot_state-npc3": 0.03710791042872837}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.608242001486626, "sim_physics": 0.014041239874703544, "survival_time": 1.7500000000000009, "driven_lanedir": 1.2616217533795693, "sim_render-ego": 0.03382927349635533, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.08222549983433315, "deviation-heading": 0.1806788823983304, "set_robot_commands": 0.04999258858816964, "deviation-center-line": 0.10801953665034704, "driven_lanedir_consec": 1.2616217533795693, "sim_compute_sim_state": 0.02090482030596052, "sim_compute_performance-ego": 0.033576222828456334, "sim_compute_robot_state-ego": 0.041680220195225305, "sim_compute_robot_state-npc0": 0.03598551750183106, "sim_compute_robot_state-npc1": 0.03778705596923828, "sim_compute_robot_state-npc2": 0.03619604110717774, "sim_compute_robot_state-npc3": 0.03820238794599261}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.812198352312563, "sim_physics": 0.01568503606887091, "survival_time": 3.149999999999997, "driven_lanedir": 1.7389031534183392, "sim_render-ego": 0.03536236853826614, "in-drivable-lane": 0.9999999999999982, "agent_compute-ego": 0.08502222242809478, "deviation-heading": 0.759385645220147, "set_robot_commands": 0.050084541714380655, "deviation-center-line": 0.17768774509810673, "driven_lanedir_consec": 1.7389031534183392, "sim_compute_sim_state": 0.02234031662108406, "sim_compute_performance-ego": 0.035475367591494604, "sim_compute_robot_state-ego": 0.041652092857966345, "sim_compute_robot_state-npc0": 0.03782932342044891, "sim_compute_robot_state-npc1": 0.03814348341926696, "sim_compute_robot_state-npc2": 0.03678824409605965, "sim_compute_robot_state-npc3": 0.03877670802767315}}set_robot_commands_max 0.05176569067913553 set_robot_commands_mean 0.05031582802825365 set_robot_commands_median 0.050002949578421454 set_robot_commands_min 0.04973336958116101 sim_compute_performance-ego_max 0.036398213842640754 sim_compute_performance-ego_mean 0.03510088509073209 sim_compute_performance-ego_median 0.035289241421607234 sim_compute_performance-ego_min 0.033576222828456334 sim_compute_robot_state-ego_max 0.04246312956656179 sim_compute_robot_state-ego_mean 0.04184781389474874 sim_compute_robot_state-ego_median 0.041680220195225305 sim_compute_robot_state-ego_min 0.04115191749904467 sim_compute_robot_state-npc0_max 0.03999678934774091 sim_compute_robot_state-npc0_mean 0.037873486036152336 sim_compute_robot_state-npc0_median 0.03782932342044891 sim_compute_robot_state-npc0_min 0.03598551750183106 sim_compute_robot_state-npc1_max 0.03872169767107282 sim_compute_robot_state-npc1_mean 0.0379921367379197 sim_compute_robot_state-npc1_median 0.03814348341926696 sim_compute_robot_state-npc1_min 0.03683167955149775 sim_compute_robot_state-npc2_max 0.0392826965876988 sim_compute_robot_state-npc2_mean 0.03737871747972407 sim_compute_robot_state-npc2_median 0.03682860084201978 sim_compute_robot_state-npc2_min 0.03619604110717774 sim_compute_robot_state-npc3_max 0.03877670802767315 sim_compute_robot_state-npc3_mean 0.03781994206681537 sim_compute_robot_state-npc3_median 0.03820238794599261 sim_compute_robot_state-npc3_min 0.03674717571424401 sim_compute_sim_state_max 0.02246917063190091 sim_compute_sim_state_mean 0.021845920062605988 sim_compute_sim_state_median 0.02193706376211984 sim_compute_sim_state_min 0.02090482030596052 sim_physics_max 0.01723170280456543 sim_physics_mean 0.015647823361382967 sim_physics_median 0.01568503606887091 sim_physics_min 0.014041239874703544 sim_render-ego_max 0.03542733192443848 sim_render-ego_mean 0.03499051259370189 sim_render-ego_median 0.03527683211911109 sim_render-ego_min 0.03382927349635533 simulation-passed 1 survival_time_max 3.149999999999997 survival_time_mean 1.899999999999999 survival_time_min 0.35
No reset possible 18146
2801
Shashank Gaur PredictorLast aido2-PRED
step1-simulation success no uberduck2
2019-04-18 12:14:43+00:00 2019-04-18 12:15:00+00:00 0:00:17 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.11297188159524908 error_L2 0.01955287129142203
No reset possible 18145
2799
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFVI-sim-testing
step1-simulation error no uberduck2
2019-04-18 10:21:41+00:00 2019-04-18 10:42:12+00:00 0:20:31 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18141
2796
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-validation
step1-simulation error no uberduck2
2019-04-18 10:00:39+00:00 2019-04-18 10:21:14+00:00 0:20:35 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18137
2788
Andrea Daniele 🇮🇹PredictorLast aido2-PRED
step1-simulation success no uberduck2
2019-04-18 02:44:46+00:00 2019-04-18 02:45:08+00:00 0:00:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L1 0.1013581716957429 error_L2 0.01631854003110063
No reset possible 18136
2742
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LF-sim-testing
step1-simulation error no uberduck2
2019-04-17 23:59:14+00:00 2019-04-18 00:19:47+00:00 0:20:33 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18133
2746
Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietown aido2-LFV-sim-testing
step1-simulation error no uberduck2
2019-04-17 23:38:10+00:00 2019-04-17 23:58:44+00:00 0:20:34 Waited 1204 seconds [...] Waited 1204 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18130
2755
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validation
step1-simulation success no uberduck2
2019-04-17 23:35:08+00:00 2019-04-17 23:37:32+00:00 0:02:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.2448526305955787 survival_time_median 1.0000000000000002 deviation-center-line_median 0.02780958695734228 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.047244983060019355 agent_compute-ego_mean 0.04339400237089381 agent_compute-ego_median 0.042951036902034986 agent_compute-ego_min 0.04082818031311035 deviation-center-line_max 0.1367821583469593 deviation-center-line_mean 0.05703771312424479 deviation-center-line_min 0.019515313732513393 deviation-heading_max 0.6295143987792061 deviation-heading_mean 0.33854872313755296 deviation-heading_median 0.30747603818653535 deviation-heading_min 0.1699364276466551 driven_any_max 0.9094890302704564 driven_any_mean 0.614817253072296 driven_any_median 0.5457640496143875 driven_any_min 0.3022738981004904 driven_lanedir_consec_max 0.7972872880234139 driven_lanedir_consec_mean 0.4211895144689454 driven_lanedir_consec_min 0.1644714808652381 driven_lanedir_max 0.7972872880234139 driven_lanedir_mean 0.42291373507306657 driven_lanedir_median 0.2448526305955787 driven_lanedir_min 0.1644714808652381 in-drivable-lane_max 0.6500000000000002 in-drivable-lane_mean 0.2500000000000001 in-drivable-lane_min 0.04999999999999999 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.008108055591583252, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.03473960161209107, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.042741703987121585, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.05161501169204712, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.02367655038833618, "sim_compute_performance-ego": 0.0369950532913208, "sim_compute_robot_state-ego": 0.04174284934997559}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126885, "sim_physics": 0.008562873391544117, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120271352061035, "sim_render-ego": 0.03500669142779182, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.042951036902034986, "deviation-heading": 0.30747603818653535, "set_robot_commands": 0.05087936625761144, "deviation-center-line": 0.023999233443120993, "driven_lanedir_consec": 0.17258161050000476, "sim_compute_sim_state": 0.023093083325554344, "sim_compute_performance-ego": 0.036574265536139995, "sim_compute_robot_state-ego": 0.04087610805735869}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3022738981004904, "sim_physics": 0.00859534740447998, "survival_time": 0.49999999999999994, "driven_lanedir": 0.2448526305955787, "sim_render-ego": 0.034009909629821776, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04082818031311035, "deviation-heading": 0.1699364276466551, "set_robot_commands": 0.05102338790893555, "deviation-center-line": 0.02780958695734228, "driven_lanedir_consec": 0.2448526305955787, "sim_compute_sim_state": 0.023114585876464845, "sim_compute_performance-ego": 0.03654313087463379, "sim_compute_robot_state-ego": 0.041907882690429686}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.00930171353476388, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.0354546138218471, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.047244983060019355, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.05154939208711896, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.023301848343440464, "sim_compute_performance-ego": 0.03720407826559884, "sim_compute_robot_state-ego": 0.04198301689965384}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704564, "sim_physics": 0.008466628289991809, "survival_time": 1.5500000000000007, "driven_lanedir": 0.7972872880234139, "sim_render-ego": 0.03664898103283298, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.043204107592182774, "deviation-heading": 0.6295143987792061, "set_robot_commands": 0.05161593806359076, "deviation-center-line": 0.1367821583469593, "driven_lanedir_consec": 0.7972872880234139, "sim_compute_sim_state": 0.023053507651052168, "sim_compute_performance-ego": 0.03653575528052545, "sim_compute_robot_state-ego": 0.041985450252409906}}set_robot_commands_max 0.05161593806359076 set_robot_commands_mean 0.05133661920186077 set_robot_commands_median 0.05154939208711896 set_robot_commands_min 0.05087936625761144 sim_compute_performance-ego_max 0.03720407826559884 sim_compute_performance-ego_mean 0.036770456649643776 sim_compute_performance-ego_median 0.036574265536139995 sim_compute_performance-ego_min 0.03653575528052545 sim_compute_robot_state-ego_max 0.041985450252409906 sim_compute_robot_state-ego_mean 0.04169906144996554 sim_compute_robot_state-ego_median 0.041907882690429686 sim_compute_robot_state-ego_min 0.04087610805735869 sim_compute_sim_state_max 0.02367655038833618 sim_compute_sim_state_mean 0.0232479151169696 sim_compute_sim_state_median 0.023114585876464845 sim_compute_sim_state_min 0.023053507651052168 sim_physics_max 0.00930171353476388 sim_physics_mean 0.008606923642472609 sim_physics_median 0.008562873391544117 sim_physics_min 0.008108055591583252 sim_render-ego_max 0.03664898103283298 sim_render-ego_mean 0.03517195950487695 sim_render-ego_median 0.03500669142779182 sim_render-ego_min 0.034009909629821776 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.0600000000000005 survival_time_min 0.49999999999999994
No reset possible 18129
2758
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-testing
step1-simulation success no uberduck2
2019-04-17 23:31:24+00:00 2019-04-17 23:35:01+00:00 0:03:37 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.24485310743273692 survival_time_median 1.0000000000000002 deviation-center-line_median 0.02780957766589444 in-drivable-lane_median 0.05000000000000005
other stats agent_compute-ego_max 0.04472272396087647 agent_compute-ego_mean 0.0425902136776563 agent_compute-ego_median 0.042178237438201906 agent_compute-ego_min 0.041349691503188186 deviation-center-line_max 0.1367821242164622 deviation-center-line_mean 0.05703768142247749 deviation-center-line_min 0.019515313732513393 deviation-heading_max 0.6295143987792059 deviation-heading_mean 0.33854872313755296 deviation-heading_median 0.3074760381865352 deviation-heading_min 0.16993642764665506 driven_any_max 0.9094890302704578 driven_any_mean 0.6148172530722962 driven_any_median 0.5457640496143875 driven_any_min 0.30227389810048894 driven_lanedir_consec_max 0.797287526441987 driven_lanedir_consec_mean 0.4211897171247365 driven_lanedir_consec_min 0.1644714808652381 driven_lanedir_max 0.797287526441987 driven_lanedir_mean 0.4229139258079286 driven_lanedir_median 0.24485310743273692 driven_lanedir_min 0.1644714808652381 in-drivable-lane_max 0.6500000000000002 in-drivable-lane_mean 0.2500000000000001 in-drivable-lane_min 0.04999999999999999 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5457640496143875, "sim_physics": 0.0145766019821167, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1644714808652381, "sim_render-ego": 0.036591196060180665, "in-drivable-lane": 0.6500000000000002, "agent_compute-ego": 0.042178237438201906, "deviation-heading": 0.1875820425785475, "set_robot_commands": 0.05125304460525513, "deviation-center-line": 0.019515313732513393, "driven_lanedir_consec": 0.1644714808652381, "sim_compute_sim_state": 0.022764420509338378, "sim_compute_performance-ego": 0.03795170783996582, "sim_compute_robot_state-ego": 0.04225994348526001, "sim_compute_robot_state-npc0": 0.04099259376525879, "sim_compute_robot_state-npc1": 0.04049006700515747, "sim_compute_robot_state-npc2": 0.038893723487854005, "sim_compute_robot_state-npc3": 0.03974690437316895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5108934139126896, "sim_physics": 0.01690383518443388, "survival_time": 0.8500000000000002, "driven_lanedir": 0.18120295193918956, "sim_render-ego": 0.03500001570757698, "in-drivable-lane": 0.4500000000000001, "agent_compute-ego": 0.041349691503188186, "deviation-heading": 0.3074760381865352, "set_robot_commands": 0.05036598093369428, "deviation-center-line": 0.02399911835622947, "driven_lanedir_consec": 0.17258190852322874, "sim_compute_sim_state": 0.022292543860042795, "sim_compute_performance-ego": 0.0364685339086196, "sim_compute_robot_state-ego": 0.04217698994804831, "sim_compute_robot_state-npc0": 0.038942912045647114, "sim_compute_robot_state-npc1": 0.038898496066822726, "sim_compute_robot_state-npc2": 0.03783291928908404, "sim_compute_robot_state-npc3": 0.038478542776668775}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.30227389810048894, "sim_physics": 0.016798019409179688, "survival_time": 0.49999999999999994, "driven_lanedir": 0.24485310743273692, "sim_render-ego": 0.0363661527633667, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.04472272396087647, "deviation-heading": 0.16993642764665506, "set_robot_commands": 0.052027106285095215, "deviation-center-line": 0.02780957766589444, "driven_lanedir_consec": 0.24485310743273692, "sim_compute_sim_state": 0.023671436309814452, "sim_compute_performance-ego": 0.03808636665344238, "sim_compute_robot_state-ego": 0.04387176036834717, "sim_compute_robot_state-npc0": 0.03936722278594971, "sim_compute_robot_state-npc1": 0.04065251350402832, "sim_compute_robot_state-npc2": 0.03985261917114258, "sim_compute_robot_state-npc3": 0.04063661098480224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.8056658734634567, "sim_physics": 0.016529483454568044, "survival_time": 1.4000000000000006, "driven_lanedir": 0.7267545623604916, "sim_render-ego": 0.03612490211214338, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.042610807078225274, "deviation-heading": 0.3982347084968211, "set_robot_commands": 0.05068013497761318, "deviation-center-line": 0.07708227314128799, "driven_lanedir_consec": 0.7267545623604916, "sim_compute_sim_state": 0.0226175103868757, "sim_compute_performance-ego": 0.035863595349448066, "sim_compute_robot_state-ego": 0.043051106589181085, "sim_compute_robot_state-npc0": 0.03895382370267596, "sim_compute_robot_state-npc1": 0.03984720366341727, "sim_compute_robot_state-npc2": 0.037811279296875, "sim_compute_robot_state-npc3": 0.03892222472599575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9094890302704578, "sim_physics": 0.014953413317280432, "survival_time": 1.5500000000000007, "driven_lanedir": 0.797287526441987, "sim_render-ego": 0.0364614148293772, "in-drivable-lane": 0.04999999999999999, "agent_compute-ego": 0.042089608407789664, "deviation-heading": 0.6295143987792059, "set_robot_commands": 0.05184868843324723, "deviation-center-line": 0.1367821242164622, "driven_lanedir_consec": 0.797287526441987, "sim_compute_sim_state": 0.022661770543744488, "sim_compute_performance-ego": 0.03820063990931357, "sim_compute_robot_state-ego": 0.04392560835807554, "sim_compute_robot_state-npc0": 0.0401264698274674, "sim_compute_robot_state-npc1": 0.03981204955808578, "sim_compute_robot_state-npc2": 0.03968522625584756, "sim_compute_robot_state-npc3": 0.03909463267172537}}set_robot_commands_max 0.052027106285095215 set_robot_commands_mean 0.051234991046981 set_robot_commands_median 0.05125304460525513 set_robot_commands_min 0.05036598093369428 sim_compute_performance-ego_max 0.03820063990931357 sim_compute_performance-ego_mean 0.037314168732157885 sim_compute_performance-ego_median 0.03795170783996582 sim_compute_performance-ego_min 0.035863595349448066 sim_compute_robot_state-ego_max 0.04392560835807554 sim_compute_robot_state-ego_mean 0.04305708174978243 sim_compute_robot_state-ego_median 0.043051106589181085 sim_compute_robot_state-ego_min 0.04217698994804831 sim_compute_robot_state-npc0_max 0.04099259376525879 sim_compute_robot_state-npc0_mean 0.03967660442539979 sim_compute_robot_state-npc0_median 0.03936722278594971 sim_compute_robot_state-npc0_min 0.038942912045647114 sim_compute_robot_state-npc1_max 0.04065251350402832 sim_compute_robot_state-npc1_mean 0.039940065959502315 sim_compute_robot_state-npc1_median 0.03984720366341727 sim_compute_robot_state-npc1_min 0.038898496066822726 sim_compute_robot_state-npc2_max 0.03985261917114258 sim_compute_robot_state-npc2_mean 0.03881515350016064 sim_compute_robot_state-npc2_median 0.038893723487854005 sim_compute_robot_state-npc2_min 0.037811279296875 sim_compute_robot_state-npc3_max 0.04063661098480224 sim_compute_robot_state-npc3_mean 0.03937578310647222 sim_compute_robot_state-npc3_median 0.03909463267172537 sim_compute_robot_state-npc3_min 0.038478542776668775 sim_compute_sim_state_max 0.023671436309814452 sim_compute_sim_state_mean 0.02280153632196316 sim_compute_sim_state_median 0.022661770543744488 sim_compute_sim_state_min 0.022292543860042795 sim_physics_max 0.01690383518443388 sim_physics_mean 0.01595227066951575 sim_physics_median 0.016529483454568044 sim_physics_min 0.0145766019821167 sim_render-ego_max 0.036591196060180665 sim_render-ego_mean 0.03610873629452899 sim_render-ego_median 0.0363661527633667 sim_render-ego_min 0.03500001570757698 simulation-passed 1 survival_time_max 1.5500000000000007 survival_time_mean 1.0600000000000005 survival_time_min 0.49999999999999994
No reset possible 18128
2759
Bhairav Mehta challenge-aido_LF-template-ros - Template solution using ROS aido2-LFV-sim-validation
step1-simulation host-error no uberduck2
2019-04-17 23:30:07+00:00 2019-04-17 23:31:01+00:00 0:00:54 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
write_logs(wd, project, services=config['services'])
File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
container_id = get_id_for_service(wd, project, service)
File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
o = run_docker(wd, project, cmd, get_output=True)
File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']:
> Command '['docker-compose', '-p', 'job18128-704807', 'ps', '-q', 'solution']' returned non-zero exit status 1.
stdout |
stderr |
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18127
2779
Rami Al-Naim 🇷🇺challenge-aido_LF-template-ros - Template solution using ROS aido2-LF-sim-validation
step1-simulation error no uberduck2
2019-04-17 23:29:31+00:00 2019-04-17 23:30:01+00:00 0:00:30 The container "solut [...] The container "solution" exited with code 1.
Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible