Evaluator 842

step1-simulation

success

2019-05-06 17:00:27+00:00

2019-05-06 17:13:27+00:00

0:13:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0680135678207798
survival_time_median	4.94999999999999
deviation-center-line_median	0.3683836422073795
in-drivable-lane_median	1.500000000000021

other stats

agent_compute-ego_max	0.3343187808990479
agent_compute-ego_mean	0.2962315481524593
agent_compute-ego_median	0.30255850878628815
agent_compute-ego_min	0.2218819519258895
deviation-center-line_max	1.1349797934935273
deviation-center-line_mean	0.5638768299737152
deviation-center-line_min	0.27597475388666126
deviation-heading_max	3.1082652497814784
deviation-heading_mean	1.697890568178956
deviation-heading_median	1.1832497626511975
deviation-heading_min	0.32972855907377124
driven_any_max	3.5630330512904034
driven_any_mean	1.7796595284760968
driven_any_median	1.128961384917068
driven_any_min	0.5664764208093115
driven_lanedir_consec_max	2.7889961194637634
driven_lanedir_consec_mean	1.4196399712756496
driven_lanedir_consec_min	0.561874652087262
driven_lanedir_max	2.7889961194637634
driven_lanedir_mean	1.4196399712756496
driven_lanedir_median	1.0680135678207798
driven_lanedir_min	0.561874652087262
in-drivable-lane_max	2.550000000000036
in-drivable-lane_mean	1.1300000000000103
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.5630330512904034, "sim_physics": 0.08314438899358113, "survival_time": 14.950000000000076, "driven_lanedir": 2.7889961194637634, "sim_render-ego": 0.04782614231109619, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.30022245248158774, "deviation-heading": 3.1082652497814784, "set_robot_commands": 0.07357827583948771, "deviation-center-line": 1.1349797934935273, "driven_lanedir_consec": 2.7889961194637634, "sim_compute_sim_state": 0.03038559277852376, "sim_compute_performance-ego": 0.05186926921208699, "sim_compute_robot_state-ego": 0.055774827003479}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.128961384917068, "sim_physics": 0.08031153678894043, "survival_time": 4.94999999999999, "driven_lanedir": 0.6693688100075108, "sim_render-ego": 0.04569161781156906, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.30255850878628815, "deviation-heading": 1.1832497626511975, "set_robot_commands": 0.07612153014751395, "deviation-center-line": 0.27597475388666126, "driven_lanedir_consec": 0.6693688100075108, "sim_compute_sim_state": 0.029841476016574435, "sim_compute_performance-ego": 0.0512952371077104, "sim_compute_robot_state-ego": 0.05538118006003023}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5664764208093115, "sim_physics": 0.08411186146286298, "survival_time": 2.6499999999999986, "driven_lanedir": 0.561874652087262, "sim_render-ego": 0.047781525917772974, "in-drivable-lane": 0, "agent_compute-ego": 0.2218819519258895, "deviation-heading": 0.32972855907377124, "set_robot_commands": 0.074415589278599, "deviation-center-line": 0.2841231133794584, "driven_lanedir_consec": 0.561874652087262, "sim_compute_sim_state": 0.031495913019720115, "sim_compute_performance-ego": 0.053112947715903226, "sim_compute_robot_state-ego": 0.05706152376138939}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0923230180312424, "sim_physics": 0.08621070037285487, "survival_time": 4.799999999999991, "driven_lanedir": 1.0680135678207798, "sim_render-ego": 0.04839677611986796, "in-drivable-lane": 0, "agent_compute-ego": 0.3221760466694832, "deviation-heading": 0.9288944234322016, "set_robot_commands": 0.07596710572640102, "deviation-center-line": 0.3683836422073795, "driven_lanedir_consec": 1.0680135678207798, "sim_compute_sim_state": 0.032510834435621895, "sim_compute_performance-ego": 0.055921249091625214, "sim_compute_robot_state-ego": 0.05890559405088425}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.5475037673324583, "sim_physics": 0.08380869931952897, "survival_time": 10.750000000000018, "driven_lanedir": 2.0099467069989316, "sim_render-ego": 0.047151333786720456, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.3343187808990479, "deviation-heading": 2.9393148459561305, "set_robot_commands": 0.07415289435275765, "deviation-center-line": 0.7559228469015499, "driven_lanedir_consec": 2.0099467069989316, "sim_compute_sim_state": 0.03049984310948571, "sim_compute_performance-ego": 0.05266198003014853, "sim_compute_robot_state-ego": 0.05679712406424589}}
set_robot_commands_max	0.07612153014751395
set_robot_commands_mean	0.07484707906895187
set_robot_commands_median	0.074415589278599
set_robot_commands_min	0.07357827583948771
sim_compute_performance-ego_max	0.055921249091625214
sim_compute_performance-ego_mean	0.05297213663149487
sim_compute_performance-ego_median	0.05266198003014853
sim_compute_performance-ego_min	0.0512952371077104
sim_compute_robot_state-ego_max	0.05890559405088425
sim_compute_robot_state-ego_mean	0.056784049788005754
sim_compute_robot_state-ego_median	0.05679712406424589
sim_compute_robot_state-ego_min	0.05538118006003023
sim_compute_sim_state_max	0.032510834435621895
sim_compute_sim_state_mean	0.030946731871985184
sim_compute_sim_state_median	0.03049984310948571
sim_compute_sim_state_min	0.029841476016574435
sim_physics_max	0.08621070037285487
sim_physics_mean	0.08351743738755368
sim_physics_median	0.08380869931952897
sim_physics_min	0.08031153678894043
sim_render-ego_max	0.04839677611986796
sim_render-ego_mean	0.04736947918940533
sim_render-ego_median	0.047781525917772974
sim_render-ego_min	0.04569161781156906
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.620000000000016
survival_time_min	2.6499999999999986

No reset possible

21560

3222

jiang peng

First test - TH

step1-simulation

success

2019-05-06 12:10:59+00:00

2019-05-06 12:42:35+00:00

0:31:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.3903952486006377
survival_time_median	14.950000000000076
deviation-center-line_median	0.7876424140923896
in-drivable-lane_median	4.350000000000029

other stats

agent_compute-ego_max	0.1853775080045064
agent_compute-ego_mean	0.1387206686337789
agent_compute-ego_median	0.13387651920318602
agent_compute-ego_min	0.10176790237426758
deviation-center-line_max	1.1089618863539743
deviation-center-line_mean	0.7236539270307375
deviation-center-line_min	0.12189823640240537
deviation-heading_max	2.6798544797767136
deviation-heading_mean	1.8554640801343136
deviation-heading_median	1.813063813943972
deviation-heading_min	0.8733846787780724
driven_any_max	4.830622662871687
driven_any_mean	3.741227171003166
driven_any_median	4.241756988795457
driven_any_min	0.9364853111574668
driven_lanedir_consec_max	4.166108115734953
driven_lanedir_consec_mean	3.0936491553625416
driven_lanedir_consec_min	0.6723264629355483
driven_lanedir_max	4.166704031424452
driven_lanedir_mean	3.093820291078193
driven_lanedir_median	3.390442213231158
driven_lanedir_min	0.6723264629355483
in-drivable-lane_max	12.950000000000076
in-drivable-lane_mean	4.6500000000000385
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 4.466629575353458, "sim_physics": 0.2055821919441223, "survival_time": 14.950000000000076, "driven_lanedir": 4.101010161279188, "sim_render-ego": 0.06556045373280843, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.1853775080045064, "deviation-heading": 2.6798544797767136, "set_robot_commands": 0.10184484640757242, "deviation-center-line": 0.9459651254986212, "driven_lanedir_consec": 4.100811767536554, "sim_compute_sim_state": 0.04123680830001831, "sim_compute_performance-ego": 0.07185652812321981, "sim_compute_robot_state-ego": 0.0803344448407491, "sim_compute_robot_state-npc0": 0.07222453196843465, "sim_compute_robot_state-npc1": 0.07278468688329061, "sim_compute_robot_state-npc2": 0.07298268715540568, "sim_compute_robot_state-npc3": 0.07405609925587972}, "udem1-1-0": {"driven_any": 0.9364853111574668, "sim_physics": 0.1651355250676473, "survival_time": 14.950000000000076, "driven_lanedir": 0.6723264629355483, "sim_render-ego": 0.05564653635025024, "in-drivable-lane": 12.950000000000076, "agent_compute-ego": 0.1543426235516866, "deviation-heading": 0.8733846787780724, "set_robot_commands": 0.08342733065287272, "deviation-center-line": 0.12189823640240537, "driven_lanedir_consec": 0.6723264629355483, "sim_compute_sim_state": 0.034971686204274495, "sim_compute_performance-ego": 0.06140010356903077, "sim_compute_robot_state-ego": 0.06489941676457724, "sim_compute_robot_state-npc0": 0.062154242992401125, "sim_compute_robot_state-npc1": 0.061951061884562175, "sim_compute_robot_state-npc2": 0.06100709676742554, "sim_compute_robot_state-npc3": 0.06097111066182454}, "udem1-2-0": {"driven_any": 4.241756988795457, "sim_physics": 0.16097631057103476, "survival_time": 14.950000000000076, "driven_lanedir": 3.13861858652062, "sim_render-ego": 0.04964434067408244, "in-drivable-lane": 5.4500000000000774, "agent_compute-ego": 0.13387651920318602, "deviation-heading": 1.813063813943972, "set_robot_commands": 0.0736589519182841, "deviation-center-line": 0.7876424140923896, "driven_lanedir_consec": 3.1386041820050146, "sim_compute_sim_state": 0.03092505693435669, "sim_compute_performance-ego": 0.05456504901250203, "sim_compute_robot_state-ego": 0.05801790634791056, "sim_compute_robot_state-npc0": 0.05515061616897583, "sim_compute_robot_state-npc1": 0.05532469352086385, "sim_compute_robot_state-npc2": 0.05464129447937012, "sim_compute_robot_state-npc3": 0.05455218076705933}, "udem1-3-0": {"driven_any": 4.830622662871687, "sim_physics": 0.1313967784245809, "survival_time": 14.950000000000076, "driven_lanedir": 3.390442213231158, "sim_render-ego": 0.04309743483861288, "in-drivable-lane": 4.350000000000029, "agent_compute-ego": 0.1182387900352478, "deviation-heading": 1.4669959486270103, "set_robot_commands": 0.06541617314020792, "deviation-center-line": 1.1089618863539743, "driven_lanedir_consec": 3.3903952486006377, "sim_compute_sim_state": 0.026693034966786704, "sim_compute_performance-ego": 0.04606579462687174, "sim_compute_robot_state-ego": 0.04939404487609864, "sim_compute_robot_state-npc0": 0.04769868453343709, "sim_compute_robot_state-npc1": 0.04707680861155192, "sim_compute_robot_state-npc2": 0.046784504254659014, "sim_compute_robot_state-npc3": 0.0485214630762736}, "udem1-4-0": {"driven_any": 4.2306413168377635, "sim_physics": 0.10879195928573608, "survival_time": 14.950000000000076, "driven_lanedir": 4.166704031424452, "sim_render-ego": 0.037006388505299886, "in-drivable-lane": 0, "agent_compute-ego": 0.10176790237426758, "deviation-heading": 2.4440214795457975, "set_robot_commands": 0.0571710475285848, "deviation-center-line": 0.6538019728062974, "driven_lanedir_consec": 4.166108115734953, "sim_compute_sim_state": 0.023223926226298017, "sim_compute_performance-ego": 0.03995807886123657, "sim_compute_robot_state-ego": 0.04224366346995036, "sim_compute_robot_state-npc0": 0.0417777959505717, "sim_compute_robot_state-npc1": 0.04101636966069539, "sim_compute_robot_state-npc2": 0.04065407673517863, "sim_compute_robot_state-npc3": 0.040775802135467526}}
set_robot_commands_max	0.10184484640757242
set_robot_commands_mean	0.0763036699295044
set_robot_commands_median	0.0736589519182841
set_robot_commands_min	0.0571710475285848
sim_compute_performance-ego_max	0.07185652812321981
sim_compute_performance-ego_mean	0.05476911083857219
sim_compute_performance-ego_median	0.05456504901250203
sim_compute_performance-ego_min	0.03995807886123657
sim_compute_robot_state-ego_max	0.0803344448407491
sim_compute_robot_state-ego_mean	0.05897789525985717
sim_compute_robot_state-ego_median	0.05801790634791056
sim_compute_robot_state-ego_min	0.04224366346995036
sim_compute_robot_state-npc0_max	0.07222453196843465
sim_compute_robot_state-npc0_mean	0.05580117432276408
sim_compute_robot_state-npc0_median	0.05515061616897583
sim_compute_robot_state-npc0_min	0.0417777959505717
sim_compute_robot_state-npc1_max	0.07278468688329061
sim_compute_robot_state-npc1_mean	0.05563072411219279
sim_compute_robot_state-npc1_median	0.05532469352086385
sim_compute_robot_state-npc1_min	0.04101636966069539
sim_compute_robot_state-npc2_max	0.07298268715540568
sim_compute_robot_state-npc2_mean	0.0552139318784078
sim_compute_robot_state-npc2_median	0.05464129447937012
sim_compute_robot_state-npc2_min	0.04065407673517863
sim_compute_robot_state-npc3_max	0.07405609925587972
sim_compute_robot_state-npc3_mean	0.05577533117930093
sim_compute_robot_state-npc3_median	0.05455218076705933
sim_compute_robot_state-npc3_min	0.040775802135467526
sim_compute_sim_state_max	0.04123680830001831
sim_compute_sim_state_mean	0.03141010252634684
sim_compute_sim_state_median	0.03092505693435669
sim_compute_sim_state_min	0.023223926226298017
sim_physics_max	0.2055821919441223
sim_physics_mean	0.15437655305862424
sim_physics_median	0.16097631057103476
sim_physics_min	0.10879195928573608
sim_render-ego_max	0.06556045373280843
sim_render-ego_mean	0.05019103082021077
sim_render-ego_median	0.04964434067408244
sim_render-ego_min	0.037006388505299886
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21517

3204

Masaya Kambara 🇯🇵

challenge-aido_LF-template-random

step1-simulation

success

2019-05-06 05:00:53+00:00

2019-05-06 05:11:20+00:00

0:10:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.09603425979614258
agent_compute-ego_mean	0.09157510121107044
agent_compute-ego_median	0.09152567386627196
agent_compute-ego_min	0.08956567446390788
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.06028105594493725, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03714792375211363, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.09268471488246212, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.057189106941223145, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.024078342649671767, "sim_compute_performance-ego": 0.0413112861138803, "sim_compute_robot_state-ego": 0.04270352257622613}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.06088775746962603, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.036827835382199754, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09044202636269962, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0565495257284127, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.02419285680733475, "sim_compute_performance-ego": 0.0402828712089389, "sim_compute_robot_state-ego": 0.04288430774913115}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06207731190849753, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03645431294160731, "in-drivable-lane": 0, "agent_compute-ego": 0.08959061959210564, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.056779005948235005, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02436511656817268, "sim_compute_performance-ego": 0.039741347817813646, "sim_compute_robot_state-ego": 0.042866482454187727}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0663947582244873, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03755213737487793, "in-drivable-lane": 0, "agent_compute-ego": 0.09603425979614258, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.055624685287475585, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02354006767272949, "sim_compute_performance-ego": 0.04004095077514649, "sim_compute_robot_state-ego": 0.04229480743408203}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.057146021082431456, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03698096094252188, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.09047793738449676, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05624779266647146, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02389717403846451, "sim_compute_performance-ego": 0.04002947746952878, "sim_compute_robot_state-ego": 0.042632812186132504}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.055976755765019634, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.037630689387418786, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.09126841292089344, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.056103463075598894, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02430957677413006, "sim_compute_performance-ego": 0.039469714067420184, "sim_compute_robot_state-ego": 0.0422928625223588}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.05842812997954233, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03754775013242449, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.09226085884230475, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.05833879113197327, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.024014204740524292, "sim_compute_performance-ego": 0.04036504030227661, "sim_compute_robot_state-ego": 0.041880909885678975}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.06236445336114792, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.03666558719816662, "in-drivable-lane": 0, "agent_compute-ego": 0.09078347115289598, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.056014208566574825, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.024242264883858815, "sim_compute_performance-ego": 0.03974155017307827, "sim_compute_robot_state-ego": 0.04293090956551688}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.060666161068415235, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03749299857576015, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.09198476096331062, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.05599969928547487, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.023980977171558445, "sim_compute_performance-ego": 0.040108361486661234, "sim_compute_robot_state-ego": 0.04322987491801634}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.06493770425969904, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03730079477483576, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.0923023917458274, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05578025471080433, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.02442038275978782, "sim_compute_performance-ego": 0.04036344614895907, "sim_compute_robot_state-ego": 0.042182120409878815}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.0670447504365599, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.03732230136920879, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.0914310665873738, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.055620215155861595, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.02387996463032512, "sim_compute_performance-ego": 0.04034573071962827, "sim_compute_robot_state-ego": 0.04290287215988357}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06699259792055402, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03815792288099017, "in-drivable-lane": 0, "agent_compute-ego": 0.0916455558368138, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.055757922785622735, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.023724113191877092, "sim_compute_performance-ego": 0.04097156013761248, "sim_compute_robot_state-ego": 0.042869550841195245}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.05893662396599265, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03658562080532897, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.0916290937685499, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.055756082721785005, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.02384556976019167, "sim_compute_performance-ego": 0.03916002722347483, "sim_compute_robot_state-ego": 0.04276625315348307}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.06252879566616482, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.036243323926572445, "in-drivable-lane": 0, "agent_compute-ego": 0.08956567446390788, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.05504154275964807, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.023728414818092628, "sim_compute_performance-ego": 0.03959319326612684, "sim_compute_robot_state-ego": 0.04201938487865307}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05903942678488937, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03692280544954188, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09152567386627196, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.055615993107066435, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02419739377264883, "sim_compute_performance-ego": 0.04010614928077249, "sim_compute_robot_state-ego": 0.04242530289818259}}
set_robot_commands_max	0.05833879113197327
set_robot_commands_mean	0.056161219324815194
set_robot_commands_median	0.05599969928547487
set_robot_commands_min	0.05504154275964807
sim_compute_performance-ego_max	0.0413112861138803
sim_compute_performance-ego_mean	0.0401087137460879
sim_compute_performance-ego_median	0.04010614928077249
sim_compute_performance-ego_min	0.03916002722347483
sim_compute_robot_state-ego_max	0.04322987491801634
sim_compute_robot_state-ego_mean	0.04259213157550712
sim_compute_robot_state-ego_median	0.04270352257622613
sim_compute_robot_state-ego_min	0.041880909885678975
sim_compute_sim_state_max	0.02442038275978782
sim_compute_sim_state_mean	0.0240277613492912
sim_compute_sim_state_median	0.024014204740524292
sim_compute_sim_state_min	0.02354006767272949
sim_physics_max	0.0670447504365599
sim_physics_mean	0.061580153589197634
sim_physics_median	0.06088775746962603
sim_physics_min	0.055976755765019634
sim_render-ego_max	0.03815792288099017
sim_render-ego_mean	0.037122197659571234
sim_render-ego_median	0.03714792375211363
sim_render-ego_min	0.036243323926572445
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21430

3131

FANG MEIYI 🇸🇬

test

step1-simulation

success

2019-04-30 10:12:13+00:00

2019-04-30 10:28:06+00:00

0:15:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.761928167609884
survival_time_median	14.950000000000076
deviation-center-line_median	0.4887306143985907
in-drivable-lane_median	1.0499999999999965

other stats

agent_compute-ego_max	0.13252033631006876
agent_compute-ego_mean	0.12339661216013358
agent_compute-ego_median	0.12670840382575987
agent_compute-ego_min	0.104632941087087
deviation-center-line_max	0.7746773469991203
deviation-center-line_mean	0.5481687374473733
deviation-center-line_min	0.3171624560616052
deviation-heading_max	3.2046877572806296
deviation-heading_mean	2.099870096362885
deviation-heading_median	1.8940743594439808
deviation-heading_min	1.5124376490110374
driven_any_max	3.870768237385547
driven_any_mean	3.093336350694064
driven_any_median	3.723853490451413
driven_any_min	1.604928099593557
driven_lanedir_consec_max	3.8391838143426056
driven_lanedir_consec_mean	2.6712259097697255
driven_lanedir_consec_min	1.24538531619957
driven_lanedir_max	3.8391838143426056
driven_lanedir_mean	2.6712259097697255
driven_lanedir_median	2.761928167609884
driven_lanedir_min	1.24538531619957
in-drivable-lane_max	3.1000000000000165
in-drivable-lane_mean	1.2900000000000027
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.723853490451413, "sim_physics": 0.07561207771301269, "survival_time": 14.950000000000076, "driven_lanedir": 2.761928167609884, "sim_render-ego": 0.04158552090326945, "in-drivable-lane": 3.1000000000000165, "agent_compute-ego": 0.104632941087087, "deviation-heading": 3.2046877572806296, "set_robot_commands": 0.06293915033340454, "deviation-center-line": 0.6966347023612063, "driven_lanedir_consec": 2.761928167609884, "sim_compute_sim_state": 0.026527442932128907, "sim_compute_performance-ego": 0.04439188639322917, "sim_compute_robot_state-ego": 0.050329949061075845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.870768237385547, "sim_physics": 0.09162737687428792, "survival_time": 14.950000000000076, "driven_lanedir": 3.8391838143426056, "sim_render-ego": 0.05021615187327067, "in-drivable-lane": 0, "agent_compute-ego": 0.1309889030456543, "deviation-heading": 1.6646371386862786, "set_robot_commands": 0.07648338635762532, "deviation-center-line": 0.4636385674163443, "driven_lanedir_consec": 3.8391838143426056, "sim_compute_sim_state": 0.03183315912882487, "sim_compute_performance-ego": 0.05546043713887532, "sim_compute_robot_state-ego": 0.060220328172047935}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.754359007217571, "sim_physics": 0.08693637132644653, "survival_time": 14.950000000000076, "driven_lanedir": 3.5611986062499854, "sim_render-ego": 0.052179481188456216, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.13252033631006876, "deviation-heading": 2.223513577392499, "set_robot_commands": 0.07721861441930135, "deviation-center-line": 0.7746773469991203, "driven_lanedir_consec": 3.5611986062499854, "sim_compute_sim_state": 0.032941521803538, "sim_compute_performance-ego": 0.05748553355534872, "sim_compute_robot_state-ego": 0.059056666692097984}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.604928099593557, "sim_physics": 0.08605449127428459, "survival_time": 6.5999999999999845, "driven_lanedir": 1.24538531619957, "sim_render-ego": 0.04933040069811272, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.12213247653209802, "deviation-heading": 1.5124376490110374, "set_robot_commands": 0.07445952567187222, "deviation-center-line": 0.3171624560616052, "driven_lanedir_consec": 1.24538531619957, "sim_compute_sim_state": 0.031834345875364364, "sim_compute_performance-ego": 0.057328834678187515, "sim_compute_robot_state-ego": 0.05851133122588649}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.51277291882223, "sim_physics": 0.0829047417640686, "survival_time": 10.000000000000009, "driven_lanedir": 1.9484336444465824, "sim_render-ego": 0.05049521803855896, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12670840382575987, "deviation-heading": 1.8940743594439808, "set_robot_commands": 0.07931874275207519, "deviation-center-line": 0.4887306143985907, "driven_lanedir_consec": 1.9484336444465824, "sim_compute_sim_state": 0.0326578426361084, "sim_compute_performance-ego": 0.05576248168945312, "sim_compute_robot_state-ego": 0.05868782043457031}}
set_robot_commands_max	0.07931874275207519
set_robot_commands_mean	0.07408388390685572
set_robot_commands_median	0.07648338635762532
set_robot_commands_min	0.06293915033340454
sim_compute_performance-ego_max	0.05748553355534872
sim_compute_performance-ego_mean	0.054085834691018776
sim_compute_performance-ego_median	0.05576248168945312
sim_compute_performance-ego_min	0.04439188639322917
sim_compute_robot_state-ego_max	0.060220328172047935
sim_compute_robot_state-ego_mean	0.05736121911713571
sim_compute_robot_state-ego_median	0.05868782043457031
sim_compute_robot_state-ego_min	0.050329949061075845
sim_compute_sim_state_max	0.032941521803538
sim_compute_sim_state_mean	0.031158862475192905
sim_compute_sim_state_median	0.031834345875364364
sim_compute_sim_state_min	0.026527442932128907
sim_physics_max	0.09162737687428792
sim_physics_mean	0.08462701179042006
sim_physics_median	0.08605449127428459
sim_physics_min	0.07561207771301269
sim_render-ego_max	0.052179481188456216
sim_render-ego_mean	0.0487613545403336
sim_render-ego_median	0.05021615187327067
sim_render-ego_min	0.04158552090326945
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.290000000000044
survival_time_min	6.5999999999999845

No reset possible

21414

3116

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-29 06:01:20+00:00

2019-04-29 06:35:37+00:00

0:34:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.973162883674172
survival_time_median	7.84999999999998
deviation-center-line_median	0.3898444675453543
in-drivable-lane_median	0.20000000000000284

other stats

agent_compute-ego_max	0.22032412782415645
agent_compute-ego_mean	0.17903709138511398
agent_compute-ego_median	0.1619945081075033
agent_compute-ego_min	0.1575902615274702
deviation-center-line_max	1.1202443535817246
deviation-center-line_mean	0.5544138874421719
deviation-center-line_min	0.12200425695395271
deviation-heading_max	4.160758485835901
deviation-heading_mean	2.31509180147006
deviation-heading_median	2.0032249180808397
deviation-heading_min	0.3580124449554322
driven_any_max	3.56020201755822
driven_any_mean	2.154384434605962
driven_any_median	2.1911875478524196
driven_any_min	0.2545119219338214
driven_lanedir_consec_max	3.392707447313275
driven_lanedir_consec_mean	1.9435444349711577
driven_lanedir_consec_min	0.24498875491291816
driven_lanedir_max	3.392707447313275
driven_lanedir_mean	1.9435444349711577
driven_lanedir_median	1.973162883674172
driven_lanedir_min	0.24498875491291816
in-drivable-lane_max	1.399999999999995
in-drivable-lane_mean	0.46999999999999914
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0553336962894966, "sim_physics": 0.08743159896449039, "survival_time": 4.749999999999991, "driven_lanedir": 1.023460746851037, "sim_render-ego": 0.05030153425116288, "in-drivable-lane": 0, "agent_compute-ego": 0.21428842544555665, "deviation-heading": 0.9737827081824408, "set_robot_commands": 0.07060777011670565, "deviation-center-line": 0.2641621205486836, "driven_lanedir_consec": 1.023460746851037, "sim_compute_sim_state": 0.03238576085943925, "sim_compute_performance-ego": 0.05627373394213225, "sim_compute_robot_state-ego": 0.05647553142748381}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5478655182507577, "sim_physics": 0.07998619715372722, "survival_time": 14.950000000000076, "driven_lanedir": 3.392707447313275, "sim_render-ego": 0.05019762674967448, "in-drivable-lane": 0, "agent_compute-ego": 0.2162678035100301, "deviation-heading": 3.898797500025273, "set_robot_commands": 0.07534109592437745, "deviation-center-line": 0.8140363123121314, "driven_lanedir_consec": 3.392707447313275, "sim_compute_sim_state": 0.03230270862579346, "sim_compute_performance-ego": 0.05427346785863241, "sim_compute_robot_state-ego": 0.059360608259836835}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.657966708256603, "sim_physics": 0.09083314208717612, "survival_time": 7.149999999999983, "driven_lanedir": 1.2924667026784684, "sim_render-ego": 0.0529319122954682, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.22032412782415645, "deviation-heading": 2.0032249180808397, "set_robot_commands": 0.07974279176938784, "deviation-center-line": 0.3602541842019745, "driven_lanedir_consec": 1.2924667026784684, "sim_compute_sim_state": 0.034390512879911836, "sim_compute_performance-ego": 0.05727626393724988, "sim_compute_robot_state-ego": 0.06122405879147403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4221913247535758, "sim_physics": 0.0910114328911964, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3799973805505741, "sim_render-ego": 0.04844043102670223, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.21490872667190877, "deviation-heading": 0.8528879975359244, "set_robot_commands": 0.07411794459566157, "deviation-center-line": 0.165210685001054, "driven_lanedir_consec": 0.3799973805505741, "sim_compute_sim_state": 0.03186718453752234, "sim_compute_performance-ego": 0.05677558513397866, "sim_compute_robot_state-ego": 0.05870582702312064}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3517572577385746, "sim_physics": 0.08517806609471638, "survival_time": 14.950000000000076, "driven_lanedir": 2.931059955940872, "sim_render-ego": 0.050017199516296386, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.2142938748995463, "deviation-heading": 3.451917518803816, "set_robot_commands": 0.07561099529266357, "deviation-center-line": 1.0810058684504582, "driven_lanedir_consec": 2.931059955940872, "sim_compute_sim_state": 0.031926964124043784, "sim_compute_performance-ego": 0.05470391909281413, "sim_compute_robot_state-ego": 0.057824857234954834}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3913735812550496, "sim_physics": 0.05936807036399841, "survival_time": 10.000000000000009, "driven_lanedir": 2.1882643028484714, "sim_render-ego": 0.03759327173233032, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.16588273882865906, "deviation-heading": 3.2027626692375706, "set_robot_commands": 0.058802409172058104, "deviation-center-line": 0.6099710646785288, "driven_lanedir_consec": 2.1882643028484714, "sim_compute_sim_state": 0.024963722229003907, "sim_compute_performance-ego": 0.04132682204246521, "sim_compute_robot_state-ego": 0.04388328313827514}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.536127195871092, "sim_physics": 0.06059012571970622, "survival_time": 14.950000000000076, "driven_lanedir": 3.266035276689632, "sim_render-ego": 0.03736237128575643, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.1619945081075033, "deviation-heading": 3.737670570370987, "set_robot_commands": 0.056990803082784015, "deviation-center-line": 1.1202443535817246, "driven_lanedir_consec": 3.266035276689632, "sim_compute_sim_state": 0.02395057678222656, "sim_compute_performance-ego": 0.040012389818827314, "sim_compute_robot_state-ego": 0.042176023324330646}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.2545119219338214, "sim_physics": 0.06022657666887555, "survival_time": 1.4000000000000006, "driven_lanedir": 0.24498875491291816, "sim_render-ego": 0.03661520140511649, "in-drivable-lane": 0, "agent_compute-ego": 0.1575902615274702, "deviation-heading": 0.3580124449554322, "set_robot_commands": 0.055612342698233466, "deviation-center-line": 0.13030615221623135, "driven_lanedir_consec": 0.24498875491291816, "sim_compute_sim_state": 0.0235343405178615, "sim_compute_performance-ego": 0.040183424949646, "sim_compute_robot_state-ego": 0.04156160354614258}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.5312008185635824, "sim_physics": 0.05796639283498128, "survival_time": 14.950000000000076, "driven_lanedir": 3.3634697637671938, "sim_render-ego": 0.037371031443278, "in-drivable-lane": 0, "agent_compute-ego": 0.16153756777445474, "deviation-heading": 3.9028516366080974, "set_robot_commands": 0.05692015012105306, "deviation-center-line": 0.7956299098980246, "driven_lanedir_consec": 3.3634697637671938, "sim_compute_sim_state": 0.02394759972890218, "sim_compute_performance-ego": 0.03999935070673625, "sim_compute_robot_state-ego": 0.04222680886586507}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0214965098501891, "sim_physics": 0.06033639735486134, "survival_time": 4.149999999999993, "driven_lanedir": 0.6903608017372684, "sim_render-ego": 0.036410363323717235, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.15909811100327825, "deviation-heading": 0.7375262719662339, "set_robot_commands": 0.05668071953647108, "deviation-center-line": 0.1797936829495383, "driven_lanedir_consec": 0.6903608017372684, "sim_compute_sim_state": 0.023471171597400343, "sim_compute_performance-ego": 0.0398202660572098, "sim_compute_robot_state-ego": 0.0415809097060238}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.56020201755822, "sim_physics": 0.05795210043589274, "survival_time": 14.950000000000076, "driven_lanedir": 3.223600834603382, "sim_render-ego": 0.03755930662155151, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.16257886489232382, "deviation-heading": 4.160758485835901, "set_robot_commands": 0.05567647139231364, "deviation-center-line": 1.051492005611097, "driven_lanedir_consec": 3.223600834603382, "sim_compute_sim_state": 0.024077845414479573, "sim_compute_performance-ego": 0.04040340820948283, "sim_compute_robot_state-ego": 0.04255523125330607}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.001960381285299, "sim_physics": 0.06255996511096046, "survival_time": 4.199999999999993, "driven_lanedir": 0.6533400920226025, "sim_render-ego": 0.03625956887290591, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.15856866041819254, "deviation-heading": 0.590269130787151, "set_robot_commands": 0.05466070345469883, "deviation-center-line": 0.12200425695395271, "driven_lanedir_consec": 0.6533400920226025, "sim_compute_sim_state": 0.02357986143657139, "sim_compute_performance-ego": 0.0407398712067377, "sim_compute_robot_state-ego": 0.04199444679986863}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.549610740080572, "sim_physics": 0.0578797197341919, "survival_time": 14.950000000000076, "driven_lanedir": 3.358274529245935, "sim_render-ego": 0.036911434332529705, "in-drivable-lane": 0, "agent_compute-ego": 0.15997484763463338, "deviation-heading": 3.944501126283542, "set_robot_commands": 0.05495530207951864, "deviation-center-line": 0.874449762952882, "driven_lanedir_consec": 3.358274529245935, "sim_compute_sim_state": 0.023641415437062583, "sim_compute_performance-ego": 0.03962771574656169, "sim_compute_robot_state-ego": 0.04220038811365763}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.2429812995501857, "sim_physics": 0.05996657518240122, "survival_time": 6.499999999999985, "driven_lanedir": 1.1719770517315635, "sim_render-ego": 0.03612579198983999, "in-drivable-lane": 0, "agent_compute-ego": 0.15797877861903264, "deviation-heading": 1.9455790837615707, "set_robot_commands": 0.05590660021855281, "deviation-center-line": 0.3898444675453543, "driven_lanedir_consec": 1.1719770517315635, "sim_compute_sim_state": 0.023389042340792143, "sim_compute_performance-ego": 0.039451958582951474, "sim_compute_robot_state-ego": 0.04131832672999455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1911875478524196, "sim_physics": 0.05392418697381475, "survival_time": 7.84999999999998, "driven_lanedir": 1.973162883674172, "sim_render-ego": 0.035900270862943805, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.160269073619964, "deviation-heading": 0.965834959616114, "set_robot_commands": 0.05496612627794789, "deviation-center-line": 0.3578034847309438, "driven_lanedir_consec": 1.973162883674172, "sim_compute_sim_state": 0.0236550334152902, "sim_compute_performance-ego": 0.03970486495145567, "sim_compute_robot_state-ego": 0.042309565149295104}}
set_robot_commands_max	0.07974279176938784
set_robot_commands_mean	0.06243948171549517
set_robot_commands_median	0.05692015012105306
set_robot_commands_min	0.05466070345469883
sim_compute_performance-ego_max	0.05727626393724988
sim_compute_performance-ego_mean	0.04537153614912541
sim_compute_performance-ego_median	0.04040340820948283
sim_compute_performance-ego_min	0.039451958582951474
sim_compute_robot_state-ego_max	0.06122405879147403
sim_compute_robot_state-ego_mean	0.04769316462424197
sim_compute_robot_state-ego_median	0.042309565149295104
sim_compute_robot_state-ego_min	0.04131832672999455
sim_compute_sim_state_max	0.034390512879911836
sim_compute_sim_state_mean	0.026738915995086737
sim_compute_sim_state_median	0.02395057678222656
sim_compute_sim_state_min	0.023389042340792143
sim_physics_max	0.0910114328911964
sim_physics_mean	0.06834736983806604
sim_physics_median	0.06033639735486134
sim_physics_min	0.05392418697381475
sim_render-ego_max	0.0529319122954682
sim_render-ego_mean	0.041333154380618235
sim_render-ego_median	0.037371031443278
sim_render-ego_min	0.035900270862943805
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.203333333333356
survival_time_min	1.4000000000000006

No reset possible

21410

3115

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-28 21:00:45+00:00

2019-04-28 21:38:19+00:00

0:37:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.170317231464851
survival_time_median	14.950000000000076
deviation-center-line_median	0.7052027507332922
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16262655337651571
agent_compute-ego_mean	0.16113631469144926
agent_compute-ego_median	0.16168573061625163
agent_compute-ego_min	0.15584772986334725
deviation-center-line_max	1.2255356035730065
deviation-center-line_mean	0.6550704956759613
deviation-center-line_min	0.18142402635883895
deviation-heading_max	3.383785952736176
deviation-heading_mean	2.0785062586343472
deviation-heading_median	2.205524543498726
deviation-heading_min	0.5746004221879178
driven_any_max	2.4666356801586087
driven_any_mean	1.817457149059831
driven_any_median	2.254976140782869
driven_any_min	0.1409838390898866
driven_lanedir_consec_max	2.431181540119132
driven_lanedir_consec_mean	1.7330023432972756
driven_lanedir_consec_min	0.12304851290535355
driven_lanedir_max	2.431181540119132
driven_lanedir_mean	1.7330023432972756
driven_lanedir_median	2.170317231464851
driven_lanedir_min	0.12304851290535355
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.29333333333333317
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.184521688202063, "sim_physics": 0.05807216246922811, "survival_time": 14.950000000000076, "driven_lanedir": 2.1527157335677, "sim_render-ego": 0.03768125375111898, "in-drivable-lane": 0, "agent_compute-ego": 0.16256863276163738, "deviation-heading": 2.234026992275024, "set_robot_commands": 0.05563155094782511, "deviation-center-line": 0.7813037829842988, "driven_lanedir_consec": 2.1527157335677, "sim_compute_sim_state": 0.02426329533259074, "sim_compute_performance-ego": 0.04018823862075806, "sim_compute_robot_state-ego": 0.04278242270151774}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.4666356801586087, "sim_physics": 0.06056701978047689, "survival_time": 14.950000000000076, "driven_lanedir": 2.431181540119132, "sim_render-ego": 0.037235028743743896, "in-drivable-lane": 0, "agent_compute-ego": 0.1623512935638428, "deviation-heading": 1.789683521887156, "set_robot_commands": 0.05538243452707926, "deviation-center-line": 0.6696053814015916, "driven_lanedir_consec": 2.431181540119132, "sim_compute_sim_state": 0.02422992467880249, "sim_compute_performance-ego": 0.04046740929285685, "sim_compute_robot_state-ego": 0.042730161348978675}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20334815634168033, "sim_physics": 0.0630752444267273, "survival_time": 1.800000000000001, "driven_lanedir": 0.1915976082164348, "sim_render-ego": 0.035828623506757945, "in-drivable-lane": 0, "agent_compute-ego": 0.15865909390979344, "deviation-heading": 0.5746004221879178, "set_robot_commands": 0.05392340819040934, "deviation-center-line": 0.18142402635883895, "driven_lanedir_consec": 0.1915976082164348, "sim_compute_sim_state": 0.024081051349639893, "sim_compute_performance-ego": 0.04118395513958401, "sim_compute_robot_state-ego": 0.04339154561360677}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.396692012593019, "sim_physics": 0.057580756513695965, "survival_time": 3.7999999999999945, "driven_lanedir": 0.3581598050799517, "sim_render-ego": 0.03721851110458374, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.16136177276310168, "deviation-heading": 1.463123302372802, "set_robot_commands": 0.05502140208294517, "deviation-center-line": 0.2672216736856907, "driven_lanedir_consec": 0.3581598050799517, "sim_compute_sim_state": 0.02427461586500469, "sim_compute_performance-ego": 0.040814067188062166, "sim_compute_robot_state-ego": 0.04285399537337454}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.249009372654152, "sim_physics": 0.05729826211929321, "survival_time": 14.950000000000076, "driven_lanedir": 1.9510259221643456, "sim_render-ego": 0.03746592044830322, "in-drivable-lane": 2.100000000000004, "agent_compute-ego": 0.1620497234662374, "deviation-heading": 2.249004776354939, "set_robot_commands": 0.056145186424255374, "deviation-center-line": 1.2255356035730065, "driven_lanedir_consec": 1.9510259221643456, "sim_compute_sim_state": 0.02425244728724162, "sim_compute_performance-ego": 0.040138136545817056, "sim_compute_robot_state-ego": 0.0423938790957133}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.306649026488444, "sim_physics": 0.05804309686024984, "survival_time": 14.950000000000076, "driven_lanedir": 2.225119703576162, "sim_render-ego": 0.036758514245351155, "in-drivable-lane": 0, "agent_compute-ego": 0.16168573061625163, "deviation-heading": 3.383785952736176, "set_robot_commands": 0.055234811305999755, "deviation-center-line": 0.6616240857995165, "driven_lanedir_consec": 2.225119703576162, "sim_compute_sim_state": 0.02400031566619873, "sim_compute_performance-ego": 0.04021577517191569, "sim_compute_robot_state-ego": 0.042265113989512125}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 2.1878796143455412, "sim_physics": 0.05794806083043416, "survival_time": 14.950000000000076, "driven_lanedir": 2.151412894850028, "sim_render-ego": 0.03725450038909912, "in-drivable-lane": 0, "agent_compute-ego": 0.16243258794148763, "deviation-heading": 2.2621249914488075, "set_robot_commands": 0.056620047092437745, "deviation-center-line": 0.8101474567000062, "driven_lanedir_consec": 2.151412894850028, "sim_compute_sim_state": 0.024062357743581137, "sim_compute_performance-ego": 0.040256956418355305, "sim_compute_robot_state-ego": 0.04269450982411702}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1409838390898866, "sim_physics": 0.058677583127408416, "survival_time": 1.850000000000001, "driven_lanedir": 0.12304851290535355, "sim_render-ego": 0.03614482364139041, "in-drivable-lane": 0, "agent_compute-ego": 0.15584772986334725, "deviation-heading": 0.833598728391157, "set_robot_commands": 0.055603227099856815, "deviation-center-line": 0.1856722550051738, "driven_lanedir_consec": 0.12304851290535355, "sim_compute_sim_state": 0.0245341868013949, "sim_compute_performance-ego": 0.04028632189776447, "sim_compute_robot_state-ego": 0.0419057897619299}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.2708938017537728, "sim_physics": 0.05858875513076782, "survival_time": 14.950000000000076, "driven_lanedir": 2.2048754316988406, "sim_render-ego": 0.0371208397547404, "in-drivable-lane": 0, "agent_compute-ego": 0.16262655337651571, "deviation-heading": 3.34771042623223, "set_robot_commands": 0.055288782119750975, "deviation-center-line": 0.7052027507332922, "driven_lanedir_consec": 2.2048754316988406, "sim_compute_sim_state": 0.02416471322377523, "sim_compute_performance-ego": 0.040226425329844155, "sim_compute_robot_state-ego": 0.042668921947479246}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.254976140782869, "sim_physics": 0.05915879170099894, "survival_time": 14.950000000000076, "driven_lanedir": 2.170317231464851, "sim_render-ego": 0.03733615001042684, "in-drivable-lane": 0, "agent_compute-ego": 0.16066975752512613, "deviation-heading": 2.927810925155725, "set_robot_commands": 0.05513281265894572, "deviation-center-line": 0.8230456589548413, "driven_lanedir_consec": 2.170317231464851, "sim_compute_sim_state": 0.024058375358581543, "sim_compute_performance-ego": 0.04114350398381551, "sim_compute_robot_state-ego": 0.04228959401448568}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.3344300525169186, "sim_physics": 0.05835407257080078, "survival_time": 14.950000000000076, "driven_lanedir": 2.276394932251117, "sim_render-ego": 0.036660389105478926, "in-drivable-lane": 0, "agent_compute-ego": 0.1610285989443461, "deviation-heading": 2.631964481133149, "set_robot_commands": 0.05552154620488485, "deviation-center-line": 0.8194946090935252, "driven_lanedir_consec": 2.276394932251117, "sim_compute_sim_state": 0.02392816702524821, "sim_compute_performance-ego": 0.04056791067123413, "sim_compute_robot_state-ego": 0.04217478513717651}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.083752823050167, "sim_physics": 0.060478643654218685, "survival_time": 7.649999999999981, "driven_lanedir": 0.7138351216084153, "sim_render-ego": 0.03712664554321688, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.16028973635505228, "deviation-heading": 1.1581418509516512, "set_robot_commands": 0.055448017868341186, "deviation-center-line": 0.4123361661867449, "driven_lanedir_consec": 0.7138351216084153, "sim_compute_sim_state": 0.023970898459939396, "sim_compute_performance-ego": 0.04007498423258463, "sim_compute_robot_state-ego": 0.04289697198306813}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.463522120706558, "sim_physics": 0.055700509548187255, "survival_time": 14.950000000000076, "driven_lanedir": 2.4213507036613424, "sim_render-ego": 0.03706065893173218, "in-drivable-lane": 0, "agent_compute-ego": 0.16179410616556802, "deviation-heading": 2.1462019296481327, "set_robot_commands": 0.05610524257024129, "deviation-center-line": 0.8883597173343794, "driven_lanedir_consec": 2.4213507036613424, "sim_compute_sim_state": 0.02431415637334188, "sim_compute_performance-ego": 0.04027499357859294, "sim_compute_robot_state-ego": 0.04290124495824178}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.446561050526043, "sim_physics": 0.058649269739786784, "survival_time": 14.950000000000076, "driven_lanedir": 2.4064503732517752, "sim_render-ego": 0.03708385070164998, "in-drivable-lane": 0, "agent_compute-ego": 0.16226320346196493, "deviation-heading": 2.205524543498726, "set_robot_commands": 0.055398600896199544, "deviation-center-line": 0.5797989494479946, "driven_lanedir_consec": 2.4064503732517752, "sim_compute_sim_state": 0.024100744724273683, "sim_compute_performance-ego": 0.04054053068161011, "sim_compute_robot_state-ego": 0.042669637997945147}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.2720018566877465, "sim_physics": 0.05577093654579216, "survival_time": 14.300000000000068, "driven_lanedir": 2.2175496350436825, "sim_render-ego": 0.03678423291319734, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.16141619965746687, "deviation-heading": 1.9702910352416192, "set_robot_commands": 0.055985298190083535, "deviation-center-line": 0.8152853178805192, "driven_lanedir_consec": 2.2175496350436825, "sim_compute_sim_state": 0.024321164284552728, "sim_compute_performance-ego": 0.04034249765889628, "sim_compute_robot_state-ego": 0.041973843441142904}}
set_robot_commands_max	0.056620047092437745
set_robot_commands_mean	0.05549615787861705
set_robot_commands_median	0.055448017868341186
set_robot_commands_min	0.05392340819040934
sim_compute_performance-ego_max	0.04118395513958401
sim_compute_performance-ego_mean	0.040448113760779426
sim_compute_performance-ego_median	0.04028632189776447
sim_compute_performance-ego_min	0.04007498423258463
sim_compute_robot_state-ego_max	0.04339154561360677
sim_compute_robot_state-ego_mean	0.04257282781255262
sim_compute_robot_state-ego_median	0.042669637997945147
sim_compute_robot_state-ego_min	0.0419057897619299
sim_compute_sim_state_max	0.0245341868013949
sim_compute_sim_state_mean	0.024170427611611128
sim_compute_sim_state_median	0.02416471322377523
sim_compute_sim_state_min	0.02392816702524821
sim_physics_max	0.0630752444267273
sim_physics_mean	0.058530877667871094
sim_physics_median	0.05835407257080078
sim_physics_min	0.055700509548187255
sim_render-ego_max	0.03768125375111898
sim_render-ego_mean	0.03698399618605273
sim_render-ego_median	0.0371208397547404
sim_render-ego_min	0.035828623506757945
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.92666666666672
survival_time_min	1.800000000000001

No reset possible

21385

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

success

2019-04-28 02:00:58+00:00

2019-04-28 02:33:28+00:00

0:32:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4674075261701268
survival_time_median	3.699999999999995
deviation-center-line_median	0.2037212999690195
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.08381830249820743
agent_compute-ego_mean	0.06246563341902844
agent_compute-ego_median	0.06691190083821615
agent_compute-ego_min	0.04721467725692257
deviation-center-line_max	0.5183621890690367
deviation-center-line_mean	0.2365365432439713
deviation-center-line_min	0.1001276403534276
deviation-heading_max	1.8192903310562811
deviation-heading_mean	0.7195980419067693
deviation-heading_median	0.5070424162880826
deviation-heading_min	0.2495279988048577
driven_any_max	2.764827318571964
driven_any_mean	1.0818349506618754
driven_any_median	1.0098273192909006
driven_any_min	0.3648701917101222
driven_lanedir_consec_max	1.9044523873117627
driven_lanedir_consec_mean	0.759860328609196
driven_lanedir_consec_min	0.3272146444894328
driven_lanedir_max	1.9045033171069223
driven_lanedir_mean	0.7732651243581526
driven_lanedir_median	0.6173586051289615
driven_lanedir_min	0.3272146444894328
in-drivable-lane_max	3.7999999999999887
in-drivable-lane_mean	0.8633333333333326
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5648273185720385, "sim_physics": 0.26919689693966425, "survival_time": 5.549999999999988, "driven_lanedir": 1.5590414710313567, "sim_render-ego": 0.07675925890604655, "in-drivable-lane": 0, "agent_compute-ego": 0.08381830249820743, "deviation-heading": 0.47436593881657807, "set_robot_commands": 0.1282354668454007, "deviation-center-line": 0.3652019984091639, "driven_lanedir_consec": 1.5588337849539742, "sim_compute_sim_state": 0.04675912857055664, "sim_compute_performance-ego": 0.08606072374292321, "sim_compute_robot_state-ego": 0.10020158956716728, "sim_compute_robot_state-npc0": 0.08392530948192149, "sim_compute_robot_state-npc1": 0.0845858771521766, "sim_compute_robot_state-npc2": 0.08218845376023301, "sim_compute_robot_state-npc3": 0.08472542719798046}, "udem1-1-0": {"driven_any": 0.4548365617710335, "sim_physics": 0.21809140411583153, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295989448974513, "sim_render-ego": 0.0641811989449166, "in-drivable-lane": 0, "agent_compute-ego": 0.06708042041675465, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.09936522148750924, "deviation-center-line": 0.13177328060574295, "driven_lanedir_consec": 0.4295989448974513, "sim_compute_sim_state": 0.04091874973194019, "sim_compute_performance-ego": 0.06969987379538047, "sim_compute_robot_state-ego": 0.07311454979149071, "sim_compute_robot_state-npc0": 0.07049200985882734, "sim_compute_robot_state-npc1": 0.06889717643325394, "sim_compute_robot_state-npc2": 0.07038431554227262, "sim_compute_robot_state-npc3": 0.06946058531065245}, "udem1-2-0": {"driven_any": 2.164827318571943, "sim_physics": 0.2051520600224173, "survival_time": 7.549999999999981, "driven_lanedir": 1.7225432153016964, "sim_render-ego": 0.06452978052050862, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.06776950059347595, "deviation-heading": 0.5111746004355058, "set_robot_commands": 0.10227686679915876, "deviation-center-line": 0.4236146577511261, "driven_lanedir_consec": 1.7224824270719754, "sim_compute_sim_state": 0.04056242285974768, "sim_compute_performance-ego": 0.07198351424261434, "sim_compute_robot_state-ego": 0.07761741789760969, "sim_compute_robot_state-npc0": 0.07269503738706475, "sim_compute_robot_state-npc1": 0.0718148196769866, "sim_compute_robot_state-npc2": 0.07302207662569767, "sim_compute_robot_state-npc3": 0.0716370762578699}, "udem1-3-0": {"driven_any": 2.764827318571964, "sim_physics": 0.2147459309762685, "survival_time": 9.55, "driven_lanedir": 1.9045033171069223, "sim_render-ego": 0.06529653509249862, "in-drivable-lane": 2.8500000000000165, "agent_compute-ego": 0.068867773285711, "deviation-heading": 0.4989824923438323, "set_robot_commands": 0.10125208025827458, "deviation-center-line": 0.5183621890690367, "driven_lanedir_consec": 1.9044523873117627, "sim_compute_sim_state": 0.04071094852467482, "sim_compute_performance-ego": 0.07097726217739245, "sim_compute_robot_state-ego": 0.07807224957730757, "sim_compute_robot_state-npc0": 0.07252344286254563, "sim_compute_robot_state-npc1": 0.07288899097143044, "sim_compute_robot_state-npc2": 0.07449386257151659, "sim_compute_robot_state-npc3": 0.07380261845613649}, "udem1-4-0": {"driven_any": 0.37986052535838966, "sim_physics": 0.2160931900143623, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3667130323691865, "sim_render-ego": 0.08049201965332031, "in-drivable-lane": 0, "agent_compute-ego": 0.06641839444637299, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.09738579392433168, "deviation-center-line": 0.10686438692139356, "driven_lanedir_consec": 0.3667130323691865, "sim_compute_sim_state": 0.041571781039237976, "sim_compute_performance-ego": 0.07403455674648285, "sim_compute_robot_state-ego": 0.08043468743562698, "sim_compute_robot_state-npc0": 0.06807132065296173, "sim_compute_robot_state-npc1": 0.07134327292442322, "sim_compute_robot_state-npc2": 0.07094762474298477, "sim_compute_robot_state-npc3": 0.07175283133983612}, "udem1-5-0": {"driven_any": 1.0548273189057942, "sim_physics": 0.2044256693356997, "survival_time": 3.8499999999999943, "driven_lanedir": 0.39637369698573455, "sim_render-ego": 0.0654408900768726, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.06852803911481585, "deviation-heading": 1.272726140232846, "set_robot_commands": 0.10309269830778048, "deviation-center-line": 0.2037212999690195, "driven_lanedir_consec": 0.39637369698573455, "sim_compute_sim_state": 0.041122421041711585, "sim_compute_performance-ego": 0.07014022245035544, "sim_compute_robot_state-ego": 0.07639041504302582, "sim_compute_robot_state-npc0": 0.07226642385705725, "sim_compute_robot_state-npc1": 0.07170300979118843, "sim_compute_robot_state-npc2": 0.07129450587483195, "sim_compute_robot_state-npc3": 0.07330719217077478}, "udem1-6-0": {"driven_any": 0.8898273241328052, "sim_physics": 0.19169653184486157, "survival_time": 3.2999999999999963, "driven_lanedir": 0.8871438691197218, "sim_render-ego": 0.054416660106543335, "in-drivable-lane": 0, "agent_compute-ego": 0.05872910311727813, "deviation-heading": 0.2564691131854334, "set_robot_commands": 0.08734401428338254, "deviation-center-line": 0.3019392944051749, "driven_lanedir_consec": 0.8871438691197218, "sim_compute_sim_state": 0.03529442801620021, "sim_compute_performance-ego": 0.062069029519052216, "sim_compute_robot_state-ego": 0.06424932046370073, "sim_compute_robot_state-npc0": 0.06225686723535711, "sim_compute_robot_state-npc1": 0.06102028760043057, "sim_compute_robot_state-npc2": 0.06138449726682721, "sim_compute_robot_state-npc3": 0.07062716195077608}, "udem1-7-0": {"driven_any": 1.0098273192909006, "sim_physics": 0.2375283466803061, "survival_time": 3.699999999999995, "driven_lanedir": 0.8892952338440012, "sim_render-ego": 0.06263577615892565, "in-drivable-lane": 0, "agent_compute-ego": 0.06867539882659912, "deviation-heading": 1.3305395181824708, "set_robot_commands": 0.09825319212836188, "deviation-center-line": 0.2328954250769578, "driven_lanedir_consec": 0.8751257158125099, "sim_compute_sim_state": 0.03967493933600348, "sim_compute_performance-ego": 0.07076945820370235, "sim_compute_robot_state-ego": 0.07950267598435685, "sim_compute_robot_state-npc0": 0.07261229205775906, "sim_compute_robot_state-npc1": 0.07191445054234685, "sim_compute_robot_state-npc2": 0.07251528147104624, "sim_compute_robot_state-npc3": 0.07144186947796796}, "udem1-8-0": {"driven_any": 1.024827319128602, "sim_physics": 0.2003009573618571, "survival_time": 3.7499999999999942, "driven_lanedir": 0.6173586051289615, "sim_render-ego": 0.06401057243347168, "in-drivable-lane": 0.9999999999999978, "agent_compute-ego": 0.06691190083821615, "deviation-heading": 1.2558531851712094, "set_robot_commands": 0.09784493764241536, "deviation-center-line": 0.25318000812184893, "driven_lanedir_consec": 0.6173586051289615, "sim_compute_sim_state": 0.039846026102701826, "sim_compute_performance-ego": 0.07110682169596354, "sim_compute_robot_state-ego": 0.07623085339864095, "sim_compute_robot_state-npc0": 0.06832526524861654, "sim_compute_robot_state-npc1": 0.0682081921895345, "sim_compute_robot_state-npc2": 0.07332735379536946, "sim_compute_robot_state-npc3": 0.07269712448120118}, "udem1-9-0": {"driven_any": 0.45483656177104664, "sim_physics": 0.25842600899773677, "survival_time": 1.850000000000001, "driven_lanedir": 0.4388914430822646, "sim_render-ego": 0.06411424843040672, "in-drivable-lane": 0, "agent_compute-ego": 0.06705002526979188, "deviation-heading": 0.49131063474122394, "set_robot_commands": 0.10657791833619812, "deviation-center-line": 0.1166531854243332, "driven_lanedir_consec": 0.4388914430822646, "sim_compute_sim_state": 0.03947023443273596, "sim_compute_performance-ego": 0.07390859320357039, "sim_compute_robot_state-ego": 0.0829679386035816, "sim_compute_robot_state-npc0": 0.0733547661755536, "sim_compute_robot_state-npc1": 0.07294832049189387, "sim_compute_robot_state-npc2": 0.07457950308516219, "sim_compute_robot_state-npc3": 0.075145470129477}, "udem1-10-0": {"driven_any": 0.3648701917101222, "sim_physics": 0.15456661870402674, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552109787971164, "sim_render-ego": 0.04704624606717017, "in-drivable-lane": 0, "agent_compute-ego": 0.04721467725692257, "deviation-heading": 0.5070424162880826, "set_robot_commands": 0.06921668206491778, "deviation-center-line": 0.1001276403534276, "driven_lanedir_consec": 0.34552109787971164, "sim_compute_sim_state": 0.028220099787558277, "sim_compute_performance-ego": 0.05156296299349877, "sim_compute_robot_state-ego": 0.054672894939299554, "sim_compute_robot_state-npc0": 0.051683841213103265, "sim_compute_robot_state-npc1": 0.04734208506922568, "sim_compute_robot_state-npc2": 0.05067984519466277, "sim_compute_robot_state-npc3": 0.04950264961488785}, "udem1-11-0": {"driven_any": 0.4098472254790859, "sim_physics": 0.14905272511874929, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054397040222266, "sim_render-ego": 0.048292321317336136, "in-drivable-lane": 0, "agent_compute-ego": 0.050507250954123104, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.07607104497797348, "deviation-center-line": 0.16731842400967326, "driven_lanedir_consec": 0.4054397040222266, "sim_compute_sim_state": 0.03018633758320528, "sim_compute_performance-ego": 0.05570457262151381, "sim_compute_robot_state-ego": 0.05548402842353372, "sim_compute_robot_state-npc0": 0.05689749296973733, "sim_compute_robot_state-npc1": 0.053264561821432674, "sim_compute_robot_state-npc2": 0.05403340564054601, "sim_compute_robot_state-npc3": 0.05321481648613425}, "udem1-12-0": {"driven_any": 1.4748273185722356, "sim_physics": 0.15415171214512416, "survival_time": 5.249999999999989, "driven_lanedir": 0.3272146444894328, "sim_render-ego": 0.04886803854079474, "in-drivable-lane": 3.7999999999999887, "agent_compute-ego": 0.05093520936511812, "deviation-heading": 0.3112188917063981, "set_robot_commands": 0.07289630572001139, "deviation-center-line": 0.16525953982768174, "driven_lanedir_consec": 0.3272146444894328, "sim_compute_sim_state": 0.02991307576497396, "sim_compute_performance-ego": 0.05346300034295945, "sim_compute_robot_state-ego": 0.05730039505731492, "sim_compute_robot_state-npc0": 0.05294777098156157, "sim_compute_robot_state-npc1": 0.05303055899483817, "sim_compute_robot_state-npc2": 0.05202201888674782, "sim_compute_robot_state-npc3": 0.05252285003662109}, "udem1-13-0": {"driven_any": 0.9948273195001724, "sim_physics": 0.14978764155139662, "survival_time": 3.649999999999995, "driven_lanedir": 0.6553480498428992, "sim_render-ego": 0.0483511016793447, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.04934162962926577, "deviation-heading": 0.7740959733116568, "set_robot_commands": 0.07235348061339496, "deviation-center-line": 0.19736301642105017, "driven_lanedir_consec": 0.6553480498428992, "sim_compute_sim_state": 0.02935082291903561, "sim_compute_performance-ego": 0.05165685692878619, "sim_compute_robot_state-ego": 0.0542762573451212, "sim_compute_robot_state-npc0": 0.052210768608197775, "sim_compute_robot_state-npc1": 0.05215663126070205, "sim_compute_robot_state-npc2": 0.05397920412560032, "sim_compute_robot_state-npc3": 0.05437666422700229}, "udem1-14-0": {"driven_any": 1.219827318592, "sim_physics": 0.15631968053904446, "survival_time": 4.399999999999992, "driven_lanedir": 0.6539905402707253, "sim_render-ego": 0.05079701271924106, "in-drivable-lane": 1.2499999999999962, "agent_compute-ego": 0.05513687567277388, "deviation-heading": 1.8192903310562811, "set_robot_commands": 0.07995225353674455, "deviation-center-line": 0.26377380229393954, "driven_lanedir_consec": 0.4674075261701268, "sim_compute_sim_state": 0.03193236751989885, "sim_compute_performance-ego": 0.05444224856116555, "sim_compute_robot_state-ego": 0.05825382471084595, "sim_compute_robot_state-npc0": 0.05541958863084966, "sim_compute_robot_state-npc1": 0.05533370917493647, "sim_compute_robot_state-npc2": 0.05594513362104243, "sim_compute_robot_state-npc3": 0.05708292668515986}}
set_robot_commands_max	0.1282354668454007
set_robot_commands_mean	0.09280786379505704
set_robot_commands_median	0.09784493764241536
set_robot_commands_min	0.06921668206491778
sim_compute_performance-ego_max	0.08606072374292321
sim_compute_performance-ego_mean	0.06583864648169073
sim_compute_performance-ego_median	0.07014022245035544
sim_compute_performance-ego_min	0.05156296299349877
sim_compute_robot_state-ego_max	0.10020158956716728
sim_compute_robot_state-ego_mean	0.07125127321590824
sim_compute_robot_state-ego_median	0.07623085339864095
sim_compute_robot_state-ego_min	0.0542762573451212
sim_compute_robot_state-npc0_max	0.08392530948192149
sim_compute_robot_state-npc0_mean	0.06571214648140761
sim_compute_robot_state-npc0_median	0.06832526524861654
sim_compute_robot_state-npc0_min	0.051683841213103265
sim_compute_robot_state-npc1_max	0.0845858771521766
sim_compute_robot_state-npc1_mean	0.06509679627298667
sim_compute_robot_state-npc1_median	0.06889717643325394
sim_compute_robot_state-npc1_min	0.04734208506922568
sim_compute_robot_state-npc2_max	0.08218845376023301
sim_compute_robot_state-npc2_mean	0.06605313881363607
sim_compute_robot_state-npc2_median	0.07094762474298477
sim_compute_robot_state-npc2_min	0.05067984519466277
sim_compute_robot_state-npc3_max	0.08472542719798046
sim_compute_robot_state-npc3_mean	0.0667531509214985
sim_compute_robot_state-npc3_median	0.07144186947796796
sim_compute_robot_state-npc3_min	0.04950264961488785
sim_compute_sim_state_max	0.04675912857055664
sim_compute_sim_state_mean	0.03703558554867882
sim_compute_sim_state_median	0.03967493933600348
sim_compute_sim_state_min	0.028220099787558277
sim_physics_max	0.26919689693966425
sim_physics_mean	0.19863569162315645
sim_physics_median	0.2044256693356997
sim_physics_min	0.14905272511874929
sim_render-ego_max	0.08049201965332031
sim_render-ego_mean	0.06034877737649316
sim_render-ego_median	0.06401057243347168
sim_render-ego_min	0.04704624606717017
simulation-passed	1
survival_time_max	9.55
survival_time_mean	3.939999999999995
survival_time_min	1.5500000000000007

No reset possible

21368

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 01:12:12+00:00

2019-04-28 02:00:08+00:00

0:47:56

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-38-104-5197-job21368/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21362

2367

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-28 01:00:57+00:00

2019-04-28 01:10:45+00:00

0:09:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.14121363434610487
agent_compute-ego_mean	0.13687431715627696
agent_compute-ego_median	0.1390286535024643
agent_compute-ego_min	0.1307742709205264
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.13547481992266058
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314897
deviation-heading_mean	0.49959867397150787
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000694
driven_any_mean	1.1068208197848532
driven_any_median	0.9410513078477724
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.826231945363564
driven_lanedir_consec_mean	0.804744013449103
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.826231945363564
driven_lanedir_mean	0.804828147320482
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2210123689868782, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.062131836444516725, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14121363434610487, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09684368326694152, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.039816826204710366, "sim_compute_performance-ego": 0.06812143627601334, "sim_compute_robot_state-ego": 0.07713435873200622, "sim_compute_robot_state-npc0": 0.06950827791721007, "sim_compute_robot_state-npc1": 0.06878006609180305, "sim_compute_robot_state-npc2": 0.06979628152485136, "sim_compute_robot_state-npc3": 0.06806805767590486}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.17823078802653722, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06031785692487445, "in-drivable-lane": 0, "agent_compute-ego": 0.13277786118643625, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09195529563086371, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03667329890387399, "sim_compute_performance-ego": 0.06500256061553955, "sim_compute_robot_state-ego": 0.06794536113739014, "sim_compute_robot_state-npc0": 0.06227210589817592, "sim_compute_robot_state-npc1": 0.06332773821694511, "sim_compute_robot_state-npc2": 0.062433293887547085, "sim_compute_robot_state-npc3": 0.06067463329860142}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1982910702529463, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06324543536288067, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14057716582585306, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10035187526813988, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03894701744746236, "sim_compute_performance-ego": 0.07142286856197616, "sim_compute_robot_state-ego": 0.07866096959530729, "sim_compute_robot_state-npc0": 0.07112028992291793, "sim_compute_robot_state-npc1": 0.0711198871575513, "sim_compute_robot_state-npc2": 0.06950784423976268, "sim_compute_robot_state-npc3": 0.06797897699967172}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22054769595464072, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.062357778350512184, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1390286535024643, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09584515790144604, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04033611714839935, "sim_compute_performance-ego": 0.07398340106010437, "sim_compute_robot_state-ego": 0.07608710726102193, "sim_compute_robot_state-npc0": 0.07074425121148427, "sim_compute_robot_state-npc1": 0.06979299088319142, "sim_compute_robot_state-npc2": 0.06833455463250478, "sim_compute_robot_state-npc3": 0.06861221293608348}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.20541025343395417, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06751172883169991, "in-drivable-lane": 0, "agent_compute-ego": 0.1307742709205264, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09494998341514951, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.038443190710885186, "sim_compute_performance-ego": 0.06981579462687175, "sim_compute_robot_state-ego": 0.07496607871282668, "sim_compute_robot_state-npc0": 0.06593567984444755, "sim_compute_robot_state-npc1": 0.07196237927391416, "sim_compute_robot_state-npc2": 0.07105055309477307, "sim_compute_robot_state-npc3": 0.06836442720322382}}
set_robot_commands_max	0.10035187526813988
set_robot_commands_mean	0.09598919909650812
set_robot_commands_median	0.09584515790144604
set_robot_commands_min	0.09195529563086371
sim_compute_performance-ego_max	0.07398340106010437
sim_compute_performance-ego_mean	0.06966921222810105
sim_compute_performance-ego_median	0.06981579462687175
sim_compute_performance-ego_min	0.06500256061553955
sim_compute_robot_state-ego_max	0.07866096959530729
sim_compute_robot_state-ego_mean	0.07495877508771046
sim_compute_robot_state-ego_median	0.07608710726102193
sim_compute_robot_state-ego_min	0.06794536113739014
sim_compute_robot_state-npc0_max	0.07112028992291793
sim_compute_robot_state-npc0_mean	0.06791612095884714
sim_compute_robot_state-npc0_median	0.06950827791721007
sim_compute_robot_state-npc0_min	0.06227210589817592
sim_compute_robot_state-npc1_max	0.07196237927391416
sim_compute_robot_state-npc1_mean	0.06899661232468102
sim_compute_robot_state-npc1_median	0.06979299088319142
sim_compute_robot_state-npc1_min	0.06332773821694511
sim_compute_robot_state-npc2_max	0.07105055309477307
sim_compute_robot_state-npc2_mean	0.06822450547588779
sim_compute_robot_state-npc2_median	0.06950784423976268
sim_compute_robot_state-npc2_min	0.062433293887547085
sim_compute_robot_state-npc3_max	0.06861221293608348
sim_compute_robot_state-npc3_mean	0.06673966162269707
sim_compute_robot_state-npc3_median	0.06806805767590486
sim_compute_robot_state-npc3_min	0.06067463329860142
sim_compute_sim_state_max	0.04033611714839935
sim_compute_sim_state_mean	0.03884329008306625
sim_compute_sim_state_median	0.03894701744746236
sim_compute_sim_state_min	0.03667329890387399
sim_physics_max	0.2210123689868782
sim_physics_mean	0.2046984353309913
sim_physics_median	0.20541025343395417
sim_physics_min	0.17823078802653722
sim_render-ego_max	0.06751172883169991
sim_render-ego_mean	0.06311292718289678
sim_render-ego_median	0.062357778350512184
sim_render-ego_min	0.06031785692487445
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

21337

2448

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 00:00:33+00:00

2019-04-28 01:00:08+00:00

0:59:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2448/step1-simulation-ip-172-31-38-104-5197-job21337/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21317

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 23:04:09+00:00

2019-04-28 00:00:09+00:00

0:56:00

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-38-104-5197-job21317/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21305

2403

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 23:00:16+00:00

2019-04-27 23:03:40+00:00

0:03:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21285

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 22:02:05+00:00

2019-04-27 23:00:08+00:00

0:58:03

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-38-104-5197-job21285/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21281

2432

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-27 22:00:58+00:00

2019-04-27 22:01:40+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21270

2444

Jacopo Tani

random_agent

step1-simulation

host-error

2019-04-27 21:53:09+00:00

2019-04-27 22:00:10+00:00

0:07:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2444/step1-simulation-ip-172-31-38-104-5197-job21270/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21249

2475

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 21:22:00+00:00

2019-04-27 21:52:34+00:00

0:30:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.17562327476648185
agent_compute-ego_mean	0.15458871850012443
agent_compute-ego_median	0.15735787391662598
agent_compute-ego_min	0.11825041142766347
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20497639873359777, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06153451038312308, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15151195888277852, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09566602525831776, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03684031208859214, "sim_compute_performance-ego": 0.06734157212172882, "sim_compute_robot_state-ego": 0.07228468339654463, "sim_compute_robot_state-npc0": 0.06403293488900873, "sim_compute_robot_state-npc1": 0.06530353691004499, "sim_compute_robot_state-npc2": 0.06507607954966871, "sim_compute_robot_state-npc3": 0.0649290265916269}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.20098954439163208, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.061732198510851176, "in-drivable-lane": 0, "agent_compute-ego": 0.16186676706586564, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.1066031541143145, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03777541433061872, "sim_compute_performance-ego": 0.07183927297592163, "sim_compute_robot_state-ego": 0.07552484955106463, "sim_compute_robot_state-npc0": 0.0700708201953343, "sim_compute_robot_state-npc1": 0.06999399832316808, "sim_compute_robot_state-npc2": 0.06983076674597603, "sim_compute_robot_state-npc3": 0.06869838067463466}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.197650589989227, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06283828124259282, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15106560420064094, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09677292305288963, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.0401213747783772, "sim_compute_performance-ego": 0.06952610062164011, "sim_compute_robot_state-ego": 0.07505144656283184, "sim_compute_robot_state-npc0": 0.06897780038778065, "sim_compute_robot_state-npc1": 0.06736315338356981, "sim_compute_robot_state-npc2": 0.06899255919225007, "sim_compute_robot_state-npc3": 0.06797263691726241}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2190614839394887, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.059119934837023415, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15546705822149912, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08525170882542928, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.035197580854098, "sim_compute_performance-ego": 0.06448636452356975, "sim_compute_robot_state-ego": 0.06886081397533417, "sim_compute_robot_state-npc0": 0.06522954006989796, "sim_compute_robot_state-npc1": 0.06695068379243214, "sim_compute_robot_state-npc2": 0.06953264772891998, "sim_compute_robot_state-npc3": 0.0638680358727773}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.16683203833443777, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.051455384209042505, "in-drivable-lane": 0, "agent_compute-ego": 0.12995003518604098, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08062259356180827, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03219422839936756, "sim_compute_performance-ego": 0.05616878327869233, "sim_compute_robot_state-ego": 0.05778920082818894, "sim_compute_robot_state-npc0": 0.05918978509448823, "sim_compute_robot_state-npc1": 0.05801944505600702, "sim_compute_robot_state-npc2": 0.05851724034263974, "sim_compute_robot_state-npc3": 0.05675370352608817}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.15629399036932848, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.04881722912816944, "in-drivable-lane": 2, "agent_compute-ego": 0.11825041142766347, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.07719129002736715, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03134313029443433, "sim_compute_performance-ego": 0.05220657765508411, "sim_compute_robot_state-ego": 0.05719452846549942, "sim_compute_robot_state-npc0": 0.06060241510768136, "sim_compute_robot_state-npc1": 0.055239149196419174, "sim_compute_robot_state-npc2": 0.05332609993255067, "sim_compute_robot_state-npc3": 0.05542403780771587}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2201375104848621, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06494012619685201, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15543146966730506, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09829276047864006, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04279162351367543, "sim_compute_performance-ego": 0.07040358978567772, "sim_compute_robot_state-ego": 0.07511670149645759, "sim_compute_robot_state-npc0": 0.07059124141063505, "sim_compute_robot_state-npc1": 0.07055229585147599, "sim_compute_robot_state-npc2": 0.06939885222796098, "sim_compute_robot_state-npc3": 0.07221438352344106}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.22706176280975343, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06089950084686279, "in-drivable-lane": 0, "agent_compute-ego": 0.156759090423584, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09827471256256104, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.040150785446166994, "sim_compute_performance-ego": 0.07007638931274414, "sim_compute_robot_state-ego": 0.07560525894165039, "sim_compute_robot_state-npc0": 0.07151430606842041, "sim_compute_robot_state-npc1": 0.06905033588409423, "sim_compute_robot_state-npc2": 0.06941576957702637, "sim_compute_robot_state-npc3": 0.06911779880523682}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2520918525182284, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.0699398059111375, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.17562327476648185, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.11155071625342736, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.044301390647888184, "sim_compute_performance-ego": 0.07816911660707913, "sim_compute_robot_state-ego": 0.0912432991541349, "sim_compute_robot_state-npc0": 0.07381359888957097, "sim_compute_robot_state-npc1": 0.07626189635350154, "sim_compute_robot_state-npc2": 0.07454692400418796, "sim_compute_robot_state-npc3": 0.07666662106147179}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.27489867577186, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.0676893087533804, "in-drivable-lane": 0, "agent_compute-ego": 0.16540790521181548, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.10533932539132926, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.039592238572927624, "sim_compute_performance-ego": 0.07246797818403977, "sim_compute_robot_state-ego": 0.08415287274580735, "sim_compute_robot_state-npc0": 0.07655672843639667, "sim_compute_robot_state-npc1": 0.0758296984892625, "sim_compute_robot_state-npc2": 0.07479901497180645, "sim_compute_robot_state-npc3": 0.07451956088726337}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.22507334839213977, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.062258005142211914, "in-drivable-lane": 0, "agent_compute-ego": 0.16357917135412042, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10215521942485464, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04079974781383167, "sim_compute_performance-ego": 0.0710187175057151, "sim_compute_robot_state-ego": 0.07426086339083585, "sim_compute_robot_state-npc0": 0.06747125495563853, "sim_compute_robot_state-npc1": 0.06948464567011053, "sim_compute_robot_state-npc2": 0.0661794597452337, "sim_compute_robot_state-npc3": 0.06986871632662686}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.201410813331604, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06433093070983886, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15735787391662598, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0962220859527588, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.038902420997619626, "sim_compute_performance-ego": 0.07151634693145752, "sim_compute_robot_state-ego": 0.07621761322021485, "sim_compute_robot_state-npc0": 0.07169725418090821, "sim_compute_robot_state-npc1": 0.06960480213165283, "sim_compute_robot_state-npc2": 0.067944974899292, "sim_compute_robot_state-npc3": 0.07031362056732178}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20355261893982585, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06476386810870881, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15890372560379354, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.1035087210066775, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.039814644671501, "sim_compute_performance-ego": 0.06972198029781909, "sim_compute_robot_state-ego": 0.07700559179833595, "sim_compute_robot_state-npc0": 0.07046631802903845, "sim_compute_robot_state-npc1": 0.06997901835340134, "sim_compute_robot_state-npc2": 0.07138158159053072, "sim_compute_robot_state-npc3": 0.07265638797841173}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.22479298940071693, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06474269353426419, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16025575766196615, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10450397087977482, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04003965396147508, "sim_compute_performance-ego": 0.07197650579305795, "sim_compute_robot_state-ego": 0.08255593134806706, "sim_compute_robot_state-npc0": 0.07184870426471417, "sim_compute_robot_state-npc1": 0.07268847868992732, "sim_compute_robot_state-npc2": 0.06975043278474075, "sim_compute_robot_state-npc3": 0.07323642877432016}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1984400136130197, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06466942741757348, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.15740067391168502, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.10317528134300596, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.041227050054640994, "sim_compute_performance-ego": 0.0713107290722075, "sim_compute_robot_state-ego": 0.07518640018644787, "sim_compute_robot_state-npc0": 0.07054937680562337, "sim_compute_robot_state-npc1": 0.07079626265026275, "sim_compute_robot_state-npc2": 0.07072872207278297, "sim_compute_robot_state-npc3": 0.07016440800258092}}
set_robot_commands_max	0.11155071625342736
set_robot_commands_mean	0.09767536587554372
set_robot_commands_median	0.09829276047864006
set_robot_commands_min	0.07719129002736715
sim_compute_performance-ego_max	0.07816911660707913
sim_compute_performance-ego_mean	0.06854866831109564
sim_compute_performance-ego_median	0.07040358978567772
sim_compute_performance-ego_min	0.05220657765508411
sim_compute_robot_state-ego_max	0.0912432991541349
sim_compute_robot_state-ego_mean	0.0745366703374277
sim_compute_robot_state-ego_median	0.07518640018644787
sim_compute_robot_state-ego_min	0.05719452846549942
sim_compute_robot_state-npc0_max	0.07655672843639667
sim_compute_robot_state-npc0_mean	0.06884080525234247
sim_compute_robot_state-npc0_median	0.07046631802903845
sim_compute_robot_state-npc0_min	0.05918978509448823
sim_compute_robot_state-npc1_max	0.07626189635350154
sim_compute_robot_state-npc1_mean	0.06847449338235537
sim_compute_robot_state-npc1_median	0.06960480213165283
sim_compute_robot_state-npc1_min	0.055239149196419174
sim_compute_robot_state-npc2_max	0.07479901497180645
sim_compute_robot_state-npc2_mean	0.06796140835770446
sim_compute_robot_state-npc2_median	0.06941576957702637
sim_compute_robot_state-npc2_min	0.05332609993255067
sim_compute_robot_state-npc3_max	0.07666662106147179
sim_compute_robot_state-npc3_mean	0.06842691648778533
sim_compute_robot_state-npc3_median	0.06986871632662686
sim_compute_robot_state-npc3_min	0.05542403780771587
sim_compute_sim_state_max	0.044301390647888184
sim_compute_sim_state_mean	0.03873943976168097
sim_compute_sim_state_median	0.039814644671501
sim_compute_sim_state_min	0.03134313029443433
sim_physics_max	0.27489867577186
sim_physics_mean	0.21155090873464813
sim_physics_median	0.20497639873359777
sim_physics_min	0.15629399036932848
sim_render-ego_max	0.0699398059111375
sim_render-ego_mean	0.061982080328775495
sim_render-ego_median	0.06283828124259282
sim_render-ego_min	0.04881722912816944
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21216

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 21:04:06+00:00

2019-04-27 21:21:43+00:00

0:17:37

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17804435447410302
agent_compute-ego_mean	0.1611448002383949
agent_compute-ego_median	0.160370761272954
agent_compute-ego_min	0.14719666481018068
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11924137009514704, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06363453246929028, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16204192020274974, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.101768105118363, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03970766067504883, "sim_compute_performance-ego": 0.07185668415493435, "sim_compute_robot_state-ego": 0.07663982002823441}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11443616829666436, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06507405580258836, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1639734950720095, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1013957332162296, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04221015817978803, "sim_compute_performance-ego": 0.07375056603375603, "sim_compute_robot_state-ego": 0.07956947999842026}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1259150645312141, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06753047774819766, "in-drivable-lane": 0, "agent_compute-ego": 0.16548769614275763, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10062899309046128, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04045591634862563, "sim_compute_performance-ego": 0.07076700995950137, "sim_compute_robot_state-ego": 0.07343574131236356}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1232602882385254, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.059963502883911134, "in-drivable-lane": 0, "agent_compute-ego": 0.14719666481018068, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09800049781799317, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.039007253646850586, "sim_compute_performance-ego": 0.06876167297363281, "sim_compute_robot_state-ego": 0.07266348838806153}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11488610883302326, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0632854111586945, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16117573086219497, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10342566574676128, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04018676733668847, "sim_compute_performance-ego": 0.07300470448747466, "sim_compute_robot_state-ego": 0.08198028878320622}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11596048121549646, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06305066906676, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15882771355765207, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09962756779729104, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04106886046273368, "sim_compute_performance-ego": 0.07263009402216697, "sim_compute_robot_state-ego": 0.08357297157754703}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.121626900775092, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06348726153373718, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1576620808669499, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10085569534982954, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.039626623903002055, "sim_compute_performance-ego": 0.07044361318860735, "sim_compute_robot_state-ego": 0.07563090750149318}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.1379937557947068, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06514053117661249, "in-drivable-lane": 0, "agent_compute-ego": 0.1647674015590123, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10584587142581033, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.039583955492292135, "sim_compute_performance-ego": 0.07616030602228074, "sim_compute_robot_state-ego": 0.07998096375238328}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.12377037840374444, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06805265555947514, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15888705496060646, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09803389290631828, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.040149248252480715, "sim_compute_performance-ego": 0.07227350897708182, "sim_compute_robot_state-ego": 0.07797736636662887}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12877704013477673, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06461332494562322, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1582037622278387, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09917577396739612, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03948316574096679, "sim_compute_performance-ego": 0.07435580600391735, "sim_compute_robot_state-ego": 0.0772526741027832}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13516513712994463, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.0646005884393469, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15851706963080864, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.09915267027817765, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04050988655585747, "sim_compute_performance-ego": 0.07002105031694685, "sim_compute_robot_state-ego": 0.07988770286758225}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12481420380728583, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06644772631781441, "in-drivable-lane": 0, "agent_compute-ego": 0.16386170046670095, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10793466227395196, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.041984149387904575, "sim_compute_performance-ego": 0.07397875615528651, "sim_compute_robot_state-ego": 0.08099193232400077}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12712998016207827, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06350972138199151, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.160370761272954, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09764447866701612, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.038639222874360925, "sim_compute_performance-ego": 0.07092390808404661, "sim_compute_robot_state-ego": 0.08246680801989985}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13792288744891132, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06380567727265535, "in-drivable-lane": 0, "agent_compute-ego": 0.17804435447410302, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10693490063702618, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.041549285252889, "sim_compute_performance-ego": 0.07317807939317492, "sim_compute_robot_state-ego": 0.0814795935595477}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12540058528675752, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06217552166359097, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15815459746940463, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.109421641218896, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03982307396683039, "sim_compute_performance-ego": 0.07062864069845162, "sim_compute_robot_state-ego": 0.07645125482596603}}
set_robot_commands_max	0.109421641218896
set_robot_commands_mean	0.10198974330076808
set_robot_commands_median	0.10085569534982954
set_robot_commands_min	0.09764447866701612
sim_compute_performance-ego_max	0.07616030602228074
sim_compute_performance-ego_mean	0.07218229336475065
sim_compute_performance-ego_median	0.07227350897708182
sim_compute_performance-ego_min	0.06876167297363281
sim_compute_robot_state-ego_max	0.08357297157754703
sim_compute_robot_state-ego_mean	0.07866539956054122
sim_compute_robot_state-ego_median	0.07956947999842026
sim_compute_robot_state-ego_min	0.07266348838806153
sim_compute_sim_state_max	0.04221015817978803
sim_compute_sim_state_mean	0.04026568187175462
sim_compute_sim_state_median	0.040149248252480715
sim_compute_sim_state_min	0.038639222874360925
sim_physics_max	0.1379937557947068
sim_physics_mean	0.12508669001022454
sim_physics_median	0.12481420380728583
sim_physics_min	0.11443616829666436
sim_render-ego_max	0.06805265555947514
sim_render-ego_mean	0.06429144382801927
sim_render-ego_median	0.06380567727265535
sim_render-ego_min	0.059963502883911134
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21201

2528

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-27 21:00:21+00:00

2019-04-27 21:03:54+00:00

0:03:33

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21184

2564

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-27 20:34:16+00:00

2019-04-27 21:00:04+00:00

0:25:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2564/step1-simulation-ip-172-31-38-104-5197-job21184/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21180

2569

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:23:23+00:00

2019-04-27 20:33:47+00:00

0:10:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4702323960536803
survival_time_median	2.849999999999998
deviation-center-line_median	0.13623952041905
in-drivable-lane_median	0.7999999999999976

other stats

agent_compute-ego_max	0.08355263257638001
agent_compute-ego_mean	0.07889600811509093
agent_compute-ego_median	0.07870648200051826
agent_compute-ego_min	0.0753083436385445
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.16546426353561405
deviation-center-line_min	0.07144385614371519
deviation-heading_max	1.2111022380750738
deviation-heading_mean	0.8262001110734373
deviation-heading_median	0.7978002362162198
deviation-heading_min	0.39989969254594865
driven_any_max	1.093753441791869
driven_any_mean	0.7182169120135662
driven_any_median	0.8072381933001392
driven_any_min	0.29795781475632777
driven_lanedir_consec_max	0.6735785385729686
driven_lanedir_consec_mean	0.4271077107010905
driven_lanedir_consec_min	0.2312609677194346
driven_lanedir_max	0.6758329617605024
driven_lanedir_mean	0.4275585953385973
driven_lanedir_median	0.4702323960536803
driven_lanedir_min	0.2312609677194346
in-drivable-lane_max	1.6499999999999957
in-drivable-lane_mean	0.7199999999999979
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2346831689397973, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06818781703351492, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07697858580623765, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.10718534366194024, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.0440225543746029, "sim_compute_performance-ego": 0.07454712132373488, "sim_compute_robot_state-ego": 0.08300630155816136, "sim_compute_robot_state-npc0": 0.07569709743361876, "sim_compute_robot_state-npc1": 0.076439472566168, "sim_compute_robot_state-npc2": 0.07761031748300576, "sim_compute_robot_state-npc3": 0.07504352604050234}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.22952164543999565, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06631099736249005, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07993399655377423, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.10417190304508916, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03967440569842303, "sim_compute_performance-ego": 0.07324913696006492, "sim_compute_robot_state-ego": 0.07874297212671351, "sim_compute_robot_state-npc0": 0.07172385851542155, "sim_compute_robot_state-npc1": 0.0729042512399179, "sim_compute_robot_state-npc2": 0.07456181667469165, "sim_compute_robot_state-npc3": 0.07599331714488843}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.2694596082736284, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.07104947628119053, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.08355263257638001, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10940558788103937, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.043148089677859575, "sim_compute_performance-ego": 0.07799867483285758, "sim_compute_robot_state-ego": 0.09324420109773292, "sim_compute_robot_state-npc0": 0.07631860635219476, "sim_compute_robot_state-npc1": 0.0760730688388531, "sim_compute_robot_state-npc2": 0.07675885542845115, "sim_compute_robot_state-npc3": 0.07644074391096066}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.2525356317821302, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06887234721267432, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07870648200051826, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10662453634697094, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.0446846694277044, "sim_compute_performance-ego": 0.07454693108274225, "sim_compute_robot_state-ego": 0.08694108327229817, "sim_compute_robot_state-npc0": 0.07627505168580172, "sim_compute_robot_state-npc1": 0.07674021051641096, "sim_compute_robot_state-npc2": 0.07733426177710817, "sim_compute_robot_state-npc3": 0.0787063439687093}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.25423393042191217, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.06979875979216202, "in-drivable-lane": 0, "agent_compute-ego": 0.0753083436385445, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.11197414605513864, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.043686991152556046, "sim_compute_performance-ego": 0.07464573694312054, "sim_compute_robot_state-ego": 0.08128313396288, "sim_compute_robot_state-npc0": 0.0790914245273756, "sim_compute_robot_state-npc1": 0.07833002961200217, "sim_compute_robot_state-npc2": 0.07973010643668797, "sim_compute_robot_state-npc3": 0.07827275732289189}}
set_robot_commands_max	0.11197414605513864
set_robot_commands_mean	0.10787230339803566
set_robot_commands_median	0.10718534366194024
set_robot_commands_min	0.10417190304508916
sim_compute_performance-ego_max	0.07799867483285758
sim_compute_performance-ego_mean	0.07499752022850403
sim_compute_performance-ego_median	0.07454712132373488
sim_compute_performance-ego_min	0.07324913696006492
sim_compute_robot_state-ego_max	0.09324420109773292
sim_compute_robot_state-ego_mean	0.08464353840355719
sim_compute_robot_state-ego_median	0.08300630155816136
sim_compute_robot_state-ego_min	0.07874297212671351
sim_compute_robot_state-npc0_max	0.0790914245273756
sim_compute_robot_state-npc0_mean	0.07582120770288248
sim_compute_robot_state-npc0_median	0.07627505168580172
sim_compute_robot_state-npc0_min	0.07172385851542155
sim_compute_robot_state-npc1_max	0.07833002961200217
sim_compute_robot_state-npc1_mean	0.07609740655467043
sim_compute_robot_state-npc1_median	0.076439472566168
sim_compute_robot_state-npc1_min	0.0729042512399179
sim_compute_robot_state-npc2_max	0.07973010643668797
sim_compute_robot_state-npc2_mean	0.07719907155998895
sim_compute_robot_state-npc2_median	0.07733426177710817
sim_compute_robot_state-npc2_min	0.07456181667469165
sim_compute_robot_state-npc3_max	0.0787063439687093
sim_compute_robot_state-npc3_mean	0.07689133767759052
sim_compute_robot_state-npc3_median	0.07644074391096066
sim_compute_robot_state-npc3_min	0.07504352604050234
sim_compute_sim_state_max	0.0446846694277044
sim_compute_sim_state_mean	0.04304334206622919
sim_compute_sim_state_median	0.043686991152556046
sim_compute_sim_state_min	0.03967440569842303
sim_physics_max	0.2694596082736284
sim_physics_mean	0.2480867969714927
sim_physics_median	0.2525356317821302
sim_physics_min	0.22952164543999565
sim_render-ego_max	0.07104947628119053
sim_render-ego_mean	0.06884387953640636
sim_render-ego_median	0.06887234721267432
sim_render-ego_min	0.06631099736249005
simulation-passed	1
survival_time_max	4.149999999999993
survival_time_mean	2.679999999999997
survival_time_min	1.1500000000000004

No reset possible

21177

2601

FANG MEIYI 🇸🇬

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 20:05:56+00:00

2019-04-27 20:23:16+00:00

0:17:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.26048344890917
survival_time_median	8.14999999999998
deviation-center-line_median	0.26920179552240436
in-drivable-lane_median	1.3499999999999952

other stats

agent_compute-ego_max	0.18905195283012155
agent_compute-ego_mean	0.18310671679198703
agent_compute-ego_median	0.18366289883852005
agent_compute-ego_min	0.1783310870329539
deviation-center-line_max	0.4255930940272569
deviation-center-line_mean	0.2899658183768261
deviation-center-line_min	0.22807489875595788
deviation-heading_max	1.935637478531224
deviation-heading_mean	1.2982476410843766
deviation-heading_median	1.243392293685051
deviation-heading_min	0.8062847745201686
driven_any_max	1.9131295130288353
driven_any_mean	1.569994877144241
driven_any_median	1.5999132095376885
driven_any_min	1.067779332243036
driven_lanedir_consec_max	1.526668131277779
driven_lanedir_consec_mean	1.1558568706691106
driven_lanedir_consec_min	0.7805040356819516
driven_lanedir_max	1.526668131277779
driven_lanedir_mean	1.1574845350779028
driven_lanedir_median	1.2629464042512046
driven_lanedir_min	0.7805040356819516
in-drivable-lane_max	6.400000000000029
in-drivable-lane_mean	2.1600000000000046
in-drivable-lane_min	0.5999999999999979
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9131295130288353, "sim_physics": 0.1255755859967236, "survival_time": 10.95000000000002, "driven_lanedir": 0.7805040356819516, "sim_render-ego": 0.06760386571492234, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.1851198270440646, "deviation-heading": 1.243392293685051, "set_robot_commands": 0.1081623573825784, "deviation-center-line": 0.22807489875595788, "driven_lanedir_consec": 0.7805040356819516, "sim_compute_sim_state": 0.04179673652126365, "sim_compute_performance-ego": 0.07675336485039698, "sim_compute_robot_state-ego": 0.08791689785648155}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.067779332243036, "sim_physics": 0.12230321433809067, "survival_time": 5.399999999999989, "driven_lanedir": 0.9486823332254474, "sim_render-ego": 0.06869945702729402, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.17936781821427522, "deviation-heading": 0.8062847745201686, "set_robot_commands": 0.1098117298550076, "deviation-center-line": 0.26920179552240436, "driven_lanedir_consec": 0.9486823332254474, "sim_compute_sim_state": 0.04208851743627478, "sim_compute_performance-ego": 0.07497918164288556, "sim_compute_robot_state-ego": 0.08268626310207226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6739757368658743, "sim_physics": 0.13280371541068667, "survival_time": 8.399999999999984, "driven_lanedir": 1.526668131277779, "sim_render-ego": 0.06818626040504092, "in-drivable-lane": 0.8000000000000034, "agent_compute-ego": 0.1783310870329539, "deviation-heading": 1.1842200225537258, "set_robot_commands": 0.10893669440632776, "deviation-center-line": 0.4255930940272569, "driven_lanedir_consec": 1.526668131277779, "sim_compute_sim_state": 0.04191798539388747, "sim_compute_performance-ego": 0.07685844245411101, "sim_compute_robot_state-ego": 0.08713806385085696}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5951765940457696, "sim_physics": 0.13319475811683326, "survival_time": 8.14999999999998, "driven_lanedir": 1.2629464042512046, "sim_render-ego": 0.06815534281584383, "in-drivable-lane": 1.649999999999996, "agent_compute-ego": 0.18905195283012155, "deviation-heading": 1.3217036361317136, "set_robot_commands": 0.11274084723068892, "deviation-center-line": 0.24892274851068152, "driven_lanedir_consec": 1.2629464042512046, "sim_compute_sim_state": 0.043092686705794074, "sim_compute_performance-ego": 0.07626807177725013, "sim_compute_robot_state-ego": 0.08750093787725717}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5999132095376885, "sim_physics": 0.13251658529043198, "survival_time": 7.99999999999998, "driven_lanedir": 1.268621770953132, "sim_render-ego": 0.06748930215835572, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.18366289883852005, "deviation-heading": 1.935637478531224, "set_robot_commands": 0.1096622422337532, "deviation-center-line": 0.27803655506782987, "driven_lanedir_consec": 1.26048344890917, "sim_compute_sim_state": 0.04221761226654053, "sim_compute_performance-ego": 0.07582865059375762, "sim_compute_robot_state-ego": 0.08702029287815094}}
set_robot_commands_max	0.11274084723068892
set_robot_commands_mean	0.10986277422167116
set_robot_commands_median	0.1096622422337532
set_robot_commands_min	0.1081623573825784
sim_compute_performance-ego_max	0.07685844245411101
sim_compute_performance-ego_mean	0.07613754226368026
sim_compute_performance-ego_median	0.07626807177725013
sim_compute_performance-ego_min	0.07497918164288556
sim_compute_robot_state-ego_max	0.08791689785648155
sim_compute_robot_state-ego_mean	0.08645249111296377
sim_compute_robot_state-ego_median	0.08713806385085696
sim_compute_robot_state-ego_min	0.08268626310207226
sim_compute_sim_state_max	0.043092686705794074
sim_compute_sim_state_mean	0.0422227076647521
sim_compute_sim_state_median	0.04208851743627478
sim_compute_sim_state_min	0.04179673652126365
sim_physics_max	0.13319475811683326
sim_physics_mean	0.12927877183055322
sim_physics_median	0.13251658529043198
sim_physics_min	0.12230321433809067
sim_render-ego_max	0.06869945702729402
sim_render-ego_mean	0.06802684562429136
sim_render-ego_median	0.06815534281584383
sim_render-ego_min	0.06748930215835572
simulation-passed	1
survival_time_max	10.95000000000002
survival_time_mean	8.17999999999999
survival_time_min	5.399999999999989

No reset possible

21165

2864

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 20:02:30+00:00

2019-04-27 20:03:53+00:00

0:01:23

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21159

2590

baseline-IL-logs-tensorflow

step1-simulation

error

2019-04-27 20:00:27+00:00

2019-04-27 20:02:17+00:00

0:01:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21121

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 19:04:57+00:00

2019-04-27 20:00:12+00:00

0:55:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-38-104-5197-job21121/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21090

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 18:04:05+00:00

2019-04-27 19:00:11+00:00

0:56:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5197-job21090/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21010

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 17:00:23+00:00

2019-04-27 18:00:11+00:00

0:59:48

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-38-104-5197-job21010/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20971

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 16:10:26+00:00

2019-04-27 17:00:04+00:00

0:49:38

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2880/step1-simulation-ip-172-31-38-104-5197-job20971/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20955

2871

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 16:00:17+00:00

2019-04-27 16:10:05+00:00

0:09:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3126963178433666
survival_time_median	2.8999999999999977
deviation-center-line_median	0.14079018765617296
in-drivable-lane_median	0.6999999999999983

other stats

agent_compute-ego_max	0.18736653081301985
agent_compute-ego_mean	0.177683667242092
agent_compute-ego_median	0.17864837185029062
agent_compute-ego_min	0.16103075572422573
deviation-center-line_max	0.2166895756843735
deviation-center-line_mean	0.14683816837624294
deviation-center-line_min	0.09726772364609684
deviation-heading_max	1.3925031660048135
deviation-heading_mean	0.7746282473903454
deviation-heading_median	0.5790775521619101
deviation-heading_min	0.18039594346608664
driven_any_max	1.9676980582112489
driven_any_mean	1.132845484522633
driven_any_median	1.139570739895851
driven_any_min	0.4904773036854176
driven_lanedir_consec_max	0.9471588657610636
driven_lanedir_consec_mean	0.5033144458129379
driven_lanedir_consec_min	0.15772741553928735
driven_lanedir_max	1.0447876098601054
driven_lanedir_mean	0.6363432295068499
driven_lanedir_median	0.6112242109872037
driven_lanedir_min	0.24806427383520635
in-drivable-lane_max	1.2999999999999976
in-drivable-lane_mean	0.7799999999999987
in-drivable-lane_min	0.40000000000000024
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4904773036854176, "sim_physics": 0.12052553699862573, "survival_time": 1.5500000000000007, "driven_lanedir": 0.24806427383520635, "sim_render-ego": 0.06448994913408833, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.17864837185029062, "deviation-heading": 0.5790775521619101, "set_robot_commands": 0.09748680360855597, "deviation-center-line": 0.1118528706291064, "driven_lanedir_consec": 0.15772741553928735, "sim_compute_sim_state": 0.038283932593560985, "sim_compute_performance-ego": 0.07332851040747858, "sim_compute_robot_state-ego": 0.0799457642339891}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9676980582112489, "sim_physics": 0.1241977242536323, "survival_time": 4.299999999999993, "driven_lanedir": 1.0447876098601054, "sim_render-ego": 0.06427211539689885, "in-drivable-lane": 1.2999999999999976, "agent_compute-ego": 0.18522883016009664, "deviation-heading": 1.3925031660048135, "set_robot_commands": 0.10139911119327988, "deviation-center-line": 0.2166895756843735, "driven_lanedir_consec": 0.7985475135853322, "sim_compute_sim_state": 0.03949212750723196, "sim_compute_performance-ego": 0.06841989727907402, "sim_compute_robot_state-ego": 0.078943366228148}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.139570739895851, "sim_physics": 0.12289397469882309, "survival_time": 2.8999999999999977, "driven_lanedir": 0.6112242109872037, "sim_render-ego": 0.06278747936774945, "in-drivable-lane": 0.6999999999999983, "agent_compute-ego": 0.18736653081301985, "deviation-heading": 1.223335833057294, "set_robot_commands": 0.10142530243972252, "deviation-center-line": 0.14079018765617296, "driven_lanedir_consec": 0.30044211633563966, "sim_compute_sim_state": 0.03961186984489704, "sim_compute_performance-ego": 0.07180164189174257, "sim_compute_robot_state-ego": 0.078026977078668}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.640839425762224, "sim_physics": 0.11385064125061035, "survival_time": 1.7500000000000009, "driven_lanedir": 0.3304811870906703, "sim_render-ego": 0.05453049795968192, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16103075572422573, "deviation-heading": 0.4978287422616228, "set_robot_commands": 0.09326673235212052, "deviation-center-line": 0.09726772364609684, "driven_lanedir_consec": 0.3126963178433666, "sim_compute_sim_state": 0.0363283566066197, "sim_compute_performance-ego": 0.0638897146497454, "sim_compute_robot_state-ego": 0.06601508004324777}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4256418950584235, "sim_physics": 0.11935433848150843, "survival_time": 2.8999999999999977, "driven_lanedir": 0.9471588657610636, "sim_render-ego": 0.06028819495233996, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.17614384766282706, "deviation-heading": 0.18039594346608664, "set_robot_commands": 0.09600523011437778, "deviation-center-line": 0.16759048426546508, "driven_lanedir_consec": 0.9471588657610636, "sim_compute_sim_state": 0.03751467014181203, "sim_compute_performance-ego": 0.06678087546907623, "sim_compute_robot_state-ego": 0.07608763924960432}}
set_robot_commands_max	0.10142530243972252
set_robot_commands_mean	0.09791663594161132
set_robot_commands_median	0.09748680360855597
set_robot_commands_min	0.09326673235212052
sim_compute_performance-ego_max	0.07332851040747858
sim_compute_performance-ego_mean	0.06884412793942336
sim_compute_performance-ego_median	0.06841989727907402
sim_compute_performance-ego_min	0.0638897146497454
sim_compute_robot_state-ego_max	0.0799457642339891
sim_compute_robot_state-ego_mean	0.07580376536673145
sim_compute_robot_state-ego_median	0.078026977078668
sim_compute_robot_state-ego_min	0.06601508004324777
sim_compute_sim_state_max	0.03961186984489704
sim_compute_sim_state_mean	0.03824619133882434
sim_compute_sim_state_median	0.038283932593560985
sim_compute_sim_state_min	0.0363283566066197
sim_physics_max	0.1241977242536323
sim_physics_mean	0.12016444313664
sim_physics_median	0.12052553699862573
sim_physics_min	0.11385064125061035
sim_render-ego_max	0.06448994913408833
sim_render-ego_mean	0.061273647362151705
sim_render-ego_median	0.06278747936774945
sim_render-ego_min	0.05453049795968192
simulation-passed	1
survival_time_max	4.299999999999993
survival_time_mean	2.6799999999999984
survival_time_min	1.5500000000000007

No reset possible

20922

3074

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 15:01:38+00:00

2019-04-27 16:00:11+00:00

0:58:33

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-38-104-5197-job20922/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20910

2937

aido2-LFV-sim-validation

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 15:00:28+00:00

2019-04-27 15:01:02+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20909

2953

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 14:58:56+00:00

2019-04-27 15:00:14+00:00

0:01:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2953/step1-simulation-ip-172-31-38-104-5197-job20909/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20857

3070

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 14:00:30+00:00

2019-04-27 14:58:39+00:00

0:58:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6437574405419284
survival_time_median	10.90000000000002
deviation-center-line_median	0.5315058582429218
in-drivable-lane_median	1.1499999999999997

other stats

agent_compute-ego_max	0.23006261080160909
agent_compute-ego_mean	0.22048254803124528
agent_compute-ego_median	0.2187449505569738
agent_compute-ego_min	0.2113943503748986
deviation-center-line_max	1.462063633216783
deviation-center-line_mean	0.6148474425038657
deviation-center-line_min	0.33185961220450144
deviation-heading_max	3.704364251748398
deviation-heading_mean	1.4953421527443462
deviation-heading_median	1.5276729151828152
deviation-heading_min	0.3215506240716209
driven_any_max	1.40250006140616
driven_any_mean	0.9812502890670418
driven_any_median	0.9938532861127236
driven_any_min	0.3020141433337549
driven_lanedir_consec_max	1.4019519912079614
driven_lanedir_consec_mean	0.7711953551590942
driven_lanedir_consec_min	0.29586949164623233
driven_lanedir_max	1.4019519912079614
driven_lanedir_mean	0.7711953551590942
driven_lanedir_median	0.6437574405419284
driven_lanedir_min	0.29586949164623233
in-drivable-lane_max	6.100000000000087
in-drivable-lane_mean	1.9666666666666897
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.992849196181698, "sim_physics": 0.1152195132106816, "survival_time": 10.90000000000002, "driven_lanedir": 0.6282954628153101, "sim_render-ego": 0.06198606250482962, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.2187449505569738, "deviation-heading": 1.0275745360158686, "set_robot_commands": 0.09984030198613436, "deviation-center-line": 0.5315058582429218, "driven_lanedir_consec": 0.6282954628153101, "sim_compute_sim_state": 0.04009065824911135, "sim_compute_performance-ego": 0.0710636913229566, "sim_compute_robot_state-ego": 0.07523911480509907}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0305006323911028, "sim_physics": 0.10648860340624784, "survival_time": 11.300000000000026, "driven_lanedir": 0.8347490608480415, "sim_render-ego": 0.06435334154989868, "in-drivable-lane": 1.1499999999999997, "agent_compute-ego": 0.2293497028604018, "deviation-heading": 3.704364251748398, "set_robot_commands": 0.10050528450349792, "deviation-center-line": 0.9865112178486956, "driven_lanedir_consec": 0.8347490608480415, "sim_compute_sim_state": 0.04005434344300127, "sim_compute_performance-ego": 0.07244523331127335, "sim_compute_robot_state-ego": 0.08144655797333844}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3020141433337549, "sim_physics": 0.12190368813528142, "survival_time": 3.5499999999999954, "driven_lanedir": 0.29586949164623233, "sim_render-ego": 0.06395151917363556, "in-drivable-lane": 0, "agent_compute-ego": 0.22977009625502037, "deviation-heading": 0.7277591566799358, "set_robot_commands": 0.10179170420472052, "deviation-center-line": 0.38194995900442624, "driven_lanedir_consec": 0.29586949164623233, "sim_compute_sim_state": 0.040251943427072445, "sim_compute_performance-ego": 0.07018346853659187, "sim_compute_robot_state-ego": 0.07930144121949102}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5515856607462154, "sim_physics": 0.12009592786911996, "survival_time": 6.199999999999986, "driven_lanedir": 0.5352817456313406, "sim_render-ego": 0.06402089134339363, "in-drivable-lane": 0, "agent_compute-ego": 0.2113943503748986, "deviation-heading": 1.518929060594277, "set_robot_commands": 0.09223170242001934, "deviation-center-line": 0.4505797401070413, "driven_lanedir_consec": 0.5352817456313406, "sim_compute_sim_state": 0.03886782738470262, "sim_compute_performance-ego": 0.07060052310266803, "sim_compute_robot_state-ego": 0.0733091119796999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.374385705608073, "sim_physics": 0.1252168599764506, "survival_time": 14.950000000000076, "driven_lanedir": 0.7953369901813234, "sim_render-ego": 0.06409749666849772, "in-drivable-lane": 6.100000000000087, "agent_compute-ego": 0.2279223903020223, "deviation-heading": 0.9765136013979782, "set_robot_commands": 0.09815956751505532, "deviation-center-line": 0.8304615806379783, "driven_lanedir_consec": 0.7953369901813234, "sim_compute_sim_state": 0.03976701339085897, "sim_compute_performance-ego": 0.0717164929707845, "sim_compute_robot_state-ego": 0.08011517842610677}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.5181575616940716, "sim_physics": 0.1115294032626682, "survival_time": 5.849999999999987, "driven_lanedir": 0.4973334314693405, "sim_render-ego": 0.06157549629863511, "in-drivable-lane": 0, "agent_compute-ego": 0.21357485575553695, "deviation-heading": 1.6751434493101007, "set_robot_commands": 0.0968618637476212, "deviation-center-line": 0.4275352079758014, "driven_lanedir_consec": 0.4973334314693405, "sim_compute_sim_state": 0.038181019644451954, "sim_compute_performance-ego": 0.0677600294096857, "sim_compute_robot_state-ego": 0.07275117564405131}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.053678700213212, "sim_physics": 0.10667985833209494, "survival_time": 11.500000000000028, "driven_lanedir": 0.5081096215228733, "sim_render-ego": 0.06331293064615001, "in-drivable-lane": 5.550000000000042, "agent_compute-ego": 0.22219782912212868, "deviation-heading": 1.5899464031122337, "set_robot_commands": 0.09522768829179848, "deviation-center-line": 0.4241907458385325, "driven_lanedir_consec": 0.5081096215228733, "sim_compute_sim_state": 0.03894917653954547, "sim_compute_performance-ego": 0.06995961562446926, "sim_compute_robot_state-ego": 0.07514907380808955}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.37516850510460087, "sim_physics": 0.1225301561684444, "survival_time": 4.3499999999999925, "driven_lanedir": 0.3700370903016176, "sim_render-ego": 0.06127142084055934, "in-drivable-lane": 0, "agent_compute-ego": 0.23006261080160909, "deviation-heading": 0.7325346217568841, "set_robot_commands": 0.09986766179402667, "deviation-center-line": 0.46228683937390175, "driven_lanedir_consec": 0.3700370903016176, "sim_compute_sim_state": 0.04031620080443634, "sim_compute_performance-ego": 0.06988125833971746, "sim_compute_robot_state-ego": 0.07959863783299238}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.3789093918563435, "sim_physics": 0.12044528643290202, "survival_time": 14.950000000000076, "driven_lanedir": 1.3697282751498316, "sim_render-ego": 0.06532199144363403, "in-drivable-lane": 0, "agent_compute-ego": 0.22809225877126055, "deviation-heading": 1.5276729151828152, "set_robot_commands": 0.09895941019058228, "deviation-center-line": 0.6178263924174615, "driven_lanedir_consec": 1.3697282751498316, "sim_compute_sim_state": 0.039798473517100016, "sim_compute_performance-ego": 0.07261458158493042, "sim_compute_robot_state-ego": 0.0792375651995341}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9938532861127236, "sim_physics": 0.11405011601404312, "survival_time": 10.90000000000002, "driven_lanedir": 0.636633071886469, "sim_render-ego": 0.06247295698988328, "in-drivable-lane": 3.300000000000039, "agent_compute-ego": 0.214279573991758, "deviation-heading": 1.6303604713059638, "set_robot_commands": 0.09379172325134276, "deviation-center-line": 0.33185961220450144, "driven_lanedir_consec": 0.636633071886469, "sim_compute_sim_state": 0.03907863700061763, "sim_compute_performance-ego": 0.0703913017150459, "sim_compute_robot_state-ego": 0.07318196712283913}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.3756987557190017, "sim_physics": 0.12196314891179402, "survival_time": 14.950000000000076, "driven_lanedir": 0.8353916052324039, "sim_render-ego": 0.06396233638127645, "in-drivable-lane": 5.60000000000008, "agent_compute-ego": 0.224210999806722, "deviation-heading": 1.5928716892398196, "set_robot_commands": 0.09890854438145956, "deviation-center-line": 0.6271759973117115, "driven_lanedir_consec": 0.8353916052324039, "sim_compute_sim_state": 0.038787918090820314, "sim_compute_performance-ego": 0.07111417452494304, "sim_compute_robot_state-ego": 0.07800644079844157}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.9914716076543734, "sim_physics": 0.1126649128187687, "survival_time": 10.90000000000002, "driven_lanedir": 0.6437574405419284, "sim_render-ego": 0.06253660162654492, "in-drivable-lane": 2.9000000000000403, "agent_compute-ego": 0.21236166057236697, "deviation-heading": 2.3115976044830027, "set_robot_commands": 0.09511978910603656, "deviation-center-line": 0.48684616533774794, "driven_lanedir_consec": 0.6437574405419284, "sim_compute_sim_state": 0.03873622745548913, "sim_compute_performance-ego": 0.06999711706004011, "sim_compute_robot_state-ego": 0.07397877513815504}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9933918851878262, "sim_physics": 0.11060642211809071, "survival_time": 10.90000000000002, "driven_lanedir": 0.8378534500252809, "sim_render-ego": 0.061817564001870814, "in-drivable-lane": 1.2500000000000178, "agent_compute-ego": 0.21494095150483855, "deviation-heading": 1.7938373910900065, "set_robot_commands": 0.09651001987107304, "deviation-center-line": 0.5691210418887267, "driven_lanedir_consec": 0.8378534500252809, "sim_compute_sim_state": 0.038332102495595946, "sim_compute_performance-ego": 0.0688190438331814, "sim_compute_robot_state-ego": 0.0724897909601894}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.3845892427964694, "sim_physics": 0.11198826869328816, "survival_time": 14.950000000000076, "driven_lanedir": 1.3776015989264612, "sim_render-ego": 0.06227792024612427, "in-drivable-lane": 0, "agent_compute-ego": 0.21869863112767535, "deviation-heading": 1.2994765151762957, "set_robot_commands": 0.09753483772277832, "deviation-center-line": 1.462063633216783, "driven_lanedir_consec": 1.3776015989264612, "sim_compute_sim_state": 0.03936696608861288, "sim_compute_performance-ego": 0.06833058516184488, "sim_compute_robot_state-ego": 0.07506952285766602}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.40250006140616, "sim_physics": 0.10850118080774944, "survival_time": 14.950000000000076, "driven_lanedir": 1.4019519912079614, "sim_render-ego": 0.0620219628016154, "in-drivable-lane": 0, "agent_compute-ego": 0.21163735866546632, "deviation-heading": 0.3215506240716209, "set_robot_commands": 0.09639279206593832, "deviation-center-line": 0.632797646151754, "driven_lanedir_consec": 1.4019519912079614, "sim_compute_sim_state": 0.03830546776453654, "sim_compute_performance-ego": 0.07021980285644532, "sim_compute_robot_state-ego": 0.07245585362116495}}
set_robot_commands_max	0.10179170420472052
set_robot_commands_mean	0.0974468594034723
set_robot_commands_median	0.09753483772277832
set_robot_commands_min	0.09223170242001934
sim_compute_performance-ego_max	0.07261458158493042
sim_compute_performance-ego_mean	0.07033979462363853
sim_compute_performance-ego_median	0.07021980285644532
sim_compute_performance-ego_min	0.0677600294096857
sim_compute_robot_state-ego_max	0.08144655797333844
sim_compute_robot_state-ego_mean	0.07608868049245725
sim_compute_robot_state-ego_median	0.07514907380808955
sim_compute_robot_state-ego_min	0.07245585362116495
sim_compute_sim_state_max	0.04031620080443634
sim_compute_sim_state_mean	0.03925893168639686
sim_compute_sim_state_median	0.03907863700061763
sim_compute_sim_state_min	0.038181019644451954
sim_physics_max	0.1252168599764506
sim_physics_mean	0.11532555641050832
sim_physics_median	0.11405011601404312
sim_physics_min	0.10648860340624784
sim_render-ego_max	0.06532199144363403
sim_render-ego_mean	0.06299869950110325
sim_render-ego_median	0.06253660162654492
sim_render-ego_min	0.06127142084055934
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.740000000000032
survival_time_min	3.5499999999999954

No reset possible

20830

3078

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 13:26:14+00:00

2019-04-27 14:00:10+00:00

0:33:56

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3078/step1-simulation-ip-172-31-38-104-5197-job20830/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20808

3100

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 13:00:29+00:00

2019-04-27 13:25:37+00:00

0:25:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.42208602676108686
survival_time_median	14.950000000000076
deviation-center-line_median	0.6417007765654409
in-drivable-lane_median	5.650000000000036

other stats

agent_compute-ego_max	0.2270560669898987
agent_compute-ego_mean	0.222088931602152
agent_compute-ego_median	0.22288171688715616
agent_compute-ego_min	0.21359946409861247
deviation-center-line_max	1.02518884705788
deviation-center-line_mean	0.6828933788881832
deviation-center-line_min	0.48815315041186613
deviation-heading_max	3.32084864243931
deviation-heading_mean	2.0877523347533904
deviation-heading_median	1.7244996354751236
deviation-heading_min	1.166974216851446
driven_any_max	0.9416411349555665
driven_any_mean	0.8680524844681831
driven_any_median	0.9280366137594372
driven_any_min	0.6817356107652515
driven_lanedir_consec_max	0.8071916017716085
driven_lanedir_consec_mean	0.5221622187658128
driven_lanedir_consec_min	0.3114935027013074
driven_lanedir_max	0.8071916017716085
driven_lanedir_mean	0.5221622187658128
driven_lanedir_median	0.42208602676108686
driven_lanedir_min	0.3114935027013074
in-drivable-lane_max	9.250000000000089
in-drivable-lane_mean	5.030000000000051
in-drivable-lane_min	1.6500000000000234
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8485385533977426, "sim_physics": 0.11621882835728528, "survival_time": 13.450000000000056, "driven_lanedir": 0.42208602676108686, "sim_render-ego": 0.06580079355204416, "in-drivable-lane": 6.450000000000073, "agent_compute-ego": 0.22618569051466025, "deviation-heading": 1.166974216851446, "set_robot_commands": 0.10177511176212128, "deviation-center-line": 0.7480567474949926, "driven_lanedir_consec": 0.42208602676108686, "sim_compute_sim_state": 0.041124838435516925, "sim_compute_performance-ego": 0.07279853306738418, "sim_compute_robot_state-ego": 0.07866835239651478}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9280366137594372, "sim_physics": 0.113255189259847, "survival_time": 14.950000000000076, "driven_lanedir": 0.3114935027013074, "sim_render-ego": 0.06418054342269898, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.2270560669898987, "deviation-heading": 1.7244996354751236, "set_robot_commands": 0.09890824635823568, "deviation-center-line": 0.48815315041186613, "driven_lanedir_consec": 0.3114935027013074, "sim_compute_sim_state": 0.039996552467346194, "sim_compute_performance-ego": 0.07153691450754801, "sim_compute_robot_state-ego": 0.0785782814025879}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.940310509462918, "sim_physics": 0.11470789353052777, "survival_time": 14.950000000000076, "driven_lanedir": 0.7578839388678116, "sim_render-ego": 0.06526345252990723, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.22288171688715616, "deviation-heading": 3.32084864243931, "set_robot_commands": 0.0988697377840678, "deviation-center-line": 1.02518884705788, "driven_lanedir_consec": 0.7578839388678116, "sim_compute_sim_state": 0.03957999547322591, "sim_compute_performance-ego": 0.07154944896697998, "sim_compute_robot_state-ego": 0.07545742273330688}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9416411349555665, "sim_physics": 0.11594226280848186, "survival_time": 14.950000000000076, "driven_lanedir": 0.8071916017716085, "sim_render-ego": 0.06226197322209676, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.21359946409861247, "deviation-heading": 2.7421714287127297, "set_robot_commands": 0.09915392875671386, "deviation-center-line": 0.6417007765654409, "driven_lanedir_consec": 0.8071916017716085, "sim_compute_sim_state": 0.03941464265187582, "sim_compute_performance-ego": 0.06972371498743693, "sim_compute_robot_state-ego": 0.07474068323771159}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6817356107652515, "sim_physics": 0.1245942200933184, "survival_time": 11.200000000000024, "driven_lanedir": 0.3121560237272498, "sim_render-ego": 0.06424359125750405, "in-drivable-lane": 5.650000000000036, "agent_compute-ego": 0.2207217195204326, "deviation-heading": 1.484267750288343, "set_robot_commands": 0.09971157354967934, "deviation-center-line": 0.5113673729107364, "driven_lanedir_consec": 0.3121560237272498, "sim_compute_sim_state": 0.04042492700474603, "sim_compute_performance-ego": 0.07270910271576472, "sim_compute_robot_state-ego": 0.07944357395172119}}
set_robot_commands_max	0.10177511176212128
set_robot_commands_mean	0.0996837196421636
set_robot_commands_median	0.09915392875671386
set_robot_commands_min	0.0988697377840678
sim_compute_performance-ego_max	0.07279853306738418
sim_compute_performance-ego_mean	0.07166354284902277
sim_compute_performance-ego_median	0.07154944896697998
sim_compute_performance-ego_min	0.06972371498743693
sim_compute_robot_state-ego_max	0.07944357395172119
sim_compute_robot_state-ego_mean	0.07737766274436847
sim_compute_robot_state-ego_median	0.0785782814025879
sim_compute_robot_state-ego_min	0.07474068323771159
sim_compute_sim_state_max	0.041124838435516925
sim_compute_sim_state_mean	0.040108191206542174
sim_compute_sim_state_median	0.039996552467346194
sim_compute_sim_state_min	0.03941464265187582
sim_physics_max	0.1245942200933184
sim_physics_mean	0.11694367880989208
sim_physics_median	0.11594226280848186
sim_physics_min	0.113255189259847
sim_render-ego_max	0.06580079355204416
sim_render-ego_mean	0.06435007079685023
sim_render-ego_median	0.06424359125750405
sim_render-ego_min	0.06226197322209676
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.900000000000064
survival_time_min	11.200000000000024

No reset possible

20796

3094

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 12:21:08+00:00

2019-04-27 13:00:12+00:00

0:39:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3094/step1-simulation-ip-172-31-38-104-5197-job20796/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20776

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 12:00:37+00:00

2019-04-27 12:20:52+00:00

0:20:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08924613644660617
survival_time_median	1.2500000000000004
deviation-center-line_median	0.08345222676695681
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.207321021867835
agent_compute-ego_mean	0.18513135069669773
agent_compute-ego_median	0.1814390986856788
agent_compute-ego_min	0.16836280822753907
deviation-center-line_max	0.18098137591634827
deviation-center-line_mean	0.08267720491043468
deviation-center-line_min	0.043312693602526965
deviation-heading_max	2.0217231033809706
deviation-heading_mean	0.82175328868438
deviation-heading_median	0.7743921445471438
deviation-heading_min	0.49431409531589793
driven_any_max	0.7046468911432043
driven_any_mean	0.19503532749662597
driven_any_median	0.15219992217819522
driven_any_min	0.09417879959762064
driven_lanedir_consec_max	0.2714961930543327
driven_lanedir_consec_mean	0.10150493235566456
driven_lanedir_consec_min	0.0524420506200034
driven_lanedir_max	0.2714961930543327
driven_lanedir_mean	0.10150493235566456
driven_lanedir_median	0.08924613644660617
driven_lanedir_min	0.0524420506200034
in-drivable-lane_max	2.0499999999999963
in-drivable-lane_mean	0.25999999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.7046468911432043, "sim_physics": 0.17714142558550594, "survival_time": 4.94999999999999, "driven_lanedir": 0.2714961930543327, "sim_render-ego": 0.06450106880881569, "in-drivable-lane": 2.0499999999999963, "agent_compute-ego": 0.1814390986856788, "deviation-heading": 2.0217231033809706, "set_robot_commands": 0.09916675933683762, "deviation-center-line": 0.18098137591634827, "driven_lanedir_consec": 0.2714961930543327, "sim_compute_sim_state": 0.04080355528629187, "sim_compute_performance-ego": 0.07123761225228357, "sim_compute_robot_state-ego": 0.07843932238492099, "sim_compute_robot_state-npc0": 0.07134610956365411, "sim_compute_robot_state-npc1": 0.0731201870272858, "sim_compute_robot_state-npc2": 0.06916370536341812, "sim_compute_robot_state-npc3": 0.07147106257351962}, "udem1-1-0": {"driven_any": 0.17748709300037663, "sim_physics": 0.2087078712604664, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06134962679631384, "sim_render-ego": 0.07012149139686867, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19941828869007253, "deviation-heading": 0.940905708676392, "set_robot_commands": 0.09809767758404768, "deviation-center-line": 0.06647593651742018, "driven_lanedir_consec": 0.06134962679631384, "sim_compute_sim_state": 0.04220659644515426, "sim_compute_performance-ego": 0.07514611879984538, "sim_compute_robot_state-ego": 0.0850597310949255, "sim_compute_robot_state-npc0": 0.07028257405316388, "sim_compute_robot_state-npc1": 0.0732346287480107, "sim_compute_robot_state-npc2": 0.07300894348709672, "sim_compute_robot_state-npc3": 0.07765506815027308}, "udem1-2-0": {"driven_any": 0.11788337451139246, "sim_physics": 0.19332693923603408, "survival_time": 1.1000000000000003, "driven_lanedir": 0.08332769641637494, "sim_render-ego": 0.0633532242341475, "in-drivable-lane": 0, "agent_compute-ego": 0.18265982107682663, "deviation-heading": 0.5123698979009025, "set_robot_commands": 0.10644954984838312, "deviation-center-line": 0.0972697819580457, "driven_lanedir_consec": 0.08332769641637494, "sim_compute_sim_state": 0.04135201194069602, "sim_compute_performance-ego": 0.0726876909082586, "sim_compute_robot_state-ego": 0.08343558961694891, "sim_compute_robot_state-npc0": 0.07194779135964134, "sim_compute_robot_state-npc1": 0.0730539235201749, "sim_compute_robot_state-npc2": 0.07174181938171387, "sim_compute_robot_state-npc3": 0.07317696918140758}, "udem1-3-0": {"driven_any": 0.09736415092613378, "sim_physics": 0.20269865575044052, "survival_time": 1.1500000000000004, "driven_lanedir": 0.05328611097307401, "sim_render-ego": 0.07720046458037003, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.207321021867835, "deviation-heading": 0.6115907515522643, "set_robot_commands": 0.10857988440472148, "deviation-center-line": 0.0876806909610018, "driven_lanedir_consec": 0.05328611097307401, "sim_compute_sim_state": 0.04592433183089546, "sim_compute_performance-ego": 0.07746359576349673, "sim_compute_robot_state-ego": 0.0871517450913139, "sim_compute_robot_state-npc0": 0.07889904146609099, "sim_compute_robot_state-npc1": 0.07519753082938817, "sim_compute_robot_state-npc2": 0.07685686194378397, "sim_compute_robot_state-npc3": 0.07694324203159499}, "udem1-4-0": {"driven_any": 0.15297947913266555, "sim_physics": 0.1951222801208496, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09181343318549096, "sim_render-ego": 0.062060279846191405, "in-drivable-lane": 0, "agent_compute-ego": 0.1896357536315918, "deviation-heading": 0.882131863264995, "set_robot_commands": 0.09833459854125975, "deviation-center-line": 0.06580449242718273, "driven_lanedir_consec": 0.09181343318549096, "sim_compute_sim_state": 0.04115082740783691, "sim_compute_performance-ego": 0.06933540344238281, "sim_compute_robot_state-ego": 0.07751757621765137, "sim_compute_robot_state-npc0": 0.07174662590026855, "sim_compute_robot_state-npc1": 0.0702998161315918, "sim_compute_robot_state-npc2": 0.07001733779907227, "sim_compute_robot_state-npc3": 0.07137274742126465}, "udem1-5-0": {"driven_any": 0.2586499506615578, "sim_physics": 0.1938666544462505, "survival_time": 1.900000000000001, "driven_lanedir": 0.15116817064018084, "sim_render-ego": 0.06728560673563104, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.179610202186986, "deviation-heading": 0.8751957371923983, "set_robot_commands": 0.10353692581779078, "deviation-center-line": 0.07493880205751617, "driven_lanedir_consec": 0.15116817064018084, "sim_compute_sim_state": 0.04258688500053004, "sim_compute_performance-ego": 0.07313439093138042, "sim_compute_robot_state-ego": 0.08009390454543264, "sim_compute_robot_state-npc0": 0.07713432061044793, "sim_compute_robot_state-npc1": 0.0760281148709749, "sim_compute_robot_state-npc2": 0.07682859270196211, "sim_compute_robot_state-npc3": 0.07358689057199579}, "udem1-6-0": {"driven_any": 0.13611501658775682, "sim_physics": 0.1766965389251709, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09536554012456833, "sim_render-ego": 0.06587676379991614, "in-drivable-lane": 0, "agent_compute-ego": 0.17671815208766772, "deviation-heading": 0.5968473468995548, "set_robot_commands": 0.10250728026680324, "deviation-center-line": 0.08345222676695681, "driven_lanedir_consec": 0.09536554012456833, "sim_compute_sim_state": 0.04128033181895381, "sim_compute_performance-ego": 0.06909996530284053, "sim_compute_robot_state-ego": 0.07446558579154637, "sim_compute_robot_state-npc0": 0.07198460205741551, "sim_compute_robot_state-npc1": 0.07377789331519086, "sim_compute_robot_state-npc2": 0.06896825458692468, "sim_compute_robot_state-npc3": 0.0682269282962965}, "udem1-7-0": {"driven_any": 0.118910626001834, "sim_physics": 0.18759126464525855, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07718377243225594, "sim_render-ego": 0.0675203005472819, "in-drivable-lane": 0, "agent_compute-ego": 0.20248494545618692, "deviation-heading": 0.6459061313091758, "set_robot_commands": 0.10442975163459778, "deviation-center-line": 0.09192180964421956, "driven_lanedir_consec": 0.07718377243225594, "sim_compute_sim_state": 0.04448767503102621, "sim_compute_performance-ego": 0.07405823469161987, "sim_compute_robot_state-ego": 0.08218338092168172, "sim_compute_robot_state-npc0": 0.07490636905034383, "sim_compute_robot_state-npc1": 0.07819352547327678, "sim_compute_robot_state-npc2": 0.08219599723815918, "sim_compute_robot_state-npc3": 0.07880207896232605}, "udem1-8-0": {"driven_any": 0.2220845182703035, "sim_physics": 0.19121212708322624, "survival_time": 1.900000000000001, "driven_lanedir": 0.11597832454156665, "sim_render-ego": 0.06431487359498676, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1747373844447889, "deviation-heading": 0.7743921445471438, "set_robot_commands": 0.09567105770111084, "deviation-center-line": 0.04368499123320292, "driven_lanedir_consec": 0.11597832454156665, "sim_compute_sim_state": 0.040638942467538935, "sim_compute_performance-ego": 0.06945335237603438, "sim_compute_robot_state-ego": 0.07460821302313554, "sim_compute_robot_state-npc0": 0.07200645773034346, "sim_compute_robot_state-npc1": 0.07146692276000977, "sim_compute_robot_state-npc2": 0.07383862922066137, "sim_compute_robot_state-npc3": 0.07000315816778886}, "udem1-9-0": {"driven_any": 0.14957873454807932, "sim_physics": 0.17417937278747558, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06589055752683048, "sim_render-ego": 0.07057124137878418, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1811104393005371, "deviation-heading": 0.8604251035120599, "set_robot_commands": 0.09626625061035156, "deviation-center-line": 0.04906446885918151, "driven_lanedir_consec": 0.06589055752683048, "sim_compute_sim_state": 0.03875772476196289, "sim_compute_performance-ego": 0.06590110778808594, "sim_compute_robot_state-ego": 0.06628448486328126, "sim_compute_robot_state-npc0": 0.07257010459899903, "sim_compute_robot_state-npc1": 0.06909730911254883, "sim_compute_robot_state-npc2": 0.0690235424041748, "sim_compute_robot_state-npc3": 0.07050799369812012}, "udem1-10-0": {"driven_any": 0.144166460078735, "sim_physics": 0.17107336719830832, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06302039116126301, "sim_render-ego": 0.06586227814356486, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.18640790383021036, "deviation-heading": 0.8528921571711496, "set_robot_commands": 0.09685582915941876, "deviation-center-line": 0.043312693602526965, "driven_lanedir_consec": 0.06302039116126301, "sim_compute_sim_state": 0.04164178172747294, "sim_compute_performance-ego": 0.06877423326174419, "sim_compute_robot_state-ego": 0.07192609707514445, "sim_compute_robot_state-npc0": 0.07286187012990315, "sim_compute_robot_state-npc1": 0.0774374504884084, "sim_compute_robot_state-npc2": 0.07723937431971233, "sim_compute_robot_state-npc3": 0.07398117582003276}, "udem1-11-0": {"driven_any": 0.09417879959762064, "sim_physics": 0.17525494666326613, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0524420506200034, "sim_render-ego": 0.0690964176541283, "in-drivable-lane": 0, "agent_compute-ego": 0.19740158035641625, "deviation-heading": 0.6796947600928381, "set_robot_commands": 0.10915509859720866, "deviation-center-line": 0.0906558532607482, "driven_lanedir_consec": 0.0524420506200034, "sim_compute_sim_state": 0.04330775851295108, "sim_compute_performance-ego": 0.07182786578223818, "sim_compute_robot_state-ego": 0.0823338372366769, "sim_compute_robot_state-npc0": 0.07416182472592309, "sim_compute_robot_state-npc1": 0.07242260660443987, "sim_compute_robot_state-npc2": 0.07339849926176525, "sim_compute_robot_state-npc3": 0.07294694582621257}, "udem1-12-0": {"driven_any": 0.22299656535063964, "sim_physics": 0.2071835221471013, "survival_time": 1.850000000000001, "driven_lanedir": 0.08924613644660617, "sim_render-ego": 0.06522129677437447, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1779437967248865, "deviation-heading": 0.7392937685134421, "set_robot_commands": 0.09676996437278954, "deviation-center-line": 0.06969896999623028, "driven_lanedir_consec": 0.08924613644660617, "sim_compute_sim_state": 0.04546660345953864, "sim_compute_performance-ego": 0.07273150779105522, "sim_compute_robot_state-ego": 0.07427523587201093, "sim_compute_robot_state-npc0": 0.07322234720797152, "sim_compute_robot_state-npc1": 0.07181807466455407, "sim_compute_robot_state-npc2": 0.06845655312409273, "sim_compute_robot_state-npc3": 0.07287258715242953}, "udem1-13-0": {"driven_any": 0.15219992217819522, "sim_physics": 0.1687993277674136, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12134435326334492, "sim_render-ego": 0.06098691276882006, "in-drivable-lane": 0, "agent_compute-ego": 0.1717190638832424, "deviation-heading": 0.49431409531589793, "set_robot_commands": 0.0924316696498705, "deviation-center-line": 0.09478679915353504, "driven_lanedir_consec": 0.12134435326334492, "sim_compute_sim_state": 0.03894494927447775, "sim_compute_performance-ego": 0.07011112959488579, "sim_compute_robot_state-ego": 0.07816564518472423, "sim_compute_robot_state-npc0": 0.07105290371438731, "sim_compute_robot_state-npc1": 0.06867303018984587, "sim_compute_robot_state-npc2": 0.07393462761588719, "sim_compute_robot_state-npc3": 0.06638432585674783}, "udem1-14-0": {"driven_any": 0.1762883304608951, "sim_physics": 0.17271352608998616, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12966162815276228, "sim_render-ego": 0.06487807432810465, "in-drivable-lane": 0, "agent_compute-ego": 0.16836280822753907, "deviation-heading": 0.8386167609365149, "set_robot_commands": 0.09411063194274902, "deviation-center-line": 0.10042918130240396, "driven_lanedir_consec": 0.12966162815276228, "sim_compute_sim_state": 0.040354681015014646, "sim_compute_performance-ego": 0.0732624371846517, "sim_compute_robot_state-ego": 0.07558505535125733, "sim_compute_robot_state-npc0": 0.06891432603200277, "sim_compute_robot_state-npc1": 0.06957698663075765, "sim_compute_robot_state-npc2": 0.06734913984934489, "sim_compute_robot_state-npc3": 0.07123740514119466}}
set_robot_commands_max	0.10915509859720866
set_robot_commands_mean	0.10015752863119602
set_robot_commands_median	0.09833459854125975
set_robot_commands_min	0.0924316696498705
sim_compute_performance-ego_max	0.07746359576349673
sim_compute_performance-ego_mean	0.07161497639138689
sim_compute_performance-ego_median	0.07182786578223818
sim_compute_performance-ego_min	0.06590110778808594
sim_compute_robot_state-ego_max	0.0871517450913139
sim_compute_robot_state-ego_mean	0.07810169361804346
sim_compute_robot_state-ego_median	0.07816564518472423
sim_compute_robot_state-ego_min	0.06628448486328126
sim_compute_robot_state-npc0_max	0.07889904146609099
sim_compute_robot_state-npc0_mean	0.07286915121337044
sim_compute_robot_state-npc0_median	0.07200645773034346
sim_compute_robot_state-npc0_min	0.06891432603200277
sim_compute_robot_state-npc1_max	0.07819352547327678
sim_compute_robot_state-npc1_mean	0.07289320002443057
sim_compute_robot_state-npc1_median	0.0730539235201749
sim_compute_robot_state-npc1_min	0.06867303018984587
sim_compute_robot_state-npc2_max	0.08219599723815918
sim_compute_robot_state-npc2_mean	0.07280145855318462
sim_compute_robot_state-npc2_median	0.07300894348709672
sim_compute_robot_state-npc2_min	0.06734913984934489
sim_compute_robot_state-npc3_max	0.07880207896232605
sim_compute_robot_state-npc3_mean	0.0726112385900803
sim_compute_robot_state-npc3_median	0.07287258715242953
sim_compute_robot_state-npc3_min	0.06638432585674783
sim_compute_sim_state_max	0.04592433183089546
sim_compute_sim_state_mean	0.0419269770653561
sim_compute_sim_state_median	0.04135201194069602
sim_compute_sim_state_min	0.03875772476196289
sim_physics_max	0.2087078712604664
sim_physics_mean	0.18637118798045027
sim_physics_median	0.18759126464525855
sim_physics_min	0.1687993277674136
sim_render-ego_max	0.07720046458037003
sim_render-ego_mean	0.06659001963946572
sim_render-ego_median	0.06586227814356486
sim_render-ego_min	0.06098691276882006
simulation-passed	1
survival_time_max	4.94999999999999
survival_time_mean	1.5966666666666665
survival_time_min	1.0500000000000005

No reset possible

20763

2973

Baseline-IL-logs-tensorflow

step1-simulation

host-error