Evaluator 835

step1-simulation

success

2019-05-07 15:19:04+00:00

2019-05-07 15:22:23+00:00

0:03:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.08763374222649468
agent_compute-ego_mean	0.08710792414883856
agent_compute-ego_median	0.0872540866272359
agent_compute-ego_min	0.08645988445655972
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.056066287888420954, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.035753077930874295, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08763374222649468, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.054468026867619264, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.023405878632156936, "sim_compute_performance-ego": 0.03918629222446018, "sim_compute_robot_state-ego": 0.040385943871957285}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05751557911143584, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03493343615064434, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08645988445655972, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.05381009625453575, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.02266512665094114, "sim_compute_performance-ego": 0.0379798225328034, "sim_compute_robot_state-ego": 0.039695122662712544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06043732867521398, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.036057261859669405, "in-drivable-lane": 0, "agent_compute-ego": 0.0869141326231115, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.05403706606696634, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.023159419789033776, "sim_compute_performance-ego": 0.03952622413635254, "sim_compute_robot_state-ego": 0.04045039064743939}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06382492065429687, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.035777015686035155, "in-drivable-lane": 0, "agent_compute-ego": 0.08727777481079102, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05420504570007324, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.023350906372070313, "sim_compute_performance-ego": 0.03927546501159668, "sim_compute_robot_state-ego": 0.04356338500976562}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.055721080755885645, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03562973119035552, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.0872540866272359, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05534776554831976, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.023016289819644976, "sim_compute_performance-ego": 0.038932911957366555, "sim_compute_robot_state-ego": 0.040738802921922904}}
set_robot_commands_max	0.05534776554831976
set_robot_commands_mean	0.054373600087502874
set_robot_commands_median	0.05420504570007324
set_robot_commands_min	0.05381009625453575
sim_compute_performance-ego_max	0.03952622413635254
sim_compute_performance-ego_mean	0.03898014317251587
sim_compute_performance-ego_median	0.03918629222446018
sim_compute_performance-ego_min	0.0379798225328034
sim_compute_robot_state-ego_max	0.04356338500976562
sim_compute_robot_state-ego_mean	0.04096672902275955
sim_compute_robot_state-ego_median	0.04045039064743939
sim_compute_robot_state-ego_min	0.039695122662712544
sim_compute_sim_state_max	0.023405878632156936
sim_compute_sim_state_mean	0.023119524252769422
sim_compute_sim_state_median	0.023159419789033776
sim_compute_sim_state_min	0.02266512665094114
sim_physics_max	0.06382492065429687
sim_physics_mean	0.05871303941705066
sim_physics_median	0.05751557911143584
sim_physics_min	0.055721080755885645
sim_render-ego_max	0.036057261859669405
sim_render-ego_mean	0.035630104563515744
sim_render-ego_median	0.035753077930874295
sim_render-ego_min	0.03493343615064434
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21621

3245

Shen Yu Chia 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-07 14:56:07+00:00

2019-05-07 14:56:23+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.09866491147411292
error_L2	0.016276006084701505

No reset possible

21614

3239

Artem Ioselevskii

SSegm

step1-simulation

success

2019-05-07 13:30:52+00:00

2019-05-07 13:42:48+00:00

0:11:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.778327611984521
survival_time_median	14.300000000000068
deviation-center-line_median	1.1950790451607245
in-drivable-lane_median	1.699999999999994

other stats

agent_compute-ego_max	0.06210793731929539
agent_compute-ego_mean	0.0596547435252605
agent_compute-ego_median	0.05991123397036852
agent_compute-ego_min	0.055727412700653074
deviation-center-line_max	1.2561643837532706
deviation-center-line_mean	1.0078297339220368
deviation-center-line_min	0.3823915665589539
deviation-heading_max	4.146443387656967
deviation-heading_mean	2.6116141520789027
deviation-heading_median	2.918418633302626
deviation-heading_min	0.3305946457003577
driven_any_max	3.5747589459488145
driven_any_mean	2.850880018490508
driven_any_median	3.415691798747307
driven_any_min	0.7132271438603454
driven_lanedir_consec_max	3.0179297012588604
driven_lanedir_consec_mean	2.370300261678608
driven_lanedir_consec_min	0.7079378766049462
driven_lanedir_max	3.0179297012588604
driven_lanedir_mean	2.370300261678608
driven_lanedir_median	2.778327611984521
driven_lanedir_min	0.7079378766049462
in-drivable-lane_max	1.950000000000018
in-drivable-lane_mean	1.410000000000012
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9760346236808144, "sim_physics": 0.06017439678845653, "survival_time": 12.550000000000043, "driven_lanedir": 2.351064104909258, "sim_render-ego": 0.03752424707450715, "in-drivable-lane": 1.950000000000018, "agent_compute-ego": 0.05991123397036852, "deviation-heading": 2.6473652060836708, "set_robot_commands": 0.05633826274795836, "deviation-center-line": 0.950818199143647, "driven_lanedir_consec": 2.351064104909258, "sim_compute_sim_state": 0.02444836722902093, "sim_compute_performance-ego": 0.040608780317572486, "sim_compute_robot_state-ego": 0.04315469274482879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.5747589459488145, "sim_physics": 0.057548490365346275, "survival_time": 14.950000000000076, "driven_lanedir": 3.0179297012588604, "sim_render-ego": 0.037093245188395185, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.055727412700653074, "deviation-heading": 3.015248887650893, "set_robot_commands": 0.05593302567799886, "deviation-center-line": 1.2561643837532706, "driven_lanedir_consec": 3.0179297012588604, "sim_compute_sim_state": 0.024378005663553873, "sim_compute_performance-ego": 0.04112754185994466, "sim_compute_robot_state-ego": 0.04383750518163045}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7132271438603454, "sim_physics": 0.05806759687570425, "survival_time": 3.2499999999999964, "driven_lanedir": 0.7079378766049462, "sim_render-ego": 0.03680129051208496, "in-drivable-lane": 0, "agent_compute-ego": 0.05943918594947229, "deviation-heading": 0.3305946457003577, "set_robot_commands": 0.05634616705087515, "deviation-center-line": 0.3823915665589539, "driven_lanedir_consec": 0.7079378766049462, "sim_compute_sim_state": 0.0249088690831111, "sim_compute_performance-ego": 0.04155400349543645, "sim_compute_robot_state-ego": 0.04511234210087703}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.415691798747307, "sim_physics": 0.06083325572780795, "survival_time": 14.300000000000068, "driven_lanedir": 2.778327611984521, "sim_render-ego": 0.03833619114402291, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.06210793731929539, "deviation-heading": 4.146443387656967, "set_robot_commands": 0.05581758489141931, "deviation-center-line": 1.1950790451607245, "driven_lanedir_consec": 2.778327611984521, "sim_compute_sim_state": 0.024420275554790365, "sim_compute_performance-ego": 0.041219386187466706, "sim_compute_robot_state-ego": 0.0430536736975183}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5746875802152553, "sim_physics": 0.055991426308949786, "survival_time": 14.950000000000076, "driven_lanedir": 2.996242013635455, "sim_render-ego": 0.037165956497192384, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.061087947686513266, "deviation-heading": 2.918418633302626, "set_robot_commands": 0.05609716653823853, "deviation-center-line": 1.2546954749935886, "driven_lanedir_consec": 2.996242013635455, "sim_compute_sim_state": 0.024335740407307942, "sim_compute_performance-ego": 0.04047004381815592, "sim_compute_robot_state-ego": 0.04251773993174235}}
set_robot_commands_max	0.05634616705087515
set_robot_commands_mean	0.05610644138129804
set_robot_commands_median	0.05609716653823853
set_robot_commands_min	0.05581758489141931
sim_compute_performance-ego_max	0.04155400349543645
sim_compute_performance-ego_mean	0.04099595113571524
sim_compute_performance-ego_median	0.04112754185994466
sim_compute_performance-ego_min	0.04047004381815592
sim_compute_robot_state-ego_max	0.04511234210087703
sim_compute_robot_state-ego_mean	0.04353519073131938
sim_compute_robot_state-ego_median	0.04315469274482879
sim_compute_robot_state-ego_min	0.04251773993174235
sim_compute_sim_state_max	0.0249088690831111
sim_compute_sim_state_mean	0.02449825158755684
sim_compute_sim_state_median	0.024420275554790365
sim_compute_sim_state_min	0.024335740407307942
sim_physics_max	0.06083325572780795
sim_physics_mean	0.05852303321325296
sim_physics_median	0.05806759687570425
sim_physics_min	0.055991426308949786
sim_render-ego_max	0.03833619114402291
sim_render-ego_mean	0.037384186083240525
sim_render-ego_median	0.037165956497192384
sim_render-ego_min	0.03680129051208496
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.000000000000052
survival_time_min	3.2499999999999964

No reset possible

21607

3234

jiang peng

First test - TH -hhk

step1-simulation

success

aido2-LFVI-sim-validation

2019-05-07 08:36:16+00:00

2019-05-07 08:48:52+00:00

0:12:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.0385711859034583
survival_time_median	14.950000000000076
deviation-center-line_median	0.8015273149071069
in-drivable-lane_median	2.10000000000003

other stats

agent_compute-ego_max	0.09647786378860472
agent_compute-ego_mean	0.09580805786688792
agent_compute-ego_median	0.09575008450921484
agent_compute-ego_min	0.09532022696954232
deviation-center-line_max	1.1737246956149718
deviation-center-line_mean	0.7663199348748481
deviation-center-line_min	0.38253128637914463
deviation-heading_max	6.903528122795809
deviation-heading_mean	5.614723068517387
deviation-heading_median	6.510965305015928
deviation-heading_min	3.369597462518233
driven_any_max	2.8331144790610754
driven_any_mean	2.013008917517807
driven_any_median	2.4906420909340596
driven_any_min	0.43187626693270326
driven_lanedir_consec_max	2.112867126049582
driven_lanedir_consec_mean	1.055401719679976
driven_lanedir_consec_min	0.09302428826066844
driven_lanedir_max	2.443206936400361
driven_lanedir_mean	1.6473712635094089
driven_lanedir_median	1.8451372591106796
driven_lanedir_min	0.20172309442952585
in-drivable-lane_max	3.050000000000011
in-drivable-lane_mean	2.1600000000000112
in-drivable-lane_min	0.9999999999999964
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6044323200574648, "sim_physics": 0.05586279233296712, "survival_time": 14.950000000000076, "driven_lanedir": 1.4717286752505785, "sim_render-ego": 0.03534852266311646, "in-drivable-lane": 3.050000000000011, "agent_compute-ego": 0.09647786378860472, "deviation-heading": 6.903528122795809, "set_robot_commands": 0.05419641335805257, "deviation-center-line": 1.1737246956149718, "driven_lanedir_consec": 0.6221382244941802, "sim_compute_sim_state": 0.022649471759796144, "sim_compute_performance-ego": 0.0381906525293986, "sim_compute_robot_state-ego": 0.04019371191660563}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8331144790610754, "sim_physics": 0.05507706721623739, "survival_time": 14.950000000000076, "driven_lanedir": 1.8451372591106796, "sim_render-ego": 0.03515044371287028, "in-drivable-lane": 2.950000000000024, "agent_compute-ego": 0.09579938729604086, "deviation-heading": 6.618004008361862, "set_robot_commands": 0.0543418542544047, "deviation-center-line": 0.6678906041900489, "driven_lanedir_consec": 1.0385711859034583, "sim_compute_sim_state": 0.0227311102549235, "sim_compute_performance-ego": 0.03861854314804077, "sim_compute_robot_state-ego": 0.040179704825083415}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.704979430603733, "sim_physics": 0.056187578435643946, "survival_time": 14.650000000000071, "driven_lanedir": 2.443206936400361, "sim_render-ego": 0.035442207453600785, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.09575008450921484, "deviation-heading": 4.671520443895107, "set_robot_commands": 0.05443673085027181, "deviation-center-line": 0.8015273149071069, "driven_lanedir_consec": 2.112867126049582, "sim_compute_sim_state": 0.02277248304451692, "sim_compute_performance-ego": 0.03847965689649354, "sim_compute_robot_state-ego": 0.0398493415259664}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.4906420909340596, "sim_physics": 0.05284723440806071, "survival_time": 14.950000000000076, "driven_lanedir": 2.2750603523559008, "sim_render-ego": 0.0351424233118693, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.09569272677103678, "deviation-heading": 6.510965305015928, "set_robot_commands": 0.05460655530293783, "deviation-center-line": 0.8059257732829681, "driven_lanedir_consec": 1.410407773691991, "sim_compute_sim_state": 0.022642188866933186, "sim_compute_performance-ego": 0.038213840325673425, "sim_compute_robot_state-ego": 0.04013877789179484}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.43187626693270326, "sim_physics": 0.05213954051335653, "survival_time": 5.399999999999989, "driven_lanedir": 0.20172309442952585, "sim_render-ego": 0.03466758242359868, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.09532022696954232, "deviation-heading": 3.369597462518233, "set_robot_commands": 0.055403186215294734, "deviation-center-line": 0.38253128637914463, "driven_lanedir_consec": 0.09302428826066844, "sim_compute_sim_state": 0.02320159364629675, "sim_compute_performance-ego": 0.03852087038534659, "sim_compute_robot_state-ego": 0.040351774957444936}}
set_robot_commands_max	0.055403186215294734
set_robot_commands_mean	0.05459694799619232
set_robot_commands_median	0.05443673085027181
set_robot_commands_min	0.05419641335805257
sim_compute_performance-ego_max	0.03861854314804077
sim_compute_performance-ego_mean	0.038404712656990594
sim_compute_performance-ego_median	0.03847965689649354
sim_compute_performance-ego_min	0.0381906525293986
sim_compute_robot_state-ego_max	0.040351774957444936
sim_compute_robot_state-ego_mean	0.04014266222337905
sim_compute_robot_state-ego_median	0.040179704825083415
sim_compute_robot_state-ego_min	0.0398493415259664
sim_compute_sim_state_max	0.02320159364629675
sim_compute_sim_state_mean	0.0227993695144933
sim_compute_sim_state_median	0.0227311102549235
sim_compute_sim_state_min	0.022642188866933186
sim_physics_max	0.056187578435643946
sim_physics_mean	0.05442284258125314
sim_physics_median	0.05507706721623739
sim_physics_min	0.05213954051335653
sim_render-ego_max	0.035442207453600785
sim_render-ego_mean	0.0351502359130111
sim_render-ego_median	0.03515044371287028
sim_render-ego_min	0.03466758242359868
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	12.980000000000055
survival_time_min	5.399999999999989

No reset possible

21559

3222

jiang peng

First test - TH

step1-simulation

success

2019-05-06 12:10:16+00:00

2019-05-06 12:32:24+00:00

0:22:08

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.1298396109190727
survival_time_median	14.950000000000076
deviation-center-line_median	0.8185809426482192
in-drivable-lane_median	5.750000000000077

other stats

agent_compute-ego_max	0.1070495088895162
agent_compute-ego_mean	0.09991132926940918
agent_compute-ego_median	0.09810949484507243
agent_compute-ego_min	0.09762869596481324
deviation-center-line_max	1.1143497622476164
deviation-center-line_mean	0.7113721300587702
deviation-center-line_min	0.12121546925639484
deviation-heading_max	2.4507254139559365
deviation-heading_mean	1.6409631327883338
deviation-heading_median	1.5921793442420955
deviation-heading_min	0.8346767111846188
driven_any_max	4.547326976721039
driven_any_mean	3.7080818517767455
driven_any_median	4.390421976973856
driven_any_min	0.9256795501976696
driven_lanedir_consec_max	4.45532240728285
driven_lanedir_consec_mean	3.138366772203074
driven_lanedir_consec_min	0.6737600954653316
driven_lanedir_max	4.455520801025484
driven_lanedir_mean	3.1384291902218098
driven_lanedir_median	3.1298865755495924
driven_lanedir_min	0.6737600954653316
in-drivable-lane_max	12.950000000000076
in-drivable-lane_mean	4.960000000000044
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 4.547326976721039, "sim_physics": 0.10577375014623006, "survival_time": 14.950000000000076, "driven_lanedir": 4.455520801025484, "sim_render-ego": 0.038859035968780514, "in-drivable-lane": 0, "agent_compute-ego": 0.1070495088895162, "deviation-heading": 2.4507254139559365, "set_robot_commands": 0.05891751289367675, "deviation-center-line": 1.1143497622476164, "driven_lanedir_consec": 4.45532240728285, "sim_compute_sim_state": 0.024270494778951008, "sim_compute_performance-ego": 0.04233839988708496, "sim_compute_robot_state-ego": 0.044254329999287925, "sim_compute_robot_state-npc0": 0.043705033461252846, "sim_compute_robot_state-npc1": 0.04303055683771769, "sim_compute_robot_state-npc2": 0.042220664024353025, "sim_compute_robot_state-npc3": 0.04240609486897787}, "udem1-1-0": {"driven_any": 0.9256795501976696, "sim_physics": 0.09893154382705688, "survival_time": 14.950000000000076, "driven_lanedir": 0.6737600954653316, "sim_render-ego": 0.03542119900385539, "in-drivable-lane": 12.950000000000076, "agent_compute-ego": 0.09795676628748576, "deviation-heading": 0.8346767111846188, "set_robot_commands": 0.05467734813690186, "deviation-center-line": 0.12121546925639484, "driven_lanedir_consec": 0.6737600954653316, "sim_compute_sim_state": 0.022349318663279216, "sim_compute_performance-ego": 0.03850451151529948, "sim_compute_robot_state-ego": 0.0402400263150533, "sim_compute_robot_state-npc0": 0.040024364789326985, "sim_compute_robot_state-npc1": 0.03931797424952189, "sim_compute_robot_state-npc2": 0.04025271654129029, "sim_compute_robot_state-npc3": 0.03905622959136963}, "udem1-2-0": {"driven_any": 4.236314241810604, "sim_physics": 0.10070326725641886, "survival_time": 14.950000000000076, "driven_lanedir": 3.0315501071359985, "sim_render-ego": 0.03553694248199463, "in-drivable-lane": 5.750000000000077, "agent_compute-ego": 0.09881218036015828, "deviation-heading": 1.5921793442420955, "set_robot_commands": 0.05501933972040812, "deviation-center-line": 0.8185809426482192, "driven_lanedir_consec": 3.031493193273463, "sim_compute_sim_state": 0.02243173837661743, "sim_compute_performance-ego": 0.03830164194107056, "sim_compute_robot_state-ego": 0.040893642902374266, "sim_compute_robot_state-npc0": 0.03985963026682536, "sim_compute_robot_state-npc1": 0.039151789347330726, "sim_compute_robot_state-npc2": 0.03912836074829101, "sim_compute_robot_state-npc3": 0.03901634693145752}, "udem1-3-0": {"driven_any": 4.390421976973856, "sim_physics": 0.10127130111058552, "survival_time": 14.950000000000076, "driven_lanedir": 3.1298865755495924, "sim_render-ego": 0.035882733662923175, "in-drivable-lane": 6.100000000000066, "agent_compute-ego": 0.09810949484507243, "deviation-heading": 1.462422214957852, "set_robot_commands": 0.05432003498077392, "deviation-center-line": 0.8971989531600177, "driven_lanedir_consec": 3.1298396109190727, "sim_compute_sim_state": 0.02232222636540731, "sim_compute_performance-ego": 0.03902855555216472, "sim_compute_robot_state-ego": 0.04039185841878255, "sim_compute_robot_state-npc0": 0.03962710936864217, "sim_compute_robot_state-npc1": 0.03926111777623494, "sim_compute_robot_state-npc2": 0.03865191698074341, "sim_compute_robot_state-npc3": 0.038874125480651854}, "udem1-4-0": {"driven_any": 4.440666513180557, "sim_physics": 0.1019226861000061, "survival_time": 14.950000000000076, "driven_lanedir": 4.401428371932642, "sim_render-ego": 0.035585351785024005, "in-drivable-lane": 0, "agent_compute-ego": 0.09762869596481324, "deviation-heading": 1.864811979601165, "set_robot_commands": 0.05374932607014974, "deviation-center-line": 0.6055155229816024, "driven_lanedir_consec": 4.401418554074654, "sim_compute_sim_state": 0.022244314352671303, "sim_compute_performance-ego": 0.03812100172042847, "sim_compute_robot_state-ego": 0.04104541858037313, "sim_compute_robot_state-npc0": 0.039639872709910075, "sim_compute_robot_state-npc1": 0.038954506715138754, "sim_compute_robot_state-npc2": 0.038849560419718425, "sim_compute_robot_state-npc3": 0.03885957956314087}}
set_robot_commands_max	0.05891751289367675
set_robot_commands_mean	0.05533671236038208
set_robot_commands_median	0.05467734813690186
set_robot_commands_min	0.05374932607014974
sim_compute_performance-ego_max	0.04233839988708496
sim_compute_performance-ego_mean	0.03925882212320963
sim_compute_performance-ego_median	0.03850451151529948
sim_compute_performance-ego_min	0.03812100172042847
sim_compute_robot_state-ego_max	0.044254329999287925
sim_compute_robot_state-ego_mean	0.04136505524317424
sim_compute_robot_state-ego_median	0.040893642902374266
sim_compute_robot_state-ego_min	0.0402400263150533
sim_compute_robot_state-npc0_max	0.043705033461252846
sim_compute_robot_state-npc0_mean	0.04057120211919149
sim_compute_robot_state-npc0_median	0.03985963026682536
sim_compute_robot_state-npc0_min	0.03962710936864217
sim_compute_robot_state-npc1_max	0.04303055683771769
sim_compute_robot_state-npc1_mean	0.0399431889851888
sim_compute_robot_state-npc1_median	0.03926111777623494
sim_compute_robot_state-npc1_min	0.038954506715138754
sim_compute_robot_state-npc2_max	0.042220664024353025
sim_compute_robot_state-npc2_mean	0.03982064374287923
sim_compute_robot_state-npc2_median	0.03912836074829101
sim_compute_robot_state-npc2_min	0.03865191698074341
sim_compute_robot_state-npc3_max	0.04240609486897787
sim_compute_robot_state-npc3_mean	0.03964247528711955
sim_compute_robot_state-npc3_median	0.03901634693145752
sim_compute_robot_state-npc3_min	0.03885957956314087
sim_compute_sim_state_max	0.024270494778951008
sim_compute_sim_state_mean	0.022723618507385253
sim_compute_sim_state_median	0.022349318663279216
sim_compute_sim_state_min	0.022244314352671303
sim_physics_max	0.10577375014623006
sim_physics_mean	0.10172050968805949
sim_physics_median	0.10127130111058552
sim_physics_min	0.09893154382705688
sim_render-ego_max	0.038859035968780514
sim_render-ego_mean	0.03625705258051554
sim_render-ego_median	0.035585351785024005
sim_render-ego_min	0.03542119900385539
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21485

3180

ZongRu Li

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-03 22:56:00+00:00

2019-05-03 22:56:26+00:00

0:00:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10462914423741251
error_L2	0.0176192379108862

No reset possible

21470

3166

Ashwin Ram 🇸🇬

challenge-aido_LF-template-random

step1-simulation

success

2019-05-02 12:47:26+00:00

2019-05-02 12:50:11+00:00

0:02:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3466139509742776
survival_time_median	1.1000000000000003
deviation-center-line_median	0.07152263747038398
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.14985264431346546
agent_compute-ego_mean	0.142374851799699
agent_compute-ego_median	0.14087834358215331
agent_compute-ego_min	0.13946441463802173
deviation-center-line_max	0.0916952474725946
deviation-center-line_mean	0.07202763815458388
deviation-center-line_min	0.05482771795165612
deviation-heading_max	0.6929437437197398
deviation-heading_mean	0.3959747874145352
deviation-heading_median	0.38319542856197664
deviation-heading_min	0.24231164951670744
driven_any_max	1.1251786300383595
driven_any_mean	0.5268707504558294
driven_any_median	0.39650538594246726
driven_any_min	0.22925944558623984
driven_lanedir_consec_max	0.4939049385625869
driven_lanedir_consec_mean	0.3431567161315022
driven_lanedir_consec_min	0.2119805050899517
driven_lanedir_max	0.4939049385625869
driven_lanedir_mean	0.3431567161315022
driven_lanedir_median	0.3466139509742776
driven_lanedir_min	0.2119805050899517
in-drivable-lane_max	1.0000000000000009
in-drivable-lane_mean	0.2200000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.39650538594246726, "sim_physics": 0.06595997376875444, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3466139509742776, "sim_render-ego": 0.03681450540369207, "in-drivable-lane": 0, "agent_compute-ego": 0.14985264431346546, "deviation-heading": 0.38319542856197664, "set_robot_commands": 0.05356455932963978, "deviation-center-line": 0.07840090931940061, "driven_lanedir_consec": 0.3466139509742776, "sim_compute_sim_state": 0.022081450982527295, "sim_compute_performance-ego": 0.03882437402551824, "sim_compute_robot_state-ego": 0.03987288475036621}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.1251786300383595, "sim_physics": 0.05362748063128928, "survival_time": 2.3, "driven_lanedir": 0.39497251036289904, "sim_render-ego": 0.034881451855535095, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.13946441463802173, "deviation-heading": 0.6929437437197398, "set_robot_commands": 0.05348369867905327, "deviation-center-line": 0.0916952474725946, "driven_lanedir_consec": 0.39497251036289904, "sim_compute_sim_state": 0.022588470707768975, "sim_compute_performance-ego": 0.03745251634846563, "sim_compute_robot_state-ego": 0.0400878553805144}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22925944558623984, "sim_physics": 0.06462235450744629, "survival_time": 0.7500000000000001, "driven_lanedir": 0.2119805050899517, "sim_render-ego": 0.03437732060750325, "in-drivable-lane": 0, "agent_compute-ego": 0.14087834358215331, "deviation-heading": 0.24231164951670744, "set_robot_commands": 0.05288190841674805, "deviation-center-line": 0.07152263747038398, "driven_lanedir_consec": 0.2119805050899517, "sim_compute_sim_state": 0.02264407475789388, "sim_compute_performance-ego": 0.03816078503926595, "sim_compute_robot_state-ego": 0.03976804415384928}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3344101112928405, "sim_physics": 0.06559636718348454, "survival_time": 0.9500000000000004, "driven_lanedir": 0.2683116756677957, "sim_render-ego": 0.03529416887383712, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1405259182578639, "deviation-heading": 0.3881499604342179, "set_robot_commands": 0.05272188939546284, "deviation-center-line": 0.05482771795165612, "driven_lanedir_consec": 0.2683116756677957, "sim_compute_sim_state": 0.023338782159905685, "sim_compute_performance-ego": 0.03724836048326994, "sim_compute_robot_state-ego": 0.04030776023864746}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.54900017941924, "sim_physics": 0.05838448913009078, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4939049385625869, "sim_render-ego": 0.035650915569729276, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14115293820699057, "deviation-heading": 0.2732731548400345, "set_robot_commands": 0.0574597782558865, "deviation-center-line": 0.06369167855888411, "driven_lanedir_consec": 0.4939049385625869, "sim_compute_sim_state": 0.023133851863719797, "sim_compute_performance-ego": 0.03884560973555953, "sim_compute_robot_state-ego": 0.039929354632342304}}
set_robot_commands_max	0.0574597782558865
set_robot_commands_mean	0.05402236681535809
set_robot_commands_median	0.05348369867905327
set_robot_commands_min	0.05272188939546284
sim_compute_performance-ego_max	0.03884560973555953
sim_compute_performance-ego_mean	0.03810632912641586
sim_compute_performance-ego_median	0.03816078503926595
sim_compute_performance-ego_min	0.03724836048326994
sim_compute_robot_state-ego_max	0.04030776023864746
sim_compute_robot_state-ego_mean	0.039993179831143935
sim_compute_robot_state-ego_median	0.039929354632342304
sim_compute_robot_state-ego_min	0.03976804415384928
sim_compute_sim_state_max	0.023338782159905685
sim_compute_sim_state_mean	0.02275732609436313
sim_compute_sim_state_median	0.02264407475789388
sim_compute_sim_state_min	0.022081450982527295
sim_physics_max	0.06595997376875444
sim_physics_mean	0.06163813304421306
sim_physics_median	0.06462235450744629
sim_physics_min	0.05362748063128928
sim_render-ego_max	0.03681450540369207
sim_render-ego_mean	0.03540367246205937
sim_render-ego_median	0.03529416887383712
sim_render-ego_min	0.03437732060750325
simulation-passed	1
survival_time_max	2.3
survival_time_mean	1.2900000000000005
survival_time_min	0.7500000000000001

No reset possible

21449

3152

Po Sheng Ser 🇹🇼

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-05-01 15:41:07+00:00

2019-05-01 15:49:54+00:00

0:08:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8977693235582156
survival_time_median	8.79999999999999
deviation-center-line_median	0.6334952044981629
in-drivable-lane_median	0.350000000000005

other stats

agent_compute-ego_max	0.055232654393338
agent_compute-ego_mean	0.05423300194895182
agent_compute-ego_median	0.05468863566716512
agent_compute-ego_min	0.05309560272719834
deviation-center-line_max	1.153960465981961
deviation-center-line_mean	0.7388328292192599
deviation-center-line_min	0.484091911912731
deviation-heading_max	5.6927935574741575
deviation-heading_mean	3.3632776863822995
deviation-heading_median	2.812337008395809
deviation-heading_min	0.6171509300191726
driven_any_max	2.348572279796288
driven_any_mean	1.4794991287629569
driven_any_median	1.360584933270243
driven_any_min	0.6776296339474068
driven_lanedir_consec_max	1.2003769900470145
driven_lanedir_consec_mean	0.8308742342119485
driven_lanedir_consec_min	0.28166708633032955
driven_lanedir_max	1.801876255000536
driven_lanedir_mean	1.1276016321197708
driven_lanedir_median	1.2003769900470145
driven_lanedir_min	0.5269293412040839
in-drivable-lane_max	3.6000000000000165
in-drivable-lane_mean	1.1000000000000043
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.260892170827943, "sim_physics": 0.0571257168858934, "survival_time": 14.45000000000007, "driven_lanedir": 1.801876255000536, "sim_render-ego": 0.0372143253735605, "in-drivable-lane": 1.3000000000000016, "agent_compute-ego": 0.055232654393338, "deviation-heading": 5.154406799481099, "set_robot_commands": 0.055852564148424405, "deviation-center-line": 1.153960465981961, "driven_lanedir_consec": 1.1044175828909393, "sim_compute_sim_state": 0.02399601408354551, "sim_compute_performance-ego": 0.040330122911393845, "sim_compute_robot_state-ego": 0.04272685001465688}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7498166259729022, "sim_physics": 0.060730865001678465, "survival_time": 4.99999999999999, "driven_lanedir": 0.5269293412040839, "sim_render-ego": 0.037372667789459225, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.054709792137146, "deviation-heading": 2.812337008395809, "set_robot_commands": 0.056532063484191895, "deviation-center-line": 0.484091911912731, "driven_lanedir_consec": 0.28166708633032955, "sim_compute_sim_state": 0.023956847190856934, "sim_compute_performance-ego": 0.040325465202331545, "sim_compute_robot_state-ego": 0.0424418568611145}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6776296339474068, "sim_physics": 0.06195147744901887, "survival_time": 4.549999999999992, "driven_lanedir": 0.6701401882332436, "sim_render-ego": 0.03697236553653256, "in-drivable-lane": 0, "agent_compute-ego": 0.05309560272719834, "deviation-heading": 0.6171509300191726, "set_robot_commands": 0.0562420048556485, "deviation-center-line": 0.5182816945448272, "driven_lanedir_consec": 0.6701401882332436, "sim_compute_sim_state": 0.02411944787580888, "sim_compute_performance-ego": 0.04046363358969217, "sim_compute_robot_state-ego": 0.042609335301996586}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.360584933270243, "sim_physics": 0.055423804304816505, "survival_time": 8.79999999999999, "driven_lanedir": 1.2003769900470145, "sim_render-ego": 0.036743785847317086, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.05343832481991161, "deviation-heading": 2.5397001365412595, "set_robot_commands": 0.055729868737134064, "deviation-center-line": 0.6334952044981629, "driven_lanedir_consec": 1.2003769900470145, "sim_compute_sim_state": 0.02320191670547832, "sim_compute_performance-ego": 0.03989045592871579, "sim_compute_robot_state-ego": 0.0424506582997062}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348572279796288, "sim_physics": 0.060227851867675784, "survival_time": 14.950000000000076, "driven_lanedir": 1.438685386113976, "sim_render-ego": 0.03680173635482789, "in-drivable-lane": 3.6000000000000165, "agent_compute-ego": 0.05468863566716512, "deviation-heading": 5.6927935574741575, "set_robot_commands": 0.0553376046816508, "deviation-center-line": 0.904334869158618, "driven_lanedir_consec": 0.8977693235582156, "sim_compute_sim_state": 0.023891751766204835, "sim_compute_performance-ego": 0.04003439505894979, "sim_compute_robot_state-ego": 0.04279215574264526}}
set_robot_commands_max	0.056532063484191895
set_robot_commands_mean	0.055938821181409935
set_robot_commands_median	0.055852564148424405
set_robot_commands_min	0.0553376046816508
sim_compute_performance-ego_max	0.04046363358969217
sim_compute_performance-ego_mean	0.04020881453821663
sim_compute_performance-ego_median	0.040325465202331545
sim_compute_performance-ego_min	0.03989045592871579
sim_compute_robot_state-ego_max	0.04279215574264526
sim_compute_robot_state-ego_mean	0.042604171244023895
sim_compute_robot_state-ego_median	0.042609335301996586
sim_compute_robot_state-ego_min	0.0424418568611145
sim_compute_sim_state_max	0.02411944787580888
sim_compute_sim_state_mean	0.023833195524378896
sim_compute_sim_state_median	0.023956847190856934
sim_compute_sim_state_min	0.02320191670547832
sim_physics_max	0.06195147744901887
sim_physics_mean	0.059091943101816605
sim_physics_median	0.060227851867675784
sim_physics_min	0.055423804304816505
sim_render-ego_max	0.037372667789459225
sim_render-ego_mean	0.037020976180339456
sim_render-ego_median	0.03697236553653256
sim_render-ego_min	0.036743785847317086
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.550000000000022
survival_time_min	4.549999999999992

No reset possible

21447

3150

Andy Ser

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-01 13:02:30+00:00

2019-05-01 13:03:01+00:00

0:00:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1161068775850374
error_L2	0.021688348267451443

No reset possible

21446

3149

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-05-01 12:08:04+00:00

2019-05-01 12:47:00+00:00

0:38:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.2901849151613187
survival_time_median	6.399999999999985
deviation-center-line_median	0.3055261749566651
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.15687271889219892
agent_compute-ego_mean	0.1550588056915602
agent_compute-ego_median	0.15554117202758788
agent_compute-ego_min	0.14934167717442368
deviation-center-line_max	1.1683154522990224
deviation-center-line_mean	0.5214042026079623
deviation-center-line_min	0.10113504410924223
deviation-heading_max	4.824580742561065
deviation-heading_mean	2.18414345263899
deviation-heading_median	1.1201942096560549
deviation-heading_min	0.5816153666778373
driven_any_max	3.6696675269713728
driven_any_mean	2.0021839948989557
driven_any_median	1.6548383075575035
driven_any_min	0.31674784564662445
driven_lanedir_consec_max	3.4737831474158014
driven_lanedir_consec_mean	1.7079968318655536
driven_lanedir_consec_min	0.27764583406110277
driven_lanedir_max	3.4737831474158014
driven_lanedir_mean	1.7085735119386305
driven_lanedir_median	1.2901849151613187
driven_lanedir_min	0.27764583406110277
in-drivable-lane_max	3.950000000000044
in-drivable-lane_mean	0.776666666666669
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1704805724412426, "sim_physics": 0.08973064111626666, "survival_time": 4.599999999999992, "driven_lanedir": 0.7610557395573121, "sim_render-ego": 0.03620117902755737, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.15363734701405402, "deviation-heading": 0.6077531650510163, "set_robot_commands": 0.054599199606024704, "deviation-center-line": 0.1866873030437143, "driven_lanedir_consec": 0.7610557395573121, "sim_compute_sim_state": 0.022348740826482357, "sim_compute_performance-ego": 0.03858835282533065, "sim_compute_robot_state-ego": 0.04050317536229673, "sim_compute_robot_state-npc0": 0.04017454904058705, "sim_compute_robot_state-npc1": 0.03915769380071889, "sim_compute_robot_state-npc2": 0.03949665764103765, "sim_compute_robot_state-npc3": 0.0388341442398403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.42949719943470327, "sim_physics": 0.09465628989199376, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3670364741760759, "sim_render-ego": 0.035366667077896444, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.15687271889219892, "deviation-heading": 0.9236856161383415, "set_robot_commands": 0.05371027804435568, "deviation-center-line": 0.154667167621111, "driven_lanedir_consec": 0.3670364741760759, "sim_compute_sim_state": 0.02271303217461769, "sim_compute_performance-ego": 0.03826818567641238, "sim_compute_robot_state-ego": 0.040932964771351915, "sim_compute_robot_state-npc0": 0.04066456125137654, "sim_compute_robot_state-npc1": 0.039229494460085605, "sim_compute_robot_state-npc2": 0.03942573831436482, "sim_compute_robot_state-npc3": 0.03915275918676498}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6548383075575035, "sim_physics": 0.09560837520389108, "survival_time": 6.349999999999985, "driven_lanedir": 1.2901849151613187, "sim_render-ego": 0.03561484156631109, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.15602860676022026, "deviation-heading": 0.5821262157691277, "set_robot_commands": 0.05388345868568721, "deviation-center-line": 0.3004893681700666, "driven_lanedir_consec": 1.2901849151613187, "sim_compute_sim_state": 0.022485838161678765, "sim_compute_performance-ego": 0.03842592051648718, "sim_compute_robot_state-ego": 0.040710357230479326, "sim_compute_robot_state-npc0": 0.03997288350983867, "sim_compute_robot_state-npc1": 0.03933641291040135, "sim_compute_robot_state-npc2": 0.038880687998974414, "sim_compute_robot_state-npc3": 0.03925103840865488}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.636588539148601, "sim_physics": 0.09164980053901672, "survival_time": 6.399999999999985, "driven_lanedir": 1.2592125523553277, "sim_render-ego": 0.03540130704641342, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.15638679824769497, "deviation-heading": 0.7356652125912474, "set_robot_commands": 0.05412803031504154, "deviation-center-line": 0.3055261749566651, "driven_lanedir_consec": 1.2577517180734863, "sim_compute_sim_state": 0.022494973614811897, "sim_compute_performance-ego": 0.038355929777026176, "sim_compute_robot_state-ego": 0.04164718836545944, "sim_compute_robot_state-npc0": 0.03998183272778988, "sim_compute_robot_state-npc1": 0.03927246667444706, "sim_compute_robot_state-npc2": 0.03906228393316269, "sim_compute_robot_state-npc3": 0.03927743621170521}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.31674784564662445, "sim_physics": 0.09044274416836826, "survival_time": 1.6500000000000008, "driven_lanedir": 0.27764583406110277, "sim_render-ego": 0.03559814077435118, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.14934167717442368, "deviation-heading": 0.5825874989192626, "set_robot_commands": 0.053760131200154625, "deviation-center-line": 0.10113504410924223, "driven_lanedir_consec": 0.27764583406110277, "sim_compute_sim_state": 0.02278429089170514, "sim_compute_performance-ego": 0.0448350834124016, "sim_compute_robot_state-ego": 0.040261059096365265, "sim_compute_robot_state-npc0": 0.03968945416537198, "sim_compute_robot_state-npc1": 0.03959093671856505, "sim_compute_robot_state-npc2": 0.03959276459433816, "sim_compute_robot_state-npc3": 0.03912222024166223}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.6696675269713728, "sim_physics": 0.08774137417475382, "survival_time": 14.950000000000076, "driven_lanedir": 2.4517581654507734, "sim_render-ego": 0.03580448865890503, "in-drivable-lane": 3.950000000000044, "agent_compute-ego": 0.15572691043217976, "deviation-heading": 3.4665134100247443, "set_robot_commands": 0.054549925327301026, "deviation-center-line": 0.7442003639529776, "driven_lanedir_consec": 2.4517581654507734, "sim_compute_sim_state": 0.02257358392079671, "sim_compute_performance-ego": 0.03858078400293986, "sim_compute_robot_state-ego": 0.04066668351491292, "sim_compute_robot_state-npc0": 0.039792006015777585, "sim_compute_robot_state-npc1": 0.03943184773127238, "sim_compute_robot_state-npc2": 0.03900408506393432, "sim_compute_robot_state-npc3": 0.0394590957959493}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 3.2999330877546735, "sim_physics": 0.08900824149449667, "survival_time": 14.950000000000076, "driven_lanedir": 3.033611414220241, "sim_render-ego": 0.035839668114980065, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.15470792214075724, "deviation-heading": 4.344169514305054, "set_robot_commands": 0.05499179045359293, "deviation-center-line": 1.1683154522990224, "driven_lanedir_consec": 3.033611414220241, "sim_compute_sim_state": 0.022431678771972656, "sim_compute_performance-ego": 0.03833279053370158, "sim_compute_robot_state-ego": 0.0404259713490804, "sim_compute_robot_state-npc0": 0.03985824743906657, "sim_compute_robot_state-npc1": 0.03932872533798218, "sim_compute_robot_state-npc2": 0.03910680373509725, "sim_compute_robot_state-npc3": 0.03888072808583577}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 3.6100031208316183, "sim_physics": 0.08760899621269307, "survival_time": 14.150000000000066, "driven_lanedir": 3.4737831474158014, "sim_render-ego": 0.03574929052022657, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.15675467737150697, "deviation-heading": 3.1800933316242013, "set_robot_commands": 0.05426807622606257, "deviation-center-line": 0.9780549952488032, "driven_lanedir_consec": 3.4737831474158014, "sim_compute_sim_state": 0.02259945448211562, "sim_compute_performance-ego": 0.038319412474076234, "sim_compute_robot_state-ego": 0.04060990650325277, "sim_compute_robot_state-npc0": 0.03995256794636325, "sim_compute_robot_state-npc1": 0.03932157422123023, "sim_compute_robot_state-npc2": 0.03904823279633539, "sim_compute_robot_state-npc3": 0.039377605957193}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.1122740403462945, "sim_physics": 0.09002078294754029, "survival_time": 14.950000000000076, "driven_lanedir": 2.845227181577444, "sim_render-ego": 0.03579975207646688, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.15554117202758788, "deviation-heading": 4.714244401418427, "set_robot_commands": 0.05475276788075765, "deviation-center-line": 0.9258536518091448, "driven_lanedir_consec": 2.845227181577444, "sim_compute_sim_state": 0.022469621499379477, "sim_compute_performance-ego": 0.0384969703356425, "sim_compute_robot_state-ego": 0.04044906934102376, "sim_compute_robot_state-npc0": 0.04006794134775798, "sim_compute_robot_state-npc1": 0.03936373472213745, "sim_compute_robot_state-npc2": 0.038970422744750974, "sim_compute_robot_state-npc3": 0.03929532368977864}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5073407695666912, "sim_physics": 0.09650916120280392, "survival_time": 2.3, "driven_lanedir": 0.49036854607390934, "sim_render-ego": 0.03532547017802363, "in-drivable-lane": 0, "agent_compute-ego": 0.1547829016395237, "deviation-heading": 0.5816153666778373, "set_robot_commands": 0.053371880365454635, "deviation-center-line": 0.1653841482200119, "driven_lanedir_consec": 0.49036854607390934, "sim_compute_sim_state": 0.022286031557166058, "sim_compute_performance-ego": 0.03833573279173478, "sim_compute_robot_state-ego": 0.04050472508306089, "sim_compute_robot_state-npc0": 0.03966027757395869, "sim_compute_robot_state-npc1": 0.03900525880896527, "sim_compute_robot_state-npc2": 0.0385550364204075, "sim_compute_robot_state-npc3": 0.038781596266705055}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.033508607505638, "sim_physics": 0.0916566290753953, "survival_time": 4.699999999999991, "driven_lanedir": 0.7696239067463075, "sim_render-ego": 0.03591765495056801, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.15636776609623687, "deviation-heading": 1.1201942096560549, "set_robot_commands": 0.053201469969242174, "deviation-center-line": 0.2676759672625516, "driven_lanedir_consec": 0.7696239067463075, "sim_compute_sim_state": 0.02234690493725716, "sim_compute_performance-ego": 0.0381403958543818, "sim_compute_robot_state-ego": 0.04064246187818811, "sim_compute_robot_state-npc0": 0.04010638277581398, "sim_compute_robot_state-npc1": 0.03910206987502727, "sim_compute_robot_state-npc2": 0.03922382060517656, "sim_compute_robot_state-npc3": 0.039200389638860175}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 3.5197596257427595, "sim_physics": 0.08877203623453776, "survival_time": 14.950000000000076, "driven_lanedir": 3.120507849925628, "sim_render-ego": 0.035723760922749835, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.1554986786842346, "deviation-heading": 4.824580742561065, "set_robot_commands": 0.05426931937535604, "deviation-center-line": 1.0926146928559852, "driven_lanedir_consec": 3.120507849925628, "sim_compute_sim_state": 0.022324848969777423, "sim_compute_performance-ego": 0.03888420104980469, "sim_compute_robot_state-ego": 0.040249387423197426, "sim_compute_robot_state-npc0": 0.04000704288482666, "sim_compute_robot_state-npc1": 0.039240804513295494, "sim_compute_robot_state-npc2": 0.03895086288452149, "sim_compute_robot_state-npc3": 0.03907903671264648}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.019131189315694, "sim_physics": 0.09231676584408607, "survival_time": 4.049999999999994, "driven_lanedir": 0.6681872228835631, "sim_render-ego": 0.035446882247924805, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.15328043772850508, "deviation-heading": 1.450861755847466, "set_robot_commands": 0.05301927637170862, "deviation-center-line": 0.2137502265673143, "driven_lanedir_consec": 0.660997856069246, "sim_compute_sim_state": 0.022575260680398824, "sim_compute_performance-ego": 0.03821876019607356, "sim_compute_robot_state-ego": 0.0399239769688359, "sim_compute_robot_state-npc0": 0.04036056848219883, "sim_compute_robot_state-npc1": 0.03904233449771081, "sim_compute_robot_state-npc2": 0.038868494975714034, "sim_compute_robot_state-npc3": 0.03884780848467791}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.6563968494769574, "sim_physics": 0.08526410350093135, "survival_time": 6.749999999999984, "driven_lanedir": 1.618285091777995, "sim_render-ego": 0.035347938537597656, "in-drivable-lane": 0, "agent_compute-ego": 0.15554469956292047, "deviation-heading": 1.0883071165474187, "set_robot_commands": 0.054272694057888454, "deviation-center-line": 0.35049300982640563, "driven_lanedir_consec": 1.618285091777995, "sim_compute_sim_state": 0.021996597007468893, "sim_compute_performance-ego": 0.03790386164629901, "sim_compute_robot_state-ego": 0.039632855521308054, "sim_compute_robot_state-npc0": 0.03906623345834238, "sim_compute_robot_state-npc1": 0.03900176860668041, "sim_compute_robot_state-npc2": 0.03818316283049407, "sim_compute_robot_state-npc3": 0.03850624119793927}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.396592641743954, "sim_physics": 0.08969664971033732, "survival_time": 14.950000000000076, "driven_lanedir": 3.2021146376966616, "sim_render-ego": 0.03488504966100057, "in-drivable-lane": 0, "agent_compute-ego": 0.15540977160135905, "deviation-heading": 4.559754232453578, "set_robot_commands": 0.054956624507904055, "deviation-center-line": 0.8662154731764184, "driven_lanedir_consec": 3.2021146376966616, "sim_compute_sim_state": 0.022084670066833494, "sim_compute_performance-ego": 0.03767255942026774, "sim_compute_robot_state-ego": 0.04008259614308675, "sim_compute_robot_state-npc0": 0.039399851163228354, "sim_compute_robot_state-npc1": 0.03848597685496012, "sim_compute_robot_state-npc2": 0.03859027226765951, "sim_compute_robot_state-npc3": 0.03844772100448608}}
set_robot_commands_max	0.05499179045359293
set_robot_commands_mean	0.05411566149243547
set_robot_commands_median	0.05426807622606257
set_robot_commands_min	0.05301927637170862
sim_compute_performance-ego_max	0.0448350834124016
sim_compute_performance-ego_mean	0.038757262700838645
sim_compute_performance-ego_median	0.03833573279173478
sim_compute_performance-ego_min	0.03767255942026774
sim_compute_robot_state-ego_max	0.04164718836545944
sim_compute_robot_state-ego_mean	0.040482825236793314
sim_compute_robot_state-ego_median	0.04050317536229673
sim_compute_robot_state-ego_min	0.039632855521308054
sim_compute_robot_state-npc0_max	0.04066456125137654
sim_compute_robot_state-npc0_mean	0.03991695998548655
sim_compute_robot_state-npc0_median	0.03997288350983867
sim_compute_robot_state-npc0_min	0.03906623345834238
sim_compute_robot_state-npc1_max	0.03959093671856505
sim_compute_robot_state-npc1_mean	0.039194073315565306
sim_compute_robot_state-npc1_median	0.039240804513295494
sim_compute_robot_state-npc1_min	0.03848597685496012
sim_compute_robot_state-npc2_max	0.03959276459433816
sim_compute_robot_state-npc2_mean	0.03899728845373126
sim_compute_robot_state-npc2_median	0.03900408506393432
sim_compute_robot_state-npc2_min	0.03818316283049407
sim_compute_robot_state-npc3_max	0.0394590957959493
sim_compute_robot_state-npc3_mean	0.03903420967484663
sim_compute_robot_state-npc3_median	0.03912222024166223
sim_compute_robot_state-npc3_min	0.03844772100448608
sim_compute_sim_state_max	0.02278429089170514
sim_compute_sim_state_mean	0.02243436850416414
sim_compute_sim_state_median	0.022469621499379477
sim_compute_sim_state_min	0.021996597007468893
sim_physics_max	0.09650916120280392
sim_physics_mean	0.09071217275447412
sim_physics_median	0.09002078294754029
sim_physics_min	0.08526410350093135
sim_render-ego_max	0.03620117902755737
sim_render-ego_mean	0.035601472757398174
sim_render-ego_median	0.03561484156631109
sim_render-ego_min	0.03488504966100057
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.536666666666692
survival_time_min	1.6500000000000008

No reset possible

21439

3141

Amaury Camus 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-30 15:14:56+00:00

2019-04-30 15:27:52+00:00

0:12:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.11382454854470712
agent_compute-ego_mean	0.09252803669255603
agent_compute-ego_median	0.08690969149271648
agent_compute-ego_min	0.08573441401771877
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11652367644839816, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04632035891215006, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11382454854470712, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06825075767658374, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.027749317663687247, "sim_compute_performance-ego": 0.050952006269384315, "sim_compute_robot_state-ego": 0.05585320790608724, "sim_compute_robot_state-npc0": 0.05164604716830783, "sim_compute_robot_state-npc1": 0.05068041218651666, "sim_compute_robot_state-npc2": 0.050246587506047, "sim_compute_robot_state-npc3": 0.0511413989243684}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.13596060752868652, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.04755538940429688, "in-drivable-lane": 0, "agent_compute-ego": 0.11027358055114746, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0670387840270996, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02835317611694336, "sim_compute_performance-ego": 0.05300828933715821, "sim_compute_robot_state-ego": 0.054909582138061526, "sim_compute_robot_state-npc0": 0.05263205528259277, "sim_compute_robot_state-npc1": 0.05101961135864258, "sim_compute_robot_state-npc2": 0.0494620418548584, "sim_compute_robot_state-npc3": 0.05145087242126465}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12052869483044272, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.045159844975722466, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11357908499868292, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.07032173244576705, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.027197803321637605, "sim_compute_performance-ego": 0.047767730135666694, "sim_compute_robot_state-ego": 0.04977825440858539, "sim_compute_robot_state-npc0": 0.050657802506497034, "sim_compute_robot_state-npc1": 0.05068954668546978, "sim_compute_robot_state-npc2": 0.04756200627276772, "sim_compute_robot_state-npc3": 0.04851462025391428}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.10731203344803822, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.0381926283051696, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09345170214206358, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05932630466509469, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0242757736882077, "sim_compute_performance-ego": 0.04054303712482694, "sim_compute_robot_state-ego": 0.04351161099687408, "sim_compute_robot_state-npc0": 0.0435972364642952, "sim_compute_robot_state-npc1": 0.04267123379284823, "sim_compute_robot_state-npc2": 0.04252358931529371, "sim_compute_robot_state-npc3": 0.043104319632807864}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09123792818614417, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.035180091857910156, "in-drivable-lane": 0, "agent_compute-ego": 0.0913739630154201, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05404942376273019, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02240954978125436, "sim_compute_performance-ego": 0.03869920117514474, "sim_compute_robot_state-ego": 0.04045948811939785, "sim_compute_robot_state-npc0": 0.03989231586456299, "sim_compute_robot_state-npc1": 0.0385055456842695, "sim_compute_robot_state-npc2": 0.0393299971308027, "sim_compute_robot_state-npc3": 0.03860029152461461}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.09059275962688304, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03550323733577022, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08698729232505516, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.05462835011658845, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022742161044368037, "sim_compute_performance-ego": 0.04017688168419732, "sim_compute_robot_state-ego": 0.040719464973167134, "sim_compute_robot_state-npc0": 0.0395421098779749, "sim_compute_robot_state-npc1": 0.04010357680144133, "sim_compute_robot_state-npc2": 0.03903373523994728, "sim_compute_robot_state-npc3": 0.03886823300962095}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.08480413754781087, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03520374827914768, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08727005234471073, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05437833291512949, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022059321403503414, "sim_compute_performance-ego": 0.037938316663106285, "sim_compute_robot_state-ego": 0.03986276520623101, "sim_compute_robot_state-npc0": 0.03948151182245325, "sim_compute_robot_state-npc1": 0.03850077699731897, "sim_compute_robot_state-npc2": 0.03869887634559914, "sim_compute_robot_state-npc3": 0.03838467156445539}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.1070074028438992, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03535022735595703, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08690969149271648, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05404627058241102, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022325097190009226, "sim_compute_performance-ego": 0.03808720906575521, "sim_compute_robot_state-ego": 0.04032474093967014, "sim_compute_robot_state-npc0": 0.03941178321838379, "sim_compute_robot_state-npc1": 0.03904270066155328, "sim_compute_robot_state-npc2": 0.03870556089613173, "sim_compute_robot_state-npc3": 0.038316202163696286}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08413879767708156, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.035642535790153175, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08573441401771877, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.054020114566968834, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022144701169884724, "sim_compute_performance-ego": 0.03811747094859248, "sim_compute_robot_state-ego": 0.04013778334078581, "sim_compute_robot_state-npc0": 0.0398703554402227, "sim_compute_robot_state-npc1": 0.03922970916913903, "sim_compute_robot_state-npc2": 0.039075861806454865, "sim_compute_robot_state-npc3": 0.03908335125964621}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.10090846061706545, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.03539017200469971, "in-drivable-lane": 0, "agent_compute-ego": 0.08634466648101807, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05400182723999023, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02208285331726074, "sim_compute_performance-ego": 0.038965797424316405, "sim_compute_robot_state-ego": 0.04203757286071777, "sim_compute_robot_state-npc0": 0.039389514923095705, "sim_compute_robot_state-npc1": 0.03868093490600586, "sim_compute_robot_state-npc2": 0.0392566442489624, "sim_compute_robot_state-npc3": 0.03868548393249512}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10602911710739137, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.03609036207199097, "in-drivable-lane": 0, "agent_compute-ego": 0.08687140941619872, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05278823375701904, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.022552525997161864, "sim_compute_performance-ego": 0.038402330875396726, "sim_compute_robot_state-ego": 0.04109022617340088, "sim_compute_robot_state-npc0": 0.03870689868927002, "sim_compute_robot_state-npc1": 0.03950612545013428, "sim_compute_robot_state-npc2": 0.03862130641937256, "sim_compute_robot_state-npc3": 0.03917118310928345}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08708647677772924, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03554386841623407, "in-drivable-lane": 0, "agent_compute-ego": 0.08635794489007247, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05446392611453408, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.022039011905067844, "sim_compute_performance-ego": 0.03809596362866854, "sim_compute_robot_state-ego": 0.03975313588192588, "sim_compute_robot_state-npc0": 0.03927739042984812, "sim_compute_robot_state-npc1": 0.039044706444991265, "sim_compute_robot_state-npc2": 0.03930014058163291, "sim_compute_robot_state-npc3": 0.038883874290867856}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08423797130584716, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.035303378105163576, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08609416484832763, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05422092914581299, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.022271747589111327, "sim_compute_performance-ego": 0.03777441024780273, "sim_compute_robot_state-ego": 0.03958477020263672, "sim_compute_robot_state-npc0": 0.039811167716979984, "sim_compute_robot_state-npc1": 0.038940324783325195, "sim_compute_robot_state-npc2": 0.03845320224761963, "sim_compute_robot_state-npc3": 0.038344502449035645}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1037780913439664, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.03507138382304798, "in-drivable-lane": 0, "agent_compute-ego": 0.08604832129044966, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05407332290302624, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.021981445225802337, "sim_compute_performance-ego": 0.03769225423986262, "sim_compute_robot_state-ego": 0.04007298296148127, "sim_compute_robot_state-npc0": 0.039511919021606445, "sim_compute_robot_state-npc1": 0.03885286504572088, "sim_compute_robot_state-npc2": 0.038815606724132194, "sim_compute_robot_state-npc3": 0.03891848434101452}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.09921703046681928, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.034982058466697226, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08679971403005171, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.05376170606029277, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.022564698238762056, "sim_compute_performance-ego": 0.037983096375757336, "sim_compute_robot_state-ego": 0.039610108550713986, "sim_compute_robot_state-npc0": 0.03871411693339445, "sim_compute_robot_state-npc1": 0.03876519689754564, "sim_compute_robot_state-npc2": 0.03816757883344378, "sim_compute_robot_state-npc3": 0.03818620467672543}}
set_robot_commands_max	0.07032173244576705
set_robot_commands_mean	0.057291334398603226
set_robot_commands_median	0.05422092914581299
set_robot_commands_min	0.05278823375701904
sim_compute_performance-ego_max	0.05300828933715821
sim_compute_performance-ego_mean	0.04094693301304244
sim_compute_performance-ego_median	0.038402330875396726
sim_compute_performance-ego_min	0.03769225423986262
sim_compute_robot_state-ego_max	0.05585320790608724
sim_compute_robot_state-ego_mean	0.04318037964398245
sim_compute_robot_state-ego_median	0.04045948811939785
sim_compute_robot_state-ego_min	0.03958477020263672
sim_compute_robot_state-npc0_max	0.05263205528259277
sim_compute_robot_state-npc0_mean	0.04214281502396568
sim_compute_robot_state-npc0_median	0.0395421098779749
sim_compute_robot_state-npc0_min	0.03870689868927002
sim_compute_robot_state-npc1_max	0.05101961135864258
sim_compute_robot_state-npc1_mean	0.041615551124328166
sim_compute_robot_state-npc1_median	0.039044706444991265
sim_compute_robot_state-npc1_min	0.03850077699731897
sim_compute_robot_state-npc2_max	0.050246587506047
sim_compute_robot_state-npc2_mean	0.04115018236153774
sim_compute_robot_state-npc2_median	0.039075861806454865
sim_compute_robot_state-npc2_min	0.03816757883344378
sim_compute_robot_state-npc3_max	0.05145087242126465
sim_compute_robot_state-npc3_mean	0.04131024623692071
sim_compute_robot_state-npc3_median	0.038883874290867856
sim_compute_robot_state-npc3_min	0.03818620467672543
sim_compute_sim_state_max	0.02835317611694336
sim_compute_sim_state_mean	0.02351661224351079
sim_compute_sim_state_median	0.02240954978125436
sim_compute_sim_state_min	0.021981445225802337
sim_physics_max	0.13596060752868652
sim_physics_mean	0.10129087905041352
sim_physics_median	0.10090846061706545
sim_physics_min	0.08413879767708156
sim_render-ego_max	0.04755538940429688
sim_render-ego_mean	0.03776595234027405
sim_render-ego_median	0.03550323733577022
sim_render-ego_min	0.034982058466697226
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

21378

2446

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 02:00:18+00:00

2019-04-28 03:00:09+00:00

0:59:51

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2446/step1-simulation-ip-172-31-40-253-31940-job21378/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21373

2379

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

2019-04-28 01:32:01+00:00

2019-04-28 02:00:11+00:00

0:28:10

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2379/step1-simulation-ip-172-31-40-253-31940-job21373/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21356

2369

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 01:00:35+00:00

2019-04-28 01:31:18+00:00

0:30:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6202968959903497
survival_time_median	6.8999999999999835
deviation-center-line_median	0.2968973039399582
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.16041473614967475
agent_compute-ego_mean	0.14647046168634065
agent_compute-ego_median	0.14479910823660838
agent_compute-ego_min	0.1325126988547189
deviation-center-line_max	1.2578907011919125
deviation-center-line_mean	0.392559795052945
deviation-center-line_min	0.20837582250812192
deviation-heading_max	1.7338651399303977
deviation-heading_mean	0.922434565822337
deviation-heading_median	0.801279189692507
deviation-heading_min	0.48740885281046914
driven_any_max	1.7560498171261352
driven_any_mean	0.8746411422725543
driven_any_median	0.9886852216355494
driven_any_min	0.278862430643389
driven_lanedir_consec_max	1.7523714592470048
driven_lanedir_consec_mean	0.6813457664348396
driven_lanedir_consec_min	0.2720172605900939
driven_lanedir_max	1.7523714592470048
driven_lanedir_mean	0.6813457664348396
driven_lanedir_median	0.6202968959903497
driven_lanedir_min	0.2720172605900939
in-drivable-lane_max	6.400000000000029
in-drivable-lane_mean	1.1100000000000017
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.10176711802859958, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05920337944579639, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14218579264853498, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08765517550406696, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03651342117529121, "sim_compute_performance-ego": 0.06614582487147488, "sim_compute_robot_state-ego": 0.06975125923431177}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10064024073737007, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.057224246433803014, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.14105529274259296, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.08639905282429286, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.036390694550105504, "sim_compute_performance-ego": 0.06360251562935966, "sim_compute_robot_state-ego": 0.06599200963973999}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.11108150482177734, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.06235658327738444, "in-drivable-lane": 0, "agent_compute-ego": 0.14352180163065592, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.09909583197699652, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.04037963019476997, "sim_compute_performance-ego": 0.0677465279897054, "sim_compute_robot_state-ego": 0.07286706500583225}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11229624696399856, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.06006719236788542, "in-drivable-lane": 0, "agent_compute-ego": 0.14803185670272165, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.0917222577592601, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.03703455043875653, "sim_compute_performance-ego": 0.06686041666113812, "sim_compute_robot_state-ego": 0.0709801549496858}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.11274996631221684, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.06067225377853602, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.15015941667774496, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.0949016564512906, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.03879616902843458, "sim_compute_performance-ego": 0.0704095222089933, "sim_compute_robot_state-ego": 0.07547286438615355}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.09805238928113665, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.0542097738810948, "in-drivable-lane": 0, "agent_compute-ego": 0.1325126988547189, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.08080523695264544, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.035781747954232355, "sim_compute_performance-ego": 0.06288190909794399, "sim_compute_robot_state-ego": 0.06545041629246302}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.1021788842241529, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.057419669460242906, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14479910823660838, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.08979209543953479, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.03646189729932328, "sim_compute_performance-ego": 0.06505891638742366, "sim_compute_robot_state-ego": 0.07025778461510027}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.10907088673633078, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06121214576389478, "in-drivable-lane": 0, "agent_compute-ego": 0.14918504590573517, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.09370615689650826, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.036489704380864685, "sim_compute_performance-ego": 0.06956033603004787, "sim_compute_robot_state-ego": 0.07338830699091373}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1101460059483846, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.060825157165527347, "in-drivable-lane": 0, "agent_compute-ego": 0.14693173037634957, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.08905344009399414, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.03692355155944824, "sim_compute_performance-ego": 0.0674448463651869, "sim_compute_robot_state-ego": 0.06908909479777019}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.10613883405491924, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.05960864778878032, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.15170207058174023, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.09150728626527647, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.03810673174650773, "sim_compute_performance-ego": 0.06531306107838948, "sim_compute_robot_state-ego": 0.07132961266282675}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.11745743795272408, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.06494563107096821, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.1570410750327854, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.09822949138256389, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.03993824315727304, "sim_compute_performance-ego": 0.06958859010573921, "sim_compute_robot_state-ego": 0.07889464579590964}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.10885508524047004, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.05876824259757995, "in-drivable-lane": 0, "agent_compute-ego": 0.14017251133918762, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.08711120817396376, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.03562552399105496, "sim_compute_performance-ego": 0.06359101666344537, "sim_compute_robot_state-ego": 0.06991491383976406}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.10230579479135198, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.058692076223359695, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14466500282287598, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.09030082929048606, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.03741243074266173, "sim_compute_performance-ego": 0.06698662428547153, "sim_compute_robot_state-ego": 0.07055359950168527}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.1262446581307104, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.06638736644033659, "in-drivable-lane": 0, "agent_compute-ego": 0.16041473614967475, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.10359137341127556, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.0403835369368731, "sim_compute_performance-ego": 0.07613052352000091, "sim_compute_robot_state-ego": 0.08999096337011304}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.10895467497006492, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.06033712699700193, "in-drivable-lane": 0, "agent_compute-ego": 0.1446787855931832, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.09069040801020578, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.03730521855017951, "sim_compute_performance-ego": 0.06528067588806152, "sim_compute_robot_state-ego": 0.07032032626298454}}
set_robot_commands_max	0.10359137341127556
set_robot_commands_mean	0.09163743336215743
set_robot_commands_median	0.09069040801020578
set_robot_commands_min	0.08080523695264544
sim_compute_performance-ego_max	0.07613052352000091
sim_compute_performance-ego_mean	0.06710675378549213
sim_compute_performance-ego_median	0.06686041666113812
sim_compute_performance-ego_min	0.06288190909794399
sim_compute_robot_state-ego_max	0.08999096337011304
sim_compute_robot_state-ego_mean	0.0722835344896836
sim_compute_robot_state-ego_median	0.07055359950168527
sim_compute_robot_state-ego_min	0.06545041629246302
sim_compute_sim_state_max	0.0403835369368731
sim_compute_sim_state_mean	0.0375695367803851
sim_compute_sim_state_median	0.03703455043875653
sim_compute_sim_state_min	0.03562552399105496
sim_physics_max	0.1262446581307104
sim_physics_mean	0.1085293152129472
sim_physics_median	0.10895467497006492
sim_physics_min	0.09805238928113665
sim_render-ego_max	0.06638736644033659
sim_render-ego_mean	0.06012863284614612
sim_render-ego_median	0.06006719236788542
sim_render-ego_min	0.0542097738810948
simulation-passed	1
survival_time_max	12.050000000000036
survival_time_mean	6.166666666666666
survival_time_min	2.25

No reset possible

21331

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-28 00:00:31+00:00

2019-04-28 01:00:10+00:00

0:59:39

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-40-253-31940-job21331/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21328

2395

Liam Paull 🇨🇦

random_agent

step1-simulation

host-error

2019-04-27 23:40:43+00:00

2019-04-28 00:00:09+00:00

0:19:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2395/step1-simulation-ip-172-31-40-253-31940-job21328/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21307

2404

Victor Guerra 🇫🇷

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-27 23:00:17+00:00

2019-04-27 23:40:26+00:00

0:40:09

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.06786145158611356
survival_time_median	1.6000000000000008
deviation-center-line_median	0.0900306277508787
in-drivable-lane_median	0.4500000000000004

other stats

agent_compute-ego_max	0.17636674184065598
agent_compute-ego_mean	0.1639250471796888
agent_compute-ego_median	0.1645049285888672
agent_compute-ego_min	0.14927279507672345
deviation-center-line_max	0.7152117870173232
deviation-center-line_mean	0.19645627424412113
deviation-center-line_min	0.03243094285371508
deviation-heading_max	6.1730659518854365
deviation-heading_mean	2.1057002516368155
deviation-heading_median	0.7666467016482028
deviation-heading_min	0.6352477328706679
driven_any_max	1.7727343815740058
driven_any_mean	0.5646908628092375
driven_any_median	0.1580420283951172
driven_any_min	0.0902946141397137
driven_lanedir_consec_max	0.6129774544926991
driven_lanedir_consec_mean	0.20705498543453063
driven_lanedir_consec_min	0.04365599114252383
driven_lanedir_max	0.6129774544926991
driven_lanedir_mean	0.20705498543453063
driven_lanedir_median	0.06786145158611356
driven_lanedir_min	0.04365599114252383
in-drivable-lane_max	7.450000000000042
in-drivable-lane_mean	2.1666666666666776
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.728314623655175, "sim_physics": 0.17062642415364584, "survival_time": 14.950000000000076, "driven_lanedir": 0.6012354410413878, "sim_render-ego": 0.061878435611724854, "in-drivable-lane": 7.300000000000041, "agent_compute-ego": 0.1734746249516805, "deviation-heading": 5.6644260477352395, "set_robot_commands": 0.09584758917490642, "deviation-center-line": 0.7152117870173232, "driven_lanedir_consec": 0.6012354410413878, "sim_compute_sim_state": 0.03761708895365397, "sim_compute_performance-ego": 0.06746572335561117, "sim_compute_robot_state-ego": 0.0720801043510437, "sim_compute_robot_state-npc0": 0.06853703180948893, "sim_compute_robot_state-npc1": 0.06810633261998494, "sim_compute_robot_state-npc2": 0.06782676696777344, "sim_compute_robot_state-npc3": 0.0672326421737671}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6311366663748514, "sim_physics": 0.15841265122095743, "survival_time": 14.950000000000076, "driven_lanedir": 0.5601586823132658, "sim_render-ego": 0.05894453207651774, "in-drivable-lane": 7.250000000000041, "agent_compute-ego": 0.1655977686246236, "deviation-heading": 6.1730659518854365, "set_robot_commands": 0.09144948323567707, "deviation-center-line": 0.2851781880573261, "driven_lanedir_consec": 0.5601586823132658, "sim_compute_sim_state": 0.03925947427749634, "sim_compute_performance-ego": 0.06589964866638183, "sim_compute_robot_state-ego": 0.07023919582366943, "sim_compute_robot_state-npc0": 0.06629884243011475, "sim_compute_robot_state-npc1": 0.06859591166178386, "sim_compute_robot_state-npc2": 0.0672248101234436, "sim_compute_robot_state-npc3": 0.06896880865097046}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11093180490044864, "sim_physics": 0.18228963705209583, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06778534170269257, "sim_render-ego": 0.06711111618922307, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17636674184065598, "deviation-heading": 0.6765228761594979, "set_robot_commands": 0.1097112252162053, "deviation-center-line": 0.10628435158242136, "driven_lanedir_consec": 0.06778534170269257, "sim_compute_sim_state": 0.038101792335510254, "sim_compute_performance-ego": 0.06625886146838848, "sim_compute_robot_state-ego": 0.07351184808290921, "sim_compute_robot_state-npc0": 0.07167184352874756, "sim_compute_robot_state-npc1": 0.07362991112929124, "sim_compute_robot_state-npc2": 0.07292651213132419, "sim_compute_robot_state-npc3": 0.07080981364616981}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09474951237901552, "sim_physics": 0.18246303558349608, "survival_time": 1.2500000000000004, "driven_lanedir": 0.04974498457450238, "sim_render-ego": 0.059694223403930664, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1645049285888672, "deviation-heading": 0.6849248911634299, "set_robot_commands": 0.08485819816589356, "deviation-center-line": 0.0933926455128373, "driven_lanedir_consec": 0.04974498457450238, "sim_compute_sim_state": 0.03483891487121582, "sim_compute_performance-ego": 0.06406791687011719, "sim_compute_robot_state-ego": 0.06931376457214355, "sim_compute_robot_state-npc0": 0.06187405586242676, "sim_compute_robot_state-npc1": 0.06219202995300293, "sim_compute_robot_state-npc2": 0.06474527359008789, "sim_compute_robot_state-npc3": 0.06439915657043457}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1577345773104903, "sim_physics": 0.15994245558977127, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05563831193364788, "sim_render-ego": 0.058962032198905945, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16064555197954178, "deviation-heading": 0.7957696819433993, "set_robot_commands": 0.08483606576919556, "deviation-center-line": 0.038678253199125434, "driven_lanedir_consec": 0.05563831193364788, "sim_compute_sim_state": 0.03843008726835251, "sim_compute_performance-ego": 0.06242435425519943, "sim_compute_robot_state-ego": 0.06808792799711227, "sim_compute_robot_state-npc0": 0.06105256825685501, "sim_compute_robot_state-npc1": 0.0601339116692543, "sim_compute_robot_state-npc2": 0.06313823163509369, "sim_compute_robot_state-npc3": 0.06606325507164001}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.21856355945743167, "sim_physics": 0.1623014308310844, "survival_time": 1.850000000000001, "driven_lanedir": 0.10780882368392808, "sim_render-ego": 0.057613192377863706, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.15683315251324628, "deviation-heading": 0.8764594909252057, "set_robot_commands": 0.09043258589667244, "deviation-center-line": 0.06506883937793898, "driven_lanedir_consec": 0.10780882368392808, "sim_compute_sim_state": 0.03894588753983781, "sim_compute_performance-ego": 0.060643093006030935, "sim_compute_robot_state-ego": 0.06724320231257258, "sim_compute_robot_state-npc0": 0.07091636271090121, "sim_compute_robot_state-npc1": 0.07371686600350044, "sim_compute_robot_state-npc2": 0.07188115248808989, "sim_compute_robot_state-npc3": 0.07100441649153426}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14422620255228788, "sim_physics": 0.19696570932865143, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06037937254437964, "sim_render-ego": 0.0657452791929245, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.17568403482437134, "deviation-heading": 0.6836506125468975, "set_robot_commands": 0.0935029536485672, "deviation-center-line": 0.0730370580429908, "driven_lanedir_consec": 0.06037937254437964, "sim_compute_sim_state": 0.03717069327831268, "sim_compute_performance-ego": 0.07709811627864838, "sim_compute_robot_state-ego": 0.08366905897855759, "sim_compute_robot_state-npc0": 0.07324519008398056, "sim_compute_robot_state-npc1": 0.07056211680173874, "sim_compute_robot_state-npc2": 0.06913361698389053, "sim_compute_robot_state-npc3": 0.06455641239881516}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.12937342534062007, "sim_physics": 0.1732630111553051, "survival_time": 1.3500000000000003, "driven_lanedir": 0.0878491880699106, "sim_render-ego": 0.05612262090047201, "in-drivable-lane": 0, "agent_compute-ego": 0.14927279507672345, "deviation-heading": 0.752936850532291, "set_robot_commands": 0.08910982697098344, "deviation-center-line": 0.10827184653051472, "driven_lanedir_consec": 0.0878491880699106, "sim_compute_sim_state": 0.03675498785795989, "sim_compute_performance-ego": 0.06350494314123083, "sim_compute_robot_state-ego": 0.06425830169960305, "sim_compute_robot_state-npc0": 0.06753249521608706, "sim_compute_robot_state-npc1": 0.06723611443131058, "sim_compute_robot_state-npc2": 0.06410692356250904, "sim_compute_robot_state-npc3": 0.06360378971806278}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.17600857728363625, "sim_physics": 0.17170949578285216, "survival_time": 2.000000000000001, "driven_lanedir": 0.06786145158611356, "sim_render-ego": 0.06013656258583069, "in-drivable-lane": 0.7000000000000004, "agent_compute-ego": 0.17268939614295958, "deviation-heading": 0.7396889846644146, "set_robot_commands": 0.09394357800483703, "deviation-center-line": 0.03243094285371508, "driven_lanedir_consec": 0.06786145158611356, "sim_compute_sim_state": 0.037225037813186646, "sim_compute_performance-ego": 0.06437405943870544, "sim_compute_robot_state-ego": 0.06452447175979614, "sim_compute_robot_state-npc0": 0.07000429630279541, "sim_compute_robot_state-npc1": 0.06524540185928344, "sim_compute_robot_state-npc2": 0.06934266686439514, "sim_compute_robot_state-npc3": 0.06617964506149292}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1723295844740451, "sim_physics": 0.1510499119758606, "survival_time": 1.800000000000001, "driven_lanedir": 0.06489560071940481, "sim_render-ego": 0.05774582756890191, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.15320786502626207, "deviation-heading": 0.7666467016482028, "set_robot_commands": 0.08422878053453234, "deviation-center-line": 0.03861269112672947, "driven_lanedir_consec": 0.06489560071940481, "sim_compute_sim_state": 0.03682138522466024, "sim_compute_performance-ego": 0.06201146708594428, "sim_compute_robot_state-ego": 0.06840909189648098, "sim_compute_robot_state-npc0": 0.06465678082572089, "sim_compute_robot_state-npc1": 0.06624707248475817, "sim_compute_robot_state-npc2": 0.06709185573789808, "sim_compute_robot_state-npc3": 0.06256990300284491}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.769544645277032, "sim_physics": 0.16478625297546387, "survival_time": 14.950000000000076, "driven_lanedir": 0.5691344620700658, "sim_render-ego": 0.06190489133199056, "in-drivable-lane": 7.450000000000042, "agent_compute-ego": 0.16667453050613404, "deviation-heading": 5.88686607534099, "set_robot_commands": 0.09373860279719036, "deviation-center-line": 0.6039852374588249, "driven_lanedir_consec": 0.5691344620700658, "sim_compute_sim_state": 0.03705699602762858, "sim_compute_performance-ego": 0.06737650553385417, "sim_compute_robot_state-ego": 0.07195972363154093, "sim_compute_robot_state-npc0": 0.06702205260594686, "sim_compute_robot_state-npc1": 0.06738568623860677, "sim_compute_robot_state-npc2": 0.06684830824534098, "sim_compute_robot_state-npc3": 0.0679236658414205}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.0902946141397137, "sim_physics": 0.15043136477470398, "survival_time": 1.2000000000000004, "driven_lanedir": 0.04365599114252383, "sim_render-ego": 0.05504670739173889, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1511822243531545, "deviation-heading": 0.6775039165476301, "set_robot_commands": 0.0853139062722524, "deviation-center-line": 0.0864558230800899, "driven_lanedir_consec": 0.04365599114252383, "sim_compute_sim_state": 0.034371783336003624, "sim_compute_performance-ego": 0.06659862399101257, "sim_compute_robot_state-ego": 0.0738160212834676, "sim_compute_robot_state-npc0": 0.06126583615938822, "sim_compute_robot_state-npc1": 0.0685126781463623, "sim_compute_robot_state-npc2": 0.06817786892255147, "sim_compute_robot_state-npc3": 0.06341460347175598}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.7727343815740058, "sim_physics": 0.17279531160990397, "survival_time": 14.950000000000076, "driven_lanedir": 0.6129774544926991, "sim_render-ego": 0.0620404839515686, "in-drivable-lane": 7.150000000000042, "agent_compute-ego": 0.17186488707860312, "deviation-heading": 5.767782988119984, "set_robot_commands": 0.09280046224594116, "deviation-center-line": 0.535294926379708, "driven_lanedir_consec": 0.6129774544926991, "sim_compute_sim_state": 0.038011698722839354, "sim_compute_performance-ego": 0.0683152723312378, "sim_compute_robot_state-ego": 0.07386461098988852, "sim_compute_robot_state-npc0": 0.06870046854019166, "sim_compute_robot_state-npc1": 0.06848757187525431, "sim_compute_robot_state-npc2": 0.06741066535313923, "sim_compute_robot_state-npc3": 0.06792384227116903}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11637873902469052, "sim_physics": 0.17361547207010203, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04718695593579092, "sim_render-ego": 0.05881083422693713, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.16382896489110485, "deviation-heading": 0.6352477328706679, "set_robot_commands": 0.0902344851658262, "deviation-center-line": 0.07491089569139331, "driven_lanedir_consec": 0.04718695593579092, "sim_compute_sim_state": 0.03599776070693444, "sim_compute_performance-ego": 0.0658270079514076, "sim_compute_robot_state-ego": 0.0709210675338219, "sim_compute_robot_state-npc0": 0.0666319830664273, "sim_compute_robot_state-npc1": 0.06426251345667346, "sim_compute_robot_state-npc2": 0.06549468533746128, "sim_compute_robot_state-npc3": 0.06829820830246498}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1580420283951172, "sim_physics": 0.16364348729451497, "survival_time": 1.5000000000000009, "driven_lanedir": 0.10951271970764688, "sim_render-ego": 0.05742239952087402, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15704824129740397, "deviation-heading": 0.8040109724689486, "set_robot_commands": 0.08659682273864747, "deviation-center-line": 0.0900306277508787, "driven_lanedir_consec": 0.10951271970764688, "sim_compute_sim_state": 0.03525560696919759, "sim_compute_performance-ego": 0.06693933010101319, "sim_compute_robot_state-ego": 0.06480617523193359, "sim_compute_robot_state-npc0": 0.06092125574747721, "sim_compute_robot_state-npc1": 0.06153979301452637, "sim_compute_robot_state-npc2": 0.06473581790924073, "sim_compute_robot_state-npc3": 0.06420346895853678}}
set_robot_commands_max	0.1097112252162053
set_robot_commands_mean	0.09110697105582184
set_robot_commands_median	0.09043258589667244
set_robot_commands_min	0.08422878053453234
sim_compute_performance-ego_max	0.07709811627864838
sim_compute_performance-ego_mean	0.06592032823165223
sim_compute_performance-ego_median	0.06589964866638183
sim_compute_performance-ego_min	0.060643093006030935
sim_compute_robot_state-ego_max	0.08366905897855759
sim_compute_robot_state-ego_mean	0.07044697107630274
sim_compute_robot_state-ego_median	0.07023919582366943
sim_compute_robot_state-ego_min	0.06425830169960305
sim_compute_robot_state-npc0_max	0.07324519008398056
sim_compute_robot_state-npc0_mean	0.06668873754310328
sim_compute_robot_state-npc0_median	0.06702205260594686
sim_compute_robot_state-npc0_min	0.06092125574747721
sim_compute_robot_state-npc1_max	0.07371686600350044
sim_compute_robot_state-npc1_mean	0.06705692742302212
sim_compute_robot_state-npc1_median	0.06738568623860677
sim_compute_robot_state-npc1_min	0.0601339116692543
sim_compute_robot_state-npc2_max	0.07292651213132419
sim_compute_robot_state-npc2_mean	0.06733901039014928
sim_compute_robot_state-npc2_median	0.0672248101234436
sim_compute_robot_state-npc2_min	0.06313823163509369
sim_compute_robot_state-npc3_max	0.07100441649153426
sim_compute_robot_state-npc3_mean	0.06647677544207195
sim_compute_robot_state-npc3_median	0.06617964506149292
sim_compute_robot_state-npc3_min	0.06256990300284491
sim_compute_sim_state_max	0.03925947427749634
sim_compute_sim_state_mean	0.037057279678852646
sim_compute_sim_state_median	0.03717069327831268
sim_compute_sim_state_min	0.034371783336003624
sim_physics_max	0.19696570932865143
sim_physics_mean	0.1689530434265606
sim_physics_median	0.17062642415364584
sim_physics_min	0.15043136477470398
sim_render-ego_max	0.06711111618922307
sim_render-ego_mean	0.05994527590196028
sim_render-ego_median	0.058962032198905945
sim_render-ego_min	0.05504670739173889
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	5.1133333333333555
survival_time_min	1.2000000000000004

No reset possible

21301

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 22:56:36+00:00

2019-04-27 23:00:09+00:00

0:03:33

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-40-253-31940-job21301/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21284

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 22:02:00+00:00

2019-04-27 22:55:59+00:00

0:53:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4861461122154971
survival_time_median	3.7999999999999945
deviation-center-line_median	0.3338167565194672
in-drivable-lane_median	0.14999999999999947

other stats

agent_compute-ego_max	0.1096583698310104
agent_compute-ego_mean	0.10006205838080756
agent_compute-ego_median	0.09883115330680473
agent_compute-ego_min	0.08973806244986397
deviation-center-line_max	1.3961355591934264
deviation-center-line_mean	0.538268945838615
deviation-center-line_min	0.10868944755534243
deviation-heading_max	7.710127968597522
deviation-heading_mean	2.2975389110061935
deviation-heading_median	1.0613091398983183
deviation-heading_min	0.5432258830302972
driven_any_max	2.3487608095422123
driven_any_mean	1.0337929281894636
driven_any_median	0.5570661499927073
driven_any_min	0.17134950861771794
driven_lanedir_consec_max	2.117170658807209
driven_lanedir_consec_mean	0.6681033819799187
driven_lanedir_consec_min	0.13711492274865522
driven_lanedir_max	2.121566667868982
driven_lanedir_mean	0.8029247296399056
driven_lanedir_median	0.4861461122154971
driven_lanedir_min	0.13711492274865522
in-drivable-lane_max	2.8000000000000336
in-drivable-lane_mean	0.7300000000000038
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.341417208873324, "sim_physics": 0.2066521167755127, "survival_time": 14.950000000000076, "driven_lanedir": 2.121566667868982, "sim_render-ego": 0.06413936456044515, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.09827680985132851, "deviation-heading": 3.5383092052690603, "set_robot_commands": 0.10013026158014932, "deviation-center-line": 1.3961355591934264, "driven_lanedir_consec": 2.117170658807209, "sim_compute_sim_state": 0.0396470061937968, "sim_compute_performance-ego": 0.07185616890589396, "sim_compute_robot_state-ego": 0.07639563004175821, "sim_compute_robot_state-npc0": 0.07083611249923706, "sim_compute_robot_state-npc1": 0.07057806730270386, "sim_compute_robot_state-npc2": 0.07024249712626139, "sim_compute_robot_state-npc3": 0.07073301633199056}, "udem1-1-0": {"driven_any": 0.3561556757625332, "sim_physics": 0.20569110384174424, "survival_time": 2.549999999999999, "driven_lanedir": 0.3070653384519195, "sim_render-ego": 0.06424566811206293, "in-drivable-lane": 0, "agent_compute-ego": 0.1095441088956945, "deviation-heading": 1.1291962175642734, "set_robot_commands": 0.093140069176169, "deviation-center-line": 0.14818647281819008, "driven_lanedir_consec": 0.3070653384519195, "sim_compute_sim_state": 0.04119076915815765, "sim_compute_performance-ego": 0.07306974074419807, "sim_compute_robot_state-ego": 0.07207661516526166, "sim_compute_robot_state-npc0": 0.06939508400711358, "sim_compute_robot_state-npc1": 0.0672619015562768, "sim_compute_robot_state-npc2": 0.0706943530662387, "sim_compute_robot_state-npc3": 0.07233620157428816}, "udem1-2-0": {"driven_any": 0.5570661499927073, "sim_physics": 0.22237405651494077, "survival_time": 3.7999999999999945, "driven_lanedir": 0.5046832902056324, "sim_render-ego": 0.06635918429023341, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09655623059523732, "deviation-heading": 0.7685941780761518, "set_robot_commands": 0.09282471631702624, "deviation-center-line": 0.3654622178006246, "driven_lanedir_consec": 0.5046832902056324, "sim_compute_sim_state": 0.04098630265185708, "sim_compute_performance-ego": 0.06948807365015934, "sim_compute_robot_state-ego": 0.07516021791257356, "sim_compute_robot_state-npc0": 0.06953161954879761, "sim_compute_robot_state-npc1": 0.06740229694466841, "sim_compute_robot_state-npc2": 0.07061236155660529, "sim_compute_robot_state-npc3": 0.0707114715325205}, "udem1-3-0": {"driven_any": 0.2115205325419034, "sim_physics": 0.23266187581149017, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1854689114276924, "sim_render-ego": 0.06424750703753847, "in-drivable-lane": 0, "agent_compute-ego": 0.10501834118005002, "deviation-heading": 0.5452695039032753, "set_robot_commands": 0.0988931366891572, "deviation-center-line": 0.14479594800188628, "driven_lanedir_consec": 0.1854689114276924, "sim_compute_sim_state": 0.03598101211316658, "sim_compute_performance-ego": 0.06951447689171994, "sim_compute_robot_state-ego": 0.08103264461864125, "sim_compute_robot_state-npc0": 0.06659771456862941, "sim_compute_robot_state-npc1": 0.07390482497937752, "sim_compute_robot_state-npc2": 0.06897756547638864, "sim_compute_robot_state-npc3": 0.07179172833760579}, "udem1-4-0": {"driven_any": 1.898913412757509, "sim_physics": 0.21263646196436, "survival_time": 12.150000000000038, "driven_lanedir": 1.3041629909584107, "sim_render-ego": 0.06391036461410209, "in-drivable-lane": 2.8000000000000336, "agent_compute-ego": 0.10660265600730362, "deviation-heading": 3.4477643358156884, "set_robot_commands": 0.10141327057355716, "deviation-center-line": 0.724021292703352, "driven_lanedir_consec": 1.3041629909584107, "sim_compute_sim_state": 0.04045388335553707, "sim_compute_performance-ego": 0.0724165626023532, "sim_compute_robot_state-ego": 0.07746405464140967, "sim_compute_robot_state-npc0": 0.07127452681584613, "sim_compute_robot_state-npc1": 0.0710725980531041, "sim_compute_robot_state-npc2": 0.07115230540679807, "sim_compute_robot_state-npc3": 0.07108499287577813}, "udem1-5-0": {"driven_any": 2.3487608095422123, "sim_physics": 0.203824569384257, "survival_time": 14.950000000000076, "driven_lanedir": 1.8408582553993644, "sim_render-ego": 0.06464611530303956, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.10288424491882324, "deviation-heading": 6.4057031026244555, "set_robot_commands": 0.1034600297609965, "deviation-center-line": 1.3585639702969143, "driven_lanedir_consec": 0.8524637150376144, "sim_compute_sim_state": 0.04061438798904419, "sim_compute_performance-ego": 0.07125288804372151, "sim_compute_robot_state-ego": 0.07684166510899862, "sim_compute_robot_state-npc0": 0.07185669183731079, "sim_compute_robot_state-npc1": 0.07147404034932454, "sim_compute_robot_state-npc2": 0.0725985582669576, "sim_compute_robot_state-npc3": 0.07242504437764485}, "udem1-6-0": {"driven_any": 0.7660210752634931, "sim_physics": 0.2522922450420903, "survival_time": 5.09999999999999, "driven_lanedir": 0.7553414455252458, "sim_render-ego": 0.0713722542220471, "in-drivable-lane": 0, "agent_compute-ego": 0.1096583698310104, "deviation-heading": 0.6922254654292563, "set_robot_commands": 0.1109470713372324, "deviation-center-line": 0.557426647013065, "driven_lanedir_consec": 0.7546677416314009, "sim_compute_sim_state": 0.04148624223821303, "sim_compute_performance-ego": 0.07633712946199904, "sim_compute_robot_state-ego": 0.08760741177727194, "sim_compute_robot_state-npc0": 0.07725764255897671, "sim_compute_robot_state-npc1": 0.07609234136693618, "sim_compute_robot_state-npc2": 0.07506303927477669, "sim_compute_robot_state-npc3": 0.07343703625248928}, "udem1-7-0": {"driven_any": 0.5168908432031573, "sim_physics": 0.2086571908332932, "survival_time": 3.5499999999999954, "driven_lanedir": 0.4861461122154971, "sim_render-ego": 0.062453988572241555, "in-drivable-lane": 0, "agent_compute-ego": 0.09806107131528184, "deviation-heading": 1.0877324599610454, "set_robot_commands": 0.09326049643503108, "deviation-center-line": 0.17363964912195726, "driven_lanedir_consec": 0.4861461122154971, "sim_compute_sim_state": 0.039077470000361055, "sim_compute_performance-ego": 0.07244846182809749, "sim_compute_robot_state-ego": 0.07545784829368055, "sim_compute_robot_state-npc0": 0.06791195063523843, "sim_compute_robot_state-npc1": 0.06954832479987345, "sim_compute_robot_state-npc2": 0.06663535010646766, "sim_compute_robot_state-npc3": 0.0710556104149617}, "udem1-8-0": {"driven_any": 2.3483963094398725, "sim_physics": 0.20710108041763303, "survival_time": 14.950000000000076, "driven_lanedir": 1.4040808575133044, "sim_render-ego": 0.06317493995030721, "in-drivable-lane": 2.750000000000015, "agent_compute-ego": 0.09912317355473836, "deviation-heading": 7.710127968597522, "set_robot_commands": 0.09799426952997844, "deviation-center-line": 1.17791273128002, "driven_lanedir_consec": 0.7241104352278693, "sim_compute_sim_state": 0.041020575364430746, "sim_compute_performance-ego": 0.07319972515106202, "sim_compute_robot_state-ego": 0.07671822468439737, "sim_compute_robot_state-npc0": 0.07090082009633382, "sim_compute_robot_state-npc1": 0.07064936558405559, "sim_compute_robot_state-npc2": 0.07235679149627686, "sim_compute_robot_state-npc3": 0.07161166588465373}, "udem1-9-0": {"driven_any": 0.4767202525280974, "sim_physics": 0.23511938254038492, "survival_time": 3.2999999999999963, "driven_lanedir": 0.4601997825063924, "sim_render-ego": 0.06315627965060147, "in-drivable-lane": 0, "agent_compute-ego": 0.0997123501517556, "deviation-heading": 0.8038978018698708, "set_robot_commands": 0.09940946824622876, "deviation-center-line": 0.21081252472111064, "driven_lanedir_consec": 0.4601997825063924, "sim_compute_sim_state": 0.03973821076479825, "sim_compute_performance-ego": 0.06970338387922807, "sim_compute_robot_state-ego": 0.07491254806518555, "sim_compute_robot_state-npc0": 0.07049263246131665, "sim_compute_robot_state-npc1": 0.06947853709712173, "sim_compute_robot_state-npc2": 0.06967436183582652, "sim_compute_robot_state-npc3": 0.0712031415014556}, "udem1-10-0": {"driven_any": 0.508863281369693, "sim_physics": 0.18604742118290493, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4561563585552963, "sim_render-ego": 0.06145693234034947, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09795709337506976, "deviation-heading": 0.97107490716412, "set_robot_commands": 0.09864423615591866, "deviation-center-line": 0.21651149088243615, "driven_lanedir_consec": 0.4561563585552963, "sim_compute_sim_state": 0.038571769850594656, "sim_compute_performance-ego": 0.0682642766407558, "sim_compute_robot_state-ego": 0.07389026028769356, "sim_compute_robot_state-npc0": 0.07165378161839077, "sim_compute_robot_state-npc1": 0.06952783039637975, "sim_compute_robot_state-npc2": 0.06923908165522984, "sim_compute_robot_state-npc3": 0.06892899785723006}, "udem1-11-0": {"driven_any": 0.4365420130779862, "sim_physics": 0.2162286922579906, "survival_time": 3.049999999999997, "driven_lanedir": 0.4259902722023541, "sim_render-ego": 0.0616077868664851, "in-drivable-lane": 0, "agent_compute-ego": 0.09883115330680473, "deviation-heading": 0.5432258830302972, "set_robot_commands": 0.09772330033974568, "deviation-center-line": 0.3338167565194672, "driven_lanedir_consec": 0.4259902722023541, "sim_compute_sim_state": 0.03897223316255163, "sim_compute_performance-ego": 0.06948006739381885, "sim_compute_robot_state-ego": 0.07365977959554704, "sim_compute_robot_state-npc0": 0.06782618507010038, "sim_compute_robot_state-npc1": 0.07134526674864722, "sim_compute_robot_state-npc2": 0.06975663685407794, "sim_compute_robot_state-npc3": 0.06970905085079006}, "udem1-12-0": {"driven_any": 0.5730502586387246, "sim_physics": 0.19207583940946135, "survival_time": 3.899999999999994, "driven_lanedir": 0.40594850510344593, "sim_render-ego": 0.056441028912862144, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09138828363174048, "deviation-heading": 1.0613091398983183, "set_robot_commands": 0.08858917309687687, "deviation-center-line": 0.2396508659293193, "driven_lanedir_consec": 0.40594850510344593, "sim_compute_sim_state": 0.0339888089742416, "sim_compute_performance-ego": 0.06175266473721235, "sim_compute_robot_state-ego": 0.06680134015205579, "sim_compute_robot_state-npc0": 0.061747926932114824, "sim_compute_robot_state-npc1": 0.06132485622014755, "sim_compute_robot_state-npc2": 0.06021595918215238, "sim_compute_robot_state-npc3": 0.05998973357371795}, "udem1-13-0": {"driven_any": 1.9952265912330192, "sim_physics": 0.1956810614641975, "survival_time": 12.750000000000046, "driven_lanedir": 1.2490872339163943, "sim_render-ego": 0.06278929803885666, "in-drivable-lane": 2.75, "agent_compute-ego": 0.09757892664741068, "deviation-heading": 5.0483062056248045, "set_robot_commands": 0.09598280495288324, "deviation-center-line": 0.9184086137421128, "driven_lanedir_consec": 0.9002016946193916, "sim_compute_sim_state": 0.0375892022076775, "sim_compute_performance-ego": 0.06951493842929017, "sim_compute_robot_state-ego": 0.07324926151948817, "sim_compute_robot_state-npc0": 0.06939990006241144, "sim_compute_robot_state-npc1": 0.068907662933948, "sim_compute_robot_state-npc2": 0.07025883057538201, "sim_compute_robot_state-npc3": 0.06974825391582415}, "udem1-14-0": {"driven_any": 0.17134950861771794, "sim_physics": 0.20382252761295863, "survival_time": 1.4000000000000006, "driven_lanedir": 0.13711492274865522, "sim_render-ego": 0.060487406594412665, "in-drivable-lane": 0, "agent_compute-ego": 0.08973806244986397, "deviation-heading": 0.7103472902647608, "set_robot_commands": 0.09041105849402292, "deviation-center-line": 0.10868944755534243, "driven_lanedir_consec": 0.13711492274865522, "sim_compute_sim_state": 0.03591221570968628, "sim_compute_performance-ego": 0.06379742281777519, "sim_compute_robot_state-ego": 0.07364122356687273, "sim_compute_robot_state-npc0": 0.06664934328624181, "sim_compute_robot_state-npc1": 0.06580563953944615, "sim_compute_robot_state-npc2": 0.06639659404754639, "sim_compute_robot_state-npc3": 0.06636091641017369}}
set_robot_commands_max	0.1109470713372324
set_robot_commands_mean	0.09752155751233156
set_robot_commands_median	0.09799426952997844
set_robot_commands_min	0.08858917309687687
sim_compute_performance-ego_max	0.07633712946199904
sim_compute_performance-ego_mean	0.07013973207848564
sim_compute_performance-ego_median	0.06970338387922807
sim_compute_performance-ego_min	0.06175266473721235
sim_compute_robot_state-ego_max	0.08760741177727194
sim_compute_robot_state-ego_mean	0.07566058169538903
sim_compute_robot_state-ego_median	0.07516021791257356
sim_compute_robot_state-ego_min	0.06680134015205579
sim_compute_robot_state-npc0_max	0.07725764255897671
sim_compute_robot_state-npc0_mean	0.06955546213320396
sim_compute_robot_state-npc0_median	0.06953161954879761
sim_compute_robot_state-npc0_min	0.061747926932114824
sim_compute_robot_state-npc1_max	0.07609234136693618
sim_compute_robot_state-npc1_mean	0.06962490359146739
sim_compute_robot_state-npc1_median	0.06954832479987345
sim_compute_robot_state-npc1_min	0.06132485622014755
sim_compute_robot_state-npc2_max	0.07506303927477669
sim_compute_robot_state-npc2_mean	0.06959161906179907
sim_compute_robot_state-npc2_median	0.07024249712626139
sim_compute_robot_state-npc2_min	0.06021595918215238
sim_compute_robot_state-npc3_max	0.07343703625248928
sim_compute_robot_state-npc3_mean	0.07007512411274161
sim_compute_robot_state-npc3_median	0.0710556104149617
sim_compute_robot_state-npc3_min	0.05998973357371795
sim_compute_sim_state_max	0.04148624223821303
sim_compute_sim_state_mean	0.039015339315607606
sim_compute_sim_state_median	0.0396470061937968
sim_compute_sim_state_min	0.0339888089742416
sim_physics_max	0.2522922450420903
sim_physics_mean	0.21205770833688128
sim_physics_median	0.20710108041763303
sim_physics_min	0.18604742118290493
sim_render-ego_max	0.0713722542220471
sim_render-ego_mean	0.06336587460437232
sim_render-ego_median	0.06317493995030721
sim_render-ego_min	0.056441028912862144
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.770000000000019
survival_time_min	1.4000000000000006

No reset possible

21278

2429

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-27 22:00:39+00:00

2019-04-27 22:01:39+00:00

0:01:00

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21268

3112

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

host-error

2019-04-27 21:46:58+00:00

2019-04-27 22:00:09+00:00

0:13:11

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3112/step1-simulation-ip-172-31-40-253-31940-job21268/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21252

2471

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 21:23:46+00:00

2019-04-27 21:46:43+00:00

0:22:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.16652061501327825
agent_compute-ego_mean	0.1591349757067052
agent_compute-ego_median	0.1608879518508911
agent_compute-ego_min	0.13582218544823782
deviation-center-line_max	0.1743913456502906
deviation-center-line_mean	0.11122054568266285
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.371509805944231
deviation-heading_median	0.3477435217829391
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589035
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708377
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708377
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17625702752007377, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06573141504217077, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15685827202267116, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10178978354842574, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04061427381303576, "sim_compute_performance-ego": 0.07193340637065747, "sim_compute_robot_state-ego": 0.09028752203340884, "sim_compute_robot_state-npc0": 0.0689635850765087, "sim_compute_robot_state-npc1": 0.07216614264029043, "sim_compute_robot_state-npc2": 0.07295191287994385, "sim_compute_robot_state-npc3": 0.073745745199698}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.22254567146301268, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06704947471618652, "in-drivable-lane": 0, "agent_compute-ego": 0.16516663551330563, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10924653053283692, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03953330993652344, "sim_compute_performance-ego": 0.07368463516235352, "sim_compute_robot_state-ego": 0.08015395164489746, "sim_compute_robot_state-npc0": 0.07623950004577637, "sim_compute_robot_state-npc1": 0.07360225677490234, "sim_compute_robot_state-npc2": 0.07112601280212402, "sim_compute_robot_state-npc3": 0.06902026176452637}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.20688588054556595, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06409817306618941, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1632731180442007, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10225474520733482, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04107806870811864, "sim_compute_performance-ego": 0.07215779392342818, "sim_compute_robot_state-ego": 0.07966157323435734, "sim_compute_robot_state-npc0": 0.07248176712738841, "sim_compute_robot_state-npc1": 0.07418475025578548, "sim_compute_robot_state-npc2": 0.07175907649491962, "sim_compute_robot_state-npc3": 0.07345656031056454}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.19821205018441887, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.0598097722741622, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15088544918012017, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09340159198905848, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.036560927765278875, "sim_compute_performance-ego": 0.06979400598550145, "sim_compute_robot_state-ego": 0.07378039782560325, "sim_compute_robot_state-npc0": 0.06590049478072155, "sim_compute_robot_state-npc1": 0.06926683232754091, "sim_compute_robot_state-npc2": 0.06626861608481105, "sim_compute_robot_state-npc3": 0.06870382043379772}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.17101873670305526, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06272144828523908, "in-drivable-lane": 0, "agent_compute-ego": 0.13582218544823782, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08759146077292305, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03516824756349836, "sim_compute_performance-ego": 0.06589933804103307, "sim_compute_robot_state-ego": 0.07672727108001709, "sim_compute_robot_state-npc0": 0.06158873013087681, "sim_compute_robot_state-npc1": 0.06635774884905134, "sim_compute_robot_state-npc2": 0.06174802780151367, "sim_compute_robot_state-npc3": 0.0652752433504377}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.18648737448233144, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06202786498599582, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.16017422411176893, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09663322236802845, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.04182287498756691, "sim_compute_performance-ego": 0.06936201784345838, "sim_compute_robot_state-ego": 0.07731257986139368, "sim_compute_robot_state-npc0": 0.06903167565663655, "sim_compute_robot_state-npc1": 0.07108385033077663, "sim_compute_robot_state-npc2": 0.069752538645709, "sim_compute_robot_state-npc3": 0.07354341171405933}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.17980997650711625, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06415097360257749, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.1602029182292797, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09724146789974636, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.041351362510963725, "sim_compute_performance-ego": 0.07328631259776928, "sim_compute_robot_state-ego": 0.07544036706288655, "sim_compute_robot_state-npc0": 0.07114464706844753, "sim_compute_robot_state-npc1": 0.06927793555789524, "sim_compute_robot_state-npc2": 0.0700977952392013, "sim_compute_robot_state-npc3": 0.07313883746111835}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.24908847808837892, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.0667884455786811, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16451171239217122, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10205716027153865, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04355357487996419, "sim_compute_performance-ego": 0.07570586204528809, "sim_compute_robot_state-ego": 0.09035802417331272, "sim_compute_robot_state-npc0": 0.07366817262437608, "sim_compute_robot_state-npc1": 0.07352447509765625, "sim_compute_robot_state-npc2": 0.0740706443786621, "sim_compute_robot_state-npc3": 0.07431139416164823}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18097906009010647, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06176622017570164, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.15188285578852115, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.09343791526296864, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.040812445723492165, "sim_compute_performance-ego": 0.06925380229949951, "sim_compute_robot_state-ego": 0.07120298302691916, "sim_compute_robot_state-npc0": 0.0712234403776086, "sim_compute_robot_state-npc1": 0.07137792006782863, "sim_compute_robot_state-npc2": 0.07193394329236902, "sim_compute_robot_state-npc3": 0.07254752905472465}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.19997135639190677, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06298059940338135, "in-drivable-lane": 0, "agent_compute-ego": 0.15900203704833984, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10100796222686768, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04172706604003906, "sim_compute_performance-ego": 0.07221936225891114, "sim_compute_robot_state-ego": 0.07870483875274659, "sim_compute_robot_state-npc0": 0.07339227199554443, "sim_compute_robot_state-npc1": 0.07418944835662841, "sim_compute_robot_state-npc2": 0.07431709289550781, "sim_compute_robot_state-npc3": 0.07298644542694092}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22792582511901857, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06477869749069214, "in-drivable-lane": 0, "agent_compute-ego": 0.16193290948867797, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.0988906979560852, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.044474029541015626, "sim_compute_performance-ego": 0.07403674125671386, "sim_compute_robot_state-ego": 0.08259660005569458, "sim_compute_robot_state-npc0": 0.0751274824142456, "sim_compute_robot_state-npc1": 0.07485344409942626, "sim_compute_robot_state-npc2": 0.0717970848083496, "sim_compute_robot_state-npc3": 0.07725447416305542}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.17520034940619217, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.06918437857376902, "in-drivable-lane": 0, "agent_compute-ego": 0.16403259729084216, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.1011907552417956, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04046509140416195, "sim_compute_performance-ego": 0.07714583999232243, "sim_compute_robot_state-ego": 0.08148998963205438, "sim_compute_robot_state-npc0": 0.07138877165944953, "sim_compute_robot_state-npc1": 0.0707217768618935, "sim_compute_robot_state-npc2": 0.07251562570270739, "sim_compute_robot_state-npc3": 0.06609481259396202}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1773664951324463, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06542104244232178, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.1608879518508911, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.09892844200134278, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04483457088470459, "sim_compute_performance-ego": 0.07163027286529541, "sim_compute_robot_state-ego": 0.07397538185119629, "sim_compute_robot_state-npc0": 0.07588183403015136, "sim_compute_robot_state-npc1": 0.07420166015625, "sim_compute_robot_state-npc2": 0.07047809600830078, "sim_compute_robot_state-npc3": 0.0727470302581787}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2477187568491155, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.09082412719726562, "in-drivable-lane": 0, "agent_compute-ego": 0.16587115417827258, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.10026575218547476, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04122838107022373, "sim_compute_performance-ego": 0.0757708116011186, "sim_compute_robot_state-ego": 0.0928348411213268, "sim_compute_robot_state-npc0": 0.07237332517450507, "sim_compute_robot_state-npc1": 0.0719564828005704, "sim_compute_robot_state-npc2": 0.07439073649319736, "sim_compute_robot_state-npc3": 0.0716596625067971}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.20905361856733048, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06640920833665498, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.16652061501327825, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10093476334396674, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04524763263001734, "sim_compute_performance-ego": 0.07171103419089804, "sim_compute_robot_state-ego": 0.0778601802125269, "sim_compute_robot_state-npc0": 0.07384502644441565, "sim_compute_robot_state-npc1": 0.07458410944257464, "sim_compute_robot_state-npc2": 0.07320652202684053, "sim_compute_robot_state-npc3": 0.0743932480714759}}
set_robot_commands_max	0.10924653053283692
set_robot_commands_mean	0.09899148338722628
set_robot_commands_median	0.10026575218547476
set_robot_commands_min	0.08759146077292305
sim_compute_performance-ego_max	0.07714583999232243
sim_compute_performance-ego_mean	0.07223941576228322
sim_compute_performance-ego_median	0.07215779392342818
sim_compute_performance-ego_min	0.06589933804103307
sim_compute_robot_state-ego_max	0.0928348411213268
sim_compute_robot_state-ego_mean	0.08015910010455611
sim_compute_robot_state-ego_median	0.07870483875274659
sim_compute_robot_state-ego_min	0.07120298302691916
sim_compute_robot_state-npc0_max	0.07623950004577637
sim_compute_robot_state-npc0_mean	0.07148338164044349
sim_compute_robot_state-npc0_median	0.07237332517450507
sim_compute_robot_state-npc0_min	0.06158873013087681
sim_compute_robot_state-npc1_max	0.07485344409942626
sim_compute_robot_state-npc1_mean	0.07208992224127136
sim_compute_robot_state-npc1_median	0.07216614264029043
sim_compute_robot_state-npc1_min	0.06635774884905134
sim_compute_robot_state-npc2_max	0.07439073649319736
sim_compute_robot_state-npc2_mean	0.07109424837027714
sim_compute_robot_state-npc2_median	0.0717970848083496
sim_compute_robot_state-npc2_min	0.06174802780151367
sim_compute_robot_state-npc3_max	0.07725447416305542
sim_compute_robot_state-npc3_mean	0.07192523176473233
sim_compute_robot_state-npc3_median	0.07298644542694092
sim_compute_robot_state-npc3_min	0.0652752433504377
sim_compute_sim_state_max	0.04524763263001734
sim_compute_sim_state_mean	0.04123145716390696
sim_compute_sim_state_median	0.04122838107022373
sim_compute_sim_state_min	0.03516824756349836
sim_physics_max	0.24908847808837892
sim_physics_mean	0.200568043803338
sim_physics_median	0.19821205018441887
sim_physics_min	0.17101873670305526
sim_render-ego_max	0.09082412719726562
sim_render-ego_mean	0.06624945607806593
sim_render-ego_median	0.06477869749069214
sim_render-ego_min	0.0598097722741622
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

21245

2483

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-04-27 21:20:21+00:00

2019-04-27 21:22:53+00:00

0:02:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21212

2547

Andrea Censi 🇨🇭

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 21:02:56+00:00

2019-04-27 21:20:14+00:00

0:17:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11871775985231396
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.07834709644317626
agent_compute-ego_mean	0.07417977162429776
agent_compute-ego_median	0.07456143697102864
agent_compute-ego_min	0.07000352035869252
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054905994
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829774
driven_any_max	1.6839250134630197
driven_any_mean	0.7327294413370017
driven_any_median	0.7309130538792373
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1264553103648441, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06810812211372483, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07460496459208743, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10681873308101172, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04135608001494072, "sim_compute_performance-ego": 0.0746967355969926, "sim_compute_robot_state-ego": 0.08248017875241562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11757393678029378, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06443040370941162, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07411878108978272, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.10501302480697632, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.04362597862879435, "sim_compute_performance-ego": 0.07457729975382486, "sim_compute_robot_state-ego": 0.08424714008967081}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11489146406000313, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06197464466094971, "in-drivable-lane": 0, "agent_compute-ego": 0.07000352035869252, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.08814106204292992, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03957670385187322, "sim_compute_performance-ego": 0.06906288320367987, "sim_compute_robot_state-ego": 0.07470425692471591}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12056249876817068, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06753355761369069, "in-drivable-lane": 0, "agent_compute-ego": 0.07318195203940074, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.10087206959724426, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04187098145484924, "sim_compute_performance-ego": 0.06931948661804199, "sim_compute_robot_state-ego": 0.07966789603233337}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12308940680130669, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06693789751633354, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07477582537609598, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.10053247472514278, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03996046211408532, "sim_compute_performance-ego": 0.07182276248931885, "sim_compute_robot_state-ego": 0.07937847531360129}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.132071852684021, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.06465499599774678, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07385854919751485, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.09783671299616496, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.04023496309916178, "sim_compute_performance-ego": 0.07040960590044658, "sim_compute_robot_state-ego": 0.07317509253819783}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.13102992987021422, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.06419000870142227, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.07503703007331261, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.10479751917032096, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.04151213780427591, "sim_compute_performance-ego": 0.07546013746506129, "sim_compute_robot_state-ego": 0.08502859947008964}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.13926325099808828, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.06540973271642413, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.07558920979499817, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.0980134393487658, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.04133197239467075, "sim_compute_performance-ego": 0.07519539764949254, "sim_compute_robot_state-ego": 0.08149923597063337}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.12607942504444342, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.06468016251750376, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.0710389066016537, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.10152389263284615, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.04035567415171656, "sim_compute_performance-ego": 0.07314679540436843, "sim_compute_robot_state-ego": 0.08016625766096444}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.12946289886127818, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06648290807550604, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07256327759135853, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.1018268801949241, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.04017798900604248, "sim_compute_performance-ego": 0.0740957195108587, "sim_compute_robot_state-ego": 0.0816610032861883}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.12060000499089558, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.0648586352666219, "in-drivable-lane": 0, "agent_compute-ego": 0.07331982254981995, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.10346006353696188, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.0389819343884786, "sim_compute_performance-ego": 0.07165276010831197, "sim_compute_robot_state-ego": 0.06864381829897563}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.12432052872397682, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06403274040717583, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0757801223110843, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.10629276486186238, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.04192379233124968, "sim_compute_performance-ego": 0.0725152740230808, "sim_compute_robot_state-ego": 0.07925085278300496}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.12473704814910888, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06628117084503174, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07834709644317626, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.10610423564910888, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.04147315502166748, "sim_compute_performance-ego": 0.07677356719970703, "sim_compute_robot_state-ego": 0.08330990314483643}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.15421410707327035, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06851189870100755, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07591607937446007, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.10332268017988938, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.042404550772446856, "sim_compute_performance-ego": 0.0774234991807204, "sim_compute_robot_state-ego": 0.09033457132486196}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.12366493542989096, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.06728654437594944, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07456143697102864, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.09480644596947564, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.03923174628505, "sim_compute_performance-ego": 0.07298165339010733, "sim_compute_robot_state-ego": 0.07591396790963632}}
set_robot_commands_max	0.10681873308101172
set_robot_commands_mean	0.101290799919575
set_robot_commands_median	0.1018268801949241
set_robot_commands_min	0.08814106204292992
sim_compute_performance-ego_max	0.0774234991807204
sim_compute_performance-ego_mean	0.07327557183293422
sim_compute_performance-ego_median	0.07314679540436843
sim_compute_performance-ego_min	0.06906288320367987
sim_compute_robot_state-ego_max	0.09033457132486196
sim_compute_robot_state-ego_mean	0.07996408330000838
sim_compute_robot_state-ego_median	0.08016625766096444
sim_compute_robot_state-ego_min	0.06864381829897563
sim_compute_sim_state_max	0.04362597862879435
sim_compute_sim_state_mean	0.04093454142128686
sim_compute_sim_state_median	0.04133197239467075
sim_compute_sim_state_min	0.0389819343884786
sim_physics_max	0.15421410707327035
sim_physics_mean	0.1272011065733204
sim_physics_median	0.12473704814910888
sim_physics_min	0.11489146406000313
sim_render-ego_max	0.06851189870100755
sim_render-ego_mean	0.06569156154789998
sim_render-ego_median	0.06540973271642413
sim_render-ego_min	0.06197464466094971
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

21199

2532

Liam Paull 🇨🇦

baseline-IL-sim-tensorflow

step1-simulation

error

2019-04-27 21:00:18+00:00

2019-04-27 21:02:41+00:00

0:02:23

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21196

2543

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

host-error

2019-04-27 20:57:50+00:00

2019-04-27 21:00:10+00:00

0:02:20

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2543/step1-simulation-ip-172-31-40-253-31940-job21196/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21186

2560

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

aido2-LFV-sim-validation

2019-04-27 20:42:10+00:00

2019-04-27 20:57:43+00:00

0:15:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4126113388371666
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11871775985231396
in-drivable-lane_median	0.9499999999999976

other stats

agent_compute-ego_max	0.07510862143143364
agent_compute-ego_mean	0.06843147589733287
agent_compute-ego_median	0.07071606929485615
agent_compute-ego_min	0.053858102896274664
deviation-center-line_max	0.2616199012603187
deviation-center-line_mean	0.12663752615997417
deviation-center-line_min	0.07143676193760398
deviation-heading_max	1.4563581054905994
deviation-heading_mean	0.5551840294909584
deviation-heading_median	0.55940705176748
deviation-heading_min	0.2596285487829774
driven_any_max	1.6839250134630197
driven_any_mean	0.7327294413370017
driven_any_median	0.7309130538792373
driven_any_min	0.2364518949491652
driven_lanedir_consec_max	0.9416535020294268
driven_lanedir_consec_mean	0.4469104002974222
driven_lanedir_consec_min	0.2221238695940002
driven_lanedir_max	0.9416535020294268
driven_lanedir_mean	0.4469104002974222
driven_lanedir_median	0.4126113388371666
driven_lanedir_min	0.2221238695940002
in-drivable-lane_max	2.1499999999999924
in-drivable-lane_mean	0.8233333333333307
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11188801913194252, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.059242678360200265, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06556645581420038, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.08686624110584527, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03711433142003879, "sim_compute_performance-ego": 0.06653013363690444, "sim_compute_robot_state-ego": 0.0696338028974936}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.1215404470761617, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06406495968500774, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07262047131856282, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09814974466959636, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.04074689944585164, "sim_compute_performance-ego": 0.07386855284372966, "sim_compute_robot_state-ego": 0.08135310808817546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.10771518403833565, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05798417871648615, "in-drivable-lane": 0, "agent_compute-ego": 0.06087713891809637, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.08196381005373868, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03563181920485063, "sim_compute_performance-ego": 0.06630926782434637, "sim_compute_robot_state-ego": 0.06886874545704234}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12286843359470367, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.0626608282327652, "in-drivable-lane": 0, "agent_compute-ego": 0.07160212099552155, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.10097054143746692, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03925514221191406, "sim_compute_performance-ego": 0.06984960039456685, "sim_compute_robot_state-ego": 0.0787565807501475}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.1167323692985203, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06080900586169699, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07510862143143364, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09728473165760868, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.039265528969142746, "sim_compute_performance-ego": 0.06667446571847667, "sim_compute_robot_state-ego": 0.0743803822475931}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.11149049798647565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.06059875090916952, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0658169686794281, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.09113916754722597, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.03685713807741801, "sim_compute_performance-ego": 0.06573058168093364, "sim_compute_robot_state-ego": 0.06991710265477498}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.08282397954891889, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.047579050064086914, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.053858102896274664, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.07379274490552071, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.030452413436694022, "sim_compute_performance-ego": 0.054221177712464944, "sim_compute_robot_state-ego": 0.05608132252326378}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.12073060444423132, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.0583536582333701, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.06755832263401576, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.09164763348443168, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.036825516394206455, "sim_compute_performance-ego": 0.06377546276365008, "sim_compute_robot_state-ego": 0.07047149538993835}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.12340573606819942, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.06073048745078602, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.06875121730497513, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.09095069183700386, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.03813307312713272, "sim_compute_performance-ego": 0.06577168387928228, "sim_compute_robot_state-ego": 0.07208130277436355}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.11590294187719172, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06165597222068093, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.0711041515523737, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.096093825860457, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03874287605285645, "sim_compute_performance-ego": 0.06968088366768577, "sim_compute_robot_state-ego": 0.07698917388916016}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.1198990245660146, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.05938476324081421, "in-drivable-lane": 0, "agent_compute-ego": 0.07096701860427856, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.09502326448758444, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.03683169682820638, "sim_compute_performance-ego": 0.06926321983337402, "sim_compute_robot_state-ego": 0.07300414641698201}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.12217513307348474, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.0638109337199818, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07172015735081264, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.09611369417859364, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03947325186295943, "sim_compute_performance-ego": 0.06894038869188977, "sim_compute_robot_state-ego": 0.07810512146392426}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11303147315979004, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06137995719909668, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06865376472473145, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.09721998691558838, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03760082244873047, "sim_compute_performance-ego": 0.0707335615158081, "sim_compute_robot_state-ego": 0.07223004817962647}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.11579530972700852, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06132848446185772, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07071606929485615, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09747164983015794, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.03893594558422382, "sim_compute_performance-ego": 0.07095231459690975, "sim_compute_robot_state-ego": 0.0789725321989793}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1165492887850161, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.061012722827770094, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07155155694043194, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.0978734051739728, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.03733720161296703, "sim_compute_performance-ego": 0.07253688353079336, "sim_compute_robot_state-ego": 0.08146769470638698}}
set_robot_commands_max	0.10097054143746692
set_robot_commands_mean	0.09283740887631949
set_robot_commands_median	0.096093825860457
set_robot_commands_min	0.07379274490552071
sim_compute_performance-ego_max	0.07386855284372966
sim_compute_performance-ego_mean	0.06765587855272105
sim_compute_performance-ego_median	0.06894038869188977
sim_compute_performance-ego_min	0.054221177712464944
sim_compute_robot_state-ego_max	0.08146769470638698
sim_compute_robot_state-ego_mean	0.07348750397585681
sim_compute_robot_state-ego_median	0.07300414641698201
sim_compute_robot_state-ego_min	0.05608132252326378
sim_compute_sim_state_max	0.04074689944585164
sim_compute_sim_state_mean	0.03754691044514617
sim_compute_sim_state_median	0.03760082244873047
sim_compute_sim_state_min	0.030452413436694022
sim_physics_max	0.12340573606819942
sim_physics_mean	0.11483656282506634
sim_physics_median	0.1165492887850161
sim_physics_min	0.08282397954891889
sim_render-ego_max	0.06406495968500774
sim_render-ego_mean	0.06003976207891803
sim_render-ego_median	0.06080900586169699
sim_render-ego_min	0.047579050064086914
simulation-passed	1
survival_time_max	5.4999999999999885
survival_time_mean	2.7766666666666637
survival_time_min	1.1000000000000003

No reset possible

21183

2565

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 20:33:04+00:00

2019-04-27 20:41:31+00:00

0:08:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.5999999999999988
deviation-center-line_median	0.16987818035809085
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.07620084853399367
agent_compute-ego_mean	0.07298092291674697
agent_compute-ego_median	0.07274624327538719
agent_compute-ego_min	0.07049926122029622
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.14972083567701736
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.4280304166285303
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.2972979671834337
driven_any_mean	0.7173901327940211
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	0.97716132702229
driven_lanedir_consec_mean	0.5227475277218055
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	0.97716132702229
driven_lanedir_mean	0.5227475277218055
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.5799999999999983
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.16639042908037213, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06436482281752036, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07274624327538719, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10101632668938436, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0391572999282622, "sim_compute_performance-ego": 0.06826783569765763, "sim_compute_robot_state-ego": 0.07789909000128088, "sim_compute_robot_state-npc0": 0.07114795899726975, "sim_compute_robot_state-npc1": 0.06891487685727402, "sim_compute_robot_state-npc2": 0.07070200544008066, "sim_compute_robot_state-npc3": 0.06885119894860496}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.18565991520881653, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.055385805666446686, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.072207972407341, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09675440937280656, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.03907784819602966, "sim_compute_performance-ego": 0.06328938156366348, "sim_compute_robot_state-ego": 0.06801903247833252, "sim_compute_robot_state-npc0": 0.07027655094861984, "sim_compute_robot_state-npc1": 0.06658852845430374, "sim_compute_robot_state-npc2": 0.06607279926538467, "sim_compute_robot_state-npc3": 0.0684671700000763}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1940957124416645, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06473869543809158, "in-drivable-lane": 0, "agent_compute-ego": 0.07325028914671677, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09981202162229098, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.0384327402481666, "sim_compute_performance-ego": 0.06961855063071617, "sim_compute_robot_state-ego": 0.078768422970405, "sim_compute_robot_state-npc0": 0.07363784313201904, "sim_compute_robot_state-npc1": 0.07278610192812406, "sim_compute_robot_state-npc2": 0.0712387332549462, "sim_compute_robot_state-npc3": 0.07028696628717276}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.1866429595537083, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.05990343709145823, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07049926122029622, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09605264920060352, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03784481940730926, "sim_compute_performance-ego": 0.0674073644863662, "sim_compute_robot_state-ego": 0.07513485159925236, "sim_compute_robot_state-npc0": 0.06941772532719438, "sim_compute_robot_state-npc1": 0.06719538216949791, "sim_compute_robot_state-npc2": 0.06785921896657636, "sim_compute_robot_state-npc3": 0.06565256528956916}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.2063227721623012, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06729454085940406, "in-drivable-lane": 0, "agent_compute-ego": 0.07620084853399367, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.10825149218241374, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04120162555149624, "sim_compute_performance-ego": 0.07653152374994188, "sim_compute_robot_state-ego": 0.09154572941008068, "sim_compute_robot_state-npc0": 0.07531619071960449, "sim_compute_robot_state-npc1": 0.074567749386742, "sim_compute_robot_state-npc2": 0.07443425768897646, "sim_compute_robot_state-npc3": 0.073934725352696}}
set_robot_commands_max	0.10825149218241374
set_robot_commands_mean	0.10037737981349984
set_robot_commands_median	0.09981202162229098
set_robot_commands_min	0.09605264920060352
sim_compute_performance-ego_max	0.07653152374994188
sim_compute_performance-ego_mean	0.06902293122566908
sim_compute_performance-ego_median	0.06826783569765763
sim_compute_performance-ego_min	0.06328938156366348
sim_compute_robot_state-ego_max	0.09154572941008068
sim_compute_robot_state-ego_mean	0.07827342529187029
sim_compute_robot_state-ego_median	0.07789909000128088
sim_compute_robot_state-ego_min	0.06801903247833252
sim_compute_robot_state-npc0_max	0.07531619071960449
sim_compute_robot_state-npc0_mean	0.0719592538249415
sim_compute_robot_state-npc0_median	0.07114795899726975
sim_compute_robot_state-npc0_min	0.06941772532719438
sim_compute_robot_state-npc1_max	0.074567749386742
sim_compute_robot_state-npc1_mean	0.07001052775918834
sim_compute_robot_state-npc1_median	0.06891487685727402
sim_compute_robot_state-npc1_min	0.06658852845430374
sim_compute_robot_state-npc2_max	0.07443425768897646
sim_compute_robot_state-npc2_mean	0.07006140292319288
sim_compute_robot_state-npc2_median	0.07070200544008066
sim_compute_robot_state-npc2_min	0.06607279926538467
sim_compute_robot_state-npc3_max	0.073934725352696
sim_compute_robot_state-npc3_mean	0.06943852517562385
sim_compute_robot_state-npc3_median	0.06885119894860496
sim_compute_robot_state-npc3_min	0.06565256528956916
sim_compute_sim_state_max	0.04120162555149624
sim_compute_sim_state_mean	0.03914286666625279
sim_compute_sim_state_median	0.03907784819602966
sim_compute_sim_state_min	0.03784481940730926
sim_physics_max	0.2063227721623012
sim_physics_mean	0.18782235768937253
sim_physics_median	0.1866429595537083
sim_physics_min	0.16639042908037213
sim_render-ego_max	0.06729454085940406
sim_render-ego_mean	0.06233746037458419
sim_render-ego_median	0.06436482281752036
sim_render-ego_min	0.055385805666446686
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	2.6899999999999973
survival_time_min	1.0500000000000005

No reset possible

21161

2586

baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 20:00:28+00:00

2019-04-27 20:32:48+00:00

0:32:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24114147177694667
survival_time_median	5.299999999999989
deviation-center-line_median	0.33335853391563286
in-drivable-lane_median	0.04999999999999982

other stats

agent_compute-ego_max	0.24802171284297728
agent_compute-ego_mean	0.2323908263007484
agent_compute-ego_median	0.23528076807657877
agent_compute-ego_min	0.21702888456441588
deviation-center-line_max	0.47574190700742264
deviation-center-line_mean	0.3479274081079726
deviation-center-line_min	0.26525691624972525
deviation-heading_max	2.9076654668058755
deviation-heading_mean	2.057158942240314
deviation-heading_median	2.1078610086576557
deviation-heading_min	1.1604108767814585
driven_any_max	0.504196964717085
driven_any_mean	0.2905924170824204
driven_any_median	0.2842163199303993
driven_any_min	0.16119892473949063
driven_lanedir_consec_max	0.45812760373127626
driven_lanedir_consec_mean	0.25068269257535175
driven_lanedir_consec_min	0.1304450289584227
driven_lanedir_max	0.45812760373127626
driven_lanedir_mean	0.25068269257535175
driven_lanedir_median	0.24114147177694667
driven_lanedir_min	0.1304450289584227
in-drivable-lane_max	0.350000000000005
in-drivable-lane_mean	0.08000000000000013
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3311801059145351, "sim_physics": 0.10722969424340031, "survival_time": 6.199999999999986, "driven_lanedir": 0.2761000092392294, "sim_render-ego": 0.05893915314828196, "in-drivable-lane": 0, "agent_compute-ego": 0.2201569003443564, "deviation-heading": 2.9076654668058755, "set_robot_commands": 0.09142565727233888, "deviation-center-line": 0.3717712910850991, "driven_lanedir_consec": 0.2761000092392294, "sim_compute_sim_state": 0.03698199410592356, "sim_compute_performance-ego": 0.0668378722283148, "sim_compute_robot_state-ego": 0.07071403534181657}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.428396192010745, "sim_physics": 0.109903722027548, "survival_time": 7.649999999999981, "driven_lanedir": 0.3867122534896983, "sim_render-ego": 0.06000119720409119, "in-drivable-lane": 0, "agent_compute-ego": 0.2371895344428767, "deviation-heading": 2.4542845445495876, "set_robot_commands": 0.09630585651771696, "deviation-center-line": 0.33800337145119347, "driven_lanedir_consec": 0.3867122534896983, "sim_compute_sim_state": 0.03891805885663999, "sim_compute_performance-ego": 0.06869239900626388, "sim_compute_robot_state-ego": 0.07492858132505728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.16521021547609546, "sim_physics": 0.10146974363634664, "survival_time": 3.099999999999997, "driven_lanedir": 0.13368686424849097, "sim_render-ego": 0.06149090874579645, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2336521110227031, "deviation-heading": 1.4477261235040717, "set_robot_commands": 0.09945107659985944, "deviation-center-line": 0.3173016112980837, "driven_lanedir_consec": 0.13368686424849097, "sim_compute_sim_state": 0.04122938648346932, "sim_compute_performance-ego": 0.07074737548828125, "sim_compute_robot_state-ego": 0.07909747092954574}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2545966211670788, "sim_physics": 0.1126756803555922, "survival_time": 4.399999999999992, "driven_lanedir": 0.19988488189684395, "sim_render-ego": 0.06137683174826882, "in-drivable-lane": 0, "agent_compute-ego": 0.2305780134417794, "deviation-heading": 2.633240866476926, "set_robot_commands": 0.09396859190680763, "deviation-center-line": 0.28210400053737, "driven_lanedir_consec": 0.19988488189684395, "sim_compute_sim_state": 0.03923683003945784, "sim_compute_performance-ego": 0.06796809218146584, "sim_compute_robot_state-ego": 0.07202410697937012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3537124318825668, "sim_physics": 0.1194960590480834, "survival_time": 6.449999999999985, "driven_lanedir": 0.3103305034023145, "sim_render-ego": 0.061397842658582585, "in-drivable-lane": 0, "agent_compute-ego": 0.23576760846515035, "deviation-heading": 2.3948628700288084, "set_robot_commands": 0.09411379533220632, "deviation-center-line": 0.3153921514169963, "driven_lanedir_consec": 0.3103305034023145, "sim_compute_sim_state": 0.036797383034876154, "sim_compute_performance-ego": 0.06774741365003956, "sim_compute_robot_state-ego": 0.07690951990526776}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.31295962729454485, "sim_physics": 0.11070683435960248, "survival_time": 5.4999999999999885, "driven_lanedir": 0.25981470783172744, "sim_render-ego": 0.06181233362718062, "in-drivable-lane": 0, "agent_compute-ego": 0.24309255426580256, "deviation-heading": 2.848573086595973, "set_robot_commands": 0.09981700073588978, "deviation-center-line": 0.33335853391563286, "driven_lanedir_consec": 0.25981470783172744, "sim_compute_sim_state": 0.03855004527352073, "sim_compute_performance-ego": 0.06657638983293013, "sim_compute_robot_state-ego": 0.07172599055550315}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.504196964717085, "sim_physics": 0.10639145169939314, "survival_time": 8.74999999999999, "driven_lanedir": 0.45812760373127626, "sim_render-ego": 0.061582483564104354, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.22300853320530484, "deviation-heading": 2.1078610086576557, "set_robot_commands": 0.09229138238089424, "deviation-center-line": 0.4756328606629784, "driven_lanedir_consec": 0.45812760373127626, "sim_compute_sim_state": 0.03748486110142299, "sim_compute_performance-ego": 0.06563792092459543, "sim_compute_robot_state-ego": 0.072295960017613}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.16119892473949063, "sim_physics": 0.0985255241394043, "survival_time": 2.9499999999999975, "driven_lanedir": 0.1304450289584227, "sim_render-ego": 0.05718878164129742, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.21702888456441588, "deviation-heading": 1.448282236346144, "set_robot_commands": 0.09598874237577794, "deviation-center-line": 0.29341065065858607, "driven_lanedir_consec": 0.1304450289584227, "sim_compute_sim_state": 0.03800343254865226, "sim_compute_performance-ego": 0.06700312889228432, "sim_compute_robot_state-ego": 0.07151935464244778}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2842163199303993, "sim_physics": 0.10146173891031517, "survival_time": 5.299999999999989, "driven_lanedir": 0.24114147177694667, "sim_render-ego": 0.06218577555890353, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.24802171284297728, "deviation-heading": 2.180294112277473, "set_robot_commands": 0.10052394642020172, "deviation-center-line": 0.3247571141631385, "driven_lanedir_consec": 0.24114147177694667, "sim_compute_sim_state": 0.039019886052833415, "sim_compute_performance-ego": 0.07147823414712581, "sim_compute_robot_state-ego": 0.07925890301758388}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.2444862525424281, "sim_physics": 0.12522362553796104, "survival_time": 4.299999999999993, "driven_lanedir": 0.21348641459488604, "sim_render-ego": 0.06345936309459597, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.23547445618829063, "deviation-heading": 1.5481764752080347, "set_robot_commands": 0.09302732833596164, "deviation-center-line": 0.34563140725825375, "driven_lanedir_consec": 0.21348641459488604, "sim_compute_sim_state": 0.03799682994221532, "sim_compute_performance-ego": 0.06748775825944058, "sim_compute_robot_state-ego": 0.07426230020301286}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.30388829909552595, "sim_physics": 0.12289171307175248, "survival_time": 5.399999999999989, "driven_lanedir": 0.2759191592602872, "sim_render-ego": 0.06206381762469256, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.23828578878332068, "deviation-heading": 1.360782145738216, "set_robot_commands": 0.09748334134066548, "deviation-center-line": 0.47574190700742264, "driven_lanedir_consec": 0.2759191592602872, "sim_compute_sim_state": 0.0376195024560999, "sim_compute_performance-ego": 0.07000285387039185, "sim_compute_robot_state-ego": 0.0774698434052644}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.21282847411534525, "sim_physics": 0.1131659730275472, "survival_time": 3.7499999999999942, "driven_lanedir": 0.1818078948146664, "sim_render-ego": 0.06267138163248698, "in-drivable-lane": 0, "agent_compute-ego": 0.23528076807657877, "deviation-heading": 1.700384315997999, "set_robot_commands": 0.09958143552144368, "deviation-center-line": 0.2852123499667294, "driven_lanedir_consec": 0.1818078948146664, "sim_compute_sim_state": 0.03966310501098633, "sim_compute_performance-ego": 0.0689925765991211, "sim_compute_robot_state-ego": 0.07606252034505208}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.32994644631887693, "sim_physics": 0.1118152509859907, "survival_time": 6.149999999999986, "driven_lanedir": 0.2844796545723054, "sim_render-ego": 0.0606614961856749, "in-drivable-lane": 0, "agent_compute-ego": 0.23625081147604843, "deviation-heading": 2.615457968470655, "set_robot_commands": 0.09810609546134144, "deviation-center-line": 0.3523940290291094, "driven_lanedir_consec": 0.2844796545723054, "sim_compute_sim_state": 0.039838521461176675, "sim_compute_performance-ego": 0.06889116279477996, "sim_compute_robot_state-ego": 0.07836524451651224}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.22285144268278376, "sim_physics": 0.1015843242406845, "survival_time": 3.999999999999994, "driven_lanedir": 0.18316178969440425, "sim_render-ego": 0.06050607264041901, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2199907898902893, "deviation-heading": 2.0493820361658286, "set_robot_commands": 0.09552083313465118, "deviation-center-line": 0.26525691624972525, "driven_lanedir_consec": 0.18316178969440425, "sim_compute_sim_state": 0.03688095211982727, "sim_compute_performance-ego": 0.06683965921401977, "sim_compute_robot_state-ego": 0.07006855905056}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.2492179383488052, "sim_physics": 0.10744023323059082, "survival_time": 4.399999999999992, "driven_lanedir": 0.22514215111877656, "sim_render-ego": 0.05985181440006603, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.2320839275013317, "deviation-heading": 1.1604108767814585, "set_robot_commands": 0.09602731466293336, "deviation-center-line": 0.4429429269192707, "driven_lanedir_consec": 0.22514215111877656, "sim_compute_sim_state": 0.03885892846367576, "sim_compute_performance-ego": 0.06751411069523204, "sim_compute_robot_state-ego": 0.07282804900949652}}
set_robot_commands_max	0.10052394642020172
set_robot_commands_mean	0.0962421598665793
set_robot_commands_median	0.09602731466293336
set_robot_commands_min	0.09142565727233888
sim_compute_performance-ego_max	0.07147823414712581
sim_compute_performance-ego_mean	0.06816112985228574
sim_compute_performance-ego_median	0.06774741365003956
sim_compute_performance-ego_min	0.06563792092459543
sim_compute_robot_state-ego_max	0.07925890301758388
sim_compute_robot_state-ego_mean	0.07450202928294022
sim_compute_robot_state-ego_median	0.07426230020301286
sim_compute_robot_state-ego_min	0.07006855905056
sim_compute_sim_state_max	0.04122938648346932
sim_compute_sim_state_mean	0.03847198113005183
sim_compute_sim_state_median	0.03855004527352073
sim_compute_sim_state_min	0.036797383034876154
sim_physics_max	0.12522362553796104
sim_physics_mean	0.10999877123428084
sim_physics_median	0.109903722027548
sim_physics_min	0.0985255241394043
sim_render-ego_max	0.06345936309459597
sim_render-ego_mean	0.06101261689829615
sim_render-ego_median	0.061397842658582585
sim_render-ego_min	0.05718878164129742
simulation-passed	1
survival_time_max	8.74999999999999
survival_time_mean	5.21999999999999
survival_time_min	2.9499999999999975

No reset possible

21148

2598

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 19:56:36+00:00

2019-04-27 20:00:11+00:00

0:03:35

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2598/step1-simulation-ip-172-31-40-253-31940-job21148/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21146

2600

Liam Paull 🇨🇦

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-04-27 19:52:39+00:00

2019-04-27 19:56:05+00:00

0:03:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21137

2616

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

2019-04-27 19:33:24+00:00

2019-04-27 19:52:07+00:00

0:18:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.17303215756135829
agent_compute-ego_mean	0.1652589567512627
agent_compute-ego_median	0.1646904790556276
agent_compute-ego_min	0.15750748139840584
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12440917668519196, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06935547457800971, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16370519443794532, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1040979093975491, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.040598255616647226, "sim_compute_performance-ego": 0.07498909808971264, "sim_compute_robot_state-ego": 0.08165483563034623}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.14207878767275342, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06966781616210938, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.17303215756135829, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1084911916770187, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04169011116027832, "sim_compute_performance-ego": 0.07914050420125325, "sim_compute_robot_state-ego": 0.09792039441127404}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14577345287098603, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06655303169699277, "in-drivable-lane": 0, "agent_compute-ego": 0.1658295042374555, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10297322273254396, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03829761112437529, "sim_compute_performance-ego": 0.07471224840949564, "sim_compute_robot_state-ego": 0.0822904530693503}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14330164909362794, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.07011445999145507, "in-drivable-lane": 0, "agent_compute-ego": 0.160217866897583, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10193205833435058, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04383626937866211, "sim_compute_performance-ego": 0.08126390457153321, "sim_compute_robot_state-ego": 0.08071911811828614}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12045243420178375, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0667603257336194, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16088460668732849, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10430400281012812, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04296381865875631, "sim_compute_performance-ego": 0.07422817809672295, "sim_compute_robot_state-ego": 0.0827186198174199}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.11920434601452884, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06670409805920659, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.16823925290788924, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10011030216606295, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04139205387660435, "sim_compute_performance-ego": 0.0770976008201132, "sim_compute_robot_state-ego": 0.08407094527264031}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12477835587092807, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06755059106009347, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16548649753843034, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10634823782103402, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.042077520063945224, "sim_compute_performance-ego": 0.077556312084198, "sim_compute_robot_state-ego": 0.08267959952354431}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14995470501127697, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06886984053112212, "in-drivable-lane": 0, "agent_compute-ego": 0.16246812684195383, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.11799798692975726, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04450770786830357, "sim_compute_performance-ego": 0.0693366186959403, "sim_compute_robot_state-ego": 0.0887323674701509}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.1398110389709473, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06993134547088106, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1716579421091888, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.11217001333075056, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.042523444709131275, "sim_compute_performance-ego": 0.07554530693312823, "sim_compute_robot_state-ego": 0.0919937966233593}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.13163936354897238, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0654852346940474, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16344554207541723, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10198825922879304, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04233931194652211, "sim_compute_performance-ego": 0.07587783986871893, "sim_compute_robot_state-ego": 0.08544535636901855}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.14124894761419915, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06843712732389376, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1646904790556276, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10750877083121956, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04242222959345037, "sim_compute_performance-ego": 0.07555074196357231, "sim_compute_robot_state-ego": 0.08128776488366066}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.14583675350461686, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.0691333498273577, "in-drivable-lane": 0, "agent_compute-ego": 0.16337055819375174, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.1006410036768232, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.03994996207101005, "sim_compute_performance-ego": 0.08135898624147687, "sim_compute_robot_state-ego": 0.08490092413766044}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12488179113350664, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06802985714931115, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.16822432069217458, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10526171385073196, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04425753799139285, "sim_compute_performance-ego": 0.07859943427291571, "sim_compute_robot_state-ego": 0.0829472214567895}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.1391367029260706, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06706612198441117, "in-drivable-lane": 0, "agent_compute-ego": 0.15750748139840584, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10572375191582574, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04307906715958207, "sim_compute_performance-ego": 0.07159270180596246, "sim_compute_robot_state-ego": 0.08525254991319445}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.13844900738959218, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06769177025439692, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.17012482063443052, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10650411774130428, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04233702257567761, "sim_compute_performance-ego": 0.07841658124736711, "sim_compute_robot_state-ego": 0.0893470469643088}}
set_robot_commands_max	0.11799798692975726
set_robot_commands_mean	0.1057368361629262
set_robot_commands_median	0.10526171385073196
set_robot_commands_min	0.10011030216606295
sim_compute_performance-ego_max	0.08135898624147687
sim_compute_performance-ego_mean	0.07635107048680739
sim_compute_performance-ego_median	0.07587783986871893
sim_compute_performance-ego_min	0.0693366186959403
sim_compute_robot_state-ego_max	0.09792039441127404
sim_compute_robot_state-ego_mean	0.08546406624406691
sim_compute_robot_state-ego_median	0.08407094527264031
sim_compute_robot_state-ego_min	0.08071911811828614
sim_compute_sim_state_max	0.04450770786830357
sim_compute_sim_state_mean	0.042151461586289254
sim_compute_sim_state_median	0.04233931194652211
sim_compute_sim_state_min	0.03829761112437529
sim_physics_max	0.14995470501127697
sim_physics_mean	0.13539710083393214
sim_physics_median	0.1391367029260706
sim_physics_min	0.11920434601452884
sim_render-ego_max	0.07011445999145507
sim_render-ego_mean	0.06809002963446051
sim_render-ego_median	0.06802985714931115
sim_render-ego_min	0.0654852346940474
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21113

2636

Andrea Censi 🇨🇭

challenge-aido_LF-template-random

step1-simulation

success

aido2-LFVI-sim-validation

2019-04-27 19:00:14+00:00

2019-04-27 19:33:18+00:00

0:33:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.1787331754511053
agent_compute-ego_mean	0.15993937372650122
agent_compute-ego_median	0.16480490684509275
agent_compute-ego_min	0.11948619842529296
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.2399966173534152, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06730610811257665, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16724486894245388, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.1057780030407483, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04236463655399371, "sim_compute_performance-ego": 0.07837045645412011, "sim_compute_robot_state-ego": 0.08484922179692908, "sim_compute_robot_state-npc0": 0.07292341280587111, "sim_compute_robot_state-npc1": 0.07323408428626725, "sim_compute_robot_state-npc2": 0.07329087921335728, "sim_compute_robot_state-npc3": 0.07577964625781096}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.19018511261258805, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05821817261832101, "in-drivable-lane": 0, "agent_compute-ego": 0.1481620499065944, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09038529225758143, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03587688718523298, "sim_compute_performance-ego": 0.05974419627870832, "sim_compute_robot_state-ego": 0.06217355387551444, "sim_compute_robot_state-npc0": 0.06411271435873848, "sim_compute_robot_state-npc1": 0.06374858958380562, "sim_compute_robot_state-npc2": 0.06277029003415789, "sim_compute_robot_state-npc3": 0.06304606369563512}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18694927854445373, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.058005821357652976, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14558228474218868, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09337890495374364, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03625743828930901, "sim_compute_performance-ego": 0.06533147987810153, "sim_compute_robot_state-ego": 0.0705174450735444, "sim_compute_robot_state-npc0": 0.07008656483252072, "sim_compute_robot_state-npc1": 0.06804481061916907, "sim_compute_robot_state-npc2": 0.06841514642956187, "sim_compute_robot_state-npc3": 0.06743504237202765}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2216599633296331, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06512071192264557, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15639440715312958, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09831387797991437, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04094641407330831, "sim_compute_performance-ego": 0.07006773352622986, "sim_compute_robot_state-ego": 0.07993689179420471, "sim_compute_robot_state-npc0": 0.07110087076822917, "sim_compute_robot_state-npc1": 0.06961118181546529, "sim_compute_robot_state-npc2": 0.0708372990290324, "sim_compute_robot_state-npc3": 0.07081245879332225}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.21225970132010324, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06547077496846516, "in-drivable-lane": 0, "agent_compute-ego": 0.16321387745085217, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.1043227059500558, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04231824193681989, "sim_compute_performance-ego": 0.06995078495570592, "sim_compute_robot_state-ego": 0.07007871355329241, "sim_compute_robot_state-npc0": 0.06894700867789132, "sim_compute_robot_state-npc1": 0.07192558333987281, "sim_compute_robot_state-npc2": 0.07773487908499581, "sim_compute_robot_state-npc3": 0.07374346823919387}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.20880661324826544, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06354912883507277, "in-drivable-lane": 2, "agent_compute-ego": 0.15880518473550945, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09971742144601788, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.040471445300621904, "sim_compute_performance-ego": 0.07055105848940546, "sim_compute_robot_state-ego": 0.07612358595796688, "sim_compute_robot_state-npc0": 0.07188124713783492, "sim_compute_robot_state-npc1": 0.07084848495300658, "sim_compute_robot_state-npc2": 0.07047334545386766, "sim_compute_robot_state-npc3": 0.06958035651795165}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2406045163719399, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06506142107028405, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1604454679396546, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10106367509341936, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04115011159656117, "sim_compute_performance-ego": 0.07132579979387302, "sim_compute_robot_state-ego": 0.08257200185535024, "sim_compute_robot_state-npc0": 0.06980468694446157, "sim_compute_robot_state-npc1": 0.07037525269591692, "sim_compute_robot_state-npc2": 0.07136185192367406, "sim_compute_robot_state-npc3": 0.07489367596154074}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.1699807834625244, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.050958662033081054, "in-drivable-lane": 0, "agent_compute-ego": 0.11948619842529296, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07385818481445312, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.032218427658081056, "sim_compute_performance-ego": 0.054004392623901366, "sim_compute_robot_state-ego": 0.05674378871917725, "sim_compute_robot_state-npc0": 0.0528607988357544, "sim_compute_robot_state-npc1": 0.05306710720062256, "sim_compute_robot_state-npc2": 0.05432374477386474, "sim_compute_robot_state-npc3": 0.05266977310180664}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.22969961166381836, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06596789910243107, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16515054152562067, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.1049911746611962, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04114237656960121, "sim_compute_performance-ego": 0.07533872127532959, "sim_compute_robot_state-ego": 0.08349110988470224, "sim_compute_robot_state-npc0": 0.07641029816407424, "sim_compute_robot_state-npc1": 0.0746334561934838, "sim_compute_robot_state-npc2": 0.07436509315784161, "sim_compute_robot_state-npc3": 0.07356703739899856}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.26840012807112473, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.07578370204338661, "in-drivable-lane": 0, "agent_compute-ego": 0.16783600587111253, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.11133192135737492, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.04257861467508169, "sim_compute_performance-ego": 0.07835778823265663, "sim_compute_robot_state-ego": 0.08955891315753643, "sim_compute_robot_state-npc0": 0.0779732740842379, "sim_compute_robot_state-npc1": 0.07576096057891846, "sim_compute_robot_state-npc2": 0.07648012271294227, "sim_compute_robot_state-npc3": 0.07295751571655273}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2691433754834262, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.07012194936925714, "in-drivable-lane": 0, "agent_compute-ego": 0.1787331754511053, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.11056419936093416, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04081407460299405, "sim_compute_performance-ego": 0.07555859739130194, "sim_compute_robot_state-ego": 0.0918549515984275, "sim_compute_robot_state-npc0": 0.07384945045817982, "sim_compute_robot_state-npc1": 0.07299189134077592, "sim_compute_robot_state-npc2": 0.0740058422088623, "sim_compute_robot_state-npc3": 0.0757737701589411}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.2178921413421631, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.07023534774780274, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16480490684509275, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.1016737985610962, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04689965724945069, "sim_compute_performance-ego": 0.07500275611877441, "sim_compute_robot_state-ego": 0.07979442596435547, "sim_compute_robot_state-npc0": 0.07509942531585694, "sim_compute_robot_state-npc1": 0.07556457042694092, "sim_compute_robot_state-npc2": 0.07592830181121826, "sim_compute_robot_state-npc3": 0.07644237041473388}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.238736314976469, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06791474717728635, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1693278601829042, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.10606788574381078, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04230310308172348, "sim_compute_performance-ego": 0.07490991785171185, "sim_compute_robot_state-ego": 0.08293030109811336, "sim_compute_robot_state-npc0": 0.0726388895765264, "sim_compute_robot_state-npc1": 0.07232697973860071, "sim_compute_robot_state-npc2": 0.07409036920425739, "sim_compute_robot_state-npc3": 0.07836212249512368}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.22657268322431123, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.07165022079761212, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1685744203053988, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.1068825309093182, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.043065749681912936, "sim_compute_performance-ego": 0.07704298312847431, "sim_compute_robot_state-ego": 0.08029795609987699, "sim_compute_robot_state-npc0": 0.07149770626654992, "sim_compute_robot_state-npc1": 0.07387101191740769, "sim_compute_robot_state-npc2": 0.072076847920051, "sim_compute_robot_state-npc3": 0.07636563136027409}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.21504282043093725, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06779930932181222, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.16532935642060778, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.10169753574189686, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04243912469773065, "sim_compute_performance-ego": 0.07116495768229167, "sim_compute_robot_state-ego": 0.07828955877394904, "sim_compute_robot_state-npc0": 0.07313217889694941, "sim_compute_robot_state-npc1": 0.07538847242082869, "sim_compute_robot_state-npc2": 0.07399180276053292, "sim_compute_robot_state-npc3": 0.07363971755618141}}
set_robot_commands_max	0.11133192135737492
set_robot_commands_mean	0.10066847412477076
set_robot_commands_median	0.10169753574189686
set_robot_commands_min	0.07385818481445312
sim_compute_performance-ego_max	0.07837045645412011
sim_compute_performance-ego_mean	0.07111477491203906
sim_compute_performance-ego_median	0.07132579979387302
sim_compute_performance-ego_min	0.054004392623901366
sim_compute_robot_state-ego_max	0.0918549515984275
sim_compute_robot_state-ego_mean	0.07794749461352933
sim_compute_robot_state-ego_median	0.07993689179420471
sim_compute_robot_state-ego_min	0.05674378871917725
sim_compute_robot_state-npc0_max	0.0779732740842379
sim_compute_robot_state-npc0_mean	0.07082123514157843
sim_compute_robot_state-npc0_median	0.07188124713783492
sim_compute_robot_state-npc0_min	0.0528607988357544
sim_compute_robot_state-npc1_max	0.07576096057891846
sim_compute_robot_state-npc1_mean	0.0707594958074055
sim_compute_robot_state-npc1_median	0.07232697973860071
sim_compute_robot_state-npc1_min	0.05306710720062256
sim_compute_robot_state-npc2_max	0.07773487908499581
sim_compute_robot_state-npc2_mean	0.0713430543812145
sim_compute_robot_state-npc2_median	0.07329087921335728
sim_compute_robot_state-npc2_min	0.05432374477386474
sim_compute_robot_state-npc3_max	0.07836212249512368
sim_compute_robot_state-npc3_mean	0.07167124333600629
sim_compute_robot_state-npc3_median	0.07363971755618141
sim_compute_robot_state-npc3_min	0.05266977310180664
sim_compute_sim_state_max	0.04689965724945069
sim_compute_sim_state_mean	0.04072308687682818
sim_compute_sim_state_median	0.04115011159656117
sim_compute_sim_state_min	0.032218427658081056
sim_physics_max	0.2691433754834262
sim_physics_mean	0.2223953107623449
sim_physics_median	0.2216599633296331
sim_physics_min	0.1699807834625244
sim_render-ego_max	0.07578370204338661
sim_render-ego_mean	0.0655442650985125
sim_render-ego_median	0.06596789910243107
sim_render-ego_min	0.050958662033081054
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21108

2649

Egor Zamotaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

host-error

2019-04-27 18:51:49+00:00

2019-04-27 19:00:07+00:00

0:08:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-validation/submission2649/step1-simulation-ip-172-31-40-253-31940-job21108/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21084

2690

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-04-27 18:02:00+00:00

2019-04-27 18:51:22+00:00

0:49:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7409490091978497
survival_time_median	5.749999999999988
deviation-center-line_median	0.4611593234868057
in-drivable-lane_median	0.2500000000000002

other stats

agent_compute-ego_max	0.0937936202339504
agent_compute-ego_mean	0.08659182006352668
agent_compute-ego_median	0.08785872754797472
agent_compute-ego_min	0.06880700203680223
deviation-center-line_max	1.1369960132308723
deviation-center-line_mean	0.5589323994907558
deviation-center-line_min	0.2531981299107281
deviation-heading_max	7.1393348963615555
deviation-heading_mean	3.5207826312536388
deviation-heading_median	2.534717133784091
deviation-heading_min	0.4410339581852604
driven_any_max	2.348807310422842
driven_any_mean	1.322377791859524
driven_any_median	0.8543766888243405
driven_any_min	0.3963595332076136
driven_lanedir_consec_max	1.2102383929894738
driven_lanedir_consec_mean	0.7224346825010985
driven_lanedir_consec_min	0.20474640386777615
driven_lanedir_max	1.7136481218221875
driven_lanedir_mean	0.9069102918129252
driven_lanedir_median	0.8135409573816705
driven_lanedir_min	0.3856255928869673
in-drivable-lane_max	4.050000000000001
in-drivable-lane_mean	1.346666666666672
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.853438683188371, "sim_physics": 0.14928312094315238, "survival_time": 5.749999999999988, "driven_lanedir": 0.6594314811404642, "sim_render-ego": 0.07307715830595597, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09139366564543353, "deviation-heading": 2.815447276816155, "set_robot_commands": 0.1169945011968198, "deviation-center-line": 0.4054563363406779, "driven_lanedir_consec": 0.6594314811404642, "sim_compute_sim_state": 0.04444149266118589, "sim_compute_performance-ego": 0.08882794794828995, "sim_compute_robot_state-ego": 0.093351760117904}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6854819108119777, "sim_physics": 0.14956126005753226, "survival_time": 4.599999999999992, "driven_lanedir": 0.3856255928869673, "sim_render-ego": 0.07370137390883072, "in-drivable-lane": 0.6999999999999988, "agent_compute-ego": 0.0937936202339504, "deviation-heading": 2.534717133784091, "set_robot_commands": 0.11491299452988998, "deviation-center-line": 0.4187183011274892, "driven_lanedir_consec": 0.20474640386777615, "sim_compute_sim_state": 0.04461642451908277, "sim_compute_performance-ego": 0.08298712191374405, "sim_compute_robot_state-ego": 0.09341051267540972}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3963595332076136, "sim_physics": 0.1442292971270425, "survival_time": 2.799999999999998, "driven_lanedir": 0.3894717854915788, "sim_render-ego": 0.07171118259429932, "in-drivable-lane": 0, "agent_compute-ego": 0.0851282264505114, "deviation-heading": 0.4641621997087847, "set_robot_commands": 0.10864230564662387, "deviation-center-line": 0.2702944246548057, "driven_lanedir_consec": 0.3894717854915788, "sim_compute_sim_state": 0.04105299711227417, "sim_compute_performance-ego": 0.08071857690811157, "sim_compute_robot_state-ego": 0.09157895190375193}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.17584661836453, "sim_physics": 0.15161506179111456, "survival_time": 7.649999999999981, "driven_lanedir": 1.093568628293302, "sim_render-ego": 0.0746809236364427, "in-drivable-lane": 0, "agent_compute-ego": 0.09225663172653298, "deviation-heading": 2.4573829332521653, "set_robot_commands": 0.12030851607229195, "deviation-center-line": 0.4770769763152822, "driven_lanedir_consec": 1.093568628293302, "sim_compute_sim_state": 0.04616181367363026, "sim_compute_performance-ego": 0.08210090718238182, "sim_compute_robot_state-ego": 0.09254522261276744}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.858624387862033, "sim_physics": 0.1476575887503744, "survival_time": 11.900000000000034, "driven_lanedir": 1.1655251015831605, "sim_render-ego": 0.07274091043392149, "in-drivable-lane": 2.35000000000002, "agent_compute-ego": 0.09368231516926229, "deviation-heading": 5.037907032503472, "set_robot_commands": 0.11821894685761268, "deviation-center-line": 0.8210084873324892, "driven_lanedir_consec": 0.7409490091978497, "sim_compute_sim_state": 0.04561208075835925, "sim_compute_performance-ego": 0.08210731554432076, "sim_compute_robot_state-ego": 0.09504918891842626}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.348807310422842, "sim_physics": 0.13932748476664225, "survival_time": 14.950000000000076, "driven_lanedir": 1.3847847616895963, "sim_render-ego": 0.06737974405288696, "in-drivable-lane": 3.800000000000039, "agent_compute-ego": 0.08576432228088379, "deviation-heading": 6.2993598703587015, "set_robot_commands": 0.11193058013916016, "deviation-center-line": 0.7489275390016138, "driven_lanedir_consec": 1.2102383929894738, "sim_compute_sim_state": 0.0434489115079244, "sim_compute_performance-ego": 0.07676926692326863, "sim_compute_robot_state-ego": 0.0872503654162089}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.8060935897686518, "sim_physics": 0.14541010767499976, "survival_time": 5.349999999999989, "driven_lanedir": 0.7449158444755347, "sim_render-ego": 0.07165524892717878, "in-drivable-lane": 0, "agent_compute-ego": 0.08618865948971187, "deviation-heading": 1.823729172877429, "set_robot_commands": 0.11288502283185442, "deviation-center-line": 0.2531981299107281, "driven_lanedir_consec": 0.7449158444755347, "sim_compute_sim_state": 0.04300597003687208, "sim_compute_performance-ego": 0.08069412062101275, "sim_compute_robot_state-ego": 0.09427590904948868}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.4445795169870802, "sim_physics": 0.09945219562899682, "survival_time": 3.099999999999997, "driven_lanedir": 0.4392979311725254, "sim_render-ego": 0.0564103280344317, "in-drivable-lane": 0, "agent_compute-ego": 0.06880700203680223, "deviation-heading": 0.4410339581852604, "set_robot_commands": 0.08415374063676404, "deviation-center-line": 0.3089433478337876, "driven_lanedir_consec": 0.4392979311725254, "sim_compute_sim_state": 0.03487112829762121, "sim_compute_performance-ego": 0.06100480402669599, "sim_compute_robot_state-ego": 0.06450803049149052}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.348723707149654, "sim_physics": 0.13500322818756105, "survival_time": 14.950000000000076, "driven_lanedir": 1.7136481218221875, "sim_render-ego": 0.06551578521728516, "in-drivable-lane": 1.6500000000000083, "agent_compute-ego": 0.08239618778228759, "deviation-heading": 6.989545015351265, "set_robot_commands": 0.10583205858866374, "deviation-center-line": 0.7343388095792917, "driven_lanedir_consec": 1.1461920361370788, "sim_compute_sim_state": 0.04153692881266276, "sim_compute_performance-ego": 0.07288649002710978, "sim_compute_robot_state-ego": 0.08238760789235433}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6614881296150275, "sim_physics": 0.14708765169207969, "survival_time": 4.449999999999992, "driven_lanedir": 0.555358663738549, "sim_render-ego": 0.07056860709458254, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.0925122620014662, "deviation-heading": 1.4811934503549096, "set_robot_commands": 0.11778641550728444, "deviation-center-line": 0.2862630299657008, "driven_lanedir_consec": 0.555358663738549, "sim_compute_sim_state": 0.044522786408327936, "sim_compute_performance-ego": 0.08320816715111894, "sim_compute_robot_state-ego": 0.08988079863987612}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.34855445904135, "sim_physics": 0.146025284131368, "survival_time": 14.950000000000076, "driven_lanedir": 1.317058887675545, "sim_render-ego": 0.07031283855438232, "in-drivable-lane": 3.6500000000000066, "agent_compute-ego": 0.0885504674911499, "deviation-heading": 7.12537974439661, "set_robot_commands": 0.113482715288798, "deviation-center-line": 0.8821018449106627, "driven_lanedir_consec": 0.9166563970342796, "sim_compute_sim_state": 0.04418443361918131, "sim_compute_performance-ego": 0.07863264719645183, "sim_compute_robot_state-ego": 0.0903285551071167}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.0273772825878695, "sim_physics": 0.13564433554424743, "survival_time": 12.950000000000047, "driven_lanedir": 1.117086154893746, "sim_render-ego": 0.07153622063890848, "in-drivable-lane": 4.050000000000001, "agent_compute-ego": 0.08708814580468137, "deviation-heading": 4.266163813246415, "set_robot_commands": 0.1146014657259908, "deviation-center-line": 0.7250416629491067, "driven_lanedir_consec": 0.9054190261505052, "sim_compute_sim_state": 0.04405484236345328, "sim_compute_performance-ego": 0.07980025136792981, "sim_compute_robot_state-ego": 0.09180762316729572}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6774833415661158, "sim_physics": 0.11144276241679768, "survival_time": 4.549999999999992, "driven_lanedir": 0.4768458568042703, "sim_render-ego": 0.0601279840364561, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.07445609438550341, "deviation-heading": 2.412213917982253, "set_robot_commands": 0.09360956359695602, "deviation-center-line": 0.4544617657220231, "driven_lanedir_consec": 0.2784459079652822, "sim_compute_sim_state": 0.037778566171834754, "sim_compute_performance-ego": 0.06576657033228613, "sim_compute_robot_state-ego": 0.0703093953185029}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.8543766888243405, "sim_physics": 0.1371367441869415, "survival_time": 5.649999999999988, "driven_lanedir": 0.8135409573816705, "sim_render-ego": 0.0680152082865217, "in-drivable-lane": 0, "agent_compute-ego": 0.08785872754797472, "deviation-heading": 1.524169053625519, "set_robot_commands": 0.1132882168862672, "deviation-center-line": 0.4611593234868057, "driven_lanedir_consec": 0.8135409573816705, "sim_compute_sim_state": 0.04405291312563736, "sim_compute_performance-ego": 0.07927606591081197, "sim_compute_robot_state-ego": 0.08951161182032222}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.348431718495402, "sim_physics": 0.1485072390238444, "survival_time": 14.950000000000076, "driven_lanedir": 1.3474946081447796, "sim_render-ego": 0.07230412165323893, "in-drivable-lane": 3.3500000000000068, "agent_compute-ego": 0.08900097290674845, "deviation-heading": 7.1393348963615555, "set_robot_commands": 0.11400256395339964, "deviation-center-line": 1.1369960132308723, "driven_lanedir_consec": 0.7382877724806076, "sim_compute_sim_state": 0.044910298188527424, "sim_compute_performance-ego": 0.08210752805074056, "sim_compute_robot_state-ego": 0.09367148796717326}}
set_robot_commands_max	0.12030851607229195
set_robot_commands_mean	0.11070997383055846
set_robot_commands_median	0.113482715288798
set_robot_commands_min	0.08415374063676404
sim_compute_performance-ego_max	0.08882794794828995
sim_compute_performance-ego_mean	0.07845918540695164
sim_compute_performance-ego_median	0.08069412062101275
sim_compute_performance-ego_min	0.06100480402669599
sim_compute_robot_state-ego_max	0.09504918891842626
sim_compute_robot_state-ego_mean	0.08799113473987258
sim_compute_robot_state-ego_median	0.09157895190375193
sim_compute_robot_state-ego_min	0.06450803049149052
sim_compute_sim_state_max	0.04616181367363026
sim_compute_sim_state_mean	0.04295010581710499
sim_compute_sim_state_median	0.04405484236345328
sim_compute_sim_state_min	0.03487112829762121
sim_physics_max	0.15161506179111456
sim_physics_mean	0.1391588907948463
sim_physics_median	0.14541010767499976
sim_physics_min	0.09945219562899682
sim_render-ego_max	0.0746809236364427
sim_render-ego_mean	0.06931584235835486
sim_render-ego_median	0.07153622063890848
sim_render-ego_min	0.0564103280344317
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.57000000000002
survival_time_min	2.799999999999998

No reset possible

21029

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:05:47+00:00

2019-04-27 18:00:04+00:00

0:54:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-40-253-31940-job21029/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21026

2778

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:04:58+00:00

2019-04-27 17:05:32+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21020

2786

Rami Al-Naim 🇷🇺

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

error

2019-04-27 17:04:15+00:00

2019-04-27 17:04:50+00:00

0:00:35

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21004

2795

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-04-27 17:00:20+00:00

2019-04-27 17:02:22+00:00

0:02:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20962

2907

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 16:00:43+00:00

2019-04-27 16:59:33+00:00

0:58:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4666269195057299
survival_time_median	6.099999999999986
deviation-center-line_median	0.33342045979934726
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.2664610950314269
agent_compute-ego_mean	0.2476612981830721
agent_compute-ego_median	0.24815997014562768
agent_compute-ego_min	0.23170781295571552
deviation-center-line_max	1.0679252017096004
deviation-center-line_mean	0.3924914804475109
deviation-center-line_min	0.16662188238079648
deviation-heading_max	3.003760940366442
deviation-heading_mean	1.1827375892216667
deviation-heading_median	0.8526165284633079
deviation-heading_min	0.3980745231922676
driven_any_max	2.5534750247780256
driven_any_mean	1.0539409492055236
driven_any_median	1.0073534337255925
driven_any_min	0.3609526397352217
driven_lanedir_consec_max	2.319986201404549
driven_lanedir_consec_mean	0.7711578039542435
driven_lanedir_consec_min	0.3359040954329422
driven_lanedir_max	2.320011827433317
driven_lanedir_mean	0.7846553049466682
driven_lanedir_median	0.6115510331777083
driven_lanedir_min	0.3359040954329422
in-drivable-lane_max	6.899999999999996
in-drivable-lane_mean	1.2566666666666677
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3917000438981204, "sim_physics": 0.20319811981844615, "survival_time": 8.299999999999983, "driven_lanedir": 1.385164263676098, "sim_render-ego": 0.0649482141058129, "in-drivable-lane": 0, "agent_compute-ego": 0.24815997014562768, "deviation-heading": 0.7900800801587916, "set_robot_commands": 0.10079308877508324, "deviation-center-line": 0.5314409393909165, "driven_lanedir_consec": 1.3847999119740728, "sim_compute_sim_state": 0.04068264042038515, "sim_compute_performance-ego": 0.07108707025826695, "sim_compute_robot_state-ego": 0.08195674850280027, "sim_compute_robot_state-npc0": 0.07276905444731195, "sim_compute_robot_state-npc1": 0.07276600527476115, "sim_compute_robot_state-npc2": 0.07284060300114643, "sim_compute_robot_state-npc3": 0.07119336042059474}, "udem1-1-0": {"driven_any": 0.4483038438315837, "sim_physics": 0.2262823581695557, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42268219757764713, "sim_render-ego": 0.06666525890087259, "in-drivable-lane": 0, "agent_compute-ego": 0.26337349003758925, "deviation-heading": 0.9834275270262504, "set_robot_commands": 0.10552911922849458, "deviation-center-line": 0.20839337138315597, "driven_lanedir_consec": 0.42268219757764713, "sim_compute_sim_state": 0.04328347896707469, "sim_compute_performance-ego": 0.0735543390800213, "sim_compute_robot_state-ego": 0.08681420211134286, "sim_compute_robot_state-npc0": 0.07641861356537917, "sim_compute_robot_state-npc1": 0.07194787469403498, "sim_compute_robot_state-npc2": 0.07428174183286469, "sim_compute_robot_state-npc3": 0.07615955944718986}, "udem1-2-0": {"driven_any": 2.1691284131378556, "sim_physics": 0.20375274302912696, "survival_time": 12.750000000000046, "driven_lanedir": 1.7728091353929467, "sim_render-ego": 0.06660434965993844, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.24912126391541725, "deviation-heading": 0.8643955126282414, "set_robot_commands": 0.09888327074985878, "deviation-center-line": 0.6335156899837494, "driven_lanedir_consec": 1.7727837451824469, "sim_compute_sim_state": 0.0416808895036286, "sim_compute_performance-ego": 0.07379641065410539, "sim_compute_robot_state-ego": 0.07987124405655206, "sim_compute_robot_state-npc0": 0.0727443629620122, "sim_compute_robot_state-npc1": 0.07327769971361348, "sim_compute_robot_state-npc2": 0.07358566732967602, "sim_compute_robot_state-npc3": 0.07321768180996764}, "udem1-3-0": {"driven_any": 2.5534750247780256, "sim_physics": 0.211795224348704, "survival_time": 14.950000000000076, "driven_lanedir": 2.320011827433317, "sim_render-ego": 0.0657030741373698, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.255876784324646, "deviation-heading": 0.8526165284633079, "set_robot_commands": 0.10092665036519367, "deviation-center-line": 1.0679252017096004, "driven_lanedir_consec": 2.319986201404549, "sim_compute_sim_state": 0.041560147603352866, "sim_compute_performance-ego": 0.07169158856074015, "sim_compute_robot_state-ego": 0.07893640915552776, "sim_compute_robot_state-npc0": 0.07227652072906494, "sim_compute_robot_state-npc1": 0.07427234172821046, "sim_compute_robot_state-npc2": 0.07416579246520996, "sim_compute_robot_state-npc3": 0.07408375342686971}, "udem1-4-0": {"driven_any": 0.36968771707772213, "sim_physics": 0.21861985751560756, "survival_time": 2.4499999999999993, "driven_lanedir": 0.35661432194998266, "sim_render-ego": 0.06851492609296526, "in-drivable-lane": 0, "agent_compute-ego": 0.2664610950314269, "deviation-heading": 0.6524331044587797, "set_robot_commands": 0.10369286731797822, "deviation-center-line": 0.17497068978210834, "driven_lanedir_consec": 0.35661432194998266, "sim_compute_sim_state": 0.04198435861237195, "sim_compute_performance-ego": 0.07391172039265535, "sim_compute_robot_state-ego": 0.0804389155640894, "sim_compute_robot_state-npc0": 0.0731201950384646, "sim_compute_robot_state-npc1": 0.07232730242670798, "sim_compute_robot_state-npc2": 0.07326476914542061, "sim_compute_robot_state-npc3": 0.07350131443568639}, "udem1-5-0": {"driven_any": 1.042294034481285, "sim_physics": 0.2122189544496082, "survival_time": 6.299999999999986, "driven_lanedir": 0.397789206115704, "sim_render-ego": 0.06676763390737867, "in-drivable-lane": 2.94999999999999, "agent_compute-ego": 0.2512595937365577, "deviation-heading": 2.0607034254461456, "set_robot_commands": 0.09970244717976404, "deviation-center-line": 0.33342045979934726, "driven_lanedir_consec": 0.397789206115704, "sim_compute_sim_state": 0.046148669152032765, "sim_compute_performance-ego": 0.07228826151953803, "sim_compute_robot_state-ego": 0.07735534130580841, "sim_compute_robot_state-npc0": 0.07403504848480225, "sim_compute_robot_state-npc1": 0.07155121129656596, "sim_compute_robot_state-npc2": 0.07242349215916224, "sim_compute_robot_state-npc3": 0.07452310077727788}, "udem1-6-0": {"driven_any": 0.8064449781322619, "sim_physics": 0.23848541336830217, "survival_time": 4.94999999999999, "driven_lanedir": 0.8035054895550815, "sim_render-ego": 0.06833069733899048, "in-drivable-lane": 0, "agent_compute-ego": 0.24244421178644351, "deviation-heading": 0.4193176749368592, "set_robot_commands": 0.0984559396300653, "deviation-center-line": 0.452136787656477, "driven_lanedir_consec": 0.8035054895550815, "sim_compute_sim_state": 0.04126566829103412, "sim_compute_performance-ego": 0.0736178725656837, "sim_compute_robot_state-ego": 0.08153633637861772, "sim_compute_robot_state-npc0": 0.07091114737770775, "sim_compute_robot_state-npc1": 0.07305030148438733, "sim_compute_robot_state-npc2": 0.07324241387723672, "sim_compute_robot_state-npc3": 0.07381963248204704}, "udem1-7-0": {"driven_any": 1.0073534337255925, "sim_physics": 0.2220058069854486, "survival_time": 6.099999999999986, "driven_lanedir": 0.8835113000614128, "sim_render-ego": 0.06432184039569291, "in-drivable-lane": 0, "agent_compute-ego": 0.24268319176845865, "deviation-heading": 2.2471885996035605, "set_robot_commands": 0.09873952826515572, "deviation-center-line": 0.3798457091493637, "driven_lanedir_consec": 0.8699546836324721, "sim_compute_sim_state": 0.04020705183998483, "sim_compute_performance-ego": 0.07049650051554696, "sim_compute_robot_state-ego": 0.07790095298016658, "sim_compute_robot_state-npc0": 0.0712605284862831, "sim_compute_robot_state-npc1": 0.07332914774535132, "sim_compute_robot_state-npc2": 0.07277577236050466, "sim_compute_robot_state-npc3": 0.07229507946577228}, "udem1-8-0": {"driven_any": 1.0248237349998126, "sim_physics": 0.2108490813163019, "survival_time": 6.199999999999986, "driven_lanedir": 0.6115510331777083, "sim_render-ego": 0.0635644139782075, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.2504970200600163, "deviation-heading": 2.0843956771066994, "set_robot_commands": 0.0970152251182064, "deviation-center-line": 0.4228098836080403, "driven_lanedir_consec": 0.6115510331777083, "sim_compute_sim_state": 0.04190304971510364, "sim_compute_performance-ego": 0.07359238401536018, "sim_compute_robot_state-ego": 0.07860740154020247, "sim_compute_robot_state-npc0": 0.07188071743134529, "sim_compute_robot_state-npc1": 0.07221336518564532, "sim_compute_robot_state-npc2": 0.07403638093702254, "sim_compute_robot_state-npc3": 0.07327828099650721}, "udem1-9-0": {"driven_any": 0.44830384366262993, "sim_physics": 0.22951715568016315, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4319199663087821, "sim_render-ego": 0.06359829573795714, "in-drivable-lane": 0, "agent_compute-ego": 0.23641832943620353, "deviation-heading": 0.7843859210886422, "set_robot_commands": 0.10100656542284736, "deviation-center-line": 0.19267161522996132, "driven_lanedir_consec": 0.4319199663087821, "sim_compute_sim_state": 0.04214499736654347, "sim_compute_performance-ego": 0.06651525250796614, "sim_compute_robot_state-ego": 0.07412050099208436, "sim_compute_robot_state-npc0": 0.068514634822977, "sim_compute_robot_state-npc1": 0.07178177504703917, "sim_compute_robot_state-npc2": 0.07192412738142342, "sim_compute_robot_state-npc3": 0.07036251446296429}, "udem1-10-0": {"driven_any": 0.3609526397352217, "sim_physics": 0.21680237352848053, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3414443288920854, "sim_render-ego": 0.06613697111606598, "in-drivable-lane": 0, "agent_compute-ego": 0.23588005701700843, "deviation-heading": 0.7915362159748539, "set_robot_commands": 0.09978727499643962, "deviation-center-line": 0.16662188238079648, "driven_lanedir_consec": 0.3414443288920854, "sim_compute_sim_state": 0.04128952821095785, "sim_compute_performance-ego": 0.06889443099498749, "sim_compute_robot_state-ego": 0.07565723856290181, "sim_compute_robot_state-npc0": 0.07212011019388835, "sim_compute_robot_state-npc1": 0.07020476460456848, "sim_compute_robot_state-npc2": 0.06799956162770589, "sim_compute_robot_state-npc3": 0.07193236549695332}, "udem1-11-0": {"driven_any": 0.4046281574967708, "sim_physics": 0.2219523843729271, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4000362944855031, "sim_render-ego": 0.06349181229213499, "in-drivable-lane": 0, "agent_compute-ego": 0.24611249959693765, "deviation-heading": 0.3980745231922676, "set_robot_commands": 0.09613722675251513, "deviation-center-line": 0.27088748121436834, "driven_lanedir_consec": 0.4000362944855031, "sim_compute_sim_state": 0.03942187327258992, "sim_compute_performance-ego": 0.07309705356381974, "sim_compute_robot_state-ego": 0.07988157362308142, "sim_compute_robot_state-npc0": 0.07052051346257047, "sim_compute_robot_state-npc1": 0.07032692657326753, "sim_compute_robot_state-npc2": 0.0698834905084574, "sim_compute_robot_state-npc3": 0.0707642267335136}, "udem1-12-0": {"driven_any": 1.5489327489550275, "sim_physics": 0.21554925389911817, "survival_time": 9.199999999999996, "driven_lanedir": 0.3359040954329422, "sim_render-ego": 0.06420541198357292, "in-drivable-lane": 6.899999999999996, "agent_compute-ego": 0.2395973335141721, "deviation-heading": 0.4854799489598317, "set_robot_commands": 0.09682963594146396, "deviation-center-line": 0.2750717398716856, "driven_lanedir_consec": 0.3359040954329422, "sim_compute_sim_state": 0.03998715074166008, "sim_compute_performance-ego": 0.07047670431759047, "sim_compute_robot_state-ego": 0.07516669320023578, "sim_compute_robot_state-npc0": 0.07087914192158243, "sim_compute_robot_state-npc1": 0.07238663797793181, "sim_compute_robot_state-npc2": 0.07266815201095912, "sim_compute_robot_state-npc3": 0.07028865943784299}, "udem1-13-0": {"driven_any": 0.989883133415772, "sim_physics": 0.21148428320884705, "survival_time": 5.999999999999987, "driven_lanedir": 0.6517686641189435, "sim_render-ego": 0.06544825633366903, "in-drivable-lane": 1.4499999999999948, "agent_compute-ego": 0.25532681941986085, "deviation-heading": 1.3232681589143314, "set_robot_commands": 0.10036274592081704, "deviation-center-line": 0.3285066985483987, "driven_lanedir_consec": 0.6517686641189435, "sim_compute_sim_state": 0.04126901825269063, "sim_compute_performance-ego": 0.07473060091336568, "sim_compute_robot_state-ego": 0.07908727129300436, "sim_compute_robot_state-npc0": 0.07370544870694479, "sim_compute_robot_state-npc1": 0.07317793766657511, "sim_compute_robot_state-npc2": 0.07114562193552652, "sim_compute_robot_state-npc3": 0.07152669628461202}, "udem1-14-0": {"driven_any": 1.243202490755171, "sim_physics": 0.21376929027122135, "survival_time": 7.449999999999981, "driven_lanedir": 0.6551174500218688, "sim_render-ego": 0.06389356619559679, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.23170781295571552, "deviation-heading": 3.003760940366442, "set_robot_commands": 0.09440724481672248, "deviation-center-line": 0.4491540570046963, "driven_lanedir_consec": 0.4666269195057299, "sim_compute_sim_state": 0.03976655646458568, "sim_compute_performance-ego": 0.07022167692248453, "sim_compute_robot_state-ego": 0.0751761942101805, "sim_compute_robot_state-npc0": 0.06841154546545655, "sim_compute_robot_state-npc1": 0.07164380374370806, "sim_compute_robot_state-npc2": 0.07043905546201155, "sim_compute_robot_state-npc3": 0.07106217441942868}}
set_robot_commands_max	0.10552911922849458
set_robot_commands_mean	0.09948458869870704
set_robot_commands_median	0.09970244717976404
set_robot_commands_min	0.09440724481672248
sim_compute_performance-ego_max	0.07473060091336568
sim_compute_performance-ego_mean	0.07186479111880881
sim_compute_performance-ego_median	0.07228826151953803
sim_compute_performance-ego_min	0.06651525250796614
sim_compute_robot_state-ego_max	0.08681420211134286
sim_compute_robot_state-ego_mean	0.0788338015651064
sim_compute_robot_state-ego_median	0.07893640915552776
sim_compute_robot_state-ego_min	0.07412050099208436
sim_compute_robot_state-npc0_max	0.07641861356537917
sim_compute_robot_state-npc0_mean	0.07197117220638606
sim_compute_robot_state-npc0_median	0.07212011019388835
sim_compute_robot_state-npc0_min	0.06841154546545655
sim_compute_robot_state-npc1_max	0.07427234172821046
sim_compute_robot_state-npc1_mean	0.07228380634415789
sim_compute_robot_state-npc1_median	0.07232730242670798
sim_compute_robot_state-npc1_min	0.07020476460456848
sim_compute_robot_state-npc2_max	0.07428174183286469
sim_compute_robot_state-npc2_mean	0.07231177613562186
sim_compute_robot_state-npc2_median	0.07277577236050466
sim_compute_robot_state-npc2_min	0.06799956162770589
sim_compute_robot_state-npc3_max	0.07615955944718986
sim_compute_robot_state-npc3_mean	0.07253389333981518
sim_compute_robot_state-npc3_median	0.07229507946577228
sim_compute_robot_state-npc3_min	0.07028865943784299
sim_compute_sim_state_max	0.046148669152032765
sim_compute_sim_state_mean	0.04150633856093308
sim_compute_sim_state_median	0.04128952821095785
sim_compute_sim_state_min	0.03942187327258992
sim_physics_max	0.23848541336830217
sim_physics_mean	0.21708548666412392
sim_physics_median	0.21554925389911817
sim_physics_min	0.20319811981844615
sim_render-ego_max	0.06851492609296526
sim_render-ego_mean	0.0654796481450817
sim_render-ego_median	0.06544825633366903
sim_render-ego_min	0.06349181229213499
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.366666666666666
survival_time_min	2.3999999999999995

No reset possible

20924

2977

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 15:02:47+00:00

2019-04-27 16:00:11+00:00

0:57:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2977/step1-simulation-ip-172-31-40-253-31940-job20924/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20912

2940

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 15:00:29+00:00

2019-04-27 15:02:20+00:00

0:01:51

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20898

2978

aido2-LFV-sim-validation

Baseline-IL-logs-tensorflow

step1-simulation

host-error

aido2-LFVI-sim-validation

2019-04-27 14:38:45+00:00

2019-04-27 15:00:08+00:00

0:21:23

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2978/step1-simulation-ip-172-31-40-253-31940-job20898/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20861

3103

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 14:00:32+00:00

2019-04-27 14:38:04+00:00

0:37:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.551236408509612
survival_time_median	14.950000000000076
deviation-center-line_median	0.47156794744277114
in-drivable-lane_median	5.350000000000065

other stats

agent_compute-ego_max	0.22346779346466064
agent_compute-ego_mean	0.21582503411867332
agent_compute-ego_median	0.21534524917602535
agent_compute-ego_min	0.20949627318472233
deviation-center-line_max	1.0555673288528404
deviation-center-line_mean	0.5926082252202004
deviation-center-line_min	0.4414497543601706
deviation-heading_max	3.401513026590721
deviation-heading_mean	2.467482299721023
deviation-heading_median	2.258145386685143
deviation-heading_min	2.1466206532718077
driven_any_max	0.9578470875387988
driven_any_mean	0.8967703244833876
driven_any_median	0.9251134358111728
driven_any_min	0.8186880336538734
driven_lanedir_consec_max	0.9195204252621296
driven_lanedir_consec_mean	0.5935964235828395
driven_lanedir_consec_min	0.44411227075643867
driven_lanedir_max	0.9195204252621296
driven_lanedir_mean	0.5936477823710558
driven_lanedir_median	0.551236408509612
driven_lanedir_min	0.44411227075643867
in-drivable-lane_max	5.650000000000072
in-drivable-lane_mean	4.190000000000053
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.9251134358111728, "sim_physics": 0.2066840640703837, "survival_time": 14.950000000000076, "driven_lanedir": 0.551236408509612, "sim_render-ego": 0.064282120068868, "in-drivable-lane": 5.600000000000063, "agent_compute-ego": 0.22346779346466064, "deviation-heading": 2.1466206532718077, "set_robot_commands": 0.09878544171651205, "deviation-center-line": 1.0555673288528404, "driven_lanedir_consec": 0.551236408509612, "sim_compute_sim_state": 0.04042999505996704, "sim_compute_performance-ego": 0.06988980452219645, "sim_compute_robot_state-ego": 0.07616305907567342, "sim_compute_robot_state-npc0": 0.07131200551986694, "sim_compute_robot_state-npc1": 0.07213663578033447, "sim_compute_robot_state-npc2": 0.07119534571965536, "sim_compute_robot_state-npc3": 0.07142783323923747}, "udem1-1-0": {"driven_any": 0.9578470875387988, "sim_physics": 0.1882398843765259, "survival_time": 14.950000000000076, "driven_lanedir": 0.6002533665434839, "sim_render-ego": 0.061684536139170326, "in-drivable-lane": 4.350000000000062, "agent_compute-ego": 0.2167030588785807, "deviation-heading": 3.401513026590721, "set_robot_commands": 0.0936846661567688, "deviation-center-line": 0.4414497543601706, "driven_lanedir_consec": 0.5999965726024024, "sim_compute_sim_state": 0.038801095485687255, "sim_compute_performance-ego": 0.06664458751678466, "sim_compute_robot_state-ego": 0.07331254323323567, "sim_compute_robot_state-npc0": 0.0679104765256246, "sim_compute_robot_state-npc1": 0.06775281111399332, "sim_compute_robot_state-npc2": 0.06831355015436809, "sim_compute_robot_state-npc3": 0.0687170926729838}, "udem1-2-0": {"driven_any": 0.8186880336538734, "sim_physics": 0.1877033673226833, "survival_time": 12.800000000000049, "driven_lanedir": 0.44411227075643867, "sim_render-ego": 0.06209773477166891, "in-drivable-lane": 5.350000000000065, "agent_compute-ego": 0.2141127958893776, "deviation-heading": 2.306441015345717, "set_robot_commands": 0.09206917323172092, "deviation-center-line": 0.4653912003434102, "driven_lanedir_consec": 0.44411227075643867, "sim_compute_sim_state": 0.038616119883954525, "sim_compute_performance-ego": 0.06871829554438591, "sim_compute_robot_state-ego": 0.07206834387034178, "sim_compute_robot_state-npc0": 0.06670946720987558, "sim_compute_robot_state-npc1": 0.06764774397015572, "sim_compute_robot_state-npc2": 0.06836870033293962, "sim_compute_robot_state-npc3": 0.06875450443476439}, "udem1-3-0": {"driven_any": 0.8497605530699448, "sim_physics": 0.19535791379100872, "survival_time": 13.250000000000052, "driven_lanedir": 0.45311644078361457, "sim_render-ego": 0.05965682695496757, "in-drivable-lane": 5.650000000000072, "agent_compute-ego": 0.20949627318472233, "deviation-heading": 2.258145386685143, "set_robot_commands": 0.09175824759141454, "deviation-center-line": 0.47156794744277114, "driven_lanedir_consec": 0.45311644078361457, "sim_compute_sim_state": 0.03816010547134111, "sim_compute_performance-ego": 0.06694279706703042, "sim_compute_robot_state-ego": 0.07130917783053416, "sim_compute_robot_state-npc0": 0.06645698907240381, "sim_compute_robot_state-npc1": 0.06633713290376483, "sim_compute_robot_state-npc2": 0.06726478630641722, "sim_compute_robot_state-npc3": 0.06685360782551315}, "udem1-4-0": {"driven_any": 0.9324425123431485, "sim_physics": 0.18546229600906372, "survival_time": 14.950000000000076, "driven_lanedir": 0.9195204252621296, "sim_render-ego": 0.06096208731333415, "in-drivable-lane": 0, "agent_compute-ego": 0.21534524917602535, "deviation-heading": 2.224691416711726, "set_robot_commands": 0.09264607191085816, "deviation-center-line": 0.5290648951018102, "driven_lanedir_consec": 0.9195204252621296, "sim_compute_sim_state": 0.03850928783416748, "sim_compute_performance-ego": 0.06801297108332316, "sim_compute_robot_state-ego": 0.07280632416407268, "sim_compute_robot_state-npc0": 0.06863005320231119, "sim_compute_robot_state-npc1": 0.06677362283070883, "sim_compute_robot_state-npc2": 0.06662051280339559, "sim_compute_robot_state-npc3": 0.06657703797022502}}
set_robot_commands_max	0.09878544171651205
set_robot_commands_mean	0.0937887201214549
set_robot_commands_median	0.09264607191085816
set_robot_commands_min	0.09175824759141454
sim_compute_performance-ego_max	0.06988980452219645
sim_compute_performance-ego_mean	0.06804169114674412
sim_compute_performance-ego_median	0.06801297108332316
sim_compute_performance-ego_min	0.06664458751678466
sim_compute_robot_state-ego_max	0.07616305907567342
sim_compute_robot_state-ego_mean	0.07313188963477155
sim_compute_robot_state-ego_median	0.07280632416407268
sim_compute_robot_state-ego_min	0.07130917783053416
sim_compute_robot_state-npc0_max	0.07131200551986694
sim_compute_robot_state-npc0_mean	0.06820379830601643
sim_compute_robot_state-npc0_median	0.0679104765256246
sim_compute_robot_state-npc0_min	0.06645698907240381
sim_compute_robot_state-npc1_max	0.07213663578033447
sim_compute_robot_state-npc1_mean	0.06812958931979143
sim_compute_robot_state-npc1_median	0.06764774397015572
sim_compute_robot_state-npc1_min	0.06633713290376483
sim_compute_robot_state-npc2_max	0.07119534571965536
sim_compute_robot_state-npc2_mean	0.06835257906335518
sim_compute_robot_state-npc2_median	0.06831355015436809
sim_compute_robot_state-npc2_min	0.06662051280339559
sim_compute_robot_state-npc3_max	0.07142783323923747
sim_compute_robot_state-npc3_mean	0.06846601522854476
sim_compute_robot_state-npc3_median	0.0687170926729838
sim_compute_robot_state-npc3_min	0.06657703797022502
sim_compute_sim_state_max	0.04042999505996704
sim_compute_sim_state_mean	0.03890332074702348
sim_compute_sim_state_median	0.038616119883954525
sim_compute_sim_state_min	0.03816010547134111
sim_physics_max	0.2066840640703837
sim_physics_mean	0.19268950511393307
sim_physics_median	0.1882398843765259
sim_physics_min	0.18546229600906372
sim_render-ego_max	0.064282120068868
sim_render-ego_mean	0.06173666104960179
sim_render-ego_median	0.061684536139170326
sim_render-ego_min	0.05965682695496757
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.180000000000067
survival_time_min	12.800000000000049

No reset possible

20823

2711

Rami Al-Naim 🇷🇺

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 13:17:50+00:00

2019-04-27 14:00:11+00:00

0:42:21

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2711/step1-simulation-ip-172-31-40-253-31940-job20823/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20813

2904

aido2-LFV-sim-validation

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 13:01:25+00:00

2019-04-27 13:17:21+00:00

0:15:56

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6700870333073428
survival_time_median	6.0499999999999865
deviation-center-line_median	0.2291733220008849
in-drivable-lane_median	1.649999999999994

other stats

agent_compute-ego_max	0.22227020099245268
agent_compute-ego_mean	0.21414290439673725
agent_compute-ego_median	0.2199107024295271
agent_compute-ego_min	0.20365149707080207
deviation-center-line_max	0.3285351272048123
deviation-center-line_mean	0.25265706851841674
deviation-center-line_min	0.17574121398722137
deviation-heading_max	0.9812538907367038
deviation-heading_mean	0.8757069805732627
deviation-heading_median	0.8947395634406148
deviation-heading_min	0.6557739565090189
driven_any_max	1.5838733491242674
driven_any_mean	0.9951242780644832
driven_any_median	0.9986182823858216
driven_any_min	0.369687716804779
driven_lanedir_consec_max	1.2192384917986678
driven_lanedir_consec_mean	0.776208889491538
driven_lanedir_consec_min	0.3564624794519041
driven_lanedir_max	1.2192384917986678
driven_lanedir_mean	0.776208889491538
driven_lanedir_median	0.6700870333073428
driven_lanedir_min	0.3564624794519041
in-drivable-lane_max	2.000000000000017
in-drivable-lane_mean	1.1100000000000054
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9986182823858216, "sim_physics": 0.175620660308964, "survival_time": 6.0499999999999865, "driven_lanedir": 0.6700870333073428, "sim_render-ego": 0.06149957396767356, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.2199107024295271, "deviation-heading": 0.9581668642592924, "set_robot_commands": 0.09039642002956928, "deviation-center-line": 0.2291733220008849, "driven_lanedir_consec": 0.6700870333073428, "sim_compute_sim_state": 0.03791502684601082, "sim_compute_performance-ego": 0.06572619745554018, "sim_compute_robot_state-ego": 0.07227590655492357, "sim_compute_robot_state-npc0": 0.06653588665418389, "sim_compute_robot_state-npc1": 0.06546940685303743, "sim_compute_robot_state-npc2": 0.06839884411204945, "sim_compute_robot_state-npc3": 0.0675948946929175}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4483038440409288, "sim_physics": 0.18375877676338984, "survival_time": 2.8999999999999977, "driven_lanedir": 0.42280807645170926, "sim_render-ego": 0.06095784697039374, "in-drivable-lane": 0, "agent_compute-ego": 0.22227020099245268, "deviation-heading": 0.9812538907367038, "set_robot_commands": 0.09468694390921756, "deviation-center-line": 0.20785734975661263, "driven_lanedir_consec": 0.42280807645170926, "sim_compute_sim_state": 0.03767383920735326, "sim_compute_performance-ego": 0.06920504158940809, "sim_compute_robot_state-ego": 0.07368733965117356, "sim_compute_robot_state-npc0": 0.06954881651648159, "sim_compute_robot_state-npc1": 0.06813166881429739, "sim_compute_robot_state-npc2": 0.07030805637096536, "sim_compute_robot_state-npc3": 0.06653129232340846}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5838733491242674, "sim_physics": 0.1600181409653197, "survival_time": 9.4, "driven_lanedir": 1.2124483664480663, "sim_render-ego": 0.06159956531321749, "in-drivable-lane": 2.000000000000017, "agent_compute-ego": 0.2208316389550554, "deviation-heading": 0.8886006279206836, "set_robot_commands": 0.0908346341011372, "deviation-center-line": 0.3285351272048123, "driven_lanedir_consec": 1.2124483664480663, "sim_compute_sim_state": 0.03891814008672187, "sim_compute_performance-ego": 0.06567041163748884, "sim_compute_robot_state-ego": 0.07088014673679432, "sim_compute_robot_state-npc0": 0.0678011343834248, "sim_compute_robot_state-npc1": 0.06800157846288478, "sim_compute_robot_state-npc2": 0.06835064609000023, "sim_compute_robot_state-npc3": 0.06695420184033982}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5751381979666186, "sim_physics": 0.15135593210312134, "survival_time": 9.349999999999998, "driven_lanedir": 1.2192384917986678, "sim_render-ego": 0.055104788611916936, "in-drivable-lane": 1.9000000000000163, "agent_compute-ego": 0.20365149707080207, "deviation-heading": 0.8947395634406148, "set_robot_commands": 0.08102538113925546, "deviation-center-line": 0.32197832964255246, "driven_lanedir_consec": 1.2192384917986678, "sim_compute_sim_state": 0.03355357736189735, "sim_compute_performance-ego": 0.06129424584740623, "sim_compute_robot_state-ego": 0.06432412779904942, "sim_compute_robot_state-npc0": 0.06061371252498525, "sim_compute_robot_state-npc1": 0.06096813895485618, "sim_compute_robot_state-npc2": 0.06128486337508747, "sim_compute_robot_state-npc3": 0.06117230558140393}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.369687716804779, "sim_physics": 0.155179889834657, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3564624794519041, "sim_render-ego": 0.05859820210203832, "in-drivable-lane": 0, "agent_compute-ego": 0.2040504825358488, "deviation-heading": 0.6557739565090189, "set_robot_commands": 0.08418310904989437, "deviation-center-line": 0.17574121398722137, "driven_lanedir_consec": 0.3564624794519041, "sim_compute_sim_state": 0.03577399253845215, "sim_compute_performance-ego": 0.061764945789259305, "sim_compute_robot_state-ego": 0.06531334409908372, "sim_compute_robot_state-npc0": 0.06256858183413136, "sim_compute_robot_state-npc1": 0.06220293045043945, "sim_compute_robot_state-npc2": 0.06396088794786103, "sim_compute_robot_state-npc3": 0.059999222658118426}}
set_robot_commands_max	0.09468694390921756
set_robot_commands_mean	0.08822529764581477
set_robot_commands_median	0.09039642002956928
set_robot_commands_min	0.08102538113925546
sim_compute_performance-ego_max	0.06920504158940809
sim_compute_performance-ego_mean	0.06473216846382052
sim_compute_performance-ego_median	0.06567041163748884
sim_compute_performance-ego_min	0.06129424584740623
sim_compute_robot_state-ego_max	0.07368733965117356
sim_compute_robot_state-ego_mean	0.06929617296820492
sim_compute_robot_state-ego_median	0.07088014673679432
sim_compute_robot_state-ego_min	0.06432412779904942
sim_compute_robot_state-npc0_max	0.06954881651648159
sim_compute_robot_state-npc0_mean	0.0654136263826414
sim_compute_robot_state-npc0_median	0.06653588665418389
sim_compute_robot_state-npc0_min	0.06061371252498525
sim_compute_robot_state-npc1_max	0.06813166881429739
sim_compute_robot_state-npc1_mean	0.06495474470710305
sim_compute_robot_state-npc1_median	0.06546940685303743
sim_compute_robot_state-npc1_min	0.06096813895485618
sim_compute_robot_state-npc2_max	0.07030805637096536
sim_compute_robot_state-npc2_mean	0.06646065957919271
sim_compute_robot_state-npc2_median	0.06835064609000023
sim_compute_robot_state-npc2_min	0.06128486337508747
sim_compute_robot_state-npc3_max	0.0675948946929175
sim_compute_robot_state-npc3_mean	0.06445038341923762
sim_compute_robot_state-npc3_median	0.06653129232340846
sim_compute_robot_state-npc3_min	0.059999222658118426
sim_compute_sim_state_max	0.03891814008672187
sim_compute_sim_state_mean	0.03676691520808709
sim_compute_sim_state_median	0.03767383920735326
sim_compute_sim_state_min	0.03355357736189735
sim_physics_max	0.18375877676338984
sim_physics_mean	0.1651866799950904
sim_physics_median	0.1600181409653197
sim_physics_min	0.15135593210312134
sim_render-ego_max	0.06159956531321749
sim_render-ego_mean	0.05955199539304801
sim_render-ego_median	0.06095784697039374
sim_render-ego_min	0.055104788611916936
simulation-passed	1
survival_time_max	9.4
survival_time_mean	6.029999999999996
survival_time_min	2.4499999999999993

No reset possible

20788

3064

Angel Woo 🇭🇰

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 12:04:24+00:00

2019-04-27 13:00:09+00:00

0:55:45

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3064/step1-simulation-ip-172-31-40-253-31940-job20788/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20787

2940

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 12:03:12+00:00

2019-04-27 12:03:59+00:00

0:00:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20775

2936

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 12:00:33+00:00

2019-04-27 12:03:05+00:00

0:02:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20765

2981

Baseline-IL-logs-tensorflow

step1-simulation

host-error