Evaluator 839

step1-simulation

success

2019-05-06 12:08:18+00:00

2019-05-06 12:34:58+00:00

0:26:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6537162971975778
survival_time_median	2.5999999999999988
deviation-center-line_median	0.14884708769804722
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.16458669251310612
agent_compute-ego_mean	0.1383677386158769
agent_compute-ego_median	0.13148507287230674
agent_compute-ego_min	0.11899121908041146
deviation-center-line_max	0.5141120095458062
deviation-center-line_mean	0.1769000227005324
deviation-center-line_min	0.06216029860587694
deviation-heading_max	1.9929437250081896
deviation-heading_mean	0.692977823395608
deviation-heading_median	0.4928440244444201
deviation-heading_min	0.24234723632033853
driven_any_max	3.5343244022418343
driven_any_mean	1.3470385992234175
driven_any_median	1.001633421251194
driven_any_min	0.3412551960104244
driven_lanedir_consec_max	2.494308053441959
driven_lanedir_consec_mean	0.881391085527715
driven_lanedir_consec_min	0.3199180625488627
driven_lanedir_max	2.494308053441959
driven_lanedir_mean	0.8962528018383226
driven_lanedir_median	0.7206363324756615
driven_lanedir_min	0.3199180625488627
in-drivable-lane_max	3.549999999999991
in-drivable-lane_mean	0.839999999999998
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.15356114846241625, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.04850250256212451, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.13148507287230674, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.07256537751306462, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.029763653308530397, "sim_compute_performance-ego": 0.05307169202007825, "sim_compute_robot_state-ego": 0.05656090265587915, "sim_compute_robot_state-npc0": 0.05607290509380872, "sim_compute_robot_state-npc1": 0.05414687832699546, "sim_compute_robot_state-npc2": 0.05316772642014902, "sim_compute_robot_state-npc3": 0.0537935932980308}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.1901072689465114, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.05605919872011457, "in-drivable-lane": 0, "agent_compute-ego": 0.15019951547895158, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09515305076326644, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03720928089959281, "sim_compute_performance-ego": 0.060739951474326, "sim_compute_robot_state-ego": 0.07033430678503853, "sim_compute_robot_state-npc0": 0.06825358527047294, "sim_compute_robot_state-npc1": 0.06700550658362252, "sim_compute_robot_state-npc2": 0.06455216237476893, "sim_compute_robot_state-npc3": 0.06630158424377441}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19368336270156417, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.060617058022508344, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14916261654455684, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.09413067345480317, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.039101380746341445, "sim_compute_performance-ego": 0.06568756149810495, "sim_compute_robot_state-ego": 0.07147599192498957, "sim_compute_robot_state-npc0": 0.06818219064508826, "sim_compute_robot_state-npc1": 0.06919862228689842, "sim_compute_robot_state-npc2": 0.06736742640004574, "sim_compute_robot_state-npc3": 0.0795851888008488}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.21915950377782187, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0654428352912267, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16155290603637695, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0994967172543208, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04342656830946604, "sim_compute_performance-ego": 0.0705889364083608, "sim_compute_robot_state-ego": 0.07802951335906982, "sim_compute_robot_state-npc0": 0.07211849093437195, "sim_compute_robot_state-npc1": 0.07523711522420247, "sim_compute_robot_state-npc2": 0.07349892954031627, "sim_compute_robot_state-npc3": 0.07365049918492635}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.22721052169799805, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06421864600408644, "in-drivable-lane": 0, "agent_compute-ego": 0.15867565927051364, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10331374122982934, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04166572434561593, "sim_compute_performance-ego": 0.07613397779918853, "sim_compute_robot_state-ego": 0.09300808679489862, "sim_compute_robot_state-npc0": 0.07380982807704381, "sim_compute_robot_state-npc1": 0.06959260077703566, "sim_compute_robot_state-npc2": 0.07213786670139857, "sim_compute_robot_state-npc3": 0.06790887741815477}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.2145176147986315, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06617130348068512, "in-drivable-lane": 2, "agent_compute-ego": 0.16458669251310612, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10143183376974688, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.0403886897835189, "sim_compute_performance-ego": 0.07423412014624316, "sim_compute_robot_state-ego": 0.08135398704848604, "sim_compute_robot_state-npc0": 0.07207230465140885, "sim_compute_robot_state-npc1": 0.07190986022263944, "sim_compute_robot_state-npc2": 0.0726026846263223, "sim_compute_robot_state-npc3": 0.07304053677770192}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2209556519406513, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06789539392712046, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1643588820707451, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10106626066189368, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.039850397017395615, "sim_compute_performance-ego": 0.0720057302308314, "sim_compute_robot_state-ego": 0.07892742897700337, "sim_compute_robot_state-npc0": 0.07136991417523726, "sim_compute_robot_state-npc1": 0.07204715719500791, "sim_compute_robot_state-npc2": 0.07256988414282937, "sim_compute_robot_state-npc3": 0.07155458904007106}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.16035030364990235, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.047998781204223635, "in-drivable-lane": 0, "agent_compute-ego": 0.1200291395187378, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07351027011871338, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.02942636013031006, "sim_compute_performance-ego": 0.053659768104553224, "sim_compute_robot_state-ego": 0.05627788066864014, "sim_compute_robot_state-npc0": 0.06059577941894531, "sim_compute_robot_state-npc1": 0.05934506893157959, "sim_compute_robot_state-npc2": 0.05627666473388672, "sim_compute_robot_state-npc3": 0.05552201747894287}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.14533544503725493, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05076328149208656, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.11899121908041146, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.07012033004027146, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.02973765593308669, "sim_compute_performance-ego": 0.05709402377788837, "sim_compute_robot_state-ego": 0.06086420095883883, "sim_compute_robot_state-npc0": 0.04971206188201904, "sim_compute_robot_state-npc1": 0.05087323372180645, "sim_compute_robot_state-npc2": 0.05325869872019841, "sim_compute_robot_state-npc3": 0.05365430391751803}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2007847290772658, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.056449477489177995, "in-drivable-lane": 0, "agent_compute-ego": 0.13671179918142465, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.08101522005521335, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.03485220212202806, "sim_compute_performance-ego": 0.05974221229553223, "sim_compute_robot_state-ego": 0.0660091180067796, "sim_compute_robot_state-npc0": 0.06166095917041485, "sim_compute_robot_state-npc1": 0.059765247198251575, "sim_compute_robot_state-npc2": 0.060506224632263184, "sim_compute_robot_state-npc3": 0.058503765326279863}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.16689662499861282, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.05267207189039751, "in-drivable-lane": 0, "agent_compute-ego": 0.1277616024017334, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07679200172424316, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03495484048669988, "sim_compute_performance-ego": 0.058754650029269134, "sim_compute_robot_state-ego": 0.05911525813016025, "sim_compute_robot_state-npc0": 0.057421055707064544, "sim_compute_robot_state-npc1": 0.0572438890283758, "sim_compute_robot_state-npc2": 0.05287300456653942, "sim_compute_robot_state-npc3": 0.05545972694050182}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.148860182762146, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.04923426628112793, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.12057457447052002, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.07156298637390136, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03260821342468262, "sim_compute_performance-ego": 0.05408650398254394, "sim_compute_robot_state-ego": 0.05588726043701172, "sim_compute_robot_state-npc0": 0.05413423538208008, "sim_compute_robot_state-npc1": 0.05438791751861572, "sim_compute_robot_state-npc2": 0.053978867530822754, "sim_compute_robot_state-npc3": 0.05694400310516357}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.15301526353714315, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.04946806836635508, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.12358971605909631, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.07075779488746156, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.031161942380539914, "sim_compute_performance-ego": 0.05556354624159793, "sim_compute_robot_state-ego": 0.05865838679861515, "sim_compute_robot_state-npc0": 0.05271730778065133, "sim_compute_robot_state-npc1": 0.051700274995032776, "sim_compute_robot_state-npc2": 0.05187415062113011, "sim_compute_robot_state-npc3": 0.05312929001260311}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1497400403022766, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.04926909850193904, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11992367872825035, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0709080696105957, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.030259343293996956, "sim_compute_performance-ego": 0.05338733012859638, "sim_compute_robot_state-ego": 0.05446663728127113, "sim_compute_robot_state-npc0": 0.05530620996768658, "sim_compute_robot_state-npc1": 0.055048855451437145, "sim_compute_robot_state-npc2": 0.053747209218832165, "sim_compute_robot_state-npc3": 0.054312715163597695}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1616712592896961, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.05238108862014044, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1279130050114223, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.07962374687194824, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.032149096897670204, "sim_compute_performance-ego": 0.05638762428646995, "sim_compute_robot_state-ego": 0.06057501747494652, "sim_compute_robot_state-npc0": 0.05711510294959659, "sim_compute_robot_state-npc1": 0.05687929789225261, "sim_compute_robot_state-npc2": 0.05715569541567848, "sim_compute_robot_state-npc3": 0.0569797606695266}}
set_robot_commands_max	0.10331374122982934
set_robot_commands_mean	0.08409653828861822
set_robot_commands_median	0.07962374687194824
set_robot_commands_min	0.07012033004027146
sim_compute_performance-ego_max	0.07613397779918853
sim_compute_performance-ego_mean	0.06140917522823896
sim_compute_performance-ego_median	0.058754650029269134
sim_compute_performance-ego_min	0.05307169202007825
sim_compute_robot_state-ego_max	0.09300808679489862
sim_compute_robot_state-ego_mean	0.06676959848677523
sim_compute_robot_state-ego_median	0.06086420095883883
sim_compute_robot_state-ego_min	0.05446663728127113
sim_compute_robot_state-npc0_max	0.07380982807704381
sim_compute_robot_state-npc0_mean	0.06203612874039267
sim_compute_robot_state-npc0_median	0.06059577941894531
sim_compute_robot_state-npc0_min	0.04971206188201904
sim_compute_robot_state-npc1_max	0.07523711522420247
sim_compute_robot_state-npc1_mean	0.06162543502358357
sim_compute_robot_state-npc1_median	0.05934506893157959
sim_compute_robot_state-npc1_min	0.05087323372180645
sim_compute_robot_state-npc2_max	0.07349892954031627
sim_compute_robot_state-npc2_mean	0.0610378130430121
sim_compute_robot_state-npc2_median	0.05715569541567848
sim_compute_robot_state-npc2_min	0.05187415062113011
sim_compute_robot_state-npc3_max	0.0795851888008488
sim_compute_robot_state-npc3_mean	0.062022696758509445
sim_compute_robot_state-npc3_median	0.0569797606695266
sim_compute_robot_state-npc3_min	0.05312929001260311
sim_compute_sim_state_max	0.04342656830946604
sim_compute_sim_state_mean	0.0351036899386317
sim_compute_sim_state_median	0.03485220212202806
sim_compute_sim_state_min	0.02942636013031006
sim_physics_max	0.22721052169799805
sim_physics_mean	0.18038992806532617
sim_physics_median	0.16689662499861282
sim_physics_min	0.14533544503725493
sim_render-ego_max	0.06789539392712046
sim_render-ego_mean	0.05580953812355429
sim_render-ego_median	0.05267207189039751
sim_render-ego_min	0.047998781204223635
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	3.3333333333333286
survival_time_min	1.0500000000000005

No reset possible

21479

3174

Chao-Chun Hsu 🇹🇼

challenge-aido_LF-template-random

step1-simulation

success

2019-05-03 06:08:19+00:00

2019-05-03 06:11:45+00:00

0:03:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.0954495334625244
agent_compute-ego_mean	0.09164842999853
agent_compute-ego_median	0.09086707573902758
agent_compute-ego_min	0.08977671022768374
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.059890566048798735, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03668539612381547, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08977671022768374, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05597106615702311, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.0237705045276218, "sim_compute_performance-ego": 0.04059379189102738, "sim_compute_robot_state-ego": 0.04210880950645164}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05772688342075722, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03701168883080576, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09074290593465167, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.056571460237690045, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.023992183161716835, "sim_compute_performance-ego": 0.04074990048128016, "sim_compute_robot_state-ego": 0.04183003014209224}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06564837343552533, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0376592944650089, "in-drivable-lane": 0, "agent_compute-ego": 0.09140592462876264, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.057659485760857075, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.024462054757510916, "sim_compute_performance-ego": 0.04066259720746208, "sim_compute_robot_state-ego": 0.04371091898749856}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.0648917293548584, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03720344543457031, "in-drivable-lane": 0, "agent_compute-ego": 0.0954495334625244, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05698627471923828, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.023504877090454103, "sim_compute_performance-ego": 0.041404218673706056, "sim_compute_robot_state-ego": 0.04301974296569824}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05775360819659656, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03903944884674459, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.09086707573902758, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05691375913499277, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.024373507197899155, "sim_compute_performance-ego": 0.04035836835450764, "sim_compute_robot_state-ego": 0.04326855985424186}}
set_robot_commands_max	0.057659485760857075
set_robot_commands_mean	0.056820409201960256
set_robot_commands_median	0.05691375913499277
set_robot_commands_min	0.05597106615702311
sim_compute_performance-ego_max	0.041404218673706056
sim_compute_performance-ego_mean	0.040753775321596665
sim_compute_performance-ego_median	0.04066259720746208
sim_compute_performance-ego_min	0.04035836835450764
sim_compute_robot_state-ego_max	0.04371091898749856
sim_compute_robot_state-ego_mean	0.04278761229119651
sim_compute_robot_state-ego_median	0.04301974296569824
sim_compute_robot_state-ego_min	0.04183003014209224
sim_compute_sim_state_max	0.024462054757510916
sim_compute_sim_state_mean	0.024020625347040563
sim_compute_sim_state_median	0.023992183161716835
sim_compute_sim_state_min	0.023504877090454103
sim_physics_max	0.06564837343552533
sim_physics_mean	0.061182232091307256
sim_physics_median	0.059890566048798735
sim_physics_min	0.05772688342075722
sim_render-ego_max	0.03903944884674459
sim_render-ego_mean	0.037519854740189006
sim_render-ego_median	0.03720344543457031
sim_render-ego_min	0.03668539612381547
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21475

3170

Chao-Chun Hsu 🇹🇼

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-03 05:35:41+00:00

2019-05-03 05:35:55+00:00

0:00:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10820898661817208
error_L2	0.017990920724967146

No reset possible

21474

3169

SIN KIAT LIM 🇲🇾

PredictorLast

aido2-PRED

step1-simulation

success

2019-05-03 05:34:26+00:00

2019-05-03 05:35:00+00:00

0:00:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.115480846555329
error_L2	0.01882082534776563

No reset possible

21413

3117

Peter Almasi 🇭🇺

Baseline solution using reinforcement learning

step1-simulation

success

2019-04-29 06:00:58+00:00

2019-04-29 06:16:00+00:00

0:15:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.6316485002549197
survival_time_median	9.249999999999996
deviation-center-line_median	0.3144037913438675
in-drivable-lane_median	0.2499999999999991

other stats

agent_compute-ego_max	0.22028698205947875
agent_compute-ego_mean	0.21173413994406465
agent_compute-ego_median	0.2112418802579244
agent_compute-ego_min	0.2025050719579061
deviation-center-line_max	1.1384414920399633
deviation-center-line_mean	0.5241819404856509
deviation-center-line_min	0.12464062827752376
deviation-heading_max	4.787043212582162
deviation-heading_mean	2.2687470361996662
deviation-heading_median	1.6966072301947612
deviation-heading_min	0.46621495190718226
driven_any_max	3.460259580484497
driven_any_mean	1.915707224344509
driven_any_median	2.1947239053452328
driven_any_min	0.25724654186193235
driven_lanedir_consec_max	3.274785725985171
driven_lanedir_consec_mean	1.675317683815107
driven_lanedir_consec_min	0.21462162514390928
driven_lanedir_max	3.274785725985171
driven_lanedir_mean	1.675317683815107
driven_lanedir_median	1.6316485002549197
driven_lanedir_min	0.21462162514390928
in-drivable-lane_max	2.050000000000014
in-drivable-lane_mean	0.6200000000000021
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1947239053452328, "sim_physics": 0.08971346777838629, "survival_time": 9.249999999999996, "driven_lanedir": 1.6316485002549197, "sim_render-ego": 0.05109705796112885, "in-drivable-lane": 2.050000000000014, "agent_compute-ego": 0.2109307611310804, "deviation-heading": 1.6966072301947612, "set_robot_commands": 0.07333871996080553, "deviation-center-line": 0.3144037913438675, "driven_lanedir_consec": 1.6316485002549197, "sim_compute_sim_state": 0.031936275636827625, "sim_compute_performance-ego": 0.05614273225938952, "sim_compute_robot_state-ego": 0.05870533376126676}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.30731368428282, "sim_physics": 0.0882560141881307, "survival_time": 14.950000000000076, "driven_lanedir": 2.9400446870970796, "sim_render-ego": 0.051405066649119056, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.22028698205947875, "deviation-heading": 4.787043212582162, "set_robot_commands": 0.0768282167116801, "deviation-center-line": 0.9050984525391714, "driven_lanedir_consec": 2.9400446870970796, "sim_compute_sim_state": 0.032380878925323486, "sim_compute_performance-ego": 0.05610439697901408, "sim_compute_robot_state-ego": 0.05949689149856567}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.25724654186193235, "sim_physics": 0.08383040428161621, "survival_time": 1.5000000000000009, "driven_lanedir": 0.21462162514390928, "sim_render-ego": 0.04667792320251465, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.2025050719579061, "deviation-heading": 0.46621495190718226, "set_robot_commands": 0.07380014260609945, "deviation-center-line": 0.13832533822772883, "driven_lanedir_consec": 0.21462162514390928, "sim_compute_sim_state": 0.032613126436869304, "sim_compute_performance-ego": 0.05455749829610189, "sim_compute_robot_state-ego": 0.05643620491027832}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3589924097480619, "sim_physics": 0.09595820231315418, "survival_time": 1.950000000000001, "driven_lanedir": 0.3154878805944552, "sim_render-ego": 0.050993711520463995, "in-drivable-lane": 0, "agent_compute-ego": 0.21370600431393355, "deviation-heading": 0.8640194883211836, "set_robot_commands": 0.07289700630383614, "deviation-center-line": 0.12464062827752376, "driven_lanedir_consec": 0.3154878805944552, "sim_compute_sim_state": 0.032826717083270736, "sim_compute_performance-ego": 0.058411806057661005, "sim_compute_robot_state-ego": 0.05994036870125013}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.460259580484497, "sim_physics": 0.08786064942677815, "survival_time": 14.950000000000076, "driven_lanedir": 3.274785725985171, "sim_render-ego": 0.0489134939511617, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.2112418802579244, "deviation-heading": 3.529850297993042, "set_robot_commands": 0.07376131375630697, "deviation-center-line": 1.1384414920399633, "driven_lanedir_consec": 3.274785725985171, "sim_compute_sim_state": 0.03098081032435099, "sim_compute_performance-ego": 0.053829812208811445, "sim_compute_robot_state-ego": 0.05814148585001628}}
set_robot_commands_max	0.0768282167116801
set_robot_commands_mean	0.07412507986774562
set_robot_commands_median	0.07376131375630697
set_robot_commands_min	0.07289700630383614
sim_compute_performance-ego_max	0.058411806057661005
sim_compute_performance-ego_mean	0.055809249160195584
sim_compute_performance-ego_median	0.05610439697901408
sim_compute_performance-ego_min	0.053829812208811445
sim_compute_robot_state-ego_max	0.05994036870125013
sim_compute_robot_state-ego_mean	0.05854405694427543
sim_compute_robot_state-ego_median	0.05870533376126676
sim_compute_robot_state-ego_min	0.05643620491027832
sim_compute_sim_state_max	0.032826717083270736
sim_compute_sim_state_mean	0.03214756168132843
sim_compute_sim_state_median	0.032380878925323486
sim_compute_sim_state_min	0.03098081032435099
sim_physics_max	0.09595820231315418
sim_physics_mean	0.0891237475976131
sim_physics_median	0.0882560141881307
sim_physics_min	0.08383040428161621
sim_render-ego_max	0.051405066649119056
sim_render-ego_mean	0.049817450656877656
sim_render-ego_median	0.050993711520463995
sim_render-ego_min	0.04667792320251465
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.52000000000003
survival_time_min	1.5000000000000009

No reset possible

21397

2450

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 04:00:37+00:00

2019-04-28 05:00:03+00:00

0:59:26

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2450/step1-simulation-ip-172-31-38-104-5376-job21397/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21389

2363

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-28 02:19:37+00:00

2019-04-28 02:25:47+00:00

0:06:10

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.13005513204193506
in-drivable-lane_median	0.29999999999999893

other stats

agent_compute-ego_max	0.15473787924822638
agent_compute-ego_mean	0.14606694701450323
agent_compute-ego_median	0.14338340759277343
agent_compute-ego_min	0.1383680596071131
deviation-center-line_max	0.2072381278624381
deviation-center-line_mean	0.13189395308989768
deviation-center-line_min	0.0788839760023766
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3206717506075888
deviation-heading_median	0.23606825392187256
deviation-heading_min	0.19401296908406307
driven_any_max	1.618214457700942
driven_any_mean	0.8613785859332687
driven_any_median	0.9933867744747804
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	0.8010406009604816
driven_lanedir_consec_mean	0.5597645764431625
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	0.8010406009604816
driven_lanedir_mean	0.5597645764431625
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.619999999999998
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11373500912277788, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06269825387884069, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14304468366834852, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09709948963589138, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04113104608323839, "sim_compute_performance-ego": 0.0699079919744421, "sim_compute_robot_state-ego": 0.0752418835957845}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12909866314308316, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06726770774990905, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15473787924822638, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.1108681454378016, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0435780169917088, "sim_compute_performance-ego": 0.07762805620829265, "sim_compute_robot_state-ego": 0.09360659356210746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1349496841430664, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06537701101864085, "in-drivable-lane": 0, "agent_compute-ego": 0.1383680596071131, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10496787463917452, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03685914768892176, "sim_compute_performance-ego": 0.07086948787464815, "sim_compute_robot_state-ego": 0.07537055015563965}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12941793441772462, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0668519401550293, "in-drivable-lane": 0, "agent_compute-ego": 0.14338340759277343, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09660685539245606, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.039673261642456055, "sim_compute_performance-ego": 0.0689106559753418, "sim_compute_robot_state-ego": 0.07416011810302735}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11880668507346624, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06507929669150823, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1508007049560547, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10485181023802938, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04099981996077526, "sim_compute_performance-ego": 0.07073571410360216, "sim_compute_robot_state-ego": 0.07883764218680467}}
set_robot_commands_max	0.1108681454378016
set_robot_commands_mean	0.1028788350686706
set_robot_commands_median	0.10485181023802938
set_robot_commands_min	0.09660685539245606
sim_compute_performance-ego_max	0.07762805620829265
sim_compute_performance-ego_mean	0.07161038122726537
sim_compute_performance-ego_median	0.07073571410360216
sim_compute_performance-ego_min	0.0689106559753418
sim_compute_robot_state-ego_max	0.09360659356210746
sim_compute_robot_state-ego_mean	0.07944335752067273
sim_compute_robot_state-ego_median	0.07537055015563965
sim_compute_robot_state-ego_min	0.07416011810302735
sim_compute_sim_state_max	0.0435780169917088
sim_compute_sim_state_mean	0.040448258473420054
sim_compute_sim_state_median	0.04099981996077526
sim_compute_sim_state_min	0.03685914768892176
sim_physics_max	0.1349496841430664
sim_physics_mean	0.12520159518002366
sim_physics_median	0.12909866314308316
sim_physics_min	0.11373500912277788
sim_render-ego_max	0.06726770774990905
sim_render-ego_mean	0.06545484189878563
sim_render-ego_median	0.06537701101864085
sim_render-ego_min	0.06269825387884069
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2599999999999985
survival_time_min	0.8500000000000002

No reset possible

21384

2362

Andrea Censi 🇨🇭

random_agent

step1-simulation

success

2019-04-28 02:00:57+00:00

2019-04-28 02:19:08+00:00

0:18:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.549999999999999
deviation-center-line_median	0.10099507669212504
in-drivable-lane_median	0.4499999999999984

other stats

agent_compute-ego_max	0.21304072274102104
agent_compute-ego_mean	0.14955416971319418
agent_compute-ego_median	0.14291026154342962
agent_compute-ego_min	0.1359099219827091
deviation-center-line_max	0.2838635700333795
deviation-center-line_mean	0.12786165368054708
deviation-center-line_min	0.07112529346797256
deviation-heading_max	0.5289022616823588
deviation-heading_mean	0.3391682685652287
deviation-heading_median	0.32928385103533875
deviation-heading_min	0.19401296908406307
driven_any_max	2.1706243860917107
driven_any_mean	0.9759490378276146
driven_any_median	1.0117660515775693
driven_any_min	0.23626560261560617
driven_lanedir_consec_max	1.919400421063832
driven_lanedir_consec_mean	0.6896171461819246
driven_lanedir_consec_min	0.2264965947033466
driven_lanedir_max	1.919400421063832
driven_lanedir_mean	0.6896171461819246
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.2264965947033466
in-drivable-lane_max	1.7999999999999936
in-drivable-lane_mean	0.5899999999999982
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17831339217998363, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.09099276419039126, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.21304072274102104, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.13636521056846335, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.05338951393410011, "sim_compute_performance-ego": 0.09825369605311642, "sim_compute_robot_state-ego": 0.1063794250841494}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.13983232367272472, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.07526411729700425, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16428105971392462, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.13007525836720185, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04628274020026712, "sim_compute_performance-ego": 0.08122214616513719, "sim_compute_robot_state-ego": 0.09435181524239336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13520158038419836, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06604207263273351, "in-drivable-lane": 0, "agent_compute-ego": 0.1423492431640625, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10821008682250977, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.043063808889950025, "sim_compute_performance-ego": 0.07393315259148092, "sim_compute_robot_state-ego": 0.0809616902295281}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.14397165298461914, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06343717575073242, "in-drivable-lane": 0, "agent_compute-ego": 0.1393827247619629, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1063614559173584, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.040581865310668944, "sim_compute_performance-ego": 0.07124069213867187, "sim_compute_robot_state-ego": 0.07948217391967774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11730893050568011, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06778149665156498, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14541329009623466, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.1009631911410561, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04054190237310868, "sim_compute_performance-ego": 0.07212470754792419, "sim_compute_robot_state-ego": 0.07869757278056085}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1202876616497429, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06647186376610581, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14291026154342962, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10072644389405544, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04083279687531141, "sim_compute_performance-ego": 0.070444647146731, "sim_compute_robot_state-ego": 0.07588321335461674}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.1214995767389025, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0634649395942688, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.14204732009342738, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10159686633518764, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04377096465655735, "sim_compute_performance-ego": 0.06945335865020752, "sim_compute_robot_state-ego": 0.07537587199892316}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.1476606868562244, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06749409721011207, "in-drivable-lane": 0, "agent_compute-ego": 0.15205537705194383, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10492688133603052, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04211438269842239, "sim_compute_performance-ego": 0.07488649232046944, "sim_compute_robot_state-ego": 0.08948089962913877}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13801713313086558, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06848909087100272, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14750075340270996, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1101388810044628, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04112963757272494, "sim_compute_performance-ego": 0.07593429694741459, "sim_compute_robot_state-ego": 0.09170360080266404}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.1288768551566384, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.07017536163330078, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.14841728643937543, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.1035115892236883, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.042457775636152786, "sim_compute_performance-ego": 0.07455999200994318, "sim_compute_robot_state-ego": 0.07785919796336781}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11878324174261712, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06655014954604112, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1404066054851978, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10093625799402016, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03987608637128558, "sim_compute_performance-ego": 0.06803778549293418, "sim_compute_robot_state-ego": 0.07663732380061955}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15096687419073923, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06894659996032715, "in-drivable-lane": 0, "agent_compute-ego": 0.14559675114495413, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10504263639450072, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.041724486010415215, "sim_compute_performance-ego": 0.0797897321837289, "sim_compute_robot_state-ego": 0.08596814530236381}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11881006465238685, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06158852109722063, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1359099219827091, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09863718350728352, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.040111728743010874, "sim_compute_performance-ego": 0.06994871532215792, "sim_compute_robot_state-ego": 0.07815823835485122}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12111788325839572, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0629592118439851, "in-drivable-lane": 0, "agent_compute-ego": 0.14170874489678276, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.09936123424106176, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04046197290773745, "sim_compute_performance-ego": 0.07062034253720884, "sim_compute_robot_state-ego": 0.0760216094829418}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.11687306796803194, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.0650097645965277, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14229248318017698, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10071979083266912, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04022955894470215, "sim_compute_performance-ego": 0.07064981320325066, "sim_compute_robot_state-ego": 0.07528806901445576}}
set_robot_commands_max	0.13636521056846335
set_robot_commands_mean	0.10717153117196997
set_robot_commands_median	0.1035115892236883
set_robot_commands_min	0.09863718350728352
sim_compute_performance-ego_max	0.09825369605311642
sim_compute_performance-ego_mean	0.07473997135402512
sim_compute_performance-ego_median	0.07212470754792419
sim_compute_performance-ego_min	0.06803778549293418
sim_compute_robot_state-ego_max	0.1063794250841494
sim_compute_robot_state-ego_mean	0.08281658979735013
sim_compute_robot_state-ego_median	0.07869757278056085
sim_compute_robot_state-ego_min	0.07528806901445576
sim_compute_sim_state_max	0.05338951393410011
sim_compute_sim_state_mean	0.042437948074961
sim_compute_sim_state_median	0.04112963757272494
sim_compute_sim_state_min	0.03987608637128558
sim_physics_max	0.17831339217998363
sim_physics_mean	0.13316806167145004
sim_physics_median	0.1288768551566384
sim_physics_min	0.11687306796803194
sim_render-ego_max	0.09099276419039126
sim_render-ego_mean	0.06831114844275454
sim_render-ego_median	0.06655014954604112
sim_render-ego_min	0.06158852109722063
simulation-passed	1
survival_time_max	5.09999999999999
survival_time_mean	2.503333333333331
survival_time_min	0.8500000000000002

No reset possible

21372

2377

Liam Paull 🇨🇦

minimal_agent_python2 (Python 2)

step1-simulation

host-error

aido2-LFVI-sim-validation

2019-04-28 01:31:54+00:00

2019-04-28 02:00:09+00:00

0:28:15

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2377/step1-simulation-ip-172-31-38-104-5376-job21372/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21365

2374

Liam Paull 🇨🇦

minimal_agent (Python 3)

step1-simulation

success

2019-04-28 01:04:42+00:00

2019-04-28 01:31:35+00:00

0:26:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7320108061087556
survival_time_median	11.300000000000026
deviation-center-line_median	0.41059891008830585
in-drivable-lane_median	1.699999999999994

other stats

agent_compute-ego_max	0.16381962003961073
agent_compute-ego_mean	0.15713104094659017
agent_compute-ego_median	0.160017724831899
agent_compute-ego_min	0.1428628596994612
deviation-center-line_max	0.9349599376168654
deviation-center-line_mean	0.5199952742557017
deviation-center-line_min	0.20044345193716143
deviation-heading_max	2.690528154812385
deviation-heading_mean	1.27316543526639
deviation-heading_median	0.9719131370069356
deviation-heading_min	0.7672903262185754
driven_any_max	2.1860208965398997
driven_any_mean	1.3991133906830493
driven_any_median	1.641282781235245
driven_any_min	0.3581279985986457
driven_lanedir_consec_max	1.8538963171887557
driven_lanedir_consec_mean	1.0402347342992102
driven_lanedir_consec_min	0.3433638903020815
driven_lanedir_max	1.8539439248016505
driven_lanedir_mean	1.0402940375630965
driven_lanedir_median	0.7320108061087556
driven_lanedir_min	0.3433638903020815
in-drivable-lane_max	6.850000000000049
in-drivable-lane_mean	2.150000000000015
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.641282781235245, "sim_physics": 0.21120394647648905, "survival_time": 11.300000000000026, "driven_lanedir": 1.6348933316601737, "sim_render-ego": 0.06398424005086444, "in-drivable-lane": 0, "agent_compute-ego": 0.16381962003961073, "deviation-heading": 0.9126756427521452, "set_robot_commands": 0.10061820418433806, "deviation-center-line": 0.672225484067654, "driven_lanedir_consec": 1.6346444229536363, "sim_compute_sim_state": 0.040505153942952114, "sim_compute_performance-ego": 0.07269415285735004, "sim_compute_robot_state-ego": 0.08109486525037647, "sim_compute_robot_state-npc0": 0.07138330219066248, "sim_compute_robot_state-npc1": 0.07119928946537254, "sim_compute_robot_state-npc2": 0.07134508242649315, "sim_compute_robot_state-npc3": 0.07243935407790462}, "udem1-1-0": {"driven_any": 1.0253513500538094, "sim_physics": 0.18712295426262748, "survival_time": 7.199999999999982, "driven_lanedir": 0.637258234942822, "sim_render-ego": 0.05867013997501797, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1428628596994612, "deviation-heading": 2.690528154812385, "set_robot_commands": 0.09159298241138458, "deviation-center-line": 0.41059891008830585, "driven_lanedir_consec": 0.637258234942822, "sim_compute_sim_state": 0.03672023448679182, "sim_compute_performance-ego": 0.06451894011762407, "sim_compute_robot_state-ego": 0.07308080461290148, "sim_compute_robot_state-npc0": 0.06451104084650676, "sim_compute_robot_state-npc1": 0.06446638537777795, "sim_compute_robot_state-npc2": 0.06484462983078426, "sim_compute_robot_state-npc3": 0.06530073285102844}, "udem1-2-0": {"driven_any": 1.784783926987647, "sim_physics": 0.2014941504744233, "survival_time": 12.200000000000038, "driven_lanedir": 0.7320108061087556, "sim_render-ego": 0.06706994771957397, "in-drivable-lane": 6.850000000000049, "agent_compute-ego": 0.16319772747696423, "deviation-heading": 1.0234199155419084, "set_robot_commands": 0.1003843936763826, "deviation-center-line": 0.38174858756852137, "driven_lanedir_consec": 0.7320108061087556, "sim_compute_sim_state": 0.04012965569730665, "sim_compute_performance-ego": 0.07362741720480998, "sim_compute_robot_state-ego": 0.08006705417007697, "sim_compute_robot_state-npc0": 0.07289442371149532, "sim_compute_robot_state-npc1": 0.07236719522319857, "sim_compute_robot_state-npc2": 0.07181134673415637, "sim_compute_robot_state-npc3": 0.07226454527651677}, "udem1-3-0": {"driven_any": 2.1860208965398997, "sim_physics": 0.20315782785415648, "survival_time": 14.950000000000076, "driven_lanedir": 1.8539439248016505, "sim_render-ego": 0.06722036520640055, "in-drivable-lane": 2.2000000000000313, "agent_compute-ego": 0.160017724831899, "deviation-heading": 0.9719131370069356, "set_robot_commands": 0.10361654996871948, "deviation-center-line": 0.9349599376168654, "driven_lanedir_consec": 1.8538963171887557, "sim_compute_sim_state": 0.04079827626546224, "sim_compute_performance-ego": 0.07308931827545166, "sim_compute_robot_state-ego": 0.07725574652353923, "sim_compute_robot_state-npc0": 0.07332268397013346, "sim_compute_robot_state-npc1": 0.07206087350845337, "sim_compute_robot_state-npc2": 0.07144113063812256, "sim_compute_robot_state-npc3": 0.0718456244468689}, "udem1-4-0": {"driven_any": 0.3581279985986457, "sim_physics": 0.20331280761294895, "survival_time": 2.6999999999999984, "driven_lanedir": 0.3433638903020815, "sim_render-ego": 0.06329535996472394, "in-drivable-lane": 0, "agent_compute-ego": 0.15575727268501563, "deviation-heading": 0.7672903262185754, "set_robot_commands": 0.096666865878635, "deviation-center-line": 0.20044345193716143, "driven_lanedir_consec": 0.3433638903020815, "sim_compute_sim_state": 0.03914784943615949, "sim_compute_performance-ego": 0.0699520331841928, "sim_compute_robot_state-ego": 0.07536927858988444, "sim_compute_robot_state-npc0": 0.0719449696717439, "sim_compute_robot_state-npc1": 0.06906642737212004, "sim_compute_robot_state-npc2": 0.07010924374615704, "sim_compute_robot_state-npc3": 0.06958700992442944}}
set_robot_commands_max	0.10361654996871948
set_robot_commands_mean	0.09857579922389197
set_robot_commands_median	0.1003843936763826
set_robot_commands_min	0.09159298241138458
sim_compute_performance-ego_max	0.07362741720480998
sim_compute_performance-ego_mean	0.07077637232788571
sim_compute_performance-ego_median	0.07269415285735004
sim_compute_performance-ego_min	0.06451894011762407
sim_compute_robot_state-ego_max	0.08109486525037647
sim_compute_robot_state-ego_mean	0.07737354982935572
sim_compute_robot_state-ego_median	0.07725574652353923
sim_compute_robot_state-ego_min	0.07308080461290148
sim_compute_robot_state-npc0_max	0.07332268397013346
sim_compute_robot_state-npc0_mean	0.07081128407810838
sim_compute_robot_state-npc0_median	0.0719449696717439
sim_compute_robot_state-npc0_min	0.06451104084650676
sim_compute_robot_state-npc1_max	0.07236719522319857
sim_compute_robot_state-npc1_mean	0.0698320341893845
sim_compute_robot_state-npc1_median	0.07119928946537254
sim_compute_robot_state-npc1_min	0.06446638537777795
sim_compute_robot_state-npc2_max	0.07181134673415637
sim_compute_robot_state-npc2_mean	0.06991028667514268
sim_compute_robot_state-npc2_median	0.07134508242649315
sim_compute_robot_state-npc2_min	0.06484462983078426
sim_compute_robot_state-npc3_max	0.07243935407790462
sim_compute_robot_state-npc3_mean	0.07028745331534965
sim_compute_robot_state-npc3_median	0.0718456244468689
sim_compute_robot_state-npc3_min	0.06530073285102844
sim_compute_sim_state_max	0.04079827626546224
sim_compute_sim_state_mean	0.03946023396573446
sim_compute_sim_state_median	0.04012965569730665
sim_compute_sim_state_min	0.03672023448679182
sim_physics_max	0.21120394647648905
sim_physics_mean	0.20125833733612905
sim_physics_median	0.20315782785415648
sim_physics_min	0.18712295426262748
sim_render-ego_max	0.06722036520640055
sim_render-ego_mean	0.06404801058331618
sim_render-ego_median	0.06398424005086444
sim_render-ego_min	0.05867013997501797
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	9.670000000000025
survival_time_min	2.6999999999999984

No reset possible

21332

2412

jiang peng

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-28 00:00:31+00:00

2019-04-28 01:00:10+00:00

0:59:39

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2412/step1-simulation-ip-172-31-38-104-5376-job21332/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21318

2770

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 23:04:11+00:00

2019-04-28 00:00:09+00:00

0:55:58

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission2770/step1-simulation-ip-172-31-38-104-5376-job21318/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21309

2409

jiang peng

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 23:00:17+00:00

2019-04-27 23:03:39+00:00

0:03:22

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21295

2424

Andrea Censi 🇨🇭

random_agent

step1-simulation

host-error

2019-04-27 22:33:53+00:00

2019-04-27 23:00:10+00:00

0:26:17

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2424/step1-simulation-ip-172-31-38-104-5376-job21295/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21283

3112

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 22:01:38+00:00

2019-04-27 22:32:00+00:00

0:30:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-0.09342973302772162
survival_time_median	14.950000000000076
deviation-center-line_median	0.5975008670483987
in-drivable-lane_median	5.099999999999982

other stats

agent_compute-ego_max	0.25615758895874025
agent_compute-ego_mean	0.252620787302653
agent_compute-ego_median	0.2512507390975952
agent_compute-ego_min	0.25038254817326866
deviation-center-line_max	0.7550703464677697
deviation-center-line_mean	0.609132371705407
deviation-center-line_min	0.4851468835069301
deviation-heading_max	5.99863358806661
deviation-heading_mean	4.927527830531443
deviation-heading_median	4.547722394369372
deviation-heading_min	4.092447484339199
driven_any_max	0.5655608268284893
driven_any_mean	0.40932775095901625
driven_any_median	0.4244096982204879
driven_any_min	0.2331749703383879
driven_lanedir_consec_max	-0.019792184207736985
driven_lanedir_consec_mean	-0.12925157602292955
driven_lanedir_consec_min	-0.2951725531613474
driven_lanedir_max	-0.019792184207736985
driven_lanedir_mean	-0.1377942777507384
driven_lanedir_median	-0.09342973302772162
driven_lanedir_min	-0.3378860618003916
in-drivable-lane_max	6.050000000000064
in-drivable-lane_mean	4.230000000000031
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3750869362513492, "sim_physics": 0.1376249305407206, "survival_time": 14.950000000000076, "driven_lanedir": -0.09342973302772162, "sim_render-ego": 0.0681051508585612, "in-drivable-lane": 6.050000000000064, "agent_compute-ego": 0.2512507390975952, "deviation-heading": 4.269154427461713, "set_robot_commands": 0.10784624099731444, "deviation-center-line": 0.6648683070741002, "driven_lanedir_consec": -0.09342973302772162, "sim_compute_sim_state": 0.04244155486424764, "sim_compute_performance-ego": 0.07673295815785726, "sim_compute_robot_state-ego": 0.0854868205388387}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2331749703383879, "sim_physics": 0.13192245086034138, "survival_time": 14.950000000000076, "driven_lanedir": -0.019792184207736985, "sim_render-ego": 0.06936866044998169, "in-drivable-lane": 0, "agent_compute-ego": 0.25615758895874025, "deviation-heading": 4.092447484339199, "set_robot_commands": 0.10946702321370444, "deviation-center-line": 0.7550703464677697, "driven_lanedir_consec": -0.019792184207736985, "sim_compute_sim_state": 0.042740338643391926, "sim_compute_performance-ego": 0.0762433385848999, "sim_compute_robot_state-ego": 0.08586676359176636}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5655608268284893, "sim_physics": 0.11435028076171876, "survival_time": 14.950000000000076, "driven_lanedir": -0.3378860618003916, "sim_render-ego": 0.06768989245096843, "in-drivable-lane": 4.800000000000047, "agent_compute-ego": 0.2504388991991679, "deviation-heading": 5.99863358806661, "set_robot_commands": 0.1088393807411194, "deviation-center-line": 0.5975008670483987, "driven_lanedir_consec": -0.2951725531613474, "sim_compute_sim_state": 0.04255659023920695, "sim_compute_performance-ego": 0.07575439771016439, "sim_compute_robot_state-ego": 0.0832006041208903}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4244096982204879, "sim_physics": 0.13467000404993693, "survival_time": 14.950000000000076, "driven_lanedir": -0.08244222286658998, "sim_render-ego": 0.06807144880294799, "in-drivable-lane": 5.099999999999982, "agent_compute-ego": 0.25038254817326866, "deviation-heading": 5.729681258420323, "set_robot_commands": 0.10754993836085, "deviation-center-line": 0.4851468835069301, "driven_lanedir_consec": -0.08244222286658998, "sim_compute_sim_state": 0.041647693316141765, "sim_compute_performance-ego": 0.07540207942326864, "sim_compute_robot_state-ego": 0.08389748573303223}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4484063231563669, "sim_physics": 0.1350066606203715, "survival_time": 14.950000000000076, "driven_lanedir": -0.15542118685125184, "sim_render-ego": 0.06680794715881348, "in-drivable-lane": 5.200000000000057, "agent_compute-ego": 0.254874161084493, "deviation-heading": 4.547722394369372, "set_robot_commands": 0.10585052331288657, "deviation-center-line": 0.5430754544298365, "driven_lanedir_consec": -0.15542118685125184, "sim_compute_sim_state": 0.04186070203781128, "sim_compute_performance-ego": 0.07582743565241495, "sim_compute_robot_state-ego": 0.08630101362864176}}
set_robot_commands_max	0.10946702321370444
set_robot_commands_mean	0.10791062132517495
set_robot_commands_median	0.10784624099731444
set_robot_commands_min	0.10585052331288657
sim_compute_performance-ego_max	0.07673295815785726
sim_compute_performance-ego_mean	0.07599204190572104
sim_compute_performance-ego_median	0.07582743565241495
sim_compute_performance-ego_min	0.07540207942326864
sim_compute_robot_state-ego_max	0.08630101362864176
sim_compute_robot_state-ego_mean	0.08495053752263386
sim_compute_robot_state-ego_median	0.0854868205388387
sim_compute_robot_state-ego_min	0.0832006041208903
sim_compute_sim_state_max	0.042740338643391926
sim_compute_sim_state_mean	0.04224937582015991
sim_compute_sim_state_median	0.04244155486424764
sim_compute_sim_state_min	0.041647693316141765
sim_physics_max	0.1376249305407206
sim_physics_mean	0.13071486536661783
sim_physics_median	0.13467000404993693
sim_physics_min	0.11435028076171876
sim_render-ego_max	0.06936866044998169
sim_render-ego_mean	0.06800861994425457
sim_render-ego_median	0.06807144880294799
sim_render-ego_min	0.06680794715881348
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

21273

2433

Andrea Censi 🇨🇭

random_agent

step1-simulation

error

2019-04-27 22:00:17+00:00

2019-04-27 22:01:10+00:00

0:00:53

The container "solut [...]

The container "solution" exited with code 2.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21264

2449

Nicky Eichmann

Baseline solution using reinforcement learning

step1-simulation

host-error

2019-04-27 21:32:04+00:00

2019-04-27 22:00:10+00:00

0:28:06

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2449/step1-simulation-ip-172-31-38-104-5376-job21264/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21256

2460

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 21:28:52+00:00

2019-04-27 21:31:36+00:00

0:02:44

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21207

2564

Alexander Karavaev

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-04-27 21:01:22+00:00

2019-04-27 21:28:05+00:00

0:26:43

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30314311735235044
survival_time_median	2.6499999999999986
deviation-center-line_median	0.1192462800776758
in-drivable-lane_median	0.9499999999999966

other stats

agent_compute-ego_max	0.14204102166941468
agent_compute-ego_mean	0.075788565523099
agent_compute-ego_median	0.07330938287683435
agent_compute-ego_min	0.05078892707824707
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.12653708755488874
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330368
deviation-heading_mean	0.44799520296706863
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829774
driven_any_max	1.599733354117788
driven_any_mean	0.8095342605803044
driven_any_median	0.7336463183586153
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	1.021002447119848
driven_lanedir_consec_mean	0.448904809024379
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	1.021002447119848
driven_lanedir_mean	0.448904809024379
driven_lanedir_median	0.30314311735235044
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	4.799999999999986
in-drivable-lane_mean	1.1466666666666634
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.225205230041289, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.07280413197799468, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.14204102166941468, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.13621234557998013, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.049161333433339297, "sim_compute_performance-ego": 0.09064968538955905, "sim_compute_robot_state-ego": 0.09751168439086054, "sim_compute_robot_state-npc0": 0.08120739963692679, "sim_compute_robot_state-npc1": 0.08143735939348248, "sim_compute_robot_state-npc2": 0.08427934243645467, "sim_compute_robot_state-npc3": 0.08286316965667295}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.22328656911849976, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06670857220888138, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07605929672718048, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.10552860796451569, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04012104123830795, "sim_compute_performance-ego": 0.07174935936927795, "sim_compute_robot_state-ego": 0.08509495854377747, "sim_compute_robot_state-npc0": 0.08038747310638428, "sim_compute_robot_state-npc1": 0.0773414894938469, "sim_compute_robot_state-npc2": 0.09779664129018784, "sim_compute_robot_state-npc3": 0.07614286988973618}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.2204090035878695, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06891063543466422, "in-drivable-lane": 0, "agent_compute-ego": 0.07689936344440167, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10571837425231934, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04250866633195143, "sim_compute_performance-ego": 0.0749793006823613, "sim_compute_robot_state-ego": 0.08210117541826688, "sim_compute_robot_state-npc0": 0.07539982979114239, "sim_compute_robot_state-npc1": 0.07389798072668222, "sim_compute_robot_state-npc2": 0.07434799120976375, "sim_compute_robot_state-npc3": 0.0747265311387869}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.20407892042590725, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06312488227762202, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07232680628376623, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09710977410757414, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.040425415961973125, "sim_compute_performance-ego": 0.06880232851992371, "sim_compute_robot_state-ego": 0.07728618191134545, "sim_compute_robot_state-npc0": 0.07144637005303496, "sim_compute_robot_state-npc1": 0.07116211870665191, "sim_compute_robot_state-npc2": 0.07205642423322124, "sim_compute_robot_state-npc3": 0.07331049057745165}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.18581080436706543, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.0618243103935605, "in-drivable-lane": 0, "agent_compute-ego": 0.06735677946181524, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.0905242193312872, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.0373273804074242, "sim_compute_performance-ego": 0.06595277786254883, "sim_compute_robot_state-ego": 0.0763334660303025, "sim_compute_robot_state-npc0": 0.06974722090221587, "sim_compute_robot_state-npc1": 0.0714897768838065, "sim_compute_robot_state-npc2": 0.07431969188508533, "sim_compute_robot_state-npc3": 0.07460348946707589}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.18939038150566667, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.0645338720526577, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.07382908143287847, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.09973801069023196, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.040982372504620515, "sim_compute_performance-ego": 0.07196518015270391, "sim_compute_robot_state-ego": 0.08009951961927178, "sim_compute_robot_state-npc0": 0.07129569881218524, "sim_compute_robot_state-npc1": 0.07054874325586745, "sim_compute_robot_state-npc2": 0.07064704461531206, "sim_compute_robot_state-npc3": 0.07117719689676584}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.17541998340969994, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.06318865503583636, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07556692759195964, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.1009632462546939, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.04184973523730323, "sim_compute_performance-ego": 0.07099031266712007, "sim_compute_robot_state-ego": 0.08228447891417004, "sim_compute_robot_state-npc0": 0.07547696431477864, "sim_compute_robot_state-npc1": 0.07367855310440063, "sim_compute_robot_state-npc2": 0.07479213816779, "sim_compute_robot_state-npc3": 0.07326567740667433}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.210733674667977, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06660142460384884, "in-drivable-lane": 0, "agent_compute-ego": 0.07330938287683435, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10350885262360444, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.03929200365736678, "sim_compute_performance-ego": 0.0720485577712188, "sim_compute_robot_state-ego": 0.08442584566167884, "sim_compute_robot_state-npc0": 0.07395235912219898, "sim_compute_robot_state-npc1": 0.07440551551612648, "sim_compute_robot_state-npc2": 0.07432963719239107, "sim_compute_robot_state-npc3": 0.07362185619972847}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.17996643318070304, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06249637736214532, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07034831245740254, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10080760055118138, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.041303124692704946, "sim_compute_performance-ego": 0.07182910707261828, "sim_compute_robot_state-ego": 0.08417056997617085, "sim_compute_robot_state-npc0": 0.07231377893024021, "sim_compute_robot_state-npc1": 0.07444874776734246, "sim_compute_robot_state-npc2": 0.07233616378572252, "sim_compute_robot_state-npc3": 0.07567016283671062}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.2289669469138172, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06409904221507991, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07135982379735073, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.098732647494735, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.040195781493855415, "sim_compute_performance-ego": 0.07304612498417079, "sim_compute_robot_state-ego": 0.07960787443357094, "sim_compute_robot_state-npc0": 0.07062438492463013, "sim_compute_robot_state-npc1": 0.07122982773825387, "sim_compute_robot_state-npc2": 0.07219103786432854, "sim_compute_robot_state-npc3": 0.07148760947111611}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.17322806075767236, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.05529298605742278, "in-drivable-lane": 0, "agent_compute-ego": 0.06690489804303204, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.08815401571768301, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.034583974767614295, "sim_compute_performance-ego": 0.0606335269080268, "sim_compute_robot_state-ego": 0.06368925836351183, "sim_compute_robot_state-npc0": 0.06713395648532444, "sim_compute_robot_state-npc1": 0.06633417694656937, "sim_compute_robot_state-npc2": 0.06165960982993797, "sim_compute_robot_state-npc3": 0.06434795591566297}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.1139657211303711, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.0448934268951416, "in-drivable-lane": 0, "agent_compute-ego": 0.05078892707824707, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.0673374080657959, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.02677601814270019, "sim_compute_performance-ego": 0.048669958114624025, "sim_compute_robot_state-ego": 0.05186763763427735, "sim_compute_robot_state-npc0": 0.04869145393371582, "sim_compute_robot_state-npc1": 0.04774308204650879, "sim_compute_robot_state-npc2": 0.04762653350830078, "sim_compute_robot_state-npc3": 0.047056541442871094}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.16761517974565615, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06123133875289053, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.06869895053359698, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.09363604941458072, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.03786796893713609, "sim_compute_performance-ego": 0.06576080142327075, "sim_compute_robot_state-ego": 0.07511102928305571, "sim_compute_robot_state-npc0": 0.06822129465499015, "sim_compute_robot_state-npc1": 0.06611675136494187, "sim_compute_robot_state-npc2": 0.06600298971500036, "sim_compute_robot_state-npc3": 0.07037815507852806}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.2223197490938248, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.0669804003930861, "in-drivable-lane": 0, "agent_compute-ego": 0.07725209574545583, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.1064224858437815, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.04397400732963316, "sim_compute_performance-ego": 0.07599282264709473, "sim_compute_robot_state-ego": 0.08469705427846601, "sim_compute_robot_state-npc0": 0.0721572829831031, "sim_compute_robot_state-npc1": 0.07443181160957582, "sim_compute_robot_state-npc2": 0.07461563233406313, "sim_compute_robot_state-npc3": 0.07408477414038873}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.2232632730521408, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06423071318981695, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07408681570314894, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.10191914147021724, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.04042405708163392, "sim_compute_performance-ego": 0.07130782744463753, "sim_compute_robot_state-ego": 0.08301804579940497, "sim_compute_robot_state-npc0": 0.07358107847325943, "sim_compute_robot_state-npc1": 0.07521348373562682, "sim_compute_robot_state-npc2": 0.07322194997002096, "sim_compute_robot_state-npc3": 0.07294492160572726}}
set_robot_commands_max	0.13621234557998013
set_robot_commands_mean	0.09975418529081208
set_robot_commands_median	0.10080760055118138
set_robot_commands_min	0.0673374080657959
sim_compute_performance-ego_max	0.09064968538955905
sim_compute_performance-ego_mean	0.07029184473394377
sim_compute_performance-ego_median	0.07174935936927795
sim_compute_performance-ego_min	0.048669958114624025
sim_compute_robot_state-ego_max	0.09751168439086054
sim_compute_robot_state-ego_mean	0.07915325201720876
sim_compute_robot_state-ego_median	0.08210117541826688
sim_compute_robot_state-ego_min	0.05186763763427735
sim_compute_robot_state-npc0_max	0.08120739963692679
sim_compute_robot_state-npc0_mean	0.07144243640827536
sim_compute_robot_state-npc0_median	0.0721572829831031
sim_compute_robot_state-npc0_min	0.04869145393371582
sim_compute_robot_state-npc1_max	0.08143735939348248
sim_compute_robot_state-npc1_mean	0.0712986278859789
sim_compute_robot_state-npc1_median	0.07367855310440063
sim_compute_robot_state-npc1_min	0.04774308204650879
sim_compute_robot_state-npc2_max	0.09779664129018784
sim_compute_robot_state-npc2_mean	0.07268152186917204
sim_compute_robot_state-npc2_median	0.07322194997002096
sim_compute_robot_state-npc2_min	0.04762653350830078
sim_compute_robot_state-npc3_max	0.08286316965667295
sim_compute_robot_state-npc3_mean	0.0717120934482598
sim_compute_robot_state-npc3_median	0.07331049057745165
sim_compute_robot_state-npc3_min	0.047056541442871094
sim_compute_sim_state_max	0.049161333433339297
sim_compute_sim_state_mean	0.03978619208117097
sim_compute_sim_state_median	0.04042405708163392
sim_compute_sim_state_min	0.02677601814270019
sim_physics_max	0.2289669469138172
sim_physics_mean	0.19624399539987733
sim_physics_median	0.20407892042590725
sim_physics_min	0.1139657211303711
sim_render-ego_max	0.07280413197799468
sim_render-ego_mean	0.06312805125670992
sim_render-ego_median	0.06409904221507991
sim_render-ego_min	0.0448934268951416
simulation-passed	1
survival_time_max	6.0499999999999865
survival_time_mean	3.046666666666663
survival_time_min	1.0500000000000005

No reset possible

21173

2774

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 20:02:57+00:00

2019-04-27 21:00:10+00:00

0:57:13

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-38-104-5376-job21173/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21162

2583

Liam Paull 🇨🇦

challenge-aido_LF-template-ros

step1-simulation

error

2019-04-27 20:00:28+00:00

2019-04-27 20:02:22+00:00

0:01:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21119

2864

Alexander Karavaev

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 19:01:26+00:00

2019-04-27 20:00:10+00:00

0:58:44

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-38-104-5376-job21119/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21089

3074

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 18:03:24+00:00

2019-04-27 19:00:10+00:00

0:56:46

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3074/step1-simulation-ip-172-31-38-104-5376-job21089/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21076

2695

Konstantin Chaika

challenge-aido_LF-baseline-duckietown

step1-simulation

host-error

2019-04-27 17:58:07+00:00

2019-04-27 18:00:11+00:00

0:02:04

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2695/step1-simulation-ip-172-31-38-104-5376-job21076/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

21011

2880

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

success

2019-04-27 17:00:24+00:00

2019-04-27 17:58:00+00:00

0:57:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4278874896529574
survival_time_median	7.049999999999983
deviation-center-line_median	0.336080725822317
in-drivable-lane_median	1.999999999999993

other stats

agent_compute-ego_max	0.20625066242629675
agent_compute-ego_mean	0.15942765071688964
agent_compute-ego_median	0.15796940288846456
agent_compute-ego_min	0.13733520731329918
deviation-center-line_max	0.6395179658578088
deviation-center-line_mean	0.3376081825040823
deviation-center-line_min	0.18432680552089345
deviation-heading_max	2.5988183506786204
deviation-heading_mean	1.1439412496731016
deviation-heading_median	1.0007157377877205
deviation-heading_min	0.4339628546397995
driven_any_max	2.1824083368295137
driven_any_mean	1.041548572842095
driven_any_median	1.002289442536604
driven_any_min	0.3471148409579561
driven_lanedir_consec_max	1.2416141769078073
driven_lanedir_consec_mean	0.5855696461150995
driven_lanedir_consec_min	0.32724226781545207
driven_lanedir_max	1.2416141769078073
driven_lanedir_mean	0.5855696461150995
driven_lanedir_median	0.4278874896529574
driven_lanedir_min	0.32724226781545207
in-drivable-lane_max	10.500000000000064
in-drivable-lane_mean	2.776666666666675
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.22916683361684675, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.07936740436142298, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.20625066242629675, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.13715228416936862, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04764060493853453, "sim_compute_performance-ego": 0.0874028857663381, "sim_compute_robot_state-ego": 0.10181550499346616, "sim_compute_robot_state-npc0": 0.08838698160734108, "sim_compute_robot_state-npc1": 0.08522218937496487, "sim_compute_robot_state-npc2": 0.09123110428130884, "sim_compute_robot_state-npc3": 0.08702670069907209}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.1914641440860809, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06203829674493699, "in-drivable-lane": 0, "agent_compute-ego": 0.15796940288846456, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.09633806773594449, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.04004759258694119, "sim_compute_performance-ego": 0.07027562837752085, "sim_compute_robot_state-ego": 0.07552159021771143, "sim_compute_robot_state-npc0": 0.0693080084664481, "sim_compute_robot_state-npc1": 0.07308818802000984, "sim_compute_robot_state-npc2": 0.07266428357078916, "sim_compute_robot_state-npc3": 0.07229011777847533}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.19158929930792917, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06609155654907227, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.16163234180874295, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.1036596647898356, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.041642896864149306, "sim_compute_performance-ego": 0.07316384209526909, "sim_compute_robot_state-ego": 0.0787881088256836, "sim_compute_robot_state-npc0": 0.07318044874403212, "sim_compute_robot_state-npc1": 0.07344143019782172, "sim_compute_robot_state-npc2": 0.07340158250596789, "sim_compute_robot_state-npc3": 0.07287420060899523}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.18155628525167017, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06430235326564807, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.1575156411816997, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.10169873918805804, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.04141711749239451, "sim_compute_performance-ego": 0.07218059087129232, "sim_compute_robot_state-ego": 0.07936792879060667, "sim_compute_robot_state-npc0": 0.0724995125273955, "sim_compute_robot_state-npc1": 0.0727780996929116, "sim_compute_robot_state-npc2": 0.07252473325773318, "sim_compute_robot_state-npc3": 0.07335500233733709}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.17391671453203475, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.0644638008541531, "in-drivable-lane": 0, "agent_compute-ego": 0.1584649540129162, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.09890561255197676, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04127595159742567, "sim_compute_performance-ego": 0.070970062225584, "sim_compute_robot_state-ego": 0.07679463946630084, "sim_compute_robot_state-npc0": 0.07451086952572777, "sim_compute_robot_state-npc1": 0.07302216121128627, "sim_compute_robot_state-npc2": 0.07221357406131805, "sim_compute_robot_state-npc3": 0.07067423775082543}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0504010241155275, "sim_physics": 0.17791348124203615, "survival_time": 7.299999999999982, "driven_lanedir": 0.39597378214039874, "sim_render-ego": 0.06367851773353472, "in-drivable-lane": 3.5499999999999874, "agent_compute-ego": 0.16281899034160455, "deviation-heading": 2.3434677844360583, "set_robot_commands": 0.10613428729854218, "deviation-center-line": 0.37507737640988825, "driven_lanedir_consec": 0.39597378214039874, "sim_compute_sim_state": 0.03993111930481375, "sim_compute_performance-ego": 0.07151747566379912, "sim_compute_robot_state-ego": 0.07637152116592616, "sim_compute_robot_state-npc0": 0.07182746390773825, "sim_compute_robot_state-npc1": 0.0747120837642722, "sim_compute_robot_state-npc2": 0.07101707262535618, "sim_compute_robot_state-npc3": 0.07173391727552023}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9925466226450728, "sim_physics": 0.18198401464832772, "survival_time": 6.949999999999983, "driven_lanedir": 0.647038156506072, "sim_render-ego": 0.0657822296773787, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.15779599011373177, "deviation-heading": 1.5590891377390808, "set_robot_commands": 0.09968334307773508, "deviation-center-line": 0.37918470593477854, "driven_lanedir_consec": 0.647038156506072, "sim_compute_sim_state": 0.04060445929602753, "sim_compute_performance-ego": 0.07327621274714848, "sim_compute_robot_state-ego": 0.07807872278227222, "sim_compute_robot_state-npc0": 0.07232903062010841, "sim_compute_robot_state-npc1": 0.07266074461902645, "sim_compute_robot_state-npc2": 0.07169891775940819, "sim_compute_robot_state-npc3": 0.07327548548472014}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.5143195051826088, "sim_physics": 0.1905337292611884, "survival_time": 10.450000000000014, "driven_lanedir": 0.5946085645782655, "sim_render-ego": 0.06522452089775121, "in-drivable-lane": 6.050000000000021, "agent_compute-ego": 0.16102795053326913, "deviation-heading": 1.0074551066905668, "set_robot_commands": 0.10201461691605418, "deviation-center-line": 0.31096291732963327, "driven_lanedir_consec": 0.5946085645782655, "sim_compute_sim_state": 0.03996281418503757, "sim_compute_performance-ego": 0.07165472016950543, "sim_compute_robot_state-ego": 0.07900250699531519, "sim_compute_robot_state-npc0": 0.07096044298564418, "sim_compute_robot_state-npc1": 0.07373606074940074, "sim_compute_robot_state-npc2": 0.07225090693058579, "sim_compute_robot_state-npc3": 0.0726801196924237}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0526053931137378, "sim_physics": 0.1690914047007658, "survival_time": 7.349999999999982, "driven_lanedir": 0.35306598250901233, "sim_render-ego": 0.06332642367096986, "in-drivable-lane": 4.599999999999984, "agent_compute-ego": 0.16059550460504027, "deviation-heading": 0.7493734577809043, "set_robot_commands": 0.09729511072846496, "deviation-center-line": 0.2543770508936741, "driven_lanedir_consec": 0.35306598250901233, "sim_compute_sim_state": 0.038569859095982144, "sim_compute_performance-ego": 0.0682073077377008, "sim_compute_robot_state-ego": 0.07476999321762397, "sim_compute_robot_state-npc0": 0.06995743472559922, "sim_compute_robot_state-npc1": 0.07051917647017913, "sim_compute_robot_state-npc2": 0.06957452475619154, "sim_compute_robot_state-npc3": 0.06920758720968856}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4247089136171447, "sim_physics": 0.17239501362755186, "survival_time": 3.149999999999997, "driven_lanedir": 0.4065794545774155, "sim_render-ego": 0.05841676394144694, "in-drivable-lane": 0, "agent_compute-ego": 0.14488078677465047, "deviation-heading": 0.9116478049678652, "set_robot_commands": 0.0934402829124814, "deviation-center-line": 0.20984142395940591, "driven_lanedir_consec": 0.4065794545774155, "sim_compute_sim_state": 0.03780386939881339, "sim_compute_performance-ego": 0.06762866368369451, "sim_compute_robot_state-ego": 0.07295115788777669, "sim_compute_robot_state-npc0": 0.06576535058399988, "sim_compute_robot_state-npc1": 0.06449393242124528, "sim_compute_robot_state-npc2": 0.06655058028205993, "sim_compute_robot_state-npc3": 0.06996288753691174}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3471148409579561, "sim_physics": 0.20810989613802927, "survival_time": 2.6499999999999986, "driven_lanedir": 0.32724226781545207, "sim_render-ego": 0.06560814155722564, "in-drivable-lane": 0, "agent_compute-ego": 0.15713931029697634, "deviation-heading": 0.8969790273027586, "set_robot_commands": 0.0970117505991234, "deviation-center-line": 0.18432680552089345, "driven_lanedir_consec": 0.32724226781545207, "sim_compute_sim_state": 0.03766418403049685, "sim_compute_performance-ego": 0.07182773104253805, "sim_compute_robot_state-ego": 0.0746637650255887, "sim_compute_robot_state-npc0": 0.07176409577423672, "sim_compute_robot_state-npc1": 0.07241866723546442, "sim_compute_robot_state-npc2": 0.07199055293820938, "sim_compute_robot_state-npc3": 0.07078698896012216}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.43182353608565555, "sim_physics": 0.14712389186024666, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4278874896529574, "sim_render-ego": 0.05805732682347298, "in-drivable-lane": 0, "agent_compute-ego": 0.13733520731329918, "deviation-heading": 0.4339628546397995, "set_robot_commands": 0.08466009795665741, "deviation-center-line": 0.336080725822317, "driven_lanedir_consec": 0.4278874896529574, "sim_compute_sim_state": 0.03487711027264595, "sim_compute_performance-ego": 0.05901094898581505, "sim_compute_robot_state-ego": 0.06827369332313538, "sim_compute_robot_state-npc0": 0.06261763349175453, "sim_compute_robot_state-npc1": 0.05980796739459038, "sim_compute_robot_state-npc2": 0.06020103022456169, "sim_compute_robot_state-npc3": 0.06085248291492462}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.002289442536604, "sim_physics": 0.14985266137630382, "survival_time": 7.049999999999983, "driven_lanedir": 0.3465233549666594, "sim_render-ego": 0.05446057454914066, "in-drivable-lane": 4.3499999999999845, "agent_compute-ego": 0.13861337452070088, "deviation-heading": 0.5501933908035521, "set_robot_commands": 0.08651676076523801, "deviation-center-line": 0.33321411572814535, "driven_lanedir_consec": 0.3465233549666594, "sim_compute_sim_state": 0.03463747822646553, "sim_compute_performance-ego": 0.06111820877021086, "sim_compute_robot_state-ego": 0.06659166694532895, "sim_compute_robot_state-npc0": 0.061843765542862264, "sim_compute_robot_state-npc1": 0.06128234897099488, "sim_compute_robot_state-npc2": 0.06240696940861695, "sim_compute_robot_state-npc3": 0.06093234204231424}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5767327422600936, "sim_physics": 0.1986188822627617, "survival_time": 10.85000000000002, "driven_lanedir": 1.2416141769078073, "sim_render-ego": 0.06283088433577717, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.15790817814488564, "deviation-heading": 1.4083883035350369, "set_robot_commands": 0.09910163132276403, "deviation-center-line": 0.6395179658578088, "driven_lanedir_consec": 1.2416141769078073, "sim_compute_sim_state": 0.039138935678016205, "sim_compute_performance-ego": 0.06873075753313056, "sim_compute_robot_state-ego": 0.07393582075971612, "sim_compute_robot_state-npc0": 0.07033262055041054, "sim_compute_robot_state-npc1": 0.06940157841976886, "sim_compute_robot_state-npc2": 0.06837918571612801, "sim_compute_robot_state-npc3": 0.06983649346136278}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1824083368295137, "sim_physics": 0.20162309249242147, "survival_time": 14.950000000000076, "driven_lanedir": 0.4632121180957165, "sim_render-ego": 0.06957073529561361, "in-drivable-lane": 10.500000000000064, "agent_compute-ego": 0.17146646579106647, "deviation-heading": 2.5988183506786204, "set_robot_commands": 0.10960356473922728, "deviation-center-line": 0.3466574247419256, "driven_lanedir_consec": 0.4632121180957165, "sim_compute_sim_state": 0.042099182605743406, "sim_compute_performance-ego": 0.07581034501393637, "sim_compute_robot_state-ego": 0.08636175235112509, "sim_compute_robot_state-npc0": 0.07698588530222575, "sim_compute_robot_state-npc1": 0.07687935590744019, "sim_compute_robot_state-npc2": 0.076132284005483, "sim_compute_robot_state-npc3": 0.07746575355529785}}
set_robot_commands_max	0.13715228416936862
set_robot_commands_mean	0.10088105431676476
set_robot_commands_median	0.09910163132276403
set_robot_commands_min	0.08466009795665741
sim_compute_performance-ego_max	0.0874028857663381
sim_compute_performance-ego_mean	0.07085169204556557
sim_compute_performance-ego_median	0.07151747566379912
sim_compute_performance-ego_min	0.05901094898581505
sim_compute_robot_state-ego_max	0.10181550499346616
sim_compute_robot_state-ego_mean	0.0775525581831718
sim_compute_robot_state-ego_median	0.07637152116592616
sim_compute_robot_state-ego_min	0.06659166694532895
sim_compute_robot_state-npc0_max	0.08838698160734108
sim_compute_robot_state-npc0_mean	0.0714846362903683
sim_compute_robot_state-npc0_median	0.07176409577423672
sim_compute_robot_state-npc0_min	0.061843765542862264
sim_compute_robot_state-npc1_max	0.08522218937496487
sim_compute_robot_state-npc1_mean	0.07156426562995846
sim_compute_robot_state-npc1_median	0.0727780996929116
sim_compute_robot_state-npc1_min	0.05980796739459038
sim_compute_robot_state-npc2_max	0.09123110428130884
sim_compute_robot_state-npc2_mean	0.07148248682158118
sim_compute_robot_state-npc2_median	0.07199055293820938
sim_compute_robot_state-npc2_min	0.06020103022456169
sim_compute_robot_state-npc3_max	0.08702670069907209
sim_compute_robot_state-npc3_mean	0.07153028782053275
sim_compute_robot_state-npc3_median	0.07173391727552023
sim_compute_robot_state-npc3_min	0.06085248291492462
sim_compute_sim_state_max	0.04764060493853453
sim_compute_sim_state_mean	0.03982087837156583
sim_compute_sim_state_median	0.03996281418503757
sim_compute_sim_state_min	0.03463747822646553
sim_physics_max	0.22916683361684675
sim_physics_mean	0.1843292896269463
sim_physics_median	0.18198401464832772
sim_physics_min	0.14712389186024666
sim_render-ego_max	0.07936740436142298
sim_render-ego_mean	0.064214635350503
sim_render-ego_median	0.06430235326564807
sim_render-ego_min	0.05446057454914066
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	7.283333333333336
survival_time_min	2.6499999999999986

No reset possible

20970

2884

Andrea Daniele 🇮🇹

minimal_agent (Python 3)

step1-simulation

host-error

2019-04-27 16:08:46+00:00

2019-04-27 17:00:04+00:00

0:51:18

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2884/step1-simulation-ip-172-31-38-104-5376-job20970/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20958

2872

Peter Almasi 🇭🇺

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 16:00:19+00:00

2019-04-27 16:08:18+00:00

0:07:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10175785224719336
survival_time_median	1.6000000000000008
deviation-center-line_median	0.06575789612509737
in-drivable-lane_median	0.20000000000000015

other stats

agent_compute-ego_max	0.19821578456509495
agent_compute-ego_mean	0.18366984396407168
agent_compute-ego_median	0.18075584229968844
agent_compute-ego_min	0.16825730150396173
deviation-center-line_max	0.09825458901850394
deviation-center-line_mean	0.06821725320788706
deviation-center-line_min	0.05006659591104595
deviation-heading_max	0.860855266338527
deviation-heading_mean	0.7612922783340845
deviation-heading_median	0.8250492229012283
deviation-heading_min	0.5170607293955559
driven_any_max	0.23066003524496995
driven_any_mean	0.19120130644651404
driven_any_median	0.1986014497576153
driven_any_min	0.1337818573476724
driven_lanedir_consec_max	0.16600921621115516
driven_lanedir_consec_mean	0.10540603943211048
driven_lanedir_consec_min	0.0652509990213006
driven_lanedir_max	0.16600921621115516
driven_lanedir_mean	0.10540603943211048
driven_lanedir_median	0.10175785224719336
driven_lanedir_min	0.0652509990213006
in-drivable-lane_max	0.5500000000000005
in-drivable-lane_mean	0.2200000000000002
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.1986014497576153, "sim_physics": 0.13651350885629654, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08716628237837964, "sim_render-ego": 0.066544309258461, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.17969194799661636, "deviation-heading": 0.860855266338527, "set_robot_commands": 0.10306291282176971, "deviation-center-line": 0.07145270893083763, "driven_lanedir_consec": 0.08716628237837964, "sim_compute_sim_state": 0.04008844494819641, "sim_compute_performance-ego": 0.07336647808551788, "sim_compute_robot_state-ego": 0.08672594279050827}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23066003524496995, "sim_physics": 0.1326676065271551, "survival_time": 1.6500000000000008, "driven_lanedir": 0.16600921621115516, "sim_render-ego": 0.06378013437444513, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16825730150396173, "deviation-heading": 0.8250492229012283, "set_robot_commands": 0.09871244430541992, "deviation-center-line": 0.06575789612509737, "driven_lanedir_consec": 0.16600921621115516, "sim_compute_sim_state": 0.038610313877914894, "sim_compute_performance-ego": 0.07446872826778528, "sim_compute_robot_state-ego": 0.07642688895716812}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1337818573476724, "sim_physics": 0.1268104144505092, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10684584730252356, "sim_render-ego": 0.06845611617678687, "in-drivable-lane": 0, "agent_compute-ego": 0.18075584229968844, "deviation-heading": 0.5170607293955559, "set_robot_commands": 0.09524770010085332, "deviation-center-line": 0.09825458901850394, "driven_lanedir_consec": 0.10684584730252356, "sim_compute_sim_state": 0.04159081549871536, "sim_compute_performance-ego": 0.07391076996212914, "sim_compute_robot_state-ego": 0.0782425290062314}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20159014471839792, "sim_physics": 0.15052782405506482, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0652509990213006, "sim_render-ego": 0.06770760362798517, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1914283434549967, "deviation-heading": 0.8264501460023753, "set_robot_commands": 0.10307027354384914, "deviation-center-line": 0.05006659591104595, "driven_lanedir_consec": 0.0652509990213006, "sim_compute_sim_state": 0.04159448363564231, "sim_compute_performance-ego": 0.0758568879329797, "sim_compute_robot_state-ego": 0.09604412136655864}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19137304516391465, "sim_physics": 0.140505398473432, "survival_time": 1.5500000000000007, "driven_lanedir": 0.10175785224719336, "sim_render-ego": 0.06376589498212261, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.19821578456509495, "deviation-heading": 0.777046027032736, "set_robot_commands": 0.10532643718104208, "deviation-center-line": 0.055554476053950405, "driven_lanedir_consec": 0.10175785224719336, "sim_compute_sim_state": 0.04109714877220892, "sim_compute_performance-ego": 0.07189589931118873, "sim_compute_robot_state-ego": 0.08857125620688161}}
set_robot_commands_max	0.10532643718104208
set_robot_commands_mean	0.10108395359058683
set_robot_commands_median	0.10306291282176971
set_robot_commands_min	0.09524770010085332
sim_compute_performance-ego_max	0.0758568879329797
sim_compute_performance-ego_mean	0.07389975271192015
sim_compute_performance-ego_median	0.07391076996212914
sim_compute_performance-ego_min	0.07189589931118873
sim_compute_robot_state-ego_max	0.09604412136655864
sim_compute_robot_state-ego_mean	0.0852021476654696
sim_compute_robot_state-ego_median	0.08672594279050827
sim_compute_robot_state-ego_min	0.07642688895716812
sim_compute_sim_state_max	0.04159448363564231
sim_compute_sim_state_mean	0.040596241346535576
sim_compute_sim_state_median	0.04109714877220892
sim_compute_sim_state_min	0.038610313877914894
sim_physics_max	0.15052782405506482
sim_physics_mean	0.13740495047249152
sim_physics_median	0.13651350885629654
sim_physics_min	0.1268104144505092
sim_render-ego_max	0.06845611617678687
sim_render-ego_mean	0.06605081168396015
sim_render-ego_median	0.066544309258461
sim_render-ego_min	0.06376589498212261
simulation-passed	1
survival_time_max	1.6500000000000008
survival_time_mean	1.5000000000000009
survival_time_min	1.0500000000000005

No reset possible

20945

2899

Baseline-IL-logs-tensorflow

step1-simulation

host-error

2019-04-27 15:41:00+00:00

2019-04-27 16:00:05+00:00

0:19:05

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission2899/step1-simulation-ip-172-31-38-104-5376-job20945/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20935

2928

challenge-aido_LF-template-pytorch

step1-simulation

success

2019-04-27 15:22:57+00:00

2019-04-27 15:40:21+00:00

0:17:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.10528715991820636
survival_time_median	1.2500000000000004
deviation-center-line_median	0.08293388183728799
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.20805468559265136
agent_compute-ego_mean	0.1772498724254179
agent_compute-ego_median	0.1757445420537676
agent_compute-ego_min	0.1596690813700358
deviation-center-line_max	0.10286882951680486
deviation-center-line_mean	0.08062850053664491
deviation-center-line_min	0.05352673024997988
deviation-heading_max	0.9510715128258124
deviation-heading_mean	0.7010149979087619
deviation-heading_median	0.8036553251162083
deviation-heading_min	0.4483639089746693
driven_any_max	0.2629388514127423
driven_any_mean	0.17800712754051606
driven_any_median	0.1602164969528906
driven_any_min	0.12938303847580476
driven_lanedir_consec_max	0.17057723068899344
driven_lanedir_consec_mean	0.1194036522090592
driven_lanedir_consec_min	0.08133534473733972
driven_lanedir_max	0.17057723068899344
driven_lanedir_mean	0.1194036522090592
driven_lanedir_median	0.10528715991820636
driven_lanedir_min	0.08133534473733972
in-drivable-lane_max	0.2500000000000002
in-drivable-lane_mean	0.03333333333333336
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.21894765630065505, "sim_physics": 0.22283707346235, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1327114110088199, "sim_render-ego": 0.06623984234673637, "in-drivable-lane": 0, "agent_compute-ego": 0.1757445420537676, "deviation-heading": 0.9140987861785528, "set_robot_commands": 0.0982185857636588, "deviation-center-line": 0.09258507248704258, "driven_lanedir_consec": 0.1327114110088199, "sim_compute_sim_state": 0.04036118303026472, "sim_compute_performance-ego": 0.07247323649270195, "sim_compute_robot_state-ego": 0.07540369885308403, "sim_compute_robot_state-npc0": 0.06978490522929601, "sim_compute_robot_state-npc1": 0.07310471364430018, "sim_compute_robot_state-npc2": 0.06965537582124982, "sim_compute_robot_state-npc3": 0.07153058052062988}, "udem1-1-0": {"driven_any": 0.20311492609043488, "sim_physics": 0.23605470146451676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0908728803227401, "sim_render-ego": 0.06907449449811663, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.1734618374279567, "deviation-heading": 0.8538309934637784, "set_robot_commands": 0.0959468058177403, "deviation-center-line": 0.06343667864984207, "driven_lanedir_consec": 0.0908728803227401, "sim_compute_sim_state": 0.04232041324887957, "sim_compute_performance-ego": 0.07476476260593959, "sim_compute_robot_state-ego": 0.07180285453796387, "sim_compute_robot_state-npc0": 0.07305147818156651, "sim_compute_robot_state-npc1": 0.0705702645438058, "sim_compute_robot_state-npc2": 0.07306088720049177, "sim_compute_robot_state-npc3": 0.07145835672106061}, "udem1-2-0": {"driven_any": 0.13306512519548772, "sim_physics": 0.26207018982280383, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10472988638280788, "sim_render-ego": 0.0682618184523149, "in-drivable-lane": 0, "agent_compute-ego": 0.17010021209716797, "deviation-heading": 0.4483639089746693, "set_robot_commands": 0.0934088013388894, "deviation-center-line": 0.096182935017759, "driven_lanedir_consec": 0.10472988638280788, "sim_compute_sim_state": 0.038049849596890534, "sim_compute_performance-ego": 0.06649421561848033, "sim_compute_robot_state-ego": 0.06943614916367964, "sim_compute_robot_state-npc0": 0.06908846985210072, "sim_compute_robot_state-npc1": 0.07036294720389626, "sim_compute_robot_state-npc2": 0.0737753998149525, "sim_compute_robot_state-npc3": 0.07204112139615146}, "udem1-3-0": {"driven_any": 0.14394820432039512, "sim_physics": 0.28138963742689654, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11247194042169406, "sim_render-ego": 0.0683571533723311, "in-drivable-lane": 0, "agent_compute-ego": 0.19443271376869897, "deviation-heading": 0.4556192681111692, "set_robot_commands": 0.10135346109216864, "deviation-center-line": 0.09417217492766082, "driven_lanedir_consec": 0.11247194042169406, "sim_compute_sim_state": 0.04125756567174738, "sim_compute_performance-ego": 0.07608472217213023, "sim_compute_robot_state-ego": 0.09143625606190074, "sim_compute_robot_state-npc0": 0.07432933287187056, "sim_compute_robot_state-npc1": 0.07358362457968971, "sim_compute_robot_state-npc2": 0.07274961471557617, "sim_compute_robot_state-npc3": 0.07147350094535133}, "udem1-4-0": {"driven_any": 0.13994328921422122, "sim_physics": 0.20027860351230783, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08144828684227479, "sim_render-ego": 0.05762385285418967, "in-drivable-lane": 0, "agent_compute-ego": 0.17092160556627356, "deviation-heading": 0.8036553251162083, "set_robot_commands": 0.09799614159957222, "deviation-center-line": 0.056610021122518686, "driven_lanedir_consec": 0.08144828684227479, "sim_compute_sim_state": 0.039119720458984375, "sim_compute_performance-ego": 0.07155504434005074, "sim_compute_robot_state-ego": 0.07245537509088931, "sim_compute_robot_state-npc0": 0.07256177197331967, "sim_compute_robot_state-npc1": 0.07360708195230235, "sim_compute_robot_state-npc2": 0.0723607643790867, "sim_compute_robot_state-npc3": 0.07638480352318805}, "udem1-5-0": {"driven_any": 0.2629388514127423, "sim_physics": 0.19635956627982004, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17057723068899344, "sim_render-ego": 0.06324789183480399, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17738420622689385, "deviation-heading": 0.8826336930899332, "set_robot_commands": 0.09730582918439593, "deviation-center-line": 0.08230674258234312, "driven_lanedir_consec": 0.17057723068899344, "sim_compute_sim_state": 0.04015031542096819, "sim_compute_performance-ego": 0.06667747497558593, "sim_compute_robot_state-ego": 0.07303753580365863, "sim_compute_robot_state-npc0": 0.07144274711608886, "sim_compute_robot_state-npc1": 0.07330633572169713, "sim_compute_robot_state-npc2": 0.07020048413957869, "sim_compute_robot_state-npc3": 0.07038195473807199}, "udem1-6-0": {"driven_any": 0.1325650250496464, "sim_physics": 0.2707155075940219, "survival_time": 1.1000000000000003, "driven_lanedir": 0.095237038574969, "sim_render-ego": 0.0662078857421875, "in-drivable-lane": 0, "agent_compute-ego": 0.17607626048001376, "deviation-heading": 0.5672368342873931, "set_robot_commands": 0.09243592348965732, "deviation-center-line": 0.07937410610085084, "driven_lanedir_consec": 0.095237038574969, "sim_compute_sim_state": 0.03979089043357155, "sim_compute_performance-ego": 0.07252766869284889, "sim_compute_robot_state-ego": 0.082257173278115, "sim_compute_robot_state-npc0": 0.0671280947598544, "sim_compute_robot_state-npc1": 0.07737038352272728, "sim_compute_robot_state-npc2": 0.07315734299746426, "sim_compute_robot_state-npc3": 0.07212224873629483}, "udem1-7-0": {"driven_any": 0.1999717432364287, "sim_physics": 0.2119347784254286, "survival_time": 1.3500000000000003, "driven_lanedir": 0.16513280142594167, "sim_render-ego": 0.06301050715976292, "in-drivable-lane": 0, "agent_compute-ego": 0.1674578454759386, "deviation-heading": 0.5311370200508537, "set_robot_commands": 0.08729591193022551, "deviation-center-line": 0.1004077809162806, "driven_lanedir_consec": 0.16513280142594167, "sim_compute_sim_state": 0.04007052492212366, "sim_compute_performance-ego": 0.06936664051479763, "sim_compute_robot_state-ego": 0.07822862377873173, "sim_compute_robot_state-npc0": 0.06622942288716634, "sim_compute_robot_state-npc1": 0.06825112413477015, "sim_compute_robot_state-npc2": 0.06457671412715206, "sim_compute_robot_state-npc3": 0.06773820629826298}, "udem1-8-0": {"driven_any": 0.208331514572041, "sim_physics": 0.2066319564293171, "survival_time": 1.4500000000000006, "driven_lanedir": 0.14440779997874742, "sim_render-ego": 0.061156256445522965, "in-drivable-lane": 0, "agent_compute-ego": 0.1720478288058577, "deviation-heading": 0.8083197444646327, "set_robot_commands": 0.09385215825047986, "deviation-center-line": 0.06893580247928391, "driven_lanedir_consec": 0.14440779997874742, "sim_compute_sim_state": 0.0389341979191221, "sim_compute_performance-ego": 0.06841454834773622, "sim_compute_robot_state-ego": 0.07058802966413827, "sim_compute_robot_state-npc0": 0.07044950024834995, "sim_compute_robot_state-npc1": 0.0670830381327662, "sim_compute_robot_state-npc2": 0.0682455013538229, "sim_compute_robot_state-npc3": 0.07155021305741935}, "udem1-9-0": {"driven_any": 0.1602164969528906, "sim_physics": 0.287093448638916, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08133534473733972, "sim_render-ego": 0.07151283264160156, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.20805468559265136, "deviation-heading": 0.8843111783339421, "set_robot_commands": 0.1054702091217041, "deviation-center-line": 0.056391638772318176, "driven_lanedir_consec": 0.08133534473733972, "sim_compute_sim_state": 0.041799554824829104, "sim_compute_performance-ego": 0.07790377616882324, "sim_compute_robot_state-ego": 0.09058913230895996, "sim_compute_robot_state-npc0": 0.07689624786376953, "sim_compute_robot_state-npc1": 0.0782216453552246, "sim_compute_robot_state-npc2": 0.07334417343139649, "sim_compute_robot_state-npc3": 0.07487928390502929}, "udem1-10-0": {"driven_any": 0.15776081734945083, "sim_physics": 0.22562351822853088, "survival_time": 1.2000000000000004, "driven_lanedir": 0.086168531373922, "sim_render-ego": 0.06531224648157756, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17347241441408792, "deviation-heading": 0.8471194303688206, "set_robot_commands": 0.10047302643458048, "deviation-center-line": 0.05352673024997988, "driven_lanedir_consec": 0.086168531373922, "sim_compute_sim_state": 0.039000352223714195, "sim_compute_performance-ego": 0.07293623685836792, "sim_compute_robot_state-ego": 0.07315129041671753, "sim_compute_robot_state-npc0": 0.07316591342290242, "sim_compute_robot_state-npc1": 0.07199602325757344, "sim_compute_robot_state-npc2": 0.07289815942446391, "sim_compute_robot_state-npc3": 0.06962692737579346}, "udem1-11-0": {"driven_any": 0.12938303847580476, "sim_physics": 0.1958552655719575, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09907020891846983, "sim_render-ego": 0.06587033044724237, "in-drivable-lane": 0, "agent_compute-ego": 0.18387341499328613, "deviation-heading": 0.5074240558218013, "set_robot_commands": 0.1013287135532924, "deviation-center-line": 0.0937991012060066, "driven_lanedir_consec": 0.09907020891846983, "sim_compute_sim_state": 0.03940619741167341, "sim_compute_performance-ego": 0.06910220781962077, "sim_compute_robot_state-ego": 0.06868198939732142, "sim_compute_robot_state-npc0": 0.07179847217741467, "sim_compute_robot_state-npc1": 0.07257282166253953, "sim_compute_robot_state-npc2": 0.06976658957345146, "sim_compute_robot_state-npc3": 0.0670741739727202}, "udem1-12-0": {"driven_any": 0.2524948602570649, "sim_physics": 0.23904044181108475, "survival_time": 1.6000000000000008, "driven_lanedir": 0.16668902959455556, "sim_render-ego": 0.06357449293136597, "in-drivable-lane": 0, "agent_compute-ego": 0.1760571375489235, "deviation-heading": 0.9510715128258124, "set_robot_commands": 0.09882105141878128, "deviation-center-line": 0.10286882951680486, "driven_lanedir_consec": 0.16668902959455556, "sim_compute_sim_state": 0.04288433492183685, "sim_compute_performance-ego": 0.06630011647939682, "sim_compute_robot_state-ego": 0.07656168192625046, "sim_compute_robot_state-npc0": 0.07128023356199265, "sim_compute_robot_state-npc1": 0.07374337315559387, "sim_compute_robot_state-npc2": 0.07596991956233978, "sim_compute_robot_state-npc3": 0.07321661710739136}, "udem1-13-0": {"driven_any": 0.13671914630859436, "sim_physics": 0.2540375164576939, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10528715991820636, "sim_render-ego": 0.06387011210123698, "in-drivable-lane": 0, "agent_compute-ego": 0.1596690813700358, "deviation-heading": 0.4621029895746055, "set_robot_commands": 0.09064426876249768, "deviation-center-line": 0.08293388183728799, "driven_lanedir_consec": 0.10528715991820636, "sim_compute_sim_state": 0.03854305403573172, "sim_compute_performance-ego": 0.07180039087931316, "sim_compute_robot_state-ego": 0.07657494999113537, "sim_compute_robot_state-npc0": 0.06923694837661017, "sim_compute_robot_state-npc1": 0.06691315060570127, "sim_compute_robot_state-npc2": 0.06910031182425362, "sim_compute_robot_state-npc3": 0.0743322599501837}, "udem1-14-0": {"driven_any": 0.19070621837188337, "sim_physics": 0.222613290504173, "survival_time": 1.3500000000000003, "driven_lanedir": 0.15491523294640652, "sim_render-ego": 0.07466544928374114, "in-drivable-lane": 0, "agent_compute-ego": 0.179994300559715, "deviation-heading": 0.598300227969255, "set_robot_commands": 0.0984602239396837, "deviation-center-line": 0.0858960121836947, "driven_lanedir_consec": 0.15491523294640652, "sim_compute_sim_state": 0.03947803709242079, "sim_compute_performance-ego": 0.07207818384523745, "sim_compute_robot_state-ego": 0.07952974460743091, "sim_compute_robot_state-npc0": 0.07225204397130895, "sim_compute_robot_state-npc1": 0.07650582878677933, "sim_compute_robot_state-npc2": 0.06987459571273238, "sim_compute_robot_state-npc3": 0.06970787048339844}}
set_robot_commands_max	0.1054702091217041
set_robot_commands_mean	0.09686740744648852
set_robot_commands_median	0.09799614159957222
set_robot_commands_min	0.08729591193022551
sim_compute_performance-ego_max	0.07790377616882324
sim_compute_performance-ego_mean	0.07123194838740204
sim_compute_performance-ego_median	0.07180039087931316
sim_compute_performance-ego_min	0.06630011647939682
sim_compute_robot_state-ego_max	0.09143625606190074
sim_compute_robot_state-ego_mean	0.07664896565866512
sim_compute_robot_state-ego_median	0.07540369885308403
sim_compute_robot_state-ego_min	0.06868198939732142
sim_compute_robot_state-npc0_max	0.07689624786376953
sim_compute_robot_state-npc0_mean	0.07124637216624077
sim_compute_robot_state-npc0_median	0.07144274711608886
sim_compute_robot_state-npc0_min	0.06622942288716634
sim_compute_robot_state-npc1_max	0.0782216453552246
sim_compute_robot_state-npc1_mean	0.07247949041729114
sim_compute_robot_state-npc1_median	0.07310471364430018
sim_compute_robot_state-npc1_min	0.06691315060570127
sim_compute_robot_state-npc2_max	0.07596991956233978
sim_compute_robot_state-npc2_mean	0.07124905560520083
sim_compute_robot_state-npc2_median	0.0723607643790867
sim_compute_robot_state-npc2_min	0.06457671412715206
sim_compute_robot_state-npc3_max	0.07638480352318805
sim_compute_robot_state-npc3_mean	0.07156787458206314
sim_compute_robot_state-npc3_median	0.07153058052062988
sim_compute_robot_state-npc3_min	0.0670741739727202
sim_compute_sim_state_max	0.04288433492183685
sim_compute_sim_state_mean	0.04007774608085055
sim_compute_sim_state_median	0.03979089043357155
sim_compute_sim_state_min	0.038049849596890534
sim_physics_max	0.287093448638916
sim_physics_mean	0.2341690330419879
sim_physics_median	0.22562351822853088
sim_physics_min	0.1958552655719575
sim_render-ego_max	0.07466544928374114
sim_render-ego_mean	0.06586567777284877
sim_render-ego_median	0.06587033044724237
sim_render-ego_min	0.05762385285418967
simulation-passed	1
survival_time_max	1.7500000000000009
survival_time_mean	1.2866666666666675
survival_time_min	1.0500000000000005

No reset possible

20933

2932

Baseline solution using reinforcement learning

step1-simulation

error

2019-04-27 15:21:42+00:00

2019-04-27 15:22:16+00:00

0:00:34

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20927

2961

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 15:03:36+00:00

2019-04-27 15:21:35+00:00

0:17:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3367864089732566
survival_time_median	5.849999999999987
deviation-center-line_median	0.2554902568586787
in-drivable-lane_median	2.1999999999999975

other stats

agent_compute-ego_max	0.24007154112102605
agent_compute-ego_mean	0.22734429472762183
agent_compute-ego_median	0.22448353281991928
agent_compute-ego_min	0.21617711618028837
deviation-center-line_max	0.4345876632868504
deviation-center-line_mean	0.2719778313835613
deviation-center-line_min	0.1876872560451181
deviation-heading_max	1.917915002672519
deviation-heading_mean	1.4301324883249988
deviation-heading_median	1.4900369759810888
deviation-heading_min	0.7566176083959606
driven_any_max	1.0816519147725905
driven_any_mean	0.7807300303158516
driven_any_median	0.7459370334992764
driven_any_min	0.6121357307742481
driven_lanedir_consec_max	0.6390381935203924
driven_lanedir_consec_mean	0.369902949081384
driven_lanedir_consec_min	0.25287850459943817
driven_lanedir_max	0.6470112749525847
driven_lanedir_mean	0.3719402072275649
driven_lanedir_median	0.3367864089732566
driven_lanedir_min	0.25287850459943817
in-drivable-lane_max	3.149999999999989
in-drivable-lane_mean	2.249999999999993
in-drivable-lane_min	1.5499999999999945
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0816519147725905, "sim_physics": 0.1911750396568618, "survival_time": 8.349999999999984, "driven_lanedir": 0.6470112749525847, "sim_render-ego": 0.06450972157324146, "in-drivable-lane": 2.1999999999999975, "agent_compute-ego": 0.22448353281991928, "deviation-heading": 1.917915002672519, "set_robot_commands": 0.0995308324962319, "deviation-center-line": 0.4345876632868504, "driven_lanedir_consec": 0.6390381935203924, "sim_compute_sim_state": 0.04029326239031946, "sim_compute_performance-ego": 0.07307985014544276, "sim_compute_robot_state-ego": 0.07824435205516701, "sim_compute_robot_state-npc0": 0.07205985834498606, "sim_compute_robot_state-npc1": 0.07154300112924177, "sim_compute_robot_state-npc2": 0.0730717439137533, "sim_compute_robot_state-npc3": 0.07544016409776881}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7459370334992764, "sim_physics": 0.21398045466496393, "survival_time": 5.849999999999987, "driven_lanedir": 0.25287850459943817, "sim_render-ego": 0.0651654422792614, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.23286413331317085, "deviation-heading": 0.7566176083959606, "set_robot_commands": 0.1010943722521138, "deviation-center-line": 0.26602363241167937, "driven_lanedir_consec": 0.25287850459943817, "sim_compute_sim_state": 0.04101162079053047, "sim_compute_performance-ego": 0.07430225152235764, "sim_compute_robot_state-ego": 0.0814164255419348, "sim_compute_robot_state-npc0": 0.07331217048514603, "sim_compute_robot_state-npc1": 0.07334454650552864, "sim_compute_robot_state-npc2": 0.0715330625191713, "sim_compute_robot_state-npc3": 0.07073375710055359}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6745882427566999, "sim_physics": 0.17378029946623175, "survival_time": 5.799999999999987, "driven_lanedir": 0.34152962785345986, "sim_render-ego": 0.06323297064879844, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.21617711618028837, "deviation-heading": 1.6334002116014756, "set_robot_commands": 0.09846513024691878, "deviation-center-line": 0.2554902568586787, "driven_lanedir_consec": 0.34152962785345986, "sim_compute_sim_state": 0.040808077516226934, "sim_compute_performance-ego": 0.07116087140708134, "sim_compute_robot_state-ego": 0.07306694778902777, "sim_compute_robot_state-npc0": 0.07229509641384256, "sim_compute_robot_state-npc1": 0.06981002256788056, "sim_compute_robot_state-npc2": 0.0706457516242718, "sim_compute_robot_state-npc3": 0.06942466826274477}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7893372297764434, "sim_physics": 0.18494807571924032, "survival_time": 5.949999999999987, "driven_lanedir": 0.3367864089732566, "sim_render-ego": 0.06578059156401818, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.24007154112102605, "deviation-heading": 1.35269264297395, "set_robot_commands": 0.10071910529577432, "deviation-center-line": 0.2161003483154797, "driven_lanedir_consec": 0.3367864089732566, "sim_compute_sim_state": 0.042629368164960074, "sim_compute_performance-ego": 0.07333952639283252, "sim_compute_robot_state-ego": 0.08135460004085253, "sim_compute_robot_state-npc0": 0.07162437118402049, "sim_compute_robot_state-npc1": 0.07364173095767237, "sim_compute_robot_state-npc2": 0.07614116909123268, "sim_compute_robot_state-npc3": 0.07436756927426122}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.6121357307742481, "sim_physics": 0.17163093090057374, "survival_time": 4.99999999999999, "driven_lanedir": 0.281495219759085, "sim_render-ego": 0.06727890253067016, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.22312515020370485, "deviation-heading": 1.4900369759810888, "set_robot_commands": 0.0977594518661499, "deviation-center-line": 0.1876872560451181, "driven_lanedir_consec": 0.27928201046037304, "sim_compute_sim_state": 0.03999229192733764, "sim_compute_performance-ego": 0.07271554946899414, "sim_compute_robot_state-ego": 0.0781783938407898, "sim_compute_robot_state-npc0": 0.07332074880599976, "sim_compute_robot_state-npc1": 0.07427725553512574, "sim_compute_robot_state-npc2": 0.07049023389816284, "sim_compute_robot_state-npc3": 0.0705389904975891}}
set_robot_commands_max	0.1010943722521138
set_robot_commands_mean	0.09951377843143774
set_robot_commands_median	0.0995308324962319
set_robot_commands_min	0.0977594518661499
sim_compute_performance-ego_max	0.07430225152235764
sim_compute_performance-ego_mean	0.07291960978734169
sim_compute_performance-ego_median	0.07307985014544276
sim_compute_performance-ego_min	0.07116087140708134
sim_compute_robot_state-ego_max	0.0814164255419348
sim_compute_robot_state-ego_mean	0.07845214385355438
sim_compute_robot_state-ego_median	0.07824435205516701
sim_compute_robot_state-ego_min	0.07306694778902777
sim_compute_robot_state-npc0_max	0.07332074880599976
sim_compute_robot_state-npc0_mean	0.07252244904679897
sim_compute_robot_state-npc0_median	0.07229509641384256
sim_compute_robot_state-npc0_min	0.07162437118402049
sim_compute_robot_state-npc1_max	0.07427725553512574
sim_compute_robot_state-npc1_mean	0.07252331133908982
sim_compute_robot_state-npc1_median	0.07334454650552864
sim_compute_robot_state-npc1_min	0.06981002256788056
sim_compute_robot_state-npc2_max	0.07614116909123268
sim_compute_robot_state-npc2_mean	0.07237639220931838
sim_compute_robot_state-npc2_median	0.0715330625191713
sim_compute_robot_state-npc2_min	0.07049023389816284
sim_compute_robot_state-npc3_max	0.07544016409776881
sim_compute_robot_state-npc3_mean	0.0721010298465835
sim_compute_robot_state-npc3_median	0.07073375710055359
sim_compute_robot_state-npc3_min	0.06942466826274477
sim_compute_sim_state_max	0.042629368164960074
sim_compute_sim_state_mean	0.04094692415787492
sim_compute_sim_state_median	0.040808077516226934
sim_compute_sim_state_min	0.03999229192733764
sim_physics_max	0.21398045466496393
sim_physics_mean	0.1871029600815743
sim_physics_median	0.18494807571924032
sim_physics_min	0.17163093090057374
sim_render-ego_max	0.06727890253067016
sim_render-ego_mean	0.06519352571919793
sim_render-ego_median	0.0651654422792614
sim_render-ego_min	0.06323297064879844
simulation-passed	1
survival_time_max	8.349999999999984
survival_time_mean	6.189999999999987
survival_time_min	4.99999999999999

No reset possible

20856

3058

Andrea Censi 🇨🇭

rotation

step1-simulation

host-error

2019-04-27 14:00:30+00:00

2019-04-27 15:00:12+00:00

0:59:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-testing/submission3058/step1-simulation-ip-172-31-38-104-5376-job20856/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20853

3038

Manfred Diaz

challenge-aido_LF-template-pytorch

step1-simulation

host-error

2019-04-27 13:58:21+00:00

2019-04-27 14:00:03+00:00

0:01:42

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission3038/step1-simulation-ip-172-31-38-104-5376-job20853/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20829

3079

aido2-LFVI-sim-validation

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-04-27 13:25:42+00:00

2019-04-27 13:57:54+00:00

0:32:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8645584780667197
survival_time_median	14.950000000000076
deviation-center-line_median	0.6386085426081696
in-drivable-lane_median	2.1500000000000306

other stats

agent_compute-ego_max	0.23208486715952556
agent_compute-ego_mean	0.22618355430182768
agent_compute-ego_median	0.2294725728034973
agent_compute-ego_min	0.2149138553937276
deviation-center-line_max	1.1737004342543906
deviation-center-line_mean	0.6568888887294707
deviation-center-line_min	0.4022255732010137
deviation-heading_max	1.6135075460955428
deviation-heading_mean	1.3718976495221225
deviation-heading_median	1.5585359942484258
deviation-heading_min	0.9984231701155272
driven_any_max	1.3761814646393389
driven_any_mean	1.017282898432779
driven_any_median	1.3733322458051855
driven_any_min	0.43826884240006975
driven_lanedir_consec_max	0.9310890473958268
driven_lanedir_consec_mean	0.722074702354438
driven_lanedir_consec_min	0.42792269885208434
driven_lanedir_max	1.1662617851244812
driven_lanedir_mean	0.7691092499001689
driven_lanedir_median	0.8645584780667197
driven_lanedir_min	0.42792269885208434
in-drivable-lane_max	5.300000000000075
in-drivable-lane_mean	2.510000000000036
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.3733322458051855, "sim_physics": 0.20558502674102783, "survival_time": 14.950000000000076, "driven_lanedir": 1.1662617851244812, "sim_render-ego": 0.0627173646291097, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.2149138553937276, "deviation-heading": 0.9984231701155272, "set_robot_commands": 0.09815272251764934, "deviation-center-line": 1.1737004342543906, "driven_lanedir_consec": 0.9310890473958268, "sim_compute_sim_state": 0.040414516925811765, "sim_compute_performance-ego": 0.06723611275355021, "sim_compute_robot_state-ego": 0.07286540428797404, "sim_compute_robot_state-npc0": 0.07011233011881511, "sim_compute_robot_state-npc1": 0.07005455493927001, "sim_compute_robot_state-npc2": 0.07109182198842366, "sim_compute_robot_state-npc3": 0.07036913792292276}, "udem1-1-0": {"driven_any": 0.5230333430126016, "sim_physics": 0.20099932662511277, "survival_time": 5.899999999999987, "driven_lanedir": 0.5034278660058491, "sim_render-ego": 0.06193482471724688, "in-drivable-lane": 0, "agent_compute-ego": 0.23160392349049197, "deviation-heading": 1.6135075460955428, "set_robot_commands": 0.09746459379034528, "deviation-center-line": 0.42766981121416486, "driven_lanedir_consec": 0.5034278660058491, "sim_compute_sim_state": 0.03971864409365897, "sim_compute_performance-ego": 0.06986159187252239, "sim_compute_robot_state-ego": 0.07407598374253613, "sim_compute_robot_state-npc0": 0.07051082990937314, "sim_compute_robot_state-npc1": 0.06874749822131658, "sim_compute_robot_state-npc2": 0.06824542910365736, "sim_compute_robot_state-npc3": 0.0688236042604608}, "udem1-2-0": {"driven_any": 1.3761814646393389, "sim_physics": 0.20771637439727783, "survival_time": 14.950000000000076, "driven_lanedir": 0.8645584780667197, "sim_render-ego": 0.06505587975184123, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.22284255266189576, "deviation-heading": 1.59085608678617, "set_robot_commands": 0.09783459027608236, "deviation-center-line": 0.6386085426081696, "driven_lanedir_consec": 0.8645584780667197, "sim_compute_sim_state": 0.040482753912607826, "sim_compute_performance-ego": 0.06970676342646281, "sim_compute_robot_state-ego": 0.07662079016367594, "sim_compute_robot_state-npc0": 0.07117399136225383, "sim_compute_robot_state-npc1": 0.07246983130772909, "sim_compute_robot_state-npc2": 0.07187770128250122, "sim_compute_robot_state-npc3": 0.0707258121172587}, "udem1-3-0": {"driven_any": 1.3755985963067003, "sim_physics": 0.20903393268585205, "survival_time": 14.950000000000076, "driven_lanedir": 0.8833754214517102, "sim_render-ego": 0.0640119194984436, "in-drivable-lane": 5.1000000000000725, "agent_compute-ego": 0.23208486715952556, "deviation-heading": 1.5585359942484258, "set_robot_commands": 0.09788573344548544, "deviation-center-line": 0.6422400823696148, "driven_lanedir_consec": 0.8833754214517102, "sim_compute_sim_state": 0.04008094469706217, "sim_compute_performance-ego": 0.0721263837814331, "sim_compute_robot_state-ego": 0.07689483165740967, "sim_compute_robot_state-npc0": 0.07130082050959269, "sim_compute_robot_state-npc1": 0.07137057304382324, "sim_compute_robot_state-npc2": 0.07119614283243815, "sim_compute_robot_state-npc3": 0.07087203582127889}, "udem1-4-0": {"driven_any": 0.43826884240006975, "sim_physics": 0.2055382561683655, "survival_time": 4.99999999999999, "driven_lanedir": 0.42792269885208434, "sim_render-ego": 0.06448162078857422, "in-drivable-lane": 0, "agent_compute-ego": 0.2294725728034973, "deviation-heading": 1.0981654503649465, "set_robot_commands": 0.09886894464492796, "deviation-center-line": 0.4022255732010137, "driven_lanedir_consec": 0.42792269885208434, "sim_compute_sim_state": 0.040119454860687256, "sim_compute_performance-ego": 0.07149788618087768, "sim_compute_robot_state-ego": 0.07779635429382324, "sim_compute_robot_state-npc0": 0.07054194688796997, "sim_compute_robot_state-npc1": 0.07130589962005615, "sim_compute_robot_state-npc2": 0.0694752049446106, "sim_compute_robot_state-npc3": 0.07079111814498901}}
set_robot_commands_max	0.09886894464492796
set_robot_commands_mean	0.09804131693489808
set_robot_commands_median	0.09788573344548544
set_robot_commands_min	0.09746459379034528
sim_compute_performance-ego_max	0.0721263837814331
sim_compute_performance-ego_mean	0.07008574760296923
sim_compute_performance-ego_median	0.06986159187252239
sim_compute_performance-ego_min	0.06723611275355021
sim_compute_robot_state-ego_max	0.07779635429382324
sim_compute_robot_state-ego_mean	0.0756506728290838
sim_compute_robot_state-ego_median	0.07662079016367594
sim_compute_robot_state-ego_min	0.07286540428797404
sim_compute_robot_state-npc0_max	0.07130082050959269
sim_compute_robot_state-npc0_mean	0.07072798375760095
sim_compute_robot_state-npc0_median	0.07054194688796997
sim_compute_robot_state-npc0_min	0.07011233011881511
sim_compute_robot_state-npc1_max	0.07246983130772909
sim_compute_robot_state-npc1_mean	0.07078967142643902
sim_compute_robot_state-npc1_median	0.07130589962005615
sim_compute_robot_state-npc1_min	0.06874749822131658
sim_compute_robot_state-npc2_max	0.07187770128250122
sim_compute_robot_state-npc2_mean	0.07037726003032618
sim_compute_robot_state-npc2_median	0.07109182198842366
sim_compute_robot_state-npc2_min	0.06824542910365736
sim_compute_robot_state-npc3_max	0.07087203582127889
sim_compute_robot_state-npc3_mean	0.07031634165338203
sim_compute_robot_state-npc3_median	0.0707258121172587
sim_compute_robot_state-npc3_min	0.0688236042604608
sim_compute_sim_state_max	0.040482753912607826
sim_compute_sim_state_mean	0.0401632628979656
sim_compute_sim_state_median	0.040119454860687256
sim_compute_sim_state_min	0.03971864409365897
sim_physics_max	0.20903393268585205
sim_physics_mean	0.2057745833235272
sim_physics_median	0.20558502674102783
sim_physics_min	0.20099932662511277
sim_render-ego_max	0.06505587975184123
sim_render-ego_mean	0.06364032187704313
sim_render-ego_median	0.0640119194984436
sim_render-ego_min	0.06193482471724688
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	11.15000000000004
survival_time_min	4.99999999999999

No reset possible

20810

3102

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

success

2019-04-27 13:00:30+00:00

2019-04-27 13:25:34+00:00

0:25:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.3914174549651501
survival_time_median	14.950000000000076
deviation-center-line_median	0.6331035964040842
in-drivable-lane_median	5.550000000000034

other stats

agent_compute-ego_max	0.22997439861297608
agent_compute-ego_mean	0.2226763568170666
agent_compute-ego_median	0.22106427510579427
agent_compute-ego_min	0.2171296286582947
deviation-center-line_max	1.297264847469063
deviation-center-line_mean	0.7232563782424948
deviation-center-line_min	0.4881512328708114
deviation-heading_max	3.642797815567504
deviation-heading_mean	2.154851464347199
deviation-heading_median	1.724521625729046
deviation-heading_min	1.1914699701032785
driven_any_max	0.9418412762407362
driven_any_mean	0.86295570796407
driven_any_median	0.9263289345823552
driven_any_min	0.674603669587458
driven_lanedir_consec_max	0.8618993594585911
driven_lanedir_consec_mean	0.5358444245845745
driven_lanedir_consec_min	0.31079818146614757
driven_lanedir_max	0.8618993594585911
driven_lanedir_mean	0.5358444245845745
driven_lanedir_median	0.3914174549651501
driven_lanedir_min	0.31079818146614757
in-drivable-lane_max	9.250000000000089
in-drivable-lane_mean	4.720000000000043
in-drivable-lane_min	0.4000000000000057
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8323113207815316, "sim_physics": 0.11615791916847228, "survival_time": 13.200000000000053, "driven_lanedir": 0.3914174549651501, "sim_render-ego": 0.06461625568794482, "in-drivable-lane": 6.700000000000068, "agent_compute-ego": 0.22651927489222903, "deviation-heading": 1.1914699701032785, "set_robot_commands": 0.10353358586629231, "deviation-center-line": 0.6937371940556569, "driven_lanedir_consec": 0.3914174549651501, "sim_compute_sim_state": 0.04083369446523262, "sim_compute_performance-ego": 0.07315402861797449, "sim_compute_robot_state-ego": 0.07825407566446246}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9263289345823552, "sim_physics": 0.11870046059290568, "survival_time": 14.950000000000076, "driven_lanedir": 0.3114803517618425, "sim_render-ego": 0.06496784130732218, "in-drivable-lane": 9.250000000000089, "agent_compute-ego": 0.22997439861297608, "deviation-heading": 1.724521625729046, "set_robot_commands": 0.10058892647425334, "deviation-center-line": 0.4881512328708114, "driven_lanedir_consec": 0.3114803517618425, "sim_compute_sim_state": 0.0396884020169576, "sim_compute_performance-ego": 0.0724797773361206, "sim_compute_robot_state-ego": 0.07994150400161742}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9396933386282692, "sim_physics": 0.12424333890279134, "survival_time": 14.950000000000076, "driven_lanedir": 0.8618993594585911, "sim_render-ego": 0.06499473571777344, "in-drivable-lane": 0.4000000000000057, "agent_compute-ego": 0.22106427510579427, "deviation-heading": 3.642797815567504, "set_robot_commands": 0.09933485507965088, "deviation-center-line": 1.297264847469063, "driven_lanedir_consec": 0.8618993594585911, "sim_compute_sim_state": 0.03929676055908203, "sim_compute_performance-ego": 0.06967852115631104, "sim_compute_robot_state-ego": 0.07443153381347656}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9418412762407362, "sim_physics": 0.11395822604497274, "survival_time": 14.950000000000076, "driven_lanedir": 0.8036267752711415, "sim_render-ego": 0.0638148848215739, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.2171296286582947, "deviation-heading": 2.7366070782471863, "set_robot_commands": 0.09745728810628256, "deviation-center-line": 0.6331035964040842, "driven_lanedir_consec": 0.8036267752711415, "sim_compute_sim_state": 0.03949706315994263, "sim_compute_performance-ego": 0.06984872817993164, "sim_compute_robot_state-ego": 0.07507818619410198}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.674603669587458, "sim_physics": 0.1268323978147895, "survival_time": 11.050000000000022, "driven_lanedir": 0.31079818146614757, "sim_render-ego": 0.061729862679183754, "in-drivable-lane": 5.550000000000034, "agent_compute-ego": 0.21869420681603893, "deviation-heading": 1.4788608320889824, "set_robot_commands": 0.09849911901206453, "deviation-center-line": 0.5040250204128586, "driven_lanedir_consec": 0.31079818146614757, "sim_compute_sim_state": 0.04045707823464234, "sim_compute_performance-ego": 0.06885729116552017, "sim_compute_robot_state-ego": 0.07445303886724274}}
set_robot_commands_max	0.10353358586629231
set_robot_commands_mean	0.09988275490770872
set_robot_commands_median	0.09933485507965088
set_robot_commands_min	0.09745728810628256
sim_compute_performance-ego_max	0.07315402861797449
sim_compute_performance-ego_mean	0.07080366929117159
sim_compute_performance-ego_median	0.06984872817993164
sim_compute_performance-ego_min	0.06885729116552017
sim_compute_robot_state-ego_max	0.07994150400161742
sim_compute_robot_state-ego_mean	0.07643166770818025
sim_compute_robot_state-ego_median	0.07507818619410198
sim_compute_robot_state-ego_min	0.07443153381347656
sim_compute_sim_state_max	0.04083369446523262
sim_compute_sim_state_mean	0.039954599687171445
sim_compute_sim_state_median	0.0396884020169576
sim_compute_sim_state_min	0.03929676055908203
sim_physics_max	0.1268323978147895
sim_physics_mean	0.1199784685047863
sim_physics_median	0.11870046059290568
sim_physics_min	0.11395822604497274
sim_render-ego_max	0.06499473571777344
sim_render-ego_mean	0.06402471604275961
sim_render-ego_median	0.06461625568794482
sim_render-ego_min	0.061729862679183754
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	13.82000000000006
survival_time_min	11.050000000000022

No reset possible

20798

3104

Angel Woo 🇭🇰

HKU Duckietown Project

step1-simulation

host-error

2019-04-27 12:36:11+00:00

2019-04-27 13:00:12+00:00

0:24:01

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission3104/step1-simulation-ip-172-31-38-104-5376-job20798/logs/challenges-runner/stdout.log'

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

20778

2970

Andrea Censi 🇨🇭

minimal_agent (Python 3)

step1-simulation

success