Evaluator 1582

step1-simulation

success

2019-11-08 08:14:20+00:00

2019-11-08 08:30:09+00:00

0:15:49

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.803610132946188
survival_time_median	5.699999999999988
deviation-center-line_median	0.28233850021916257
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.024238775571187338
agent_compute-ego_mean	0.023611552186520536
agent_compute-ego_median	0.02355010509490967
agent_compute-ego_min	0.022841377691789108
deviation-center-line_max	1.029823361828506
deviation-center-line_mean	0.39124329656704554
deviation-center-line_min	0.09991271976185707
deviation-heading_max	3.591480020253549
deviation-heading_mean	1.919977688948017
deviation-heading_median	1.920585266174882
deviation-heading_min	0.44146359435453303
driven_any_max	5.579411222527039
driven_any_mean	2.4473357263020743
driven_any_median	1.9446796615485713
driven_any_min	0.4530107961772199
driven_lanedir_consec_max	5.058270552493939
driven_lanedir_consec_mean	1.9092201243512623
driven_lanedir_consec_min	0.4253811327068524
driven_lanedir_max	5.058270552493939
driven_lanedir_mean	1.9167909919128057
driven_lanedir_median	1.803610132946188
driven_lanedir_min	0.4253811327068524
in-drivable-lane_max	5.000000000000049
in-drivable-lane_mean	0.9266666666666682
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 5.4415030263711515, "sim_physics": 0.055671226978302, "survival_time": 14.950000000000076, "driven_lanedir": 5.058270552493939, "sim_render-ego": 0.007166984875996907, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.024238775571187338, "deviation-heading": 3.591480020253549, "set_robot_commands": 0.00506583054860433, "deviation-center-line": 1.029823361828506, "driven_lanedir_consec": 5.058270552493939, "sim_compute_sim_state": 0.002949859301249186, "sim_compute_performance-ego": 0.004051499366760254, "sim_compute_robot_state-ego": 0.005095094045003255}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3232724114047096, "sim_physics": 0.05674997016565123, "survival_time": 6.699999999999984, "driven_lanedir": 1.9055660711317857, "sim_render-ego": 0.007135841383862852, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.023187680030936627, "deviation-heading": 2.659833836809776, "set_robot_commands": 0.005032656797722204, "deviation-center-line": 0.33606753589821303, "driven_lanedir_consec": 1.8316602978591208, "sim_compute_sim_state": 0.0028968942699147695, "sim_compute_performance-ego": 0.00395238577429928, "sim_compute_robot_state-ego": 0.004977848992418887}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.9081157171611616, "sim_physics": 0.05550911077638952, "survival_time": 8.199999999999982, "driven_lanedir": 2.3978147336096054, "sim_render-ego": 0.007035658126924096, "in-drivable-lane": 0.75, "agent_compute-ego": 0.023478579230424835, "deviation-heading": 2.6161275550837915, "set_robot_commands": 0.004944424803664044, "deviation-center-line": 0.4805299576107346, "driven_lanedir_consec": 2.3978147336096054, "sim_compute_sim_state": 0.002905662466840046, "sim_compute_performance-ego": 0.00392359931294511, "sim_compute_robot_state-ego": 0.004989544065987192}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4530107961772199, "sim_physics": 0.05851572354634603, "survival_time": 1.5000000000000009, "driven_lanedir": 0.4253811327068524, "sim_render-ego": 0.007195973396301269, "in-drivable-lane": 0, "agent_compute-ego": 0.02355010509490967, "deviation-heading": 0.44146359435453303, "set_robot_commands": 0.005035797754923503, "deviation-center-line": 0.09991271976185707, "driven_lanedir_consec": 0.4253811327068524, "sim_compute_sim_state": 0.0028981765111287436, "sim_compute_performance-ego": 0.003924353917439779, "sim_compute_robot_state-ego": 0.004955776532491048}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.7160470539489654, "sim_physics": 0.05569557794710485, "survival_time": 10.25000000000001, "driven_lanedir": 2.818180296187097, "sim_render-ego": 0.007065810226812595, "in-drivable-lane": 1.7999999999999954, "agent_compute-ego": 0.02388157611939965, "deviation-heading": 2.734446415537624, "set_robot_commands": 0.005021669806503668, "deviation-center-line": 0.6133710020126046, "driven_lanedir_consec": 2.818180296187097, "sim_compute_sim_state": 0.0029653444522764623, "sim_compute_performance-ego": 0.003978869973159418, "sim_compute_robot_state-ego": 0.005144737987983518}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.4125088153235184, "sim_physics": 0.053129454453786217, "survival_time": 6.5999999999999845, "driven_lanedir": 1.1936065590320135, "sim_render-ego": 0.007024028084494851, "in-drivable-lane": 2.499999999999991, "agent_compute-ego": 0.022841377691789108, "deviation-heading": 1.920585266174882, "set_robot_commands": 0.005064942620017312, "deviation-center-line": 0.23708894891641105, "driven_lanedir_consec": 1.1936065590320135, "sim_compute_sim_state": 0.0029013951619466147, "sim_compute_performance-ego": 0.003940829724976511, "sim_compute_robot_state-ego": 0.004943556857831551}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.9446796615485713, "sim_physics": 0.0563718485382368, "survival_time": 5.299999999999989, "driven_lanedir": 1.8483705730810776, "sim_render-ego": 0.007254605023366101, "in-drivable-lane": 0, "agent_compute-ego": 0.02412463808959385, "deviation-heading": 1.3527471696246482, "set_robot_commands": 0.005059451427099839, "deviation-center-line": 0.22075322882000936, "driven_lanedir_consec": 1.8483705730810776, "sim_compute_sim_state": 0.003002875256088545, "sim_compute_performance-ego": 0.004035101746613125, "sim_compute_robot_state-ego": 0.005149555656145203}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.9300511908541471, "sim_physics": 0.05556136892552961, "survival_time": 5.699999999999988, "driven_lanedir": 1.364516621034345, "sim_render-ego": 0.0071937661421926395, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.02385871870475903, "deviation-heading": 2.165531243055752, "set_robot_commands": 0.005171137943602445, "deviation-center-line": 0.271863078347221, "driven_lanedir_consec": 1.3248593808838685, "sim_compute_sim_state": 0.002999391472130491, "sim_compute_performance-ego": 0.003988199066697506, "sim_compute_robot_state-ego": 0.005133277491519326}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.9731432273959164, "sim_physics": 0.055476372702079904, "survival_time": 2.849999999999998, "driven_lanedir": 0.8951479534550275, "sim_render-ego": 0.007150294487936455, "in-drivable-lane": 0, "agent_compute-ego": 0.023269778803775187, "deviation-heading": 0.8988365701622821, "set_robot_commands": 0.004992217348332991, "deviation-center-line": 0.13841751404188946, "driven_lanedir_consec": 0.8951479534550275, "sim_compute_sim_state": 0.002904737204836126, "sim_compute_performance-ego": 0.003948763797157689, "sim_compute_robot_state-ego": 0.00502457953335946}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0255087166564107, "sim_physics": 0.05790708462397257, "survival_time": 2.9999999999999973, "driven_lanedir": 0.655906651884788, "sim_render-ego": 0.007148810227711995, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.023711697260538737, "deviation-heading": 0.8938739838462335, "set_robot_commands": 0.005021504561106364, "deviation-center-line": 0.12518543937353466, "driven_lanedir_consec": 0.655906651884788, "sim_compute_sim_state": 0.002912139892578125, "sim_compute_performance-ego": 0.003977743784586588, "sim_compute_robot_state-ego": 0.004999335606892904}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5404923708557086, "sim_physics": 0.058866437824293114, "survival_time": 4.3499999999999925, "driven_lanedir": 1.0712607599896853, "sim_render-ego": 0.0071898520677939224, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.02383792537382279, "deviation-heading": 1.1049849449082545, "set_robot_commands": 0.005039311003410953, "deviation-center-line": 0.1726507241005046, "driven_lanedir_consec": 1.0712607599896853, "sim_compute_sim_state": 0.0029496488900020205, "sim_compute_performance-ego": 0.003974108860410493, "sim_compute_robot_state-ego": 0.005097992118747755}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.939756480833239, "sim_physics": 0.05897596394904306, "survival_time": 5.349999999999989, "driven_lanedir": 1.803610132946188, "sim_render-ego": 0.007174471828425042, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.02405665745244962, "deviation-heading": 1.1709588402529354, "set_robot_commands": 0.005039716435370044, "deviation-center-line": 0.28233850021916257, "driven_lanedir_consec": 1.803610132946188, "sim_compute_sim_state": 0.002995950039302077, "sim_compute_performance-ego": 0.003973341433801384, "sim_compute_robot_state-ego": 0.0051691910930883106}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.3264427719066445, "sim_physics": 0.05542666571480887, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1841441048942032, "sim_render-ego": 0.007127823767723975, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.023149326250150606, "deviation-heading": 1.3677693735055247, "set_robot_commands": 0.004914608868685636, "deviation-center-line": 0.2951700222770752, "driven_lanedir_consec": 1.1841441048942032, "sim_compute_sim_state": 0.0028869486474371576, "sim_compute_performance-ego": 0.003933782701368456, "sim_compute_robot_state-ego": 0.004939587085278003}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.196092431566709, "sim_physics": 0.05590377699944281, "survival_time": 9.299999999999995, "driven_lanedir": 2.8475975775735463, "sim_render-ego": 0.007050309129940566, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.023471150346981585, "deviation-heading": 2.505835278379396, "set_robot_commands": 0.005057090072221653, "deviation-center-line": 0.6134180917385803, "driven_lanedir_consec": 2.8475975775735463, "sim_compute_sim_state": 0.002921913259772844, "sim_compute_performance-ego": 0.003956158955891927, "sim_compute_robot_state-ego": 0.004992019745611375}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 5.579411222527039, "sim_physics": 0.05415552377700806, "survival_time": 14.950000000000076, "driven_lanedir": 3.282491158671932, "sim_render-ego": 0.006987526416778565, "in-drivable-lane": 5.000000000000049, "agent_compute-ego": 0.023515296777089436, "deviation-heading": 3.375191242271067, "set_robot_commands": 0.005075779755910238, "deviation-center-line": 0.9520593235593792, "driven_lanedir_consec": 3.282491158671932, "sim_compute_sim_state": 0.0029598395029703777, "sim_compute_performance-ego": 0.003979557355244954, "sim_compute_robot_state-ego": 0.005074654420216878}}
set_robot_commands_max	0.005171137943602445
set_robot_commands_mean	0.005035742649811683
set_robot_commands_median	0.005039311003410953
set_robot_commands_min	0.004914608868685636
sim_compute_performance-ego_max	0.004051499366760254
sim_compute_performance-ego_mean	0.003969219718090165
sim_compute_performance-ego_median	0.003973341433801384
sim_compute_performance-ego_min	0.00392359931294511
sim_compute_robot_state-ego_max	0.0051691910930883106
sim_compute_robot_state-ego_mean	0.0050457834155049775
sim_compute_robot_state-ego_median	0.00502457953335946
sim_compute_robot_state-ego_min	0.004939587085278003
sim_compute_sim_state_max	0.003002875256088545
sim_compute_sim_state_mean	0.0029367184218982395
sim_compute_sim_state_median	0.002921913259772844
sim_compute_sim_state_min	0.0028869486474371576
sim_physics_max	0.05897596394904306
sim_physics_mean	0.05626107379479965
sim_physics_median	0.05569557794710485
sim_physics_min	0.053129454453786217
sim_render-ego_max	0.007254605023366101
sim_render-ego_mean	0.007126783679084121
sim_render-ego_median	0.007148810227711995
sim_render-ego_min	0.006987526416778565
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	6.856666666666671
survival_time_min	1.5000000000000009

No reset possible

25123

4393

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-11-07 14:24:09+00:00

2019-11-07 14:32:34+00:00

0:08:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.36592094708219225
survival_time_median	2.5999999999999988
deviation-center-line_median	0.16987818035809085
in-drivable-lane_median	0.05000000000000005

other stats

agent_compute-ego_max	0.024411901350944273
agent_compute-ego_mean	0.0229193856437555
agent_compute-ego_median	0.022925922503838177
agent_compute-ego_min	0.02120097726583481
deviation-center-line_max	0.2294363663374862
deviation-center-line_mean	0.14972083567701736
deviation-center-line_min	0.06426934298501713
deviation-heading_max	0.6986268167330367
deviation-heading_mean	0.4280304166285302
deviation-heading_median	0.41847631252347706
deviation-heading_min	0.2596285487829773
driven_any_max	1.2972979671834337
driven_any_mean	0.7173901327940223
driven_any_median	0.7336463183586179
driven_any_min	0.26903550091980144
driven_lanedir_consec_max	0.97716132702229
driven_lanedir_consec_mean	0.5227475277218055
driven_lanedir_consec_min	0.2407721645627201
driven_lanedir_max	0.97716132702229
driven_lanedir_mean	0.5227475277218055
driven_lanedir_median	0.36592094708219225
driven_lanedir_min	0.2407721645627201
in-drivable-lane_max	1.8999999999999944
in-drivable-lane_mean	0.5799999999999983
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9226822529128632, "sim_physics": 0.15392644304624745, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.013193896119023713, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.023769838709226797, "deviation-heading": 0.2596285487829773, "set_robot_commands": 0.008419980465526312, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.005151597546859526, "sim_compute_performance-ego": 0.006902671196091343, "sim_compute_robot_state-ego": 0.009028391099311936, "sim_compute_robot_state-npc0": 0.008472341886708434, "sim_compute_robot_state-npc1": 0.008425124934021855, "sim_compute_robot_state-npc2": 0.009153228410532776, "sim_compute_robot_state-npc3": 0.00868444711389676}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953953, "sim_physics": 0.18438798189163208, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.012830302119255066, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.02120097726583481, "deviation-heading": 0.6986268167330367, "set_robot_commands": 0.015377141535282137, "deviation-center-line": 0.10463456752710912, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.004755742847919464, "sim_compute_performance-ego": 0.006536148488521576, "sim_compute_robot_state-ego": 0.00809912383556366, "sim_compute_robot_state-npc0": 0.008008860051631927, "sim_compute_robot_state-npc1": 0.007528774440288544, "sim_compute_robot_state-npc2": 0.007684998214244843, "sim_compute_robot_state-npc3": 0.007959634065628052}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586179, "sim_physics": 0.1832199004980234, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.01257552091891949, "in-drivable-lane": 0, "agent_compute-ego": 0.022925922503838177, "deviation-heading": 0.27230767118055227, "set_robot_commands": 0.008795550236335168, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.005011723591731145, "sim_compute_performance-ego": 0.0069167843231788045, "sim_compute_robot_state-ego": 0.00938118421114408, "sim_compute_robot_state-npc0": 0.008642623057732215, "sim_compute_robot_state-npc1": 0.008583903312683105, "sim_compute_robot_state-npc2": 0.008320868015289307, "sim_compute_robot_state-npc3": 0.008542400140028734}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.16837582536922988, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.0122544252744285, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.024411901350944273, "deviation-heading": 0.49111273392260785, "set_robot_commands": 0.008970188838179393, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.004895082084081506, "sim_compute_performance-ego": 0.007278806419782741, "sim_compute_robot_state-ego": 0.009075682650330246, "sim_compute_robot_state-npc0": 0.00864807508325064, "sim_compute_robot_state-npc1": 0.008168246156425887, "sim_compute_robot_state-npc2": 0.008635787553684686, "sim_compute_robot_state-npc3": 0.008052636218327348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.15377551033383324, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.011117969240461077, "in-drivable-lane": 0, "agent_compute-ego": 0.022288288388933455, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.00848887080237979, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.004460187185378302, "sim_compute_performance-ego": 0.0056838080996558776, "sim_compute_robot_state-ego": 0.007647775468372163, "sim_compute_robot_state-npc0": 0.007830313273838587, "sim_compute_robot_state-npc1": 0.008001327514648438, "sim_compute_robot_state-npc2": 0.007678713117327008, "sim_compute_robot_state-npc3": 0.007176649002801804}}
set_robot_commands_max	0.015377141535282137
set_robot_commands_mean	0.01001034637554056
set_robot_commands_median	0.008795550236335168
set_robot_commands_min	0.008419980465526312
sim_compute_performance-ego_max	0.007278806419782741
sim_compute_performance-ego_mean	0.006663643705446069
sim_compute_performance-ego_median	0.006902671196091343
sim_compute_performance-ego_min	0.0056838080996558776
sim_compute_robot_state-ego_max	0.00938118421114408
sim_compute_robot_state-ego_mean	0.008646431452944418
sim_compute_robot_state-ego_median	0.009028391099311936
sim_compute_robot_state-ego_min	0.007647775468372163
sim_compute_robot_state-npc0_max	0.00864807508325064
sim_compute_robot_state-npc0_mean	0.008320442670632361
sim_compute_robot_state-npc0_median	0.008472341886708434
sim_compute_robot_state-npc0_min	0.007830313273838587
sim_compute_robot_state-npc1_max	0.008583903312683105
sim_compute_robot_state-npc1_mean	0.008141475271613565
sim_compute_robot_state-npc1_median	0.008168246156425887
sim_compute_robot_state-npc1_min	0.007528774440288544
sim_compute_robot_state-npc2_max	0.009153228410532776
sim_compute_robot_state-npc2_mean	0.008294719062215723
sim_compute_robot_state-npc2_median	0.008320868015289307
sim_compute_robot_state-npc2_min	0.007678713117327008
sim_compute_robot_state-npc3_max	0.00868444711389676
sim_compute_robot_state-npc3_mean	0.00808315330813654
sim_compute_robot_state-npc3_median	0.008052636218327348
sim_compute_robot_state-npc3_min	0.007176649002801804
sim_compute_sim_state_max	0.005151597546859526
sim_compute_sim_state_mean	0.004854866651193989
sim_compute_sim_state_median	0.004895082084081506
sim_compute_sim_state_min	0.004460187185378302
sim_physics_max	0.18438798189163208
sim_physics_mean	0.1687371322277932
sim_physics_median	0.16837582536922988
sim_physics_min	0.15377551033383324
sim_render-ego_max	0.013193896119023713
sim_render-ego_mean	0.012394422734417569
sim_render-ego_median	0.01257552091891949
sim_render-ego_min	0.011117969240461077
simulation-passed	1
survival_time_max	4.6499999999999915
survival_time_mean	2.6899999999999973
survival_time_min	1.0500000000000005

No reset possible

25101

4382

Soroush Saryazdi 🇨🇦

bluejay

step1-simulation

failed

2019-11-06 18:40:19+00:00

2019-11-06 18:46:05+00:00

0:05:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 296, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 239, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 68 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25086

4372

Peter Almasi 🇭🇺

reinforcement-learning-submission

step1-simulation

success

2019-11-05 18:00:17+00:00

2019-11-05 18:10:04+00:00

0:09:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.972281995417
survival_time_median	10.25000000000001
deviation-center-line_median	0.3910857812695708
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.02368151585261027
agent_compute-ego_mean	0.023302187192048084
agent_compute-ego_median	0.023255557548709033
agent_compute-ego_min	0.02287209192911784
deviation-center-line_max	0.7731038338304332
deviation-center-line_mean	0.4610060441534867
deviation-center-line_min	0.2860401247681476
deviation-heading_max	2.997791755383848
deviation-heading_mean	2.573055077293361
deviation-heading_median	2.746632842127778
deviation-heading_min	1.8238130372987875
driven_any_max	1.6668257354577245
driven_any_mean	1.157129388476242
driven_any_median	1.0529719503000996
driven_any_min	0.4531719870299544
driven_lanedir_consec_max	1.6235357607815455
driven_lanedir_consec_mean	1.098601170503817
driven_lanedir_consec_min	0.3898223252814712
driven_lanedir_max	1.6235357607815455
driven_lanedir_mean	1.098601170503817
driven_lanedir_median	0.972281995417
driven_lanedir_min	0.3898223252814712
in-drivable-lane_max	0.10000000000000142
in-drivable-lane_mean	0.03000000000000025
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4531719870299544, "sim_physics": 0.052868845642253914, "survival_time": 4.6499999999999915, "driven_lanedir": 0.3898223252814712, "sim_render-ego": 0.00701645625534878, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.023451661550870504, "deviation-heading": 1.8238130372987875, "set_robot_commands": 0.005087770441527008, "deviation-center-line": 0.2860401247681476, "driven_lanedir_consec": 0.3898223252814712, "sim_compute_sim_state": 0.0027665322826754663, "sim_compute_performance-ego": 0.004153646448607086, "sim_compute_robot_state-ego": 0.0048342648372855235}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6668257354577245, "sim_physics": 0.0536384646097819, "survival_time": 14.950000000000076, "driven_lanedir": 1.6235357607815455, "sim_render-ego": 0.006960570017496745, "in-drivable-lane": 0, "agent_compute-ego": 0.02287209192911784, "deviation-heading": 2.746632842127778, "set_robot_commands": 0.005073641141255697, "deviation-center-line": 0.7731038338304332, "driven_lanedir_consec": 1.6235357607815455, "sim_compute_sim_state": 0.0028520854314168296, "sim_compute_performance-ego": 0.003939606348673502, "sim_compute_robot_state-ego": 0.004962642987569173}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.614475248035844, "sim_physics": 0.05636476993560791, "survival_time": 14.950000000000076, "driven_lanedir": 1.5748989204251462, "sim_render-ego": 0.007109347184499105, "in-drivable-lane": 0, "agent_compute-ego": 0.02368151585261027, "deviation-heading": 2.7654870389903636, "set_robot_commands": 0.005156710147857666, "deviation-center-line": 0.32195094651516654, "driven_lanedir_consec": 1.5748989204251462, "sim_compute_sim_state": 0.003063867092132569, "sim_compute_performance-ego": 0.003960038026173909, "sim_compute_robot_state-ego": 0.005176022847493489}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0529719503000996, "sim_physics": 0.0558507535515762, "survival_time": 10.25000000000001, "driven_lanedir": 0.972281995417, "sim_render-ego": 0.007081464441811166, "in-drivable-lane": 0, "agent_compute-ego": 0.023255557548709033, "deviation-heading": 2.997791755383848, "set_robot_commands": 0.005091198479256979, "deviation-center-line": 0.5328495343841154, "driven_lanedir_consec": 0.972281995417, "sim_compute_sim_state": 0.002910297672923018, "sim_compute_performance-ego": 0.003924482624705245, "sim_compute_robot_state-ego": 0.004984445106692431}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9982020215575887, "sim_physics": 0.054016329804245304, "survival_time": 9.800000000000004, "driven_lanedir": 0.9324668506139226, "sim_render-ego": 0.007050884013273278, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.023250109078932785, "deviation-heading": 2.531550712666029, "set_robot_commands": 0.0051919951730844925, "deviation-center-line": 0.3910857812695708, "driven_lanedir_consec": 0.9324668506139226, "sim_compute_sim_state": 0.0029555863263655683, "sim_compute_performance-ego": 0.0039313605853489465, "sim_compute_robot_state-ego": 0.005023337140375254}}
set_robot_commands_max	0.0051919951730844925
set_robot_commands_mean	0.005120263076596369
set_robot_commands_median	0.005091198479256979
set_robot_commands_min	0.005073641141255697
sim_compute_performance-ego_max	0.004153646448607086
sim_compute_performance-ego_mean	0.003981826806701738
sim_compute_performance-ego_median	0.003939606348673502
sim_compute_performance-ego_min	0.003924482624705245
sim_compute_robot_state-ego_max	0.005176022847493489
sim_compute_robot_state-ego_mean	0.004996142583883175
sim_compute_robot_state-ego_median	0.004984445106692431
sim_compute_robot_state-ego_min	0.0048342648372855235
sim_compute_sim_state_max	0.003063867092132569
sim_compute_sim_state_mean	0.00290967376110269
sim_compute_sim_state_median	0.002910297672923018
sim_compute_sim_state_min	0.0027665322826754663
sim_physics_max	0.05636476993560791
sim_physics_mean	0.054547832708693046
sim_physics_median	0.054016329804245304
sim_physics_min	0.052868845642253914
sim_render-ego_max	0.007109347184499105
sim_render-ego_mean	0.007043744382485814
sim_render-ego_median	0.007050884013273278
sim_render-ego_min	0.006960570017496745
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.920000000000032
survival_time_min	4.6499999999999915

No reset possible

25072

4370

Jeick Hincapie Barrera 🇨🇴

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-11-05 15:16:13+00:00

2019-11-05 15:30:15+00:00

0:14:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2166768559433363
survival_time_median	1.3000000000000005
deviation-center-line_median	0.09372831765405172
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.02908165638263409
agent_compute-ego_mean	0.020170217422938463
agent_compute-ego_median	0.016948699951171875
agent_compute-ego_min	0.01581111408415295
deviation-center-line_max	0.3817503152875977
deviation-center-line_mean	0.12820877291325816
deviation-center-line_min	0.046602073323489576
deviation-heading_max	1.8181979908720587
deviation-heading_mean	0.7123572875376226
deviation-heading_median	0.5290015218495018
deviation-heading_min	0.3674246186853157
driven_any_max	1.165231647692107
driven_any_mean	0.3553589390628455
driven_any_median	0.2540479925050478
driven_any_min	0.1093747611903104
driven_lanedir_consec_max	0.5085771228431653
driven_lanedir_consec_mean	0.24455790426851143
driven_lanedir_consec_min	0.07007627457011378
driven_lanedir_max	0.6905520099531925
driven_lanedir_mean	0.26174258683892443
driven_lanedir_median	0.2166768559433363
driven_lanedir_min	0.07007627457011378
in-drivable-lane_max	1.499999999999995
in-drivable-lane_mean	0.1899999999999995
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 0.34396662550771145, "sim_physics": 0.17363803203289324, "survival_time": 1.3000000000000005, "driven_lanedir": 0.30541432398320123, "sim_render-ego": 0.0110090604195228, "in-drivable-lane": 0, "agent_compute-ego": 0.02908165638263409, "deviation-heading": 0.49730551094684183, "set_robot_commands": 0.009148661906902607, "deviation-center-line": 0.09372831765405172, "driven_lanedir_consec": 0.30541432398320123, "sim_compute_sim_state": 0.004377282582796537, "sim_compute_performance-ego": 0.0066876961634709286, "sim_compute_robot_state-ego": 0.007998090523939867, "sim_compute_robot_state-npc0": 0.00851891590998723, "sim_compute_robot_state-npc1": 0.007567671629098745, "sim_compute_robot_state-npc2": 0.00815442892221304, "sim_compute_robot_state-npc3": 0.006944500482999361}, "udem1-1-0": {"driven_any": 0.31767048631665534, "sim_physics": 0.1777823107583182, "survival_time": 1.7500000000000009, "driven_lanedir": 0.26384461505040413, "sim_render-ego": 0.012383747100830076, "in-drivable-lane": 0, "agent_compute-ego": 0.026714440754481723, "deviation-heading": 0.9159288962134144, "set_robot_commands": 0.008838605880737305, "deviation-center-line": 0.13114315449335556, "driven_lanedir_consec": 0.26384461505040413, "sim_compute_sim_state": 0.004924631118774414, "sim_compute_performance-ego": 0.0065062522888183595, "sim_compute_robot_state-ego": 0.008434200286865234, "sim_compute_robot_state-npc0": 0.00800633430480957, "sim_compute_robot_state-npc1": 0.007701969146728516, "sim_compute_robot_state-npc2": 0.007946450369698661, "sim_compute_robot_state-npc3": 0.007728133882795062}, "udem1-2-0": {"driven_any": 0.1308657650943136, "sim_physics": 0.27951326089746814, "survival_time": 0.8500000000000002, "driven_lanedir": 0.09302082003180656, "sim_render-ego": 0.013693697312298945, "in-drivable-lane": 0, "agent_compute-ego": 0.02881439994363224, "deviation-heading": 0.3828197149378233, "set_robot_commands": 0.010294198989868164, "deviation-center-line": 0.07637276514857867, "driven_lanedir_consec": 0.09302082003180656, "sim_compute_sim_state": 0.005155240788179285, "sim_compute_performance-ego": 0.007812542073866901, "sim_compute_robot_state-ego": 0.00975481201620663, "sim_compute_robot_state-npc0": 0.009217122021843403, "sim_compute_robot_state-npc1": 0.00848085740033318, "sim_compute_robot_state-npc2": 0.008307905758128446, "sim_compute_robot_state-npc3": 0.00897678206948673}, "udem1-3-0": {"driven_any": 0.16685305484522803, "sim_physics": 0.17644591331481935, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1436202462008469, "sim_render-ego": 0.01126363754272461, "in-drivable-lane": 0, "agent_compute-ego": 0.024210987091064454, "deviation-heading": 0.5290015218495018, "set_robot_commands": 0.008579111099243164, "deviation-center-line": 0.12018273040915232, "driven_lanedir_consec": 0.1436202462008469, "sim_compute_sim_state": 0.003839836120605469, "sim_compute_performance-ego": 0.005907306671142578, "sim_compute_robot_state-ego": 0.007804555892944336, "sim_compute_robot_state-npc0": 0.006481256484985352, "sim_compute_robot_state-npc1": 0.006604671478271484, "sim_compute_robot_state-npc2": 0.0068857669830322266, "sim_compute_robot_state-npc3": 0.006063108444213867}, "udem1-4-0": {"driven_any": 0.4324904071553749, "sim_physics": 0.14030705480014577, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4166801643931464, "sim_render-ego": 0.010074229801402372, "in-drivable-lane": 0, "agent_compute-ego": 0.021747596123639273, "deviation-heading": 0.4160547005282229, "set_robot_commands": 0.006439671796910903, "deviation-center-line": 0.1463590264423817, "driven_lanedir_consec": 0.4166801643931464, "sim_compute_sim_state": 0.004015410647672766, "sim_compute_performance-ego": 0.005763369448044721, "sim_compute_robot_state-ego": 0.007364511489868164, "sim_compute_robot_state-npc0": 0.006710936041439281, "sim_compute_robot_state-npc1": 0.00771786886103013, "sim_compute_robot_state-npc2": 0.006321886006523581, "sim_compute_robot_state-npc3": 0.0064560315188239605}, "udem1-5-0": {"driven_any": 0.30783124050178984, "sim_physics": 0.11992498448020532, "survival_time": 1.900000000000001, "driven_lanedir": 0.26376661519436784, "sim_render-ego": 0.007808892350447805, "in-drivable-lane": 0, "agent_compute-ego": 0.0211509528912996, "deviation-heading": 0.7443908753231055, "set_robot_commands": 0.005724756341231496, "deviation-center-line": 0.11165756582953631, "driven_lanedir_consec": 0.26376661519436784, "sim_compute_sim_state": 0.0031657595383493523, "sim_compute_performance-ego": 0.004297858790347451, "sim_compute_robot_state-ego": 0.005542598272624768, "sim_compute_robot_state-npc0": 0.00531832167976781, "sim_compute_robot_state-npc1": 0.005209138518885562, "sim_compute_robot_state-npc2": 0.005211347027828819, "sim_compute_robot_state-npc3": 0.005154866921274285}, "udem1-6-0": {"driven_any": 0.2404150431525979, "sim_physics": 0.1610575133356555, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2166768559433363, "sim_render-ego": 0.008753579238365436, "in-drivable-lane": 0, "agent_compute-ego": 0.019902196423760777, "deviation-heading": 0.527660137926357, "set_robot_commands": 0.006440187322682348, "deviation-center-line": 0.13726913467005172, "driven_lanedir_consec": 0.2166768559433363, "sim_compute_sim_state": 0.00343493757576778, "sim_compute_performance-ego": 0.004803813737014244, "sim_compute_robot_state-ego": 0.005950171371986126, "sim_compute_robot_state-npc0": 0.005730620745954843, "sim_compute_robot_state-npc1": 0.005658840310984644, "sim_compute_robot_state-npc2": 0.005905669310997273, "sim_compute_robot_state-npc3": 0.005759148762143892}, "udem1-7-0": {"driven_any": 0.1093747611903104, "sim_physics": 0.12355852127075195, "survival_time": 0.9500000000000004, "driven_lanedir": 0.07007627457011378, "sim_render-ego": 0.00731172059711657, "in-drivable-lane": 0, "agent_compute-ego": 0.016948699951171875, "deviation-heading": 0.4520847054275865, "set_robot_commands": 0.0048792362213134766, "deviation-center-line": 0.07364217099241512, "driven_lanedir_consec": 0.07007627457011378, "sim_compute_sim_state": 0.0027288386696263365, "sim_compute_performance-ego": 0.0039168157075580795, "sim_compute_robot_state-ego": 0.004886551907188014, "sim_compute_robot_state-npc0": 0.00469266740899337, "sim_compute_robot_state-npc1": 0.004607752749794408, "sim_compute_robot_state-npc2": 0.004570534354762027, "sim_compute_robot_state-npc3": 0.004584412825734992}, "udem1-8-0": {"driven_any": 0.18091716158787235, "sim_physics": 0.1006591103293679, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11054805351857544, "sim_render-ego": 0.007038896734064276, "in-drivable-lane": 0, "agent_compute-ego": 0.01605745879086581, "deviation-heading": 0.5793756490496974, "set_robot_commands": 0.004726724191145463, "deviation-center-line": 0.046602073323489576, "driven_lanedir_consec": 0.11054805351857544, "sim_compute_sim_state": 0.002704696221785112, "sim_compute_performance-ego": 0.00384565916928378, "sim_compute_robot_state-ego": 0.004758997396989303, "sim_compute_robot_state-npc0": 0.004626675085587935, "sim_compute_robot_state-npc1": 0.004533594304865057, "sim_compute_robot_state-npc2": 0.004512526772238992, "sim_compute_robot_state-npc3": 0.004493800076571378}, "udem1-9-0": {"driven_any": 0.4188047829632969, "sim_physics": 0.1217183570067088, "survival_time": 2.3999999999999995, "driven_lanedir": 0.3298312703407651, "sim_render-ego": 0.0072625478108723955, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.01660544176896413, "deviation-heading": 0.8874830346428473, "set_robot_commands": 0.004926005999247233, "deviation-center-line": 0.09295848756345676, "driven_lanedir_consec": 0.3298312703407651, "sim_compute_sim_state": 0.002754971385002136, "sim_compute_performance-ego": 0.0038994004329045615, "sim_compute_robot_state-ego": 0.004981373747189839, "sim_compute_robot_state-npc0": 0.00474017858505249, "sim_compute_robot_state-npc1": 0.004649837811787923, "sim_compute_robot_state-npc2": 0.004612520337104797, "sim_compute_robot_state-npc3": 0.004582618673642476}, "udem1-10-0": {"driven_any": 0.2540479925050478, "sim_physics": 0.10141185613778922, "survival_time": 1.3000000000000005, "driven_lanedir": 0.21120947148572955, "sim_render-ego": 0.007143726715674767, "in-drivable-lane": 0, "agent_compute-ego": 0.016441950431236856, "deviation-heading": 0.6284334967306285, "set_robot_commands": 0.004704741331247183, "deviation-center-line": 0.07018450075027294, "driven_lanedir_consec": 0.21120947148572955, "sim_compute_sim_state": 0.002691058012155386, "sim_compute_performance-ego": 0.003838630822988657, "sim_compute_robot_state-ego": 0.0048452982535729045, "sim_compute_robot_state-npc0": 0.0045756376706636865, "sim_compute_robot_state-npc1": 0.004507633355947642, "sim_compute_robot_state-npc2": 0.004494822942293608, "sim_compute_robot_state-npc3": 0.004477610954871545}, "udem1-11-0": {"driven_any": 0.18250404247529703, "sim_physics": 0.10465540383991442, "survival_time": 0.9500000000000004, "driven_lanedir": 0.15418391009800647, "sim_render-ego": 0.007315209037379215, "in-drivable-lane": 0, "agent_compute-ego": 0.016284515983179995, "deviation-heading": 0.3674246186853157, "set_robot_commands": 0.004746813523141961, "deviation-center-line": 0.08746402875819435, "driven_lanedir_consec": 0.15418391009800647, "sim_compute_sim_state": 0.0027053607137579668, "sim_compute_performance-ego": 0.0038901504717375104, "sim_compute_robot_state-ego": 0.004804937463057668, "sim_compute_robot_state-npc0": 0.004642147766916375, "sim_compute_robot_state-npc1": 0.00453320302461323, "sim_compute_robot_state-npc2": 0.004500225970619603, "sim_compute_robot_state-npc3": 0.004513853474667198}, "udem1-12-0": {"driven_any": 0.9005313562752438, "sim_physics": 0.11219390029581185, "survival_time": 5.849999999999987, "driven_lanedir": 0.5175748026289857, "sim_render-ego": 0.0069569542876675595, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.0160525639851888, "deviation-heading": 1.8181979908720587, "set_robot_commands": 0.0047298496604984645, "deviation-center-line": 0.3817503152875977, "driven_lanedir_consec": 0.5085771228431653, "sim_compute_sim_state": 0.0027493126371986847, "sim_compute_performance-ego": 0.0038402671487922342, "sim_compute_robot_state-ego": 0.0048908433343610195, "sim_compute_robot_state-npc0": 0.00464523551810501, "sim_compute_robot_state-npc1": 0.004534599108573718, "sim_compute_robot_state-npc2": 0.0045155419243706595, "sim_compute_robot_state-npc3": 0.004488525227603749}, "udem1-13-0": {"driven_any": 0.17887971867983632, "sim_physics": 0.10493898391723631, "survival_time": 1.0500000000000005, "driven_lanedir": 0.13913936919138914, "sim_render-ego": 0.007232507069905599, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01672928673880441, "deviation-heading": 0.382320208013339, "set_robot_commands": 0.00480674562000093, "deviation-center-line": 0.08282054793201442, "driven_lanedir_consec": 0.13913936919138914, "sim_compute_sim_state": 0.0027770428430466424, "sim_compute_performance-ego": 0.003896406718662807, "sim_compute_robot_state-ego": 0.005083356584821429, "sim_compute_robot_state-npc0": 0.004726739156813849, "sim_compute_robot_state-npc1": 0.0045588697705950055, "sim_compute_robot_state-npc2": 0.0045339493524460565, "sim_compute_robot_state-npc3": 0.004527284985496884}, "udem1-14-0": {"driven_any": 1.165231647692107, "sim_physics": 0.10500890016555786, "survival_time": 4.199999999999993, "driven_lanedir": 0.6905520099531925, "sim_render-ego": 0.006997409321012951, "in-drivable-lane": 1.0999999999999983, "agent_compute-ego": 0.01581111408415295, "deviation-heading": 1.556878251917598, "set_robot_commands": 0.004815919058663505, "deviation-center-line": 0.27099677444432346, "driven_lanedir_consec": 0.4417794511828179, "sim_compute_sim_state": 0.002758210613614037, "sim_compute_performance-ego": 0.003863161518460228, "sim_compute_robot_state-ego": 0.004881254264286586, "sim_compute_robot_state-npc0": 0.004679455643608456, "sim_compute_robot_state-npc1": 0.004560533024015881, "sim_compute_robot_state-npc2": 0.004537026087443034, "sim_compute_robot_state-npc3": 0.004533299377986363}}
set_robot_commands_max	0.010294198989868164
set_robot_commands_mean	0.006253415262855614
set_robot_commands_median	0.004926005999247233
set_robot_commands_min	0.004704741331247183
sim_compute_performance-ego_max	0.007812542073866901
sim_compute_performance-ego_mean	0.004851288744206203
sim_compute_performance-ego_median	0.0039168157075580795
sim_compute_performance-ego_min	0.003838630822988657
sim_compute_robot_state-ego_max	0.00975481201620663
sim_compute_robot_state-ego_mean	0.006132103520393459
sim_compute_robot_state-ego_median	0.005083356584821429
sim_compute_robot_state-ego_min	0.004758997396989303
sim_compute_robot_state-npc0_max	0.009217122021843403
sim_compute_robot_state-npc0_mean	0.005820816268301911
sim_compute_robot_state-npc0_median	0.00474017858505249
sim_compute_robot_state-npc0_min	0.0045756376706636865
sim_compute_robot_state-npc1_max	0.00848085740033318
sim_compute_robot_state-npc1_mean	0.005695136033035009
sim_compute_robot_state-npc1_median	0.004649837811787923
sim_compute_robot_state-npc1_min	0.004507633355947642
sim_compute_robot_state-npc2_max	0.008307905758128446
sim_compute_robot_state-npc2_mean	0.005667373474646723
sim_compute_robot_state-npc2_median	0.004612520337104797
sim_compute_robot_state-npc2_min	0.004494822942293608
sim_compute_robot_state-npc3_max	0.00897678206948673
sim_compute_robot_state-npc3_mean	0.005552265178554117
sim_compute_robot_state-npc3_median	0.004584412825734992
sim_compute_robot_state-npc3_min	0.004477610954871545
sim_compute_sim_state_max	0.005155240788179285
sim_compute_sim_state_mean	0.0033855059645554603
sim_compute_sim_state_median	0.0027770428430466424
sim_compute_sim_state_min	0.002691058012155386
sim_physics_max	0.27951326089746814
sim_physics_mean	0.14018760683884293
sim_physics_median	0.1217183570067088
sim_physics_min	0.1006591103293679
sim_render-ego_max	0.013693697312298945
sim_render-ego_mean	0.008816387689285691
sim_render-ego_median	0.007315209037379215
sim_render-ego_min	0.0069569542876675595
simulation-passed	1
survival_time_max	5.849999999999987
survival_time_mean	1.8666666666666656
survival_time_min	0.8500000000000002

No reset possible

25015

4361

Soroush Saryazdi 🇨🇦

bluejay

step1-simulation

error

2019-11-04 15:16:56+00:00

2019-11-04 15:20:28+00:00

0:03:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

25013

4352

challenge-aido_LF-template-tensorflow

step1-simulation

success

2019-11-04 14:18:53+00:00

2019-11-04 14:33:24+00:00

0:14:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2340229374462308
survival_time_median	1.1000000000000003
deviation-center-line_median	0.0848539960543871
in-drivable-lane_median	0

other stats

agent_compute-ego_max	0.028863225664411272
agent_compute-ego_mean	0.02015456009358647
agent_compute-ego_median	0.020310396101416613
agent_compute-ego_min	0.016074093905362217
deviation-center-line_max	0.5780618275923667
deviation-center-line_mean	0.14464727626553903
deviation-center-line_min	0.05307263042689575
deviation-heading_max	3.771066158168097
deviation-heading_mean	0.9633231437836354
deviation-heading_median	0.5674114432155569
deviation-heading_min	0.2658894096015568
driven_any_max	2.5385346876248085
driven_any_mean	0.5942156590485169
driven_any_median	0.27936457610577575
driven_any_min	0.1398176531905168
driven_lanedir_consec_max	1.2358706340920032
driven_lanedir_consec_mean	0.3134540412477475
driven_lanedir_consec_min	0.0986669764609558
driven_lanedir_max	1.2358706340920032
driven_lanedir_mean	0.3163673594297586
driven_lanedir_median	0.2340229374462308
driven_lanedir_min	0.0986669764609558
in-drivable-lane_max	6.750000000000013
in-drivable-lane_mean	0.7433333333333343
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22001812857202752, "sim_physics": 0.16608768417721703, "survival_time": 1.0500000000000005, "driven_lanedir": 0.14097554442747784, "sim_render-ego": 0.0113503478822254, "in-drivable-lane": 0, "agent_compute-ego": 0.028863225664411272, "deviation-heading": 0.609016412435369, "set_robot_commands": 0.007450262705485026, "deviation-center-line": 0.07041263804309175, "driven_lanedir_consec": 0.14097554442747784, "sim_compute_sim_state": 0.0042765821729387555, "sim_compute_performance-ego": 0.006180672418503534, "sim_compute_robot_state-ego": 0.007901169004894439, "sim_compute_robot_state-npc0": 0.007695118586222331, "sim_compute_robot_state-npc1": 0.007775454294113885, "sim_compute_robot_state-npc2": 0.007770583743140811, "sim_compute_robot_state-npc3": 0.00719852674575079}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.745409706383797, "sim_physics": 0.15015604034546884, "survival_time": 3.099999999999997, "driven_lanedir": 0.3359816155191351, "sim_render-ego": 0.009510209483485068, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.020814795647898027, "deviation-heading": 1.0421339588291858, "set_robot_commands": 0.0069268403514739, "deviation-center-line": 0.12554067392638604, "driven_lanedir_consec": 0.3359816155191351, "sim_compute_sim_state": 0.003770297573458764, "sim_compute_performance-ego": 0.005533922103143508, "sim_compute_robot_state-ego": 0.007059954827831638, "sim_compute_robot_state-npc0": 0.006405891910676033, "sim_compute_robot_state-npc1": 0.006122785229836741, "sim_compute_robot_state-npc2": 0.006071948236034763, "sim_compute_robot_state-npc3": 0.005950224015020555}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.21891741653868493, "sim_physics": 0.1260413872568231, "survival_time": 0.9500000000000004, "driven_lanedir": 0.19707200387471024, "sim_render-ego": 0.007892947447927375, "in-drivable-lane": 0, "agent_compute-ego": 0.019121483752602024, "deviation-heading": 0.2658894096015568, "set_robot_commands": 0.005750907094855057, "deviation-center-line": 0.0848539960543871, "driven_lanedir_consec": 0.19707200387471024, "sim_compute_sim_state": 0.003086541828356291, "sim_compute_performance-ego": 0.004306968889738384, "sim_compute_robot_state-ego": 0.0057684873279772305, "sim_compute_robot_state-npc0": 0.005273191552413137, "sim_compute_robot_state-npc1": 0.004985119167127107, "sim_compute_robot_state-npc2": 0.004953760849802117, "sim_compute_robot_state-npc3": 0.004952255048249897}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.21690343677908025, "sim_physics": 0.13769176006317138, "survival_time": 1.0000000000000002, "driven_lanedir": 0.17112137362728053, "sim_render-ego": 0.007797849178314209, "in-drivable-lane": 0.04999999999999993, "agent_compute-ego": 0.020778465270996093, "deviation-heading": 0.31456748877280405, "set_robot_commands": 0.005676186084747315, "deviation-center-line": 0.08257422748059814, "driven_lanedir_consec": 0.17112137362728053, "sim_compute_sim_state": 0.003188169002532959, "sim_compute_performance-ego": 0.00425800085067749, "sim_compute_robot_state-ego": 0.005621659755706787, "sim_compute_robot_state-npc0": 0.005250942707061767, "sim_compute_robot_state-npc1": 0.005026435852050782, "sim_compute_robot_state-npc2": 0.005090069770812988, "sim_compute_robot_state-npc3": 0.0050754547119140625}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.2160920218038966, "sim_physics": 0.11388874772805066, "survival_time": 9.950000000000006, "driven_lanedir": 1.2358706340920032, "sim_render-ego": 0.008914071710864504, "in-drivable-lane": 2.650000000000003, "agent_compute-ego": 0.02050755251592128, "deviation-heading": 3.709966229660816, "set_robot_commands": 0.0065785856103178246, "deviation-center-line": 0.5780618275923667, "driven_lanedir_consec": 1.2358706340920032, "sim_compute_sim_state": 0.003678140927798784, "sim_compute_performance-ego": 0.005115117259960078, "sim_compute_robot_state-ego": 0.006588765724220467, "sim_compute_robot_state-npc0": 0.006206797595000147, "sim_compute_robot_state-npc1": 0.005958456489908036, "sim_compute_robot_state-npc2": 0.006093451725178628, "sim_compute_robot_state-npc3": 0.005967506811247399}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.3078344255607185, "sim_physics": 0.10359459388546828, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2373698240338027, "sim_render-ego": 0.009483005942367926, "in-drivable-lane": 0, "agent_compute-ego": 0.020310396101416613, "deviation-heading": 0.8573018656543777, "set_robot_commands": 0.007469374959061786, "deviation-center-line": 0.119666804132965, "driven_lanedir_consec": 0.2373698240338027, "sim_compute_sim_state": 0.0034910818425620475, "sim_compute_performance-ego": 0.005331365073599466, "sim_compute_robot_state-ego": 0.00673949427720977, "sim_compute_robot_state-npc0": 0.006331961329390363, "sim_compute_robot_state-npc1": 0.006051493854057498, "sim_compute_robot_state-npc2": 0.0060716663918844085, "sim_compute_robot_state-npc3": 0.006126613151736376}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1920791175313762, "sim_physics": 0.13602982627020943, "survival_time": 0.9000000000000002, "driven_lanedir": 0.1411442279995564, "sim_render-ego": 0.008722662925720215, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.019311692979600698, "deviation-heading": 0.3050841415229838, "set_robot_commands": 0.006343033578660753, "deviation-center-line": 0.0588650658176755, "driven_lanedir_consec": 0.1411442279995564, "sim_compute_sim_state": 0.0035095479753282336, "sim_compute_performance-ego": 0.005103098021613227, "sim_compute_robot_state-ego": 0.006342185868157281, "sim_compute_robot_state-npc0": 0.006250500679016113, "sim_compute_robot_state-npc1": 0.005938304795159234, "sim_compute_robot_state-npc2": 0.0058549245198567705, "sim_compute_robot_state-npc3": 0.005839970376756456}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.18839855663669275, "sim_physics": 0.1278178800236095, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1514375157092425, "sim_render-ego": 0.007803743535822088, "in-drivable-lane": 0, "agent_compute-ego": 0.021671967072920365, "deviation-heading": 0.3902307393290654, "set_robot_commands": 0.005832964723760431, "deviation-center-line": 0.07587849496387217, "driven_lanedir_consec": 0.1514375157092425, "sim_compute_sim_state": 0.003135832873257724, "sim_compute_performance-ego": 0.004333756186745383, "sim_compute_robot_state-ego": 0.005743872035633434, "sim_compute_robot_state-npc0": 0.005306948315013538, "sim_compute_robot_state-npc1": 0.005030382763255726, "sim_compute_robot_state-npc2": 0.0050203800201416016, "sim_compute_robot_state-npc3": 0.005003398114984686}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.5385346876248085, "sim_physics": 0.1129648055487532, "survival_time": 12.30000000000004, "driven_lanedir": 0.6071453738184813, "sim_render-ego": 0.008651615158329165, "in-drivable-lane": 6.750000000000013, "agent_compute-ego": 0.020866747794112538, "deviation-heading": 3.771066158168097, "set_robot_commands": 0.00671388366358067, "deviation-center-line": 0.3751327616761639, "driven_lanedir_consec": 0.5634456010883155, "sim_compute_sim_state": 0.0034914278402561096, "sim_compute_performance-ego": 0.00489378266218232, "sim_compute_robot_state-ego": 0.006436516598957341, "sim_compute_robot_state-npc0": 0.006068114342728282, "sim_compute_robot_state-npc1": 0.005829289676697273, "sim_compute_robot_state-npc2": 0.005823013259143364, "sim_compute_robot_state-npc3": 0.005827289286667738}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.6177060079307416, "sim_physics": 0.12891199074539483, "survival_time": 2.549999999999999, "driven_lanedir": 0.5699316224102899, "sim_render-ego": 0.008909534005557789, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.020029198889638864, "deviation-heading": 0.6909719420660883, "set_robot_commands": 0.006640485688751819, "deviation-center-line": 0.21372278629493416, "driven_lanedir_consec": 0.5699316224102899, "sim_compute_sim_state": 0.003732433506086761, "sim_compute_performance-ego": 0.0048751737557205495, "sim_compute_robot_state-ego": 0.006510570937511968, "sim_compute_robot_state-npc0": 0.006173559263640759, "sim_compute_robot_state-npc1": 0.005922579297832414, "sim_compute_robot_state-npc2": 0.005822256499645757, "sim_compute_robot_state-npc3": 0.005909494325226429}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.27936457610577575, "sim_physics": 0.12887418270111084, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2488248923321752, "sim_render-ego": 0.007560437375848944, "in-drivable-lane": 0, "agent_compute-ego": 0.016886862841519443, "deviation-heading": 0.4739628836162768, "set_robot_commands": 0.005258668552745472, "deviation-center-line": 0.06134203347586182, "driven_lanedir_consec": 0.2488248923321752, "sim_compute_sim_state": 0.0029227841984141955, "sim_compute_performance-ego": 0.004013115709478205, "sim_compute_robot_state-ego": 0.0053757754239169035, "sim_compute_robot_state-npc0": 0.005011786114085804, "sim_compute_robot_state-npc1": 0.004672787406227805, "sim_compute_robot_state-npc2": 0.0047540447928688745, "sim_compute_robot_state-npc3": 0.004900162870233709}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1398176531905168, "sim_physics": 0.12112394132112202, "survival_time": 0.9500000000000004, "driven_lanedir": 0.10672352674999486, "sim_render-ego": 0.010449447129902086, "in-drivable-lane": 0, "agent_compute-ego": 0.021324496520193, "deviation-heading": 0.41145679684394143, "set_robot_commands": 0.00754907256678531, "deviation-center-line": 0.08125278945663839, "driven_lanedir_consec": 0.10672352674999486, "sim_compute_sim_state": 0.003618717193603515, "sim_compute_performance-ego": 0.005636880272313168, "sim_compute_robot_state-ego": 0.007104522303531044, "sim_compute_robot_state-npc0": 0.006852388381958008, "sim_compute_robot_state-npc1": 0.006218094574777703, "sim_compute_robot_state-npc2": 0.006488273018284848, "sim_compute_robot_state-npc3": 0.006107330322265625}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.31292403886129505, "sim_physics": 0.13323789834976196, "survival_time": 1.4000000000000006, "driven_lanedir": 0.26922232294504167, "sim_render-ego": 0.008909736360822405, "in-drivable-lane": 0, "agent_compute-ego": 0.01937503474099295, "deviation-heading": 0.5674114432155569, "set_robot_commands": 0.0060996924127851215, "deviation-center-line": 0.097591328660037, "driven_lanedir_consec": 0.26922232294504167, "sim_compute_sim_state": 0.003439562661307199, "sim_compute_performance-ego": 0.004962546484810966, "sim_compute_robot_state-ego": 0.006294046129499163, "sim_compute_robot_state-npc0": 0.005633856569017682, "sim_compute_robot_state-npc1": 0.005423469202859061, "sim_compute_robot_state-npc2": 0.005781028951917376, "sim_compute_robot_state-npc3": 0.005648868424551827}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.2528648730223348, "sim_physics": 0.12033929608084938, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2340229374462308, "sim_render-ego": 0.007272276011380282, "in-drivable-lane": 0, "agent_compute-ego": 0.016074093905362217, "deviation-heading": 0.28480760152520446, "set_robot_commands": 0.0048990032889626245, "deviation-center-line": 0.09174108598121236, "driven_lanedir_consec": 0.2340229374462308, "sim_compute_sim_state": 0.002813057465986772, "sim_compute_performance-ego": 0.003976204178550027, "sim_compute_robot_state-ego": 0.005210551348599521, "sim_compute_robot_state-npc0": 0.004732088609175248, "sim_compute_robot_state-npc1": 0.004565368999134411, "sim_compute_robot_state-npc2": 0.004539229653098367, "sim_compute_robot_state-npc3": 0.004526474259116433}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.466370239186007, "sim_physics": 0.11541328430175782, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0986669764609558, "sim_render-ego": 0.007200445447649274, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.016382387706211636, "deviation-heading": 0.7559800855132098, "set_robot_commands": 0.004898166656494141, "deviation-center-line": 0.05307263042689575, "driven_lanedir_consec": 0.0986669764609558, "sim_compute_sim_state": 0.0028358255113874165, "sim_compute_performance-ego": 0.0039115565163748605, "sim_compute_robot_state-ego": 0.005155638286045619, "sim_compute_robot_state-npc0": 0.004807615280151367, "sim_compute_robot_state-npc1": 0.004539578301565987, "sim_compute_robot_state-npc2": 0.004527146475655692, "sim_compute_robot_state-npc3": 0.004516560690743582}}
set_robot_commands_max	0.00754907256678531
set_robot_commands_mean	0.0062724751958978175
set_robot_commands_median	0.006343033578660753
set_robot_commands_min	0.004898166656494141
sim_compute_performance-ego_max	0.006180672418503534
sim_compute_performance-ego_mean	0.004828810692227411
sim_compute_performance-ego_median	0.00489378266218232
sim_compute_performance-ego_min	0.0039115565163748605
sim_compute_robot_state-ego_max	0.007901169004894439
sim_compute_robot_state-ego_mean	0.0062568806566461735
sim_compute_robot_state-ego_median	0.006342185868157281
sim_compute_robot_state-ego_min	0.005155638286045619
sim_compute_robot_state-npc0_max	0.007695118586222331
sim_compute_robot_state-npc0_mean	0.0058667174157033715
sim_compute_robot_state-npc0_median	0.006068114342728282
sim_compute_robot_state-npc0_min	0.004732088609175248
sim_compute_robot_state-npc1_max	0.007775454294113885
sim_compute_robot_state-npc1_mean	0.0056039733269735775
sim_compute_robot_state-npc1_median	0.005829289676697273
sim_compute_robot_state-npc1_min	0.004539578301565987
sim_compute_robot_state-npc2_max	0.007770583743140811
sim_compute_robot_state-npc2_mean	0.005644118527164424
sim_compute_robot_state-npc2_median	0.005822256499645757
sim_compute_robot_state-npc2_min	0.004527146475655692
sim_compute_robot_state-npc3_max	0.00719852674575079
sim_compute_robot_state-npc3_mean	0.005570008610297704
sim_compute_robot_state-npc3_median	0.005827289286667738
sim_compute_robot_state-npc3_min	0.004516560690743582
sim_compute_sim_state_max	0.0042765821729387555
sim_compute_sim_state_mean	0.003399333504885035
sim_compute_sim_state_median	0.0034910818425620475
sim_compute_sim_state_min	0.002813057465986772
sim_physics_max	0.16608768417721703
sim_physics_mean	0.12814488791991788
sim_physics_median	0.1278178800236095
sim_physics_min	0.10359459388546828
sim_render-ego_max	0.0113503478822254
sim_render-ego_mean	0.008695221973081115
sim_render-ego_median	0.008722662925720215
sim_render-ego_min	0.007200445447649274
simulation-passed	1
survival_time_max	12.30000000000004
survival_time_mean	2.750000000000003
survival_time_min	0.9000000000000002

No reset possible

25000

4129

Andrea Censi 🇨🇭

rotation

step1-simulation

error

2019-11-04 09:23:17+00:00

2019-11-04 10:00:48+00:00

0:37:31

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24981

4149

Andrea Censi 🇨🇭

rotation

step1-simulation

success

2019-11-04 09:00:39+00:00

2019-11-04 09:22:42+00:00

0:22:03

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.00030504467687686443
survival_time_median	14.950000000000076
deviation-center-line_median	0.4891046565937845
in-drivable-lane_median	7.600000000000043

other stats

agent_compute-ego_max	0.025331740379333497
agent_compute-ego_mean	0.02365919319788615
agent_compute-ego_median	0.023518534501393636
agent_compute-ego_min	0.02285491625467936
deviation-center-line_max	0.6113246250082045
deviation-center-line_mean	0.4225460275157091
deviation-center-line_min	0.020737627062439232
deviation-heading_max	5.830135897709591
deviation-heading_mean	5.6845705507076865
deviation-heading_median	5.657649106857696
deviation-heading_min	5.53666299685486
driven_any_max	0.026478672834052443
driven_any_mean	0.02486423959225232
driven_any_median	0.02593019554120905
driven_any_min	0.022165452661382787
driven_lanedir_consec_max	0.002162616049345756
driven_lanedir_consec_mean	-0.0004886462276807446
driven_lanedir_consec_min	-0.0036402347654349576
driven_lanedir_max	0.002162616049345756
driven_lanedir_mean	-0.0004886462276807446
driven_lanedir_median	0.00030504467687686443
driven_lanedir_min	-0.0036402347654349576
in-drivable-lane_max	7.650000000000043
in-drivable-lane_mean	7.600000000000042
in-drivable-lane_min	7.550000000000044
per-episodes	details {"udem1-0-0": {"driven_any": 0.026478672834052443, "sim_physics": 0.20361105362574256, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.012158433596293133, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.02369081974029541, "deviation-heading": 5.657649106857696, "set_robot_commands": 0.009837464491526286, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.004849073886871338, "sim_compute_performance-ego": 0.007268048922220866, "sim_compute_robot_state-ego": 0.009212406476338704, "sim_compute_robot_state-npc0": 0.008556463718414307, "sim_compute_robot_state-npc1": 0.008313538233439128, "sim_compute_robot_state-npc2": 0.008283321062723796, "sim_compute_robot_state-npc3": 0.008153623739878336}, "udem1-1-0": {"driven_any": 0.02593019554120905, "sim_physics": 0.1965043838818868, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.011756261189778646, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.023518534501393636, "deviation-heading": 5.79531637039674, "set_robot_commands": 0.009479601383209227, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.004788663387298584, "sim_compute_performance-ego": 0.006885465780893962, "sim_compute_robot_state-ego": 0.008945240179697672, "sim_compute_robot_state-npc0": 0.008351275126139323, "sim_compute_robot_state-npc1": 0.008071970939636231, "sim_compute_robot_state-npc2": 0.00809442440668742, "sim_compute_robot_state-npc3": 0.008030908902486165}, "udem1-2-0": {"driven_any": 0.023804404672430148, "sim_physics": 0.18613280296325685, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.01245225191116333, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.02285491625467936, "deviation-heading": 5.603088381719548, "set_robot_commands": 0.00912694772084554, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.0049271162350972494, "sim_compute_performance-ego": 0.0072463154792785645, "sim_compute_robot_state-ego": 0.009205586910247802, "sim_compute_robot_state-npc0": 0.0082966947555542, "sim_compute_robot_state-npc1": 0.007887316544850668, "sim_compute_robot_state-npc2": 0.008013219038645426, "sim_compute_robot_state-npc3": 0.008161935806274414}, "udem1-3-0": {"driven_any": 0.022165452661382787, "sim_physics": 0.19427154223124185, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202352883, "sim_render-ego": 0.011985801855723064, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.025331740379333497, "deviation-heading": 5.53666299685486, "set_robot_commands": 0.00913969119389852, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202352883, "sim_compute_sim_state": 0.004832413196563721, "sim_compute_performance-ego": 0.0071015890439351395, "sim_compute_robot_state-ego": 0.0091658353805542, "sim_compute_robot_state-npc0": 0.0083085831006368, "sim_compute_robot_state-npc1": 0.008276132742563884, "sim_compute_robot_state-npc2": 0.008133257230122884, "sim_compute_robot_state-npc3": 0.008133593400319418}, "udem1-4-0": {"driven_any": 0.02594247225218716, "sim_physics": 0.1885306453704834, "survival_time": 14.950000000000076, "driven_lanedir": 0.00030504467687686443, "sim_render-ego": 0.012136072317759195, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.02289995511372884, "deviation-heading": 5.830135897709591, "set_robot_commands": 0.00902060588200887, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.00030504467687686443, "sim_compute_sim_state": 0.004808789889017741, "sim_compute_performance-ego": 0.007239072322845459, "sim_compute_robot_state-ego": 0.00908815066019694, "sim_compute_robot_state-npc0": 0.008738478819529216, "sim_compute_robot_state-npc1": 0.008136236667633056, "sim_compute_robot_state-npc2": 0.008235231240590413, "sim_compute_robot_state-npc3": 0.008297495047251384}}
set_robot_commands_max	0.009837464491526286
set_robot_commands_mean	0.009320862134297688
set_robot_commands_median	0.00913969119389852
set_robot_commands_min	0.00902060588200887
sim_compute_performance-ego_max	0.007268048922220866
sim_compute_performance-ego_mean	0.007148098309834798
sim_compute_performance-ego_median	0.007239072322845459
sim_compute_performance-ego_min	0.006885465780893962
sim_compute_robot_state-ego_max	0.009212406476338704
sim_compute_robot_state-ego_mean	0.009123443921407064
sim_compute_robot_state-ego_median	0.0091658353805542
sim_compute_robot_state-ego_min	0.008945240179697672
sim_compute_robot_state-npc0_max	0.008738478819529216
sim_compute_robot_state-npc0_mean	0.00845029910405477
sim_compute_robot_state-npc0_median	0.008351275126139323
sim_compute_robot_state-npc0_min	0.0082966947555542
sim_compute_robot_state-npc1_max	0.008313538233439128
sim_compute_robot_state-npc1_mean	0.008137039025624595
sim_compute_robot_state-npc1_median	0.008136236667633056
sim_compute_robot_state-npc1_min	0.007887316544850668
sim_compute_robot_state-npc2_max	0.008283321062723796
sim_compute_robot_state-npc2_mean	0.008151890595753986
sim_compute_robot_state-npc2_median	0.008133257230122884
sim_compute_robot_state-npc2_min	0.008013219038645426
sim_compute_robot_state-npc3_max	0.008297495047251384
sim_compute_robot_state-npc3_mean	0.008155511379241944
sim_compute_robot_state-npc3_median	0.008153623739878336
sim_compute_robot_state-npc3_min	0.008030908902486165
sim_compute_sim_state_max	0.0049271162350972494
sim_compute_sim_state_mean	0.004841211318969727
sim_compute_sim_state_median	0.004832413196563721
sim_compute_sim_state_min	0.004788663387298584
sim_physics_max	0.20361105362574256
sim_physics_mean	0.1938100856145223
sim_physics_median	0.19427154223124185
sim_physics_min	0.18613280296325685
sim_render-ego_max	0.01245225191116333
sim_render-ego_mean	0.012097764174143473
sim_render-ego_median	0.012136072317759195
sim_render-ego_min	0.011756261189778646
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	14.950000000000076
survival_time_min	14.950000000000076

No reset possible

24976

4168

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

step1-simulation

error

2019-11-04 08:57:35+00:00

2019-11-04 09:00:11+00:00

0:02:36

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24970

4175

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

failed

2019-11-04 08:55:24+00:00

2019-11-04 08:57:11+00:00

0:01:47

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24967

4178

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-11-04 08:54:30+00:00

2019-11-04 08:55:01+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24965

4179

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-11-04 08:53:27+00:00

2019-11-04 08:53:58+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24964

4183

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-11-04 08:52:33+00:00

2019-11-04 08:53:04+00:00

0:00:31

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24961

4184

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-11-04 08:51:34+00:00

2019-11-04 08:52:16+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24952

4196

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

failed

2019-11-04 08:50:16+00:00

2019-11-04 08:51:17+00:00

0:01:01

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 110, in object_from_ipce_
    raise ZValueError(msg, expected=st, given_object=mj)
zuper_typing.exceptions.ZValueError: Type mismatch for a simple type.
│     expected: float
│ given_object: 0

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 338, in object_from_ipce_dataclass_instance
    attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 350, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'motor_right' of PWMCommands.
│ K_annotations: {motor_left: float, motor_right: float}
│   expect_type: float
│         ann_K: float
│        K_name: `PWMCommands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 66, in object_from_ipce
    res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 169, in object_from_ipce_
    return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 350, in object_from_ipce_dataclass_instance
    ) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize attribute 'wheels' of Duckiebot1Commands.
│ K_annotations: dict
│                │ wheels:
│                │ dataclass aido_schemas.schemas.PWMCommands
│                │  field  motor_left : float 
│                │  field motor_right : float 
│                │ LEDS:
│                │ dataclass aido_schemas.schemas.LEDSCommands
│                │  field      center : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  front_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field front_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field   back_left : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│                │  field  back_right : dataclass aido_schemas.schemas.RGB 
│                │                       field r : float                   
│                │                       field g : float                   
│                │                       field b : float                   
│   expect_type: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│         ann_K: dataclass aido_schemas.schemas.PWMCommands
│                 field  motor_left : float 
│                 field motor_right : float 
│        K_name: `Duckiebot1Commands`

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 215, in read_one
    data = object_from_ipce(msg[FIELD_DATA], klass)
  File "/usr/local/lib/python3.7/site-packages/zuper_ipce/conv_object_from_ipce.py", line 85, in object_from_ipce
    raise ZValueError(msg, expect_type=expect_type) from e
zuper_typing.exceptions.ZValueError: Cannot deserialize object
│ expect_type: dataclass aido_schemas.schemas.Duckiebot1Commands
│               field wheels : dataclass aido_schemas.schemas.PWMCommands               
│                               field  motor_left : float                               
│                               field motor_right : float                               
│               field   LEDS : dataclass aido_schemas.schemas.LEDSCommands              
│                               field      center : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  front_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field front_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field   back_left : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    
│                               field  back_right : dataclass aido_schemas.schemas.RGB  
│                                                    field r : float                    
│                                                    field g : float                    
│                                                    field b : float                    

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24948

4198

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-11-04 08:49:13+00:00

2019-11-04 08:49:55+00:00

0:00:42

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24944

4204

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-11-04 08:46:39+00:00

2019-11-04 08:48:38+00:00

0:01:59

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24938

4215

Baseline-IL-logs-tensorflow

step1-simulation

failed

2019-11-04 08:45:05+00:00

2019-11-04 08:46:24+00:00

0:01:19

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[{{node prefix/ConvNet/conv_layer_1/kernel/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/conv_layer_1/kernel/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/conv_layer_1/kernel
               || 	 [[node prefix/ConvNet/conv_layer_1/kernel/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24931

4220

Baseline-IL-logs-tensorflow

step1-simulation

failed

2019-11-04 08:43:46+00:00

2019-11-04 08:44:35+00:00

0:00:49

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 299, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 96, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 177, in read_one
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1334, in _do_call
               ||     return fn(*args)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
               ||     options, feed_dict, fetch_list, target_list, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
               ||     run_metadata)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[{{node prefix/ConvNet/fc_layer_2/bias/read}}]]
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 58, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1152, in _run
               ||     feed_dict_tensor, options, run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1328, in _do_run
               ||     run_metadata)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1348, in _do_call
               ||     raise type(e)(node_def, op, message)
               || tensorflow.python.framework.errors_impl.FailedPreconditionError: Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               || Caused by op 'prefix/ConvNet/fc_layer_2/bias/read', defined at:
               ||   File "imitation_agent.py", line 134, in <module>
               ||     main()
               ||   File "imitation_agent.py", line 130, in main
               ||     wrap_direct(node=node, protocol=protocol)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/interface.py", line 22, in wrap_direct
               ||     run_loop(node, protocol, args)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 196, in run_loop
               ||     config=config)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/dist-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 442, in import_graph_def
               ||     _ProcessNewOps(graph)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 235, in _ProcessNewOps
               ||     for new_op in graph._add_new_tf_operations(compute_devices=False):  # pylint: disable=protected-access
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in _add_new_tf_operations
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3433, in <listcomp>
               ||     for c_op in c_api_util.new_tf_operations(self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 3325, in _create_op_from_tf_operation
               ||     ret = Operation(c_op, self)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/ops.py", line 1801, in __init__
               ||     self._traceback = tf_stack.extract_stack()
               ||
               || FailedPreconditionError (see above for traceback): Attempting to use uninitialized value prefix/ConvNet/fc_layer_2/bias
               || 	 [[node prefix/ConvNet/fc_layer_2/bias/read (defined at /workspace/graph_utils.py:14) ]]
               ||
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24897

4258

Anastasiya Nikolskaya 🇷🇺

beta

step1-simulation

success

2019-11-04 08:01:25+00:00

2019-11-04 08:43:22+00:00

0:41:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.8558176376564193
survival_time_median	12.600000000000044
deviation-center-line_median	0.38482910386276586
in-drivable-lane_median	1.149999999999996

other stats

agent_compute-ego_max	0.12029810609488652
agent_compute-ego_mean	0.09569977132880456
agent_compute-ego_median	0.10111018144167389
agent_compute-ego_min	0.060886212249300374
deviation-center-line_max	0.993980167648684
deviation-center-line_mean	0.4965433781052581
deviation-center-line_min	0.2270669522904928
deviation-heading_max	5.273979760170636
deviation-heading_mean	1.892240502580237
deviation-heading_median	1.2455495461842216
deviation-heading_min	0.4469092223488037
driven_any_max	1.9842046421870945
driven_any_mean	1.3029275060689416
driven_any_median	1.4771305288103416
driven_any_min	0.2905196356306618
driven_lanedir_consec_max	1.9812457680069395
driven_lanedir_consec_mean	0.995974644208892
driven_lanedir_consec_min	0.2840155995123279
driven_lanedir_max	1.9812457680069395
driven_lanedir_mean	1.097694019488474
driven_lanedir_median	1.2091345202059811
driven_lanedir_min	0.2840155995123279
in-drivable-lane_max	3.3
in-drivable-lane_mean	1.1700000000000048
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.099028025009332, "sim_physics": 0.13295370956947064, "survival_time": 8.699999999999989, "driven_lanedir": 0.607051482337738, "sim_render-ego": 0.01453767288690326, "in-drivable-lane": 3.3, "agent_compute-ego": 0.12029810609488652, "deviation-heading": 0.9347079735228798, "set_robot_commands": 0.010878641029884076, "deviation-center-line": 0.37718132988362246, "driven_lanedir_consec": 0.6070002959466403, "sim_compute_sim_state": 0.005726140120933796, "sim_compute_performance-ego": 0.008658502293729234, "sim_compute_robot_state-ego": 0.01066164312691524}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0662670859684673, "sim_physics": 0.12827700879200396, "survival_time": 8.299999999999983, "driven_lanedir": 0.8558176376564193, "sim_render-ego": 0.01455535658870835, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.11242364113589368, "deviation-heading": 1.1921441248460465, "set_robot_commands": 0.010731612343385996, "deviation-center-line": 0.3602350786734126, "driven_lanedir_consec": 0.8558176376564193, "sim_compute_sim_state": 0.005853145955556847, "sim_compute_performance-ego": 0.008482107196945742, "sim_compute_robot_state-ego": 0.010955942682473055}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2905196356306618, "sim_physics": 0.12840832074483235, "survival_time": 2.25, "driven_lanedir": 0.2840155995123279, "sim_render-ego": 0.015471866395738387, "in-drivable-lane": 0, "agent_compute-ego": 0.10930052333407932, "deviation-heading": 0.4469092223488037, "set_robot_commands": 0.012037070592244466, "deviation-center-line": 0.2270669522904928, "driven_lanedir_consec": 0.2840155995123279, "sim_compute_sim_state": 0.006006675296359592, "sim_compute_performance-ego": 0.008113739225599501, "sim_compute_robot_state-ego": 0.010483307308620876}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.70301877876716, "sim_physics": 0.13507461052864894, "survival_time": 14.45000000000007, "driven_lanedir": 1.2091345202059811, "sim_render-ego": 0.01425825353312245, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.10855960020969484, "deviation-heading": 3.441741831405208, "set_robot_commands": 0.010834211296688727, "deviation-center-line": 0.5032958916722649, "driven_lanedir_consec": 1.192012444821534, "sim_compute_sim_state": 0.005747149972354665, "sim_compute_performance-ego": 0.00856329413021312, "sim_compute_robot_state-ego": 0.010881491598373464}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.728797777360938, "sim_physics": 0.11909786737882172, "survival_time": 13.00000000000005, "driven_lanedir": 1.237248533139888, "sim_render-ego": 0.013738457973186787, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.10111018144167389, "deviation-heading": 2.324913675096781, "set_robot_commands": 0.010355664216555082, "deviation-center-line": 0.416290487317732, "driven_lanedir_consec": 1.2149712332795757, "sim_compute_sim_state": 0.0053229231100815995, "sim_compute_performance-ego": 0.0079230391062223, "sim_compute_robot_state-ego": 0.010239054606511042}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.6131395142232725, "sim_physics": 0.12040221596521045, "survival_time": 12.600000000000044, "driven_lanedir": 1.58486154959819, "sim_render-ego": 0.013759869431692455, "in-drivable-lane": 0, "agent_compute-ego": 0.09663678918566022, "deviation-heading": 2.0277353042700224, "set_robot_commands": 0.010658338902488587, "deviation-center-line": 0.9258067110523788, "driven_lanedir_consec": 1.58486154959819, "sim_compute_sim_state": 0.0055467429615202405, "sim_compute_performance-ego": 0.008142860162825812, "sim_compute_robot_state-ego": 0.010517951988038562}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.6033613002651734, "sim_physics": 0.12476988554000856, "survival_time": 14.950000000000076, "driven_lanedir": 1.407889911307331, "sim_render-ego": 0.013358404636383056, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.09489640474319458, "deviation-heading": 2.9094387206702117, "set_robot_commands": 0.010423085689544675, "deviation-center-line": 0.3032346514145809, "driven_lanedir_consec": 0.6054362763966887, "sim_compute_sim_state": 0.005416837533315023, "sim_compute_performance-ego": 0.007941027482350668, "sim_compute_robot_state-ego": 0.01044048229853312}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.4771305288103416, "sim_physics": 0.12273256381352744, "survival_time": 14.950000000000076, "driven_lanedir": 1.302817117953556, "sim_render-ego": 0.0135293714205424, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.09559785922368368, "deviation-heading": 3.682459344291959, "set_robot_commands": 0.010048219362894694, "deviation-center-line": 0.6018383208036195, "driven_lanedir_consec": 1.2883240166642014, "sim_compute_sim_state": 0.0052273162206014, "sim_compute_performance-ego": 0.00811134656270345, "sim_compute_robot_state-ego": 0.01018989404042562}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.9842046421870945, "sim_physics": 0.12375434716542562, "survival_time": 14.950000000000076, "driven_lanedir": 1.9812457680069395, "sim_render-ego": 0.013402676582336426, "in-drivable-lane": 0, "agent_compute-ego": 0.10337973912556966, "deviation-heading": 0.6258832439298457, "set_robot_commands": 0.010691332817077636, "deviation-center-line": 0.7999072906495828, "driven_lanedir_consec": 1.9812457680069395, "sim_compute_sim_state": 0.005557637214660644, "sim_compute_performance-ego": 0.008246092001597087, "sim_compute_robot_state-ego": 0.01024302085240682}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9065703369579654, "sim_physics": 0.12828168443813445, "survival_time": 7.84999999999998, "driven_lanedir": 0.4882989890784488, "sim_render-ego": 0.014005638231897053, "in-drivable-lane": 2.79999999999999, "agent_compute-ego": 0.11093288622084696, "deviation-heading": 1.2152232750336296, "set_robot_commands": 0.01051481969796928, "deviation-center-line": 0.3024265959401662, "driven_lanedir_consec": 0.4882989890784488, "sim_compute_sim_state": 0.0052772722426493454, "sim_compute_performance-ego": 0.008224174475214284, "sim_compute_robot_state-ego": 0.010064150877059645}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0948275516690873, "sim_physics": 0.12403513998261297, "survival_time": 9.55, "driven_lanedir": 1.077772029133377, "sim_render-ego": 0.014105884192501687, "in-drivable-lane": 0, "agent_compute-ego": 0.1044863655929166, "deviation-heading": 1.2455495461842216, "set_robot_commands": 0.011007477475710565, "deviation-center-line": 0.38482910386276586, "driven_lanedir_consec": 1.077772029133377, "sim_compute_sim_state": 0.005644602301233102, "sim_compute_performance-ego": 0.008293014546339425, "sim_compute_robot_state-ego": 0.010654153624130167}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.5407391239984252, "sim_physics": 0.11848359902699789, "survival_time": 14.950000000000076, "driven_lanedir": 1.269169363255799, "sim_render-ego": 0.013221840858459472, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.08921230713526408, "deviation-heading": 5.273979760170636, "set_robot_commands": 0.009896481037139892, "deviation-center-line": 0.993980167648684, "driven_lanedir_consec": 0.5997760318979234, "sim_compute_sim_state": 0.005428776741027832, "sim_compute_performance-ego": 0.007882936795552572, "sim_compute_robot_state-ego": 0.009909963607788086}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0031366550796723, "sim_physics": 0.06796424602394674, "survival_time": 6.699999999999984, "driven_lanedir": 0.7520157818577032, "sim_render-ego": 0.009441025221525734, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.060886212249300374, "deviation-heading": 0.9938267513498256, "set_robot_commands": 0.006851920441015443, "deviation-center-line": 0.3540523426355928, "driven_lanedir_consec": 0.7520157818577032, "sim_compute_sim_state": 0.003911719393374315, "sim_compute_performance-ego": 0.004998276482767134, "sim_compute_robot_state-ego": 0.0066411619755759165}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.47345621081897415, "sim_physics": 0.08145666478285149, "survival_time": 3.349999999999996, "driven_lanedir": 0.4616353734402514, "sim_render-ego": 0.01011585833421394, "in-drivable-lane": 0, "agent_compute-ego": 0.06575722836736422, "deviation-heading": 0.6893015380499713, "set_robot_commands": 0.007364885130924965, "deviation-center-line": 0.2655427603738342, "driven_lanedir_consec": 0.4616353734402514, "sim_compute_sim_state": 0.0039656233431687995, "sim_compute_performance-ego": 0.005521923748414908, "sim_compute_robot_state-ego": 0.007088440567699831}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.9597154242875592, "sim_physics": 0.08153955300649007, "survival_time": 14.950000000000076, "driven_lanedir": 1.9464366358431595, "sim_render-ego": 0.008798636595408122, "in-drivable-lane": 0, "agent_compute-ego": 0.0620187258720398, "deviation-heading": 1.379793227533514, "set_robot_commands": 0.006850671768188476, "deviation-center-line": 0.6324629873601414, "driven_lanedir_consec": 1.9464366358431595, "sim_compute_sim_state": 0.003705177307128906, "sim_compute_performance-ego": 0.005086510976155599, "sim_compute_robot_state-ego": 0.0065126347541809085}}
set_robot_commands_max	0.012037070592244466
set_robot_commands_mean	0.00994296212011417
set_robot_commands_median	0.01051481969796928
set_robot_commands_min	0.006850671768188476
sim_compute_performance-ego_max	0.008658502293729234
sim_compute_performance-ego_mean	0.007612589679108723
sim_compute_performance-ego_median	0.008113739225599501
sim_compute_performance-ego_min	0.004998276482767134
sim_compute_robot_state-ego_max	0.010955942682473055
sim_compute_robot_state-ego_mean	0.009698886260582157
sim_compute_robot_state-ego_median	0.01024302085240682
sim_compute_robot_state-ego_min	0.0065126347541809085
sim_compute_sim_state_max	0.006006675296359592
sim_compute_sim_state_mean	0.005222515980931073
sim_compute_sim_state_median	0.005428776741027832
sim_compute_sim_state_min	0.003705177307128906
sim_physics_max	0.13507461052864894
sim_physics_mean	0.11581542778393222
sim_physics_median	0.12375434716542562
sim_physics_min	0.06796424602394674
sim_render-ego_max	0.015471866395738387
sim_render-ego_mean	0.013086720858841303
sim_render-ego_median	0.013738457973186787
sim_render-ego_min	0.008798636595408122
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	10.7666666666667
survival_time_min	2.25

No reset possible

24869

4278

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-11-04 07:53:23+00:00

2019-11-04 08:00:52+00:00

0:07:29

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24828

4343

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-11-04 07:00:08+00:00

2019-11-04 07:52:53+00:00

0:52:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5898737163098433
survival_time_median	8.899999999999991
deviation-center-line_median	0.29384214762524025
in-drivable-lane_median	2.6499999999999932

other stats

agent_compute-ego_max	0.07021879040917685
agent_compute-ego_mean	0.05996072698798167
agent_compute-ego_median	0.05857830365498861
agent_compute-ego_min	0.05330952723821005
deviation-center-line_max	1.1210198677736811
deviation-center-line_mean	0.5159597111592469
deviation-center-line_min	0.12195288898421298
deviation-heading_max	7.481825775158013
deviation-heading_mean	2.4646464193112054
deviation-heading_median	1.7924715273604874
deviation-heading_min	0.5369753610989247
driven_any_max	2.3488162747312575
driven_any_mean	1.349289508494274
driven_any_median	1.3766008740123918
driven_any_min	0.33206789986095075
driven_lanedir_consec_max	2.239556760647147
driven_lanedir_consec_mean	0.6851363261228619
driven_lanedir_consec_min	0.08072727852247885
driven_lanedir_max	2.2421662698105034
driven_lanedir_mean	0.870678489024313
driven_lanedir_median	0.6349381408215211
driven_lanedir_min	0.09646652038162218
in-drivable-lane_max	5.400000000000057
in-drivable-lane_mean	2.1600000000000033
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 2.341397547136814, "sim_physics": 0.2171168184280395, "survival_time": 14.950000000000076, "driven_lanedir": 2.2421662698105034, "sim_render-ego": 0.013780019283294675, "in-drivable-lane": 0, "agent_compute-ego": 0.05330952723821005, "deviation-heading": 2.9857366431022205, "set_robot_commands": 0.01172305663426717, "deviation-center-line": 0.8682140098522384, "driven_lanedir_consec": 2.239556760647147, "sim_compute_sim_state": 0.005740301609039307, "sim_compute_performance-ego": 0.007957689762115479, "sim_compute_robot_state-ego": 0.010605422655741374, "sim_compute_robot_state-npc0": 0.010182583332061767, "sim_compute_robot_state-npc1": 0.00983115275700887, "sim_compute_robot_state-npc2": 0.009950899283091228, "sim_compute_robot_state-npc3": 0.009637900988260903}, "udem1-1-0": {"driven_any": 0.5651026303450155, "sim_physics": 0.225441684970608, "survival_time": 3.8499999999999943, "driven_lanedir": 0.5375787474653992, "sim_render-ego": 0.015201599566967455, "in-drivable-lane": 0, "agent_compute-ego": 0.06316764633376877, "deviation-heading": 1.0826986070968616, "set_robot_commands": 0.011579993483308074, "deviation-center-line": 0.24540950169601009, "driven_lanedir_consec": 0.5375787474653992, "sim_compute_sim_state": 0.005901754676521599, "sim_compute_performance-ego": 0.008234804326837713, "sim_compute_robot_state-ego": 0.010265489677330117, "sim_compute_robot_state-npc0": 0.010375484243615882, "sim_compute_robot_state-npc1": 0.010073937378920518, "sim_compute_robot_state-npc2": 0.009751158875304384, "sim_compute_robot_state-npc3": 0.009918076651436942}, "udem1-2-0": {"driven_any": 0.45259493108732646, "sim_physics": 0.2204701370663113, "survival_time": 3.149999999999997, "driven_lanedir": 0.43254613090066, "sim_render-ego": 0.01238869863843161, "in-drivable-lane": 0, "agent_compute-ego": 0.05476144760374039, "deviation-heading": 0.5715471681434434, "set_robot_commands": 0.009305836662413582, "deviation-center-line": 0.28948313981060064, "driven_lanedir_consec": 0.43254613090066, "sim_compute_sim_state": 0.005013439390394423, "sim_compute_performance-ego": 0.0069386012970455106, "sim_compute_robot_state-ego": 0.009188084375290643, "sim_compute_robot_state-npc0": 0.00855414829556904, "sim_compute_robot_state-npc1": 0.008090234938121978, "sim_compute_robot_state-npc2": 0.007883832568214053, "sim_compute_robot_state-npc3": 0.008113497779482887}, "udem1-3-0": {"driven_any": 0.33206789986095075, "sim_physics": 0.2573448419570923, "survival_time": 2.3999999999999995, "driven_lanedir": 0.30828809212033703, "sim_render-ego": 0.01482206086317698, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.06441403925418854, "deviation-heading": 0.5369753610989247, "set_robot_commands": 0.011825203895568848, "deviation-center-line": 0.21408782132015877, "driven_lanedir_consec": 0.30828809212033703, "sim_compute_sim_state": 0.0055457403262456255, "sim_compute_performance-ego": 0.008927841981252035, "sim_compute_robot_state-ego": 0.011056706309318542, "sim_compute_robot_state-npc0": 0.01029174029827118, "sim_compute_robot_state-npc1": 0.009892230232556662, "sim_compute_robot_state-npc2": 0.00996159017086029, "sim_compute_robot_state-npc3": 0.009601950645446776}, "udem1-4-0": {"driven_any": 1.4488817113046888, "sim_physics": 0.2303277145732533, "survival_time": 9.349999999999998, "driven_lanedir": 0.6349381408215211, "sim_render-ego": 0.014466359653574895, "in-drivable-lane": 4.500000000000007, "agent_compute-ego": 0.06487517943356765, "deviation-heading": 2.0853299071391156, "set_robot_commands": 0.010412362807574757, "deviation-center-line": 0.24012998510200947, "driven_lanedir_consec": 0.6349381408215211, "sim_compute_sim_state": 0.0056277430631260185, "sim_compute_performance-ego": 0.008271687808521291, "sim_compute_robot_state-ego": 0.010592432583079618, "sim_compute_robot_state-npc0": 0.009920422406120096, "sim_compute_robot_state-npc1": 0.009872217229343352, "sim_compute_robot_state-npc2": 0.009709758554550417, "sim_compute_robot_state-npc3": 0.009487553713793425}, "udem1-5-0": {"driven_any": 0.966715510909793, "sim_physics": 0.23849604261203075, "survival_time": 6.349999999999985, "driven_lanedir": 0.3552857196490615, "sim_render-ego": 0.013918842856339582, "in-drivable-lane": 2.899999999999993, "agent_compute-ego": 0.05703268276424858, "deviation-heading": 2.2954974937274235, "set_robot_commands": 0.011244764478187862, "deviation-center-line": 0.29384214762524025, "driven_lanedir_consec": 0.2067639358688682, "sim_compute_sim_state": 0.005750184922706424, "sim_compute_performance-ego": 0.008006503262857753, "sim_compute_robot_state-ego": 0.010914577273871956, "sim_compute_robot_state-npc0": 0.010101975418451264, "sim_compute_robot_state-npc1": 0.009676813140628845, "sim_compute_robot_state-npc2": 0.009992250307338444, "sim_compute_robot_state-npc3": 0.009792035020242526}, "udem1-6-0": {"driven_any": 1.6741107184541508, "sim_physics": 0.22513297990311024, "survival_time": 10.750000000000018, "driven_lanedir": 1.6534094627951397, "sim_render-ego": 0.01378713430360306, "in-drivable-lane": 0, "agent_compute-ego": 0.05777706212775652, "deviation-heading": 1.289945266829721, "set_robot_commands": 0.010900851183159407, "deviation-center-line": 1.0968501097877332, "driven_lanedir_consec": 1.261599248982901, "sim_compute_sim_state": 0.005410354081974473, "sim_compute_performance-ego": 0.007937776210696199, "sim_compute_robot_state-ego": 0.010230889431265898, "sim_compute_robot_state-npc0": 0.00943414333254792, "sim_compute_robot_state-npc1": 0.009417835501737372, "sim_compute_robot_state-npc2": 0.009284186917682027, "sim_compute_robot_state-npc3": 0.009367627875749455}, "udem1-7-0": {"driven_any": 2.3488162747312575, "sim_physics": 0.2366631444295247, "survival_time": 14.950000000000076, "driven_lanedir": 1.5474108993842477, "sim_render-ego": 0.013799378871917725, "in-drivable-lane": 3.249999999999992, "agent_compute-ego": 0.05878746906916301, "deviation-heading": 4.868285657919434, "set_robot_commands": 0.010135038693745931, "deviation-center-line": 0.9953661821756068, "driven_lanedir_consec": 0.9109505433861238, "sim_compute_sim_state": 0.0055990370114644365, "sim_compute_performance-ego": 0.007979278564453124, "sim_compute_robot_state-ego": 0.010435723463694254, "sim_compute_robot_state-npc0": 0.009756375153859456, "sim_compute_robot_state-npc1": 0.009562591711680094, "sim_compute_robot_state-npc2": 0.009205228487650551, "sim_compute_robot_state-npc3": 0.0095516832669576}, "udem1-8-0": {"driven_any": 2.348512177817972, "sim_physics": 0.21342753807703657, "survival_time": 14.950000000000076, "driven_lanedir": 1.3637345555476883, "sim_render-ego": 0.013516547679901124, "in-drivable-lane": 3.2000000000000117, "agent_compute-ego": 0.05350233236948649, "deviation-heading": 7.481825775158013, "set_robot_commands": 0.010673662821451824, "deviation-center-line": 1.1210198677736811, "driven_lanedir_consec": 0.7686504210327563, "sim_compute_sim_state": 0.005461153984069825, "sim_compute_performance-ego": 0.007894638379414877, "sim_compute_robot_state-ego": 0.009975918134053548, "sim_compute_robot_state-npc0": 0.009507997035980225, "sim_compute_robot_state-npc1": 0.009180206457773845, "sim_compute_robot_state-npc2": 0.009278599421183267, "sim_compute_robot_state-npc3": 0.00924930493036906}, "udem1-9-0": {"driven_any": 2.3487713776706713, "sim_physics": 0.22344952742258709, "survival_time": 14.950000000000076, "driven_lanedir": 1.2147980546525814, "sim_render-ego": 0.013442968527475991, "in-drivable-lane": 5.400000000000057, "agent_compute-ego": 0.05857830365498861, "deviation-heading": 4.648688868058272, "set_robot_commands": 0.010798336664835612, "deviation-center-line": 0.7505524307085376, "driven_lanedir_consec": 0.5898737163098433, "sim_compute_sim_state": 0.005450898011525472, "sim_compute_performance-ego": 0.007918950716654459, "sim_compute_robot_state-ego": 0.010133710702260336, "sim_compute_robot_state-npc0": 0.009883774916330973, "sim_compute_robot_state-npc1": 0.009511601130167644, "sim_compute_robot_state-npc2": 0.00948837121327718, "sim_compute_robot_state-npc3": 0.009470176696777344}, "udem1-10-0": {"driven_any": 1.3766008740123918, "sim_physics": 0.23200216721952632, "survival_time": 8.899999999999991, "driven_lanedir": 0.679577492100427, "sim_render-ego": 0.014117938748906168, "in-drivable-lane": 3.8000000000000016, "agent_compute-ego": 0.0654212919513831, "deviation-heading": 1.7924715273604874, "set_robot_commands": 0.011034133728970302, "deviation-center-line": 0.3321695554018054, "driven_lanedir_consec": 0.47865444873609464, "sim_compute_sim_state": 0.005775415495540319, "sim_compute_performance-ego": 0.008346048633704025, "sim_compute_robot_state-ego": 0.010717197750391583, "sim_compute_robot_state-npc0": 0.01032122065511982, "sim_compute_robot_state-npc1": 0.009922406646642791, "sim_compute_robot_state-npc2": 0.009659333175487733, "sim_compute_robot_state-npc3": 0.009617923350816364}, "udem1-11-0": {"driven_any": 1.593445721352924, "sim_physics": 0.20770881350447493, "survival_time": 10.25000000000001, "driven_lanedir": 0.9876605957564752, "sim_render-ego": 0.01342797511961402, "in-drivable-lane": 2.249999999999992, "agent_compute-ego": 0.05742882054026534, "deviation-heading": 3.785581188046064, "set_robot_commands": 0.010058699584588772, "deviation-center-line": 0.7318231570036955, "driven_lanedir_consec": 0.8206007730697644, "sim_compute_sim_state": 0.005427369838807641, "sim_compute_performance-ego": 0.008050883688577792, "sim_compute_robot_state-ego": 0.009994681288556354, "sim_compute_robot_state-npc0": 0.009508403917638268, "sim_compute_robot_state-npc1": 0.009185297896222373, "sim_compute_robot_state-npc2": 0.00900954618686583, "sim_compute_robot_state-npc3": 0.009137954944517556}, "udem1-12-0": {"driven_any": 1.3604606934944867, "sim_physics": 0.2175111391327598, "survival_time": 8.79999999999999, "driven_lanedir": 0.5924344500646606, "sim_render-ego": 0.01256734403696927, "in-drivable-lane": 4.349999999999998, "agent_compute-ego": 0.06556703692132776, "deviation-heading": 1.4249770584547177, "set_robot_commands": 0.009508936242623762, "deviation-center-line": 0.17228933743076638, "driven_lanedir_consec": 0.5924344500646606, "sim_compute_sim_state": 0.005265582691539417, "sim_compute_performance-ego": 0.007222275842319836, "sim_compute_robot_state-ego": 0.009793254462155428, "sim_compute_robot_state-npc0": 0.008854979818517511, "sim_compute_robot_state-npc1": 0.008827970786528154, "sim_compute_robot_state-npc2": 0.008773431181907654, "sim_compute_robot_state-npc3": 0.008574133569544012}, "udem1-13-0": {"driven_any": 0.44456659569650775, "sim_physics": 0.2089627904276694, "survival_time": 3.099999999999997, "driven_lanedir": 0.4138822039143748, "sim_render-ego": 0.013578449526140767, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.05456927514845325, "deviation-heading": 0.6084847992847756, "set_robot_commands": 0.010495912644170944, "deviation-center-line": 0.26620553271640585, "driven_lanedir_consec": 0.4138822039143748, "sim_compute_sim_state": 0.005414685895366054, "sim_compute_performance-ego": 0.007858822422642861, "sim_compute_robot_state-ego": 0.009820945801273469, "sim_compute_robot_state-npc0": 0.009636309839064074, "sim_compute_robot_state-npc1": 0.0090812252413842, "sim_compute_robot_state-npc2": 0.009363270575000394, "sim_compute_robot_state-npc3": 0.009356129554010209}, "udem1-14-0": {"driven_any": 0.6372979635391577, "sim_physics": 0.23459499935771144, "survival_time": 4.299999999999993, "driven_lanedir": 0.09646652038162218, "sim_render-ego": 0.01310897427935933, "in-drivable-lane": 2.6499999999999932, "agent_compute-ego": 0.07021879040917685, "deviation-heading": 1.5116509682486077, "set_robot_commands": 0.009282988171244776, "deviation-center-line": 0.12195288898421298, "driven_lanedir_consec": 0.08072727852247885, "sim_compute_sim_state": 0.005084786304207735, "sim_compute_performance-ego": 0.00733144061509953, "sim_compute_robot_state-ego": 0.009200936140016068, "sim_compute_robot_state-npc0": 0.008927611417548602, "sim_compute_robot_state-npc1": 0.008622590885605923, "sim_compute_robot_state-npc2": 0.00889880989873132, "sim_compute_robot_state-npc3": 0.008718246637388717}}
set_robot_commands_max	0.011825203895568848
set_robot_commands_mean	0.01059865184640744
set_robot_commands_median	0.010673662821451824
set_robot_commands_min	0.009282988171244776
sim_compute_performance-ego_max	0.008927841981252035
sim_compute_performance-ego_mean	0.007925149567479502
sim_compute_performance-ego_median	0.007957689762115479
sim_compute_performance-ego_min	0.0069386012970455106
sim_compute_robot_state-ego_max	0.011056706309318542
sim_compute_robot_state-ego_mean	0.010195064669886612
sim_compute_robot_state-ego_median	0.010230889431265898
sim_compute_robot_state-ego_min	0.009188084375290643
sim_compute_robot_state-npc0_max	0.010375484243615882
sim_compute_robot_state-npc0_mean	0.009683811338713072
sim_compute_robot_state-npc0_median	0.009756375153859456
sim_compute_robot_state-npc0_min	0.00855414829556904
sim_compute_robot_state-npc1_max	0.010073937378920518
sim_compute_robot_state-npc1_mean	0.009383220795621507
sim_compute_robot_state-npc1_median	0.009511601130167644
sim_compute_robot_state-npc1_min	0.008090234938121978
sim_compute_robot_state-npc2_max	0.009992250307338444
sim_compute_robot_state-npc2_mean	0.009347351121142985
sim_compute_robot_state-npc2_median	0.009363270575000394
sim_compute_robot_state-npc2_min	0.007883832568214053
sim_compute_robot_state-npc3_max	0.009918076651436942
sim_compute_robot_state-npc3_mean	0.009306279708319582
sim_compute_robot_state-npc3_median	0.009470176696777344
sim_compute_robot_state-npc3_min	0.008113497779482887
sim_compute_sim_state_max	0.005901754676521599
sim_compute_sim_state_mean	0.0054978964868352504
sim_compute_sim_state_median	0.005461153984069825
sim_compute_sim_state_min	0.005013439390394423
sim_physics_max	0.2573448419570923
sim_physics_mean	0.22591002260544907
sim_physics_median	0.22513297990311024
sim_physics_min	0.20770881350447493
sim_render-ego_max	0.015201599566967455
sim_render-ego_mean	0.013728286130378178
sim_render-ego_median	0.013780019283294675
sim_render-ego_min	0.01238869863843161
simulation-passed	1
survival_time_max	14.950000000000076
survival_time_mean	8.73333333333335
survival_time_min	2.3999999999999995

No reset possible

24824

4336

baseline-IL-sim-tensorflow

step1-simulation

error

2019-11-04 06:55:45+00:00

2019-11-04 06:59:52+00:00

0:04:07

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24807

4344

Soroush Saryazdi 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

success

2019-11-02 17:34:36+00:00

2019-11-02 17:49:31+00:00

0:14:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4801341215786832
survival_time_median	4.099999999999993
deviation-center-line_median	0.3312620390371143
in-drivable-lane_median	0.34999999999999876

other stats

agent_compute-ego_max	0.06705735318331539
agent_compute-ego_mean	0.05913140619254957
agent_compute-ego_median	0.058822410862620286
agent_compute-ego_min	0.04842178395252354
deviation-center-line_max	0.5540930073957262
deviation-center-line_mean	0.34537905332642077
deviation-center-line_min	0.15813384618379425
deviation-heading_max	2.9506496617251803
deviation-heading_mean	1.9050376774822873
deviation-heading_median	1.697471765250956
deviation-heading_min	0.765151204284629
driven_any_max	1.8666867493883148
driven_any_mean	0.9363187849131565
driven_any_median	0.6052291386470404
driven_any_min	0.5088084994012348
driven_lanedir_consec_max	1.048320672031899
driven_lanedir_consec_mean	0.5732074629170179
driven_lanedir_consec_min	0.42082028398729454
driven_lanedir_max	1.0509873371905831
driven_lanedir_mean	0.6295740337685896
driven_lanedir_median	0.4815015904939095
driven_lanedir_min	0.42082028398729454
in-drivable-lane_max	4.200000000000033
in-drivable-lane_mean	1.2700000000000051
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.1518676741610772, "sim_physics": 0.2263916754564702, "survival_time": 7.549999999999981, "driven_lanedir": 0.7144268355924773, "sim_render-ego": 0.01481935362152706, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.04842178395252354, "deviation-heading": 2.9506496617251803, "set_robot_commands": 0.010361229347077427, "deviation-center-line": 0.3867428697948137, "driven_lanedir_consec": 0.4352606464933027, "sim_compute_sim_state": 0.0057404736019917675, "sim_compute_performance-ego": 0.008143898667089196, "sim_compute_robot_state-ego": 0.011035066566719914, "sim_compute_robot_state-npc0": 0.010493575342443605, "sim_compute_robot_state-npc1": 0.009755308264928148, "sim_compute_robot_state-npc2": 0.009290586244191556, "sim_compute_robot_state-npc3": 0.009519755445568767}, "udem1-1-0": {"driven_any": 0.5088084994012348, "sim_physics": 0.2084019729069301, "survival_time": 3.4999999999999956, "driven_lanedir": 0.42082028398729454, "sim_render-ego": 0.014593447957720076, "in-drivable-lane": 0, "agent_compute-ego": 0.06392741543906076, "deviation-heading": 1.697471765250956, "set_robot_commands": 0.009591477257864816, "deviation-center-line": 0.15813384618379425, "driven_lanedir_consec": 0.42082028398729454, "sim_compute_sim_state": 0.0053180558340890065, "sim_compute_performance-ego": 0.008202133859906877, "sim_compute_robot_state-ego": 0.011010687691824776, "sim_compute_robot_state-npc0": 0.009599406378609794, "sim_compute_robot_state-npc1": 0.00925865513937814, "sim_compute_robot_state-npc2": 0.009258365631103516, "sim_compute_robot_state-npc3": 0.009351580483572824}, "udem1-2-0": {"driven_any": 0.5490018629681138, "sim_physics": 0.2318528207143148, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4815015904939095, "sim_render-ego": 0.014638563791910808, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.05742806752522787, "deviation-heading": 0.765151204284629, "set_robot_commands": 0.00987736701965332, "deviation-center-line": 0.2966635042206553, "driven_lanedir_consec": 0.4815015904939095, "sim_compute_sim_state": 0.005909245808919271, "sim_compute_performance-ego": 0.007672599156697591, "sim_compute_robot_state-ego": 0.010251843134562174, "sim_compute_robot_state-npc0": 0.009392563501993816, "sim_compute_robot_state-npc1": 0.009252971013387044, "sim_compute_robot_state-npc2": 0.009112520217895508, "sim_compute_robot_state-npc3": 0.00905466397603353}, "udem1-3-0": {"driven_any": 0.6052291386470404, "sim_physics": 0.2223702262087566, "survival_time": 4.099999999999993, "driven_lanedir": 0.4801341215786832, "sim_render-ego": 0.013411443407942609, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.058822410862620286, "deviation-heading": 1.3773828720200891, "set_robot_commands": 0.009252911660729383, "deviation-center-line": 0.3312620390371143, "driven_lanedir_consec": 0.4801341215786832, "sim_compute_sim_state": 0.0053129312468738095, "sim_compute_performance-ego": 0.008290750224415848, "sim_compute_robot_state-ego": 0.009991395764234587, "sim_compute_robot_state-npc0": 0.009572831595816265, "sim_compute_robot_state-npc1": 0.009176742739793731, "sim_compute_robot_state-npc2": 0.00903692768841255, "sim_compute_robot_state-npc3": 0.009415940540592844}, "udem1-4-0": {"driven_any": 1.8666867493883148, "sim_physics": 0.2162567671372801, "survival_time": 11.950000000000037, "driven_lanedir": 1.0509873371905831, "sim_render-ego": 0.013617562449626842, "in-drivable-lane": 4.200000000000033, "agent_compute-ego": 0.06705735318331539, "deviation-heading": 2.7345328841305823, "set_robot_commands": 0.010018128231479533, "deviation-center-line": 0.5540930073957262, "driven_lanedir_consec": 1.048320672031899, "sim_compute_sim_state": 0.005582623900728744, "sim_compute_performance-ego": 0.007767137623232279, "sim_compute_robot_state-ego": 0.010382159484480217, "sim_compute_robot_state-npc0": 0.009518500651275762, "sim_compute_robot_state-npc1": 0.009272749952691369, "sim_compute_robot_state-npc2": 0.009200560996721978, "sim_compute_robot_state-npc3": 0.009276583603735247}}
set_robot_commands_max	0.010361229347077427
set_robot_commands_mean	0.009820222703360896
set_robot_commands_median	0.00987736701965332
set_robot_commands_min	0.009252911660729383
sim_compute_performance-ego_max	0.008290750224415848
sim_compute_performance-ego_mean	0.008015303906268359
sim_compute_performance-ego_median	0.008143898667089196
sim_compute_performance-ego_min	0.007672599156697591
sim_compute_robot_state-ego_max	0.011035066566719914
sim_compute_robot_state-ego_mean	0.010534230528364334
sim_compute_robot_state-ego_median	0.010382159484480217
sim_compute_robot_state-ego_min	0.009991395764234587
sim_compute_robot_state-npc0_max	0.010493575342443605
sim_compute_robot_state-npc0_mean	0.009715375494027848
sim_compute_robot_state-npc0_median	0.009572831595816265
sim_compute_robot_state-npc0_min	0.009392563501993816
sim_compute_robot_state-npc1_max	0.009755308264928148
sim_compute_robot_state-npc1_mean	0.009343285422035686
sim_compute_robot_state-npc1_median	0.00925865513937814
sim_compute_robot_state-npc1_min	0.009176742739793731
sim_compute_robot_state-npc2_max	0.009290586244191556
sim_compute_robot_state-npc2_mean	0.009179792155665022
sim_compute_robot_state-npc2_median	0.009200560996721978
sim_compute_robot_state-npc2_min	0.00903692768841255
sim_compute_robot_state-npc3_max	0.009519755445568767
sim_compute_robot_state-npc3_mean	0.009323704809900643
sim_compute_robot_state-npc3_median	0.009351580483572824
sim_compute_robot_state-npc3_min	0.00905466397603353
sim_compute_sim_state_max	0.005909245808919271
sim_compute_sim_state_mean	0.0055726660785205195
sim_compute_sim_state_median	0.005582623900728744
sim_compute_sim_state_min	0.0053129312468738095
sim_physics_max	0.2318528207143148
sim_physics_mean	0.22105469248475035
sim_physics_median	0.2223702262087566
sim_physics_min	0.2084019729069301
sim_render-ego_max	0.01481935362152706
sim_render-ego_mean	0.01421607424574548
sim_render-ego_median	0.014593447957720076
sim_render-ego_min	0.013411443407942609
simulation-passed	1
survival_time_max	11.950000000000037
survival_time_mean	6.17
survival_time_min	3.4999999999999956

No reset possible

24785

4332

Soroush Saryazdi 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-11-02 16:24:17+00:00

2019-11-02 16:40:55+00:00

0:16:38

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.02497234167876067
agent_compute-ego_mean	0.021170561380171704
agent_compute-ego_median	0.0222210693359375
agent_compute-ego_min	0.0143506721574433
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1112205456826628
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.37150980594423094
deviation-heading_median	0.34774352178293905
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589055
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.15305814919648347, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.012625760502285428, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.023978193600972492, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.008613471631650571, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004810214042663574, "sim_compute_performance-ego": 0.006991673398900915, "sim_compute_robot_state-ego": 0.009427701985394513, "sim_compute_robot_state-npc0": 0.00873463683658176, "sim_compute_robot_state-npc1": 0.008372412787543403, "sim_compute_robot_state-npc2": 0.008338230627554434, "sim_compute_robot_state-npc3": 0.007756758619237829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.16477983474731445, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.012545862197875976, "in-drivable-lane": 0, "agent_compute-ego": 0.02252969741821289, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.008557653427124024, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.005045795440673828, "sim_compute_performance-ego": 0.006786098480224609, "sim_compute_robot_state-ego": 0.008836593627929688, "sim_compute_robot_state-npc0": 0.008595161437988282, "sim_compute_robot_state-npc1": 0.00815810203552246, "sim_compute_robot_state-npc2": 0.008041706085205078, "sim_compute_robot_state-npc3": 0.008243141174316406}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1782430975060714, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.01236221664830258, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.023647672251651163, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.008714224162854646, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.004953111472882722, "sim_compute_performance-ego": 0.00700596759193822, "sim_compute_robot_state-ego": 0.009029774289382132, "sim_compute_robot_state-npc0": 0.00829476745505082, "sim_compute_robot_state-npc1": 0.007736215465947201, "sim_compute_robot_state-npc2": 0.0078039890841433875, "sim_compute_robot_state-npc3": 0.00792917766069111}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.2025085370751876, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.013040639177153382, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.023248446138599253, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.009167245671718937, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.005228102961673012, "sim_compute_performance-ego": 0.007015315792228602, "sim_compute_robot_state-ego": 0.00989000404937358, "sim_compute_robot_state-npc0": 0.008715913265566283, "sim_compute_robot_state-npc1": 0.008233471761775923, "sim_compute_robot_state-npc2": 0.008369946781593033, "sim_compute_robot_state-npc3": 0.008371573460252978}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.14030563831329346, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.010910655770983015, "in-drivable-lane": 0, "agent_compute-ego": 0.02120539971760341, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.007894950253622872, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.00496769802910941, "sim_compute_performance-ego": 0.005939926419939313, "sim_compute_robot_state-ego": 0.007413114820207868, "sim_compute_robot_state-npc0": 0.0077595625604902, "sim_compute_robot_state-npc1": 0.007213447775159564, "sim_compute_robot_state-npc2": 0.008325704506465368, "sim_compute_robot_state-npc3": 0.007614552974700928}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.15621866561748363, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.01268332975882071, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.02497234167876067, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.00955756946846291, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.005359751206857187, "sim_compute_performance-ego": 0.006991042031182183, "sim_compute_robot_state-ego": 0.00924166485115334, "sim_compute_robot_state-npc0": 0.009159622368989168, "sim_compute_robot_state-npc1": 0.008900969116776078, "sim_compute_robot_state-npc2": 0.008416114030060944, "sim_compute_robot_state-npc3": 0.008388740045052988}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0456729849899615, "sim_physics": 0.12558680110507542, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.011301773565786856, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.020139623571325233, "deviation-heading": 0.3927366768210136, "set_robot_commands": 0.007287692140649866, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.004191928439670139, "sim_compute_performance-ego": 0.006163239479064941, "sim_compute_robot_state-ego": 0.007834558133725767, "sim_compute_robot_state-npc0": 0.006927507895010489, "sim_compute_robot_state-npc1": 0.007008481908727575, "sim_compute_robot_state-npc2": 0.00699144822579843, "sim_compute_robot_state-npc3": 0.007060011227925618}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8772562288570896, "sim_physics": 0.2256214459737142, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.011819887161254882, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.022829151153564452, "deviation-heading": 0.3844740406851849, "set_robot_commands": 0.009267187118530274, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.0050458537207709415, "sim_compute_performance-ego": 0.007223871019151475, "sim_compute_robot_state-ego": 0.009708256191677518, "sim_compute_robot_state-npc0": 0.008732101652357313, "sim_compute_robot_state-npc1": 0.00795835918850369, "sim_compute_robot_state-npc2": 0.0085397826300727, "sim_compute_robot_state-npc3": 0.00793049070570204}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.843301097417158, "sim_physics": 0.12875759601593018, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.011281231175298277, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.021030249802962593, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.00865148461383322, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.004609859508016835, "sim_compute_performance-ego": 0.006512564161549444, "sim_compute_robot_state-ego": 0.008291192676710047, "sim_compute_robot_state-npc0": 0.00763758369114088, "sim_compute_robot_state-npc1": 0.007509889809981636, "sim_compute_robot_state-npc2": 0.007689398267994757, "sim_compute_robot_state-npc3": 0.007581576057102369}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.17567087650299074, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.012525734901428222, "in-drivable-lane": 0, "agent_compute-ego": 0.0222210693359375, "deviation-heading": 0.34774352178293905, "set_robot_commands": 0.00882735252380371, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.005680332183837891, "sim_compute_performance-ego": 0.006908583641052246, "sim_compute_robot_state-ego": 0.008690996170043945, "sim_compute_robot_state-npc0": 0.00813115119934082, "sim_compute_robot_state-npc1": 0.0081107759475708, "sim_compute_robot_state-npc2": 0.008116984367370605, "sim_compute_robot_state-npc3": 0.008022956848144532}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.17116546630859375, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.01222902536392212, "in-drivable-lane": 0, "agent_compute-ego": 0.021467876434326173, "deviation-heading": 0.3801610449156702, "set_robot_commands": 0.007601916790008545, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.004320120811462403, "sim_compute_performance-ego": 0.006147503852844238, "sim_compute_robot_state-ego": 0.008706343173980714, "sim_compute_robot_state-npc0": 0.007618796825408935, "sim_compute_robot_state-npc1": 0.007423341274261475, "sim_compute_robot_state-npc2": 0.0077334284782409664, "sim_compute_robot_state-npc3": 0.007516849040985108}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.13986522273013466, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.01163482666015625, "in-drivable-lane": 0, "agent_compute-ego": 0.02260858134219521, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.008825954638029399, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.004467098336470754, "sim_compute_performance-ego": 0.006408415342632093, "sim_compute_robot_state-ego": 0.008901470585873253, "sim_compute_robot_state-npc0": 0.008578639281423469, "sim_compute_robot_state-npc1": 0.007719378722341437, "sim_compute_robot_state-npc2": 0.00854836012187757, "sim_compute_robot_state-npc3": 0.007836417147987768}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700496, "sim_physics": 0.08509016513824463, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.008081307411193847, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.017457942962646484, "deviation-heading": 0.2263485117662672, "set_robot_commands": 0.005453629493713379, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.0032234096527099607, "sim_compute_performance-ego": 0.0042102766036987305, "sim_compute_robot_state-ego": 0.005592231750488281, "sim_compute_robot_state-npc0": 0.005564932823181152, "sim_compute_robot_state-npc1": 0.005220999717712402, "sim_compute_robot_state-npc2": 0.005041332244873047, "sim_compute_robot_state-npc3": 0.005134444236755371}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3514429441281624, "sim_physics": 0.10950652035799892, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.02015819332816384, "in-drivable-lane": 0, "agent_compute-ego": 0.015871503136374733, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.005759607661854137, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.0033310760151256213, "sim_compute_performance-ego": 0.004772934046658603, "sim_compute_robot_state-ego": 0.005997267636385831, "sim_compute_robot_state-npc0": 0.005674351345409046, "sim_compute_robot_state-npc1": 0.005558274009011008, "sim_compute_robot_state-npc2": 0.005324927243319425, "sim_compute_robot_state-npc3": 0.005553776567632502}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10179235010730978, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.007531458017777423, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.0143506721574433, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.0052020160519346895, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.003074529219646843, "sim_compute_performance-ego": 0.004041443065721162, "sim_compute_robot_state-ego": 0.005402151419191944, "sim_compute_robot_state-npc0": 0.005004946066408741, "sim_compute_robot_state-npc1": 0.004726867286526427, "sim_compute_robot_state-npc2": 0.004705905914306641, "sim_compute_robot_state-npc3": 0.004689163091231366}}
set_robot_commands_max	0.00955756946846291
set_robot_commands_mean	0.00795879704318608
set_robot_commands_median	0.008613471631650571
set_robot_commands_min	0.0052020160519346895
sim_compute_performance-ego_max	0.007223871019151475
sim_compute_performance-ego_mean	0.006207923661785784
sim_compute_performance-ego_median	0.006512564161549444
sim_compute_performance-ego_min	0.004041443065721162
sim_compute_robot_state-ego_max	0.00989000404937358
sim_compute_robot_state-ego_mean	0.00819755475743456
sim_compute_robot_state-ego_median	0.008706343173980714
sim_compute_robot_state-ego_min	0.005402151419191944
sim_compute_robot_state-npc0_max	0.009159622368989168
sim_compute_robot_state-npc0_mean	0.00767531164695649
sim_compute_robot_state-npc0_median	0.00813115119934082
sim_compute_robot_state-npc0_min	0.005004946066408741
sim_compute_robot_state-npc1_max	0.008900969116776078
sim_compute_robot_state-npc1_mean	0.007323399120490739
sim_compute_robot_state-npc1_median	0.007719378722341437
sim_compute_robot_state-npc1_min	0.004726867286526427
sim_compute_robot_state-npc2_max	0.00854836012187757
sim_compute_robot_state-npc2_mean	0.007465817240591758
sim_compute_robot_state-npc2_median	0.008041706085205078
sim_compute_robot_state-npc2_min	0.004705905914306641
sim_compute_robot_state-npc3_max	0.008388740045052988
sim_compute_robot_state-npc3_mean	0.007308641923847928
sim_compute_robot_state-npc3_median	0.007756758619237829
sim_compute_robot_state-npc3_min	0.004689163091231366
sim_compute_sim_state_max	0.005680332183837891
sim_compute_sim_state_mean	0.0045539254027714094
sim_compute_sim_state_median	0.004810214042663574
sim_compute_sim_state_min	0.003074529219646843
sim_physics_max	0.2256214459737142
sim_physics_mean	0.1505446911130551
sim_physics_median	0.15305814919648347
sim_physics_min	0.08509016513824463
sim_render-ego_max	0.02015819332816384
sim_render-ego_mean	0.01204879344269352
sim_render-ego_median	0.01222902536392212
sim_render-ego_min	0.007531458017777423
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

24784

4327

Soroush Saryazdi 🇨🇦

PredictorLast

step1-simulation

success

yes

2019-11-02 15:57:22+00:00

2019-11-02 15:57:57+00:00

0:00:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10978565324407494
error_L2	0.017617866468489427

No reset possible

24781

4324

baseline-IL-sim-tensorflow

step1-simulation

error

2019-11-02 14:40:54+00:00

2019-11-02 14:44:35+00:00

0:03:41

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24778

4322

baseline-IL-sim-tensorflow

step1-simulation

error

2019-11-02 13:02:44+00:00

2019-11-02 13:06:31+00:00

0:03:47

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24766

4318

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

step1-simulation

success

2019-11-02 06:48:39+00:00

2019-11-02 06:55:50+00:00

0:07:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5723310224856362
survival_time_median	2.6999999999999984
deviation-center-line_median	0.11519544839797546
in-drivable-lane_median	0.5999999999999979

other stats

agent_compute-ego_max	0.01993576244071678
agent_compute-ego_mean	0.017752677346440367
agent_compute-ego_median	0.017637745330208225
agent_compute-ego_min	0.015903491973876954
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1265175655253199
deviation-center-line_min	0.09047885846140293
deviation-heading_max	0.5020407942599271
deviation-heading_mean	0.3641979127291371
deviation-heading_median	0.34764983431811225
deviation-heading_min	0.19401296908406307
driven_any_max	1.6169932854589055
driven_any_mean	1.0272530755098268
driven_any_median	1.0243289631429704
driven_any_min	0.4119037580118985
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.7800316850006626
driven_lanedir_consec_min	0.3792793194470208
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.7800316850006626
driven_lanedir_median	0.5723310224856362
driven_lanedir_min	0.3792793194470208
in-drivable-lane_max	0.9999999999999976
in-drivable-lane_mean	0.4899999999999984
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.1126954643814652, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.010463582144843208, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.01993576244071678, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0067657143981368455, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.004045839662905093, "sim_compute_performance-ego": 0.007223897510104709, "sim_compute_robot_state-ego": 0.0074542805000587745, "sim_compute_robot_state-npc0": 0.0069250354060420285, "sim_compute_robot_state-npc1": 0.006430811352199978, "sim_compute_robot_state-npc2": 0.0064125679157398365, "sim_compute_robot_state-npc3": 0.006454185203269676}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.11678348541259766, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.009432859420776369, "in-drivable-lane": 0, "agent_compute-ego": 0.015903491973876954, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.006160697937011719, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0035489368438720702, "sim_compute_performance-ego": 0.005197105407714844, "sim_compute_robot_state-ego": 0.0066763019561767575, "sim_compute_robot_state-npc0": 0.006012763977050781, "sim_compute_robot_state-npc1": 0.005721073150634765, "sim_compute_robot_state-npc2": 0.005768671035766602, "sim_compute_robot_state-npc3": 0.005863542556762695}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10781883566003096, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.009196535537117408, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.017637745330208225, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006238096638729698, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.0035055185619153476, "sim_compute_performance-ego": 0.0051194335284985995, "sim_compute_robot_state-ego": 0.006755232810974121, "sim_compute_robot_state-npc0": 0.0059592190541719135, "sim_compute_robot_state-npc1": 0.006008935602087723, "sim_compute_robot_state-npc2": 0.0058644100239402365, "sim_compute_robot_state-npc3": 0.005827819046221282}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.11471031285539458, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.009585576721384556, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.017989400066906892, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.006169868420950974, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.003840754303751112, "sim_compute_performance-ego": 0.005106675473949577, "sim_compute_robot_state-ego": 0.006656661818299113, "sim_compute_robot_state-npc0": 0.006225773050815244, "sim_compute_robot_state-npc1": 0.006003793281844899, "sim_compute_robot_state-npc2": 0.006364427035367942, "sim_compute_robot_state-npc3": 0.0059330976462062405}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.108697772026062, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.009348980018070763, "in-drivable-lane": 0, "agent_compute-ego": 0.01729698692049299, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0062233975955418176, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.003605919224875314, "sim_compute_performance-ego": 0.004954363618578229, "sim_compute_robot_state-ego": 0.006657106535775321, "sim_compute_robot_state-npc0": 0.006406537124088832, "sim_compute_robot_state-npc1": 0.006428693022046771, "sim_compute_robot_state-npc2": 0.005855730601719448, "sim_compute_robot_state-npc3": 0.005912065505981445}}
set_robot_commands_max	0.0067657143981368455
set_robot_commands_mean	0.0063115549980742106
set_robot_commands_median	0.0062233975955418176
set_robot_commands_min	0.006160697937011719
sim_compute_performance-ego_max	0.007223897510104709
sim_compute_performance-ego_mean	0.005520295107769192
sim_compute_performance-ego_median	0.0051194335284985995
sim_compute_performance-ego_min	0.004954363618578229
sim_compute_robot_state-ego_max	0.0074542805000587745
sim_compute_robot_state-ego_mean	0.006839916724256817
sim_compute_robot_state-ego_median	0.0066763019561767575
sim_compute_robot_state-ego_min	0.006656661818299113
sim_compute_robot_state-npc0_max	0.0069250354060420285
sim_compute_robot_state-npc0_mean	0.006305865722433761
sim_compute_robot_state-npc0_median	0.006225773050815244
sim_compute_robot_state-npc0_min	0.0059592190541719135
sim_compute_robot_state-npc1_max	0.006430811352199978
sim_compute_robot_state-npc1_mean	0.0061186612817628275
sim_compute_robot_state-npc1_median	0.006008935602087723
sim_compute_robot_state-npc1_min	0.005721073150634765
sim_compute_robot_state-npc2_max	0.0064125679157398365
sim_compute_robot_state-npc2_mean	0.0060531613225068125
sim_compute_robot_state-npc2_median	0.0058644100239402365
sim_compute_robot_state-npc2_min	0.005768671035766602
sim_compute_robot_state-npc3_max	0.006454185203269676
sim_compute_robot_state-npc3_mean	0.005998141991688267
sim_compute_robot_state-npc3_median	0.005912065505981445
sim_compute_robot_state-npc3_min	0.005827819046221282
sim_compute_sim_state_max	0.004045839662905093
sim_compute_sim_state_mean	0.003709393719463788
sim_compute_sim_state_median	0.003605919224875314
sim_compute_sim_state_min	0.0035055185619153476
sim_physics_max	0.11678348541259766
sim_physics_mean	0.11214117406711008
sim_physics_median	0.1126954643814652
sim_physics_min	0.10781883566003096
sim_render-ego_max	0.010463582144843208
sim_render-ego_mean	0.00960550676843846
sim_render-ego_median	0.009432859420776369
sim_render-ego_min	0.009196535537117408
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.6199999999999974
survival_time_min	1.2500000000000004

No reset possible

24762

4310

Frank (Chude) Qian 🇨🇦

PredictorLast

step1-simulation

success

yes

2019-11-01 23:00:20+00:00

2019-11-01 23:00:55+00:00

0:00:35

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1154870840409771
error_L2	0.020425378205070947

No reset possible

24759

4308

Baseline-IL-logs-tensorflow

step1-simulation

success

2019-10-31 18:41:28+00:00

2019-10-31 18:49:10+00:00

0:07:42

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6381379121748907
survival_time_median	7.399999999999982
deviation-center-line_median	0.3458241270030483
in-drivable-lane_median	0.4999999999999982

other stats

agent_compute-ego_max	0.04857608167136588
agent_compute-ego_mean	0.04759603666128739
agent_compute-ego_median	0.04746597321307073
agent_compute-ego_min	0.04654712336403983
deviation-center-line_max	0.5539609619555554
deviation-center-line_mean	0.32449679364700207
deviation-center-line_min	0.14048354962475534
deviation-heading_max	3.002236837109649
deviation-heading_mean	1.6820948975304773
deviation-heading_median	1.4222533405952598
deviation-heading_min	0.4243211759775579
driven_any_max	1.6244973693232885
driven_any_mean	0.8377251580414683
driven_any_median	1.0115913434999215
driven_any_min	0.19493797342207836
driven_lanedir_consec_max	1.2243464312471977
driven_lanedir_consec_mean	0.6308845586960733
driven_lanedir_consec_min	0.18495352759804184
driven_lanedir_max	1.226846661616655
driven_lanedir_mean	0.632431316989237
driven_lanedir_median	0.6433714732712521
driven_lanedir_min	0.18495352759804184
in-drivable-lane_max	1.9500000000000275
in-drivable-lane_mean	0.8000000000000046
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0783062510720185, "sim_physics": 0.04623649469236048, "survival_time": 8.199999999999982, "driven_lanedir": 0.6433714732712521, "sim_render-ego": 0.0068337074140223065, "in-drivable-lane": 1.5499999999999972, "agent_compute-ego": 0.04857608167136588, "deviation-heading": 3.002236837109649, "set_robot_commands": 0.004374774490914694, "deviation-center-line": 0.3458241270030483, "driven_lanedir_consec": 0.6381379121748907, "sim_compute_sim_state": 0.002828295637921589, "sim_compute_performance-ego": 0.003806922493911371, "sim_compute_robot_state-ego": 0.004744188087742503}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0115913434999215, "sim_physics": 0.0469532399564176, "survival_time": 7.399999999999982, "driven_lanedir": 0.8703093231358646, "sim_render-ego": 0.006869443365045496, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04716482194694313, "deviation-heading": 1.4222533405952598, "set_robot_commands": 0.004396718901556892, "deviation-center-line": 0.42151903836265914, "driven_lanedir_consec": 0.8703093231358646, "sim_compute_sim_state": 0.002809888607746846, "sim_compute_performance-ego": 0.0036559894278242783, "sim_compute_robot_state-ego": 0.004668807661211169}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19493797342207836, "sim_physics": 0.04734330517905099, "survival_time": 1.4000000000000006, "driven_lanedir": 0.18495352759804184, "sim_render-ego": 0.007122337818145752, "in-drivable-lane": 0, "agent_compute-ego": 0.04654712336403983, "deviation-heading": 0.4243211759775579, "set_robot_commands": 0.00463172367640904, "deviation-center-line": 0.14048354962475534, "driven_lanedir_consec": 0.18495352759804184, "sim_compute_sim_state": 0.002816838877541678, "sim_compute_performance-ego": 0.003736249038151333, "sim_compute_robot_state-ego": 0.004782932145254952}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2792928528900355, "sim_physics": 0.05017579685557972, "survival_time": 2.2, "driven_lanedir": 0.23667559932437188, "sim_render-ego": 0.007032578641718084, "in-drivable-lane": 0, "agent_compute-ego": 0.0482261831110174, "deviation-heading": 1.1374162113714308, "set_robot_commands": 0.004374867135828192, "deviation-center-line": 0.16069629128899207, "driven_lanedir_consec": 0.23667559932437188, "sim_compute_sim_state": 0.0028306245803833008, "sim_compute_performance-ego": 0.0036894949999722567, "sim_compute_robot_state-ego": 0.004793882369995117}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6244973693232885, "sim_physics": 0.04420108775623509, "survival_time": 12.200000000000038, "driven_lanedir": 1.226846661616655, "sim_render-ego": 0.006883735539483242, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.04746597321307073, "deviation-heading": 2.42424692259849, "set_robot_commands": 0.004478717436555956, "deviation-center-line": 0.5539609619555554, "driven_lanedir_consec": 1.2243464312471977, "sim_compute_sim_state": 0.0027839492578975488, "sim_compute_performance-ego": 0.003719854550283463, "sim_compute_robot_state-ego": 0.004672237107011139}}
set_robot_commands_max	0.00463172367640904
set_robot_commands_mean	0.004451360328252956
set_robot_commands_median	0.004396718901556892
set_robot_commands_min	0.004374774490914694
sim_compute_performance-ego_max	0.003806922493911371
sim_compute_performance-ego_mean	0.00372170210202854
sim_compute_performance-ego_median	0.003719854550283463
sim_compute_performance-ego_min	0.0036559894278242783
sim_compute_robot_state-ego_max	0.004793882369995117
sim_compute_robot_state-ego_mean	0.004732409474242976
sim_compute_robot_state-ego_median	0.004744188087742503
sim_compute_robot_state-ego_min	0.004668807661211169
sim_compute_sim_state_max	0.0028306245803833008
sim_compute_sim_state_mean	0.002813919392298193
sim_compute_sim_state_median	0.002816838877541678
sim_compute_sim_state_min	0.0027839492578975488
sim_physics_max	0.05017579685557972
sim_physics_mean	0.04698198488792878
sim_physics_median	0.0469532399564176
sim_physics_min	0.04420108775623509
sim_render-ego_max	0.007122337818145752
sim_render-ego_mean	0.006948360555682977
sim_render-ego_median	0.006883735539483242
sim_render-ego_min	0.0068337074140223065
simulation-passed	1
survival_time_max	12.200000000000038
survival_time_mean	6.28
survival_time_min	1.4000000000000006

No reset possible

24757

3264

Liu Sam 🇹🇼

challenge-aido_LF-template-random

step1-simulation

host-error

yes

2019-10-31 14:17:47+00:00

2019-10-31 14:17:51+00:00

0:00:04

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24745

4304

Frank (Chude) Qian 🇨🇦

Frank test submission

step1-simulation

success

2019-10-31 14:05:28+00:00

2019-10-31 14:17:23+00:00

0:11:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.43495812661747424
survival_time_median	2.0500000000000007
deviation-center-line_median	0.09687098510612133
in-drivable-lane_median	0.4500000000000002

other stats

agent_compute-ego_max	0.02663808465003967
agent_compute-ego_mean	0.01992965931187516
agent_compute-ego_median	0.019916903972625733
agent_compute-ego_min	0.014969069783280536
deviation-center-line_max	0.23261450644924175
deviation-center-line_mean	0.09978733911587848
deviation-center-line_min	0.05490406966943519
deviation-heading_max	0.7002960682232355
deviation-heading_mean	0.33441413138792325
deviation-heading_median	0.30410032611577853
deviation-heading_min	0.1541202345559414
driven_any_max	2.049654638257259
driven_any_mean	1.0200634097564325
driven_any_median	1.0296612854712788
driven_any_min	0.37149985167138455
driven_lanedir_consec_max	1.2187176370157662
driven_lanedir_consec_mean	0.6231087646131666
driven_lanedir_consec_min	0.3341891362194134
driven_lanedir_max	1.2187176370157662
driven_lanedir_mean	0.6231087646131666
driven_lanedir_median	0.43495812661747424
driven_lanedir_min	0.3341891362194134
in-drivable-lane_max	2.149999999999994
in-drivable-lane_mean	0.5999999999999993
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.1540989339351654, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.012403875589370728, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.02663808465003967, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.008436554670333862, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.004765951633453369, "sim_compute_performance-ego": 0.006441783905029297, "sim_compute_robot_state-ego": 0.00896141529083252, "sim_compute_robot_state-npc0": 0.00838688611984253, "sim_compute_robot_state-npc1": 0.008341974020004273, "sim_compute_robot_state-npc2": 0.007841926813125611, "sim_compute_robot_state-npc3": 0.008028763532638549}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4605114688305785, "sim_physics": 0.14570718461816962, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495812661747424, "sim_render-ego": 0.0121592716737227, "in-drivable-lane": 0, "agent_compute-ego": 0.024221279404380104, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.008925893089988014, "deviation-center-line": 0.0772648215662309, "driven_lanedir_consec": 0.43495812661747424, "sim_compute_sim_state": 0.004570343277671121, "sim_compute_performance-ego": 0.006665630774064498, "sim_compute_robot_state-ego": 0.008601210334084251, "sim_compute_robot_state-npc0": 0.008070100437511097, "sim_compute_robot_state-npc1": 0.007874261249195446, "sim_compute_robot_state-npc2": 0.008250106464732777, "sim_compute_robot_state-npc3": 0.008027770302512428}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.599654688730019, "sim_physics": 0.1374813119570414, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.011447580655415852, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.025243250528971355, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.007657575607299805, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.004609107971191406, "sim_compute_performance-ego": 0.006602458159128825, "sim_compute_robot_state-ego": 0.008355168501536052, "sim_compute_robot_state-npc0": 0.007476194699605306, "sim_compute_robot_state-npc1": 0.007266982396443685, "sim_compute_robot_state-npc2": 0.0075483600298563635, "sim_compute_robot_state-npc3": 0.0071662068367004395}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.59965468873004, "sim_physics": 0.11458237965901692, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2187176370157662, "sim_render-ego": 0.00944447120030721, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.020365095138549803, "deviation-heading": 0.2793068494541745, "set_robot_commands": 0.006460813681284586, "deviation-center-line": 0.11447341980984076, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.0036882797876993815, "sim_compute_performance-ego": 0.005017900466918945, "sim_compute_robot_state-ego": 0.006522425015767415, "sim_compute_robot_state-npc0": 0.006443162759145101, "sim_compute_robot_state-npc1": 0.006203679243723551, "sim_compute_robot_state-npc2": 0.006214237213134766, "sim_compute_robot_state-npc3": 0.0060456593831380205}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4010834948810249, "sim_physics": 0.12383569478988649, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3872027169265986, "sim_render-ego": 0.010631716251373291, "in-drivable-lane": 0, "agent_compute-ego": 0.022844386100769044, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.007084202766418457, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3872027169265986, "sim_compute_sim_state": 0.004045939445495606, "sim_compute_performance-ego": 0.005447089672088623, "sim_compute_robot_state-ego": 0.007259714603424072, "sim_compute_robot_state-npc0": 0.006674659252166748, "sim_compute_robot_state-npc1": 0.006884336471557617, "sim_compute_robot_state-npc2": 0.006400692462921143, "sim_compute_robot_state-npc3": 0.006956064701080322}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0596597849416751, "sim_physics": 0.08599154154459636, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4194320481036524, "sim_render-ego": 0.008303806895301455, "in-drivable-lane": 0.8500000000000006, "agent_compute-ego": 0.018958086059207006, "deviation-heading": 0.7002960682232355, "set_robot_commands": 0.0059171233858381, "deviation-center-line": 0.1184982840435769, "driven_lanedir_consec": 0.4194320481036524, "sim_compute_sim_state": 0.0031787043526059107, "sim_compute_performance-ego": 0.004451059159778413, "sim_compute_robot_state-ego": 0.005776479130699521, "sim_compute_robot_state-npc0": 0.005505715097699847, "sim_compute_robot_state-npc1": 0.005350453513009208, "sim_compute_robot_state-npc2": 0.005396019844781785, "sim_compute_robot_state-npc3": 0.005251748221261161}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9996632207705796, "sim_physics": 0.1002435028553009, "survival_time": 2.000000000000001, "driven_lanedir": 0.6650890986148248, "sim_render-ego": 0.00924898386001587, "in-drivable-lane": 0.40000000000000013, "agent_compute-ego": 0.019916903972625733, "deviation-heading": 0.4487014341183701, "set_robot_commands": 0.006209927797317505, "deviation-center-line": 0.10928357993966978, "driven_lanedir_consec": 0.6650890986148248, "sim_compute_sim_state": 0.0037600338459014898, "sim_compute_performance-ego": 0.005091071128845215, "sim_compute_robot_state-ego": 0.00642743706703186, "sim_compute_robot_state-npc0": 0.005906730890274048, "sim_compute_robot_state-npc1": 0.00618852972984314, "sim_compute_robot_state-npc2": 0.0056721031665802005, "sim_compute_robot_state-npc3": 0.005847233533859253}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.049654638257259, "sim_physics": 0.1122174294789632, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7460407290516171, "sim_render-ego": 0.00936563491821289, "in-drivable-lane": 2.149999999999994, "agent_compute-ego": 0.020211884180704753, "deviation-heading": 0.30410032611577853, "set_robot_commands": 0.006651814778645833, "deviation-center-line": 0.1152644463841786, "driven_lanedir_consec": 0.7460407290516171, "sim_compute_sim_state": 0.0034538555145263673, "sim_compute_performance-ego": 0.005116421381632487, "sim_compute_robot_state-ego": 0.0064809862772623695, "sim_compute_robot_state-npc0": 0.006034104029337565, "sim_compute_robot_state-npc1": 0.005894123713175456, "sim_compute_robot_state-npc2": 0.0059482955932617185, "sim_compute_robot_state-npc3": 0.0059274037679036455}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0296612854712894, "sim_physics": 0.08758350116450613, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3882646174160169, "sim_render-ego": 0.007542976518956627, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.018819622877167493, "deviation-heading": 0.2534940122720117, "set_robot_commands": 0.005003667459255312, "deviation-center-line": 0.07868203516863714, "driven_lanedir_consec": 0.3882646174160169, "sim_compute_sim_state": 0.0030878113537299925, "sim_compute_performance-ego": 0.003992644751944193, "sim_compute_robot_state-ego": 0.005347129775256645, "sim_compute_robot_state-npc0": 0.005021996614409656, "sim_compute_robot_state-npc1": 0.00488519087070372, "sim_compute_robot_state-npc2": 0.004874508555342511, "sim_compute_robot_state-npc3": 0.00484957927610816}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.46051146883057537, "sim_physics": 0.09732477231459184, "survival_time": 1.1000000000000003, "driven_lanedir": 0.44436723204554784, "sim_render-ego": 0.00732642954046076, "in-drivable-lane": 0, "agent_compute-ego": 0.017878803339871494, "deviation-heading": 0.29213064768397096, "set_robot_commands": 0.005182938142256303, "deviation-center-line": 0.06393803408849831, "driven_lanedir_consec": 0.44436723204554784, "sim_compute_sim_state": 0.002954873171719638, "sim_compute_performance-ego": 0.003872622143138539, "sim_compute_robot_state-ego": 0.005205176093361594, "sim_compute_robot_state-npc0": 0.004927808588201349, "sim_compute_robot_state-npc1": 0.00477268479087136, "sim_compute_robot_state-npc2": 0.004973389885642312, "sim_compute_robot_state-npc3": 0.0047561255368319426}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.37149985167138455, "sim_physics": 0.11541965133265446, "survival_time": 0.9500000000000004, "driven_lanedir": 0.35179947184110283, "sim_render-ego": 0.008211186057642886, "in-drivable-lane": 0, "agent_compute-ego": 0.02070843546014083, "deviation-heading": 0.3107679325636635, "set_robot_commands": 0.005582671416433234, "deviation-center-line": 0.05490406966943519, "driven_lanedir_consec": 0.35179947184110283, "sim_compute_sim_state": 0.003081346813001131, "sim_compute_performance-ego": 0.004636061818976151, "sim_compute_robot_state-ego": 0.006208344509727077, "sim_compute_robot_state-npc0": 0.005198453602037932, "sim_compute_robot_state-npc1": 0.005354429546155427, "sim_compute_robot_state-npc2": 0.005088944184152703, "sim_compute_robot_state-npc3": 0.005012863560726768}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4307612897755764, "sim_physics": 0.10450589089166552, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261301360773668, "sim_render-ego": 0.008853094918387277, "in-drivable-lane": 0, "agent_compute-ego": 0.017840782801310223, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.005330766950334821, "deviation-center-line": 0.09941450694466288, "driven_lanedir_consec": 0.4261301360773668, "sim_compute_sim_state": 0.0035005751110258557, "sim_compute_performance-ego": 0.004917973563784645, "sim_compute_robot_state-ego": 0.00601649284362793, "sim_compute_robot_state-npc0": 0.005859545298985073, "sim_compute_robot_state-npc1": 0.005463622865222749, "sim_compute_robot_state-npc2": 0.005463066555204846, "sim_compute_robot_state-npc3": 0.0051879315149216424}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0296612854712788, "sim_physics": 0.07484142954756574, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3341891362194134, "sim_render-ego": 0.006988205560823766, "in-drivable-lane": 1.1500000000000006, "agent_compute-ego": 0.014969069783280536, "deviation-heading": 0.1931703465763851, "set_robot_commands": 0.004436283576779249, "deviation-center-line": 0.09687098510612133, "driven_lanedir_consec": 0.3341891362194134, "sim_compute_sim_state": 0.0028010345086818787, "sim_compute_performance-ego": 0.003669971373023056, "sim_compute_robot_state-ego": 0.004652261734008789, "sim_compute_robot_state-npc0": 0.004485258241979088, "sim_compute_robot_state-npc1": 0.004413604736328125, "sim_compute_robot_state-npc2": 0.0043964676740692885, "sim_compute_robot_state-npc3": 0.004365124353548375}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5996546887300007, "sim_physics": 0.07869300444920858, "survival_time": 2.9999999999999973, "driven_lanedir": 1.2178752145687624, "sim_render-ego": 0.00675126314163208, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.01496981382369995, "deviation-heading": 0.508484918322853, "set_robot_commands": 0.004327114423116048, "deviation-center-line": 0.23261450644924175, "driven_lanedir_consec": 1.2178752145687624, "sim_compute_sim_state": 0.0026431997617085774, "sim_compute_performance-ego": 0.003598888715108236, "sim_compute_robot_state-ego": 0.0045950055122375485, "sim_compute_robot_state-npc0": 0.00445633331934611, "sim_compute_robot_state-npc1": 0.004339881738026937, "sim_compute_robot_state-npc2": 0.004318702220916748, "sim_compute_robot_state-npc3": 0.004339949289957682}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2096560704846235, "sim_physics": 0.08503030208831137, "survival_time": 2.3499999999999996, "driven_lanedir": 0.4085053433383865, "sim_render-ego": 0.006946903593996738, "in-drivable-lane": 1.2999999999999994, "agent_compute-ego": 0.015359391557409409, "deviation-heading": 0.3389915723746089, "set_robot_commands": 0.004355339293784284, "deviation-center-line": 0.06805678782796773, "driven_lanedir_consec": 0.4085053433383865, "sim_compute_sim_state": 0.002662049963119182, "sim_compute_performance-ego": 0.0036012771281790225, "sim_compute_robot_state-ego": 0.004683053239862969, "sim_compute_robot_state-npc0": 0.004479580737174826, "sim_compute_robot_state-npc1": 0.004353026126293426, "sim_compute_robot_state-npc2": 0.004334191058544402, "sim_compute_robot_state-npc3": 0.004329382105076567}}
set_robot_commands_max	0.008925893089988014
set_robot_commands_mean	0.006104179135939028
set_robot_commands_median	0.0059171233858381
set_robot_commands_min	0.004327114423116048
sim_compute_performance-ego_max	0.006665630774064498
sim_compute_performance-ego_mean	0.0048748569427760095
sim_compute_performance-ego_median	0.004917973563784645
sim_compute_performance-ego_min	0.003598888715108236
sim_compute_robot_state-ego_max	0.00896141529083252
sim_compute_robot_state-ego_mean	0.006339486661914706
sim_compute_robot_state-ego_median	0.006208344509727077
sim_compute_robot_state-ego_min	0.0045950055122375485
sim_compute_robot_state-npc0_max	0.00838688611984253
sim_compute_robot_state-npc0_mean	0.005928435312514418
sim_compute_robot_state-npc0_median	0.005859545298985073
sim_compute_robot_state-npc0_min	0.00445633331934611
sim_compute_robot_state-npc1_max	0.008341974020004273
sim_compute_robot_state-npc1_mean	0.005839118734036943
sim_compute_robot_state-npc1_median	0.005463622865222749
sim_compute_robot_state-npc1_min	0.004339881738026937
sim_compute_robot_state-npc2_max	0.008250106464732777
sim_compute_robot_state-npc2_mean	0.005781400781484479
sim_compute_robot_state-npc2_median	0.005463066555204846
sim_compute_robot_state-npc2_min	0.004318702220916748
sim_compute_robot_state-npc3_max	0.008028763532638549
sim_compute_robot_state-npc3_mean	0.005739453727750995
sim_compute_robot_state-npc3_median	0.005251748221261161
sim_compute_robot_state-npc3_min	0.004329382105076567
sim_compute_sim_state_max	0.004765951633453369
sim_compute_sim_state_mean	0.0035202071007687263
sim_compute_sim_state_median	0.0034538555145263673
sim_compute_sim_state_min	0.0026431997617085774
sim_physics_max	0.1540989339351654
sim_physics_mean	0.10783710204177628
sim_physics_median	0.10450589089166552
sim_physics_min	0.07484142954756574
sim_render-ego_max	0.012403875589370728
sim_render-ego_mean	0.009041693358374675
sim_render-ego_median	0.008853094918387277
sim_render-ego_min	0.00675126314163208
simulation-passed	1
survival_time_max	3.7499999999999942
survival_time_mean	2.0333333333333328
survival_time_min	0.9500000000000004

No reset possible

24739

3265

Liu Sam 🇹🇼

challenge-aido_LF-template-random

step1-simulation

host-error

yes

2019-10-31 14:05:09+00:00

2019-10-31 14:05:14+00:00

0:00:05

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24725

2788

Andrea Daniele 🇮🇹

PredictorLast

step1-simulation

success

yes

2019-10-31 14:04:14+00:00

2019-10-31 14:05:02+00:00

0:00:48

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11449851428674636
error_L2	0.01988751644922942

No reset possible

24691

3163

Andy Ser

PredictorRandom

step1-simulation

success

yes

2019-10-31 14:02:29+00:00

2019-10-31 14:03:51+00:00

0:01:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.3268422744074837
error_L2	0.15854280660055142

No reset possible

24664

3254

Michael Su 🇹🇼

PredictorLast

step1-simulation

success

yes

2019-10-31 14:00:48+00:00

2019-10-31 14:02:20+00:00

0:01:32

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10452934683082152
error_L2	0.017547204978723006

No reset possible

24657

3257

Liu Sam 🇹🇼

PredictorLast

step1-simulation

host-error

yes

2019-10-31 14:00:10+00:00

2019-10-31 14:00:41+00:00

0:00:31

Error while running [...]


stderr | Pulling solution   ... 
stderr | Pulling evaluation ... done
stderr | 
stderr | ERROR: for solution  pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr | pull access denied for coolcat647/aido-submissions, repository does not exist or may require 'docker login'
stderr |

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24646

3255

Leul Shiferaw 🇩🇪

PredictorLast

step1-simulation

success

yes

2019-10-31 13:59:44+00:00

2019-10-31 14:00:00+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10949939286875934
error_L2	0.017747872698593868

No reset possible

24641

3282

Daniel Huang

PredictorLast

step1-simulation

success

yes

2019-10-31 13:59:11+00:00

2019-10-31 13:59:28+00:00

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11396626918065128
error_L2	0.02033884542372673

No reset possible

24631

3592

Victor Adolfo Romero Cano 🇨🇴

PredictorLast

step1-simulation

success

yes

2019-10-31 13:58:37+00:00

2019-10-31 13:58:56+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12826394319814488
error_L2	0.02569366750944345

No reset possible

24620

3558

Karthikk Subramanian 🇸🇬

PredictorLast

step1-simulation

success

yes

2019-10-31 13:58:05+00:00

2019-10-31 13:58:22+00:00

0:00:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11239171981443807
error_L2	0.01925874361489779

No reset possible

24617

3898

Gabriel Descoteaux 🇨🇦

PredictorLast

step1-simulation

success

yes

2019-10-31 13:57:20+00:00

2019-10-31 13:57:43+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10031927459098292
error_L2	0.016273355986581306

No reset possible

24608

4028

Frank (Chude) Qian 🇨🇦

PredictorLast

step1-simulation

success

yes

2019-10-31 13:56:47+00:00

2019-10-31 13:57:05+00:00

0:00:18

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1301496081264959
error_L2	0.02456762969711729

No reset possible

24605

4042

Leul Shiferaw 🇩🇪

PredictorLast

step1-simulation

success

yes

2019-10-31 13:56:24+00:00

2019-10-31 13:56:39+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11007911252792987
error_L2	0.020084672110275297

No reset possible

24599

4060

YUNG-CHIEN CHOU 🇹🇼

PredictorLast

step1-simulation

success

yes

2019-10-31 13:55:52+00:00

2019-10-31 13:56:08+00:00

0:00:16

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11513630100717805
error_L2	0.01975259495303912

No reset possible

24591

4064

Basile Dura 🇨🇦

PredictorLast

step1-simulation

success

yes

2019-10-31 13:55:22+00:00

2019-10-31 13:55:37+00:00

0:00:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.1093613334739707
error_L2	0.018478989007949368

No reset possible

24587

4078

Maximilian Stölzle 🇨🇭

PredictorLast

step1-simulation

success

yes

2019-10-31 13:54:52+00:00

2019-10-31 13:55:13+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.11050093904988018
error_L2	0.017630563762314217

No reset possible

24581

4080

Johannes Lienhart 🇨🇭

PredictorLast

step1-simulation

success

yes

2019-10-31 13:54:20+00:00

2019-10-31 13:54:43+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10941371626971852
error_L2	0.017860645236966816

No reset possible

24576

4082

Elias Wicki 🇨🇭

PredictorLast

step1-simulation

success

yes

2019-10-31 13:53:48+00:00

2019-10-31 13:54:12+00:00

0:00:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.117593153853695
error_L2	0.01998602621255292

No reset possible

24571

4088

Trevor Phillips 🇨🇭

PredictorLast

step1-simulation

success

yes

2019-10-31 13:53:19+00:00

2019-10-31 13:53:40+00:00

0:00:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10657580057817773
error_L2	0.01768582527702342

No reset possible

24566

4096

Johannes Boghaert

PredictorLast

step1-simulation

success

yes

2019-10-31 13:52:33+00:00

2019-10-31 13:52:52+00:00

0:00:19

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.12064788446240954
error_L2	0.022975327763824833

No reset possible

24557

4107

Oliver Widler

PredictorLast

step1-simulation

success

yes

2019-10-31 13:52:02+00:00

2019-10-31 13:52:25+00:00

0:00:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10414394569907162
error_L2	0.017970611437519657

No reset possible

24533

4160

Tanli Chou 🇹🇼

PredictorLast

step1-simulation

success

yes

2019-10-31 13:50:13+00:00

2019-10-31 13:51:36+00:00

0:01:23

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.10827825124986376
error_L2	0.017954546121199125

No reset possible

24516

4284

Liam Paull 🇨🇦

challenge-aido_LF-template-random

step1-simulation

success

2019-10-31 12:29:40+00:00

2019-10-31 12:42:10+00:00

0:12:30

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.47061816984274774
survival_time_median	2.4499999999999993
deviation-center-line_median	0.09047885846140293
in-drivable-lane_median	0.7999999999999974

other stats

agent_compute-ego_max	0.019590812070029124
agent_compute-ego_mean	0.016267001449544745
agent_compute-ego_median	0.01616905551207693
agent_compute-ego_min	0.012748680114746091
deviation-center-line_max	0.17439134565029044
deviation-center-line_mean	0.1112205456826628
deviation-center-line_min	0.05649185041622204
deviation-heading_max	0.8583234710357402
deviation-heading_mean	0.37150980594423094
deviation-heading_median	0.34774352178293905
deviation-heading_min	0.1892537419842091
driven_any_max	1.6169932854589055
driven_any_mean	0.8549136794030617
driven_any_median	0.9441796518284096
driven_any_min	0.28668385087664994
driven_lanedir_consec_max	1.2433038249708372
driven_lanedir_consec_mean	0.5622432991481365
driven_lanedir_consec_min	0.24216121529728207
driven_lanedir_max	1.2433038249708372
driven_lanedir_mean	0.5622432991481365
driven_lanedir_median	0.47061816984274774
driven_lanedir_min	0.24216121529728207
in-drivable-lane_max	1.3499999999999996
in-drivable-lane_mean	0.5899999999999992
in-drivable-lane_min	0
per-episodes	details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429704, "sim_physics": 0.11368854840596516, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.009439883408723052, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.018896133811385545, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.006527286988717539, "deviation-center-line": 0.15907928712407876, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.003732491422582556, "sim_compute_performance-ego": 0.005153179168701172, "sim_compute_robot_state-ego": 0.006871894553855613, "sim_compute_robot_state-npc0": 0.006321107899701154, "sim_compute_robot_state-npc1": 0.006018616535045483, "sim_compute_robot_state-npc2": 0.006143278545803494, "sim_compute_robot_state-npc3": 0.00607756773630778}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118985, "sim_physics": 0.09829338073730468, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.008179969787597656, "in-drivable-lane": 0, "agent_compute-ego": 0.01461383819580078, "deviation-heading": 0.47860435001913376, "set_robot_commands": 0.005722293853759766, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.003223810195922851, "sim_compute_performance-ego": 0.004447221755981445, "sim_compute_robot_state-ego": 0.005782489776611328, "sim_compute_robot_state-npc0": 0.005442953109741211, "sim_compute_robot_state-npc1": 0.005318222045898438, "sim_compute_robot_state-npc2": 0.005281696319580078, "sim_compute_robot_state-npc3": 0.005244121551513672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.10377101835451628, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708372, "sim_render-ego": 0.008590977442891974, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.01616905551207693, "deviation-heading": 0.5020407942599271, "set_robot_commands": 0.006136012704748856, "deviation-center-line": 0.17439134565029044, "driven_lanedir_consec": 1.2433038249708372, "sim_compute_sim_state": 0.003354342360245554, "sim_compute_performance-ego": 0.004586633883024517, "sim_compute_robot_state-ego": 0.0059223614240947525, "sim_compute_robot_state-npc0": 0.005594677046725624, "sim_compute_robot_state-npc1": 0.005584619547191419, "sim_compute_robot_state-npc2": 0.005475806562524093, "sim_compute_robot_state-npc3": 0.005632557367023669}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589055, "sim_physics": 0.1180762550498866, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.009751956674117076, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.017635490320905854, "deviation-heading": 0.34764983431811225, "set_robot_commands": 0.007081629354742509, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0036733331559579583, "sim_compute_performance-ego": 0.005401517771467378, "sim_compute_robot_state-ego": 0.006749177280860611, "sim_compute_robot_state-npc0": 0.006569125984288469, "sim_compute_robot_state-npc1": 0.006332593628122837, "sim_compute_robot_state-npc2": 0.006402181673653518, "sim_compute_robot_state-npc3": 0.0063357896442654766}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846434, "sim_physics": 0.11137621743338448, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.009532834802355086, "in-drivable-lane": 0, "agent_compute-ego": 0.019590812070029124, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.006606970514569964, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.003691009112766811, "sim_compute_performance-ego": 0.005202387060437884, "sim_compute_robot_state-ego": 0.006310020174298968, "sim_compute_robot_state-npc0": 0.006413681166512626, "sim_compute_robot_state-npc1": 0.005946142332894462, "sim_compute_robot_state-npc2": 0.006050612245287214, "sim_compute_robot_state-npc3": 0.005939066410064697}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.0862628353966607, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.007588704427083333, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.014053331481085883, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.005161801973978679, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.0030027583793357567, "sim_compute_performance-ego": 0.003985661047476309, "sim_compute_robot_state-ego": 0.005247102843390571, "sim_compute_robot_state-npc0": 0.004907047307049787, "sim_compute_robot_state-npc1": 0.004811644554138184, "sim_compute_robot_state-npc2": 0.004803480925383391, "sim_compute_robot_state-npc3": 0.004762901200188531}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0456729849899615, "sim_physics": 0.10163472316883228, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.009469800525241427, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.01751412727214672, "deviation-heading": 0.3927366768210136, "set_robot_commands": 0.005952225791083442, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.003628421712804724, "sim_compute_performance-ego": 0.0051376863762184425, "sim_compute_robot_state-ego": 0.006660567389594184, "sim_compute_robot_state-npc0": 0.006032656740259241, "sim_compute_robot_state-npc1": 0.0062177711062961155, "sim_compute_robot_state-npc2": 0.006020912417659053, "sim_compute_robot_state-npc3": 0.006111617441530581}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8772562288570896, "sim_physics": 0.11391353607177734, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.008734120262993706, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.015365860197279188, "deviation-heading": 0.3844740406851849, "set_robot_commands": 0.006143490473429362, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.003265137142605252, "sim_compute_performance-ego": 0.004709058337741428, "sim_compute_robot_state-ego": 0.006218083699544271, "sim_compute_robot_state-npc0": 0.005786201688978407, "sim_compute_robot_state-npc1": 0.005477317174275716, "sim_compute_robot_state-npc2": 0.005472426944308811, "sim_compute_robot_state-npc3": 0.005528481801350912}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.843301097417158, "sim_physics": 0.10197020613628884, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.010042999101721722, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.017340178075044052, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.006403306256169858, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.003687625345976456, "sim_compute_performance-ego": 0.005041578541631284, "sim_compute_robot_state-ego": 0.006766111954398777, "sim_compute_robot_state-npc0": 0.006213908610136613, "sim_compute_robot_state-npc1": 0.006104469299316406, "sim_compute_robot_state-npc2": 0.006203397460605787, "sim_compute_robot_state-npc3": 0.006037867587545644}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.12842453956604005, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.009686541557312012, "in-drivable-lane": 0, "agent_compute-ego": 0.019120440483093262, "deviation-heading": 0.34774352178293905, "set_robot_commands": 0.006920294761657715, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.0036426639556884767, "sim_compute_performance-ego": 0.005190868377685547, "sim_compute_robot_state-ego": 0.006783962249755859, "sim_compute_robot_state-npc0": 0.006193170547485352, "sim_compute_robot_state-npc1": 0.00617739200592041, "sim_compute_robot_state-npc2": 0.0061831045150756835, "sim_compute_robot_state-npc3": 0.00609227180480957}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.11338101625442504, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.009231889247894288, "in-drivable-lane": 0, "agent_compute-ego": 0.019011592864990233, "deviation-heading": 0.3801610449156702, "set_robot_commands": 0.0056895256042480465, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.003247439861297607, "sim_compute_performance-ego": 0.004488730430603027, "sim_compute_robot_state-ego": 0.006083178520202637, "sim_compute_robot_state-npc0": 0.005787992477416992, "sim_compute_robot_state-npc1": 0.005375874042510986, "sim_compute_robot_state-npc2": 0.00569225549697876, "sim_compute_robot_state-npc3": 0.005563390254974365}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.0898794500451339, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.008797018151534232, "in-drivable-lane": 0, "agent_compute-ego": 0.01565861701965332, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.006404174001593339, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.0033236302827533925, "sim_compute_performance-ego": 0.00489622668216103, "sim_compute_robot_state-ego": 0.0058639802430805405, "sim_compute_robot_state-npc0": 0.005991120087473016, "sim_compute_robot_state-npc1": 0.005722158833553917, "sim_compute_robot_state-npc2": 0.005666619852969521, "sim_compute_robot_state-npc3": 0.005649529005351819}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700496, "sim_physics": 0.07474040508270263, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.006835966110229492, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.012748680114746091, "deviation-heading": 0.2263485117662672, "set_robot_commands": 0.004529128074645996, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.002704024314880371, "sim_compute_performance-ego": 0.00370887279510498, "sim_compute_robot_state-ego": 0.004619641304016113, "sim_compute_robot_state-npc0": 0.004510641098022461, "sim_compute_robot_state-npc1": 0.004462466239929199, "sim_compute_robot_state-npc2": 0.004475111961364746, "sim_compute_robot_state-npc3": 0.0044443893432617185}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3514429441281624, "sim_physics": 0.09033217213370584, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.006973797624761408, "in-drivable-lane": 0, "agent_compute-ego": 0.013200803236527876, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.004469123753634366, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.002700328826904297, "sim_compute_performance-ego": 0.0037120147184892135, "sim_compute_robot_state-ego": 0.004770723256197843, "sim_compute_robot_state-npc0": 0.004475897008722479, "sim_compute_robot_state-npc1": 0.004430283199657093, "sim_compute_robot_state-npc2": 0.0044355284083973275, "sim_compute_robot_state-npc3": 0.0044165199453180485}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.08891442357277383, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.006862129483904157, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.01308606108840631, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.004277696414869659, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.002657136138604612, "sim_compute_performance-ego": 0.0036595840843356383, "sim_compute_robot_state-ego": 0.004667184790786432, "sim_compute_robot_state-npc0": 0.004411906612162687, "sim_compute_robot_state-npc1": 0.004379705506928113, "sim_compute_robot_state-npc2": 0.004350477335404376, "sim_compute_robot_state-npc3": 0.004356729740999183}}
set_robot_commands_max	0.007081629354742509
set_robot_commands_mean	0.005868330701456606
set_robot_commands_median	0.006136012704748856
set_robot_commands_min	0.004277696414869659
sim_compute_performance-ego_max	0.005401517771467378
sim_compute_performance-ego_mean	0.004621414735403954
sim_compute_performance-ego_median	0.004709058337741428
sim_compute_performance-ego_min	0.0036595840843356383
sim_compute_robot_state-ego_max	0.006871894553855613
sim_compute_robot_state-ego_mean	0.0059544319640459
sim_compute_robot_state-ego_median	0.006083178520202637
sim_compute_robot_state-ego_min	0.004619641304016113
sim_compute_robot_state-npc0_max	0.006569125984288469
sim_compute_robot_state-npc0_mean	0.005643472492311741
sim_compute_robot_state-npc0_median	0.005787992477416992
sim_compute_robot_state-npc0_min	0.004411906612162687
sim_compute_robot_state-npc1_max	0.006332593628122837
sim_compute_robot_state-npc1_mean	0.00549061840344525
sim_compute_robot_state-npc1_median	0.005584619547191419
sim_compute_robot_state-npc1_min	0.004379705506928113
sim_compute_robot_state-npc2_max	0.006402181673653518
sim_compute_robot_state-npc2_mean	0.00551045937766639
sim_compute_robot_state-npc2_median	0.005666619852969521
sim_compute_robot_state-npc2_min	0.004350477335404376
sim_compute_robot_state-npc3_max	0.0063357896442654766
sim_compute_robot_state-npc3_mean	0.005479520055633711
sim_compute_robot_state-npc3_median	0.005632557367023669
sim_compute_robot_state-npc3_min	0.004356729740999183
sim_compute_sim_state_max	0.003732491422582556
sim_compute_sim_state_mean	0.0033022768138884447
sim_compute_sim_state_median	0.0033236302827533925
sim_compute_sim_state_min	0.002657136138604612
sim_physics_max	0.12842453956604005
sim_physics_mean	0.10231058182729316
sim_physics_median	0.10197020613628884
sim_physics_min	0.07474040508270263
sim_render-ego_max	0.010042999101721722
sim_render-ego_mean	0.00864790590722404
sim_render-ego_median	0.008797018151534232
sim_render-ego_min	0.006835966110229492
simulation-passed	1
survival_time_max	3.949999999999994
survival_time_mean	2.2366666666666655
survival_time_min	0.9500000000000004

No reset possible

24513

4279

Liam Paull 🇨🇦

PredictorLast

step1-simulation

error

2019-10-31 12:21:56+00:00

2019-10-31 12:23:11+00:00

0:01:15

Unexpected exception [...]

Unexpected exception:
Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
    return deserialize_Dict(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
    return schema_to_type(schema, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
    res = schema_to_type_(schema0, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
    assert False, schema  # pragma: no cover
AssertionError: {'title': 'Any'}

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
    attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 75, in <module>
    main(cie)
  File "experiment_manager.py", line 26, in main
    agent_ci._get_node_protocol()
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 79, in _get_node_protocol
    timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 92, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 211, in read_one
    data = ipce_to_object(msg[FIELD_DATA], {}, expect_type=klass)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
    return deserialize_dataclass(K, mj, global_symbols, encountered)
  File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
    raise Exception(msg) from e
Exception: Cannot deserialize attribute meta (expect: <class 'zuper_nodes.language.InteractionProtocol'>)
value: {'inputs': {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'outputs': {'logs': {'type': 'array', 'items': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'title': 'List[str]', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'aborted': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config_ack': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'node_description': {'$id': 'http://invalid.json-schema.org/NodeDescription#', 'type': 'object', 'order': ['description'], 'title': 'NodeDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'NodeDescription(description: str)', '__qualname__': 'NodeDescription'}, 'set_config_error': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'build_description': {'$id': 'http://invalid.json-schema.org/BuildDescription#', 'type': 'object', 'order': [], 'title': 'BuildDescription', '$schema': 'http://json-schema.org/draft-07/schema#', '__module__': 'zuper_nodes_wrapper.meta_protocol', 'description': 'BuildDescription()', '__qualname__': 'BuildDescription'}, 'config_description': {'$id': 'http://invalid.json-schema.org/ConfigDescription#', 'type': 'object', 'order': ['config', 'current'], 'title': 'ConfigDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['config', 'current'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'config': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}, 'current': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'ConfigDescription(config: type, current: Any)', '__qualname__': 'ConfigDescription'}, 'protocol_description': {'$id': 'http://invalid.json-schema.org/ProtocolDescription#', 'type': 'object', 'order': ['data', 'meta'], 'title': 'ProtocolDescription', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['data', 'meta'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'data': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}, 'meta': {'$id': 'http://invalid.json-schema.org/InteractionProtocol#', 'type': 'object', 'order': ['description', 'inputs', 'outputs', 'language'], 'title': 'InteractionProtocol', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['description', 'inputs', 'language', 'outputs'], '__module__': 'zuper_nodes.language', 'properties': {'inputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'outputs': {'type': 'object', 'title': 'Dict[str,type]', '$schema': 'http://json-schema.org/draft-07/schema#', 'properties': {'$schema': {}}, 'additionalProperties': {'$ref': 'http://json-schema.org/draft-07/schema#', 'title': 'type'}}, 'language': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'description': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'InteractionProtocol(description: str, inputs: Dict[str, type], outputs: Dict[str, type], language: str)', '__qualname__': 'InteractionProtocol'}}, 'description': 'ProtocolDescription(data: zuper_nodes.language.InteractionProtocol, meta: zuper_nodes.language.InteractionProtocol)', '__qualname__': 'ProtocolDescription'}}, 'language': '((in:describe_config ; out:config_description) | (in:set_config ; (out:set_config_ack | out:set_config_error)) | (in:describe_protocol ; out:protocol_description) | (in:describe_node ; out:node_description) | (in:describe_build ; out:build_description) | (in:get_state ; out:node_state) | (in:set_state ; (out:set_state_ack | out:set_state_error)) | (in:get_logs ; out:logs) | out:aborted)*', 'description': '\nBasic interaction protocol for nodes spoken by the node wrapper.\n\n    '}

| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
|     return deserialize_Dict(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
|     return schema_to_type(schema, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
|     res = schema_to_type_(schema0, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
|     assert False, schema  # pragma: no cover
| AssertionError: {'title': 'Any'}
| 
| The above exception was the direct cause of the following exception:
| 
| Traceback (most recent call last):
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
|     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 315, in ipce_to_object
|     return deserialize_dataclass(K, mj, global_symbols, encountered)
|   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 375, in deserialize_dataclass
|     raise Exception(msg) from e
| Exception: Cannot deserialize attribute inputs (expect: typing.Dict[str, type])
| value: {'get_logs': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'get_state': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_state': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'set_config': {'$id': 'http://invalid.json-schema.org/SetConfig#', 'type': 'object', 'order': ['key', 'value'], 'title': 'SetConfig', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['key', 'value'], '__module__': 'zuper_nodes_wrapper.meta_protocol', 'properties': {'key': {'type': 'string', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'value': {'title': 'Any', '$schema': 'http://json-schema.org/draft-07/schema#'}}, 'description': 'SetConfig(key: str, value: Any)', '__qualname__': 'SetConfig'}, 'describe_node': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_build': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_config': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}, 'describe_protocol': {'type': 'null', '$schema': 'http://json-schema.org/draft-07/schema#'}}
| 
| | Traceback (most recent call last):
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 370, in deserialize_dataclass
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=expect_type)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 310, in ipce_to_object
| |     return deserialize_Dict(K, mj, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 428, in deserialize_Dict
| |     attrs[k] = ipce_to_object(v, global_symbols, encountered, expect_type=V)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 282, in ipce_to_object
| |     return schema_to_type(schema, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 453, in schema_to_type
| |     res = schema_to_type_(schema0, global_symbols, encountered)
| |   File "/project/src/zuper-utils/src/zuper_json/ipce.py", line 555, in schema_to_type_
| |     assert False, schema  # pragma: no cover
| | AssertionError: {'title': 'Any'}
| |
|

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24506

4277

Diego Charrez 🇵🇪

PredictorLast

step1-simulation

success

2019-10-29 20:29:55+00:00

2019-10-29 20:31:02+00:00

0:01:07

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

error_L1	0.0987720498410491
error_L2	0.016155564352759385

No reset possible

24497

4265

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-10-29 17:54:44+00:00

2019-10-29 18:00:38+00:00

0:05:54

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24448

4242

Baseline-IL-logs-tensorflow

step1-simulation

error

2019-10-24 23:55:58+00:00

2019-10-25 00:00:45+00:00

0:04:47

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24397

4198

challenge-aido_LF-template-tensorflow

step1-simulation

error

2019-10-24 03:38:39+00:00

2019-10-24 03:42:11+00:00

0:03:32

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24385

4192

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-10-23 20:00:40+00:00

2019-10-23 20:07:24+00:00

0:06:44

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4702323960536803
survival_time_median	2.849999999999998
deviation-center-line_median	0.13623952041905
in-drivable-lane_median	0.7999999999999976

other stats

agent_compute-ego_max	0.016617598357024015
agent_compute-ego_mean	0.01591481226735847
agent_compute-ego_median	0.01617487367377224
agent_compute-ego_min	0.014918327331542969
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.16546426353561405
deviation-center-line_min	0.07144385614371519
deviation-heading_max	1.2111022380750738
deviation-heading_mean	0.8262001110734373
deviation-heading_median	0.7978002362162196
deviation-heading_min	0.39989969254594865
driven_any_max	1.093753441791868
driven_any_mean	0.7182169120135662
driven_any_median	0.8072381933001381
driven_any_min	0.29795781475632777
driven_lanedir_consec_max	0.6735785385729686
driven_lanedir_consec_mean	0.4271077107010905
driven_lanedir_consec_min	0.2312609677194346
driven_lanedir_max	0.6758329617605024
driven_lanedir_mean	0.4275585953385973
driven_lanedir_median	0.4702323960536803
driven_lanedir_min	0.2312609677194346
in-drivable-lane_max	1.6499999999999957
in-drivable-lane_mean	0.7199999999999979
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791868, "sim_physics": 0.0967669917876462, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.007235794182283333, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.01617487367377224, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.004421159445521343, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.002930690007037427, "sim_compute_performance-ego": 0.0039033602519207697, "sim_compute_robot_state-ego": 0.005129067294568901, "sim_compute_robot_state-npc0": 0.004741993295141013, "sim_compute_robot_state-npc1": 0.004467852144356233, "sim_compute_robot_state-npc2": 0.004422210785279791, "sim_compute_robot_state-npc3": 0.004353304943406439}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.09550599698667173, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.007351266013251411, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.016617598357024015, "deviation-heading": 0.6953408166028195, "set_robot_commands": 0.004390796025594075, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.0026961167653401694, "sim_compute_performance-ego": 0.0037480460272894967, "sim_compute_robot_state-ego": 0.0049285093943278, "sim_compute_robot_state-npc0": 0.0045080626452410665, "sim_compute_robot_state-npc1": 0.004359677985862449, "sim_compute_robot_state-npc2": 0.004328957310429326, "sim_compute_robot_state-npc3": 0.004321531013206199}, "udem1-2-0": {"driven_any": 1.0809477890804953, "sim_physics": 0.10075123493488018, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.007168372472127278, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.016398182282081016, "deviation-heading": 1.0268575719271245, "set_robot_commands": 0.00437014836531419, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.002723363729623648, "sim_compute_performance-ego": 0.0036808221768110222, "sim_compute_robot_state-ego": 0.0048988996407924555, "sim_compute_robot_state-npc0": 0.004520914493462978, "sim_compute_robot_state-npc1": 0.0043572126290737055, "sim_compute_robot_state-npc2": 0.004323039299402482, "sim_compute_robot_state-npc3": 0.004304644389030261}, "udem1-3-0": {"driven_any": 0.8072381933001381, "sim_physics": 0.10029689889205128, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.007187567259135999, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.015465079692372104, "deviation-heading": 0.7978002362162196, "set_robot_commands": 0.00429869952954744, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.0027304364923845257, "sim_compute_performance-ego": 0.003676882961340118, "sim_compute_robot_state-ego": 0.004916446250781678, "sim_compute_robot_state-npc0": 0.004515191964935838, "sim_compute_robot_state-npc1": 0.00434850391588713, "sim_compute_robot_state-npc2": 0.004305115917272735, "sim_compute_robot_state-npc3": 0.004273314225046258}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.0961335223654042, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.0072468467380689535, "in-drivable-lane": 0, "agent_compute-ego": 0.014918327331542969, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.004476858221966288, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.002770268398782481, "sim_compute_performance-ego": 0.0037311367366624913, "sim_compute_robot_state-ego": 0.004980108012323794, "sim_compute_robot_state-npc0": 0.004708487054576044, "sim_compute_robot_state-npc1": 0.004457494486933169, "sim_compute_robot_state-npc2": 0.004378743793653405, "sim_compute_robot_state-npc3": 0.0043543110723080845}}
set_robot_commands_max	0.004476858221966288
set_robot_commands_mean	0.004391532317588667
set_robot_commands_median	0.004390796025594075
set_robot_commands_min	0.00429869952954744
sim_compute_performance-ego_max	0.0039033602519207697
sim_compute_performance-ego_mean	0.00374804963080478
sim_compute_performance-ego_median	0.0037311367366624913
sim_compute_performance-ego_min	0.003676882961340118
sim_compute_robot_state-ego_max	0.005129067294568901
sim_compute_robot_state-ego_mean	0.0049706061185589255
sim_compute_robot_state-ego_median	0.0049285093943278
sim_compute_robot_state-ego_min	0.0048988996407924555
sim_compute_robot_state-npc0_max	0.004741993295141013
sim_compute_robot_state-npc0_mean	0.004598929890671388
sim_compute_robot_state-npc0_median	0.004520914493462978
sim_compute_robot_state-npc0_min	0.0045080626452410665
sim_compute_robot_state-npc1_max	0.004467852144356233
sim_compute_robot_state-npc1_mean	0.004398148232422538
sim_compute_robot_state-npc1_median	0.004359677985862449
sim_compute_robot_state-npc1_min	0.00434850391588713
sim_compute_robot_state-npc2_max	0.004422210785279791
sim_compute_robot_state-npc2_mean	0.004351613421207548
sim_compute_robot_state-npc2_median	0.004328957310429326
sim_compute_robot_state-npc2_min	0.004305115917272735
sim_compute_robot_state-npc3_max	0.0043543110723080845
sim_compute_robot_state-npc3_mean	0.004321421128599448
sim_compute_robot_state-npc3_median	0.004321531013206199
sim_compute_robot_state-npc3_min	0.004273314225046258
sim_compute_sim_state_max	0.002930690007037427
sim_compute_sim_state_mean	0.0027701750786336505
sim_compute_sim_state_median	0.0027304364923845257
sim_compute_sim_state_min	0.0026961167653401694
sim_physics_max	0.10075123493488018
sim_physics_mean	0.09789092899333073
sim_physics_median	0.0967669917876462
sim_physics_min	0.09550599698667173
sim_render-ego_max	0.007351266013251411
sim_render-ego_mean	0.007237969332973394
sim_render-ego_median	0.007235794182283333
sim_render-ego_min	0.007168372472127278
simulation-passed	1
survival_time_max	4.149999999999993
survival_time_mean	2.679999999999997
survival_time_min	1.1500000000000004

No reset possible

24373

4192

Liam Paull 🇨🇦

challenge-aido_LF-template-ros - Template solution using ROS

step1-simulation

success

2019-10-23 19:50:20+00:00

2019-10-23 19:57:14+00:00

0:06:54

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4702323960536803
survival_time_median	2.849999999999998
deviation-center-line_median	0.13623952041905
in-drivable-lane_median	0.7999999999999976

other stats

agent_compute-ego_max	0.01686095274411715
agent_compute-ego_mean	0.016023674582342322
agent_compute-ego_median	0.016087629708899074
agent_compute-ego_min	0.015012575232464334
deviation-center-line_max	0.2701922695523504
deviation-center-line_mean	0.16546426353561405
deviation-center-line_min	0.07144385614371519
deviation-heading_max	1.2111022380750738
deviation-heading_mean	0.8262001110734373
deviation-heading_median	0.7978002362162196
deviation-heading_min	0.39989969254594865
driven_any_max	1.093753441791868
driven_any_mean	0.7182169120135662
driven_any_median	0.8072381933001381
driven_any_min	0.29795781475632777
driven_lanedir_consec_max	0.6735785385729686
driven_lanedir_consec_mean	0.4271077107010905
driven_lanedir_consec_min	0.2312609677194346
driven_lanedir_max	0.6758329617605024
driven_lanedir_mean	0.4275585953385973
driven_lanedir_median	0.4702323960536803
driven_lanedir_min	0.2312609677194346
in-drivable-lane_max	1.6499999999999957
in-drivable-lane_mean	0.7199999999999979
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.093753441791868, "sim_physics": 0.09700399996286416, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.007314854357616011, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.016087629708899074, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.004512232470225139, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.002980622900537698, "sim_compute_performance-ego": 0.003893237516104457, "sim_compute_robot_state-ego": 0.005245682704879577, "sim_compute_robot_state-npc0": 0.004768811076520437, "sim_compute_robot_state-npc1": 0.004528755165008177, "sim_compute_robot_state-npc2": 0.006474819528051169, "sim_compute_robot_state-npc3": 0.004586328943091703}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.0964003668891059, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.007406402517248083, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.01656792781971119, "deviation-heading": 0.6953408166028195, "set_robot_commands": 0.004574281198007089, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.002820677227444119, "sim_compute_performance-ego": 0.003777715894911024, "sim_compute_robot_state-ego": 0.005045590577302156, "sim_compute_robot_state-npc0": 0.004613161087036133, "sim_compute_robot_state-npc1": 0.00447490480211046, "sim_compute_robot_state-npc2": 0.004455442781801577, "sim_compute_robot_state-npc3": 0.004449491147641782}, "udem1-2-0": {"driven_any": 1.0809477890804953, "sim_physics": 0.1015151891952906, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.007272209876622909, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.01686095274411715, "deviation-heading": 1.0268575719271245, "set_robot_commands": 0.004390649306468475, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.0028452536998650967, "sim_compute_performance-ego": 0.003718253893729968, "sim_compute_robot_state-ego": 0.005046034470582619, "sim_compute_robot_state-npc0": 0.004621135882842235, "sim_compute_robot_state-npc1": 0.004411853276766264, "sim_compute_robot_state-npc2": 0.0043938985237708455, "sim_compute_robot_state-npc3": 0.00436697862087152}, "udem1-3-0": {"driven_any": 0.8072381933001381, "sim_physics": 0.0996129638270328, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.0072020271368194045, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.01558928740651984, "deviation-heading": 0.7978002362162196, "set_robot_commands": 0.004394861689785071, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.0028094827083119177, "sim_compute_performance-ego": 0.003695065515083179, "sim_compute_robot_state-ego": 0.004932880401611328, "sim_compute_robot_state-npc0": 0.0045226916932223134, "sim_compute_robot_state-npc1": 0.004407911969904314, "sim_compute_robot_state-npc2": 0.004382401181940446, "sim_compute_robot_state-npc3": 0.004366422954358552}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.09650383824887485, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.007219397503396739, "in-drivable-lane": 0, "agent_compute-ego": 0.015012575232464334, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.004263473593670389, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.0027716056160304856, "sim_compute_performance-ego": 0.0036929793979810633, "sim_compute_robot_state-ego": 0.004949341649594514, "sim_compute_robot_state-npc0": 0.004498906757520593, "sim_compute_robot_state-npc1": 0.004355285478674848, "sim_compute_robot_state-npc2": 0.00432815759078316, "sim_compute_robot_state-npc3": 0.004320766614831012}}
set_robot_commands_max	0.004574281198007089
set_robot_commands_mean	0.004427099651631232
set_robot_commands_median	0.004394861689785071
set_robot_commands_min	0.004263473593670389
sim_compute_performance-ego_max	0.003893237516104457
sim_compute_performance-ego_mean	0.0037554504435619385
sim_compute_performance-ego_median	0.003718253893729968
sim_compute_performance-ego_min	0.0036929793979810633
sim_compute_robot_state-ego_max	0.005245682704879577
sim_compute_robot_state-ego_mean	0.0050439059607940385
sim_compute_robot_state-ego_median	0.005045590577302156
sim_compute_robot_state-ego_min	0.004932880401611328
sim_compute_robot_state-npc0_max	0.004768811076520437
sim_compute_robot_state-npc0_mean	0.004604941299428342
sim_compute_robot_state-npc0_median	0.004613161087036133
sim_compute_robot_state-npc0_min	0.004498906757520593
sim_compute_robot_state-npc1_max	0.004528755165008177
sim_compute_robot_state-npc1_mean	0.004435742138492812
sim_compute_robot_state-npc1_median	0.004411853276766264
sim_compute_robot_state-npc1_min	0.004355285478674848
sim_compute_robot_state-npc2_max	0.006474819528051169
sim_compute_robot_state-npc2_mean	0.00480694392126944
sim_compute_robot_state-npc2_median	0.0043938985237708455
sim_compute_robot_state-npc2_min	0.00432815759078316
sim_compute_robot_state-npc3_max	0.004586328943091703
sim_compute_robot_state-npc3_mean	0.0044179976561589136
sim_compute_robot_state-npc3_median	0.00436697862087152
sim_compute_robot_state-npc3_min	0.004320766614831012
sim_compute_sim_state_max	0.002980622900537698
sim_compute_sim_state_mean	0.0028455284304378633
sim_compute_sim_state_median	0.002820677227444119
sim_compute_sim_state_min	0.0027716056160304856
sim_physics_max	0.1015151891952906
sim_physics_mean	0.09820727162463364
sim_physics_median	0.09700399996286416
sim_physics_min	0.0964003668891059
sim_render-ego_max	0.007406402517248083
sim_render-ego_mean	0.007282978278340628
sim_render-ego_median	0.007272209876622909
sim_render-ego_min	0.0072020271368194045
simulation-passed	1
survival_time_max	4.149999999999993
survival_time_mean	2.679999999999997
survival_time_min	1.1500000000000004

No reset possible

24369

4182

Liam Paull 🇨🇦

challenge-aido_LF-baseline-duckietown

step1-simulation

error

2019-10-23 16:54:06+00:00

2019-10-23 16:57:29+00:00

0:03:23

The container "solut [...]

The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24356

4173

Bhairav Mehta

challenge-aido_LF-template-pytorch

step1-simulation

failed

2019-10-21 23:18:37+00:00

2019-10-21 23:22:08+00:00

0:03:31

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 298, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 105, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 258, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 286, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 277, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/wrapper.py", line 431, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/usr/local/lib/python3.7/site-packages/zuper_nodes_wrapper/utils.py", line 19, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 36, in on_received_observations
               ||     self.current_image = self.preprocessor.preprocess(obs)
               ||   File "/workspace/wrappers.py", line 9, in preprocess
               ||     from scipy.misc import imresize
               || ImportError: cannot import name 'imresize' from 'scipy.misc' (/usr/local/lib/python3.7/site-packages/scipy/misc/__init__.py)
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/duckietown_challenges/cie_concrete.py", line 675, in scoring_context
    yield cie
  File "experiment_manager.py", line 444, in <module>
    wrap(cie)
  File "experiment_manager.py", line 432, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 136, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 303, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

24341

4168

Tanli Chou 🇹🇼

challenge-aido_LF-template-random

step1-simulation

success

2019-10-21 14:46:55+00:00

2019-10-21 14:53:21+00:00

0:06:26

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.493517638549009
survival_time_median	2.3999999999999995
deviation-center-line_median	0.09791133281082
in-drivable-lane_median	0.549999999999998

other stats

agent_compute-ego_max	0.014706109251294817
agent_compute-ego_mean	0.014403634688541778
agent_compute-ego_median	0.01449258116227162
agent_compute-ego_min	0.013980354581560408
deviation-center-line_max	0.2348196785686717
deviation-center-line_mean	0.1354748199226606
deviation-center-line_min	0.06216029860587694
deviation-heading_max	0.8115272458314912
deviation-heading_mean	0.49959867397150814
deviation-heading_median	0.46504862964833654
deviation-heading_min	0.30044835691402494
driven_any_max	2.1864003300000703
driven_any_mean	1.1068208197848537
driven_any_median	0.9410513078477728
driven_any_min	0.34749292376309954
driven_lanedir_consec_max	1.8262319453635671
driven_lanedir_consec_mean	0.8047440134491037
driven_lanedir_consec_min	0.3325249708009643
driven_lanedir_max	1.8262319453635671
driven_lanedir_mean	0.8048281473204828
driven_lanedir_median	0.493517638549009
driven_lanedir_min	0.3325249708009643
in-drivable-lane_max	1.3499999999999952
in-drivable-lane_mean	0.5599999999999984
in-drivable-lane_min	0
per-episodes	details {"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.10127070885670336, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.00832458085651639, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.01449258116227162, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.004641535915905917, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.0030614152739319622, "sim_compute_performance-ego": 0.00395785404157035, "sim_compute_robot_state-ego": 0.005185727831683582, "sim_compute_robot_state-npc0": 0.0049391275719751285, "sim_compute_robot_state-npc1": 0.004608051686347286, "sim_compute_robot_state-npc2": 0.004660066170028493, "sim_compute_robot_state-npc3": 0.004567734802825542}, "udem1-1-0": {"driven_any": 0.47798123795353264, "sim_physics": 0.10142044510160174, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.007616988250187465, "in-drivable-lane": 0, "agent_compute-ego": 0.014706109251294817, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.004328693662370954, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.0029496380261012484, "sim_compute_performance-ego": 0.003930389881134033, "sim_compute_robot_state-ego": 0.005091743809836251, "sim_compute_robot_state-npc0": 0.0048747147832598, "sim_compute_robot_state-npc1": 0.0045531562396458215, "sim_compute_robot_state-npc2": 0.00449650628226144, "sim_compute_robot_state-npc3": 0.004468432494572231}, "udem1-2-0": {"driven_any": 2.1864003300000703, "sim_physics": 0.09758702528129504, "survival_time": 5.14999999999999, "driven_lanedir": 1.8262319453635671, "sim_render-ego": 0.007499000401172823, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.014229607813566634, "deviation-heading": 0.8115272458314912, "set_robot_commands": 0.004475299594471756, "deviation-center-line": 0.19273160416094068, "driven_lanedir_consec": 1.8262319453635671, "sim_compute_sim_state": 0.0030330662588471348, "sim_compute_performance-ego": 0.0039356449275340846, "sim_compute_robot_state-ego": 0.005145184044699067, "sim_compute_robot_state-npc0": 0.004917570688192127, "sim_compute_robot_state-npc1": 0.004669175564664081, "sim_compute_robot_state-npc2": 0.004604642831006096, "sim_compute_robot_state-npc3": 0.004554327251841721}, "udem1-3-0": {"driven_any": 0.9410513078477728, "sim_physics": 0.10399604340394338, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.00748025377591451, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.014609520634015402, "deviation-heading": 0.35154027506548413, "set_robot_commands": 0.004437352220217387, "deviation-center-line": 0.08975118546699376, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.003027175863583883, "sim_compute_performance-ego": 0.003937204678853353, "sim_compute_robot_state-ego": 0.0051389286915461225, "sim_compute_robot_state-npc0": 0.00488811731338501, "sim_compute_robot_state-npc1": 0.004707301656405131, "sim_compute_robot_state-npc2": 0.004582310716311137, "sim_compute_robot_state-npc3": 0.004545445243517558}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.09948593094235376, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.007598593121483212, "in-drivable-lane": 0, "agent_compute-ego": 0.013980354581560408, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.004704577582223075, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.0029549598693847656, "sim_compute_performance-ego": 0.003941967373802548, "sim_compute_robot_state-ego": 0.005132073447817848, "sim_compute_robot_state-npc0": 0.004884345190865653, "sim_compute_robot_state-npc1": 0.004639648255847749, "sim_compute_robot_state-npc2": 0.0045965853191557385, "sim_compute_robot_state-npc3": 0.0045930203937348865}}
set_robot_commands_max	0.004704577582223075
set_robot_commands_mean	0.004517491795037817
set_robot_commands_median	0.004475299594471756
set_robot_commands_min	0.004328693662370954
sim_compute_performance-ego_max	0.00395785404157035
sim_compute_performance-ego_mean	0.0039406121805788735
sim_compute_performance-ego_median	0.003937204678853353
sim_compute_performance-ego_min	0.003930389881134033
sim_compute_robot_state-ego_max	0.005185727831683582
sim_compute_robot_state-ego_mean	0.005138731565116575
sim_compute_robot_state-ego_median	0.0051389286915461225
sim_compute_robot_state-ego_min	0.005091743809836251
sim_compute_robot_state-npc0_max	0.0049391275719751285
sim_compute_robot_state-npc0_mean	0.004900775109535543
sim_compute_robot_state-npc0_median	0.00488811731338501
sim_compute_robot_state-npc0_min	0.0048747147832598
sim_compute_robot_state-npc1_max	0.004707301656405131
sim_compute_robot_state-npc1_mean	0.004635466680582014
sim_compute_robot_state-npc1_median	0.004639648255847749
sim_compute_robot_state-npc1_min	0.0045531562396458215
sim_compute_robot_state-npc2_max	0.004660066170028493
sim_compute_robot_state-npc2_mean	0.004588022263752581
sim_compute_robot_state-npc2_median	0.0045965853191557385
sim_compute_robot_state-npc2_min	0.00449650628226144
sim_compute_robot_state-npc3_max	0.0045930203937348865
sim_compute_robot_state-npc3_mean	0.004545792037298388
sim_compute_robot_state-npc3_median	0.004554327251841721
sim_compute_robot_state-npc3_min	0.004468432494572231
sim_compute_sim_state_max	0.0030614152739319622
sim_compute_sim_state_mean	0.0030052510583697986
sim_compute_sim_state_median	0.003027175863583883
sim_compute_sim_state_min	0.0029496380261012484
sim_physics_max	0.10399604340394338
sim_physics_mean	0.10075203071717946
sim_physics_median	0.10127070885670336
sim_physics_min	0.09758702528129504
sim_render-ego_max	0.00832458085651639
sim_render-ego_mean	0.00770388328105488
sim_render-ego_median	0.007598593121483212
sim_render-ego_min	0.00748025377591451
simulation-passed	1
survival_time_max	5.14999999999999
survival_time_mean	2.789999999999997
survival_time_min	1.0500000000000005

No reset possible

24340

4160

Tanli Chou 🇹🇼

PredictorLast

step1-simulation

success