Evaluator 4783

LFv-sim

success

yes

2020-12-03 21:28:41+00:00

2020-12-03 21:33:41+00:00

0:05:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4085849985567304
survival_time_median	7.149999999999983
deviation-center-line_median	0.1190809164100794
in-drivable-lane_median	4.574999999999983

other stats

agent_compute-ego0_max	0.013689790453229631
agent_compute-ego0_mean	0.012930215403275913
agent_compute-ego0_median	0.012847205028983923
agent_compute-ego0_min	0.012336661101906165
complete-iteration_max	0.18971045135606265
complete-iteration_mean	0.17880613401741133
complete-iteration_median	0.1858047163023156
complete-iteration_min	0.1539046521089515
deviation-center-line_max	0.1521499948733922
deviation-center-line_mean	0.12471669027375644
deviation-center-line_min	0.1085549334014747
deviation-heading_max	1.0436810448220888
deviation-heading_mean	0.6096785879312672
deviation-heading_median	0.4755878721700181
deviation-heading_min	0.443857562562944
driven_any_max	1.474005138638284
driven_any_mean	1.2698758114321465
driven_any_median	1.3854581695947648
driven_any_min	0.8345817679007718
driven_lanedir_consec_max	0.5707823809021169
driven_lanedir_consec_mean	0.3830647089348423
driven_lanedir_consec_min	0.14430645772379158
driven_lanedir_max	0.5707823809021169
driven_lanedir_mean	0.3830647089348423
driven_lanedir_median	0.4085849985567304
driven_lanedir_min	0.14430645772379158
get_duckie_state_max	1.7771484158563275e-06
get_duckie_state_mean	1.7186756797772723e-06
get_duckie_state_median	1.705391701743303e-06
get_duckie_state_min	1.6867708997661564e-06
get_robot_state_max	0.003688761166163853
get_robot_state_mean	0.003588930877593898
get_robot_state_median	0.0035925654119926933
get_robot_state_min	0.003481831520226351
get_state_dump_max	0.004718515337729941
get_state_dump_mean	0.0045668983453746904
get_state_dump_median	0.004592175317373095
get_state_dump_min	0.004364727409022629
get_ui_image_max	0.03597370074812774
get_ui_image_mean	0.031142675087556346
get_ui_image_median	0.031078355834114516
get_ui_image_min	0.026440287933868618
in-drivable-lane_max	5.499999999999981
in-drivable-lane_mean	4.612499999999985
in-drivable-lane_min	3.7999999999999905
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 0.8345817679007718, "get_ui_image": 0.02853139809199742, "step_physics": 0.11622673638012944, "survival_time": 4.849999999999991, "driven_lanedir": 0.14430645772379158, "get_state_dump": 0.004718515337729941, "get_robot_state": 0.003688761166163853, "sim_render-ego0": 0.003939253943307059, "get_duckie_state": 1.6932584801498724e-06, "in-drivable-lane": 3.7999999999999905, "deviation-heading": 0.4521611490921394, "agent_compute-ego0": 0.013689790453229631, "complete-iteration": 0.1833040106053255, "set_robot_commands": 0.0022422002286327128, "deviation-center-line": 0.10856192747695548, "driven_lanedir_consec": 0.14430645772379158, "sim_compute_sim_state": 0.00815627282979537, "sim_compute_performance-ego0": 0.0020287377493722098}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3305053314343331, "get_ui_image": 0.03597370074812774, "step_physics": 0.11477475864872053, "survival_time": 7.79999999999998, "driven_lanedir": 0.5707823809021169, "get_state_dump": 0.004364727409022629, "get_robot_state": 0.003481831520226351, "sim_render-ego0": 0.003632038262239687, "get_duckie_state": 1.7175249233367337e-06, "in-drivable-lane": 4.3499999999999845, "deviation-heading": 1.0436810448220888, "agent_compute-ego0": 0.012336661101906165, "complete-iteration": 0.18830542199930567, "set_robot_commands": 0.0020454491779303093, "deviation-center-line": 0.1521499948733922, "driven_lanedir_consec": 0.5707823809021169, "sim_compute_sim_state": 0.00977784964689024, "sim_compute_performance-ego0": 0.0018405990236124417}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.474005138638284, "get_ui_image": 0.033625313576231615, "step_physics": 0.11801392474073044, "survival_time": 6.999999999999983, "driven_lanedir": 0.4613474793768537, "get_state_dump": 0.0047043925481485135, "get_robot_state": 0.0035896132178340396, "sim_render-ego0": 0.0038242847361463182, "get_duckie_state": 1.7771484158563275e-06, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.4990145952478968, "agent_compute-ego0": 0.013243815577622, "complete-iteration": 0.18971045135606265, "set_robot_commands": 0.002120410296933871, "deviation-center-line": 0.12959990534320331, "driven_lanedir_consec": 0.4613474793768537, "sim_compute_sim_state": 0.008560515464620387, "sim_compute_performance-ego0": 0.0019486677562091368}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4404110077551966, "get_ui_image": 0.026440287933868618, "step_physics": 0.09412003050045092, "survival_time": 7.299999999999982, "driven_lanedir": 0.355822517736607, "get_state_dump": 0.004479958086597676, "get_robot_state": 0.0035955176061513473, "sim_render-ego0": 0.003744639506956347, "get_duckie_state": 1.6867708997661564e-06, "in-drivable-lane": 5.499999999999981, "deviation-heading": 0.443857562562944, "agent_compute-ego0": 0.012450594480345849, "complete-iteration": 0.1539046521089515, "set_robot_commands": 0.0020695965306288533, "deviation-center-line": 0.1085549334014747, "driven_lanedir_consec": 0.355822517736607, "sim_compute_sim_state": 0.005051775043513499, "sim_compute_performance-ego0": 0.0018731590841903167}}
set_robot_commands_max	0.0022422002286327128
set_robot_commands_mean	0.0021194140585314367
set_robot_commands_median	0.0020950034137813623
set_robot_commands_min	0.0020454491779303093
sim_compute_performance-ego0_max	0.0020287377493722098
sim_compute_performance-ego0_mean	0.0019227909033460264
sim_compute_performance-ego0_median	0.0019109134201997268
sim_compute_performance-ego0_min	0.0018405990236124417
sim_compute_sim_state_max	0.00977784964689024
sim_compute_sim_state_mean	0.007886603246204875
sim_compute_sim_state_median	0.00835839414720788
sim_compute_sim_state_min	0.005051775043513499
sim_render-ego0_max	0.003939253943307059
sim_render-ego0_mean	0.003785054112162353
sim_render-ego0_median	0.003784462121551333
sim_render-ego0_min	0.003632038262239687
simulation-passed	1
step_physics_max	0.11801392474073044
step_physics_mean	0.11078386256750784
step_physics_median	0.11550074751442498
step_physics_min	0.09412003050045092
survival_time_max	7.79999999999998
survival_time_mean	6.737499999999984
survival_time_min	4.849999999999991

No reset possible

58107

9767

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:18:08+00:00

2020-12-03 21:28:28+00:00

0:10:20

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.439711620959802
survival_time_median	11.150000000000023
deviation-center-line_median	0.42932161273426894
in-drivable-lane_median	3.275000000000011

other stats

agent_compute-ego0_max	0.013505814292214133
agent_compute-ego0_mean	0.01298141481657102
agent_compute-ego0_median	0.01291323985520254
agent_compute-ego0_min	0.01259336526366486
complete-iteration_max	0.24076731421730735
complete-iteration_mean	0.1837486972099303
complete-iteration_median	0.17314056803923367
complete-iteration_min	0.1479463385439467
deviation-center-line_max	0.898997872245244
deviation-center-line_mean	0.4625481065495183
deviation-center-line_min	0.0925513284842914
deviation-heading_max	4.347873737033082
deviation-heading_mean	1.9092383826629635
deviation-heading_median	1.278451744644323
deviation-heading_min	0.7321763043301253
driven_any_max	6.977437920510254
driven_any_mean	2.8122059216319313
driven_any_median	1.9732893630762245
driven_any_min	0.32480703986502085
driven_lanedir_consec_max	2.45604338615854
driven_lanedir_consec_mean	1.3774478199142912
driven_lanedir_consec_min	0.17432465157902088
driven_lanedir_max	2.45604338615854
driven_lanedir_mean	1.3774478199142912
driven_lanedir_median	1.439711620959802
driven_lanedir_min	0.17432465157902088
get_duckie_state_max	1.4236603660145023e-06
get_duckie_state_mean	1.3803968598734177e-06
get_duckie_state_median	1.379224073627013e-06
get_duckie_state_min	1.339478926225142e-06
get_robot_state_max	0.003737029367989867
get_robot_state_mean	0.0036268505601976496
get_robot_state_median	0.0036228997514213984
get_robot_state_min	0.003524573369957935
get_state_dump_max	0.004755596681074663
get_state_dump_mean	0.004625833443198394
get_state_dump_median	0.004636319772543325
get_state_dump_min	0.004475097546632263
get_ui_image_max	0.03613490624861284
get_ui_image_mean	0.030973384276690594
get_ui_image_median	0.030936383996241153
get_ui_image_min	0.025885862865667235
in-drivable-lane_max	22.399999999999913
in-drivable-lane_mean	7.549999999999983
in-drivable-lane_min	1.2499999999999978
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.45756203046916, "get_ui_image": 0.0287560355054201, "step_physics": 0.10273894428336708, "survival_time": 13.65000000000006, "driven_lanedir": 2.1799640449482136, "get_state_dump": 0.004734689301817956, "get_robot_state": 0.003737029367989867, "sim_render-ego0": 0.0037885921714949783, "get_duckie_state": 1.3817835898294936e-06, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 1.7082889582870964, "agent_compute-ego0": 0.012772840304966391, "complete-iteration": 0.170635882955398, "set_robot_commands": 0.002245375709812137, "deviation-center-line": 0.6733647286693826, "driven_lanedir_consec": 2.1799640449482136, "sim_compute_sim_state": 0.00979231308846578, "sim_compute_performance-ego0": 0.0019861746878519545}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32480703986502085, "get_ui_image": 0.03613490624861284, "step_physics": 0.16534886360168458, "survival_time": 2.6999999999999984, "driven_lanedir": 0.17432465157902088, "get_state_dump": 0.004755596681074663, "get_robot_state": 0.003638757358897816, "sim_render-ego0": 0.0038485006852583457, "get_duckie_state": 1.339478926225142e-06, "in-drivable-lane": 1.2499999999999978, "deviation-heading": 0.84861453100155, "agent_compute-ego0": 0.013505814292214133, "complete-iteration": 0.24076731421730735, "set_robot_commands": 0.002226422049782493, "deviation-center-line": 0.0925513284842914, "driven_lanedir_consec": 0.17432465157902088, "sim_compute_sim_state": 0.00925061052495783, "sim_compute_performance-ego0": 0.001975059509277344}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.977437920510254, "get_ui_image": 0.033116732487062206, "step_physics": 0.1033507943964329, "survival_time": 36.70000000000005, "driven_lanedir": 2.45604338615854, "get_state_dump": 0.004537950243268694, "get_robot_state": 0.003607042143944981, "sim_render-ego0": 0.0037386783937207696, "get_duckie_state": 1.3766645574245322e-06, "in-drivable-lane": 22.399999999999913, "deviation-heading": 4.347873737033082, "agent_compute-ego0": 0.013053639405438688, "complete-iteration": 0.1756452531230693, "set_robot_commands": 0.0021536395663306826, "deviation-center-line": 0.898997872245244, "driven_lanedir_consec": 2.45604338615854, "sim_compute_sim_state": 0.01007342630503129, "sim_compute_performance-ego0": 0.00193539217215817}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.489016695683289, "get_ui_image": 0.025885862865667235, "step_physics": 0.08860900210238051, "survival_time": 8.649999999999988, "driven_lanedir": 0.6994591969713904, "get_state_dump": 0.004475097546632263, "get_robot_state": 0.003524573369957935, "sim_render-ego0": 0.003637849599465557, "get_duckie_state": 1.4236603660145023e-06, "in-drivable-lane": 4.599999999999994, "deviation-heading": 0.7321763043301253, "agent_compute-ego0": 0.01259336526366486, "complete-iteration": 0.1479463385439467, "set_robot_commands": 0.002092560132344564, "deviation-center-line": 0.18527849679915528, "driven_lanedir_consec": 0.6994591969713904, "sim_compute_sim_state": 0.005184262648396109, "sim_compute_performance-ego0": 0.0018661611381618455}}
set_robot_commands_max	0.002245375709812137
set_robot_commands_mean	0.002179499364567469
set_robot_commands_median	0.0021900308080565877
set_robot_commands_min	0.002092560132344564
sim_compute_performance-ego0_max	0.0019861746878519545
sim_compute_performance-ego0_mean	0.0019406968768623284
sim_compute_performance-ego0_median	0.001955225840717757
sim_compute_performance-ego0_min	0.0018661611381618455
sim_compute_sim_state_max	0.01007342630503129
sim_compute_sim_state_mean	0.008575153141712751
sim_compute_sim_state_median	0.009521461806711803
sim_compute_sim_state_min	0.005184262648396109
sim_render-ego0_max	0.0038485006852583457
sim_render-ego0_mean	0.003753405212484912
sim_render-ego0_median	0.003763635282607874
sim_render-ego0_min	0.003637849599465557
simulation-passed	1
step_physics_max	0.16534886360168458
step_physics_mean	0.11501190109596626
step_physics_median	0.10304486933989998
step_physics_min	0.08860900210238051
survival_time_max	36.70000000000005
survival_time_mean	15.425000000000024
survival_time_min	2.6999999999999984

No reset possible

58101

9772

Étienne Boucher 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:13:26+00:00

2020-12-03 21:17:39+00:00

0:04:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4653176790304343
survival_time_median	5.09999999999999
deviation-center-line_median	0.12174990741128576
in-drivable-lane_median	2.8749999999999916

other stats

agent_compute-ego0_max	0.018158692939608704
agent_compute-ego0_mean	0.01419178272426233
agent_compute-ego0_median	0.013131057618786603
agent_compute-ego0_min	0.012346322719867412
complete-iteration_max	0.2068539890674276
complete-iteration_mean	0.18136223851725103
complete-iteration_median	0.18158907806261992
complete-iteration_min	0.1554168088763368
deviation-center-line_max	0.20443595688705443
deviation-center-line_mean	0.1350404068223495
deviation-center-line_min	0.09222585557977206
deviation-heading_max	2.412113939293801
deviation-heading_mean	0.960999122907092
deviation-heading_median	0.5400480734645314
deviation-heading_min	0.35178640540550415
driven_any_max	1.523395806841329
driven_any_mean	1.3312264113665553
driven_any_median	1.4185785893921106
driven_any_min	0.9643526598406708
driven_lanedir_consec_max	0.6898953584661565
driven_lanedir_consec_mean	0.4465359403685411
driven_lanedir_consec_min	0.16561304494713935
driven_lanedir_max	0.6898953584661565
driven_lanedir_mean	0.4528703060369874
driven_lanedir_median	0.47798641036732703
driven_lanedir_min	0.16561304494713935
get_duckie_state_max	1.9357838761915854e-06
get_duckie_state_mean	1.8398504985849071e-06
get_duckie_state_median	1.833022629693263e-06
get_duckie_state_min	1.7575728587615183e-06
get_robot_state_max	0.0035854669717641976
get_robot_state_mean	0.003503736472322656
get_robot_state_median	0.003495139613400569
get_robot_state_min	0.003439199690725289
get_state_dump_max	0.004548698390295746
get_state_dump_mean	0.004397211266739776
get_state_dump_median	0.004379255649371024
get_state_dump_min	0.00428163537792131
get_ui_image_max	0.0363554867035752
get_ui_image_mean	0.030396017793591815
get_ui_image_median	0.02991246412961911
get_ui_image_min	0.025403656211553837
in-drivable-lane_max	2.949999999999994
in-drivable-lane_mean	2.824999999999992
in-drivable-lane_min	2.5999999999999908
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 0.9643526598406708, "get_ui_image": 0.027889309785304926, "step_physics": 0.11399130332164276, "survival_time": 3.8499999999999943, "driven_lanedir": 0.16561304494713935, "get_state_dump": 0.004475899231739533, "get_robot_state": 0.0035854669717641976, "sim_render-ego0": 0.00369562858190292, "get_duckie_state": 1.7575728587615183e-06, "in-drivable-lane": 2.949999999999994, "deviation-heading": 0.354727182562641, "agent_compute-ego0": 0.012685115520770732, "complete-iteration": 0.17801915376614302, "set_robot_commands": 0.002096873063307542, "deviation-center-line": 0.09222585557977206, "driven_lanedir_consec": 0.16561304494713935, "sim_compute_sim_state": 0.007631145990811861, "sim_compute_performance-ego0": 0.0018849495129707532}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.523395806841329, "get_ui_image": 0.0363554867035752, "step_physics": 0.131770171156717, "survival_time": 5.399999999999989, "driven_lanedir": 0.31090385170697865, "get_state_dump": 0.004548698390295746, "get_robot_state": 0.003545330205094924, "sim_render-ego0": 0.003639474921270248, "get_duckie_state": 1.9357838761915854e-06, "in-drivable-lane": 2.949999999999993, "deviation-heading": 2.412113939293801, "agent_compute-ego0": 0.013576999716802474, "complete-iteration": 0.2068539890674276, "set_robot_commands": 0.0020740316548478713, "deviation-center-line": 0.20443595688705443, "driven_lanedir_consec": 0.2855663890331932, "sim_compute_sim_state": 0.009374430420201852, "sim_compute_performance-ego0": 0.0018851407077334344}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4360482628596445, "get_ui_image": 0.031935618473933294, "step_physics": 0.11742155368511492, "survival_time": 5.14999999999999, "driven_lanedir": 0.6898953584661565, "get_state_dump": 0.004282612067002516, "get_robot_state": 0.003444949021706214, "sim_render-ego0": 0.003575533628463745, "get_duckie_state": 1.8592064197246848e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 0.7253689643664217, "agent_compute-ego0": 0.012346322719867412, "complete-iteration": 0.1851590023590968, "set_robot_commands": 0.002013172094638531, "deviation-center-line": 0.13800851195688613, "driven_lanedir_consec": 0.6898953584661565, "sim_compute_sim_state": 0.008248656988143921, "sim_compute_performance-ego0": 0.0018100944849161}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4011089159245769, "get_ui_image": 0.025403656211553837, "step_physics": 0.09191453690622368, "survival_time": 5.04999999999999, "driven_lanedir": 0.6450689690276754, "get_state_dump": 0.00428163537792131, "get_robot_state": 0.003439199690725289, "sim_render-ego0": 0.003515806852602491, "get_duckie_state": 1.8068388396618412e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.35178640540550415, "agent_compute-ego0": 0.018158692939608704, "complete-iteration": 0.1554168088763368, "set_robot_commands": 0.0020092398512597176, "deviation-center-line": 0.10549130286568538, "driven_lanedir_consec": 0.6450689690276754, "sim_compute_sim_state": 0.004817065070657169, "sim_compute_performance-ego0": 0.0017967013751759248}}
set_robot_commands_max	0.002096873063307542
set_robot_commands_mean	0.0020483291660134155
set_robot_commands_median	0.0020436018747432014
set_robot_commands_min	0.0020092398512597176
sim_compute_performance-ego0_max	0.0018851407077334344
sim_compute_performance-ego0_mean	0.0018442215201990532
sim_compute_performance-ego0_median	0.0018475219989434264
sim_compute_performance-ego0_min	0.0017967013751759248
sim_compute_sim_state_max	0.009374430420201852
sim_compute_sim_state_mean	0.007517824617453701
sim_compute_sim_state_median	0.007939901489477891
sim_compute_sim_state_min	0.004817065070657169
sim_render-ego0_max	0.00369562858190292
sim_render-ego0_mean	0.0036066109960598506
sim_render-ego0_median	0.003607504274866997
sim_render-ego0_min	0.003515806852602491
simulation-passed	1
step_physics_max	0.131770171156717
step_physics_mean	0.11377439126742458
step_physics_median	0.11570642850337884
step_physics_min	0.09191453690622368
survival_time_max	5.399999999999989
survival_time_mean	4.862499999999991
survival_time_min	3.8499999999999943

No reset possible

58091

9774

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 21:06:50+00:00

2020-12-03 21:13:11+00:00

0:06:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4384584331043765
survival_time_median	10.725000000000016
deviation-center-line_median	0.16430406830755806
in-drivable-lane_median	7.600000000000017

other stats

agent_compute-ego0_max	0.014918078909387122
agent_compute-ego0_mean	0.01322786384017525
agent_compute-ego0_median	0.01291822136007
agent_compute-ego0_min	0.012156933731173877
complete-iteration_max	0.2141993792660265
complete-iteration_mean	0.17281583907325596
complete-iteration_median	0.1665525990858871
complete-iteration_min	0.1439587788552231
deviation-center-line_max	0.223461692314485
deviation-center-line_mean	0.16219810946653318
deviation-center-line_min	0.0967226089365316
deviation-heading_max	1.9549907815321208
deviation-heading_mean	1.137185012068172
deviation-heading_median	1.0988853580458875
deviation-heading_min	0.3959785506487917
driven_any_max	3.4868753439111426
driven_any_mean	2.2657448479496995
driven_any_median	2.465552128867132
driven_any_min	0.6449997901533923
driven_lanedir_consec_max	0.6957957263013493
driven_lanedir_consec_mean	0.44505994135727334
driven_lanedir_consec_min	0.20752717291899092
driven_lanedir_max	0.6957957263013493
driven_lanedir_mean	0.44505994135727334
driven_lanedir_median	0.4384584331043765
driven_lanedir_min	0.20752717291899092
get_duckie_state_max	1.1047221118618982e-06
get_duckie_state_mean	1.0877159857621016e-06
get_duckie_state_median	1.0866291126147384e-06
get_duckie_state_min	1.0728836059570312e-06
get_robot_state_max	0.003619419111238493
get_robot_state_mean	0.003555363957329428
get_robot_state_median	0.00355574121852565
get_robot_state_min	0.0034905542810279204
get_state_dump_max	0.007099321089595197
get_state_dump_mean	0.005103494103013868
get_state_dump_median	0.004448416547372656
get_state_dump_min	0.004417822227714965
get_ui_image_max	0.035618038062589716
get_ui_image_mean	0.030743994895479018
get_ui_image_median	0.030578611008832565
get_ui_image_min	0.026200719501661217
in-drivable-lane_max	12.30000000000007
in-drivable-lane_mean	7.562500000000024
in-drivable-lane_min	2.749999999999993
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.4868753439111426, "get_ui_image": 0.02848191778142969, "step_physics": 0.09062401064625988, "survival_time": 14.250000000000068, "driven_lanedir": 0.22813062331527512, "get_state_dump": 0.004456399204014065, "get_robot_state": 0.003619419111238493, "sim_render-ego0": 0.003674519645584213, "get_duckie_state": 1.0728836059570312e-06, "in-drivable-lane": 12.30000000000007, "deviation-heading": 1.4856170213324444, "agent_compute-ego0": 0.014918078909387122, "complete-iteration": 0.15990704923242957, "set_robot_commands": 0.0021584775898006413, "deviation-center-line": 0.19447135376268967, "driven_lanedir_consec": 0.22813062331527512, "sim_compute_sim_state": 0.00999847658864268, "sim_compute_performance-ego0": 0.0019036339713143305}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6449997901533923, "get_ui_image": 0.035618038062589716, "step_physics": 0.13772039815603968, "survival_time": 4.099999999999993, "driven_lanedir": 0.20752717291899092, "get_state_dump": 0.007099321089595197, "get_robot_state": 0.0034905542810279204, "sim_render-ego0": 0.00361607448164239, "get_duckie_state": 1.0800648884600905e-06, "in-drivable-lane": 2.749999999999993, "deviation-heading": 0.7121536947593305, "agent_compute-ego0": 0.012692129755594644, "complete-iteration": 0.2141993792660265, "set_robot_commands": 0.0020567968667271628, "deviation-center-line": 0.0967226089365316, "driven_lanedir_consec": 0.20752717291899092, "sim_compute_sim_state": 0.009985685348510742, "sim_compute_performance-ego0": 0.0018484649888004163}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0767103075719566, "get_ui_image": 0.03267530423623544, "step_physics": 0.10115753809611004, "survival_time": 13.450000000000056, "driven_lanedir": 0.6957957263013493, "get_state_dump": 0.004440433890731246, "get_robot_state": 0.0035954007395991574, "sim_render-ego0": 0.003752121218928584, "get_duckie_state": 1.0931933367693866e-06, "in-drivable-lane": 9.800000000000054, "deviation-heading": 1.9549907815321208, "agent_compute-ego0": 0.013144312964545357, "complete-iteration": 0.17319814893934465, "set_robot_commands": 0.0022354708777533637, "deviation-center-line": 0.223461692314485, "driven_lanedir_consec": 0.6957957263013493, "sim_compute_sim_state": 0.010203409194946288, "sim_compute_performance-ego0": 0.0019202179378933375}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8543939501623072, "get_ui_image": 0.026200719501661217, "step_physics": 0.08511515581829948, "survival_time": 7.99999999999998, "driven_lanedir": 0.6487862428934779, "get_state_dump": 0.004417822227714965, "get_robot_state": 0.0035160816974521424, "sim_render-ego0": 0.0036001916257491023, "get_duckie_state": 1.1047221118618982e-06, "in-drivable-lane": 5.399999999999981, "deviation-heading": 0.3959785506487917, "agent_compute-ego0": 0.012156933731173877, "complete-iteration": 0.1439587788552231, "set_robot_commands": 0.002056789694365507, "deviation-center-line": 0.13413678285242642, "driven_lanedir_consec": 0.6487862428934779, "sim_compute_sim_state": 0.004955382080552, "sim_compute_performance-ego0": 0.0018665568428750364}}
set_robot_commands_max	0.0022354708777533637
set_robot_commands_mean	0.002126883757161669
set_robot_commands_median	0.002107637228263902
set_robot_commands_min	0.002056789694365507
sim_compute_performance-ego0_max	0.0019202179378933375
sim_compute_performance-ego0_mean	0.0018847184352207805
sim_compute_performance-ego0_median	0.001885095407094683
sim_compute_performance-ego0_min	0.0018484649888004163
sim_compute_sim_state_max	0.010203409194946288
sim_compute_sim_state_mean	0.008785738303162927
sim_compute_sim_state_median	0.009992080968576712
sim_compute_sim_state_min	0.004955382080552
sim_render-ego0_max	0.003752121218928584
sim_render-ego0_mean	0.003660726742976072
sim_render-ego0_median	0.0036452970636133017
sim_render-ego0_min	0.0036001916257491023
simulation-passed	1
step_physics_max	0.13772039815603968
step_physics_mean	0.10365427567917726
step_physics_median	0.09589077437118496
step_physics_min	0.08511515581829948
survival_time_max	14.250000000000068
survival_time_mean	9.950000000000024
survival_time_min	4.099999999999993

No reset possible

58075

10029

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 20:32:26+00:00

2020-12-03 21:06:11+00:00

0:33:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.203833932003182
survival_time_median	59.99999999999873
deviation-center-line_median	2.4025932955789915
in-drivable-lane_median	4.024999999999888

other stats

agent_compute-ego0_max	0.012634055402058546
agent_compute-ego0_mean	0.01220389920210064
agent_compute-ego0_median	0.01218299990788189
agent_compute-ego0_min	0.011815541590580238
complete-iteration_max	0.18222901624604923
complete-iteration_mean	0.16663720372515256
complete-iteration_median	0.1707446953339144
complete-iteration_min	0.14283040798673224
deviation-center-line_max	3.273247314288642
deviation-center-line_mean	2.5218653337141212
deviation-center-line_min	2.00902742940986
deviation-heading_max	9.76991966258618
deviation-heading_mean	7.794109251585867
deviation-heading_median	9.189168556347898
deviation-heading_min	3.0281802310614943
driven_any_max	5.775077450276304
driven_any_mean	5.68848350401926
driven_any_median	5.673404344365721
driven_any_min	5.632047877069289
driven_lanedir_consec_max	5.5406320120894685
driven_lanedir_consec_mean	4.941256899361573
driven_lanedir_consec_min	3.816727721350459
driven_lanedir_max	5.5406320120894685
driven_lanedir_mean	4.941256899361573
driven_lanedir_median	5.203833932003182
driven_lanedir_min	3.816727721350459
get_duckie_state_max	1.328275364503376e-06
get_duckie_state_mean	1.2908053338577307e-06
get_duckie_state_median	1.3269850058321352e-06
get_duckie_state_min	1.1809759592632766e-06
get_robot_state_max	0.003690572702120385
get_robot_state_mean	0.0035816060315560145
get_robot_state_median	0.0035500865891811553
get_robot_state_min	0.003535678245741362
get_state_dump_max	0.004639649569839363
get_state_dump_mean	0.004490417157680566
get_state_dump_median	0.004444637763113106
get_state_dump_min	0.004432743534656686
get_ui_image_max	0.03551937320845808
get_ui_image_mean	0.030317416943479437
get_ui_image_median	0.03018006535989855
get_ui_image_min	0.02539016384566257
in-drivable-lane_max	21.399999999998784
in-drivable-lane_mean	7.36249999999964
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.775077450276304, "get_ui_image": 0.02828719752912815, "step_physics": 0.09946271144380976, "survival_time": 59.99999999999873, "driven_lanedir": 3.816727721350459, "get_state_dump": 0.004639649569839363, "get_robot_state": 0.003690572702120385, "sim_render-ego0": 0.0038232086699372223, "get_duckie_state": 1.1809759592632766e-06, "in-drivable-lane": 21.399999999998784, "deviation-heading": 3.0281802310614943, "agent_compute-ego0": 0.012634055402058546, "complete-iteration": 0.16732968676596455, "set_robot_commands": 0.002240610559417445, "deviation-center-line": 2.532127982025198, "driven_lanedir_consec": 3.816727721350459, "sim_compute_sim_state": 0.010502402728840673, "sim_compute_performance-ego0": 0.001968639875629562}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.632047877069289, "get_ui_image": 0.03551937320845808, "step_physics": 0.1074291260216655, "survival_time": 59.99999999999873, "driven_lanedir": 5.125837989836341, "get_state_dump": 0.0044366801211875645, "get_robot_state": 0.003561173747917893, "sim_render-ego0": 0.003638621670915919, "get_duckie_state": 1.328275364503376e-06, "in-drivable-lane": 4.74999999999973, "deviation-heading": 9.76991966258618, "agent_compute-ego0": 0.012151571634310071, "complete-iteration": 0.18222901624604923, "set_robot_commands": 0.002070842634926827, "deviation-center-line": 3.273247314288642, "driven_lanedir_consec": 5.125837989836341, "sim_compute_sim_state": 0.011455095181556466, "sim_compute_performance-ego0": 0.0018873016204961036}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.703488800195813, "get_ui_image": 0.03207293319066895, "step_physics": 0.1015401817579055, "survival_time": 59.99999999999873, "driven_lanedir": 5.281829874170024, "get_state_dump": 0.004452595405038648, "get_robot_state": 0.003535678245741362, "sim_render-ego0": 0.003610141072841012, "get_duckie_state": 1.328275364503376e-06, "in-drivable-lane": 3.300000000000047, "deviation-heading": 9.382837498443754, "agent_compute-ego0": 0.012214428181453707, "complete-iteration": 0.17415970390186422, "set_robot_commands": 0.002083453409479222, "deviation-center-line": 2.273058609132785, "driven_lanedir_consec": 5.281829874170024, "sim_compute_sim_state": 0.012689235506208612, "sim_compute_performance-ego0": 0.0018817139704161935}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.643319888535631, "get_ui_image": 0.02539016384566257, "step_physics": 0.08404310100977863, "survival_time": 59.99999999999873, "driven_lanedir": 5.5406320120894685, "get_state_dump": 0.004432743534656686, "get_robot_state": 0.0035389994304444172, "sim_render-ego0": 0.0035742921297198826, "get_duckie_state": 1.3256946471608946e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.995499614252042, "agent_compute-ego0": 0.011815541590580238, "complete-iteration": 0.14283040798673224, "set_robot_commands": 0.002090148584332494, "deviation-center-line": 2.00902742940986, "driven_lanedir_consec": 5.5406320120894685, "sim_compute_sim_state": 0.00600548251086131, "sim_compute_performance-ego0": 0.001860748024209155}}
set_robot_commands_max	0.002240610559417445
set_robot_commands_mean	0.0021212637970389973
set_robot_commands_median	0.002086800996905858
set_robot_commands_min	0.002070842634926827
sim_compute_performance-ego0_max	0.001968639875629562
sim_compute_performance-ego0_mean	0.0018996008726877536
sim_compute_performance-ego0_median	0.0018845077954561483
sim_compute_performance-ego0_min	0.001860748024209155
sim_compute_sim_state_max	0.012689235506208612
sim_compute_sim_state_mean	0.010163053981866763
sim_compute_sim_state_median	0.01097874895519857
sim_compute_sim_state_min	0.00600548251086131
sim_render-ego0_max	0.0038232086699372223
sim_render-ego0_mean	0.0036615658858535098
sim_render-ego0_median	0.003624381371878466
sim_render-ego0_min	0.0035742921297198826
simulation-passed	1
step_physics_max	0.1074291260216655
step_physics_mean	0.09811878005828983
step_physics_median	0.10050144660085762
step_physics_min	0.08404310100977863
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58072

10006

exercise_ros_template

LFv-sim

success

yes

2020-12-03 20:21:51+00:00

2020-12-03 20:32:18+00:00

0:10:27

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.7842376006605076
survival_time_median	15.600000000000088
deviation-center-line_median	0.5919435979764599
in-drivable-lane_median	6.275000000000077

other stats

agent_compute-ego0_max	0.012133665285085443
agent_compute-ego0_mean	0.011785220663737448
agent_compute-ego0_median	0.011862059710758766
agent_compute-ego0_min	0.011283097948346818
complete-iteration_max	0.22540758223760696
complete-iteration_mean	0.17813937365926247
complete-iteration_median	0.17010712322843202
complete-iteration_min	0.1469356659425789
deviation-center-line_max	0.9012182654318094
deviation-center-line_mean	0.6223058328956738
deviation-center-line_min	0.40411787019796586
deviation-heading_max	3.424686073934781
deviation-heading_mean	2.051630641903907
deviation-heading_median	1.8256866313630644
deviation-heading_min	1.130463230954719
driven_any_max	7.8548685893892625
driven_any_mean	3.763352787562058
driven_any_median	3.1487121893117203
driven_any_min	0.9011181822355294
driven_lanedir_consec_max	2.5366279933115656
driven_lanedir_consec_mean	1.718947576918353
driven_lanedir_consec_min	0.7706871130408326
driven_lanedir_max	2.5366279933115656
driven_lanedir_mean	1.718947576918353
driven_lanedir_median	1.7842376006605076
driven_lanedir_min	0.7706871130408326
get_duckie_state_max	1.2352710633765991e-06
get_duckie_state_mean	1.17019094424997e-06
get_duckie_state_median	1.1546271187918528e-06
get_duckie_state_min	1.136238476039575e-06
get_robot_state_max	0.0036866168586575255
get_robot_state_mean	0.003541292978035551
get_robot_state_median	0.003499816445373758
get_robot_state_min	0.003478922162737165
get_state_dump_max	0.0046194222508644574
get_state_dump_mean	0.004432716199761001
get_state_dump_median	0.004395544739041295
get_state_dump_min	0.004320353070096957
get_ui_image_max	0.03624010994320824
get_ui_image_mean	0.030769474532600424
get_ui_image_median	0.03062955115717412
get_ui_image_min	0.025578685872845223
in-drivable-lane_max	24.899999999999977
in-drivable-lane_mean	9.650000000000032
in-drivable-lane_min	1.149999999999996
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.4067636516961315, "get_ui_image": 0.028750322302993465, "step_physics": 0.09619232197197115, "survival_time": 12.200000000000038, "driven_lanedir": 2.066463272956069, "get_state_dump": 0.0046194222508644574, "get_robot_state": 0.0036866168586575255, "sim_render-ego0": 0.003796140515074438, "get_duckie_state": 1.1648450578962057e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 1.2022136938975807, "agent_compute-ego0": 0.011954371783198142, "complete-iteration": 0.16294467692472497, "set_robot_commands": 0.0021976908858941527, "deviation-center-line": 0.40411787019796586, "driven_lanedir_consec": 2.066463272956069, "sim_compute_sim_state": 0.009716655770126656, "sim_compute_performance-ego0": 0.0019483634403773716}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9011181822355294, "get_ui_image": 0.03624010994320824, "step_physics": 0.15273471559797014, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7706871130408326, "get_state_dump": 0.004343459719703311, "get_robot_state": 0.003478922162737165, "sim_render-ego0": 0.0035570031120663597, "get_duckie_state": 1.1444091796875e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.130463230954719, "agent_compute-ego0": 0.011283097948346818, "complete-iteration": 0.22540758223760696, "set_robot_commands": 0.0020315510886056085, "deviation-center-line": 0.4616773365139268, "driven_lanedir_consec": 0.7706871130408326, "sim_compute_sim_state": 0.009842111950828916, "sim_compute_performance-ego0": 0.001820954822358631}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.890660726927309, "get_ui_image": 0.03250878001135478, "step_physics": 0.10540771171489724, "survival_time": 19.000000000000135, "driven_lanedir": 1.5020119283649462, "get_state_dump": 0.004447629758379278, "get_robot_state": 0.0035204981255719044, "sim_render-ego0": 0.003683037019464287, "get_duckie_state": 1.2352710633765991e-06, "in-drivable-lane": 10.400000000000125, "deviation-heading": 3.424686073934781, "agent_compute-ego0": 0.012133665285085443, "complete-iteration": 0.1772695695321391, "set_robot_commands": 0.002078211526545327, "deviation-center-line": 0.7222098594389931, "driven_lanedir_consec": 1.5020119283649462, "sim_compute_sim_state": 0.011547216280238836, "sim_compute_performance-ego0": 0.0018647173884033844}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.8548685893892625, "get_ui_image": 0.025578685872845223, "step_physics": 0.08786519974908995, "survival_time": 37.30000000000002, "driven_lanedir": 2.5366279933115656, "get_state_dump": 0.004320353070096957, "get_robot_state": 0.0034791347651756113, "sim_render-ego0": 0.0035710430528265403, "get_duckie_state": 1.136238476039575e-06, "in-drivable-lane": 24.899999999999977, "deviation-heading": 2.449159568828548, "agent_compute-ego0": 0.011769747638319393, "complete-iteration": 0.1469356659425789, "set_robot_commands": 0.0023441084896225527, "deviation-center-line": 0.9012182654318094, "driven_lanedir_consec": 2.5366279933115656, "sim_compute_sim_state": 0.006101707856817897, "sim_compute_performance-ego0": 0.001829142551345519}}
set_robot_commands_max	0.0023441084896225527
set_robot_commands_mean	0.00216289049766691
set_robot_commands_median	0.00213795120621974
set_robot_commands_min	0.0020315510886056085
sim_compute_performance-ego0_max	0.0019483634403773716
sim_compute_performance-ego0_mean	0.0018657945506212264
sim_compute_performance-ego0_median	0.001846929969874452
sim_compute_performance-ego0_min	0.001820954822358631
sim_compute_sim_state_max	0.011547216280238836
sim_compute_sim_state_mean	0.009301922964503075
sim_compute_sim_state_median	0.009779383860477784
sim_compute_sim_state_min	0.006101707856817897
sim_render-ego0_max	0.003796140515074438
sim_render-ego0_mean	0.0036518059248579066
sim_render-ego0_median	0.0036270400361454137
sim_render-ego0_min	0.0035570031120663597
simulation-passed	1
step_physics_max	0.15273471559797014
step_physics_mean	0.11054998725848213
step_physics_median	0.1008000168434342
step_physics_min	0.08786519974908995
survival_time_max	37.30000000000002
survival_time_mean	18.425000000000047
survival_time_min	5.1999999999999895

No reset possible

58051

10026

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 19:48:36+00:00

2020-12-03 20:21:27+00:00

0:32:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	4.586745267198937
survival_time_median	59.99999999999873
deviation-center-line_median	2.954836239971719
in-drivable-lane_median	1.6750000000000045

other stats

agent_compute-ego0_max	0.012201574025404244
agent_compute-ego0_mean	0.01194111750981492
agent_compute-ego0_median	0.011938730147756406
agent_compute-ego0_min	0.011685435718342624
complete-iteration_max	0.17928339797789408
complete-iteration_mean	0.16278862913482692
complete-iteration_median	0.16438580164802163
complete-iteration_min	0.1430995152653703
deviation-center-line_max	3.707898573033883
deviation-center-line_mean	2.825329767581635
deviation-center-line_min	1.6837480173492192
deviation-heading_max	11.23044118084887
deviation-heading_mean	9.845481208035844
deviation-heading_median	9.81627615522169
deviation-heading_min	8.518931340851124
driven_any_max	5.8795791966651585
driven_any_mean	5.678949289186747
driven_any_median	5.680896129158235
driven_any_min	5.474425701765358
driven_lanedir_consec_max	5.542463942025633
driven_lanedir_consec_mean	4.618966108183322
driven_lanedir_consec_min	3.759909956309781
driven_lanedir_max	5.684414515059316
driven_lanedir_mean	5.100092247870706
driven_lanedir_median	5.391365085498107
driven_lanedir_min	3.933224305427295
get_duckie_state_max	1.1482207006856266e-06
get_duckie_state_mean	1.0950182200867767e-06
get_duckie_state_median	1.0960108036800388e-06
get_duckie_state_min	1.0398305723014024e-06
get_robot_state_max	0.003540352123365315
get_robot_state_mean	0.0035039078782341266
get_robot_state_median	0.003500855137763869
get_robot_state_min	0.0034735691140434528
get_state_dump_max	0.004383288851189276
get_state_dump_mean	0.00433337226894674
get_state_dump_median	0.004325032035675176
get_state_dump_min	0.0043001361532473345
get_ui_image_max	0.03554402005166237
get_ui_image_mean	0.030289717856096687
get_ui_image_median	0.030055170154492127
get_ui_image_min	0.02550451106374012
in-drivable-lane_max	16.249999999999076
in-drivable-lane_mean	4.899999999999771
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.8795791966651585, "get_ui_image": 0.028039433974012744, "step_physics": 0.08918343336754893, "survival_time": 59.99999999999873, "driven_lanedir": 5.684414515059316, "get_state_dump": 0.0043001361532473345, "get_robot_state": 0.003540352123365315, "sim_render-ego0": 0.003557322523576036, "get_duckie_state": 1.0398305723014024e-06, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 8.518931340851124, "agent_compute-ego0": 0.01196360945403824, "complete-iteration": 0.15509575630207045, "set_robot_commands": 0.0020672657606901476, "deviation-center-line": 3.707898573033883, "driven_lanedir_consec": 3.759909956309781, "sim_compute_sim_state": 0.010536398319876464, "sim_compute_performance-ego0": 0.001836569680460883}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.686638570967558, "get_ui_image": 0.03554402005166237, "step_physics": 0.10452247876906572, "survival_time": 59.99999999999873, "driven_lanedir": 5.542463942025633, "get_state_dump": 0.004324403432485563, "get_robot_state": 0.0035081594611683256, "sim_render-ego0": 0.003575318858188753, "get_duckie_state": 1.1144728585147145e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.945676947147478, "agent_compute-ego0": 0.012201574025404244, "complete-iteration": 0.17928339797789408, "set_robot_commands": 0.0022235625391697307, "deviation-center-line": 3.1330596858085245, "driven_lanedir_consec": 5.542463942025633, "sim_compute_sim_state": 0.011467934448852033, "sim_compute_performance-ego0": 0.0018439326655557016}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.675153687348913, "get_ui_image": 0.032070906334971505, "step_physics": 0.10147470161380816, "survival_time": 59.99999999999873, "driven_lanedir": 5.2402662289705795, "get_state_dump": 0.004383288851189276, "get_robot_state": 0.0034735691140434528, "sim_render-ego0": 0.003579259415054004, "get_duckie_state": 1.1482207006856266e-06, "in-drivable-lane": 2.80000000000004, "deviation-heading": 11.23044118084887, "agent_compute-ego0": 0.011913850841474572, "complete-iteration": 0.17367584699397282, "set_robot_commands": 0.002244742883432914, "deviation-center-line": 2.7766127941349144, "driven_lanedir_consec": 5.2402662289705795, "sim_compute_sim_state": 0.012622724464791304, "sim_compute_performance-ego0": 0.0018418867522532697}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.474425701765358, "get_ui_image": 0.02550451106374012, "step_physics": 0.0845999384204315, "survival_time": 59.99999999999873, "driven_lanedir": 3.933224305427295, "get_state_dump": 0.004325660638864789, "get_robot_state": 0.0034935508143594126, "sim_render-ego0": 0.003547149335811974, "get_duckie_state": 1.077548748845363e-06, "in-drivable-lane": 16.249999999999076, "deviation-heading": 8.6868753632959, "agent_compute-ego0": 0.011685435718342624, "complete-iteration": 0.1430995152653703, "set_robot_commands": 0.00204635123031324, "deviation-center-line": 1.6837480173492192, "driven_lanedir_consec": 3.933224305427295, "sim_compute_sim_state": 0.005988525411270739, "sim_compute_performance-ego0": 0.0018338386859623817}}
set_robot_commands_max	0.002244742883432914
set_robot_commands_mean	0.002145480603401508
set_robot_commands_median	0.002145414149929939
set_robot_commands_min	0.00204635123031324
sim_compute_performance-ego0_max	0.0018439326655557016
sim_compute_performance-ego0_mean	0.0018390569460580589
sim_compute_performance-ego0_median	0.0018392282163570764
sim_compute_performance-ego0_min	0.0018338386859623817
sim_compute_sim_state_max	0.012622724464791304
sim_compute_sim_state_mean	0.010153895661197634
sim_compute_sim_state_median	0.011002166384364246
sim_compute_sim_state_min	0.005988525411270739
sim_render-ego0_max	0.003579259415054004
sim_render-ego0_mean	0.0035647625331576916
sim_render-ego0_median	0.0035663206908823947
sim_render-ego0_min	0.003547149335811974
simulation-passed	1
step_physics_max	0.10452247876906572
step_physics_mean	0.09494513804271358
step_physics_median	0.09532906749067854
step_physics_min	0.0845999384204315
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

58041

10032

exercise_ros_template

LFv-sim

success

yes

2020-12-03 19:34:29+00:00

2020-12-03 19:48:26+00:00

0:13:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.3153486320087646
survival_time_median	23.650000000000137
deviation-center-line_median	0.9159241548225854
in-drivable-lane_median	6.974999999999991

other stats

agent_compute-ego0_max	0.01292106644673781
agent_compute-ego0_mean	0.012247950334868012
agent_compute-ego0_median	0.01214740100243308
agent_compute-ego0_min	0.01177593288786808
complete-iteration_max	0.19275170063448135
complete-iteration_mean	0.17187371205432356
complete-iteration_median	0.1723471659790547
complete-iteration_min	0.15004881562470335
deviation-center-line_max	1.968160245756636
deviation-center-line_mean	1.005889497424319
deviation-center-line_min	0.22354943429547128
deviation-heading_max	4.549745916366247
deviation-heading_mean	2.6623156857138057
deviation-heading_median	2.773914759846338
deviation-heading_min	0.5516873067963003
driven_any_max	7.349024880585545
driven_any_mean	4.424706575844096
driven_any_median	4.420634497691416
driven_any_min	1.508532427408009
driven_lanedir_consec_max	4.6353275825747895
driven_lanedir_consec_mean	2.491588225445667
driven_lanedir_consec_min	0.7003280551903501
driven_lanedir_max	4.6353275825747895
driven_lanedir_mean	2.491588225445667
driven_lanedir_median	2.3153486320087646
driven_lanedir_min	0.7003280551903501
get_duckie_state_max	1.2720173055475408e-06
get_duckie_state_mean	1.2189907487802042e-06
get_duckie_state_median	1.2094716547145391e-06
get_duckie_state_min	1.1850023801441972e-06
get_robot_state_max	0.003656058506451575
get_robot_state_mean	0.0035753074606077666
get_robot_state_median	0.003559771898776305
get_robot_state_min	0.0035256275384268816
get_state_dump_max	0.004518344056650608
get_state_dump_mean	0.004478199050373522
get_state_dump_median	0.004483852851205696
get_state_dump_min	0.004426746442432083
get_ui_image_max	0.03532176955397039
get_ui_image_mean	0.03031632637769724
get_ui_image_median	0.030027677805168317
get_ui_image_min	0.02588818034648193
in-drivable-lane_max	24.450000000000088
in-drivable-lane_mean	10.087500000000023
in-drivable-lane_min	1.9500000000000275
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.408650956417383, "get_ui_image": 0.02761514567974332, "step_physics": 0.09109215310958238, "survival_time": 13.400000000000055, "driven_lanedir": 2.1352823353485637, "get_state_dump": 0.004518344056650608, "get_robot_state": 0.003656058506451575, "sim_render-ego0": 0.003656493686832017, "get_duckie_state": 1.1850023801441972e-06, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 1.2856569058487832, "agent_compute-ego0": 0.011903377270609916, "complete-iteration": 0.15618013183423576, "set_robot_commands": 0.0022137103027570645, "deviation-center-line": 0.4866176727201203, "driven_lanedir_consec": 2.1352823353485637, "sim_compute_sim_state": 0.009545561106231577, "sim_compute_performance-ego0": 0.0019045266076977811}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.349024880585545, "get_ui_image": 0.03532176955397039, "step_physics": 0.11559492095167548, "survival_time": 38.599999999999945, "driven_lanedir": 2.4954149286689655, "get_state_dump": 0.004426746442432083, "get_robot_state": 0.0035256275384268816, "sim_render-ego0": 0.0036507177167845574, "get_duckie_state": 1.2022711789623425e-06, "in-drivable-lane": 24.450000000000088, "deviation-heading": 4.262172613843893, "agent_compute-ego0": 0.012391424734256246, "complete-iteration": 0.19275170063448135, "set_robot_commands": 0.002068755543401602, "deviation-center-line": 1.3452306369250504, "driven_lanedir_consec": 2.4954149286689655, "sim_compute_sim_state": 0.01381898018860416, "sim_compute_performance-ego0": 0.001878152997805261}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.508532427408009, "get_ui_image": 0.032440209930593315, "step_physics": 0.11825042285702446, "survival_time": 8.74999999999999, "driven_lanedir": 0.7003280551903501, "get_state_dump": 0.004463760690255599, "get_robot_state": 0.0035562461072748356, "sim_render-ego0": 0.003715045072815635, "get_duckie_state": 1.2720173055475408e-06, "in-drivable-lane": 4.749999999999996, "deviation-heading": 0.5516873067963003, "agent_compute-ego0": 0.01292106644673781, "complete-iteration": 0.18851420012387363, "set_robot_commands": 0.0020836971022865987, "deviation-center-line": 0.22354943429547128, "driven_lanedir_consec": 0.7003280551903501, "sim_compute_sim_state": 0.00913192467256026, "sim_compute_performance-ego0": 0.0018764341419393363}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.432618038965448, "get_ui_image": 0.02588818034648193, "step_physics": 0.0906963762724347, "survival_time": 33.90000000000021, "driven_lanedir": 4.6353275825747895, "get_state_dump": 0.004503945012155794, "get_robot_state": 0.0035632976902777737, "sim_render-ego0": 0.003608437806411766, "get_duckie_state": 1.2166721304667364e-06, "in-drivable-lane": 9.199999999999989, "deviation-heading": 4.549745916366247, "agent_compute-ego0": 0.01177593288786808, "complete-iteration": 0.15004881562470335, "set_robot_commands": 0.002087345530604052, "deviation-center-line": 1.968160245756636, "driven_lanedir_consec": 4.6353275825747895, "sim_compute_sim_state": 0.005970879752786942, "sim_compute_performance-ego0": 0.001878083893406549}}
set_robot_commands_max	0.0022137103027570645
set_robot_commands_mean	0.0021133771197623294
set_robot_commands_median	0.0020855213164453256
set_robot_commands_min	0.002068755543401602
sim_compute_performance-ego0_max	0.0019045266076977811
sim_compute_performance-ego0_mean	0.001884299410212232
sim_compute_performance-ego0_median	0.001878118445605905
sim_compute_performance-ego0_min	0.0018764341419393363
sim_compute_sim_state_max	0.01381898018860416
sim_compute_sim_state_mean	0.009616836430045735
sim_compute_sim_state_median	0.00933874288939592
sim_compute_sim_state_min	0.005970879752786942
sim_render-ego0_max	0.003715045072815635
sim_render-ego0_mean	0.0036576735707109943
sim_render-ego0_median	0.003653605701808287
sim_render-ego0_min	0.003608437806411766
simulation-passed	1
step_physics_max	0.11825042285702446
step_physics_mean	0.10390846829767925
step_physics_median	0.10334353703062892
step_physics_min	0.0906963762724347
survival_time_max	38.599999999999945
survival_time_mean	23.66250000000005
survival_time_min	8.74999999999999

No reset possible

58031

10052

exercise_ros_template

LFv-sim

success

yes

2020-12-03 19:12:55+00:00

2020-12-03 19:34:16+00:00

0:21:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	5.7203613757282765
survival_time_median	40.44999999999945
deviation-center-line_median	1.861565296440708
in-drivable-lane_median	4.8000000000000345

other stats

agent_compute-ego0_max	0.013014639125150792
agent_compute-ego0_mean	0.012163743387801415
agent_compute-ego0_median	0.01205060187135431
agent_compute-ego0_min	0.011539130683346254
complete-iteration_max	0.20737938319935517
complete-iteration_mean	0.17084230369658304
complete-iteration_median	0.1655266821489729
complete-iteration_min	0.14493646728903128
deviation-center-line_max	3.7108358107583626
deviation-center-line_mean	1.8918860853438584
deviation-center-line_min	0.13357793773565443
deviation-heading_max	6.1998613255675075
deviation-heading_mean	3.70462601028843
deviation-heading_median	3.823753603459414
deviation-heading_min	0.9711355086673836
driven_any_max	10.299046363946063
driven_any_mean	6.1594001409487875
driven_any_median	6.840842707699105
driven_any_min	0.6568687844508753
driven_lanedir_consec_max	10.041676702080904
driven_lanedir_consec_mean	5.422348129539275
driven_lanedir_consec_min	0.20699306461964095
driven_lanedir_max	10.041676702080904
driven_lanedir_mean	5.422348129539275
driven_lanedir_median	5.7203613757282765
driven_lanedir_min	0.20699306461964095
get_duckie_state_max	1.2014426437078735e-06
get_duckie_state_mean	1.1501833722834842e-06
get_duckie_state_median	1.1471288587330385e-06
get_duckie_state_min	1.1050331279599865e-06
get_robot_state_max	0.0035963064161860575
get_robot_state_mean	0.003555523381817099
get_robot_state_median	0.003550353836474914
get_robot_state_min	0.0035250794381325094
get_state_dump_max	0.004654959136364507
get_state_dump_mean	0.004452818427986167
get_state_dump_median	0.004399815268995624
get_state_dump_min	0.004356684037588915
get_ui_image_max	0.036413143662845385
get_ui_image_mean	0.030523945963087887
get_ui_image_median	0.030084889657031405
get_ui_image_min	0.025512860875443355
in-drivable-lane_max	7.150000000000102
in-drivable-lane_mean	4.3875000000000455
in-drivable-lane_min	0.8000000000000114
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.4170754929643947, "get_ui_image": 0.02804062360795415, "step_physics": 0.08791845282962044, "survival_time": 20.90000000000016, "driven_lanedir": 2.326940869930196, "get_state_dump": 0.004361267590579668, "get_robot_state": 0.0035963064161860575, "sim_render-ego0": 0.003699846654632495, "get_duckie_state": 1.1050331279599865e-06, "in-drivable-lane": 7.150000000000102, "deviation-heading": 1.498949206813634, "agent_compute-ego0": 0.012425022079722693, "complete-iteration": 0.15451701387300695, "set_robot_commands": 0.002126404095378867, "deviation-center-line": 0.5424558699489594, "driven_lanedir_consec": 2.326940869930196, "sim_compute_sim_state": 0.010388655992567112, "sim_compute_performance-ego0": 0.001886937384958199}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6568687844508753, "get_ui_image": 0.036413143662845385, "step_physics": 0.1314606409446866, "survival_time": 5.04999999999999, "driven_lanedir": 0.20699306461964095, "get_state_dump": 0.004654959136364507, "get_robot_state": 0.0035497370888205137, "sim_render-ego0": 0.003744137053396187, "get_duckie_state": 1.2014426437078735e-06, "in-drivable-lane": 3.199999999999989, "deviation-heading": 0.9711355086673836, "agent_compute-ego0": 0.013014639125150792, "complete-iteration": 0.20737938319935517, "set_robot_commands": 0.0021065543679630056, "deviation-center-line": 0.13357793773565443, "driven_lanedir_consec": 0.20699306461964095, "sim_compute_sim_state": 0.010463436444600424, "sim_compute_performance-ego0": 0.0018907902287501916}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.299046363946063, "get_ui_image": 0.03212915570610866, "step_physics": 0.10392965742392306, "survival_time": 59.99999999999873, "driven_lanedir": 9.113781881526355, "get_state_dump": 0.004438362947411581, "get_robot_state": 0.0035509705841293144, "sim_render-ego0": 0.00362324198517176, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 6.40000000000008, "deviation-heading": 6.1998613255675075, "agent_compute-ego0": 0.011676181662985924, "complete-iteration": 0.17653635042493884, "set_robot_commands": 0.0020569575815574015, "deviation-center-line": 3.7108358107583626, "driven_lanedir_consec": 9.113781881526355, "sim_compute_sim_state": 0.013182794323173989, "sim_compute_performance-ego0": 0.001874196936347701}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.264609922433817, "get_ui_image": 0.025512860875443355, "step_physics": 0.08632118398204235, "survival_time": 59.99999999999873, "driven_lanedir": 10.041676702080904, "get_state_dump": 0.004356684037588915, "get_robot_state": 0.0035250794381325094, "sim_render-ego0": 0.003571451752509404, "get_duckie_state": 1.1575509864622905e-06, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 6.1485580001051945, "agent_compute-ego0": 0.011539130683346254, "complete-iteration": 0.14493646728903128, "set_robot_commands": 0.0020528113613716274, "deviation-center-line": 3.1806747229324563, "driven_lanedir_consec": 10.041676702080904, "sim_compute_sim_state": 0.006134528303821319, "sim_compute_performance-ego0": 0.0018489406468171464}}
set_robot_commands_max	0.002126404095378867
set_robot_commands_mean	0.0020856818515677254
set_robot_commands_median	0.0020817559747602033
set_robot_commands_min	0.0020528113613716274
sim_compute_performance-ego0_max	0.0018907902287501916
sim_compute_performance-ego0_mean	0.0018752162992183095
sim_compute_performance-ego0_median	0.00188056716065295
sim_compute_performance-ego0_min	0.0018489406468171464
sim_compute_sim_state_max	0.013182794323173989
sim_compute_sim_state_mean	0.01004235376604071
sim_compute_sim_state_median	0.010426046218583769
sim_compute_sim_state_min	0.006134528303821319
sim_render-ego0_max	0.003744137053396187
sim_render-ego0_mean	0.0036596693614274617
sim_render-ego0_median	0.003661544319902128
sim_render-ego0_min	0.003571451752509404
simulation-passed	1
step_physics_max	0.1314606409446866
step_physics_mean	0.10240748379506812
step_physics_median	0.09592405512677174
step_physics_min	0.08632118398204235
survival_time_max	59.99999999999873
survival_time_mean	36.4874999999994
survival_time_min	5.04999999999999

No reset possible

58030

Robert Moni 🇭🇺

duckietown-rm

LFv-sim

failed

yes

2020-12-03 19:11:34+00:00

2020-12-03 19:12:24+00:00

0:00:50

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58029

Robert Moni 🇭🇺

duckietown-rm

LFv-sim

failed

yes

2020-12-03 19:10:29+00:00

2020-12-03 19:11:24+00:00

0:00:55

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58026

Robert Moni 🇭🇺

duckietown-rm

LFv-sim

failed

yes

2020-12-03 19:07:54+00:00

2020-12-03 19:08:46+00:00

0:00:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

58008

Robert Moni 🇭🇺

duckietown-rm

LFv-sim

failed

yes

2020-12-03 19:04:03+00:00

2020-12-03 19:07:27+00:00

0:03:24

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57995

10056

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 17:52:29+00:00

2020-12-03 18:26:09+00:00

0:33:40

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	7.905076918496212
survival_time_median	59.99999999999873
deviation-center-line_median	3.0019069759729966
in-drivable-lane_median	0.75

other stats

agent_compute-ego0_max	0.012184251655051354
agent_compute-ego0_mean	0.011972239620977395
agent_compute-ego0_median	0.011960018683631257
agent_compute-ego0_min	0.011784669461595725
complete-iteration_max	0.18987209016734813
complete-iteration_mean	0.1661507071900824
complete-iteration_median	0.16624593923332093
complete-iteration_min	0.1422388601263397
deviation-center-line_max	3.338755507602876
deviation-center-line_mean	2.888509700053738
deviation-center-line_min	2.2114693406660835
deviation-heading_max	13.370261906416951
deviation-heading_mean	12.36352263039402
deviation-heading_median	12.41221086269237
deviation-heading_min	11.25940688977439
driven_any_max	9.113708487947584
driven_any_mean	8.334084335958432
driven_any_median	8.351091226692027
driven_any_min	7.520446402502089
driven_lanedir_consec_max	8.90358488205321
driven_lanedir_consec_mean	8.023108390637548
driven_lanedir_consec_min	7.378694843504558
driven_lanedir_max	8.90358488205321
driven_lanedir_mean	8.023108390637548
driven_lanedir_median	7.905076918496212
driven_lanedir_min	7.378694843504558
get_duckie_state_max	1.1295601291322986e-06
get_duckie_state_mean	1.0898071562221503e-06
get_duckie_state_median	1.0959115453207123e-06
get_duckie_state_min	1.0378454051148783e-06
get_robot_state_max	0.00353745219113924
get_robot_state_mean	0.0034937817885615646
get_robot_state_median	0.0034850320649285997
get_robot_state_min	0.003467610833249819
get_state_dump_max	0.0043787420242652605
get_state_dump_mean	0.004345312354765169
get_state_dump_median	0.0043564985237153344
get_state_dump_min	0.0042895103473647445
get_ui_image_max	0.035376778252416606
get_ui_image_mean	0.03004860952434492
get_ui_image_median	0.02971579043891011
get_ui_image_min	0.02538607896714286
in-drivable-lane_max	2.050000000000029
in-drivable-lane_mean	0.8875000000000073
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.113708487947584, "get_ui_image": 0.027609785033900176, "step_physics": 0.08924260663549469, "survival_time": 59.99999999999873, "driven_lanedir": 8.90358488205321, "get_state_dump": 0.0042895103473647445, "get_robot_state": 0.00353745219113924, "sim_render-ego0": 0.0035667709268002983, "get_duckie_state": 1.0378454051148783e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.25940688977439, "agent_compute-ego0": 0.011934217465708, "complete-iteration": 0.15336407650321052, "set_robot_commands": 0.0020651662478736793, "deviation-center-line": 2.763286125248916, "driven_lanedir_consec": 8.90358488205321, "sim_compute_sim_state": 0.009203995594275583, "sim_compute_performance-ego0": 0.0018445649413046097}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.302363593792053, "get_ui_image": 0.035376778252416606, "step_physics": 0.11487441058956913, "survival_time": 59.99999999999873, "driven_lanedir": 7.872141373660552, "get_state_dump": 0.0043738092808401855, "get_robot_state": 0.0034804554604967865, "sim_render-ego0": 0.003564072489043656, "get_duckie_state": 1.0664318126008274e-06, "in-drivable-lane": 2.050000000000029, "deviation-heading": 12.850951054774372, "agent_compute-ego0": 0.012184251655051354, "complete-iteration": 0.18987209016734813, "set_robot_commands": 0.0020351731509193594, "deviation-center-line": 3.240527826697077, "driven_lanedir_consec": 7.872141373660552, "sim_compute_sim_state": 0.012081232793523708, "sim_compute_performance-ego0": 0.0018311767752819711}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.399818859592, "get_ui_image": 0.031821795843920045, "step_physics": 0.1067656098952599, "survival_time": 59.99999999999873, "driven_lanedir": 7.938012463331871, "get_state_dump": 0.004339187766590483, "get_robot_state": 0.0034896086693604125, "sim_render-ego0": 0.0035855666882390284, "get_duckie_state": 1.1295601291322986e-06, "in-drivable-lane": 1.5, "deviation-heading": 13.370261906416951, "agent_compute-ego0": 0.011985819901554512, "complete-iteration": 0.17912780196343137, "set_robot_commands": 0.0020856190283630015, "deviation-center-line": 3.338755507602876, "driven_lanedir_consec": 7.938012463331871, "sim_compute_sim_state": 0.013123191862082502, "sim_compute_performance-ego0": 0.001860922321888132}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.520446402502089, "get_ui_image": 0.02538607896714286, "step_physics": 0.08371576004282422, "survival_time": 59.99999999999873, "driven_lanedir": 7.378694843504558, "get_state_dump": 0.0043787420242652605, "get_robot_state": 0.003467610833249819, "sim_render-ego0": 0.0035262101893619533, "get_duckie_state": 1.1253912780405976e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.97347067061037, "agent_compute-ego0": 0.011784669461595725, "complete-iteration": 0.1422388601263397, "set_robot_commands": 0.0020168911507485016, "deviation-center-line": 2.2114693406660835, "driven_lanedir_consec": 7.378694843504558, "sim_compute_sim_state": 0.006072190480863522, "sim_compute_performance-ego0": 0.001821030982825083}}
set_robot_commands_max	0.0020856190283630015
set_robot_commands_mean	0.0020507123944761355
set_robot_commands_median	0.002050169699396519
set_robot_commands_min	0.0020168911507485016
sim_compute_performance-ego0_max	0.001860922321888132
sim_compute_performance-ego0_mean	0.001839423755324949
sim_compute_performance-ego0_median	0.0018378708582932903
sim_compute_performance-ego0_min	0.001821030982825083
sim_compute_sim_state_max	0.013123191862082502
sim_compute_sim_state_mean	0.010120152682686328
sim_compute_sim_state_median	0.010642614193899644
sim_compute_sim_state_min	0.006072190480863522
sim_render-ego0_max	0.0035855666882390284
sim_render-ego0_mean	0.003560655073361234
sim_render-ego0_median	0.003565421707921977
sim_render-ego0_min	0.0035262101893619533
simulation-passed	1
step_physics_max	0.11487441058956913
step_physics_mean	0.09864959679078698
step_physics_median	0.0980041082653773
step_physics_min	0.08371576004282422
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57986

10065

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 17:12:46+00:00

2020-12-03 17:16:38+00:00

0:03:52

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57977

10713

sim-exercise-1

LFv-sim

success

yes

2020-12-03 15:45:49+00:00

2020-12-03 16:13:30+00:00

0:27:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.37193555633125
survival_time_median	52.72499999999914
deviation-center-line_median	2.1173915993573
in-drivable-lane_median	4.925000000000049

other stats

agent_compute-ego0_max	0.01218677103072777
agent_compute-ego0_mean	0.012046555248147942
agent_compute-ego0_median	0.012018484551210963
agent_compute-ego0_min	0.011962480859442072
complete-iteration_max	0.19146170763052275
complete-iteration_mean	0.17117259652190178
complete-iteration_median	0.17235044362259555
complete-iteration_min	0.14852779121189327
deviation-center-line_max	3.957915484310653
deviation-center-line_mean	2.292644375404266
deviation-center-line_min	0.9778788185918108
deviation-heading_max	14.237983876061657
deviation-heading_mean	9.384145658243924
deviation-heading_median	9.581999285327472
deviation-heading_min	4.134600186259103
driven_any_max	10.219778460456116
driven_any_mean	7.53144830241248
driven_any_median	7.494314542622262
driven_any_min	4.91738566394928
driven_lanedir_consec_max	9.872477800619889
driven_lanedir_consec_mean	6.458222569481856
driven_lanedir_consec_min	3.216541364645036
driven_lanedir_max	9.872477800619889
driven_lanedir_mean	6.5412959215335515
driven_lanedir_median	6.37193555633125
driven_lanedir_min	3.5488347728518175
get_duckie_state_max	1.1770056248902282e-06
get_duckie_state_mean	1.1376587028240797e-06
get_duckie_state_median	1.1658106999347933e-06
get_duckie_state_min	1.042007786536503e-06
get_robot_state_max	0.0035405052669256875
get_robot_state_mean	0.0035105549744971916
get_robot_state_median	0.003506208141082332
get_robot_state_min	0.003489298348898416
get_state_dump_max	0.004341624757828661
get_state_dump_mean	0.004329373010754109
get_state_dump_median	0.004330189066452163
get_state_dump_min	0.004315489152283448
get_ui_image_max	0.03524576912910912
get_ui_image_mean	0.029968286149199615
get_ui_image_median	0.02971772648274302
get_ui_image_min	0.025191922502203305
in-drivable-lane_max	20.59999999999956
in-drivable-lane_mean	7.612499999999915
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.91738566394928, "get_ui_image": 0.027649355589014383, "step_physics": 0.09894354797350197, "survival_time": 29.10000000000028, "driven_lanedir": 3.8910485123772705, "get_state_dump": 0.004315489152283448, "get_robot_state": 0.0035405052669256875, "sim_render-ego0": 0.0035916053614935377, "get_duckie_state": 1.042007786536503e-06, "in-drivable-lane": 9.250000000000131, "deviation-heading": 4.134600186259103, "agent_compute-ego0": 0.012047536990654816, "complete-iteration": 0.16473843384770545, "set_robot_commands": 0.0020850845716420823, "deviation-center-line": 0.9778788185918108, "driven_lanedir_consec": 3.8910485123772705, "sim_compute_sim_state": 0.010611570106362395, "sim_compute_performance-ego0": 0.00187647158653822}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.236272915366785, "get_ui_image": 0.03524576912910912, "step_physics": 0.11571147956022317, "survival_time": 59.99999999999873, "driven_lanedir": 8.85282260028523, "get_state_dump": 0.004341624757828661, "get_robot_state": 0.0035150327055182284, "sim_render-ego0": 0.0036091367767613495, "get_duckie_state": 1.1770056248902282e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.237983876061657, "agent_compute-ego0": 0.01198943211176711, "complete-iteration": 0.19146170763052275, "set_robot_commands": 0.002154452318355106, "deviation-center-line": 3.957915484310653, "driven_lanedir_consec": 8.85282260028523, "sim_compute_sim_state": 0.012950825552261442, "sim_compute_performance-ego0": 0.001865556694685073}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.219778460456116, "get_ui_image": 0.03178609737647165, "step_physics": 0.10730705074624754, "survival_time": 59.99999999999873, "driven_lanedir": 9.872477800619889, "get_state_dump": 0.004329781051877138, "get_robot_state": 0.0034973835766464348, "sim_render-ego0": 0.00363086999008598, "get_duckie_state": 1.1565584028690284e-06, "in-drivable-lane": 0.5999999999999659, "deviation-heading": 11.788204031481849, "agent_compute-ego0": 0.01218677103072777, "complete-iteration": 0.17996245339748565, "set_robot_commands": 0.002109052934416327, "deviation-center-line": 2.8154760996881687, "driven_lanedir_consec": 9.872477800619889, "sim_compute_sim_state": 0.013163883620555155, "sim_compute_performance-ego0": 0.00187610329239692}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.752356169877739, "get_ui_image": 0.025191922502203305, "step_physics": 0.08960934811896021, "survival_time": 45.449999999999555, "driven_lanedir": 3.5488347728518175, "get_state_dump": 0.004330597081027188, "get_robot_state": 0.003489298348898416, "sim_render-ego0": 0.003580871257153186, "get_duckie_state": 1.175062997000558e-06, "in-drivable-lane": 20.59999999999956, "deviation-heading": 7.375794539173095, "agent_compute-ego0": 0.011962480859442072, "complete-iteration": 0.14852779121189327, "set_robot_commands": 0.0020326493860601067, "deviation-center-line": 1.419307099026431, "driven_lanedir_consec": 3.216541364645036, "sim_compute_sim_state": 0.006404692786080497, "sim_compute_performance-ego0": 0.0018491040219317423}}
set_robot_commands_max	0.002154452318355106
set_robot_commands_mean	0.0020953098026184054
set_robot_commands_median	0.0020970687530292046
set_robot_commands_min	0.0020326493860601067
sim_compute_performance-ego0_max	0.00187647158653822
sim_compute_performance-ego0_mean	0.001866808898887989
sim_compute_performance-ego0_median	0.0018708299935409965
sim_compute_performance-ego0_min	0.0018491040219317423
sim_compute_sim_state_max	0.013163883620555155
sim_compute_sim_state_mean	0.010782743016314874
sim_compute_sim_state_median	0.01178119782931192
sim_compute_sim_state_min	0.006404692786080497
sim_render-ego0_max	0.00363086999008598
sim_render-ego0_mean	0.0036031208463735134
sim_render-ego0_median	0.0036003710691274436
sim_render-ego0_min	0.003580871257153186
simulation-passed	1
step_physics_max	0.11571147956022317
step_physics_mean	0.1028928565997332
step_physics_median	0.10312529935987474
step_physics_min	0.08960934811896021
survival_time_max	59.99999999999873
survival_time_mean	48.63749999999932
survival_time_min	29.10000000000028

No reset possible

57956

10720

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 15:25:17+00:00

2020-12-03 15:45:08+00:00

0:19:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.724947928991738
survival_time_median	31.300000000000157
deviation-center-line_median	0.8184118666239679
in-drivable-lane_median	16.77500000000007

other stats

agent_compute-ego0_max	0.013778356935167903
agent_compute-ego0_mean	0.01282026568670033
agent_compute-ego0_median	0.012651752638677871
agent_compute-ego0_min	0.012199200534277668
complete-iteration_max	0.18704079696204015
complete-iteration_mean	0.1697736684950749
complete-iteration_median	0.17019335833084426
complete-iteration_min	0.15166716035657085
deviation-center-line_max	2.1948275702018227
deviation-center-line_mean	1.111641874535525
deviation-center-line_min	0.6149161946923412
deviation-heading_max	8.487022094905782
deviation-heading_mean	5.154921103623886
deviation-heading_median	4.974958512472968
deviation-heading_min	2.182745294643827
driven_any_max	9.57663665720568
driven_any_mean	5.563750164136566
driven_any_median	5.010791631230111
driven_any_min	2.656780736880363
driven_lanedir_consec_max	4.151580054180654
driven_lanedir_consec_mean	2.783748515913242
driven_lanedir_consec_min	1.5335181514888376
driven_lanedir_max	4.151580054180654
driven_lanedir_mean	2.786898476482844
driven_lanedir_median	2.724947928991738
driven_lanedir_min	1.546117993767247
get_duckie_state_max	1.2653455646905573e-06
get_duckie_state_mean	1.2259361526262784e-06
get_duckie_state_median	1.216159463499726e-06
get_duckie_state_min	1.206080118815104e-06
get_robot_state_max	0.0035586406881488028
get_robot_state_mean	0.003543276395729238
get_robot_state_median	0.003554045585710084
get_robot_state_min	0.003506373723347982
get_state_dump_max	0.004524800104463627
get_state_dump_mean	0.004424610746832177
get_state_dump_median	0.0044135302350726754
get_state_dump_min	0.004346582412719726
get_ui_image_max	0.03553951458885057
get_ui_image_mean	0.030604708990769003
get_ui_image_median	0.03039665667577909
get_ui_image_min	0.026086008022667268
in-drivable-lane_max	31.499999999998455
in-drivable-lane_mean	18.612499999999677
in-drivable-lane_min	9.400000000000116
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.762909857725101, "get_ui_image": 0.028120420463171137, "step_physics": 0.0943673756362365, "survival_time": 26.30000000000024, "driven_lanedir": 3.7227243818151057, "get_state_dump": 0.004421625915469436, "get_robot_state": 0.0035586406881488028, "sim_render-ego0": 0.003638706804452856, "get_duckie_state": 1.219237325766055e-06, "in-drivable-lane": 9.450000000000134, "deviation-heading": 2.634763722601749, "agent_compute-ego0": 0.012199200534277668, "complete-iteration": 0.1610031602957217, "set_robot_commands": 0.0021108929527326147, "deviation-center-line": 0.6708859297610898, "driven_lanedir_consec": 3.7227243818151057, "sim_compute_sim_state": 0.010619379763811318, "sim_compute_performance-ego0": 0.0018924544839298025}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.25867340473512, "get_ui_image": 0.03553951458885057, "step_physics": 0.11005991918676657, "survival_time": 36.300000000000075, "driven_lanedir": 1.546117993767247, "get_state_dump": 0.004405434554675914, "get_robot_state": 0.0035530081149472495, "sim_render-ego0": 0.0037365094175692928, "get_duckie_state": 1.2130816012333971e-06, "in-drivable-lane": 24.10000000000001, "deviation-heading": 7.315153302344187, "agent_compute-ego0": 0.013778356935167903, "complete-iteration": 0.18704079696204015, "set_robot_commands": 0.0023328565993696, "deviation-center-line": 0.965937803486846, "driven_lanedir_consec": 1.5335181514888376, "sim_compute_sim_state": 0.011631424522137545, "sim_compute_performance-ego0": 0.0019237145761020248}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.656780736880363, "get_ui_image": 0.032672892888387046, "step_physics": 0.10788728586832684, "survival_time": 18.70000000000013, "driven_lanedir": 1.727171476168371, "get_state_dump": 0.004346582412719726, "get_robot_state": 0.003506373723347982, "sim_render-ego0": 0.003731631596883138, "get_duckie_state": 1.206080118815104e-06, "in-drivable-lane": 9.400000000000116, "deviation-heading": 2.182745294643827, "agent_compute-ego0": 0.012748544692993163, "complete-iteration": 0.17938355636596678, "set_robot_commands": 0.0022372652689615887, "deviation-center-line": 0.6149161946923412, "driven_lanedir_consec": 1.727171476168371, "sim_compute_sim_state": 0.010207826614379883, "sim_compute_performance-ego0": 0.0019521528879801432}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.57663665720568, "get_ui_image": 0.026086008022667268, "step_physics": 0.0908966213340664, "survival_time": 59.99999999999873, "driven_lanedir": 4.151580054180654, "get_state_dump": 0.004524800104463627, "get_robot_state": 0.003555083056472918, "sim_render-ego0": 0.0036822310296026096, "get_duckie_state": 1.2653455646905573e-06, "in-drivable-lane": 31.499999999998455, "deviation-heading": 8.487022094905782, "agent_compute-ego0": 0.01255496058436258, "complete-iteration": 0.15166716035657085, "set_robot_commands": 0.0021675955147469274, "deviation-center-line": 2.1948275702018227, "driven_lanedir_consec": 4.151580054180654, "sim_compute_sim_state": 0.006235152061138423, "sim_compute_performance-ego0": 0.001885995181970652}}
set_robot_commands_max	0.0023328565993696
set_robot_commands_mean	0.002212152583952683
set_robot_commands_median	0.0022024303918542583
set_robot_commands_min	0.0021108929527326147
sim_compute_performance-ego0_max	0.0019521528879801432
sim_compute_performance-ego0_mean	0.0019135792824956552
sim_compute_performance-ego0_median	0.0019080845300159135
sim_compute_performance-ego0_min	0.001885995181970652
sim_compute_sim_state_max	0.011631424522137545
sim_compute_sim_state_mean	0.009673445740366791
sim_compute_sim_state_median	0.0104136031890956
sim_compute_sim_state_min	0.006235152061138423
sim_render-ego0_max	0.0037365094175692928
sim_render-ego0_mean	0.003697269712126974
sim_render-ego0_median	0.0037069313132428736
sim_render-ego0_min	0.003638706804452856
simulation-passed	1
step_physics_max	0.11005991918676657
step_physics_mean	0.10080280050634909
step_physics_median	0.10112733075228168
step_physics_min	0.0908966213340664
survival_time_max	59.99999999999873
survival_time_mean	35.32499999999979
survival_time_min	18.70000000000013

No reset possible

57948

10730

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 15:13:18+00:00

2020-12-03 15:23:52+00:00

0:10:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1506587109610598
survival_time_median	21.52500000000017
deviation-center-line_median	0.4140802218841245
in-drivable-lane_median	12.100000000000165

other stats

agent_compute-ego0_max	0.013200221703066464
agent_compute-ego0_mean	0.012825154559513576
agent_compute-ego0_median	0.01282656933009666
agent_compute-ego0_min	0.01244725787479452
complete-iteration_max	0.23979565459237973
complete-iteration_mean	0.18071257591295736
complete-iteration_median	0.16900638216241648
complete-iteration_min	0.14504188473461666
deviation-center-line_max	0.629798023513816
deviation-center-line_mean	0.3940119175940079
deviation-center-line_min	0.11808920309396652
deviation-heading_max	3.228095052460892
deviation-heading_mean	2.269108655517491
deviation-heading_median	2.160984707379778
deviation-heading_min	1.5263701548495154
driven_any_max	4.243010919429168
driven_any_mean	2.848583633902857
driven_any_median	3.4399313786804937
driven_any_min	0.27146085882127236
driven_lanedir_consec_max	1.984507696766142
driven_lanedir_consec_mean	1.094301563667897
driven_lanedir_consec_min	0.09138113598332608
driven_lanedir_max	1.984507696766142
driven_lanedir_mean	1.094301563667897
driven_lanedir_median	1.1506587109610598
driven_lanedir_min	0.09138113598332608
get_duckie_state_max	1.8603365186234596e-06
get_duckie_state_mean	1.622376450702547e-06
get_duckie_state_median	1.5524231382667762e-06
get_duckie_state_min	1.524323007653176e-06
get_robot_state_max	0.0037002911265660615
get_robot_state_mean	0.0035581519732763127
get_robot_state_median	0.003532904112325613
get_robot_state_min	0.003466508541887964
get_state_dump_max	0.004632234573364258
get_state_dump_mean	0.0044455173224954595
get_state_dump_median	0.004409507809654488
get_state_dump_min	0.004330819097308605
get_ui_image_max	0.03642291754064426
get_ui_image_mean	0.030682229842177756
get_ui_image_median	0.03028898496114789
get_ui_image_min	0.025728031905771
in-drivable-lane_max	20.50000000000021
in-drivable-lane_mean	11.537500000000133
in-drivable-lane_min	1.4499999999999948
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.243010919429168, "get_ui_image": 0.028305088947464547, "step_physics": 0.09743388280301084, "survival_time": 26.00000000000023, "driven_lanedir": 1.984507696766142, "get_state_dump": 0.004447058844246013, "get_robot_state": 0.0037002911265660615, "sim_render-ego0": 0.0038259093454840543, "get_duckie_state": 1.524323007653176e-06, "in-drivable-lane": 16.30000000000023, "deviation-heading": 1.5263701548495154, "agent_compute-ego0": 0.01244725787479452, "complete-iteration": 0.1652866485251575, "set_robot_commands": 0.0023283198790449555, "deviation-center-line": 0.43058736820464566, "driven_lanedir_consec": 1.984507696766142, "sim_compute_sim_state": 0.010703077700682656, "sim_compute_performance-ego0": 0.00201818215412279}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.27146085882127236, "get_ui_image": 0.03642291754064426, "step_physics": 0.16456498226649324, "survival_time": 3.4999999999999956, "driven_lanedir": 0.09138113598332608, "get_state_dump": 0.004632234573364258, "get_robot_state": 0.0035659830335160376, "sim_render-ego0": 0.003716102788146113, "get_duckie_state": 1.8603365186234596e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 1.705529979735685, "agent_compute-ego0": 0.012873276858262611, "complete-iteration": 0.23979565459237973, "set_robot_commands": 0.0020913439737239355, "deviation-center-line": 0.11808920309396652, "driven_lanedir_consec": 0.09138113598332608, "sim_compute_sim_state": 0.009923327137047137, "sim_compute_performance-ego0": 0.0019195986465669016}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.222061567207831, "get_ui_image": 0.03227288097483123, "step_physics": 0.10034716990510774, "survival_time": 26.25000000000024, "driven_lanedir": 0.7767156074800039, "get_state_dump": 0.004330819097308605, "get_robot_state": 0.003499825191135189, "sim_render-ego0": 0.003743911424063911, "get_duckie_state": 1.5565197730698966e-06, "in-drivable-lane": 20.50000000000021, "deviation-heading": 3.228095052460892, "agent_compute-ego0": 0.012779861801930708, "complete-iteration": 0.17272611579967542, "set_robot_commands": 0.002228526561432465, "deviation-center-line": 0.3975730755636034, "driven_lanedir_consec": 0.7767156074800039, "sim_compute_sim_state": 0.011535954566056284, "sim_compute_performance-ego0": 0.001911707250790904}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6578011901531564, "get_ui_image": 0.025728031905771, "step_physics": 0.08520721204099599, "survival_time": 17.050000000000107, "driven_lanedir": 1.5246018144421156, "get_state_dump": 0.004371956775062962, "get_robot_state": 0.003466508541887964, "sim_render-ego0": 0.0035796841682746395, "get_duckie_state": 1.5483265034636558e-06, "in-drivable-lane": 7.900000000000098, "deviation-heading": 2.616439435023871, "agent_compute-ego0": 0.013200221703066464, "complete-iteration": 0.14504188473461666, "set_robot_commands": 0.0020537717997679236, "deviation-center-line": 0.629798023513816, "driven_lanedir_consec": 1.5246018144421156, "sim_compute_sim_state": 0.005496397353055184, "sim_compute_performance-ego0": 0.0018584546987076252}}
set_robot_commands_max	0.0023283198790449555
set_robot_commands_mean	0.0021754905534923197
set_robot_commands_median	0.0021599352675782
set_robot_commands_min	0.0020537717997679236
sim_compute_performance-ego0_max	0.00201818215412279
sim_compute_performance-ego0_mean	0.0019269856875470553
sim_compute_performance-ego0_median	0.001915652948678903
sim_compute_performance-ego0_min	0.0018584546987076252
sim_compute_sim_state_max	0.011535954566056284
sim_compute_sim_state_mean	0.009414689189210314
sim_compute_sim_state_median	0.010313202418864896
sim_compute_sim_state_min	0.005496397353055184
sim_render-ego0_max	0.0038259093454840543
sim_render-ego0_mean	0.003716401931492179
sim_render-ego0_median	0.003730007106105012
sim_render-ego0_min	0.0035796841682746395
simulation-passed	1
step_physics_max	0.16456498226649324
step_physics_mean	0.11188831175390196
step_physics_median	0.09889052635405927
step_physics_min	0.08520721204099599
survival_time_max	26.25000000000024
survival_time_mean	18.200000000000145
survival_time_min	3.4999999999999956

No reset possible

57937

10740

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 14:50:01+00:00

2020-12-03 15:13:06+00:00

0:23:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	3.332706253958915
survival_time_median	48.1499999999994
deviation-center-line_median	1.1675635313027857
in-drivable-lane_median	6.149999999999921

other stats

agent_compute-ego0_max	0.012869986963708831
agent_compute-ego0_mean	0.012349167535472686
agent_compute-ego0_median	0.012506906043931138
agent_compute-ego0_min	0.011512871090319631
complete-iteration_max	0.21867075027563632
complete-iteration_mean	0.17085062887306313
complete-iteration_median	0.16251247237186367
complete-iteration_min	0.1397068204728888
deviation-center-line_max	3.1498327181465413
deviation-center-line_mean	1.4086058798714407
deviation-center-line_min	0.14946373873365096
deviation-heading_max	10.663520123509658
deviation-heading_mean	5.290313590674521
deviation-heading_median	4.318534319619824
deviation-heading_min	1.8606655999487776
driven_any_max	7.681449336890444
driven_any_mean	5.096992213227585
driven_any_median	6.210920768797388
driven_any_min	0.28467797842511866
driven_lanedir_consec_max	7.527123174745925
driven_lanedir_consec_mean	3.574891579163563
driven_lanedir_consec_min	0.10703063399049606
driven_lanedir_max	7.527123174745925
driven_lanedir_mean	3.574891579163563
driven_lanedir_median	3.332706253958915
driven_lanedir_min	0.10703063399049606
get_duckie_state_max	1.5452541379904767e-06
get_duckie_state_mean	1.5188037658111714e-06
get_duckie_state_median	1.5316875563394928e-06
get_duckie_state_min	1.4665858125752235e-06
get_robot_state_max	0.003555209633408747
get_robot_state_mean	0.0034994464375829285
get_robot_state_median	0.0034883092654530426
get_robot_state_min	0.0034659575860168813
get_state_dump_max	0.004421707911369128
get_state_dump_mean	0.0043596150580972855
get_state_dump_median	0.0043473740997759126
get_state_dump_min	0.004322004121468189
get_ui_image_max	0.03553043878995455
get_ui_image_mean	0.03013128550552839
get_ui_image_median	0.029836912548045172
get_ui_image_min	0.025320878136068654
in-drivable-lane_max	38.49999999999899
in-drivable-lane_mean	12.699999999999708
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.096713242280407, "get_ui_image": 0.027813774683452537, "step_physics": 0.08731822560873123, "survival_time": 36.300000000000075, "driven_lanedir": 3.9147120148215153, "get_state_dump": 0.004322004121468189, "get_robot_state": 0.003555209633408747, "sim_render-ego0": 0.003737719219685257, "get_duckie_state": 1.4665858125752235e-06, "in-drivable-lane": 10.799999999999848, "deviation-heading": 3.7044058393123342, "agent_compute-ego0": 0.012257742586621228, "complete-iteration": 0.153922563077987, "set_robot_commands": 0.002210138916477377, "deviation-center-line": 1.1805956241254054, "driven_lanedir_consec": 3.9147120148215153, "sim_compute_sim_state": 0.01071965120517568, "sim_compute_performance-ego0": 0.0019187340218230489}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.28467797842511866, "get_ui_image": 0.03553043878995455, "step_physics": 0.14510355851589105, "survival_time": 3.8499999999999943, "driven_lanedir": 0.10703063399049606, "get_state_dump": 0.004421707911369128, "get_robot_state": 0.003490123993311173, "sim_render-ego0": 0.0036237514936006982, "get_duckie_state": 1.525267576559996e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.8606655999487776, "agent_compute-ego0": 0.012756069501241049, "complete-iteration": 0.21867075027563632, "set_robot_commands": 0.0020740949190579928, "deviation-center-line": 0.14946373873365096, "driven_lanedir_consec": 0.10703063399049606, "sim_compute_sim_state": 0.009765025896903796, "sim_compute_performance-ego0": 0.0018345484366783728}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.325128295314371, "get_ui_image": 0.03186005041263781, "step_physics": 0.09928814457616242, "survival_time": 59.99999999999873, "driven_lanedir": 2.7507004930963155, "get_state_dump": 0.004323886296433473, "get_robot_state": 0.0034659575860168813, "sim_render-ego0": 0.0036734258205467817, "get_duckie_state": 1.5452541379904767e-06, "in-drivable-lane": 38.49999999999899, "deviation-heading": 4.932662799927313, "agent_compute-ego0": 0.012869986963708831, "complete-iteration": 0.17110238166574038, "set_robot_commands": 0.0020446283037120557, "deviation-center-line": 1.1545314384801657, "driven_lanedir_consec": 2.7507004930963155, "sim_compute_sim_state": 0.01165650111253216, "sim_compute_performance-ego0": 0.0018497216115883248}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.681449336890444, "get_ui_image": 0.025320878136068654, "step_physics": 0.08138400708308922, "survival_time": 59.99999999999873, "driven_lanedir": 7.527123174745925, "get_state_dump": 0.004370861903118353, "get_robot_state": 0.003486494537594912, "sim_render-ego0": 0.0035504335964053595, "get_duckie_state": 1.5381075361189897e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.663520123509658, "agent_compute-ego0": 0.011512871090319631, "complete-iteration": 0.1397068204728888, "set_robot_commands": 0.00210475385635719, "deviation-center-line": 3.1498327181465413, "driven_lanedir_consec": 7.527123174745925, "sim_compute_sim_state": 0.006070085806612369, "sim_compute_performance-ego0": 0.0018364255573231417}}
set_robot_commands_max	0.002210138916477377
set_robot_commands_mean	0.0021084039989011536
set_robot_commands_median	0.002089424387707591
set_robot_commands_min	0.0020446283037120557
sim_compute_performance-ego0_max	0.0019187340218230489
sim_compute_performance-ego0_mean	0.001859857406853222
sim_compute_performance-ego0_median	0.0018430735844557331
sim_compute_performance-ego0_min	0.0018345484366783728
sim_compute_sim_state_max	0.01165650111253216
sim_compute_sim_state_mean	0.009552816005306
sim_compute_sim_state_median	0.010242338551039738
sim_compute_sim_state_min	0.006070085806612369
sim_render-ego0_max	0.003737719219685257
sim_render-ego0_mean	0.003646332532559524
sim_render-ego0_median	0.003648588657073741
sim_render-ego0_min	0.0035504335964053595
simulation-passed	1
step_physics_max	0.14510355851589105
step_physics_mean	0.10327348394596848
step_physics_median	0.09330318509244682
step_physics_min	0.08138400708308922
survival_time_max	59.99999999999873
survival_time_mean	40.03749999999938
survival_time_min	3.8499999999999943

No reset possible

57919

10767

exercise_ros_template

LFv-sim

success

yes

2020-12-03 14:23:21+00:00

2020-12-03 14:49:45+00:00

0:26:24

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.2758706063324015
survival_time_median	50.724999999999255
deviation-center-line_median	1.9952949608226351
in-drivable-lane_median	13.400000000000077

other stats

agent_compute-ego0_max	0.012615963089756849
agent_compute-ego0_mean	0.0123495458064421
agent_compute-ego0_median	0.012381601241056752
agent_compute-ego0_min	0.012019017653898038
complete-iteration_max	0.18749400650162296
complete-iteration_mean	0.1650139928329219
complete-iteration_median	0.16423275912838847
complete-iteration_min	0.14409644657328763
deviation-center-line_max	4.701744202311129
deviation-center-line_mean	2.364220494225082
deviation-center-line_min	0.7645478529439311
deviation-heading_max	6.940827312414172
deviation-heading_mean	5.21158334361337
deviation-heading_median	5.459270853534672
deviation-heading_min	2.9869643549699627
driven_any_max	11.183348433593627
driven_any_mean	8.243435126758303
driven_any_median	8.315748596713338
driven_any_min	5.15889488001291
driven_lanedir_consec_max	10.00207748123367
driven_lanedir_consec_mean	6.078496721413957
driven_lanedir_consec_min	1.7601681917573588
driven_lanedir_max	10.00207748123367
driven_lanedir_mean	6.078496721413957
driven_lanedir_median	6.2758706063324015
driven_lanedir_min	1.7601681917573588
get_duckie_state_max	1.108137572683939e-06
get_duckie_state_mean	1.0870304406267712e-06
get_duckie_state_median	1.0986871917303046e-06
get_duckie_state_min	1.0426098063625364e-06
get_robot_state_max	0.0035551606765099114
get_robot_state_mean	0.0035171059981513003
get_robot_state_median	0.003517621261520564
get_robot_state_min	0.003478020793054162
get_state_dump_max	0.004480122328797149
get_state_dump_mean	0.00443987025117413
get_state_dump_median	0.004430592549086017
get_state_dump_min	0.004418173577727341
get_ui_image_max	0.0359581548047353
get_ui_image_mean	0.030652585875961934
get_ui_image_median	0.030508965737714454
get_ui_image_min	0.02563425722368353
in-drivable-lane_max	24.449999999999655
in-drivable-lane_mean	12.81249999999995
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 11.183348433593627, "get_ui_image": 0.028607399239329673, "step_physics": 0.090210233302438, "survival_time": 59.99999999999873, "driven_lanedir": 10.00207748123367, "get_state_dump": 0.004480122328797149, "get_robot_state": 0.0035346209456978196, "sim_render-ego0": 0.0036410270979958313, "get_duckie_state": 1.0426098063625364e-06, "in-drivable-lane": 5.349999999999898, "deviation-heading": 6.940827312414172, "agent_compute-ego0": 0.012019017653898038, "complete-iteration": 0.1556964115139646, "set_robot_commands": 0.002066477847833816, "deviation-center-line": 4.701744202311129, "driven_lanedir_consec": 10.00207748123367, "sim_compute_sim_state": 0.009175170371177096, "sim_compute_performance-ego0": 0.0018864847241988488}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.536728041007729, "get_ui_image": 0.0359581548047353, "step_physics": 0.11211306330669356, "survival_time": 41.44999999999978, "driven_lanedir": 2.551713784670129, "get_state_dump": 0.004421508168599692, "get_robot_state": 0.0035006215773433088, "sim_render-ego0": 0.0036184514861509025, "get_duckie_state": 1.1001724794686558e-06, "in-drivable-lane": 24.449999999999655, "deviation-heading": 4.32128528288168, "agent_compute-ego0": 0.012353862050067948, "complete-iteration": 0.18749400650162296, "set_robot_commands": 0.002064364502228886, "deviation-center-line": 1.5939685698393375, "driven_lanedir_consec": 2.551713784670129, "sim_compute_sim_state": 0.011545017253921692, "sim_compute_performance-ego0": 0.0018444437578500035}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.15889488001291, "get_ui_image": 0.03241053223609924, "step_physics": 0.09982278652307464, "survival_time": 32.75000000000028, "driven_lanedir": 1.7601681917573588, "get_state_dump": 0.004418173577727341, "get_robot_state": 0.003478020793054162, "sim_render-ego0": 0.003650351268489186, "get_duckie_state": 1.108137572683939e-06, "in-drivable-lane": 21.45000000000025, "deviation-heading": 2.9869643549699627, "agent_compute-ego0": 0.012615963089756849, "complete-iteration": 0.17276910674281237, "set_robot_commands": 0.00204800323742192, "deviation-center-line": 0.7645478529439311, "driven_lanedir_consec": 1.7601681917573588, "sim_compute_sim_state": 0.01240440185477094, "sim_compute_performance-ego0": 0.0018462753150521255}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.094769152418946, "get_ui_image": 0.02563425722368353, "step_physics": 0.08428839144361307, "survival_time": 59.99999999999873, "driven_lanedir": 10.000027427994674, "get_state_dump": 0.004439676929572341, "get_robot_state": 0.0035551606765099114, "sim_render-ego0": 0.003614921156909444, "get_duckie_state": 1.0972019039919534e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.597256424187665, "agent_compute-ego0": 0.01240934043204556, "complete-iteration": 0.14409644657328763, "set_robot_commands": 0.0021370616582509975, "deviation-center-line": 2.396621351805933, "driven_lanedir_consec": 10.000027427994674, "sim_compute_sim_state": 0.006051336101052366, "sim_compute_performance-ego0": 0.001890705388154118}}
set_robot_commands_max	0.0021370616582509975
set_robot_commands_mean	0.002078976811433905
set_robot_commands_median	0.002065421175031351
set_robot_commands_min	0.00204800323742192
sim_compute_performance-ego0_max	0.001890705388154118
sim_compute_performance-ego0_mean	0.001866977296313774
sim_compute_performance-ego0_median	0.0018663800196254872
sim_compute_performance-ego0_min	0.0018444437578500035
sim_compute_sim_state_max	0.01240440185477094
sim_compute_sim_state_mean	0.009793981395230524
sim_compute_sim_state_median	0.010360093812549391
sim_compute_sim_state_min	0.006051336101052366
sim_render-ego0_max	0.003650351268489186
sim_render-ego0_mean	0.003631187752386341
sim_render-ego0_median	0.003629739292073367
sim_render-ego0_min	0.003614921156909444
simulation-passed	1
step_physics_max	0.11211306330669356
step_physics_mean	0.0966086186439548
step_physics_median	0.09501650991275631
step_physics_min	0.08428839144361307
survival_time_max	59.99999999999873
survival_time_mean	48.54999999999938
survival_time_min	32.75000000000028

No reset possible

57914

10743

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 14:15:49+00:00

2020-12-03 14:23:02+00:00

0:07:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7572732143505012
survival_time_median	10.750000000000018
deviation-center-line_median	0.2142906704728767
in-drivable-lane_median	3.7249999999999943

other stats

agent_compute-ego0_max	0.01268287314925083
agent_compute-ego0_mean	0.012531092065831282
agent_compute-ego0_median	0.012554308285121043
agent_compute-ego0_min	0.012332878543832209
complete-iteration_max	0.22826548232588656
complete-iteration_mean	0.18736333206428524
complete-iteration_median	0.18181460809473896
complete-iteration_min	0.15755862974177645
deviation-center-line_max	0.5319498908318375
deviation-center-line_mean	0.268088344073663
deviation-center-line_min	0.11182214451706098
deviation-heading_max	2.1211222632627487
deviation-heading_mean	1.2794080327526745
deviation-heading_median	1.1945553865955678
deviation-heading_min	0.6073990945568128
driven_any_max	3.5450095640931996
driven_any_mean	2.0696701192854543
driven_any_median	2.030365687438586
driven_any_min	0.6729395381714459
driven_lanedir_consec_max	2.144771612417122
driven_lanedir_consec_mean	0.9730647166693648
driven_lanedir_consec_min	0.2329408255593348
driven_lanedir_max	2.144771612417122
driven_lanedir_mean	0.9730647166693648
driven_lanedir_median	0.7572732143505012
driven_lanedir_min	0.2329408255593348
get_duckie_state_max	1.2675921122233072e-06
get_duckie_state_mean	1.1921422562448857e-06
get_duckie_state_median	1.2071158807513007e-06
get_duckie_state_min	1.0867451512536335e-06
get_robot_state_max	0.0036731710620954926
get_robot_state_mean	0.0035873236868336484
get_robot_state_median	0.0035877603595539675
get_robot_state_min	0.003500602966131166
get_state_dump_max	0.00471493496614344
get_state_dump_mean	0.004596187036008042
get_state_dump_median	0.004603095220756172
get_state_dump_min	0.004463622736376386
get_ui_image_max	0.03630343426105588
get_ui_image_mean	0.03083487448505588
get_ui_image_median	0.03032663291186289
get_ui_image_min	0.026382797855441852
in-drivable-lane_max	13.350000000000117
in-drivable-lane_mean	5.650000000000032
in-drivable-lane_min	1.8000000000000256
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.4339190649396807, "get_ui_image": 0.028017533994188496, "step_physics": 0.10810101826985676, "survival_time": 12.700000000000044, "driven_lanedir": 2.144771612417122, "get_state_dump": 0.00471493496614344, "get_robot_state": 0.0036731710620954926, "sim_render-ego0": 0.003815613540948606, "get_duckie_state": 1.1911579206878064e-06, "in-drivable-lane": 1.8000000000000256, "deviation-heading": 2.1211222632627487, "agent_compute-ego0": 0.012526490641575232, "complete-iteration": 0.17493082308301738, "set_robot_commands": 0.002230656380746879, "deviation-center-line": 0.5319498908318375, "driven_lanedir_consec": 2.144771612417122, "sim_compute_sim_state": 0.00977756462845148, "sim_compute_performance-ego0": 0.001995920667461321}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6729395381714459, "get_ui_image": 0.03630343426105588, "step_physics": 0.15346789360046387, "survival_time": 4.249999999999993, "driven_lanedir": 0.2329408255593348, "get_state_dump": 0.004463622736376386, "get_robot_state": 0.003500602966131166, "sim_render-ego0": 0.003633973210356956, "get_duckie_state": 1.0867451512536335e-06, "in-drivable-lane": 2.6499999999999924, "deviation-heading": 0.771684169785067, "agent_compute-ego0": 0.01268287314925083, "complete-iteration": 0.22826548232588656, "set_robot_commands": 0.002091685006784838, "deviation-center-line": 0.11182214451706098, "driven_lanedir_consec": 0.2329408255593348, "sim_compute_sim_state": 0.010169783303903978, "sim_compute_performance-ego0": 0.0018790904865708465}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.5450095640931996, "get_ui_image": 0.03263573182953729, "step_physics": 0.11670941710472107, "survival_time": 17.95000000000012, "driven_lanedir": 0.7676724542020589, "get_state_dump": 0.004584203826056586, "get_robot_state": 0.0035951296488444012, "sim_render-ego0": 0.003798178831736247, "get_duckie_state": 1.2675921122233072e-06, "in-drivable-lane": 13.350000000000117, "deviation-heading": 1.6174266034060685, "agent_compute-ego0": 0.012582125928666857, "complete-iteration": 0.18869839310646055, "set_robot_commands": 0.0021308422088623046, "deviation-center-line": 0.24925246560936615, "driven_lanedir_consec": 0.7676724542020589, "sim_compute_sim_state": 0.010634430911805897, "sim_compute_performance-ego0": 0.001952087879180908}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.626812309937491, "get_ui_image": 0.026382797855441852, "step_physics": 0.09753739227682856, "survival_time": 8.79999999999999, "driven_lanedir": 0.7468739744989437, "get_state_dump": 0.0046219866154557565, "get_robot_state": 0.0035803910702635337, "sim_render-ego0": 0.003734705811839993, "get_duckie_state": 1.2230738408147953e-06, "in-drivable-lane": 4.799999999999996, "deviation-heading": 0.6073990945568128, "agent_compute-ego0": 0.012332878543832209, "complete-iteration": 0.15755862974177645, "set_robot_commands": 0.002145998895505054, "deviation-center-line": 0.17932887533638725, "driven_lanedir_consec": 0.7468739744989437, "sim_compute_sim_state": 0.005235752816927635, "sim_compute_performance-ego0": 0.001911444852581132}}
set_robot_commands_max	0.002230656380746879
set_robot_commands_mean	0.002149795622974769
set_robot_commands_median	0.0021384205521836792
set_robot_commands_min	0.002091685006784838
sim_compute_performance-ego0_max	0.001995920667461321
sim_compute_performance-ego0_mean	0.001934635971448552
sim_compute_performance-ego0_median	0.00193176636588102
sim_compute_performance-ego0_min	0.0018790904865708465
sim_compute_sim_state_max	0.010634430911805897
sim_compute_sim_state_mean	0.008954382915272247
sim_compute_sim_state_median	0.009973673966177729
sim_compute_sim_state_min	0.005235752816927635
sim_render-ego0_max	0.003815613540948606
sim_render-ego0_mean	0.0037456178487204504
sim_render-ego0_median	0.00376644232178812
sim_render-ego0_min	0.003633973210356956
simulation-passed	1
step_physics_max	0.15346789360046387
step_physics_mean	0.11895393031296755
step_physics_median	0.11240521768728892
step_physics_min	0.09753739227682856
survival_time_max	17.95000000000012
survival_time_mean	10.925000000000038
survival_time_min	4.249999999999993

No reset possible

57886

10782

exercise_ros_template

LFv-sim

success

yes

2020-12-03 13:46:38+00:00

2020-12-03 14:15:14+00:00

0:28:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	7.061135411702674
survival_time_median	59.99999999999873
deviation-center-line_median	3.2367476349211617
in-drivable-lane_median	1.3250000000000188

other stats

agent_compute-ego0_max	0.012418414571602357
agent_compute-ego0_mean	0.012059118165040164
agent_compute-ego0_median	0.012001404158777242
agent_compute-ego0_min	0.011815249771003818
complete-iteration_max	0.18181601829274707
complete-iteration_mean	0.16783442700935972
complete-iteration_median	0.1724383628974734
complete-iteration_min	0.14464496394974505
deviation-center-line_max	4.929082353186433
deviation-center-line_mean	3.05835281466652
deviation-center-line_min	0.8308336356373228
deviation-heading_max	7.378247080854623
deviation-heading_mean	5.562436054480552
deviation-heading_median	6.4855529338595534
deviation-heading_min	1.9003912693484768
driven_any_max	7.504325032986965
driven_any_mean	6.230754155412649
driven_any_median	7.504316940414864
driven_any_min	2.410057707833904
driven_lanedir_consec_max	7.413388451156735
driven_lanedir_consec_mean	5.9191560873665
driven_lanedir_consec_min	2.140965074903916
driven_lanedir_max	7.413388451156735
driven_lanedir_mean	5.9191560873665
driven_lanedir_median	7.061135411702674
driven_lanedir_min	2.140965074903916
get_duckie_state_max	1.3350249329375585e-06
get_duckie_state_mean	1.2806361193617863e-06
get_duckie_state_median	1.2693254337335904e-06
get_duckie_state_min	1.248868677042406e-06
get_robot_state_max	0.003620840645776006
get_robot_state_mean	0.0035159341992750752
get_robot_state_median	0.0034888893440303756
get_robot_state_min	0.003465117463263544
get_state_dump_max	0.004607013880912894
get_state_dump_mean	0.004425689060189292
get_state_dump_median	0.004375902838155093
get_state_dump_min	0.004343936683534087
get_ui_image_max	0.03594657761369716
get_ui_image_mean	0.03064927436161065
get_ui_image_median	0.03047057879018871
get_ui_image_min	0.025709362252368025
in-drivable-lane_max	5.699999999999747
in-drivable-lane_mean	2.087499999999946
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.410057707833904, "get_ui_image": 0.02854267364652286, "step_physics": 0.09906106746842708, "survival_time": 20.250000000000153, "driven_lanedir": 2.140965074903916, "get_state_dump": 0.004607013880912894, "get_robot_state": 0.003620840645776006, "sim_render-ego0": 0.003786548017868267, "get_duckie_state": 1.274893436525843e-06, "in-drivable-lane": 2.6500000000000377, "deviation-heading": 1.9003912693484768, "agent_compute-ego0": 0.012418414571602357, "complete-iteration": 0.16605406030645511, "set_robot_commands": 0.0022083556123555, "deviation-center-line": 0.8308336356373228, "driven_lanedir_consec": 2.140965074903916, "sim_compute_sim_state": 0.009757065420667526, "sim_compute_performance-ego0": 0.0019728009923925542}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.504325032986965, "get_ui_image": 0.03594657761369716, "step_physics": 0.10632562875549165, "survival_time": 59.99999999999873, "driven_lanedir": 7.411386172802298, "get_state_dump": 0.004343936683534087, "get_robot_state": 0.003465117463263544, "sim_render-ego0": 0.0036082773978863033, "get_duckie_state": 1.248868677042406e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.378247080854623, "agent_compute-ego0": 0.012071168591438183, "complete-iteration": 0.18181601829274707, "set_robot_commands": 0.0020408680000273413, "deviation-center-line": 3.451403178569121, "driven_lanedir_consec": 7.411386172802298, "sim_compute_sim_state": 0.012088132242080472, "sim_compute_performance-ego0": 0.0018501682742052927}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.504321379600353, "get_ui_image": 0.03239848393385456, "step_physics": 0.10587670662123198, "survival_time": 59.99999999999873, "driven_lanedir": 6.710884650603051, "get_state_dump": 0.0044055727498914475, "get_robot_state": 0.003487141106547563, "sim_render-ego0": 0.003609547904885679, "get_duckie_state": 1.263757430941338e-06, "in-drivable-lane": 5.699999999999747, "deviation-heading": 6.262452169967977, "agent_compute-ego0": 0.011931639726116298, "complete-iteration": 0.17882266548849166, "set_robot_commands": 0.0020444512267990176, "deviation-center-line": 4.929082353186433, "driven_lanedir_consec": 6.710884650603051, "sim_compute_sim_state": 0.013134014596549996, "sim_compute_performance-ego0": 0.0018596768279953064}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.504312501229373, "get_ui_image": 0.025709362252368025, "step_physics": 0.0856325626373291, "survival_time": 59.99999999999873, "driven_lanedir": 7.413388451156735, "get_state_dump": 0.00434623292641874, "get_robot_state": 0.003490637581513188, "sim_render-ego0": 0.003602197029310698, "get_duckie_state": 1.3350249329375585e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.708653697751131, "agent_compute-ego0": 0.011815249771003818, "complete-iteration": 0.14464496394974505, "set_robot_commands": 0.0021676280714887862, "deviation-center-line": 3.0220920912732026, "driven_lanedir_consec": 7.413388451156735, "sim_compute_sim_state": 0.005943608025924848, "sim_compute_performance-ego0": 0.0018602036913666104}}
set_robot_commands_max	0.0022083556123555
set_robot_commands_mean	0.0021153257276676617
set_robot_commands_median	0.002106039649143902
set_robot_commands_min	0.0020408680000273413
sim_compute_performance-ego0_max	0.0019728009923925542
sim_compute_performance-ego0_mean	0.0018857124464899408
sim_compute_performance-ego0_median	0.0018599402596809584
sim_compute_performance-ego0_min	0.0018501682742052927
sim_compute_sim_state_max	0.013134014596549996
sim_compute_sim_state_mean	0.010230705071305713
sim_compute_sim_state_median	0.010922598831374
sim_compute_sim_state_min	0.005943608025924848
sim_render-ego0_max	0.003786548017868267
sim_render-ego0_mean	0.003651642587487737
sim_render-ego0_median	0.003608912651385991
sim_render-ego0_min	0.003602197029310698
simulation-passed	1
step_physics_max	0.10632562875549165
step_physics_mean	0.09922399137061996
step_physics_median	0.10246888704482954
step_physics_min	0.0856325626373291
survival_time_max	59.99999999999873
survival_time_mean	50.06249999999908
survival_time_min	20.250000000000153

No reset possible

57881

10786

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

host-error

yes

2020-12-03 13:43:10+00:00

2020-12-03 13:46:21+00:00

0:03:11

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57872

10786

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 13:37:17+00:00

2020-12-03 13:41:48+00:00

0:04:31

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 17 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57827

10805

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 13:12:17+00:00

2020-12-03 13:36:30+00:00

0:24:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7861858629457574
survival_time_median	47.49999999999944
deviation-center-line_median	1.6341131119535366
in-drivable-lane_median	31.49999999999958

other stats

agent_compute-ego0_max	0.013077479417278408
agent_compute-ego0_mean	0.012605645163301298
agent_compute-ego0_median	0.012638892656976436
agent_compute-ego0_min	0.01206731592197391
complete-iteration_max	0.20670045484410657
complete-iteration_mean	0.18937619396440836
complete-iteration_median	0.20137098706830933
complete-iteration_min	0.1480623468769083
deviation-center-line_max	3.3259128395361013
deviation-center-line_mean	1.69899413543101
deviation-center-line_min	0.2018374782808655
deviation-heading_max	7.496073673980464
deviation-heading_mean	4.59111742055532
deviation-heading_median	4.365897119146821
deviation-heading_min	2.1366017699471747
driven_any_max	4.169101586284656
driven_any_mean	2.7461490930549113
driven_any_median	3.2693831910652045
driven_any_min	0.276728403804579
driven_lanedir_consec_max	1.4697807810500727
driven_lanedir_consec_mean	0.7909330780026128
driven_lanedir_consec_min	0.12157980506886368
driven_lanedir_max	1.4697807810500727
driven_lanedir_mean	0.7929057136935329
driven_lanedir_median	0.7901311343275977
driven_lanedir_min	0.12157980506886368
get_duckie_state_max	1.492647207547584e-06
get_duckie_state_mean	1.2464644092697377e-06
get_duckie_state_median	1.1842298644883172e-06
get_duckie_state_min	1.1247507005547322e-06
get_robot_state_max	0.0037202997866717102
get_robot_state_mean	0.0035562769611717
get_robot_state_median	0.003509531559774905
get_robot_state_min	0.003485744938465281
get_state_dump_max	0.004553444478831422
get_state_dump_mean	0.004438645691257766
get_state_dump_median	0.004417978844862109
get_state_dump_min	0.004365180596475424
get_ui_image_max	0.036304936550631384
get_ui_image_mean	0.03066801168310194
get_ui_image_median	0.030346033650606136
get_ui_image_min	0.02567504288056411
in-drivable-lane_max	42.84999999999867
in-drivable-lane_mean	26.999999999999456
in-drivable-lane_min	2.1499999999999924
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.3696709805027263, "get_ui_image": 0.02800372493760222, "step_physics": 0.14049151518545544, "survival_time": 35.00000000000015, "driven_lanedir": 0.5843971081934165, "get_state_dump": 0.004365180596475424, "get_robot_state": 0.0035227042292052093, "sim_render-ego0": 0.0035937386810694543, "get_duckie_state": 1.1247507005547322e-06, "in-drivable-lane": 24.900000000000087, "deviation-heading": 4.639686804213481, "agent_compute-ego0": 0.01206731592197391, "complete-iteration": 0.20570598315240313, "set_robot_commands": 0.0020476482734190413, "deviation-center-line": 1.1973672446246586, "driven_lanedir_consec": 0.5843971081934165, "sim_compute_sim_state": 0.009678034231428071, "sim_compute_performance-ego0": 0.001863882306979148}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.276728403804579, "get_ui_image": 0.036304936550631384, "step_physics": 0.1315927269435165, "survival_time": 4.99999999999999, "driven_lanedir": 0.12157980506886368, "get_state_dump": 0.004407906296229599, "get_robot_state": 0.0034963588903446008, "sim_render-ego0": 0.003683274335200244, "get_duckie_state": 1.1968140554900217e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 2.1366017699471747, "agent_compute-ego0": 0.013006904337665822, "complete-iteration": 0.20670045484410657, "set_robot_commands": 0.00208120062799737, "deviation-center-line": 0.2018374782808655, "driven_lanedir_consec": 0.12157980506886368, "sim_compute_sim_state": 0.010151671891165252, "sim_compute_performance-ego0": 0.0019008357926170423}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.169101586284656, "get_ui_image": 0.032688342363610054, "step_physics": 0.1230297366546453, "survival_time": 59.99999999999873, "driven_lanedir": 0.995865160461779, "get_state_dump": 0.004553444478831422, "get_robot_state": 0.0037202997866717102, "sim_render-ego0": 0.003840543745360109, "get_duckie_state": 1.492647207547584e-06, "in-drivable-lane": 42.84999999999867, "deviation-heading": 7.496073673980464, "agent_compute-ego0": 0.013077479417278408, "complete-iteration": 0.1970359909842155, "set_robot_commands": 0.0021308643633281064, "deviation-center-line": 2.0708589792824146, "driven_lanedir_consec": 0.9879746176980984, "sim_compute_sim_state": 0.011903921035207578, "sim_compute_performance-ego0": 0.0020068428300004716}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.169095401627683, "get_ui_image": 0.02567504288056411, "step_physics": 0.08862205528399034, "survival_time": 59.99999999999873, "driven_lanedir": 1.4697807810500727, "get_state_dump": 0.004428051393494618, "get_robot_state": 0.003485744938465281, "sim_render-ego0": 0.003547700616739672, "get_duckie_state": 1.1716456734866127e-06, "in-drivable-lane": 38.09999999999907, "deviation-heading": 4.0921074340801615, "agent_compute-ego0": 0.012270880976287054, "complete-iteration": 0.1480623468769083, "set_robot_commands": 0.002048120609826589, "deviation-center-line": 3.3259128395361013, "driven_lanedir_consec": 1.4697807810500727, "sim_compute_sim_state": 0.006082155424589718, "sim_compute_performance-ego0": 0.0018295437767543363}}
set_robot_commands_max	0.0021308643633281064
set_robot_commands_mean	0.0020769584686427768
set_robot_commands_median	0.0020646606189119792
set_robot_commands_min	0.0020476482734190413
sim_compute_performance-ego0_max	0.0020068428300004716
sim_compute_performance-ego0_mean	0.0019002761765877496
sim_compute_performance-ego0_median	0.0018823590497980957
sim_compute_performance-ego0_min	0.0018295437767543363
sim_compute_sim_state_max	0.011903921035207578
sim_compute_sim_state_mean	0.009453945645597655
sim_compute_sim_state_median	0.009914853061296663
sim_compute_sim_state_min	0.006082155424589718
sim_render-ego0_max	0.003840543745360109
sim_render-ego0_mean	0.0036663143445923698
sim_render-ego0_median	0.003638506508134849
sim_render-ego0_min	0.003547700616739672
simulation-passed	1
step_physics_max	0.14049151518545544
step_physics_mean	0.12093400851690188
step_physics_median	0.1273112317990809
step_physics_min	0.08862205528399034
survival_time_max	59.99999999999873
survival_time_mean	39.9999999999994
survival_time_min	4.99999999999999

No reset possible

57818

10810

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

host-error

yes

2020-12-03 13:07:01+00:00

2020-12-03 13:10:59+00:00

0:03:58

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57806

10818

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 12:59:40+00:00

2020-12-03 13:06:25+00:00

0:06:45

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.34376751057916755
survival_time_median	10.325000000000012
deviation-center-line_median	0.1704096934179259
in-drivable-lane_median	7.349999999999996

other stats

agent_compute-ego0_max	0.012952220683195154
agent_compute-ego0_mean	0.012638077919133874
agent_compute-ego0_median	0.012617035036519808
agent_compute-ego0_min	0.012366020920300725
complete-iteration_max	0.24633627521748447
complete-iteration_mean	0.18301913686271615
complete-iteration_median	0.17015004075195567
complete-iteration_min	0.14544019072946876
deviation-center-line_max	0.4630310318846671
deviation-center-line_mean	0.21993269097939697
deviation-center-line_min	0.07588034519706902
deviation-heading_max	1.6155763914017556
deviation-heading_mean	0.9506774957609496
deviation-heading_median	0.7731523440802012
deviation-heading_min	0.6408289034816406
driven_any_max	3.9223434395955272
driven_any_mean	2.022509260718403
driven_any_median	1.9412854532466928
driven_any_min	0.2851226967847003
driven_lanedir_consec_max	0.6918779689815444
driven_lanedir_consec_mean	0.3789176672429189
driven_lanedir_consec_min	0.13625767883179618
driven_lanedir_max	0.6918779689815444
driven_lanedir_mean	0.3789176672429189
driven_lanedir_median	0.34376751057916755
driven_lanedir_min	0.13625767883179618
get_duckie_state_max	1.2212870072345344e-06
get_duckie_state_mean	1.197927793651507e-06
get_duckie_state_median	1.1964344950507904e-06
get_duckie_state_min	1.1775551772699124e-06
get_robot_state_max	0.003634123213262672
get_robot_state_mean	0.0035300665024237
get_robot_state_median	0.0034997863747798096
get_robot_state_min	0.003486570046872509
get_state_dump_max	0.00466332872550326
get_state_dump_mean	0.004448266306519865
get_state_dump_median	0.004399134084441402
get_state_dump_min	0.004331468331693399
get_ui_image_max	0.035507990389454125
get_ui_image_mean	0.030541392999720172
get_ui_image_median	0.030546376351515067
get_ui_image_min	0.025564828906396424
in-drivable-lane_max	17.400000000000148
in-drivable-lane_mean	8.312500000000034
in-drivable-lane_min	1.149999999999999
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.3920282568648927, "get_ui_image": 0.028659465303459017, "step_physics": 0.09150762387005933, "survival_time": 12.500000000000044, "driven_lanedir": 0.6918779689815444, "get_state_dump": 0.00466332872550326, "get_robot_state": 0.003634123213262672, "sim_render-ego0": 0.003799872569353932, "get_duckie_state": 1.1911430206906748e-06, "in-drivable-lane": 8.450000000000012, "deviation-heading": 1.6155763914017556, "agent_compute-ego0": 0.012582024730059257, "complete-iteration": 0.15872753663841946, "set_robot_commands": 0.002253653043769745, "deviation-center-line": 0.4630310318846671, "driven_lanedir_consec": 0.6918779689815444, "sim_compute_sim_state": 0.009573545113977682, "sim_compute_performance-ego0": 0.001976777832821546}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2851226967847003, "get_ui_image": 0.035507990389454125, "step_physics": 0.17346383114250338, "survival_time": 2.3999999999999995, "driven_lanedir": 0.13625767883179618, "get_state_dump": 0.004377102365299147, "get_robot_state": 0.003486570046872509, "sim_render-ego0": 0.003660824834084024, "get_duckie_state": 1.2212870072345344e-06, "in-drivable-lane": 1.149999999999999, "deviation-heading": 0.8411300214744882, "agent_compute-ego0": 0.012952220683195154, "complete-iteration": 0.24633627521748447, "set_robot_commands": 0.002086313403382593, "deviation-center-line": 0.07588034519706902, "driven_lanedir_consec": 0.13625767883179618, "sim_compute_sim_state": 0.008867847676179846, "sim_compute_performance-ego0": 0.0018560302500822104}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.490542649628493, "get_ui_image": 0.03243328739957112, "step_physics": 0.11236945739606533, "survival_time": 8.14999999999998, "driven_lanedir": 0.2959842168024316, "get_state_dump": 0.0044211658035836566, "get_robot_state": 0.0035094269892064537, "sim_render-ego0": 0.0036977384148574456, "get_duckie_state": 1.1775551772699124e-06, "in-drivable-lane": 6.24999999999998, "deviation-heading": 0.6408289034816406, "agent_compute-ego0": 0.012652045342980362, "complete-iteration": 0.1815725448654919, "set_robot_commands": 0.0020965933799743652, "deviation-center-line": 0.10750214482416208, "driven_lanedir_consec": 0.2959842168024316, "sim_compute_sim_state": 0.008444518577761767, "sim_compute_performance-ego0": 0.0018713721414891683}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.9223434395955272, "get_ui_image": 0.025564828906396424, "step_physics": 0.08690183210854578, "survival_time": 19.750000000000146, "driven_lanedir": 0.3915508043559035, "get_state_dump": 0.004331468331693399, "get_robot_state": 0.0034901457603531655, "sim_render-ego0": 0.00362844659824564, "get_duckie_state": 1.201725969410906e-06, "in-drivable-lane": 17.400000000000148, "deviation-heading": 0.7051746666859141, "agent_compute-ego0": 0.012366020920300725, "complete-iteration": 0.14544019072946876, "set_robot_commands": 0.0020800250949281635, "deviation-center-line": 0.2333172420116897, "driven_lanedir_consec": 0.3915508043559035, "sim_compute_sim_state": 0.0051578873335713085, "sim_compute_performance-ego0": 0.0018443218385330352}}
set_robot_commands_max	0.002253653043769745
set_robot_commands_mean	0.002129146230513717
set_robot_commands_median	0.002091453391678479
set_robot_commands_min	0.0020800250949281635
sim_compute_performance-ego0_max	0.001976777832821546
sim_compute_performance-ego0_mean	0.0018871255157314904
sim_compute_performance-ego0_median	0.0018637011957856897
sim_compute_performance-ego0_min	0.0018443218385330352
sim_compute_sim_state_max	0.009573545113977682
sim_compute_sim_state_mean	0.008010949675372652
sim_compute_sim_state_median	0.008656183126970807
sim_compute_sim_state_min	0.0051578873335713085
sim_render-ego0_max	0.003799872569353932
sim_render-ego0_mean	0.0036967206041352606
sim_render-ego0_median	0.003679281624470735
sim_render-ego0_min	0.00362844659824564
simulation-passed	1
step_physics_max	0.17346383114250338
step_physics_mean	0.11606068612929346
step_physics_median	0.10193854063306232
step_physics_min	0.08690183210854578
survival_time_max	19.750000000000146
survival_time_mean	10.700000000000042
survival_time_min	2.3999999999999995

No reset possible

57799

10823

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 12:55:43+00:00

2020-12-03 12:58:45+00:00

0:03:02

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 7 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57791

10824

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

yes

2020-12-03 12:51:34+00:00

2020-12-03 12:54:48+00:00

0:03:14

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 5 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57653

11313

template-pytorch

LFVmultibodyv-sim

success

yes

2020-12-03 11:15:29+00:00

2020-12-03 12:51:20+00:00

1:35:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.984893814521406
survival_time_median	59.99999999999873
deviation-center-line_median	3.005694071175435
in-drivable-lane_median	0.3250000000000046

other stats

agent_compute-ego0_max	0.01372488154459754
agent_compute-ego0_mean	0.013329606953691004
agent_compute-ego0_median	0.013264519487392098
agent_compute-ego0_min	0.013063605679361946
agent_compute-ego1_max	0.012790384115996183
agent_compute-ego1_mean	0.012458569398327632
agent_compute-ego1_median	0.012416593835911684
agent_compute-ego1_min	0.012214421431885274
agent_compute-ego2_max	0.012821735688589892
agent_compute-ego2_mean	0.012528679088324664
agent_compute-ego2_median	0.01245920505253699
agent_compute-ego2_min	0.012305096523847111
agent_compute-ego3_max	0.01276572419642211
agent_compute-ego3_mean	0.01222595922357335
agent_compute-ego3_median	0.011966883193245535
agent_compute-ego3_min	0.011945270281052411
complete-iteration_max	0.731606378047095
complete-iteration_mean	0.6367893821058235
complete-iteration_median	0.7052013500842524
complete-iteration_min	0.29617044807952125
deviation-center-line_max	3.293010553175821
deviation-center-line_mean	2.5627482762740104
deviation-center-line_min	0.2075314128275519
deviation-heading_max	17.554849608991095
deviation-heading_mean	12.342500675192014
deviation-heading_median	13.094032588617278
deviation-heading_min	1.1045475745701203
driven_any_max	10.78927886654006
driven_any_mean	8.65302496583876
driven_any_median	9.711169470221776
driven_any_min	1.1994404939293988
driven_lanedir_consec_max	9.937095412010413
driven_lanedir_consec_mean	8.02897979139077
driven_lanedir_consec_min	1.0701523471111591
driven_lanedir_max	9.937095412010413
driven_lanedir_mean	8.02897979139077
driven_lanedir_median	8.984893814521406
driven_lanedir_min	1.0701523471111591
get_duckie_state_max	1.405299851340517e-06
get_duckie_state_mean	1.3569177908164585e-06
get_duckie_state_median	1.3415759846530886e-06
get_duckie_state_min	1.3209302459132365e-06
get_robot_state_max	0.014812378164731296
get_robot_state_mean	0.013336287289682152
get_robot_state_median	0.014205357911287
get_robot_state_min	0.007108920886192793
get_state_dump_max	0.009985964463017168
get_state_dump_mean	0.009209377210785533
get_state_dump_median	0.009588804967595971
get_state_dump_min	0.006404307153489854
get_ui_image_max	0.04982248968526187
get_ui_image_mean	0.044307982612604
get_ui_image_median	0.04769318427372535
get_ui_image_min	0.029957181141700272
in-drivable-lane_max	4.749999999999927
in-drivable-lane_mean	0.9821428571428472
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 10.78927886654006, "get_ui_image": 0.04258367461427662, "step_physics": 0.4652816375824534, "survival_time": 59.99999999999873, "driven_lanedir": 9.033576837727434, "get_state_dump": 0.009588804967595971, "get_robot_state": 0.014205357911287, "sim_render-ego0": 0.003713153978867098, "sim_render-ego1": 0.003667621588726822, "sim_render-ego2": 0.0036732094373234502, "sim_render-ego3": 0.003673041293662752, "get_duckie_state": 1.3415759846530886e-06, "in-drivable-lane": 4.749999999999927, "deviation-heading": 17.396097784803036, "agent_compute-ego0": 0.013063605679361946, "agent_compute-ego1": 0.01257878556835165, "agent_compute-ego2": 0.012305096523847111, "agent_compute-ego3": 0.011945270281052411, "complete-iteration": 0.6438698851992745, "set_robot_commands": 0.0021716869443183535, "deviation-center-line": 3.136987301332599, "driven_lanedir_consec": 9.033576837727434, "sim_compute_sim_state": 0.031001750277440617, "sim_compute_performance-ego0": 0.001953703080684716, "sim_compute_performance-ego1": 0.001943207104736125, "sim_compute_performance-ego2": 0.0019240230445957103, "sim_compute_performance-ego3": 0.0019119381408310256}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 10.450149529659072, "get_ui_image": 0.04258367461427662, "step_physics": 0.4652816375824534, "survival_time": 59.99999999999873, "driven_lanedir": 9.291924419550764, "get_state_dump": 0.009588804967595971, "get_robot_state": 0.014205357911287, "sim_render-ego0": 0.003713153978867098, "sim_render-ego1": 0.003667621588726822, "sim_render-ego2": 0.0036732094373234502, "sim_render-ego3": 0.003673041293662752, "get_duckie_state": 1.3415759846530886e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 17.40296405607593, "agent_compute-ego0": 0.013063605679361946, "agent_compute-ego1": 0.01257878556835165, "agent_compute-ego2": 0.012305096523847111, "agent_compute-ego3": 0.011945270281052411, "complete-iteration": 0.6438698851992745, "set_robot_commands": 0.0021716869443183535, "deviation-center-line": 3.1783663520616185, "driven_lanedir_consec": 9.291924419550764, "sim_compute_sim_state": 0.031001750277440617, "sim_compute_performance-ego0": 0.001953703080684716, "sim_compute_performance-ego1": 0.001943207104736125, "sim_compute_performance-ego2": 0.0019240230445957103, "sim_compute_performance-ego3": 0.0019119381408310256}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.18348375050304, "get_ui_image": 0.04258367461427662, "step_physics": 0.4652816375824534, "survival_time": 59.99999999999873, "driven_lanedir": 9.937095412010413, "get_state_dump": 0.009588804967595971, "get_robot_state": 0.014205357911287, "sim_render-ego0": 0.003713153978867098, "sim_render-ego1": 0.003667621588726822, "sim_render-ego2": 0.0036732094373234502, "sim_render-ego3": 0.003673041293662752, "get_duckie_state": 1.3415759846530886e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.965549780574012, "agent_compute-ego0": 0.013063605679361946, "agent_compute-ego1": 0.01257878556835165, "agent_compute-ego2": 0.012305096523847111, "agent_compute-ego3": 0.011945270281052411, "complete-iteration": 0.6438698851992745, "set_robot_commands": 0.0021716869443183535, "deviation-center-line": 2.148249641196662, "driven_lanedir_consec": 9.937095412010413, "sim_compute_sim_state": 0.031001750277440617, "sim_compute_performance-ego0": 0.001953703080684716, "sim_compute_performance-ego1": 0.001943207104736125, "sim_compute_performance-ego2": 0.0019240230445957103, "sim_compute_performance-ego3": 0.0019119381408310256}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.507435431456496, "get_ui_image": 0.04258367461427662, "step_physics": 0.4652816375824534, "survival_time": 59.99999999999873, "driven_lanedir": 9.285885857444942, "get_state_dump": 0.009588804967595971, "get_robot_state": 0.014205357911287, "sim_render-ego0": 0.003713153978867098, "sim_render-ego1": 0.003667621588726822, "sim_render-ego2": 0.0036732094373234502, "sim_render-ego3": 0.003673041293662752, "get_duckie_state": 1.3415759846530886e-06, "in-drivable-lane": 2.199999999999875, "deviation-heading": 17.554849608991095, "agent_compute-ego0": 0.013063605679361946, "agent_compute-ego1": 0.01257878556835165, "agent_compute-ego2": 0.012305096523847111, "agent_compute-ego3": 0.011945270281052411, "complete-iteration": 0.6438698851992745, "set_robot_commands": 0.0021716869443183535, "deviation-center-line": 3.293010553175821, "driven_lanedir_consec": 9.285885857444942, "sim_compute_sim_state": 0.031001750277440617, "sim_compute_performance-ego0": 0.001953703080684716, "sim_compute_performance-ego1": 0.001943207104736125, "sim_compute_performance-ego2": 0.0019240230445957103, "sim_compute_performance-ego3": 0.0019119381408310256}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 10.063427950898738, "get_ui_image": 0.04982248968526187, "step_physics": 0.5308298512759753, "survival_time": 59.99999999999873, "driven_lanedir": 9.677760670126014, "get_state_dump": 0.0094558972303913, "get_robot_state": 0.01410480899477283, "sim_render-ego0": 0.003741506732175193, "sim_render-ego1": 0.0036612339162707423, "sim_render-ego2": 0.0036082742216188048, "sim_render-ego3": 0.0035990400179339685, "get_duckie_state": 1.3209302459132365e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.990182720796527, "agent_compute-ego0": 0.013264519487392098, "agent_compute-ego1": 0.012416593835911684, "agent_compute-ego2": 0.01245920505253699, "agent_compute-ego3": 0.011966883193245535, "complete-iteration": 0.731606378047095, "set_robot_commands": 0.002100919704453137, "deviation-center-line": 2.661975364038246, "driven_lanedir_consec": 9.677760670126014, "sim_compute_sim_state": 0.046321727751097413, "sim_compute_performance-ego0": 0.001986459927396115, "sim_compute_performance-ego1": 0.001939264364186969, "sim_compute_performance-ego2": 0.0018953496867869912, "sim_compute_performance-ego3": 0.0018781444412981044}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 10.382360251581352, "get_ui_image": 0.04982248968526187, "step_physics": 0.5308298512759753, "survival_time": 59.99999999999873, "driven_lanedir": 9.718695764907167, "get_state_dump": 0.0094558972303913, "get_robot_state": 0.01410480899477283, "sim_render-ego0": 0.003741506732175193, "sim_render-ego1": 0.0036612339162707423, "sim_render-ego2": 0.0036082742216188048, "sim_render-ego3": 0.0035990400179339685, "get_duckie_state": 1.3209302459132365e-06, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 14.65348353919882, "agent_compute-ego0": 0.013264519487392098, "agent_compute-ego1": 0.012416593835911684, "agent_compute-ego2": 0.01245920505253699, "agent_compute-ego3": 0.011966883193245535, "complete-iteration": 0.731606378047095, "set_robot_commands": 0.002100919704453137, "deviation-center-line": 3.0908221966390985, "driven_lanedir_consec": 9.718695764907167, "sim_compute_sim_state": 0.046321727751097413, "sim_compute_performance-ego0": 0.001986459927396115, "sim_compute_performance-ego1": 0.001939264364186969, "sim_compute_performance-ego2": 0.0018953496867869912, "sim_compute_performance-ego3": 0.0018781444412981044}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.15363788979483, "get_ui_image": 0.04982248968526187, "step_physics": 0.5308298512759753, "survival_time": 59.99999999999873, "driven_lanedir": 8.782157233219303, "get_state_dump": 0.0094558972303913, "get_robot_state": 0.01410480899477283, "sim_render-ego0": 0.003741506732175193, "sim_render-ego1": 0.0036612339162707423, "sim_render-ego2": 0.0036082742216188048, "sim_render-ego3": 0.0035990400179339685, "get_duckie_state": 1.3209302459132365e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.155488405735406, "agent_compute-ego0": 0.013264519487392098, "agent_compute-ego1": 0.012416593835911684, "agent_compute-ego2": 0.01245920505253699, "agent_compute-ego3": 0.011966883193245535, "complete-iteration": 0.731606378047095, "set_robot_commands": 0.002100919704453137, "deviation-center-line": 2.4910015708584328, "driven_lanedir_consec": 8.782157233219303, "sim_compute_sim_state": 0.046321727751097413, "sim_compute_performance-ego0": 0.001986459927396115, "sim_compute_performance-ego1": 0.001939264364186969, "sim_compute_performance-ego2": 0.0018953496867869912, "sim_compute_performance-ego3": 0.0018781444412981044}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 9.248020765246148, "get_ui_image": 0.04982248968526187, "step_physics": 0.5308298512759753, "survival_time": 59.99999999999873, "driven_lanedir": 8.936210791315379, "get_state_dump": 0.0094558972303913, "get_robot_state": 0.01410480899477283, "sim_render-ego0": 0.003741506732175193, "sim_render-ego1": 0.0036612339162707423, "sim_render-ego2": 0.0036082742216188048, "sim_render-ego3": 0.0035990400179339685, "get_duckie_state": 1.3209302459132365e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.197882456438023, "agent_compute-ego0": 0.013264519487392098, "agent_compute-ego1": 0.012416593835911684, "agent_compute-ego2": 0.01245920505253699, "agent_compute-ego3": 0.011966883193245535, "complete-iteration": 0.731606378047095, "set_robot_commands": 0.002100919704453137, "deviation-center-line": 3.146595912990896, "driven_lanedir_consec": 8.936210791315379, "sim_compute_sim_state": 0.046321727751097413, "sim_compute_performance-ego0": 0.001986459927396115, "sim_compute_performance-ego1": 0.001939264364186969, "sim_compute_performance-ego2": 0.0018953496867869912, "sim_compute_performance-ego3": 0.0018781444412981044}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.248069339355968, "get_ui_image": 0.04769318427372535, "step_physics": 0.5037450641517734, "survival_time": 59.99999999999873, "driven_lanedir": 8.794299074133717, "get_state_dump": 0.009985964463017168, "get_robot_state": 0.014812378164731296, "sim_render-ego0": 0.003936428908602979, "sim_render-ego1": 0.0037975273561120337, "sim_render-ego2": 0.003756519161989846, "sim_render-ego3": 0.003713686400706524, "get_duckie_state": 1.405299851340517e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.665001673722006, "agent_compute-ego0": 0.01372488154459754, "agent_compute-ego1": 0.012214421431885274, "agent_compute-ego2": 0.012821735688589892, "agent_compute-ego3": 0.01276572419642211, "complete-iteration": 0.7052013500842524, "set_robot_commands": 0.0022121116978044216, "deviation-center-line": 3.019908244775759, "driven_lanedir_consec": 8.794299074133717, "sim_compute_sim_state": 0.04513742187239546, "sim_compute_performance-ego0": 0.0020822811682555797, "sim_compute_performance-ego1": 0.002005436339048819, "sim_compute_performance-ego2": 0.001948591275179416, "sim_compute_performance-ego3": 0.0019817247081060987}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 9.5119208082605, "get_ui_image": 0.04769318427372535, "step_physics": 0.5037450641517734, "survival_time": 59.99999999999873, "driven_lanedir": 9.073958255009792, "get_state_dump": 0.009985964463017168, "get_robot_state": 0.014812378164731296, "sim_render-ego0": 0.003936428908602979, "sim_render-ego1": 0.0037975273561120337, "sim_render-ego2": 0.003756519161989846, "sim_render-ego3": 0.003713686400706524, "get_duckie_state": 1.405299851340517e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.895994198082196, "agent_compute-ego0": 0.01372488154459754, "agent_compute-ego1": 0.012214421431885274, "agent_compute-ego2": 0.012821735688589892, "agent_compute-ego3": 0.01276572419642211, "complete-iteration": 0.7052013500842524, "set_robot_commands": 0.0022121116978044216, "deviation-center-line": 2.8146246388783296, "driven_lanedir_consec": 9.073958255009792, "sim_compute_sim_state": 0.04513742187239546, "sim_compute_performance-ego0": 0.0020822811682555797, "sim_compute_performance-ego1": 0.002005436339048819, "sim_compute_performance-ego2": 0.001948591275179416, "sim_compute_performance-ego3": 0.0019817247081060987}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 9.143291556877108, "get_ui_image": 0.04769318427372535, "step_physics": 0.5037450641517734, "survival_time": 59.99999999999873, "driven_lanedir": 8.775830349237314, "get_state_dump": 0.009985964463017168, "get_robot_state": 0.014812378164731296, "sim_render-ego0": 0.003936428908602979, "sim_render-ego1": 0.0037975273561120337, "sim_render-ego2": 0.003756519161989846, "sim_render-ego3": 0.003713686400706524, "get_duckie_state": 1.405299851340517e-06, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 12.357274593223096, "agent_compute-ego0": 0.01372488154459754, "agent_compute-ego1": 0.012214421431885274, "agent_compute-ego2": 0.012821735688589892, "agent_compute-ego3": 0.01276572419642211, "complete-iteration": 0.7052013500842524, "set_robot_commands": 0.0022121116978044216, "deviation-center-line": 3.290427580369817, "driven_lanedir_consec": 8.775830349237314, "sim_compute_sim_state": 0.04513742187239546, "sim_compute_performance-ego0": 0.0020822811682555797, "sim_compute_performance-ego1": 0.002005436339048819, "sim_compute_performance-ego2": 0.001948591275179416, "sim_compute_performance-ego3": 0.0019817247081060987}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 9.910418132183052, "get_ui_image": 0.04769318427372535, "step_physics": 0.5037450641517734, "survival_time": 59.99999999999873, "driven_lanedir": 8.69367146586659, "get_state_dump": 0.009985964463017168, "get_robot_state": 0.014812378164731296, "sim_render-ego0": 0.003936428908602979, "sim_render-ego1": 0.0037975273561120337, "sim_render-ego2": 0.003756519161989846, "sim_render-ego3": 0.003713686400706524, "get_duckie_state": 1.405299851340517e-06, "in-drivable-lane": 2.5500000000000274, "deviation-heading": 14.448349843787875, "agent_compute-ego0": 0.01372488154459754, "agent_compute-ego1": 0.012214421431885274, "agent_compute-ego2": 0.012821735688589892, "agent_compute-ego3": 0.01276572419642211, "complete-iteration": 0.7052013500842524, "set_robot_commands": 0.0022121116978044216, "deviation-center-line": 2.991479897575111, "driven_lanedir_consec": 8.69367146586659, "sim_compute_sim_state": 0.04513742187239546, "sim_compute_performance-ego0": 0.0020822811682555797, "sim_compute_performance-ego1": 0.002005436339048819, "sim_compute_performance-ego2": 0.001948591275179416, "sim_compute_performance-ego3": 0.0019817247081060987}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.1994404939293988, "get_ui_image": 0.029957181141700272, "step_physics": 0.2019840493614291, "survival_time": 8.04999999999998, "driven_lanedir": 1.0701523471111591, "get_state_dump": 0.006404307153489854, "get_robot_state": 0.007108920886192793, "sim_render-ego0": 0.003670325985661259, "sim_render-ego1": 0.0036427179972330728, "get_duckie_state": 1.3628123719015238e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.007343216690023, "agent_compute-ego0": 0.013201235253133893, "agent_compute-ego1": 0.012790384115996183, "complete-iteration": 0.29617044807952125, "set_robot_commands": 0.002152017605157546, "deviation-center-line": 0.40749520111620074, "driven_lanedir_consec": 1.0701523471111591, "sim_compute_sim_state": 0.009168536574752242, "sim_compute_performance-ego0": 0.0018768501870426132, "sim_compute_performance-ego1": 0.0019367153261914663}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.3514147554568967, "get_ui_image": 0.029957181141700272, "step_physics": 0.2019840493614291, "survival_time": 8.04999999999998, "driven_lanedir": 1.3344986018107792, "get_state_dump": 0.006404307153489854, "get_robot_state": 0.007108920886192793, "sim_render-ego0": 0.003670325985661259, "sim_render-ego1": 0.0036427179972330728, "get_duckie_state": 1.3628123719015238e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1045475745701203, "agent_compute-ego0": 0.013201235253133893, "agent_compute-ego1": 0.012790384115996183, "complete-iteration": 0.29617044807952125, "set_robot_commands": 0.002152017605157546, "deviation-center-line": 0.2075314128275519, "driven_lanedir_consec": 1.3344986018107792, "sim_compute_sim_state": 0.009168536574752242, "sim_compute_performance-ego0": 0.0018768501870426132, "sim_compute_performance-ego1": 0.0019367153261914663}}
set_robot_commands_max	0.0022121116978044216
set_robot_commands_mean	0.0021602077569013384
set_robot_commands_median	0.0021716869443183535
set_robot_commands_min	0.002100919704453137
sim_compute_performance-ego0_max	0.0020822811682555797
sim_compute_performance-ego0_mean	0.00198881979138792
sim_compute_performance-ego0_median	0.001986459927396115
sim_compute_performance-ego0_min	0.0018768501870426132
sim_compute_performance-ego1_max	0.002005436339048819
sim_compute_performance-ego1_mean	0.0019589329917336132
sim_compute_performance-ego1_median	0.001943207104736125
sim_compute_performance-ego1_min	0.0019367153261914663
sim_compute_performance-ego2_max	0.001948591275179416
sim_compute_performance-ego2_mean	0.0019226546688540392
sim_compute_performance-ego2_median	0.0019240230445957103
sim_compute_performance-ego2_min	0.0018953496867869912
sim_compute_performance-ego3_max	0.0019817247081060987
sim_compute_performance-ego3_mean	0.0019239357634117428
sim_compute_performance-ego3_median	0.0019119381408310256
sim_compute_performance-ego3_min	0.0018781444412981044
sim_compute_sim_state_max	0.046321727751097413
sim_compute_sim_state_mean	0.03629861948237417
sim_compute_sim_state_median	0.04513742187239546
sim_compute_sim_state_min	0.009168536574752242
sim_render-ego0_max	0.003936428908602979
sim_render-ego0_mean	0.003778929317850256
sim_render-ego0_median	0.003741506732175193
sim_render-ego0_min	0.003670325985661259
sim_render-ego1_max	0.0037975273561120337
sim_render-ego1_mean	0.003699354817064609
sim_render-ego1_median	0.003667621588726822
sim_render-ego1_min	0.0036427179972330728
sim_render-ego2_max	0.003756519161989846
sim_render-ego2_mean	0.0036793342736440335
sim_render-ego2_median	0.0036732094373234502
sim_render-ego2_min	0.0036082742216188048
sim_render-ego3_max	0.003713686400706524
sim_render-ego3_mean	0.003661922570767748
sim_render-ego3_median	0.003673041293662752
sim_render-ego3_min	0.0035990400179339685
simulation-passed	1
step_physics_max	0.5308298512759753
step_physics_mean	0.4573853079116903
step_physics_median	0.5037450641517734
step_physics_min	0.2019840493614291
survival_time_max	59.99999999999873
survival_time_mean	52.57857142857034
survival_time_min	8.04999999999998

No reset possible

57607

10912

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

success

yes

2020-12-03 10:45:06+00:00

2020-12-03 11:15:03+00:00

0:29:57

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	6.957175329448686
survival_time_median	53.92499999999907
deviation-center-line_median	2.124317095276193
in-drivable-lane_median	5.299999999999699

other stats

agent_compute-ego0_max	0.01241386625892855
agent_compute-ego0_mean	0.0119294405877577
agent_compute-ego0_median	0.011914410200665068
agent_compute-ego0_min	0.011475075690772114
complete-iteration_max	0.19723437588776677
complete-iteration_mean	0.1735932027917951
complete-iteration_median	0.1748168763176457
complete-iteration_min	0.14750468264412225
deviation-center-line_max	2.3073905256221487
deviation-center-line_mean	2.0808616506968254
deviation-center-line_min	1.7674218866127671
deviation-heading_max	10.640349499062085
deviation-heading_mean	8.324153763545615
deviation-heading_median	9.102655192241397
deviation-heading_min	4.450955170637587
driven_any_max	9.322412028568394
driven_any_mean	7.950055805953232
driven_any_median	8.01564272856662
driven_any_min	6.446525738111294
driven_lanedir_consec_max	9.124688738084988
driven_lanedir_consec_mean	7.194500319656381
driven_lanedir_consec_min	5.738961881643164
driven_lanedir_max	9.124688738084988
driven_lanedir_mean	7.194500319656381
driven_lanedir_median	6.957175329448686
driven_lanedir_min	5.738961881643164
get_duckie_state_max	1.1592480236020622e-06
get_duckie_state_mean	1.1136215753553306e-06
get_duckie_state_median	1.1248253603384683e-06
get_duckie_state_min	1.0455875571423228e-06
get_robot_state_max	0.003564036347036139
get_robot_state_mean	0.003484134926291112
get_robot_state_median	0.003470953876860851
get_robot_state_min	0.003430595604406606
get_state_dump_max	0.004570868035817351
get_state_dump_mean	0.004344021290481172
get_state_dump_median	0.004304860758731162
get_state_dump_min	0.004195495608645018
get_ui_image_max	0.03588105816328952
get_ui_image_mean	0.030340822075927913
get_ui_image_median	0.03000798205829865
get_ui_image_min	0.025466266023824853
in-drivable-lane_max	7.400000000000093
in-drivable-lane_mean	4.499999999999872
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 6.446525738111294, "get_ui_image": 0.02788025104105106, "step_physics": 0.09436893668415217, "survival_time": 40.59999999999983, "driven_lanedir": 5.738961881643164, "get_state_dump": 0.004570868035817351, "get_robot_state": 0.003564036347036139, "sim_render-ego0": 0.0038120931364953297, "get_duckie_state": 1.1592480236020622e-06, "in-drivable-lane": 5.149999999999707, "deviation-heading": 4.450955170637587, "agent_compute-ego0": 0.01241386625892855, "complete-iteration": 0.16089376224362983, "set_robot_commands": 0.00227410180395673, "deviation-center-line": 1.7674218866127671, "driven_lanedir_consec": 5.738961881643164, "sim_compute_sim_state": 0.009956641097496943, "sim_compute_performance-ego0": 0.00197768445970974}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.322412028568394, "get_ui_image": 0.03588105816328952, "step_physics": 0.12124828970700278, "survival_time": 59.99999999999873, "driven_lanedir": 9.124688738084988, "get_state_dump": 0.004351118224348057, "get_robot_state": 0.0034868838288801894, "sim_render-ego0": 0.0035792034333393436, "get_duckie_state": 1.1053410894567027e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.90639676599926, "agent_compute-ego0": 0.011940119764786974, "complete-iteration": 0.19723437588776677, "set_robot_commands": 0.002051077516350917, "deviation-center-line": 2.3073905256221487, "driven_lanedir_consec": 9.124688738084988, "sim_compute_sim_state": 0.012774347365646936, "sim_compute_performance-ego0": 0.0018504434183773451}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.060729631734629, "get_ui_image": 0.03213571307554623, "step_physics": 0.11670514686122568, "survival_time": 47.84999999999942, "driven_lanedir": 6.20809141780205, "get_state_dump": 0.004258603293114266, "get_robot_state": 0.0034550239248415126, "sim_render-ego0": 0.0035689549057866935, "get_duckie_state": 1.1443096312202342e-06, "in-drivable-lane": 5.44999999999969, "deviation-heading": 8.29891361848353, "agent_compute-ego0": 0.011888700636543162, "complete-iteration": 0.1887399903916616, "set_robot_commands": 0.0020356113577187683, "deviation-center-line": 2.184861907189109, "driven_lanedir_consec": 6.20809141780205, "sim_compute_sim_state": 0.012778687825531453, "sim_compute_performance-ego0": 0.0018436269123021645}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.97055582539861, "get_ui_image": 0.025466266023824853, "step_physics": 0.0896684170563354, "survival_time": 59.99999999999873, "driven_lanedir": 7.706259241095322, "get_state_dump": 0.004195495608645018, "get_robot_state": 0.003430595604406606, "sim_render-ego0": 0.0034998261263527344, "get_duckie_state": 1.0455875571423228e-06, "in-drivable-lane": 7.400000000000093, "deviation-heading": 10.640349499062085, "agent_compute-ego0": 0.011475075690772114, "complete-iteration": 0.14750468264412225, "set_robot_commands": 0.002019680509162287, "deviation-center-line": 2.0637722833632774, "driven_lanedir_consec": 7.706259241095322, "sim_compute_sim_state": 0.005881076450649646, "sim_compute_performance-ego0": 0.0017996731646154247}}
set_robot_commands_max	0.00227410180395673
set_robot_commands_mean	0.0020951177967971756
set_robot_commands_median	0.0020433444370348427
set_robot_commands_min	0.002019680509162287
sim_compute_performance-ego0_max	0.00197768445970974
sim_compute_performance-ego0_mean	0.0018678569887511688
sim_compute_performance-ego0_median	0.0018470351653397548
sim_compute_performance-ego0_min	0.0017996731646154247
sim_compute_sim_state_max	0.012778687825531453
sim_compute_sim_state_mean	0.010347688184831245
sim_compute_sim_state_median	0.01136549423157194
sim_compute_sim_state_min	0.005881076450649646
sim_render-ego0_max	0.0038120931364953297
sim_render-ego0_mean	0.003615019400493525
sim_render-ego0_median	0.0035740791695630185
sim_render-ego0_min	0.0034998261263527344
simulation-passed	1
step_physics_max	0.12124828970700278
step_physics_mean	0.105497697577179
step_physics_median	0.10553704177268892
step_physics_min	0.0896684170563354
survival_time_max	59.99999999999873
survival_time_mean	52.11249999999917
survival_time_min	40.59999999999983

No reset possible

57492

10910

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

success

yes

2020-12-03 10:01:40+00:00

2020-12-03 10:44:55+00:00

0:43:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.2422730096440104
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.012453612241022394
agent_compute-ego0_mean	0.012157020074541027
agent_compute-ego0_median	0.012149715999282468
agent_compute-ego0_min	0.011875036058576776
complete-iteration_max	0.3255780531305953
complete-iteration_mean	0.27313668741770925
complete-iteration_median	0.27692009834921627
complete-iteration_min	0.2131284998418092
deviation-center-line_max	4.053503393024394
deviation-center-line_mean	1.731069028434027
deviation-center-line_min	0.386226701423694
deviation-heading_max	27.859809596736422
deviation-heading_mean	14.925250437835436
deviation-heading_median	14.309269950178932
deviation-heading_min	3.22265225424745
driven_any_max	2.6645352591003757e-13
driven_any_mean	1.9984014443252818e-13
driven_any_median	2.6645352591003757e-13
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	1.168866439425479e-06
get_duckie_state_mean	1.1611242873980342e-06
get_duckie_state_median	1.1625139044286011e-06
get_duckie_state_min	1.1506029013094555e-06
get_robot_state_max	0.00352431772948304
get_robot_state_mean	0.0034989802466145565
get_robot_state_median	0.0035000893595216673
get_robot_state_min	0.0034714245379318504
get_state_dump_max	0.004401484099554083
get_state_dump_mean	0.004328887031834688
get_state_dump_median	0.004327483022342018
get_state_dump_min	0.00425909798310063
get_ui_image_max	0.035196655695881075
get_ui_image_mean	0.030029326851024517
get_ui_image_median	0.029788838735131003
get_ui_image_min	0.025342974237954983
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02754487919866989, "step_physics": 0.19520119207288503, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00425909798310063, "get_robot_state": 0.00352431772948304, "sim_render-ego0": 0.0035995287660952908, "get_duckie_state": 1.1567569195876808e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012453612241022394, "complete-iteration": 0.25898246880276415, "set_robot_commands": 0.002199583506206986, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008280818408772312, "sim_compute_performance-ego0": 0.001849821465497807}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035196655695881075, "step_physics": 0.2515297803553217, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004315963097158618, "get_robot_state": 0.0034714245379318504, "sim_render-ego0": 0.003592790910147509, "get_duckie_state": 1.1506029013094555e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012265816814794233, "complete-iteration": 0.3255780531305953, "set_robot_commands": 0.0020376768437750034, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011263362970280707, "sim_compute_performance-ego0": 0.0018313776742012477}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03203279827159211, "step_physics": 0.22675272844713196, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004339002947525418, "get_robot_state": 0.0034903407990188027, "sim_render-ego0": 0.0035805658535794553, "get_duckie_state": 1.1682708892695215e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012033615183770706, "complete-iteration": 0.2948577278956684, "set_robot_commands": 0.002081577227971238, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00862771386806415, "sim_compute_performance-ego0": 0.001845107686013405}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025342974237954983, "step_physics": 0.15444532739034203, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004401484099554083, "get_robot_state": 0.003509837920024532, "sim_render-ego0": 0.0035932800553422684, "get_duckie_state": 1.168866439425479e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011875036058576776, "complete-iteration": 0.2131284998418092, "set_robot_commands": 0.0021112024734458957, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0059056837890269255, "sim_compute_performance-ego0": 0.001867853136086444}}
set_robot_commands_max	0.002199583506206986
set_robot_commands_mean	0.002107510012849781
set_robot_commands_median	0.0020963898507085667
set_robot_commands_min	0.0020376768437750034
sim_compute_performance-ego0_max	0.001867853136086444
sim_compute_performance-ego0_mean	0.001848539990449726
sim_compute_performance-ego0_median	0.001847464575755606
sim_compute_performance-ego0_min	0.0018313776742012477
sim_compute_sim_state_max	0.011263362970280707
sim_compute_sim_state_mean	0.008519394759036023
sim_compute_sim_state_median	0.00845426613841823
sim_compute_sim_state_min	0.0059056837890269255
sim_render-ego0_max	0.0035995287660952908
sim_render-ego0_mean	0.003591541396291131
sim_render-ego0_median	0.003593035482744889
sim_render-ego0_min	0.0035805658535794553
simulation-passed	1
step_physics_max	0.2515297803553217
step_physics_mean	0.20698225706642015
step_physics_median	0.2109769602600085
step_physics_min	0.15444532739034203
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57477

11278

template-pytorch

LFv-sim

failed

yes

2020-12-03 09:57:05+00:00

2020-12-03 09:57:50+00:00

0:00:45

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 66, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 89, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57466

11278

template-pytorch

LFv-sim

failed

yes

2020-12-03 09:55:15+00:00

2020-12-03 09:56:36+00:00

0:01:21

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 66, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 89, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

57286

11281

template-pytorch

LFv-sim

success

yes

2020-12-03 09:15:46+00:00

2020-12-03 09:54:47+00:00

0:39:01

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.1168505853455444
survival_time_median	59.99999999999873
deviation-center-line_median	2.2273771248073544
in-drivable-lane_median	30.424999999999265

other stats

agent_compute-ego0_max	0.012656557669151237
agent_compute-ego0_mean	0.01223416635138506
agent_compute-ego0_median	0.012097404362458573
agent_compute-ego0_min	0.012085299011471866
complete-iteration_max	0.21580314914153875
complete-iteration_mean	0.1854309587554074
complete-iteration_median	0.18252189014476103
complete-iteration_min	0.16087690559056875
deviation-center-line_max	2.8832603040844913
deviation-center-line_mean	2.280682217037345
deviation-center-line_min	1.7847143144501805
deviation-heading_max	24.65649933168261
deviation-heading_mean	20.921325306955584
deviation-heading_median	22.438032176300908
deviation-heading_min	14.15273754353791
driven_any_max	3.5237768448061355
driven_any_mean	3.3105398840713876
driven_any_median	3.2861036757417423
driven_any_min	3.1461753399959305
driven_lanedir_consec_max	1.2098091679720795
driven_lanedir_consec_mean	1.1139997100546066
driven_lanedir_consec_min	1.0124885015552585
driven_lanedir_max	1.2098091679720795
driven_lanedir_mean	1.1139997100546066
driven_lanedir_median	1.1168505853455444
driven_lanedir_min	1.0124885015552585
get_duckie_state_max	1.2977037898309026e-06
get_duckie_state_mean	1.1974032177317648e-06
get_duckie_state_median	1.1802811507479932e-06
get_duckie_state_min	1.1313467796001703e-06
get_robot_state_max	0.003514529465636445
get_robot_state_mean	0.003488131804231998
get_robot_state_median	0.0034908471159097254
get_robot_state_min	0.003456303519472095
get_state_dump_max	0.004503950489053718
get_state_dump_mean	0.00434269143778716
get_state_dump_median	0.004309118339957842
get_state_dump_min	0.004248578582179238
get_ui_image_max	0.03566444069023037
get_ui_image_mean	0.03051164560175061
get_ui_image_median	0.030337983523677725
get_ui_image_min	0.02570617466941662
in-drivable-lane_max	35.69999999999921
in-drivable-lane_mean	31.074999999999264
in-drivable-lane_min	27.74999999999931
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.5237768448061355, "get_ui_image": 0.02818243231602652, "step_physics": 0.107420926685635, "survival_time": 59.99999999999873, "driven_lanedir": 1.1041147780236664, "get_state_dump": 0.004248578582179238, "get_robot_state": 0.003514529465636445, "sim_render-ego0": 0.0036103624189823096, "get_duckie_state": 1.1313467796001703e-06, "in-drivable-lane": 32.24999999999917, "deviation-heading": 21.014146472722032, "agent_compute-ego0": 0.012085299011471866, "complete-iteration": 0.171483513318331, "set_robot_commands": 0.002119328556807214, "deviation-center-line": 2.47774098693569, "driven_lanedir_consec": 1.1041147780236664, "sim_compute_sim_state": 0.008367524357461412, "sim_compute_performance-ego0": 0.0018660480235637377}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.4068005848290643, "get_ui_image": 0.03566444069023037, "step_physics": 0.14079839720714102, "survival_time": 59.99999999999873, "driven_lanedir": 1.2098091679720795, "get_state_dump": 0.004367055543554911, "get_robot_state": 0.0034725783171006583, "sim_render-ego0": 0.0035437277016492808, "get_duckie_state": 1.163903521459168e-06, "in-drivable-lane": 27.74999999999931, "deviation-heading": 24.65649933168261, "agent_compute-ego0": 0.012656557669151237, "complete-iteration": 0.21580314914153875, "set_robot_commands": 0.0020614915048947045, "deviation-center-line": 1.7847143144501805, "driven_lanedir_consec": 1.2098091679720795, "sim_compute_sim_state": 0.011341553544323212, "sim_compute_performance-ego0": 0.0018274651081933268}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.1461753399959305, "get_ui_image": 0.03249353473132893, "step_physics": 0.12474494373470818, "survival_time": 59.99999999999873, "driven_lanedir": 1.0124885015552585, "get_state_dump": 0.004251181136360772, "get_robot_state": 0.003456303519472095, "sim_render-ego0": 0.0035438724203371783, "get_duckie_state": 1.1966587800368185e-06, "in-drivable-lane": 35.69999999999921, "deviation-heading": 14.15273754353791, "agent_compute-ego0": 0.01209805728394622, "complete-iteration": 0.1935602669711911, "set_robot_commands": 0.002004495369802407, "deviation-center-line": 2.8832603040844913, "driven_lanedir_consec": 1.0124885015552585, "sim_compute_sim_state": 0.009088639514233846, "sim_compute_performance-ego0": 0.0018107134734065603}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.1654067666544203, "get_ui_image": 0.02570617466941662, "step_physics": 0.10155614428873562, "survival_time": 59.99999999999873, "driven_lanedir": 1.129586392667422, "get_state_dump": 0.004503950489053718, "get_robot_state": 0.003509115914718793, "sim_render-ego0": 0.003574649459813457, "get_duckie_state": 1.2977037898309026e-06, "in-drivable-lane": 28.599999999999365, "deviation-heading": 23.861917879879787, "agent_compute-ego0": 0.012096751440970924, "complete-iteration": 0.16087690559056875, "set_robot_commands": 0.002041957856812743, "deviation-center-line": 1.977013262679019, "driven_lanedir_consec": 1.129586392667422, "sim_compute_sim_state": 0.00597689630189208, "sim_compute_performance-ego0": 0.0018395597392772255}}
set_robot_commands_max	0.002119328556807214
set_robot_commands_mean	0.002056818322079267
set_robot_commands_median	0.0020517246808537237
set_robot_commands_min	0.002004495369802407
sim_compute_performance-ego0_max	0.0018660480235637377
sim_compute_performance-ego0_mean	0.0018359465861102129
sim_compute_performance-ego0_median	0.0018335124237352765
sim_compute_performance-ego0_min	0.0018107134734065603
sim_compute_sim_state_max	0.011341553544323212
sim_compute_sim_state_mean	0.008693653429477637
sim_compute_sim_state_median	0.008728081935847629
sim_compute_sim_state_min	0.00597689630189208
sim_render-ego0_max	0.0036103624189823096
sim_render-ego0_mean	0.0035681530001955564
sim_render-ego0_median	0.003559260940075318
sim_render-ego0_min	0.0035437277016492808
simulation-passed	1
step_physics_max	0.14079839720714102
step_physics_mean	0.11863010297905496
step_physics_median	0.1160829352101716
step_physics_min	0.10155614428873562
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57083

11281

template-pytorch

LFv-sim

success

yes

2020-12-03 08:27:42+00:00

2020-12-03 09:10:28+00:00

0:42:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.564261803227275
survival_time_median	59.99999999999873
deviation-center-line_median	4.116087882833963
in-drivable-lane_median	19.024999999999466

other stats

agent_compute-ego0_max	0.030925366404054563
agent_compute-ego0_mean	0.021498603288775973
agent_compute-ego0_median	0.021272877074598177
agent_compute-ego0_min	0.01252329260185299
complete-iteration_max	0.32316372078920186
complete-iteration_mean	0.2669965986109693
complete-iteration_median	0.261564970711288
complete-iteration_min	0.22169273223209937
deviation-center-line_max	5.390842116865975
deviation-center-line_mean	4.107575186034575
deviation-center-line_min	2.807282861604399
deviation-heading_max	30.51535666628356
deviation-heading_mean	28.01206941788994
deviation-heading_median	27.953669273569552
deviation-heading_min	25.625582458137103
driven_any_max	5.777164930950149
driven_any_mean	5.647849263544634
driven_any_median	5.708993566859793
driven_any_min	5.3962449895088
driven_lanedir_consec_max	1.81848959788875
driven_lanedir_consec_mean	1.400262508397973
driven_lanedir_consec_min	0.6540368292485921
driven_lanedir_max	3.215274781310497
driven_lanedir_mean	2.738783882338629
driven_lanedir_median	2.766194526031875
driven_lanedir_min	2.2074716959802676
get_duckie_state_max	1.1768071081715757e-06
get_duckie_state_mean	1.1514962265433915e-06
get_duckie_state_median	1.1522902934180012e-06
get_duckie_state_min	1.124597211165988e-06
get_robot_state_max	0.0035771982159642354
get_robot_state_mean	0.003514332140018104
get_robot_state_median	0.0034984482218085675
get_robot_state_min	0.003483233900491046
get_state_dump_max	0.004445659826439088
get_state_dump_mean	0.004379960172480091
get_state_dump_median	0.004379296580718816
get_state_dump_min	0.004315587702043646
get_ui_image_max	0.03501762577536501
get_ui_image_mean	0.029971096636750717
get_ui_image_median	0.02994417479195067
get_ui_image_min	0.024978411187736516
in-drivable-lane_max	24.59999999999929
in-drivable-lane_mean	19.137499999999505
in-drivable-lane_min	13.89999999999981
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 5.777164930950149, "get_ui_image": 0.027939274944334007, "step_physics": 0.1809037307418455, "survival_time": 59.99999999999873, "driven_lanedir": 2.68691475022605, "get_state_dump": 0.004328728317718125, "get_robot_state": 0.0035771982159642354, "sim_render-ego0": 0.003554257226923324, "get_duckie_state": 1.124597211165988e-06, "in-drivable-lane": 19.849999999999365, "deviation-heading": 27.9701854183618, "agent_compute-ego0": 0.01252329260185299, "complete-iteration": 0.24524207893358876, "set_robot_commands": 0.002137510504551871, "deviation-center-line": 3.8924215500488337, "driven_lanedir_consec": 1.81848959788875, "sim_compute_sim_state": 0.008333708225539284, "sim_compute_performance-ego0": 0.001871131044144833}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.3962449895088, "get_ui_image": 0.03501762577536501, "step_physics": 0.230448266647936, "survival_time": 59.99999999999873, "driven_lanedir": 2.2074716959802676, "get_state_dump": 0.004445659826439088, "get_robot_state": 0.0034925981326265993, "sim_render-ego0": 0.003543648691995257, "get_duckie_state": 1.1575509864622905e-06, "in-drivable-lane": 24.59999999999929, "deviation-heading": 25.625582458137103, "agent_compute-ego0": 0.030925366404054563, "complete-iteration": 0.32316372078920186, "set_robot_commands": 0.002085379418683588, "deviation-center-line": 2.807282861604399, "driven_lanedir_consec": 0.6540368292485921, "sim_compute_sim_state": 0.011281774204835409, "sim_compute_performance-ego0": 0.0018487953325790928}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.660012884943214, "get_ui_image": 0.03194907463956733, "step_physics": 0.20880854020607065, "survival_time": 59.99999999999873, "driven_lanedir": 2.845474301837701, "get_state_dump": 0.004315587702043646, "get_robot_state": 0.003483233900491046, "sim_render-ego0": 0.0035076516554020127, "get_duckie_state": 1.1768071081715757e-06, "in-drivable-lane": 18.19999999999957, "deviation-heading": 27.937153128777307, "agent_compute-ego0": 0.013269159418657162, "complete-iteration": 0.2778878624889872, "set_robot_commands": 0.0020647356651109223, "deviation-center-line": 4.3397542156190925, "driven_lanedir_consec": 1.3940096056358928, "sim_compute_sim_state": 0.008580435126349888, "sim_compute_performance-ego0": 0.0018349595113558931}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.757974248776373, "get_ui_image": 0.024978411187736516, "step_physics": 0.14611088147667622, "survival_time": 59.99999999999873, "driven_lanedir": 3.215274781310497, "get_state_dump": 0.004429864843719508, "get_robot_state": 0.003504298310990536, "sim_render-ego0": 0.0035243629912948926, "get_duckie_state": 1.147029600373712e-06, "in-drivable-lane": 13.89999999999981, "deviation-heading": 30.51535666628356, "agent_compute-ego0": 0.029276594730539188, "complete-iteration": 0.22169273223209937, "set_robot_commands": 0.0020957233308256914, "deviation-center-line": 5.390842116865975, "driven_lanedir_consec": 1.7345140008186573, "sim_compute_sim_state": 0.00585607962247037, "sim_compute_performance-ego0": 0.0018420068548680544}}
set_robot_commands_max	0.002137510504551871
set_robot_commands_mean	0.002095837229793018
set_robot_commands_median	0.0020905513747546396
set_robot_commands_min	0.0020647356651109223
sim_compute_performance-ego0_max	0.001871131044144833
sim_compute_performance-ego0_mean	0.0018492231857369684
sim_compute_performance-ego0_median	0.0018454010937235736
sim_compute_performance-ego0_min	0.0018349595113558931
sim_compute_sim_state_max	0.011281774204835409
sim_compute_sim_state_mean	0.008512999294798738
sim_compute_sim_state_median	0.008457071675944585
sim_compute_sim_state_min	0.00585607962247037
sim_render-ego0_max	0.003554257226923324
sim_render-ego0_mean	0.003532480141403871
sim_render-ego0_median	0.0035340058416450746
sim_render-ego0_min	0.0035076516554020127
simulation-passed	1
step_physics_max	0.230448266647936
step_physics_mean	0.1915678547681321
step_physics_median	0.19485613547395808
step_physics_min	0.14611088147667622
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

57008

11285

template-pytorch

LFv-sim

success

yes

2020-12-03 08:13:54+00:00

2020-12-03 08:26:23+00:00

0:12:29

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4265649265651074
survival_time_median	16.950000000000106
deviation-center-line_median	0.478673839855124
in-drivable-lane_median	11.175000000000118

other stats

agent_compute-ego0_max	0.013401612172143385
agent_compute-ego0_mean	0.012724247939555651
agent_compute-ego0_median	0.012622783296796296
agent_compute-ego0_min	0.012249812992486628
complete-iteration_max	0.2086722386347783
complete-iteration_mean	0.15954060714348106
complete-iteration_median	0.15119503383817584
complete-iteration_min	0.12710012226279432
deviation-center-line_max	3.2492533173428466
deviation-center-line_mean	1.0831984912295518
deviation-center-line_min	0.12619296786511316
deviation-heading_max	12.289315120675708
deviation-heading_mean	4.451009207377777
deviation-heading_median	2.2721153746826954
deviation-heading_min	0.9704909594700092
driven_any_max	5.722263251901193
driven_any_mean	2.138445521921884
driven_any_median	1.2634952091283755
driven_any_min	0.30452841752959137
driven_lanedir_consec_max	3.387784313302375
driven_lanedir_consec_mean	1.0966298420655072
driven_lanedir_consec_min	0.1456052018294378
driven_lanedir_max	3.387784313302375
driven_lanedir_mean	1.0966298420655072
driven_lanedir_median	0.4265649265651074
driven_lanedir_min	0.1456052018294378
get_duckie_state_max	1.1829549011868467e-06
get_duckie_state_mean	1.124433420684774e-06
get_duckie_state_median	1.1226159111882686e-06
get_duckie_state_min	1.0695469591757118e-06
get_robot_state_max	0.003555371257791689
get_robot_state_mean	0.003492894592304252
get_robot_state_median	0.0034770006464371244
get_robot_state_min	0.0034622058185510693
get_state_dump_max	0.004381694860159312
get_state_dump_mean	0.004309205451090144
get_state_dump_median	0.0042984157944727965
get_state_dump_min	0.004258295355255671
get_ui_image_max	0.0352043021808971
get_ui_image_mean	0.02975510768228383
get_ui_image_median	0.029509198576733245
get_ui_image_min	0.024797731394771733
in-drivable-lane_max	21.599999999999618
in-drivable-lane_mean	11.46249999999996
in-drivable-lane_min	1.8999999999999937
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.2764407349327054, "get_ui_image": 0.02730175799692557, "step_physics": 0.07493151174550142, "survival_time": 19.600000000000144, "driven_lanedir": 0.5483695032752229, "get_state_dump": 0.004258295355255671, "get_robot_state": 0.003555371257791689, "sim_render-ego0": 0.003665463008346752, "get_duckie_state": 1.0695469591757118e-06, "in-drivable-lane": 11.750000000000163, "deviation-heading": 3.303146008130278, "agent_compute-ego0": 0.012740979667838293, "complete-iteration": 0.13905978020820908, "set_robot_commands": 0.002136829245181484, "deviation-center-line": 0.7231580278878754, "driven_lanedir_consec": 0.5483695032752229, "sim_compute_sim_state": 0.008494555495167507, "sim_compute_performance-ego0": 0.0019002694816686425}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30452841752959137, "get_ui_image": 0.0352043021808971, "step_physics": 0.13581584955190684, "survival_time": 3.7999999999999945, "driven_lanedir": 0.1456052018294378, "get_state_dump": 0.004328644120848024, "get_robot_state": 0.0034658103794246524, "sim_render-ego0": 0.0036449215628884058, "get_duckie_state": 1.1456477177607549e-06, "in-drivable-lane": 1.8999999999999937, "deviation-heading": 1.2410847412351127, "agent_compute-ego0": 0.0125045869257543, "complete-iteration": 0.2086722386347783, "set_robot_commands": 0.0020538398197719027, "deviation-center-line": 0.12619296786511316, "driven_lanedir_consec": 0.1456052018294378, "sim_compute_sim_state": 0.009751149586268834, "sim_compute_performance-ego0": 0.0018268219836346516}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.2505496833240457, "get_ui_image": 0.031716639156540924, "step_physics": 0.09320328792213148, "survival_time": 14.300000000000068, "driven_lanedir": 0.304760349854992, "get_state_dump": 0.004381694860159312, "get_robot_state": 0.0034881909134495963, "sim_render-ego0": 0.00371654523789675, "get_duckie_state": 1.1829549011868467e-06, "in-drivable-lane": 10.600000000000072, "deviation-heading": 0.9704909594700092, "agent_compute-ego0": 0.013401612172143385, "complete-iteration": 0.16333028746814263, "set_robot_commands": 0.002118194560140683, "deviation-center-line": 0.23418965182237267, "driven_lanedir_consec": 0.304760349854992, "sim_compute_sim_state": 0.009340287085609567, "sim_compute_performance-ego0": 0.0018854033240873224}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.722263251901193, "get_ui_image": 0.024797731394771733, "step_physics": 0.06868182570610713, "survival_time": 59.99999999999873, "driven_lanedir": 3.387784313302375, "get_state_dump": 0.004268187468097569, "get_robot_state": 0.0034622058185510693, "sim_render-ego0": 0.0035520475373280037, "get_duckie_state": 1.0995841046157823e-06, "in-drivable-lane": 21.599999999999618, "deviation-heading": 12.289315120675708, "agent_compute-ego0": 0.012249812992486628, "complete-iteration": 0.12710012226279432, "set_robot_commands": 0.002049868351017605, "deviation-center-line": 3.2492533173428466, "driven_lanedir_consec": 3.387784313302375, "sim_compute_sim_state": 0.006122577001808288, "sim_compute_performance-ego0": 0.0018400756842290036}}
set_robot_commands_max	0.002136829245181484
set_robot_commands_mean	0.002089682994027919
set_robot_commands_median	0.002086017189956293
set_robot_commands_min	0.002049868351017605
sim_compute_performance-ego0_max	0.0019002694816686425
sim_compute_performance-ego0_mean	0.001863142618404905
sim_compute_performance-ego0_median	0.001862739504158163
sim_compute_performance-ego0_min	0.0018268219836346516
sim_compute_sim_state_max	0.009751149586268834
sim_compute_sim_state_mean	0.008427142292213549
sim_compute_sim_state_median	0.008917421290388538
sim_compute_sim_state_min	0.006122577001808288
sim_render-ego0_max	0.00371654523789675
sim_render-ego0_mean	0.0036447443366149778
sim_render-ego0_median	0.0036551922856175784
sim_render-ego0_min	0.0035520475373280037
simulation-passed	1
step_physics_max	0.13581584955190684
step_physics_mean	0.09315811873141172
step_physics_median	0.08406739983381645
step_physics_min	0.06868182570610713
survival_time_max	59.99999999999873
survival_time_mean	24.424999999999734
survival_time_min	3.7999999999999945

No reset possible

56946

11286

template-pytorch

LFv-sim

success

yes

2020-12-03 07:58:31+00:00

2020-12-03 08:12:46+00:00

0:14:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5565854421252486
survival_time_median	27.675000000000168
deviation-center-line_median	0.4330049078260399
in-drivable-lane_median	21.025000000000155

other stats

agent_compute-ego0_max	0.01221040262393975
agent_compute-ego0_mean	0.011849708558440933
agent_compute-ego0_median	0.012018434559028566
agent_compute-ego0_min	0.01115156249176684
complete-iteration_max	0.1591306689390942
complete-iteration_mean	0.1440391021149476
complete-iteration_median	0.1459944389178639
complete-iteration_min	0.12503686168496844
deviation-center-line_max	0.5734485913425701
deviation-center-line_mean	0.4262521116534147
deviation-center-line_min	0.26555003961900914
deviation-heading_max	4.942655856484083
deviation-heading_mean	3.2204821510201103
deviation-heading_median	3.173814389438089
deviation-heading_min	1.5916439687201818
driven_any_max	4.087956933494294
driven_any_mean	2.6779304786407208
driven_any_median	2.4365875585524117
driven_any_min	1.750589863963768
driven_lanedir_consec_max	0.6952958604879392
driven_lanedir_consec_mean	0.5513309010284025
driven_lanedir_consec_min	0.3968568593751737
driven_lanedir_max	0.6952958604879392
driven_lanedir_mean	0.5513309010284025
driven_lanedir_median	0.5565854421252486
driven_lanedir_min	0.3968568593751737
get_duckie_state_max	1.115950545823643e-06
get_duckie_state_mean	1.096351284210643e-06
get_duckie_state_median	1.0980986441147252e-06
get_duckie_state_min	1.0732573027894788e-06
get_robot_state_max	0.0034907735841122668
get_robot_state_mean	0.0034278188054393663
get_robot_state_median	0.0034143742339175307
get_robot_state_min	0.003391753169810137
get_state_dump_max	0.004281773388041237
get_state_dump_mean	0.004192778718287628
get_state_dump_median	0.004182339456003066
get_state_dump_min	0.004124662573103138
get_ui_image_max	0.03506270770368905
get_ui_image_mean	0.03015692103323268
get_ui_image_median	0.030117521482714613
get_ui_image_min	0.02532993346381245
in-drivable-lane_max	31.249999999999975
in-drivable-lane_mean	21.162500000000097
in-drivable-lane_min	11.3500000000001
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.1049884692673477, "get_ui_image": 0.028224406559343284, "step_physics": 0.07765676417102703, "survival_time": 34.550000000000175, "driven_lanedir": 0.3968568593751737, "get_state_dump": 0.004281773388041237, "get_robot_state": 0.0034907735841122668, "sim_render-ego0": 0.003610839733498634, "get_duckie_state": 1.115950545823643e-06, "in-drivable-lane": 29.20000000000013, "deviation-heading": 3.353396772835354, "agent_compute-ego0": 0.012058887867569234, "complete-iteration": 0.14348508512353622, "set_robot_commands": 0.002051234589835812, "deviation-center-line": 0.5734485913425701, "driven_lanedir_consec": 0.3968568593751737, "sim_compute_sim_state": 0.01017648532900507, "sim_compute_performance-ego0": 0.00186592133748049}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.750589863963768, "get_ui_image": 0.03506270770368905, "step_physics": 0.08750688244930255, "survival_time": 15.900000000000093, "driven_lanedir": 0.4296820689262684, "get_state_dump": 0.004131176628662875, "get_robot_state": 0.003391753169810137, "sim_render-ego0": 0.0035139864141290836, "get_duckie_state": 1.0732573027894788e-06, "in-drivable-lane": 11.3500000000001, "deviation-heading": 2.9942320060408236, "agent_compute-ego0": 0.011977981250487898, "complete-iteration": 0.1591306689390942, "set_robot_commands": 0.001975074457150642, "deviation-center-line": 0.382713479826542, "driven_lanedir_consec": 0.4296820689262684, "sim_compute_sim_state": 0.009720199160441336, "sim_compute_performance-ego0": 0.0017854173355341704}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.087956933494294, "get_ui_image": 0.03201063640608594, "step_physics": 0.07839070795202667, "survival_time": 40.49999999999984, "driven_lanedir": 0.6952958604879392, "get_state_dump": 0.004233502283343258, "get_robot_state": 0.0034235188170220203, "sim_render-ego0": 0.003607976598304533, "get_duckie_state": 1.1030166569532214e-06, "in-drivable-lane": 31.249999999999975, "deviation-heading": 4.942655856484083, "agent_compute-ego0": 0.01221040262393975, "complete-iteration": 0.1485037927121916, "set_robot_commands": 0.0019828829312589107, "deviation-center-line": 0.4832963358255379, "driven_lanedir_consec": 0.6952958604879392, "sim_compute_sim_state": 0.01077965978629492, "sim_compute_performance-ego0": 0.001799173919546031}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7681866478374753, "get_ui_image": 0.02532993346381245, "step_physics": 0.06878706591306545, "survival_time": 20.80000000000016, "driven_lanedir": 0.6834888153242289, "get_state_dump": 0.004124662573103138, "get_robot_state": 0.003405229650813041, "sim_render-ego0": 0.003474788985949912, "get_duckie_state": 1.093180631276229e-06, "in-drivable-lane": 12.85000000000018, "deviation-heading": 1.5916439687201818, "agent_compute-ego0": 0.01115156249176684, "complete-iteration": 0.12503686168496844, "set_robot_commands": 0.0019882662976674326, "deviation-center-line": 0.26555003961900914, "driven_lanedir_consec": 0.6834888153242289, "sim_compute_sim_state": 0.004910746924311137, "sim_compute_performance-ego0": 0.001798017991246651}}
set_robot_commands_max	0.002051234589835812
set_robot_commands_mean	0.0019993645689781996
set_robot_commands_median	0.0019855746144631717
set_robot_commands_min	0.001975074457150642
sim_compute_performance-ego0_max	0.00186592133748049
sim_compute_performance-ego0_mean	0.0018121326459518356
sim_compute_performance-ego0_median	0.001798595955396341
sim_compute_performance-ego0_min	0.0017854173355341704
sim_compute_sim_state_max	0.01077965978629492
sim_compute_sim_state_mean	0.008896772800013115
sim_compute_sim_state_median	0.009948342244723202
sim_compute_sim_state_min	0.004910746924311137
sim_render-ego0_max	0.003610839733498634
sim_render-ego0_mean	0.0035518979329705403
sim_render-ego0_median	0.003560981506216808
sim_render-ego0_min	0.003474788985949912
simulation-passed	1
step_physics_max	0.08750688244930255
step_physics_mean	0.07808535512135542
step_physics_median	0.07802373606152685
step_physics_min	0.06878706591306545
survival_time_max	40.49999999999984
survival_time_mean	27.937500000000064
survival_time_min	15.900000000000093

No reset possible

56864

11289

template-pytorch

LFv-sim

success

yes

2020-12-03 07:41:51+00:00

2020-12-03 07:56:55+00:00

0:15:04

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.42368231456898464
survival_time_median	4.749999999999991
deviation-center-line_median	0.127204436172341
in-drivable-lane_median	3.0749999999999904

other stats

agent_compute-ego0_max	0.013698178894665776
agent_compute-ego0_mean	0.012819624534218177
agent_compute-ego0_median	0.01290730039106196
agent_compute-ego0_min	0.011765718460083008
complete-iteration_max	0.26351008659754044
complete-iteration_mean	0.21306208466892385
complete-iteration_median	0.2137317518488097
complete-iteration_min	0.16127474838053554
deviation-center-line_max	4.0556283463320515
deviation-center-line_mean	1.0898962912781809
deviation-center-line_min	0.049547946435989254
deviation-heading_max	15.5627057501695
deviation-heading_mean	4.297901705763713
deviation-heading_median	0.661990675102742
deviation-heading_min	0.3049197226798702
driven_any_max	20.844249511734684
driven_any_mean	5.934368111820029
driven_any_median	1.296214773932241
driven_any_min	0.30079338768095215
driven_lanedir_consec_max	15.671292207571785
driven_lanedir_consec_mean	4.166651709314932
driven_lanedir_consec_min	0.14795000054997276
driven_lanedir_max	15.671292207571785
driven_lanedir_mean	4.166651709314932
driven_lanedir_median	0.42368231456898464
driven_lanedir_min	0.14795000054997276
get_duckie_state_max	1.2546256618833264e-06
get_duckie_state_mean	1.1821898664423837e-06
get_duckie_state_median	1.1807568840394578e-06
get_duckie_state_min	1.1126200358072915e-06
get_robot_state_max	0.003651536240869639
get_robot_state_mean	0.003571265381457056
get_robot_state_median	0.003561002376248636
get_robot_state_min	0.003511520532461313
get_state_dump_max	0.004554586207613032
get_state_dump_mean	0.004468858646774611
get_state_dump_median	0.004458063131776524
get_state_dump_min	0.004404722115932367
get_ui_image_max	0.03538986352773813
get_ui_image_mean	0.03048141381619742
get_ui_image_median	0.03050099377315354
get_ui_image_min	0.02553380419074447
in-drivable-lane_max	11.399999999999842
in-drivable-lane_mean	4.637499999999956
in-drivable-lane_min	1.0000000000000009
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.331155144104765, "get_ui_image": 0.02772487669574971, "step_physics": 0.12969375873098568, "survival_time": 4.849999999999991, "driven_lanedir": 0.5345941398733602, "get_state_dump": 0.004459646283363809, "get_robot_state": 0.003651536240869639, "sim_render-ego0": 0.003612798087450923, "get_duckie_state": 1.1288389867665816e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.7655031264836807, "agent_compute-ego0": 0.013698178894665776, "complete-iteration": 0.1950151895990177, "set_robot_commands": 0.0021564035999531647, "deviation-center-line": 0.17674022093630012, "driven_lanedir_consec": 0.5345941398733602, "sim_compute_sim_state": 0.008018440129805585, "sim_compute_performance-ego0": 0.001927638540462572}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30079338768095215, "get_ui_image": 0.03538986352773813, "step_physics": 0.1926744167621319, "survival_time": 1.900000000000001, "driven_lanedir": 0.14795000054997276, "get_state_dump": 0.004404722115932367, "get_robot_state": 0.003511520532461313, "sim_render-ego0": 0.0036564178955860623, "get_duckie_state": 1.1126200358072915e-06, "in-drivable-lane": 1.0000000000000009, "deviation-heading": 0.5584782237218034, "agent_compute-ego0": 0.011765718460083008, "complete-iteration": 0.26351008659754044, "set_robot_commands": 0.0020896226931840945, "deviation-center-line": 0.049547946435989254, "driven_lanedir_consec": 0.14795000054997276, "sim_compute_sim_state": 0.008098455575796274, "sim_compute_performance-ego0": 0.0018480313129914112}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.2612744037597166, "get_ui_image": 0.033277110850557366, "step_physics": 0.16124458008624137, "survival_time": 4.6499999999999915, "driven_lanedir": 0.31277048926460904, "get_state_dump": 0.004554586207613032, "get_robot_state": 0.0035671452258495572, "sim_render-ego0": 0.003717069930218635, "get_duckie_state": 1.2326747813123338e-06, "in-drivable-lane": 3.3499999999999908, "deviation-heading": 0.3049197226798702, "agent_compute-ego0": 0.013264323802704509, "complete-iteration": 0.23244831409860164, "set_robot_commands": 0.002173423767089844, "deviation-center-line": 0.07766865140838188, "driven_lanedir_consec": 0.31277048926460904, "sim_compute_sim_state": 0.008658639928127857, "sim_compute_performance-ego0": 0.0019150515820117709}, "LF-norm-small_loop-000-ego0": {"driven_any": 20.844249511734684, "get_ui_image": 0.02553380419074447, "step_physics": 0.10111547151671955, "survival_time": 59.99999999999873, "driven_lanedir": 15.671292207571785, "get_state_dump": 0.004456479980189238, "get_robot_state": 0.0035548595266477155, "sim_render-ego0": 0.003673701957302427, "get_duckie_state": 1.2546256618833264e-06, "in-drivable-lane": 11.399999999999842, "deviation-heading": 15.5627057501695, "agent_compute-ego0": 0.012550276979419413, "complete-iteration": 0.16127474838053554, "set_robot_commands": 0.0022259105949179515, "deviation-center-line": 4.0556283463320515, "driven_lanedir_consec": 15.671292207571785, "sim_compute_sim_state": 0.0061594899945413934, "sim_compute_performance-ego0": 0.001929828070482545}}
set_robot_commands_max	0.0022259105949179515
set_robot_commands_mean	0.0021613401637862635
set_robot_commands_median	0.002164913683521504
set_robot_commands_min	0.0020896226931840945
sim_compute_performance-ego0_max	0.001929828070482545
sim_compute_performance-ego0_mean	0.0019051373764870747
sim_compute_performance-ego0_median	0.0019213450612371712
sim_compute_performance-ego0_min	0.0018480313129914112
sim_compute_sim_state_max	0.008658639928127857
sim_compute_sim_state_mean	0.007733756407067777
sim_compute_sim_state_median	0.00805844785280093
sim_compute_sim_state_min	0.0061594899945413934
sim_render-ego0_max	0.003717069930218635
sim_render-ego0_mean	0.003664996967639512
sim_render-ego0_median	0.003665059926444245
sim_render-ego0_min	0.003612798087450923
simulation-passed	1
step_physics_max	0.1926744167621319
step_physics_mean	0.14618205677401963
step_physics_median	0.14546916940861354
step_physics_min	0.10111547151671955
survival_time_max	59.99999999999873
survival_time_mean	17.849999999999678
survival_time_min	1.900000000000001

No reset possible

56827

11301

template-pytorch

LFv-sim

success

yes

2020-12-03 07:36:13+00:00

2020-12-03 07:40:44+00:00

0:04:31

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5400457508484146
survival_time_median	5.824999999999987
deviation-center-line_median	0.11789914648094156
in-drivable-lane_median	3.774999999999989

other stats

agent_compute-ego0_max	0.013272687423327736
agent_compute-ego0_mean	0.012791745647805783
agent_compute-ego0_median	0.012748691171080202
agent_compute-ego0_min	0.012396912825734992
complete-iteration_max	0.18593717606599663
complete-iteration_mean	0.16271818282746758
complete-iteration_median	0.16074109677430037
complete-iteration_min	0.14345336169527287
deviation-center-line_max	0.16680634346641923
deviation-center-line_mean	0.11944498866436358
deviation-center-line_min	0.07517531822915192
deviation-heading_max	1.1883029977838735
deviation-heading_mean	0.7893330076045567
deviation-heading_median	0.8078336958065248
deviation-heading_min	0.3533616410213036
driven_any_max	2.890632072565673
driven_any_mean	1.936133934562208
driven_any_median	1.723772568323471
driven_any_min	1.406358529036217
driven_lanedir_consec_max	0.6756913931013827
driven_lanedir_consec_mean	0.5084164514108487
driven_lanedir_consec_min	0.2778829108451831
driven_lanedir_max	0.6756913931013827
driven_lanedir_mean	0.5084164514108487
driven_lanedir_median	0.5400457508484146
driven_lanedir_min	0.2778829108451831
get_duckie_state_max	1.2628324739225618e-06
get_duckie_state_mean	1.196042276951189e-06
get_duckie_state_median	1.1897185617241976e-06
get_duckie_state_min	1.1418995104337994e-06
get_robot_state_max	0.003559326077555562
get_robot_state_mean	0.003536057469839602
get_robot_state_median	0.0035315947365342527
get_robot_state_min	0.0035217143287343427
get_state_dump_max	0.004508298290662529
get_state_dump_mean	0.004466327206499899
get_state_dump_median	0.00448398980097847
get_state_dump_min	0.004389030933380127
get_ui_image_max	0.03599690996910915
get_ui_image_mean	0.031025546934009204
get_ui_image_median	0.030239146384564076
get_ui_image_min	0.02762698499779952
in-drivable-lane_max	7.449999999999996
in-drivable-lane_mean	4.3999999999999915
in-drivable-lane_min	2.5999999999999908
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.890632072565673, "get_ui_image": 0.028204375570947, "step_physics": 0.08319443529778785, "survival_time": 9.049999999999994, "driven_lanedir": 0.2778829108451831, "get_state_dump": 0.004478888197259588, "get_robot_state": 0.003559326077555562, "sim_render-ego0": 0.003760588038098681, "get_duckie_state": 1.2628324739225618e-06, "in-drivable-lane": 7.449999999999996, "deviation-heading": 1.161596209619217, "agent_compute-ego0": 0.012721956431210695, "complete-iteration": 0.14967433698884733, "set_robot_commands": 0.0021659201318091088, "deviation-center-line": 0.16680634346641923, "driven_lanedir_consec": 0.2778829108451831, "sim_compute_sim_state": 0.009560054475134546, "sim_compute_performance-ego0": 0.0019504748857938328}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.7811774873708313, "get_ui_image": 0.03599690996910915, "step_physics": 0.1110775529845687, "survival_time": 5.999999999999987, "driven_lanedir": 0.41645746797092387, "get_state_dump": 0.004508298290662529, "get_robot_state": 0.0035217143287343427, "sim_render-ego0": 0.003731026137170713, "get_duckie_state": 1.237412129551911e-06, "in-drivable-lane": 4.14999999999999, "deviation-heading": 1.1883029977838735, "agent_compute-ego0": 0.013272687423327736, "complete-iteration": 0.18593717606599663, "set_robot_commands": 0.0020769706442336404, "deviation-center-line": 0.13810456179815722, "driven_lanedir_consec": 0.41645746797092387, "sim_compute_sim_state": 0.009797604616023293, "sim_compute_performance-ego0": 0.001879960052238023}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.406358529036217, "get_ui_image": 0.03227391719818115, "step_physics": 0.10291898012161256, "survival_time": 4.94999999999999, "driven_lanedir": 0.6756913931013827, "get_state_dump": 0.004389030933380127, "get_robot_state": 0.003525643348693848, "sim_render-ego0": 0.0037170839309692383, "get_duckie_state": 1.1420249938964844e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 0.4540711819938326, "agent_compute-ego0": 0.012775425910949706, "complete-iteration": 0.17180785655975342, "set_robot_commands": 0.002101974487304687, "deviation-center-line": 0.07517531822915192, "driven_lanedir_consec": 0.6756913931013827, "sim_compute_sim_state": 0.00813753604888916, "sim_compute_performance-ego0": 0.0018891143798828128}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6663676492761108, "get_ui_image": 0.02762698499779952, "step_physics": 0.08267846232966373, "survival_time": 5.649999999999988, "driven_lanedir": 0.6636340337259052, "get_state_dump": 0.004489091404697351, "get_robot_state": 0.003537546124374657, "sim_render-ego0": 0.003687337825172826, "get_duckie_state": 1.1418995104337994e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 0.3533616410213036, "agent_compute-ego0": 0.012396912825734992, "complete-iteration": 0.14345336169527287, "set_robot_commands": 0.0021195934529890095, "deviation-center-line": 0.09769373116372594, "driven_lanedir_consec": 0.6636340337259052, "sim_compute_sim_state": 0.004934754287987424, "sim_compute_performance-ego0": 0.0019027496639050937}}
set_robot_commands_max	0.0021659201318091088
set_robot_commands_mean	0.0021161146790841115
set_robot_commands_median	0.0021107839701468485
set_robot_commands_min	0.0020769706442336404
sim_compute_performance-ego0_max	0.0019504748857938328
sim_compute_performance-ego0_mean	0.0019055747454549403
sim_compute_performance-ego0_median	0.0018959320218939531
sim_compute_performance-ego0_min	0.001879960052238023
sim_compute_sim_state_max	0.009797604616023293
sim_compute_sim_state_mean	0.008107487357008607
sim_compute_sim_state_median	0.008848795262011853
sim_compute_sim_state_min	0.004934754287987424
sim_render-ego0_max	0.003760588038098681
sim_render-ego0_mean	0.0037240089828528646
sim_render-ego0_median	0.003724055034069976
sim_render-ego0_min	0.003687337825172826
simulation-passed	1
step_physics_max	0.1110775529845687
step_physics_mean	0.09496735768340822
step_physics_median	0.0930567077097002
step_physics_min	0.08267846232966373
survival_time_max	9.049999999999994
survival_time_mean	6.412499999999989
survival_time_min	4.94999999999999

No reset possible

56765

11296

template-pytorch

LFv-sim

success

yes

2020-12-03 07:25:01+00:00

2020-12-03 07:31:52+00:00

0:06:51

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7279734983150391
survival_time_median	10.85000000000002
deviation-center-line_median	0.4202444477733832
in-drivable-lane_median	5.075000000000029

other stats

agent_compute-ego0_max	0.013506876164345288
agent_compute-ego0_mean	0.01325815911289516
agent_compute-ego0_median	0.01333488345519876
agent_compute-ego0_min	0.012855993376837837
complete-iteration_max	0.1926293290894607
complete-iteration_mean	0.15732843642484717
complete-iteration_median	0.15103670358113253
complete-iteration_min	0.1346110094476629
deviation-center-line_max	0.614976268495809
deviation-center-line_mean	0.3885426142839663
deviation-center-line_min	0.09870529309328964
deviation-heading_max	3.4194640069490583
deviation-heading_mean	2.023174586280547
deviation-heading_median	1.9314022078080175
deviation-heading_min	0.8104299225570942
driven_any_max	3.0188619348708587
driven_any_mean	1.6442717680862329
driven_any_median	1.4571091660196611
driven_any_min	0.6440068054347501
driven_lanedir_consec_max	1.0672936294562023
driven_lanedir_consec_mean	0.6802249919315236
driven_lanedir_consec_min	0.197659341639814
driven_lanedir_max	1.0672936294562023
driven_lanedir_mean	0.6802249919315236
driven_lanedir_median	0.7279734983150391
driven_lanedir_min	0.197659341639814
get_duckie_state_max	1.2987223102818782e-06
get_duckie_state_mean	1.165124407729514e-06
get_duckie_state_median	1.1509481822241617e-06
get_duckie_state_min	1.059878956187855e-06
get_robot_state_max	0.0035744784054932773
get_robot_state_mean	0.003542453610615286
get_robot_state_median	0.003553259519373104
get_robot_state_min	0.0034888169982216573
get_state_dump_max	0.004609573846575858
get_state_dump_mean	0.004486442669058711
get_state_dump_median	0.004523302758625271
get_state_dump_min	0.004289591312408447
get_ui_image_max	0.035812221724411536
get_ui_image_mean	0.03036693733274448
get_ui_image_median	0.03010780809403773
get_ui_image_min	0.02543991141849094
in-drivable-lane_max	11.65000000000012
in-drivable-lane_mean	6.150000000000041
in-drivable-lane_min	2.799999999999992
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.4908786251546795, "get_ui_image": 0.028259937329725787, "step_physics": 0.08049160458824851, "survival_time": 10.95000000000002, "driven_lanedir": 0.7522520356852127, "get_state_dump": 0.004289591312408447, "get_robot_state": 0.0034888169982216573, "sim_render-ego0": 0.003616696054285223, "get_duckie_state": 1.059878956187855e-06, "in-drivable-lane": 5.350000000000026, "deviation-heading": 2.044665167708162, "agent_compute-ego0": 0.01333990747278387, "complete-iteration": 0.14618406079032203, "set_robot_commands": 0.002080348404971036, "deviation-center-line": 0.614976268495809, "driven_lanedir_consec": 0.7522520356852127, "sim_compute_sim_state": 0.0086942120031877, "sim_compute_performance-ego0": 0.0018515055829828437}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6440068054347501, "get_ui_image": 0.035812221724411536, "step_physics": 0.1173788158372901, "survival_time": 4.299999999999993, "driven_lanedir": 0.197659341639814, "get_state_dump": 0.004609573846575858, "get_robot_state": 0.0035661253435858363, "sim_render-ego0": 0.003747750972879344, "get_duckie_state": 1.120841366121139e-06, "in-drivable-lane": 2.799999999999992, "deviation-heading": 0.8104299225570942, "agent_compute-ego0": 0.013329859437613651, "complete-iteration": 0.1926293290894607, "set_robot_commands": 0.002141933331544372, "deviation-center-line": 0.09870529309328964, "driven_lanedir_consec": 0.197659341639814, "sim_compute_sim_state": 0.010049044400796124, "sim_compute_performance-ego0": 0.00191604680028455}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0188619348708587, "get_ui_image": 0.03195567885834967, "step_physics": 0.0837872914932481, "survival_time": 19.850000000000147, "driven_lanedir": 1.0672936294562023, "get_state_dump": 0.00446693561783987, "get_robot_state": 0.003540393695160372, "sim_render-ego0": 0.003798186479501389, "get_duckie_state": 1.2987223102818782e-06, "in-drivable-lane": 11.65000000000012, "deviation-heading": 3.4194640069490583, "agent_compute-ego0": 0.013506876164345288, "complete-iteration": 0.15588934637194302, "set_robot_commands": 0.002229736078923671, "deviation-center-line": 0.5939639991971228, "driven_lanedir_consec": 1.0672936294562023, "sim_compute_sim_state": 0.010569340619609584, "sim_compute_performance-ego0": 0.0019578041143752823}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4233397068846432, "get_ui_image": 0.02543991141849094, "step_physics": 0.07488373584217495, "survival_time": 10.750000000000018, "driven_lanedir": 0.7036949609448655, "get_state_dump": 0.004579669899410672, "get_robot_state": 0.0035744784054932773, "sim_render-ego0": 0.003693424993091159, "get_duckie_state": 1.1810549983271845e-06, "in-drivable-lane": 4.800000000000031, "deviation-heading": 1.8181392479078724, "agent_compute-ego0": 0.012855993376837837, "complete-iteration": 0.1346110094476629, "set_robot_commands": 0.0022942004380402743, "deviation-center-line": 0.2465248963496436, "driven_lanedir_consec": 0.7036949609448655, "sim_compute_sim_state": 0.005285281825948645, "sim_compute_performance-ego0": 0.0019246527442225703}}
set_robot_commands_max	0.0022942004380402743
set_robot_commands_mean	0.0021865545633698385
set_robot_commands_median	0.0021858347052340216
set_robot_commands_min	0.002080348404971036
sim_compute_performance-ego0_max	0.0019578041143752823
sim_compute_performance-ego0_mean	0.0019125023104663117
sim_compute_performance-ego0_median	0.00192034977225356
sim_compute_performance-ego0_min	0.0018515055829828437
sim_compute_sim_state_max	0.010569340619609584
sim_compute_sim_state_mean	0.008649469712385513
sim_compute_sim_state_median	0.009371628201991913
sim_compute_sim_state_min	0.005285281825948645
sim_render-ego0_max	0.003798186479501389
sim_render-ego0_mean	0.003714014624939279
sim_render-ego0_median	0.003720587982985252
sim_render-ego0_min	0.003616696054285223
simulation-passed	1
step_physics_max	0.1173788158372901
step_physics_mean	0.08913536194024041
step_physics_median	0.0821394480407483
step_physics_min	0.07488373584217495
survival_time_max	19.850000000000147
survival_time_mean	11.462500000000045
survival_time_min	4.299999999999993

No reset possible

56722

11290

template-pytorch

LFv-sim

success

yes

2020-12-03 07:16:10+00:00

2020-12-03 07:24:27+00:00

0:08:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.23427455506800765
survival_time_median	4.94999999999999
deviation-center-line_median	0.08838448985296787
in-drivable-lane_median	3.79999999999999

other stats

agent_compute-ego0_max	0.013511101219141597
agent_compute-ego0_mean	0.013177176736788428
agent_compute-ego0_median	0.013290217099592204
agent_compute-ego0_min	0.012617171528827712
complete-iteration_max	0.22867112794769143
complete-iteration_mean	0.2053401550585347
complete-iteration_median	0.2114191836408337
complete-iteration_min	0.16985112500477986
deviation-center-line_max	0.5169227038280926
deviation-center-line_mean	0.19473694386724333
deviation-center-line_min	0.08525609193494496
deviation-heading_max	4.063893486920211
deviation-heading_mean	1.4485431885062892
deviation-heading_median	0.6532010752962616
deviation-heading_min	0.4238771165124224
driven_any_max	5.676730591595053
driven_any_mean	2.1794417231219336
driven_any_median	1.092870994273364
driven_any_min	0.8552943123459538
driven_lanedir_consec_max	1.213797061314493
driven_lanedir_consec_mean	0.4506379585628312
driven_lanedir_consec_min	0.12020566280081636
driven_lanedir_max	1.3155938853661169
driven_lanedir_mean	0.4773448008312749
driven_lanedir_median	0.2367898275790833
driven_lanedir_min	0.12020566280081636
get_duckie_state_max	1.290265251608456e-06
get_duckie_state_mean	1.2353980115481173e-06
get_duckie_state_median	1.241019577234262e-06
get_duckie_state_min	1.1692876401154892e-06
get_robot_state_max	0.003661987055902896
get_robot_state_mean	0.0035744927862222525
get_robot_state_median	0.003576210752301586
get_robot_state_min	0.0034835625843829417
get_state_dump_max	0.004665366400068051
get_state_dump_mean	0.004526131745954628
get_state_dump_median	0.004542491198195825
get_state_dump_min	0.00435417818735881
get_ui_image_max	0.035698149805871125
get_ui_image_mean	0.030579440852357222
get_ui_image_median	0.0305863609094449
get_ui_image_min	0.02544689178466797
in-drivable-lane_max	14.600000000000126
in-drivable-lane_mean	6.2250000000000245
in-drivable-lane_min	2.699999999999993
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 1.3024991841722673, "get_ui_image": 0.028542460565981656, "step_physics": 0.13241372315779976, "survival_time": 5.699999999999988, "driven_lanedir": 0.12020566280081636, "get_state_dump": 0.004549478447955588, "get_robot_state": 0.003661987055902896, "sim_render-ego0": 0.00378168769504713, "get_duckie_state": 1.1692876401154892e-06, "in-drivable-lane": 4.849999999999987, "deviation-heading": 0.4238771165124224, "agent_compute-ego0": 0.013459191115006156, "complete-iteration": 0.1983769997306492, "set_robot_commands": 0.002215258971504543, "deviation-center-line": 0.08813423683996927, "driven_lanedir_consec": 0.12020566280081636, "sim_compute_sim_state": 0.007675533709318742, "sim_compute_performance-ego0": 0.001998254527216372}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.676730591595053, "get_ui_image": 0.035698149805871125, "step_physics": 0.15149311595988052, "survival_time": 21.35000000000017, "driven_lanedir": 1.3155938853661169, "get_state_dump": 0.004665366400068051, "get_robot_state": 0.0035858310271646376, "sim_render-ego0": 0.003881888968922267, "get_duckie_state": 1.2411135379399094e-06, "in-drivable-lane": 14.600000000000126, "deviation-heading": 4.063893486920211, "agent_compute-ego0": 0.013511101219141597, "complete-iteration": 0.22867112794769143, "set_robot_commands": 0.002311122194628849, "deviation-center-line": 0.5169227038280926, "driven_lanedir_consec": 1.213797061314493, "sim_compute_sim_state": 0.011434276527333484, "sim_compute_performance-ego0": 0.0020068315702064013}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.8832428043744607, "get_ui_image": 0.032630261252908146, "step_physics": 0.15519100918489345, "survival_time": 4.199999999999993, "driven_lanedir": 0.24751267268392785, "get_state_dump": 0.004535503948436064, "get_robot_state": 0.003566590477438534, "sim_render-ego0": 0.003743314743041992, "get_duckie_state": 1.290265251608456e-06, "in-drivable-lane": 2.699999999999993, "deviation-heading": 0.7165428221163933, "agent_compute-ego0": 0.01312124308417825, "complete-iteration": 0.2244613675510182, "set_robot_commands": 0.0022197891684139475, "deviation-center-line": 0.08863474286596648, "driven_lanedir_consec": 0.2439576300029549, "sim_compute_sim_state": 0.007418335185331457, "sim_compute_performance-ego0": 0.001955335280474494}, "LF-norm-small_loop-000-ego0": {"driven_any": 0.8552943123459538, "get_ui_image": 0.02544689178466797, "step_physics": 0.11115234443940313, "survival_time": 4.099999999999993, "driven_lanedir": 0.22606698247423873, "get_state_dump": 0.00435417818735881, "get_robot_state": 0.0034835625843829417, "sim_render-ego0": 0.003567635294902755, "get_duckie_state": 1.2409256165286144e-06, "in-drivable-lane": 2.7499999999999933, "deviation-heading": 0.58985932847613, "agent_compute-ego0": 0.012617171528827712, "complete-iteration": 0.16985112500477986, "set_robot_commands": 0.0020579286368496447, "deviation-center-line": 0.08525609193494496, "driven_lanedir_consec": 0.2245914801330604, "sim_compute_sim_state": 0.005242020250803016, "sim_compute_performance-ego0": 0.0018479393189211929}}
set_robot_commands_max	0.002311122194628849
set_robot_commands_mean	0.002201024742849246
set_robot_commands_median	0.0022175240699592452
set_robot_commands_min	0.0020579286368496447
sim_compute_performance-ego0_max	0.0020068315702064013
sim_compute_performance-ego0_mean	0.0019520901742046152
sim_compute_performance-ego0_median	0.0019767949038454334
sim_compute_performance-ego0_min	0.0018479393189211929
sim_compute_sim_state_max	0.011434276527333484
sim_compute_sim_state_mean	0.007942541418196674
sim_compute_sim_state_median	0.007546934447325099
sim_compute_sim_state_min	0.005242020250803016
sim_render-ego0_max	0.003881888968922267
sim_render-ego0_mean	0.003743631675478536
sim_render-ego0_median	0.003762501219044561
sim_render-ego0_min	0.003567635294902755
simulation-passed	1
step_physics_max	0.15519100918489345
step_physics_mean	0.13756254818549424
step_physics_median	0.14195341955884014
step_physics_min	0.11115234443940313
survival_time_max	21.35000000000017
survival_time_mean	8.837500000000036
survival_time_min	4.099999999999993

No reset possible

56481

11450

Cliff Chandler 🇺🇸

template-pytorch

LFt-sim

success

yes

2020-12-03 06:45:19+00:00

2020-12-03 07:14:52+00:00

0:29:33

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.7824001806192992
survival_time_median	58.34999999999882
deviation-center-line_median	1.0951450953959705
in-drivable-lane_median	43.92499999999908

other stats

agent_compute-ego0_max	0.013272682494863084
agent_compute-ego0_mean	0.012230915706167002
agent_compute-ego0_median	0.012219907374988265
agent_compute-ego0_min	0.011211165579828394
complete-iteration_max	0.3178124760472497
complete-iteration_mean	0.2644284876548536
complete-iteration_median	0.26424817925777155
complete-iteration_min	0.2114051160566217
deviation-center-line_max	1.5174351027708604
deviation-center-line_mean	0.9436571326079906
deviation-center-line_min	0.06690323686916151
deviation-heading_max	13.997705513975866
deviation-heading_mean	8.763724228547797
deviation-heading_median	10.091152179564135
deviation-heading_min	0.8748870410870514
driven_any_max	8.043310123957838
driven_any_mean	5.921568908394299
driven_any_median	7.739190872429036
driven_any_min	0.16458376476128478
driven_lanedir_consec_max	1.365680092236078
driven_lanedir_consec_mean	0.7564515561760787
driven_lanedir_consec_min	0.09532577122963914
driven_lanedir_max	1.3740499502595709
driven_lanedir_mean	0.7588072130686023
driven_lanedir_median	0.7829265653925997
driven_lanedir_min	0.09532577122963914
get_duckie_state_max	1.1367067310037858e-06
get_duckie_state_mean	1.1089602530219308e-06
get_duckie_state_median	1.1163287590007209e-06
get_duckie_state_min	1.066476763082496e-06
get_robot_state_max	0.003605794696555789
get_robot_state_mean	0.003573064547228323
get_robot_state_median	0.0035740469777306846
get_robot_state_min	0.003538369536896133
get_state_dump_max	0.004578074743581372
get_state_dump_mean	0.004486712010742468
get_state_dump_median	0.004474907691631587
get_state_dump_min	0.004418957916125327
get_ui_image_max	0.0358949761058009
get_ui_image_mean	0.030288895388933416
get_ui_image_median	0.029931371364443717
get_ui_image_min	0.02539786272104535
in-drivable-lane_max	50.74999999999884
in-drivable-lane_mean	34.82499999999925
in-drivable-lane_min	0.7
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.725452283530268, "get_ui_image": 0.02786100299347865, "step_physics": 0.17856130326897038, "survival_time": 56.69999999999891, "driven_lanedir": 1.3740499502595709, "get_state_dump": 0.004418957916125327, "get_robot_state": 0.003605794696555789, "sim_render-ego0": 0.003607062621263681, "get_duckie_state": 1.066476763082496e-06, "in-drivable-lane": 40.649999999999494, "deviation-heading": 13.997705513975866, "agent_compute-ego0": 0.012510408073795, "complete-iteration": 0.2422671137402236, "set_robot_commands": 0.0021549695388861164, "deviation-center-line": 1.5174351027708604, "driven_lanedir_consec": 1.365680092236078, "sim_compute_sim_state": 0.007569090385268963, "sim_compute_performance-ego0": 0.001904160755846469}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.16458376476128478, "get_ui_image": 0.0358949761058009, "step_physics": 0.24327440040056095, "survival_time": 2.1000000000000005, "driven_lanedir": 0.09532577122963914, "get_state_dump": 0.004578074743581372, "get_robot_state": 0.003590650336686955, "sim_render-ego0": 0.003702108250107876, "get_duckie_state": 1.1366467143214023e-06, "in-drivable-lane": 0.7, "deviation-heading": 0.8748870410870514, "agent_compute-ego0": 0.011929406676181527, "complete-iteration": 0.3178124760472497, "set_robot_commands": 0.0022765481194784473, "deviation-center-line": 0.06690323686916151, "driven_lanedir_consec": 0.09532577122963914, "sim_compute_sim_state": 0.010596463846605878, "sim_compute_performance-ego0": 0.0019002847893293511}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.752929461327804, "get_ui_image": 0.032001739735408784, "step_physics": 0.21292588752473424, "survival_time": 59.99999999999873, "driven_lanedir": 1.0081833256819903, "get_state_dump": 0.004464816491272328, "get_robot_state": 0.003538369536896133, "sim_render-ego0": 0.0036258508918882906, "get_duckie_state": 1.0960108036800388e-06, "in-drivable-lane": 47.19999999999867, "deviation-heading": 10.800100263415072, "agent_compute-ego0": 0.013272682494863084, "complete-iteration": 0.28622924477531947, "set_robot_commands": 0.0021287281249186877, "deviation-center-line": 1.1668979373972297, "driven_lanedir_consec": 1.0081833256819903, "sim_compute_sim_state": 0.012301937130269756, "sim_compute_performance-ego0": 0.0018991308347271643}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.043310123957838, "get_ui_image": 0.02539786272104535, "step_physics": 0.15308514324254935, "survival_time": 59.99999999999873, "driven_lanedir": 0.557669805103209, "get_state_dump": 0.004484998891990846, "get_robot_state": 0.003557443618774414, "sim_render-ego0": 0.003591963889497603, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 50.74999999999884, "deviation-heading": 9.382204095713204, "agent_compute-ego0": 0.011211165579828394, "complete-iteration": 0.2114051160566217, "set_robot_commands": 0.002105872895100234, "deviation-center-line": 1.023392253394711, "driven_lanedir_consec": 0.5566170355566078, "sim_compute_sim_state": 0.006026183040215511, "sim_compute_performance-ego0": 0.0018764278672319169}}
set_robot_commands_max	0.0022765481194784473
set_robot_commands_mean	0.0021665296695958713
set_robot_commands_median	0.002141848831902402
set_robot_commands_min	0.002105872895100234
sim_compute_performance-ego0_max	0.001904160755846469
sim_compute_performance-ego0_mean	0.0018950010617837256
sim_compute_performance-ego0_median	0.0018997078120282576
sim_compute_performance-ego0_min	0.0018764278672319169
sim_compute_sim_state_max	0.012301937130269756
sim_compute_sim_state_mean	0.009123418600590029
sim_compute_sim_state_median	0.00908277711593742
sim_compute_sim_state_min	0.006026183040215511
sim_render-ego0_max	0.003702108250107876
sim_render-ego0_mean	0.0036317464131893624
sim_render-ego0_median	0.0036164567565759856
sim_render-ego0_min	0.003591963889497603
simulation-passed	1
step_physics_max	0.24327440040056095
step_physics_mean	0.19696168360920377
step_physics_median	0.19574359539685232
step_physics_min	0.15308514324254935
survival_time_max	59.99999999999873
survival_time_mean	44.69999999999909
survival_time_min	2.1000000000000005

No reset possible

56455

11305

template-pytorch

LFv-sim

failed

yes

2020-12-03 06:43:04+00:00

2020-12-03 06:43:47+00:00

0:00:43

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     return action.astype(float)
              || AttributeError: 'Tensor' object has no attribute 'astype'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

56193

11425

Frank (Chude) Qian 🇨🇦

template-pytorch

LFP-sim

success

2020-12-03 06:25:02+00:00

2020-12-03 06:41:38+00:00

0:16:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	15.82500000000009
in-drivable-lane_median	9.95000000000006
driven_lanedir_consec_median	0.834908849963265
deviation-center-line_median	0.4514636315085888

other stats

agent_compute-ego0_max	0.013525651848834494
agent_compute-ego0_mean	0.012901587851442627
agent_compute-ego0_median	0.012846776727254624
agent_compute-ego0_min	0.012387146102426775
complete-iteration_max	0.3392289541233545
complete-iteration_mean	0.2957002658162273
complete-iteration_median	0.3138987819353739
complete-iteration_min	0.21577454527080683
deviation-center-line_max	0.5949383505863416
deviation-center-line_mean	0.3912230932965767
deviation-center-line_min	0.06702675958278753
deviation-heading_max	5.8504886353748535
deviation-heading_mean	3.145289444725785
deviation-heading_median	3.031160032264661
deviation-heading_min	0.6683490789989647
driven_any_max	5.689645434770484
driven_any_mean	3.2003683927848714
driven_any_median	3.4240071525231315
driven_any_min	0.26381383132273784
driven_lanedir_consec_max	1.1869668341525907
driven_lanedir_consec_mean	0.733570473425595
driven_lanedir_consec_min	0.07749735962325954
driven_lanedir_max	1.1869668341525907
driven_lanedir_mean	0.733570473425595
driven_lanedir_median	0.834908849963265
driven_lanedir_min	0.07749735962325954
get_duckie_state_max	0.0250692834024844
get_duckie_state_mean	0.017576554780191676
get_duckie_state_median	0.02057937966974694
get_duckie_state_min	0.004078176378788433
get_robot_state_max	0.0037428963752019974
get_robot_state_mean	0.0036167085084756706
get_robot_state_median	0.003603387223899482
get_robot_state_min	0.003517163210901721
get_state_dump_max	0.008647923884184464
get_state_dump_mean	0.007328713786449755
get_state_dump_median	0.0077865147156733665
get_state_dump_min	0.005093901830267823
get_ui_image_max	0.03898252152848518
get_ui_image_mean	0.03309205872068291
get_ui_image_median	0.03370379462704484
get_ui_image_min	0.025978124100156777
in-drivable-lane_max	18.600000000000165
in-drivable-lane_mean	9.95000000000007
in-drivable-lane_min	1.2999999999999998
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 0.26381383132273784, "get_ui_image": 0.03170713134433912, "step_physics": 0.20195593522942584, "survival_time": 2.25, "driven_lanedir": 0.07749735962325954, "get_state_dump": 0.008647923884184464, "get_robot_state": 0.003683862478836723, "sim_render-ego0": 0.003809125527091648, "get_duckie_state": 0.0250692834024844, "in-drivable-lane": 1.2999999999999998, "deviation-heading": 0.6683490789989647, "agent_compute-ego0": 0.013525651848834494, "complete-iteration": 0.30017292499542236, "set_robot_commands": 0.002205459967903469, "deviation-center-line": 0.06702675958278753, "driven_lanedir_consec": 0.07749735962325954, "sim_compute_sim_state": 0.007518825323685356, "sim_compute_performance-ego0": 0.001955369244451108}, "LFP-norm-zigzag-000-ego0": {"driven_any": 3.843921188232805, "get_ui_image": 0.03898252152848518, "step_physics": 0.23747163051846384, "survival_time": 17.35000000000011, "driven_lanedir": 0.8347426357388776, "get_state_dump": 0.007611991345197305, "get_robot_state": 0.003517163210901721, "sim_render-ego0": 0.0035930310172596195, "get_duckie_state": 0.019886548491730088, "in-drivable-lane": 10.450000000000069, "deviation-heading": 5.8504886353748535, "agent_compute-ego0": 0.012865598859458134, "complete-iteration": 0.3392289541233545, "set_robot_commands": 0.0020603153897427963, "deviation-center-line": 0.5949383505863416, "driven_lanedir_consec": 0.8347426357388776, "sim_compute_sim_state": 0.011316361783564776, "sim_compute_performance-ego0": 0.0018386690095923413}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.689645434770484, "get_ui_image": 0.03570045790975056, "step_physics": 0.22289492875810657, "survival_time": 25.150000000000222, "driven_lanedir": 1.1869668341525907, "get_state_dump": 0.007961038086149428, "get_robot_state": 0.0037428963752019974, "sim_render-ego0": 0.003779985601939852, "get_duckie_state": 0.02127221084776379, "in-drivable-lane": 18.600000000000165, "deviation-heading": 3.390209832059732, "agent_compute-ego0": 0.012827954595051117, "complete-iteration": 0.3276246388753255, "set_robot_commands": 0.002187528307475741, "deviation-center-line": 0.46172122011230377, "driven_lanedir_consec": 1.1869668341525907, "sim_compute_sim_state": 0.015189213885201348, "sim_compute_performance-ego0": 0.001979327391064356}, "LFP-norm-small_loop-000-ego0": {"driven_any": 3.0040931168134586, "get_ui_image": 0.025978124100156777, "step_physics": 0.15081194136616244, "survival_time": 14.300000000000068, "driven_lanedir": 0.8350750641876523, "get_state_dump": 0.005093901830267823, "get_robot_state": 0.003522911968962241, "sim_render-ego0": 0.0035705724244333727, "get_duckie_state": 0.004078176378788433, "in-drivable-lane": 9.450000000000047, "deviation-heading": 2.6721102324695907, "agent_compute-ego0": 0.012387146102426775, "complete-iteration": 0.21577454527080683, "set_robot_commands": 0.002108396138048338, "deviation-center-line": 0.44120604290487375, "driven_lanedir_consec": 0.8350750641876523, "sim_compute_sim_state": 0.006277786314695139, "sim_compute_performance-ego0": 0.0018595951359446456}}
set_robot_commands_max	0.002205459967903469
set_robot_commands_mean	0.002140424950792586
set_robot_commands_median	0.0021479622227620395
set_robot_commands_min	0.0020603153897427963
sim_compute_performance-ego0_max	0.001979327391064356
sim_compute_performance-ego0_mean	0.0019082401952631128
sim_compute_performance-ego0_median	0.0019074821901978768
sim_compute_performance-ego0_min	0.0018386690095923413
sim_compute_sim_state_max	0.015189213885201348
sim_compute_sim_state_mean	0.010075546826786654
sim_compute_sim_state_median	0.009417593553625066
sim_compute_sim_state_min	0.006277786314695139
sim_render-ego0_max	0.003809125527091648
sim_render-ego0_mean	0.003688178642681123
sim_render-ego0_median	0.003686508309599736
sim_render-ego0_min	0.0035705724244333727
simulation-passed	1
step_physics_max	0.23747163051846384
step_physics_mean	0.20328360896803965
step_physics_median	0.21242543199376615
step_physics_min	0.15081194136616244
survival_time_max	25.150000000000222
survival_time_mean	14.7625000000001
survival_time_min	2.25

No reset possible

55823

11310

template-pytorch

LFv-sim

success

yes

2020-12-03 05:48:02+00:00

2020-12-03 06:23:48+00:00

0:35:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.734783682090551
survival_time_median	59.99999999999873
deviation-center-line_median	3.2248542476717703
in-drivable-lane_median	0.6749999999999954

other stats

agent_compute-ego0_max	0.01982125334696011
agent_compute-ego0_mean	0.016086040091057997
agent_compute-ego0_median	0.015607300050848231
agent_compute-ego0_min	0.01330830691557542
complete-iteration_max	0.20610928376648052
complete-iteration_mean	0.1844450840842813
complete-iteration_median	0.18842076391701296
complete-iteration_min	0.15482952473661882
deviation-center-line_max	3.4111732440831477
deviation-center-line_mean	2.99514643110151
deviation-center-line_min	2.1197039849793513
deviation-heading_max	17.02764977492676
deviation-heading_mean	13.938983841046255
deviation-heading_median	14.407081697037768
deviation-heading_min	9.914122195182731
driven_any_max	10.754231374248086
driven_any_mean	9.670142262634684
driven_any_median	9.702369197695846
driven_any_min	8.52159928089896
driven_lanedir_consec_max	10.53805466972804
driven_lanedir_consec_mean	9.01846977505896
driven_lanedir_consec_min	8.066257066326697
driven_lanedir_max	10.53805466972804
driven_lanedir_mean	9.01846977505896
driven_lanedir_median	8.734783682090551
driven_lanedir_min	8.066257066326697
get_duckie_state_max	1.1855418437922824e-06
get_duckie_state_mean	1.163407229662537e-06
get_duckie_state_median	1.1692634728627835e-06
get_duckie_state_min	1.1295601291322986e-06
get_robot_state_max	0.0035357985468728657
get_robot_state_mean	0.0034929348169814335
get_robot_state_median	0.0034829903204772594
get_robot_state_min	0.0034699600800983514
get_state_dump_max	0.00440542068608496
get_state_dump_mean	0.00435249086819918
get_state_dump_median	0.004356913423657318
get_state_dump_min	0.004290715939397121
get_ui_image_max	0.035599508253759786
get_ui_image_mean	0.03018910620829942
get_ui_image_median	0.02998107716403933
get_ui_image_min	0.02519476225135924
in-drivable-lane_max	2.7500000000000284
in-drivable-lane_mean	1.0250000000000048
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 10.623489038299782, "get_ui_image": 0.02785070472514004, "step_physics": 0.11495286102199634, "survival_time": 59.99999999999873, "driven_lanedir": 9.322946364336872, "get_state_dump": 0.004290715939397121, "get_robot_state": 0.0035357985468728657, "sim_render-ego0": 0.0035744966019400945, "get_duckie_state": 1.1295601291322986e-06, "in-drivable-lane": 2.7500000000000284, "deviation-heading": 17.02764977492676, "agent_compute-ego0": 0.01330830691557542, "complete-iteration": 0.18063595709852337, "set_robot_commands": 0.0020949119929965588, "deviation-center-line": 3.0652815056375458, "driven_lanedir_consec": 9.322946364336872, "sim_compute_sim_state": 0.009112037885794531, "sim_compute_performance-ego0": 0.0018451942393027377}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.52159928089896, "get_ui_image": 0.035599508253759786, "step_physics": 0.12264987570757076, "survival_time": 59.99999999999873, "driven_lanedir": 8.146620999844233, "get_state_dump": 0.00440542068608496, "get_robot_state": 0.003479665760989987, "sim_render-ego0": 0.0035614580238590033, "get_duckie_state": 1.1654916552083877e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.54268282555354, "agent_compute-ego0": 0.01982125334696011, "complete-iteration": 0.20610928376648052, "set_robot_commands": 0.0020525171595945843, "deviation-center-line": 3.4111732440831477, "driven_lanedir_consec": 8.146620999844233, "sim_compute_sim_state": 0.012641929766220614, "sim_compute_performance-ego0": 0.0018269696104635704}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.78124935709191, "get_ui_image": 0.03211144960293861, "step_physics": 0.11927282978950392, "survival_time": 59.99999999999873, "driven_lanedir": 8.066257066326697, "get_state_dump": 0.004395017020410542, "get_robot_state": 0.0034699600800983514, "sim_render-ego0": 0.0035455870092361793, "get_duckie_state": 1.1730352905171796e-06, "in-drivable-lane": 1.3499999999999908, "deviation-heading": 14.271480568521994, "agent_compute-ego0": 0.016345964085549537, "complete-iteration": 0.1962055707355026, "set_robot_commands": 0.002037804688541816, "deviation-center-line": 3.384426989705995, "driven_lanedir_consec": 8.066257066326697, "sim_compute_sim_state": 0.013124072680763162, "sim_compute_performance-ego0": 0.0018320246401873357}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.754231374248086, "get_ui_image": 0.02519476225135924, "step_physics": 0.09342651760250605, "survival_time": 59.99999999999873, "driven_lanedir": 10.53805466972804, "get_state_dump": 0.004318809826904094, "get_robot_state": 0.0034863148799645317, "sim_render-ego0": 0.0035260980274159147, "get_duckie_state": 1.1855418437922824e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.914122195182731, "agent_compute-ego0": 0.014868636016146923, "complete-iteration": 0.15482952473661882, "set_robot_commands": 0.0020677660228211516, "deviation-center-line": 2.1197039849793513, "driven_lanedir_consec": 10.53805466972804, "sim_compute_sim_state": 0.006043920509027105, "sim_compute_performance-ego0": 0.0018248689065467904}}
set_robot_commands_max	0.0020949119929965588
set_robot_commands_mean	0.0020632499659885275
set_robot_commands_median	0.002060141591207868
set_robot_commands_min	0.002037804688541816
sim_compute_performance-ego0_max	0.0018451942393027377
sim_compute_performance-ego0_mean	0.0018322643491251085
sim_compute_performance-ego0_median	0.001829497125325453
sim_compute_performance-ego0_min	0.0018248689065467904
sim_compute_sim_state_max	0.013124072680763162
sim_compute_sim_state_mean	0.010230490210451353
sim_compute_sim_state_median	0.010876983826007576
sim_compute_sim_state_min	0.006043920509027105
sim_render-ego0_max	0.0035744966019400945
sim_render-ego0_mean	0.003551909915612798
sim_render-ego0_median	0.003553522516547591
sim_render-ego0_min	0.0035260980274159147
simulation-passed	1
step_physics_max	0.12264987570757076
step_physics_mean	0.11257552103039428
step_physics_median	0.11711284540575014
step_physics_min	0.09342651760250605
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

55751

11308

template-pytorch

LFv-sim

success

yes

2020-12-03 05:44:11+00:00

2020-12-03 05:47:45+00:00

0:03:34

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4864664613945788
survival_time_median	4.324999999999992
deviation-center-line_median	0.10780143347994642
in-drivable-lane_median	2.5499999999999936

other stats

agent_compute-ego0_max	0.012505070729689163
agent_compute-ego0_mean	0.0121944975643561
agent_compute-ego0_median	0.01216481904750326
agent_compute-ego0_min	0.011943281432728709
complete-iteration_max	0.18924704238549983
complete-iteration_mean	0.17050238936007783
complete-iteration_median	0.1734351476379397
complete-iteration_min	0.14589221977893216
deviation-center-line_max	0.1328316105393819
deviation-center-line_mean	0.09967901806456224
deviation-center-line_min	0.05028159475897433
deviation-heading_max	1.3855208131706416
deviation-heading_mean	0.686881187157517
deviation-heading_median	0.5476085084820659
deviation-heading_min	0.2667869184952947
driven_any_max	2.6951202470336506
driven_any_mean	1.6220958507903482
driven_any_median	1.3642763954266144
driven_any_min	1.0647103652745131
driven_lanedir_consec_max	0.6509706223069186
driven_lanedir_consec_mean	0.49340890506039126
driven_lanedir_consec_min	0.3497320751454889
driven_lanedir_max	0.6509706223069186
driven_lanedir_mean	0.49340890506039126
driven_lanedir_median	0.4864664613945788
driven_lanedir_min	0.3497320751454889
get_duckie_state_max	1.0703472380942487e-06
get_duckie_state_mean	1.0581615927118815e-06
get_duckie_state_median	1.0582542735743482e-06
get_duckie_state_min	1.045790585604581e-06
get_robot_state_max	0.0035261313120524087
get_robot_state_mean	0.0034962904487441677
get_robot_state_median	0.0034962400714402615
get_robot_state_min	0.0034665503400437376
get_state_dump_max	0.004565813324668191
get_state_dump_mean	0.004429994898380052
get_state_dump_median	0.004409049149044579
get_state_dump_min	0.0043360679707628615
get_ui_image_max	0.03535089847889352
get_ui_image_mean	0.030403876255556753
get_ui_image_median	0.03027148854134041
get_ui_image_min	0.025721629460652668
in-drivable-lane_max	5.249999999999987
in-drivable-lane_mean	2.9624999999999924
in-drivable-lane_min	1.4999999999999951
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6951202470336506, "get_ui_image": 0.028102186593142425, "step_physics": 0.09262940016659824, "survival_time": 6.549999999999985, "driven_lanedir": 0.3497320751454889, "get_state_dump": 0.004565813324668191, "get_robot_state": 0.0035261313120524087, "sim_render-ego0": 0.0036653009327975183, "get_duckie_state": 1.045790585604581e-06, "in-drivable-lane": 5.249999999999987, "deviation-heading": 0.800827607795311, "agent_compute-ego0": 0.012505070729689163, "complete-iteration": 0.15828594475081473, "set_robot_commands": 0.002080601273160992, "deviation-center-line": 0.12974527290725824, "driven_lanedir_consec": 0.3497320751454889, "sim_compute_sim_state": 0.009253935380415483, "sim_compute_performance-ego0": 0.0018864563017180471}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.280776163697676, "get_ui_image": 0.03535089847889352, "step_physics": 0.11621860747641706, "survival_time": 4.6499999999999915, "driven_lanedir": 0.35176646134013545, "get_state_dump": 0.0043360679707628615, "get_robot_state": 0.0034665503400437376, "sim_render-ego0": 0.003583502262196642, "get_duckie_state": 1.0703472380942487e-06, "in-drivable-lane": 2.749999999999994, "deviation-heading": 1.3855208131706416, "agent_compute-ego0": 0.012276806729905148, "complete-iteration": 0.18858435052506467, "set_robot_commands": 0.0020431914228074095, "deviation-center-line": 0.1328316105393819, "driven_lanedir_consec": 0.35176646134013545, "sim_compute_sim_state": 0.009404347297993111, "sim_compute_performance-ego0": 0.0018356708770102645}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0647103652745131, "get_ui_image": 0.03244079048953839, "step_physics": 0.12169810907164616, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6509706223069186, "get_state_dump": 0.004478924310029443, "get_robot_state": 0.0035102296231397942, "sim_render-ego0": 0.003637961487271893, "get_duckie_state": 1.0568704178084188e-06, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 0.2943894091688206, "agent_compute-ego0": 0.012052831365101373, "complete-iteration": 0.18924704238549983, "set_robot_commands": 0.002060342190870598, "deviation-center-line": 0.05028159475897433, "driven_lanedir_consec": 0.6509706223069186, "sim_compute_sim_state": 0.007458391474254096, "sim_compute_performance-ego0": 0.0018380471129915608}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4477766271555526, "get_ui_image": 0.025721629460652668, "step_physics": 0.08797127523539978, "survival_time": 3.999999999999994, "driven_lanedir": 0.6211664614490222, "get_state_dump": 0.004339173988059715, "get_robot_state": 0.003482250519740729, "sim_render-ego0": 0.0036212779857494218, "get_duckie_state": 1.0596381293402778e-06, "in-drivable-lane": 2.349999999999993, "deviation-heading": 0.2667869184952947, "agent_compute-ego0": 0.011943281432728709, "complete-iteration": 0.14589221977893216, "set_robot_commands": 0.002073579364352756, "deviation-center-line": 0.08585759405263459, "driven_lanedir_consec": 0.6211664614490222, "sim_compute_sim_state": 0.004823996696943118, "sim_compute_performance-ego0": 0.001845545238918728}}
set_robot_commands_max	0.002080601273160992
set_robot_commands_mean	0.002064428562797939
set_robot_commands_median	0.002066960777611677
set_robot_commands_min	0.0020431914228074095
sim_compute_performance-ego0_max	0.0018864563017180471
sim_compute_performance-ego0_mean	0.0018514298826596504
sim_compute_performance-ego0_median	0.0018417961759551445
sim_compute_performance-ego0_min	0.0018356708770102645
sim_compute_sim_state_max	0.009404347297993111
sim_compute_sim_state_mean	0.0077351677124014515
sim_compute_sim_state_median	0.008356163427334789
sim_compute_sim_state_min	0.004823996696943118
sim_render-ego0_max	0.0036653009327975183
sim_render-ego0_mean	0.0036270106670038688
sim_render-ego0_median	0.003629619736510657
sim_render-ego0_min	0.003583502262196642
simulation-passed	1
step_physics_max	0.12169810907164616
step_physics_mean	0.1046293479875153
step_physics_median	0.10442400382150764
step_physics_min	0.08797127523539978
survival_time_max	6.549999999999985
survival_time_mean	4.624999999999991
survival_time_min	3.2999999999999963

No reset possible

55674

11308

template-pytorch

LFv-sim

success

yes

2020-12-03 05:39:55+00:00

2020-12-03 05:43:42+00:00

0:03:47

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4864664613945788
survival_time_median	4.324999999999992
deviation-center-line_median	0.10458832883362174
in-drivable-lane_median	2.5499999999999936

other stats

agent_compute-ego0_max	0.013903843892085087
agent_compute-ego0_mean	0.01361586169196828
agent_compute-ego0_median	0.013736241206908415
agent_compute-ego0_min	0.013087120461971202
complete-iteration_max	0.19998844701852372
complete-iteration_mean	0.17689944619222273
complete-iteration_median	0.17714667163787212
complete-iteration_min	0.15331599447462294
deviation-center-line_max	0.1328316105393819
deviation-center-line_mean	0.09807246574139994
deviation-center-line_min	0.05028159475897433
deviation-heading_max	1.3855208131706416
deviation-heading_mean	0.6845135825868174
deviation-heading_median	0.5428732993406667
deviation-heading_min	0.2667869184952947
driven_any_max	3.2328235111062673
driven_any_mean	1.7565216668085024
driven_any_median	1.3642763954266144
driven_any_min	1.0647103652745131
driven_lanedir_consec_max	0.6509706223069186
driven_lanedir_consec_mean	0.4858535529587733
driven_lanedir_consec_min	0.31951066673901685
driven_lanedir_max	0.6509706223069186
driven_lanedir_mean	0.4858535529587733
driven_lanedir_median	0.4864664613945788
driven_lanedir_min	0.31951066673901685
get_duckie_state_max	1.2808657707052028e-06
get_duckie_state_mean	1.218348534021594e-06
get_duckie_state_median	1.2031611741848475e-06
get_duckie_state_min	1.1862060170114776e-06
get_robot_state_max	0.003695299099018047
get_robot_state_mean	0.003592481163532395
get_robot_state_median	0.003562817746928928
get_robot_state_min	0.003548990061253677
get_state_dump_max	0.004662545759286454
get_state_dump_mean	0.0045777215989045465
get_state_dump_median	0.0045822792107244
get_state_dump_min	0.004483782214882933
get_ui_image_max	0.03600915949395363
get_ui_image_mean	0.031383769046769566
get_ui_image_median	0.03109398116250213
get_ui_image_min	0.02733795436812036
in-drivable-lane_max	6.399999999999983
in-drivable-lane_mean	3.249999999999991
in-drivable-lane_min	1.4999999999999951
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.2328235111062673, "get_ui_image": 0.028862400488419968, "step_physics": 0.09077106977437996, "survival_time": 7.649999999999981, "driven_lanedir": 0.31951066673901685, "get_state_dump": 0.004633507171234527, "get_robot_state": 0.003695299099018047, "sim_render-ego0": 0.00378620314907718, "get_duckie_state": 1.2106709666066355e-06, "in-drivable-lane": 6.399999999999983, "deviation-heading": 0.7913571895125129, "agent_compute-ego0": 0.013903843892085087, "complete-iteration": 0.15962138268854711, "set_robot_commands": 0.0021969977911416587, "deviation-center-line": 0.1233190636146089, "driven_lanedir_consec": 0.31951066673901685, "sim_compute_sim_state": 0.009711412640361045, "sim_compute_performance-ego0": 0.0019810044920289672}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.280776163697676, "get_ui_image": 0.03600915949395363, "step_physics": 0.12007988513784204, "survival_time": 4.6499999999999915, "driven_lanedir": 0.35176646134013545, "get_state_dump": 0.004531051250214272, "get_robot_state": 0.003559541194996935, "sim_render-ego0": 0.003696827178305768, "get_duckie_state": 1.2808657707052028e-06, "in-drivable-lane": 2.749999999999994, "deviation-heading": 1.3855208131706416, "agent_compute-ego0": 0.013087120461971202, "complete-iteration": 0.19467196058719716, "set_robot_commands": 0.0021358068953169153, "deviation-center-line": 0.1328316105393819, "driven_lanedir_consec": 0.35176646134013545, "sim_compute_sim_state": 0.009577530495663908, "sim_compute_performance-ego0": 0.0019183666148084276}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0647103652745131, "get_ui_image": 0.03332556183658429, "step_physics": 0.12900609044886346, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6509706223069186, "get_state_dump": 0.004662545759286454, "get_robot_state": 0.00356609429886092, "sim_render-ego0": 0.003729314946416599, "get_duckie_state": 1.1956513817630598e-06, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 0.2943894091688206, "agent_compute-ego0": 0.013862599187822485, "complete-iteration": 0.19998844701852372, "set_robot_commands": 0.00211774413265399, "deviation-center-line": 0.05028159475897433, "driven_lanedir_consec": 0.6509706223069186, "sim_compute_sim_state": 0.007738768164791278, "sim_compute_performance-ego0": 0.0019003846752109813}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4477766271555526, "get_ui_image": 0.02733795436812036, "step_physics": 0.0916830610345911, "survival_time": 3.999999999999994, "driven_lanedir": 0.6211664614490222, "get_state_dump": 0.004483782214882933, "get_robot_state": 0.003548990061253677, "sim_render-ego0": 0.003699370372442552, "get_duckie_state": 1.1862060170114776e-06, "in-drivable-lane": 2.349999999999993, "deviation-heading": 0.2667869184952947, "agent_compute-ego0": 0.013609883225994346, "complete-iteration": 0.15331599447462294, "set_robot_commands": 0.0021104341671790605, "deviation-center-line": 0.08585759405263459, "driven_lanedir_consec": 0.6211664614490222, "sim_compute_sim_state": 0.00488567057950997, "sim_compute_performance-ego0": 0.0018779613353587963}}
set_robot_commands_max	0.0021969977911416587
set_robot_commands_mean	0.002140245746572906
set_robot_commands_median	0.002126775513985453
set_robot_commands_min	0.0021104341671790605
sim_compute_performance-ego0_max	0.0019810044920289672
sim_compute_performance-ego0_mean	0.001919429279351793
sim_compute_performance-ego0_median	0.0019093756450097043
sim_compute_performance-ego0_min	0.0018779613353587963
sim_compute_sim_state_max	0.009711412640361045
sim_compute_sim_state_mean	0.00797834547008155
sim_compute_sim_state_median	0.008658149330227592
sim_compute_sim_state_min	0.00488567057950997
sim_render-ego0_max	0.00378620314907718
sim_render-ego0_mean	0.003727928911560524
sim_render-ego0_median	0.003714342659429575
sim_render-ego0_min	0.003696827178305768
simulation-passed	1
step_physics_max	0.12900609044886346
step_physics_mean	0.10788502659891916
step_physics_median	0.10588147308621658
step_physics_min	0.09077106977437996
survival_time_max	7.649999999999981
survival_time_mean	4.899999999999991
survival_time_min	3.2999999999999963

No reset possible

55569

11307

template-pytorch

LFv-sim

success

yes

2020-12-03 05:34:08+00:00

2020-12-03 05:39:44+00:00

0:05:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4864664613945788
survival_time_median	4.324999999999992
deviation-center-line_median	0.10454845700197168
in-drivable-lane_median	2.5499999999999936

other stats

agent_compute-ego0_max	0.013815072626849403
agent_compute-ego0_mean	0.013325280093210424
agent_compute-ego0_median	0.013196693776879438
agent_compute-ego0_min	0.013092660192233412
complete-iteration_max	0.19826380886248687
complete-iteration_mean	0.17793596452210392
complete-iteration_median	0.17861922195733232
complete-iteration_min	0.1562416053112642
deviation-center-line_max	0.1328316105393819
deviation-center-line_mean	0.09805252982557491
deviation-center-line_min	0.05028159475897433
deviation-heading_max	1.3855208131706416
deviation-heading_mean	0.6839886295268475
deviation-heading_median	0.5418233932207268
deviation-heading_min	0.2667869184952947
driven_any_max	3.20846375770855
driven_any_mean	1.7504317284590731
driven_any_median	1.3642763954266144
driven_any_min	1.0647103652745131
driven_lanedir_consec_max	0.6509706223069186
driven_lanedir_consec_mean	0.48611355786855304
driven_lanedir_consec_min	0.320550686378136
driven_lanedir_max	0.6509706223069186
driven_lanedir_mean	0.48611355786855304
driven_lanedir_median	0.4864664613945788
driven_lanedir_min	0.320550686378136
get_duckie_state_max	1.430511474609375e-06
get_duckie_state_mean	1.315504598478302e-06
get_duckie_state_median	1.3019524368585323e-06
get_duckie_state_min	1.2276020455867683e-06
get_robot_state_max	0.003607044032975739
get_robot_state_mean	0.0035577906611993938
get_robot_state_median	0.003552282877346647
get_robot_state_min	0.0035195528571285418
get_state_dump_max	0.0046337386708200715
get_state_dump_mean	0.004562257558332445
get_state_dump_median	0.004564016638835239
get_state_dump_min	0.004487258284839231
get_ui_image_max	0.03631630349666514
get_ui_image_mean	0.03139360129845881
get_ui_image_median	0.030936601208240364
get_ui_image_min	0.027384899280689386
in-drivable-lane_max	6.349999999999983
in-drivable-lane_mean	3.237499999999991
in-drivable-lane_min	1.4999999999999951
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 3.20846375770855, "get_ui_image": 0.028905118992126062, "step_physics": 0.09133755771163242, "survival_time": 7.599999999999981, "driven_lanedir": 0.320550686378136, "get_state_dump": 0.004574989181718016, "get_robot_state": 0.003607044032975739, "sim_render-ego0": 0.003836756438211678, "get_duckie_state": 1.305848165275225e-06, "in-drivable-lane": 6.349999999999983, "deviation-heading": 0.7892573772726329, "agent_compute-ego0": 0.013815072626849403, "complete-iteration": 0.1602085743075103, "set_robot_commands": 0.0022491458194707735, "deviation-center-line": 0.1232393199513088, "driven_lanedir_consec": 0.320550686378136, "sim_compute_sim_state": 0.009797724243862178, "sim_compute_performance-ego0": 0.0020029404584099263}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.280776163697676, "get_ui_image": 0.03631630349666514, "step_physics": 0.12224558312842186, "survival_time": 4.6499999999999915, "driven_lanedir": 0.35176646134013545, "get_state_dump": 0.00455304409595246, "get_robot_state": 0.00352134349498343, "sim_render-ego0": 0.003667166892518389, "get_duckie_state": 1.2276020455867683e-06, "in-drivable-lane": 2.749999999999994, "deviation-heading": 1.3855208131706416, "agent_compute-ego0": 0.013116374928900536, "complete-iteration": 0.19702986960715435, "set_robot_commands": 0.002105588608599724, "deviation-center-line": 0.1328316105393819, "driven_lanedir_consec": 0.35176646134013545, "sim_compute_sim_state": 0.009546381361941074, "sim_compute_performance-ego0": 0.0018759585441427027}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0647103652745131, "get_ui_image": 0.032968083424354665, "step_physics": 0.1288004882300078, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6509706223069186, "get_state_dump": 0.004487258284839231, "get_robot_state": 0.0035195528571285418, "sim_render-ego0": 0.003737794819162853, "get_duckie_state": 1.430511474609375e-06, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 0.2943894091688206, "agent_compute-ego0": 0.013092660192233412, "complete-iteration": 0.19826380886248687, "set_robot_commands": 0.0021349707646156424, "deviation-center-line": 0.05028159475897433, "driven_lanedir_consec": 0.6509706223069186, "sim_compute_sim_state": 0.007533646341580064, "sim_compute_performance-ego0": 0.0019088289630946828}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4477766271555526, "get_ui_image": 0.027384899280689386, "step_physics": 0.0944654588346128, "survival_time": 3.999999999999994, "driven_lanedir": 0.6211664614490222, "get_state_dump": 0.0046337386708200715, "get_robot_state": 0.0035832222597098643, "sim_render-ego0": 0.0037374643631923345, "get_duckie_state": 1.2980567084418403e-06, "in-drivable-lane": 2.349999999999993, "deviation-heading": 0.2667869184952947, "agent_compute-ego0": 0.013277012624858338, "complete-iteration": 0.1562416053112642, "set_robot_commands": 0.0022123095429973836, "deviation-center-line": 0.08585759405263459, "driven_lanedir_consec": 0.6211664614490222, "sim_compute_sim_state": 0.004927808855786735, "sim_compute_performance-ego0": 0.001934646088400005}}
set_robot_commands_max	0.0022491458194707735
set_robot_commands_mean	0.0021755036839208805
set_robot_commands_median	0.002173640153806513
set_robot_commands_min	0.002105588608599724
sim_compute_performance-ego0_max	0.0020029404584099263
sim_compute_performance-ego0_mean	0.0019305935135118292
sim_compute_performance-ego0_median	0.001921737525747344
sim_compute_performance-ego0_min	0.0018759585441427027
sim_compute_sim_state_max	0.009797724243862178
sim_compute_sim_state_mean	0.007951390200792514
sim_compute_sim_state_median	0.00854001385176057
sim_compute_sim_state_min	0.004927808855786735
sim_render-ego0_max	0.003836756438211678
sim_render-ego0_mean	0.0037447956282713134
sim_render-ego0_median	0.0037376295911775935
sim_render-ego0_min	0.003667166892518389
simulation-passed	1
step_physics_max	0.1288004882300078
step_physics_mean	0.10921227197616871
step_physics_median	0.10835552098151734
step_physics_min	0.09133755771163242
survival_time_max	7.599999999999981
survival_time_mean	4.88749999999999
survival_time_min	3.2999999999999963

No reset possible

54919

11439

Charlie Gauthier 🇨🇦

baseline-RL-sim-pytorch

LFv-sim

success

yes

2020-12-03 04:53:05+00:00

2020-12-03 05:33:18+00:00

0:40:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	-3.3932304394795496
survival_time_median	59.99999999999873
deviation-center-line_median	2.639544155232162
in-drivable-lane_median	27.424999999999216

other stats

agent_compute-ego0_max	0.01132537423323632
agent_compute-ego0_mean	0.010887328284070654
agent_compute-ego0_median	0.01081074435546138
agent_compute-ego0_min	0.010602450192123528
complete-iteration_max	0.29521995460262507
complete-iteration_mean	0.2471593234263094
complete-iteration_median	0.2504952121634567
complete-iteration_min	0.1924269147756991
deviation-center-line_max	5.898942745221874
deviation-center-line_mean	3.325008025297271
deviation-center-line_min	2.1220010455028846
deviation-heading_max	33.29356657251972
deviation-heading_mean	26.916356915078826
deviation-heading_median	25.59322942519295
deviation-heading_min	23.185402237409676
driven_any_max	14.41135301112388
driven_any_mean	12.352203270010513
driven_any_median	11.81348553900737
driven_any_min	11.37048899090342
driven_lanedir_consec_max	-2.825970514753078
driven_lanedir_consec_mean	-3.547314574430258
driven_lanedir_consec_min	-4.576826904008857
driven_lanedir_max	-3.112971636452116
driven_lanedir_mean	-4.68852708819181
driven_lanedir_median	-3.590518758894233
driven_lanedir_min	-8.460099198526658
get_duckie_state_max	1.4696192681839028e-06
get_duckie_state_mean	1.4430180278844776e-06
get_duckie_state_median	1.4530431221764254e-06
get_duckie_state_min	1.3963665990011578e-06
get_robot_state_max	0.003614753410282183
get_robot_state_mean	0.003512150937571911
get_robot_state_median	0.003478994178930786
get_robot_state_min	0.003475861982143888
get_state_dump_max	0.004559194118553753
get_state_dump_mean	0.004394738898487711
get_state_dump_median	0.00434638171469937
get_state_dump_min	0.00432699804599835
get_ui_image_max	0.03525772499700668
get_ui_image_mean	0.029996081504297695
get_ui_image_median	0.0298611229405018
get_ui_image_min	0.02500435513918049
in-drivable-lane_max	34.14999999999919
in-drivable-lane_mean	24.474999999999355
in-drivable-lane_min	8.899999999999796
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 14.41135301112388, "get_ui_image": 0.027842307269424323, "step_physics": 0.17668713558524177, "survival_time": 59.99999999999873, "driven_lanedir": -8.460099198526658, "get_state_dump": 0.004559194118553753, "get_robot_state": 0.003614753410282183, "sim_render-ego0": 0.00363345527331299, "get_duckie_state": 1.438452143355472e-06, "in-drivable-lane": 8.899999999999796, "deviation-heading": 33.29356657251972, "agent_compute-ego0": 0.01132537423323632, "complete-iteration": 0.23990495258525052, "set_robot_commands": 0.0021437328125813123, "deviation-center-line": 5.898942745221874, "driven_lanedir_consec": -4.576826904008857, "sim_compute_sim_state": 0.008120626930789488, "sim_compute_performance-ego0": 0.0019019458017976556}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.084552635718106, "get_ui_image": 0.03525772499700668, "step_physics": 0.22248173593779985, "survival_time": 59.99999999999873, "driven_lanedir": -3.9035112368521583, "get_state_dump": 0.004356224074351798, "get_robot_state": 0.003481153643796287, "sim_render-ego0": 0.0035750740870746545, "get_duckie_state": 1.3963665990011578e-06, "in-drivable-lane": 26.099999999999312, "deviation-heading": 26.384793870769403, "agent_compute-ego0": 0.010713794447798018, "complete-iteration": 0.29521995460262507, "set_robot_commands": 0.0020220777970567333, "deviation-center-line": 2.371257718910199, "driven_lanedir_consec": -3.537120223433383, "sim_compute_sim_state": 0.01141352399402018, "sim_compute_performance-ego0": 0.0018434574165312476}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.542418442296633, "get_ui_image": 0.03187993861157928, "step_physics": 0.1943027808406172, "survival_time": 59.99999999999873, "driven_lanedir": -3.277526280936308, "get_state_dump": 0.004336539355046942, "get_robot_state": 0.003475861982143888, "sim_render-ego0": 0.0035522071447698, "get_duckie_state": 1.4696192681839028e-06, "in-drivable-lane": 34.14999999999919, "deviation-heading": 23.185402237409676, "agent_compute-ego0": 0.010907694263124743, "complete-iteration": 0.26108547174166286, "set_robot_commands": 0.002020925407504956, "deviation-center-line": 2.1220010455028846, "driven_lanedir_consec": -3.2493406555257156, "sim_compute_sim_state": 0.008704194617608902, "sim_compute_performance-ego0": 0.0018308905141736745}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.37048899090342, "get_ui_image": 0.02500435513918049, "step_physics": 0.13564434813817872, "survival_time": 59.99999999999873, "driven_lanedir": -3.112971636452116, "get_state_dump": 0.00432699804599835, "get_robot_state": 0.003476834714065285, "sim_render-ego0": 0.0035336202229190924, "get_duckie_state": 1.4676341009973783e-06, "in-drivable-lane": 28.74999999999912, "deviation-heading": 24.801664979616493, "agent_compute-ego0": 0.010602450192123528, "complete-iteration": 0.1924269147756991, "set_robot_commands": 0.0020311515992328982, "deviation-center-line": 2.907830591554125, "driven_lanedir_consec": -2.825970514753078, "sim_compute_sim_state": 0.005903929298267475, "sim_compute_performance-ego0": 0.0018276288844862152}}
set_robot_commands_max	0.0021437328125813123
set_robot_commands_mean	0.002054471904093975
set_robot_commands_median	0.002026614698144816
set_robot_commands_min	0.002020925407504956
sim_compute_performance-ego0_max	0.0019019458017976556
sim_compute_performance-ego0_mean	0.0018509806542471984
sim_compute_performance-ego0_median	0.001837173965352461
sim_compute_performance-ego0_min	0.0018276288844862152
sim_compute_sim_state_max	0.01141352399402018
sim_compute_sim_state_mean	0.008535568710171512
sim_compute_sim_state_median	0.008412410774199195
sim_compute_sim_state_min	0.005903929298267475
sim_render-ego0_max	0.00363345527331299
sim_render-ego0_mean	0.0035735891820191344
sim_render-ego0_median	0.003563640615922227
sim_render-ego0_min	0.0035336202229190924
simulation-passed	1
step_physics_max	0.22248173593779985
step_physics_mean	0.1822790001254594
step_physics_median	0.1854949582129295
step_physics_min	0.13564434813817872
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

54842

11352

Charlie Gauthier 🇨🇦

Baseline solution using reinforcement learning

LFv-sim

success

yes

2020-12-03 04:41:26+00:00

2020-12-03 04:52:37+00:00

0:11:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4953415167970959
survival_time_median	3.8749999999999942
deviation-center-line_median	0.10019431734994318
in-drivable-lane_median	2.5999999999999948

other stats

agent_compute-ego0_max	0.012525453800108374
agent_compute-ego0_mean	0.012143681882755438
agent_compute-ego0_median	0.012395107173734396
agent_compute-ego0_min	0.01125905938344459
complete-iteration_max	0.23632793310211925
complete-iteration_mean	0.2021110316950288
complete-iteration_median	0.20139139725968072
complete-iteration_min	0.16933339915863457
deviation-center-line_max	1.3347053459531408
deviation-center-line_mean	0.3964925199382131
deviation-center-line_min	0.050876099099825205
deviation-heading_max	7.092505358170257
deviation-heading_mean	2.1832773338209277
deviation-heading_median	0.6958540662065884
deviation-heading_min	0.24889584470027704
driven_any_max	32.21451956876099
driven_any_mean	9.164620243328644
driven_any_median	1.53081754802698
driven_any_min	1.3823263084996291
driven_lanedir_consec_max	9.151844330275928
driven_lanedir_consec_mean	2.6196278682405016
driven_lanedir_consec_min	0.3359841090918858
driven_lanedir_max	10.09337842757754
driven_lanedir_mean	2.85860808999487
driven_lanedir_median	0.5025349116550267
driven_lanedir_min	0.3359841090918858
get_duckie_state_max	1.2429555257161455e-06
get_duckie_state_mean	1.166695747432473e-06
get_duckie_state_median	1.1559676614207563e-06
get_duckie_state_min	1.1118921411722328e-06
get_robot_state_max	0.0035006301190632764
get_robot_state_mean	0.003482871488900311
get_robot_state_median	0.0034834329714712947
get_robot_state_min	0.0034639898935953776
get_state_dump_max	0.004396213877707298
get_state_dump_mean	0.0043807603151646
get_state_dump_median	0.004390832336698533
get_state_dump_min	0.004345162709554037
get_ui_image_max	0.03620511148034072
get_ui_image_mean	0.031075520405681095
get_ui_image_median	0.03070216410893915
get_ui_image_min	0.026692641924505364
in-drivable-lane_max	39.1499999999992
in-drivable-lane_mean	11.612499999999796
in-drivable-lane_min	2.0999999999999934
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 32.21451956876099, "get_ui_image": 0.028109942943626995, "step_physics": 0.11880401786816903, "survival_time": 59.99999999999873, "driven_lanedir": 10.09337842757754, "get_state_dump": 0.004396213877707298, "get_robot_state": 0.0035006301190632764, "sim_render-ego0": 0.0036171900044869223, "get_duckie_state": 1.1118921411722328e-06, "in-drivable-lane": 39.1499999999992, "deviation-heading": 7.092505358170257, "agent_compute-ego0": 0.012287798372533895, "complete-iteration": 0.18289603698660592, "set_robot_commands": 0.0023690077982576165, "deviation-center-line": 1.3347053459531408, "driven_lanedir_consec": 9.151844330275928, "sim_compute_sim_state": 0.007835592854330681, "sim_compute_performance-ego0": 0.001898562282844944}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6253119880518745, "get_ui_image": 0.03620511148034072, "step_physics": 0.16277252174005274, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188196930254084, "get_state_dump": 0.004385500419430617, "get_robot_state": 0.0034823359512701265, "sim_render-ego0": 0.003569748343490973, "get_duckie_state": 1.1688325463271722e-06, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 1.1348402688492234, "agent_compute-ego0": 0.012525453800108374, "complete-iteration": 0.23632793310211925, "set_robot_commands": 0.0025493517154600563, "deviation-center-line": 0.14647640362993186, "driven_lanedir_consec": 0.6044329033095468, "sim_compute_sim_state": 0.008931284997521377, "sim_compute_performance-ego0": 0.0018317583130627144}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.436323108002086, "get_ui_image": 0.033294385274251305, "step_physics": 0.1512198575337728, "survival_time": 3.699999999999995, "driven_lanedir": 0.38625013028464505, "get_state_dump": 0.004345162709554037, "get_robot_state": 0.0034639898935953776, "sim_render-ego0": 0.0035135650634765623, "get_duckie_state": 1.2429555257161455e-06, "in-drivable-lane": 2.5999999999999943, "deviation-heading": 0.25686786356395347, "agent_compute-ego0": 0.012502415974934896, "complete-iteration": 0.21988675753275552, "set_robot_commands": 0.0023477776845296223, "deviation-center-line": 0.050876099099825205, "driven_lanedir_consec": 0.38625013028464505, "sim_compute_sim_state": 0.007290611267089844, "sim_compute_performance-ego0": 0.0018352381388346355}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3823263084996291, "get_ui_image": 0.026692641924505364, "step_physics": 0.11102690762036468, "survival_time": 3.599999999999995, "driven_lanedir": 0.3359841090918858, "get_state_dump": 0.004396164253966449, "get_robot_state": 0.003484529991672463, "sim_render-ego0": 0.00353583571029036, "get_duckie_state": 1.1431027765143409e-06, "in-drivable-lane": 2.599999999999995, "deviation-heading": 0.24889584470027704, "agent_compute-ego0": 0.01125905938344459, "complete-iteration": 0.16933339915863457, "set_robot_commands": 0.0021404076928961766, "deviation-center-line": 0.053912231069954485, "driven_lanedir_consec": 0.3359841090918858, "sim_compute_sim_state": 0.004887976058541912, "sim_compute_performance-ego0": 0.00183788391008769}}
set_robot_commands_max	0.0025493517154600563
set_robot_commands_mean	0.0023516362227858677
set_robot_commands_median	0.002358392741393619
set_robot_commands_min	0.0021404076928961766
sim_compute_performance-ego0_max	0.001898562282844944
sim_compute_performance-ego0_mean	0.0018508606612074956
sim_compute_performance-ego0_median	0.0018365610244611627
sim_compute_performance-ego0_min	0.0018317583130627144
sim_compute_sim_state_max	0.008931284997521377
sim_compute_sim_state_mean	0.007236366294370954
sim_compute_sim_state_median	0.007563102060710263
sim_compute_sim_state_min	0.004887976058541912
sim_render-ego0_max	0.0036171900044869223
sim_render-ego0_mean	0.0035590847804362045
sim_render-ego0_median	0.0035527920268906667
sim_render-ego0_min	0.0035135650634765623
simulation-passed	1
step_physics_max	0.16277252174005274
step_physics_mean	0.13595582619058982
step_physics_median	0.13501193770097092
step_physics_min	0.11102690762036468
survival_time_max	59.99999999999873
survival_time_mean	17.83749999999968
survival_time_min	3.599999999999995

No reset possible

54682

11449

Cliff Chandler 🇺🇸

template-pytorch

LFv-sim

success

yes

2020-12-03 04:15:23+00:00

2020-12-03 04:41:04+00:00

0:25:41

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.9159810791291468
survival_time_median	51.6499999999992
deviation-center-line_median	0.6914696454497408
in-drivable-lane_median	39.57499999999916

other stats

agent_compute-ego0_max	0.012480280616066671
agent_compute-ego0_mean	0.012208000344316404
agent_compute-ego0_median	0.01215779052015857
agent_compute-ego0_min	0.012036139720881809
complete-iteration_max	0.26951519792730155
complete-iteration_mean	0.2281482094208469
complete-iteration_median	0.230698763500756
complete-iteration_min	0.181680112754574
deviation-center-line_max	1.0934507028407006
deviation-center-line_mean	0.6379857210107042
deviation-center-line_min	0.07555289030263485
deviation-heading_max	9.174864599159545
deviation-heading_mean	4.206918354894706
deviation-heading_median	3.3885046183086747
deviation-heading_min	0.8757995838019291
driven_any_max	10.040997045510029
driven_any_mean	6.648307290383675
driven_any_median	8.135204636578063
driven_any_min	0.28182284286854825
driven_lanedir_consec_max	1.4008762071524252
driven_lanedir_consec_mean	0.8403101659178447
driven_lanedir_consec_min	0.12840229826066007
driven_lanedir_max	1.5968116611455017
driven_lanedir_mean	0.8892940294161138
driven_lanedir_median	0.9159810791291468
driven_lanedir_min	0.12840229826066007
get_duckie_state_max	1.1645936360958676e-06
get_duckie_state_mean	1.107595336615565e-06
get_duckie_state_median	1.1171474201241953e-06
get_duckie_state_min	1.0314928701180003e-06
get_robot_state_max	0.0035834248913614876
get_robot_state_mean	0.003551502866321169
get_robot_state_median	0.0035557761076458537
get_robot_state_min	0.003511034358631481
get_state_dump_max	0.00446630824695934
get_state_dump_mean	0.004424807451851823
get_state_dump_median	0.004429494897396178
get_state_dump_min	0.004373931765655594
get_ui_image_max	0.03517228906804865
get_ui_image_mean	0.029977307547465325
get_ui_image_median	0.029842137774765538
get_ui_image_min	0.02505266557228158
in-drivable-lane_max	55.899999999998734
in-drivable-lane_mean	34.112499999999265
in-drivable-lane_min	1.399999999999998
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 9.349799227831856, "get_ui_image": 0.027673534112210872, "step_physics": 0.15440799195403165, "survival_time": 59.99999999999873, "driven_lanedir": 0.5103444420553513, "get_state_dump": 0.004373931765655594, "get_robot_state": 0.0035672271182197617, "sim_render-ego0": 0.003574960138478148, "get_duckie_state": 1.0314928701180003e-06, "in-drivable-lane": 55.899999999998734, "deviation-heading": 2.073637675205364, "agent_compute-ego0": 0.012254877749529608, "complete-iteration": 0.21766791335748295, "set_robot_commands": 0.0021185019331907452, "deviation-center-line": 0.3780780568226991, "driven_lanedir_consec": 0.5103444420553513, "sim_compute_sim_state": 0.007763922164878877, "sim_compute_performance-ego0": 0.0018590135836382888}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.28182284286854825, "get_ui_image": 0.03517228906804865, "step_physics": 0.19718302379954944, "survival_time": 2.6999999999999984, "driven_lanedir": 0.12840229826066007, "get_state_dump": 0.00446630824695934, "get_robot_state": 0.003511034358631481, "sim_render-ego0": 0.003598520972511985, "get_duckie_state": 1.1140649968927555e-06, "in-drivable-lane": 1.399999999999998, "deviation-heading": 0.8757995838019291, "agent_compute-ego0": 0.012480280616066671, "complete-iteration": 0.26951519792730155, "set_robot_commands": 0.0020916852084073155, "deviation-center-line": 0.07555289030263485, "driven_lanedir_consec": 0.12840229826066007, "sim_compute_sim_state": 0.00909455039284446, "sim_compute_performance-ego0": 0.001840816844593395}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.920610045324271, "get_ui_image": 0.0320107414373202, "step_physics": 0.17557205845877924, "survival_time": 43.29999999999968, "driven_lanedir": 1.5968116611455017, "get_state_dump": 0.0044137966811588205, "get_robot_state": 0.0035443250970719456, "sim_render-ego0": 0.0035702791730975337, "get_duckie_state": 1.1645936360958676e-06, "in-drivable-lane": 29.14999999999966, "deviation-heading": 9.174864599159545, "agent_compute-ego0": 0.012060703290787535, "complete-iteration": 0.24372961364402904, "set_robot_commands": 0.0020896219739726944, "deviation-center-line": 1.0934507028407006, "driven_lanedir_consec": 1.4008762071524252, "sim_compute_sim_state": 0.008531021824345043, "sim_compute_performance-ego0": 0.0018600053578237072}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.040997045510029, "get_ui_image": 0.02505266557228158, "step_physics": 0.1227155940717305, "survival_time": 59.99999999999873, "driven_lanedir": 1.321617716202942, "get_state_dump": 0.004445193113633536, "get_robot_state": 0.0035834248913614876, "sim_render-ego0": 0.0035817245956662296, "get_duckie_state": 1.1202298433556349e-06, "in-drivable-lane": 49.99999999999865, "deviation-heading": 4.703371561411985, "agent_compute-ego0": 0.012036139720881809, "complete-iteration": 0.181680112754574, "set_robot_commands": 0.002140347308461414, "deviation-center-line": 1.0048612340767824, "driven_lanedir_consec": 1.321617716202942, "sim_compute_sim_state": 0.006177637598893723, "sim_compute_performance-ego0": 0.001871459192280765}}
set_robot_commands_max	0.002140347308461414
set_robot_commands_mean	0.002110039106008042
set_robot_commands_median	0.00210509357079903
set_robot_commands_min	0.0020896219739726944
sim_compute_performance-ego0_max	0.001871459192280765
sim_compute_performance-ego0_mean	0.001857823744584039
sim_compute_performance-ego0_median	0.001859509470730998
sim_compute_performance-ego0_min	0.001840816844593395
sim_compute_sim_state_max	0.00909455039284446
sim_compute_sim_state_mean	0.007891782995240525
sim_compute_sim_state_median	0.00814747199461196
sim_compute_sim_state_min	0.006177637598893723
sim_render-ego0_max	0.003598520972511985
sim_render-ego0_mean	0.003581371219938474
sim_render-ego0_median	0.0035783423670721886
sim_render-ego0_min	0.0035702791730975337
simulation-passed	1
step_physics_max	0.19718302379954944
step_physics_mean	0.1624696670710227
step_physics_median	0.16499002520640543
step_physics_min	0.1227155940717305
survival_time_max	59.99999999999873
survival_time_mean	41.49999999999928
survival_time_min	2.6999999999999984

No reset possible

54506

11472

sim-exercise-2

LFv-sim

success

yes

2020-12-03 03:32:53+00:00

2020-12-03 04:13:48+00:00

0:40:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.0
survival_time_median	59.99999999999873
deviation-center-line_median	1.2422730096440104
in-drivable-lane_median	0.0

other stats

agent_compute-ego0_max	0.0120188022632583
agent_compute-ego0_mean	0.01167696416626167
agent_compute-ego0_median	0.011663925240776325
agent_compute-ego0_min	0.01136120392023574
complete-iteration_max	0.3303719545581954
complete-iteration_mean	0.27658125845022147
complete-iteration_median	0.27825121736645597
complete-iteration_min	0.21945064450977844
deviation-center-line_max	4.053503393024394
deviation-center-line_mean	1.731069028434027
deviation-center-line_min	0.386226701423694
deviation-heading_max	27.859809596736422
deviation-heading_mean	14.925250437835436
deviation-heading_median	14.309269950178932
deviation-heading_min	3.22265225424745
driven_any_max	2.6645352591003757e-13
driven_any_mean	1.9984014443252818e-13
driven_any_median	2.6645352591003757e-13
driven_any_min	0.0
driven_lanedir_consec_max	0.000286102294921875
driven_lanedir_consec_mean	7.152557373046875e-05
driven_lanedir_consec_min	0.0
driven_lanedir_max	0.000286102294921875
driven_lanedir_mean	7.152557373046875e-05
driven_lanedir_median	0.0
driven_lanedir_min	0.0
get_duckie_state_max	1.2383472909538276e-06
get_duckie_state_mean	1.1531836186519372e-06
get_duckie_state_median	1.1528858435739584e-06
get_duckie_state_min	1.068615496506004e-06
get_robot_state_max	0.003673980079225259
get_robot_state_mean	0.003594354179677717
get_robot_state_median	0.003586454455004842
get_robot_state_min	0.003530527729475925
get_state_dump_max	0.004520757112971552
get_state_dump_mean	0.004487370720116126
get_state_dump_median	0.004505825677978109
get_state_dump_min	0.004417074411536732
get_ui_image_max	0.0356640333339237
get_ui_image_mean	0.03036756767619162
get_ui_image_median	0.030064201871123936
get_ui_image_min	0.025677833628594923
in-drivable-lane_max	0.0
in-drivable-lane_mean	0.0
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02783328786082907, "step_physics": 0.19481440031161215, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004513588078710856, "get_robot_state": 0.003673980079225259, "sim_render-ego0": 0.0037685810378151672, "get_duckie_state": 1.068615496506004e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.01173570015150542, "complete-iteration": 0.2591081570824616, "set_robot_commands": 0.00226676692375037, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008425538883320398, "sim_compute_performance-ego0": 0.00199549839359636}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.0356640333339237, "step_physics": 0.2554146294589841, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004417074411536732, "get_robot_state": 0.003530527729475925, "sim_render-ego0": 0.0037373057213750706, "get_duckie_state": 1.2075771995627016e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.0120188022632583, "complete-iteration": 0.3303719545581954, "set_robot_commands": 0.00219527986226332, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01137816737236131, "sim_compute_performance-ego0": 0.0019321243133671971}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.032295115881418805, "step_physics": 0.22883686594522368, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004498063277245362, "get_robot_state": 0.0035722069101071577, "sim_render-ego0": 0.003701707504869599, "get_duckie_state": 1.2383472909538276e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.011592150330047226, "complete-iteration": 0.2973942776504504, "set_robot_commands": 0.002179124373182667, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008690136854694249, "sim_compute_performance-ego0": 0.0019472931743561477}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025677833628594923, "step_physics": 0.16014247770412676, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004520757112971552, "get_robot_state": 0.0036007019999025267, "sim_render-ego0": 0.003696146456029989, "get_duckie_state": 1.0981944875852154e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01136120392023574, "complete-iteration": 0.21945064450977844, "set_robot_commands": 0.0024083631421803037, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0060342648543485694, "sim_compute_performance-ego0": 0.0019308075519723757}}
set_robot_commands_max	0.0024083631421803037
set_robot_commands_mean	0.002262383575344165
set_robot_commands_median	0.002231023393006845
set_robot_commands_min	0.002179124373182667
sim_compute_performance-ego0_max	0.00199549839359636
sim_compute_performance-ego0_mean	0.00195143085832302
sim_compute_performance-ego0_median	0.0019397087438616724
sim_compute_performance-ego0_min	0.0019308075519723757
sim_compute_sim_state_max	0.01137816737236131
sim_compute_sim_state_mean	0.008632026991181131
sim_compute_sim_state_median	0.008557837869007323
sim_compute_sim_state_min	0.0060342648543485694
sim_render-ego0_max	0.0037685810378151672
sim_render-ego0_mean	0.0037259351800224567
sim_render-ego0_median	0.003719506613122335
sim_render-ego0_min	0.003696146456029989
simulation-passed	1
step_physics_max	0.2554146294589841
step_physics_mean	0.20980209335498667
step_physics_median	0.21182563312841793
step_physics_min	0.16014247770412676
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

54432

11543

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 03:02:20+00:00

2020-12-03 03:32:41+00:00

0:30:21

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	10.288215680531088
survival_time_median	59.99999999999873
deviation-center-line_median	3.569708777024473
in-drivable-lane_median	1.3749999999999218

other stats

agent_compute-ego0_max	0.012341292672709165
agent_compute-ego0_mean	0.011894701815808269
agent_compute-ego0_median	0.01177821398822676
agent_compute-ego0_min	0.011681086614070389
complete-iteration_max	0.2150622678736068
complete-iteration_mean	0.180749093440697
complete-iteration_median	0.17924198113710654
complete-iteration_min	0.1494501436149681
deviation-center-line_max	3.993563429915041
deviation-center-line_mean	2.837926099894435
deviation-center-line_min	0.2187234156137522
deviation-heading_max	13.698728658347711
deviation-heading_mean	10.373816205220042
deviation-heading_median	13.287588081855358
deviation-heading_min	1.221359998821739
driven_any_max	11.942941993271951
driven_any_mean	9.733965062364716
driven_any_median	10.932500488353044
driven_any_min	5.127917279480827
driven_lanedir_consec_max	11.503669464430978
driven_lanedir_consec_mean	8.204018140987579
driven_lanedir_consec_min	0.7359717384571571
driven_lanedir_max	11.503669464430978
driven_lanedir_mean	8.204018140987579
driven_lanedir_median	10.288215680531088
driven_lanedir_min	0.7359717384571571
get_duckie_state_max	1.0868790346220272e-06
get_duckie_state_mean	1.062448752797096e-06
get_duckie_state_median	1.0709976971298332e-06
get_duckie_state_min	1.0209205823066909e-06
get_robot_state_max	0.0035593132492306827
get_robot_state_mean	0.0034967447907489815
get_robot_state_median	0.0034929420628416648
get_robot_state_min	0.003441781788081913
get_state_dump_max	0.004513148761212478
get_state_dump_mean	0.004371867571817506
get_state_dump_median	0.004337374713399031
get_state_dump_min	0.004299572099259485
get_ui_image_max	0.03618234698718831
get_ui_image_mean	0.03030243384541893
get_ui_image_median	0.029967642644362885
get_ui_image_min	0.02509210310576163
in-drivable-lane_max	23.30000000000026
in-drivable-lane_mean	6.512500000000026
in-drivable-lane_min	0.0
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 11.942941993271951, "get_ui_image": 0.02795210130804286, "step_physics": 0.10416705959742512, "survival_time": 59.99999999999873, "driven_lanedir": 11.503669464430978, "get_state_dump": 0.004328595708550065, "get_robot_state": 0.0034988799956716366, "sim_render-ego0": 0.0035719532057407197, "get_duckie_state": 1.0858864510287652e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.505644342008662, "agent_compute-ego0": 0.012341292672709165, "complete-iteration": 0.16901889212621837, "set_robot_commands": 0.002123897022053562, "deviation-center-line": 3.35419334394254, "driven_lanedir_consec": 11.503669464430978, "sim_compute_sim_state": 0.00912162544923857, "sim_compute_performance-ego0": 0.0018433049556913223}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.666682113357153, "get_ui_image": 0.03618234698718831, "step_physics": 0.13779555867851823, "survival_time": 59.99999999999873, "driven_lanedir": 9.784627184896856, "get_state_dump": 0.004513148761212478, "get_robot_state": 0.0035593132492306827, "sim_render-ego0": 0.0037022339712074657, "get_duckie_state": 1.0561089432309013e-06, "in-drivable-lane": 2.7499999999998437, "deviation-heading": 13.698728658347711, "agent_compute-ego0": 0.011850224645012722, "complete-iteration": 0.2150622678736068, "set_robot_commands": 0.0021689799703428093, "deviation-center-line": 3.993563429915041, "driven_lanedir_consec": 9.784627184896856, "sim_compute_sim_state": 0.01331085229694198, "sim_compute_performance-ego0": 0.001909046744823853}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.198318863348936, "get_ui_image": 0.03198318398068291, "step_physics": 0.11754419920744248, "survival_time": 59.99999999999873, "driven_lanedir": 10.79180417616532, "get_state_dump": 0.004346153718247998, "get_robot_state": 0.0034870041300116925, "sim_render-ego0": 0.00355925766454946, "get_duckie_state": 1.0868790346220272e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.069531821702052, "agent_compute-ego0": 0.011681086614070389, "complete-iteration": 0.1894650701479947, "set_robot_commands": 0.002136170318184248, "deviation-center-line": 3.7852242101064064, "driven_lanedir_consec": 10.79180417616532, "sim_compute_sim_state": 0.012814685168810232, "sim_compute_performance-ego0": 0.001841538752445472}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.127917279480827, "get_ui_image": 0.02509210310576163, "step_physics": 0.09141304204752156, "survival_time": 27.250000000000252, "driven_lanedir": 0.7359717384571571, "get_state_dump": 0.004299572099259485, "get_robot_state": 0.003441781788081913, "sim_render-ego0": 0.003544758964370895, "get_duckie_state": 1.0209205823066909e-06, "in-drivable-lane": 23.30000000000026, "deviation-heading": 1.221359998821739, "agent_compute-ego0": 0.011706203331440797, "complete-iteration": 0.1494501436149681, "set_robot_commands": 0.0020079250300760235, "deviation-center-line": 0.2187234156137522, "driven_lanedir_consec": 0.7359717384571571, "sim_compute_sim_state": 0.006066141547737541, "sim_compute_performance-ego0": 0.0018090223654722555}}
set_robot_commands_max	0.0021689799703428093
set_robot_commands_mean	0.0021092430851641607
set_robot_commands_median	0.002130033670118905
set_robot_commands_min	0.0020079250300760235
sim_compute_performance-ego0_max	0.001909046744823853
sim_compute_performance-ego0_mean	0.0018507282046082256
sim_compute_performance-ego0_median	0.001842421854068397
sim_compute_performance-ego0_min	0.0018090223654722555
sim_compute_sim_state_max	0.01331085229694198
sim_compute_sim_state_mean	0.01032832611568208
sim_compute_sim_state_median	0.0109681553090244
sim_compute_sim_state_min	0.006066141547737541
sim_render-ego0_max	0.0037022339712074657
sim_render-ego0_mean	0.003594550951467135
sim_render-ego0_median	0.0035656054351450896
sim_render-ego0_min	0.003544758964370895
simulation-passed	1
step_physics_max	0.13779555867851823
step_physics_mean	0.11272996488272684
step_physics_median	0.1108556294024338
step_physics_min	0.09141304204752156
survival_time_max	59.99999999999873
survival_time_mean	51.812499999999105
survival_time_min	27.250000000000252

No reset possible

54387

11557

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 02:47:41+00:00

2020-12-03 03:01:53+00:00

0:14:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4650400412861663
survival_time_median	16.825000000000102
deviation-center-line_median	0.33427800757803794
in-drivable-lane_median	13.525000000000096

other stats

agent_compute-ego0_max	0.013141233187455395
agent_compute-ego0_mean	0.012740764842942832
agent_compute-ego0_median	0.012748350654361989
agent_compute-ego0_min	0.012325124875591956
complete-iteration_max	0.19424592875517332
complete-iteration_mean	0.16937338859015788
complete-iteration_median	0.16996586851555762
complete-iteration_min	0.1433158885743429
deviation-center-line_max	1.7475556581672365
deviation-center-line_mean	0.634070286379598
deviation-center-line_min	0.12016947219507956
deviation-heading_max	9.189706588528642
deviation-heading_mean	3.440242433890387
deviation-heading_median	2.0539370479886716
deviation-heading_min	0.4633890510555651
driven_any_max	12.130132055950206
driven_any_mean	4.854189483343579
driven_any_median	2.833258853013326
driven_any_min	1.6201081713974557
driven_lanedir_consec_max	4.090105540420278
driven_lanedir_consec_mean	1.327811857141701
driven_lanedir_consec_min	0.2910618055741938
driven_lanedir_max	4.15746263126906
driven_lanedir_mean	1.3488725008938889
driven_lanedir_median	0.4650400412861663
driven_lanedir_min	0.30794728973416285
get_duckie_state_max	1.9497228128241265e-06
get_duckie_state_mean	1.859693242100076e-06
get_duckie_state_median	1.9023178989051753e-06
get_duckie_state_min	1.6844143577658266e-06
get_robot_state_max	0.003663637755216905
get_robot_state_mean	0.0035748055856045205
get_robot_state_median	0.0035646422013696855
get_robot_state_min	0.0035063001844618056
get_state_dump_max	0.004520222705964939
get_state_dump_mean	0.004492344568124387
get_state_dump_median	0.004497305804594568
get_state_dump_min	0.004454543957343468
get_ui_image_max	0.0357905408510795
get_ui_image_mean	0.03050058233313844
get_ui_image_median	0.030266063068210607
get_ui_image_min	0.02567966234505304
in-drivable-lane_max	40.899999999998904
in-drivable-lane_mean	18.64999999999978
in-drivable-lane_min	6.650000000000017
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 12.130132055950206, "get_ui_image": 0.028070162376892954, "step_physics": 0.09338096456662702, "survival_time": 59.99999999999873, "driven_lanedir": 4.15746263126906, "get_state_dump": 0.004520222705964939, "get_robot_state": 0.003663637755216905, "sim_render-ego0": 0.003810447816745526, "get_duckie_state": 1.6844143577658266e-06, "in-drivable-lane": 40.899999999998904, "deviation-heading": 9.189706588528642, "agent_compute-ego0": 0.012325124875591956, "complete-iteration": 0.15922819108986835, "set_robot_commands": 0.0022552882900444497, "deviation-center-line": 1.7475556581672365, "driven_lanedir_consec": 4.090105540420278, "sim_compute_sim_state": 0.009166831279376664, "sim_compute_performance-ego0": 0.001960108421128755}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6201509538772736, "get_ui_image": 0.0357905408510795, "step_physics": 0.12001377229507151, "survival_time": 10.350000000000012, "driven_lanedir": 0.30794728973416285, "get_state_dump": 0.004454543957343468, "get_robot_state": 0.003539311198087839, "sim_render-ego0": 0.0036553522715201746, "get_duckie_state": 1.9039099033062275e-06, "in-drivable-lane": 6.650000000000017, "deviation-heading": 3.3983940485593456, "agent_compute-ego0": 0.013141233187455395, "complete-iteration": 0.19424592875517332, "set_robot_commands": 0.0020679831504821777, "deviation-center-line": 0.3068091355269511, "driven_lanedir_consec": 0.2910618055741938, "sim_compute_sim_state": 0.009638523826232323, "sim_compute_performance-ego0": 0.0018673378687638503}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6201081713974557, "get_ui_image": 0.03246196375952826, "step_physics": 0.11140020291010538, "survival_time": 8.949999999999992, "driven_lanedir": 0.44141916752283006, "get_state_dump": 0.004518877135382758, "get_robot_state": 0.0035063001844618056, "sim_render-ego0": 0.003709289762708876, "get_duckie_state": 1.9007258945041233e-06, "in-drivable-lane": 7.099999999999992, "deviation-heading": 0.4633890510555651, "agent_compute-ego0": 0.013065217600928412, "complete-iteration": 0.18070354594124688, "set_robot_commands": 0.0021541502740648056, "deviation-center-line": 0.12016947219507956, "driven_lanedir_consec": 0.44141916752283006, "sim_compute_sim_state": 0.007932893435160319, "sim_compute_performance-ego0": 0.001878715886010064}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.046366752149378, "get_ui_image": 0.02567966234505304, "step_physics": 0.08336854746816501, "survival_time": 23.300000000000196, "driven_lanedir": 0.4886609150495025, "get_state_dump": 0.004475734473806377, "get_robot_state": 0.0035899732046515325, "sim_render-ego0": 0.0036367798259988337, "get_duckie_state": 1.9497228128241265e-06, "in-drivable-lane": 19.9500000000002, "deviation-heading": 0.7094800474179979, "agent_compute-ego0": 0.012431483707795562, "complete-iteration": 0.1433158885743429, "set_robot_commands": 0.0020968903821336634, "deviation-center-line": 0.3617468796291248, "driven_lanedir_consec": 0.4886609150495025, "sim_compute_sim_state": 0.006071492487153864, "sim_compute_performance-ego0": 0.0018886718300731584}}
set_robot_commands_max	0.0022552882900444497
set_robot_commands_mean	0.0021435780241812743
set_robot_commands_median	0.0021255203280992345
set_robot_commands_min	0.0020679831504821777
sim_compute_performance-ego0_max	0.001960108421128755
sim_compute_performance-ego0_mean	0.0018987085014939569
sim_compute_performance-ego0_median	0.0018836938580416112
sim_compute_performance-ego0_min	0.0018673378687638503
sim_compute_sim_state_max	0.009638523826232323
sim_compute_sim_state_mean	0.008202435256980792
sim_compute_sim_state_median	0.008549862357268491
sim_compute_sim_state_min	0.006071492487153864
sim_render-ego0_max	0.003810447816745526
sim_render-ego0_mean	0.003702967419243352
sim_render-ego0_median	0.003682321017114525
sim_render-ego0_min	0.0036367798259988337
simulation-passed	1
step_physics_max	0.12001377229507151
step_physics_mean	0.10204087180999225
step_physics_median	0.1023905837383662
step_physics_min	0.08336854746816501
survival_time_max	59.99999999999873
survival_time_mean	25.649999999999732
survival_time_min	8.949999999999992

No reset possible

54335

11571

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 02:36:33+00:00

2020-12-03 02:43:23+00:00

0:06:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5930430400046578
survival_time_median	8.675000000000015
deviation-center-line_median	0.11174838251934076
in-drivable-lane_median	6.400000000000015

other stats

agent_compute-ego0_max	0.012725820386312842
agent_compute-ego0_mean	0.012273373023465234
agent_compute-ego0_median	0.012247325431123545
agent_compute-ego0_min	0.011873020845301011
complete-iteration_max	0.2662065075893028
complete-iteration_mean	0.19399790016154697
complete-iteration_median	0.17916218454367103
complete-iteration_min	0.15146072396954283
deviation-center-line_max	0.4239740224977358
deviation-center-line_mean	0.1807027846945257
deviation-center-line_min	0.0753403512416854
deviation-heading_max	1.668632700643614
deviation-heading_mean	0.8790502586222192
deviation-heading_median	0.7645479372664463
deviation-heading_min	0.31847245931237006
driven_any_max	4.258445830548083
driven_any_mean	2.306517473275658
driven_any_median	2.341812112114254
driven_any_min	0.2839998383260433
driven_lanedir_consec_max	1.414372889630986
driven_lanedir_consec_mean	0.6793974146075111
driven_lanedir_consec_min	0.11713068878974298
driven_lanedir_max	1.414372889630986
driven_lanedir_mean	0.6793974146075111
driven_lanedir_median	0.5930430400046578
driven_lanedir_min	0.11713068878974298
get_duckie_state_max	1.4702479044596357e-06
get_duckie_state_mean	1.4223865365726347e-06
get_duckie_state_median	1.4224426282109478e-06
get_duckie_state_min	1.3744129854090071e-06
get_robot_state_max	0.003790895144144694
get_robot_state_mean	0.003648405654033149
get_robot_state_median	0.003619100709475971
get_robot_state_min	0.0035645260530359603
get_state_dump_max	0.004658329777601288
get_state_dump_mean	0.004604649530547096
get_state_dump_median	0.00460750512886259
get_state_dump_min	0.004545258086861916
get_ui_image_max	0.03618977584090887
get_ui_image_mean	0.030597931702050583
get_ui_image_median	0.030244802199801267
get_ui_image_min	0.02571234656769095
in-drivable-lane_max	10.450000000000031
in-drivable-lane_mean	6.125000000000015
in-drivable-lane_min	1.249999999999999
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 4.258445830548083, "get_ui_image": 0.02777333304567157, "step_physics": 0.10183546078280084, "survival_time": 15.85000000000009, "driven_lanedir": 1.414372889630986, "get_state_dump": 0.004576272934487781, "get_robot_state": 0.0036389535328127305, "sim_render-ego0": 0.0037559488284512887, "get_duckie_state": 1.4282622427310585e-06, "in-drivable-lane": 10.450000000000031, "deviation-heading": 1.668632700643614, "agent_compute-ego0": 0.01247014639512548, "complete-iteration": 0.16855011946000392, "set_robot_commands": 0.002259012288267507, "deviation-center-line": 0.4239740224977358, "driven_lanedir_consec": 1.414372889630986, "sim_compute_sim_state": 0.010162693149638628, "sim_compute_performance-ego0": 0.0019918725175677604}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2839998383260433, "get_ui_image": 0.03618977584090887, "step_physics": 0.19301701994503245, "survival_time": 2.499999999999999, "driven_lanedir": 0.11713068878974298, "get_state_dump": 0.004638737323237401, "get_robot_state": 0.0035645260530359603, "sim_render-ego0": 0.0037281419716629328, "get_duckie_state": 1.3744129854090071e-06, "in-drivable-lane": 1.249999999999999, "deviation-heading": 0.9068646159855612, "agent_compute-ego0": 0.011873020845301011, "complete-iteration": 0.2662065075893028, "set_robot_commands": 0.0021065543679630056, "deviation-center-line": 0.0753403512416854, "driven_lanedir_consec": 0.11713068878974298, "sim_compute_sim_state": 0.009093742744595396, "sim_compute_performance-ego0": 0.001917432336246266}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.3016468152222407, "get_ui_image": 0.03271627135393096, "step_physics": 0.11755798599584316, "survival_time": 12.25000000000004, "driven_lanedir": 0.6026424056794798, "get_state_dump": 0.004658329777601288, "get_robot_state": 0.003790895144144694, "sim_render-ego0": 0.0039039123349073456, "get_duckie_state": 1.4702479044596357e-06, "in-drivable-lane": 9.65000000000004, "deviation-heading": 0.6222312585473314, "agent_compute-ego0": 0.012725820386312842, "complete-iteration": 0.1897742496273382, "set_robot_commands": 0.002370213105426571, "deviation-center-line": 0.11322763731121992, "driven_lanedir_consec": 0.6026424056794798, "sim_compute_sim_state": 0.009926547849081396, "sim_compute_performance-ego0": 0.0020383208747801742}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3819774090062669, "get_ui_image": 0.02571234656769095, "step_physics": 0.09264641132169556, "survival_time": 5.09999999999999, "driven_lanedir": 0.5834436743298359, "get_state_dump": 0.004545258086861916, "get_robot_state": 0.003599247886139212, "sim_render-ego0": 0.003732996079528216, "get_duckie_state": 1.4166230136908374e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.31847245931237006, "agent_compute-ego0": 0.012024504467121604, "complete-iteration": 0.15146072396954283, "set_robot_commands": 0.0022029506350026546, "deviation-center-line": 0.1102691277274616, "driven_lanedir_consec": 0.5834436743298359, "sim_compute_sim_state": 0.004964474335457515, "sim_compute_performance-ego0": 0.0019481251540693263}}
set_robot_commands_max	0.002370213105426571
set_robot_commands_mean	0.0022346825991649347
set_robot_commands_median	0.002230981461635081
set_robot_commands_min	0.0021065543679630056
sim_compute_performance-ego0_max	0.0020383208747801742
sim_compute_performance-ego0_mean	0.001973937720665882
sim_compute_performance-ego0_median	0.001969998835818543
sim_compute_performance-ego0_min	0.001917432336246266
sim_compute_sim_state_max	0.010162693149638628
sim_compute_sim_state_mean	0.008536864519693235
sim_compute_sim_state_median	0.009510145296838395
sim_compute_sim_state_min	0.004964474335457515
sim_render-ego0_max	0.0039039123349073456
sim_render-ego0_mean	0.003780249803637446
sim_render-ego0_median	0.003744472453989753
sim_render-ego0_min	0.0037281419716629328
simulation-passed	1
step_physics_max	0.19301701994503245
step_physics_mean	0.12626421951134298
step_physics_median	0.109696723389322
step_physics_min	0.09264641132169556
survival_time_max	15.85000000000009
survival_time_mean	8.92500000000003
survival_time_min	2.499999999999999

No reset possible

54316

11585

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFv-sim

failed

yes

2020-12-03 02:30:24+00:00

2020-12-03 02:36:18+00:00

0:05:54

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 421 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

54237

11625

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 02:05:16+00:00

2020-12-03 02:30:16+00:00

0:25:00

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	2.369739867202404
survival_time_median	48.87499999999936
deviation-center-line_median	1.7930981009563254
in-drivable-lane_median	22.34999999999956

other stats

agent_compute-ego0_max	0.012957097130184454
agent_compute-ego0_mean	0.012478191846262972
agent_compute-ego0_median	0.01239395082074126
agent_compute-ego0_min	0.012167768613384923
complete-iteration_max	0.27615086278767165
complete-iteration_mean	0.22574456988002925
complete-iteration_median	0.21786643844500325
complete-iteration_min	0.19109453984243885
deviation-center-line_max	3.2097813710588334
deviation-center-line_mean	1.7954532682795348
deviation-center-line_min	0.3858355001466551
deviation-heading_max	14.039730394159651
deviation-heading_mean	8.791217008247612
deviation-heading_median	8.96974800345194
deviation-heading_min	3.185641631926914
driven_any_max	7.919696277104027
driven_any_mean	5.437466077515292
driven_any_median	6.346932575656934
driven_any_min	1.13630288164327
driven_lanedir_consec_max	3.013533866693826
driven_lanedir_consec_mean	2.102728627892568
driven_lanedir_consec_min	0.6579009104716389
driven_lanedir_max	3.013533866693826
driven_lanedir_mean	2.102728627892568
driven_lanedir_median	2.369739867202404
driven_lanedir_min	0.6579009104716389
get_duckie_state_max	1.2859779318379614e-06
get_duckie_state_mean	1.191905688724041e-06
get_duckie_state_median	1.1894923264934658e-06
get_duckie_state_min	1.1026601700712712e-06
get_robot_state_max	0.0036006878446481717
get_robot_state_mean	0.0035318487117121495
get_robot_state_median	0.003515037472525008
get_robot_state_min	0.0034966320571504107
get_state_dump_max	0.004479479975193455
get_state_dump_mean	0.004443463317245447
get_state_dump_median	0.004441049019530961
get_state_dump_min	0.00441227525472641
get_ui_image_max	0.03615159197792488
get_ui_image_mean	0.030652038675469437
get_ui_image_median	0.03036092414923959
get_ui_image_min	0.025734714425473686
in-drivable-lane_max	42.64999999999877
in-drivable-lane_mean	22.649999999999473
in-drivable-lane_min	3.2500000000000044
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 7.528257802858483, "get_ui_image": 0.02836019187109575, "step_physics": 0.14102346173832925, "survival_time": 57.79999999999885, "driven_lanedir": 1.8314557859564, "get_state_dump": 0.004479479975193455, "get_robot_state": 0.0036006878446481717, "sim_render-ego0": 0.003677244112217539, "get_duckie_state": 1.1026601700712712e-06, "in-drivable-lane": 42.64999999999877, "deviation-heading": 4.5574004287099354, "agent_compute-ego0": 0.012957097130184454, "complete-iteration": 0.2084791641762881, "set_robot_commands": 0.002248720558120345, "deviation-center-line": 0.7498641345031708, "driven_lanedir_consec": 1.8314557859564, "sim_compute_sim_state": 0.010170821393473764, "sim_compute_performance-ego0": 0.001888109469269511}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.13630288164327, "get_ui_image": 0.03615159197792488, "step_physics": 0.2017379054133756, "survival_time": 9.6, "driven_lanedir": 0.6579009104716389, "get_state_dump": 0.004413551617162833, "get_robot_state": 0.0034966320571504107, "sim_render-ego0": 0.003555201495867319, "get_duckie_state": 1.2859779318379614e-06, "in-drivable-lane": 3.2500000000000044, "deviation-heading": 3.185641631926914, "agent_compute-ego0": 0.012375755013579532, "complete-iteration": 0.27615086278767165, "set_robot_commands": 0.0020748444789431874, "deviation-center-line": 0.3858355001466551, "driven_lanedir_consec": 0.6579009104716389, "sim_compute_sim_state": 0.010423982699300342, "sim_compute_performance-ego0": 0.001848248002442671}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.165607348455386, "get_ui_image": 0.03236165642738342, "step_physics": 0.15503439009189607, "survival_time": 39.94999999999987, "driven_lanedir": 2.9080239484484087, "get_state_dump": 0.00441227525472641, "get_robot_state": 0.003497249186038971, "sim_render-ego0": 0.003579094409942627, "get_duckie_state": 1.1444091796875e-06, "in-drivable-lane": 12.399999999999803, "deviation-heading": 14.039730394159651, "agent_compute-ego0": 0.012412146627902984, "complete-iteration": 0.2272537127137184, "set_robot_commands": 0.0020481762290000915, "deviation-center-line": 2.83633206740948, "driven_lanedir_consec": 2.9080239484484087, "sim_compute_sim_state": 0.011974465847015382, "sim_compute_performance-ego0": 0.001861354410648346}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.919696277104027, "get_ui_image": 0.025734714425473686, "step_physics": 0.1315144057277835, "survival_time": 59.99999999999873, "driven_lanedir": 3.013533866693826, "get_state_dump": 0.004468546421899089, "get_robot_state": 0.0035328257590110453, "sim_render-ego0": 0.0035696428681690428, "get_duckie_state": 1.2345754732994315e-06, "in-drivable-lane": 32.299999999999315, "deviation-heading": 13.382095578193946, "agent_compute-ego0": 0.012167768613384923, "complete-iteration": 0.19109453984243885, "set_robot_commands": 0.0021391830079065177, "deviation-center-line": 3.2097813710588334, "driven_lanedir_consec": 3.013533866693826, "sim_compute_sim_state": 0.006028246025955746, "sim_compute_performance-ego0": 0.001865453863024811}}
set_robot_commands_max	0.002248720558120345
set_robot_commands_mean	0.0021277310684925353
set_robot_commands_median	0.0021070137434248525
set_robot_commands_min	0.0020481762290000915
sim_compute_performance-ego0_max	0.001888109469269511
sim_compute_performance-ego0_mean	0.0018657914363463348
sim_compute_performance-ego0_median	0.0018634041368365785
sim_compute_performance-ego0_min	0.001848248002442671
sim_compute_sim_state_max	0.011974465847015382
sim_compute_sim_state_mean	0.009649378991436308
sim_compute_sim_state_median	0.010297402046387053
sim_compute_sim_state_min	0.006028246025955746
sim_render-ego0_max	0.003677244112217539
sim_render-ego0_mean	0.003595295721549132
sim_render-ego0_median	0.003574368639055835
sim_render-ego0_min	0.003555201495867319
simulation-passed	1
step_physics_max	0.2017379054133756
step_physics_mean	0.1573275407428461
step_physics_median	0.14802892591511266
step_physics_min	0.1315144057277835
survival_time_max	59.99999999999873
survival_time_mean	41.83749999999936
survival_time_min	9.6

No reset possible

54190

11636

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

success

yes

2020-12-03 01:45:53+00:00

2020-12-03 02:04:55+00:00

0:19:02

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.8625550372152329
survival_time_median	25.47500000000023
deviation-center-line_median	0.850470500239714
in-drivable-lane_median	13.57499999999991

other stats

agent_compute-ego0_max	0.012405272824480371
agent_compute-ego0_mean	0.012164397024284596
agent_compute-ego0_median	0.012150104299873187
agent_compute-ego0_min	0.011952106672911637
complete-iteration_max	0.20568040540464705
complete-iteration_mean	0.184904371655712
complete-iteration_median	0.1859819322932008
complete-iteration_min	0.16197321663179928
deviation-center-line_max	3.302891326995918
deviation-center-line_mean	1.3521585824115157
deviation-center-line_min	0.4048020021707158
deviation-heading_max	11.864231684817453
deviation-heading_mean	5.508305680947957
deviation-heading_median	3.9103904443646806
deviation-heading_min	2.348210150245017
driven_any_max	13.18817160056444
driven_any_mean	6.810923276998384
driven_any_median	4.8694491293547
driven_any_min	4.316623248719697
driven_lanedir_consec_max	10.715231257481223
driven_lanedir_consec_mean	3.9523510615204738
driven_lanedir_consec_min	1.369062914170204
driven_lanedir_max	10.715231257481223
driven_lanedir_mean	3.9523510615204738
driven_lanedir_median	1.8625550372152329
driven_lanedir_min	1.369062914170204
get_duckie_state_max	1.2032190958658857e-06
get_duckie_state_mean	1.1660725119033364e-06
get_duckie_state_median	1.1770786867334125e-06
get_duckie_state_min	1.1069135782806344e-06
get_robot_state_max	0.0036415551524674465
get_robot_state_mean	0.003555923250681395
get_robot_state_median	0.003550831465301637
get_robot_state_min	0.0034804749196548595
get_state_dump_max	0.0045617283715142145
get_state_dump_mean	0.004492674195012257
get_state_dump_median	0.00454496199403101
get_state_dump_min	0.004319044420472795
get_ui_image_max	0.03615307139849287
get_ui_image_mean	0.03080096591838419
get_ui_image_median	0.030443891722153026
get_ui_image_min	0.02616300883073784
in-drivable-lane_max	18.95000000000027
in-drivable-lane_mean	14.100000000000058
in-drivable-lane_min	10.300000000000146
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 13.18817160056444, "get_ui_image": 0.02813632124965137, "step_physics": 0.10755119732674907, "survival_time": 59.99999999999873, "driven_lanedir": 10.715231257481223, "get_state_dump": 0.0045594901069812635, "get_robot_state": 0.0036415551524674465, "sim_render-ego0": 0.0037163455321528737, "get_duckie_state": 1.166682755520302e-06, "in-drivable-lane": 12.899999999999649, "deviation-heading": 11.864231684817453, "agent_compute-ego0": 0.012405272824480371, "complete-iteration": 0.17349097532197696, "set_robot_commands": 0.002178930620865262, "deviation-center-line": 3.302891326995918, "driven_lanedir_consec": 10.715231257481223, "sim_compute_sim_state": 0.00928927162704023, "sim_compute_performance-ego0": 0.00193546793045946}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.296395222305083, "get_ui_image": 0.03615307139849287, "step_physics": 0.13147764656881944, "survival_time": 28.50000000000027, "driven_lanedir": 1.5399406862527143, "get_state_dump": 0.004319044420472795, "get_robot_state": 0.0034804749196548595, "sim_render-ego0": 0.0036169488876797063, "get_duckie_state": 1.1069135782806344e-06, "in-drivable-lane": 18.95000000000027, "deviation-heading": 3.226301380728469, "agent_compute-ego0": 0.011952106672911637, "complete-iteration": 0.20568040540464705, "set_robot_commands": 0.002280563481426072, "deviation-center-line": 0.663196430999679, "driven_lanedir_consec": 1.5399406862527143, "sim_compute_sim_state": 0.010486970223395084, "sim_compute_performance-ego0": 0.0018387199909591007}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.442503036404316, "get_ui_image": 0.032751462194654676, "step_physics": 0.1263943804634942, "survival_time": 22.450000000000184, "driven_lanedir": 2.185169388177751, "get_state_dump": 0.0045617283715142145, "get_robot_state": 0.003542531331380208, "sim_render-ego0": 0.0037323395411173505, "get_duckie_state": 1.2032190958658857e-06, "in-drivable-lane": 10.300000000000146, "deviation-heading": 4.594479508000893, "agent_compute-ego0": 0.012121729850769043, "complete-iteration": 0.19847288926442463, "set_robot_commands": 0.0021359523137410483, "deviation-center-line": 1.0377445694797491, "driven_lanedir_consec": 2.185169388177751, "sim_compute_sim_state": 0.01124736573961046, "sim_compute_performance-ego0": 0.001909309493170844}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.316623248719697, "get_ui_image": 0.02616300883073784, "step_physics": 0.10163724104948252, "survival_time": 20.60000000000016, "driven_lanedir": 1.369062914170204, "get_state_dump": 0.0045304338810807565, "get_robot_state": 0.003559131599223066, "sim_render-ego0": 0.003665221516791614, "get_duckie_state": 1.187474617946523e-06, "in-drivable-lane": 14.250000000000172, "deviation-heading": 2.348210150245017, "agent_compute-ego0": 0.01217847874897733, "complete-iteration": 0.16197321663179928, "set_robot_commands": 0.0021009987838043137, "deviation-center-line": 0.4048020021707158, "driven_lanedir_consec": 1.369062914170204, "sim_compute_sim_state": 0.006156917345725884, "sim_compute_performance-ego0": 0.0019051872789138163}}
set_robot_commands_max	0.002280563481426072
set_robot_commands_mean	0.002174111299959174
set_robot_commands_median	0.002157441467303155
set_robot_commands_min	0.0021009987838043137
sim_compute_performance-ego0_max	0.00193546793045946
sim_compute_performance-ego0_mean	0.0018971711733758057
sim_compute_performance-ego0_median	0.0019072483860423303
sim_compute_performance-ego0_min	0.0018387199909591007
sim_compute_sim_state_max	0.01124736573961046
sim_compute_sim_state_mean	0.009295131233942915
sim_compute_sim_state_median	0.009888120925217658
sim_compute_sim_state_min	0.006156917345725884
sim_render-ego0_max	0.0037323395411173505
sim_render-ego0_mean	0.003682713869435386
sim_render-ego0_median	0.003690783524472244
sim_render-ego0_min	0.0036169488876797063
simulation-passed	1
step_physics_max	0.13147764656881944
step_physics_mean	0.11676511635213632
step_physics_median	0.11697278889512164
step_physics_min	0.10163724104948252
survival_time_max	59.99999999999873
survival_time_mean	32.88749999999983
survival_time_min	20.60000000000016

No reset possible

53874

12643

Bea Baselines 🐤

template-pytorch

LFVmultibodyv-sim

success

yes

2020-12-02 23:33:59+00:00

2020-12-03 01:45:35+00:00

2:11:36

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.6484044145152017
survival_time_median	59.99999999999873
deviation-center-line_median	1.1793254858577928
in-drivable-lane_median	48.324999999998695

other stats

agent_compute-ego0_max	0.014727246453621109
agent_compute-ego0_mean	0.0131232365283442
agent_compute-ego0_median	0.013391270824117922
agent_compute-ego0_min	0.011820346290721782
agent_compute-ego1_max	0.01541045484296686
agent_compute-ego1_mean	0.013884494686659863
agent_compute-ego1_median	0.014465934926524548
agent_compute-ego1_min	0.011765321625162422
agent_compute-ego2_max	0.015588998794555664
agent_compute-ego2_mean	0.01345722522465613
agent_compute-ego2_median	0.013033051375643995
agent_compute-ego2_min	0.01174962550376873
agent_compute-ego3_max	0.014024920507235687
agent_compute-ego3_mean	0.012746478926960111
agent_compute-ego3_median	0.012436721048982417
agent_compute-ego3_min	0.011777795224662229
complete-iteration_max	1.3034764926300555
complete-iteration_mean	1.107826174376083
complete-iteration_median	1.2395031051175185
complete-iteration_min	0.40519441831717384
deviation-center-line_max	2.0795342768194507
deviation-center-line_mean	1.086384093559488
deviation-center-line_min	0.04961564404319747
deviation-heading_max	17.605145356012954
deviation-heading_mean	8.902698432888606
deviation-heading_median	8.77600979089662
deviation-heading_min	0.6070223847639707
driven_any_max	12.460484964869122
driven_any_mean	7.258227844498035
driven_any_median	7.512542285309959
driven_any_min	0.2198051856755729
driven_lanedir_consec_max	2.0417897993978293
driven_lanedir_consec_mean	0.8390134449920675
driven_lanedir_consec_min	0.09546725179377248
driven_lanedir_max	2.477096768971399
driven_lanedir_mean	1.062737299638124
driven_lanedir_median	1.0320477848855285
driven_lanedir_min	0.09546725179377248
get_duckie_state_max	1.427335207110936e-06
get_duckie_state_mean	1.3647740812041863e-06
get_duckie_state_median	1.4193945383648391e-06
get_duckie_state_min	1.2750728839045262e-06
get_robot_state_max	0.014028308989106368
get_robot_state_mean	0.01287621630490202
get_robot_state_median	0.013815735500122883
get_robot_state_min	0.006927059850128961
get_state_dump_max	0.00955323355084752
get_state_dump_mean	0.008926711355277185
get_state_dump_median	0.00934214734912018
get_state_dump_min	0.0060589607311823685
get_ui_image_max	0.04955957176087798
get_ui_image_mean	0.04356196846365857
get_ui_image_median	0.046395846945757074
get_ui_image_min	0.02952784423923413
in-drivable-lane_max	58.59999999999873
in-drivable-lane_mean	48.9999999999989
in-drivable-lane_min	38.249999999999275
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 3.780126772892805, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 0.7330266869612989, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 52.24999999999869, "deviation-heading": 6.583779327607867, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 0.5601560198859746, "driven_lanedir_consec": 0.6476781171082246, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.460484964869122, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 1.123418892040022, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 47.499999999998984, "deviation-heading": 12.99868397653156, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.281640241505811, "driven_lanedir_consec": 0.3990990629682371, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 5.614864027361239, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 0.9658211472014951, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 46.19999999999936, "deviation-heading": 9.436903144357268, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.7439394931413217, "driven_lanedir_consec": 0.9658211472014951, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.0772530105938, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 1.1690162041234513, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 47.84999999999874, "deviation-heading": 8.073637555075656, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.3736569466911133, "driven_lanedir_consec": 0.6491307119221786, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.201937730547376, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 2.0417897993978293, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 40.249999999999154, "deviation-heading": 17.090187029236617, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 1.949991673663512, "driven_lanedir_consec": 2.0417897993978293, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.4159826558219435, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.6160775610852487, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 55.749999999998735, "deviation-heading": 2.944189789637947, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.37460353384286355, "driven_lanedir_consec": 0.6160775610852487, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 5.203943969574526, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.4943078452708538, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 51.44999999999868, "deviation-heading": 6.165356082025716, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.7909989300383918, "driven_lanedir_consec": 0.4943078452708538, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.236412958670156, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.2032266827046889, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 58.49999999999873, "deviation-heading": 0.6070223847639707, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.14833891725193588, "driven_lanedir_consec": 0.2032266827046889, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.135630858203626, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 1.2739683210000623, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 45.09999999999894, "deviation-heading": 14.621642579598644, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 1.546704818892302, "driven_lanedir_consec": 1.2739683210000623, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.372132751920008, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 1.0982744225695618, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 49.04999999999886, "deviation-heading": 10.246820809598262, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 1.077010730209775, "driven_lanedir_consec": 1.063103018943326, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.2198051856755729, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 0.09546725179377248, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.7123904442007795, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 0.04961564404319747, "driven_lanedir_consec": 0.09546725179377248, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.947831560026117, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 0.8260766882858807, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 48.79999999999865, "deviation-heading": 9.198328418947936, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 0.8616347045040561, "driven_lanedir_consec": 0.47317892317123217, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 11.024411120116763, "get_ui_image": 0.02952784423923413, "step_physics": 0.31230509092567565, "survival_time": 59.99999999999873, "driven_lanedir": 1.760753923528174, "get_state_dump": 0.0060589607311823685, "get_robot_state": 0.006927059850128961, "sim_render-ego0": 0.003542060359729319, "sim_render-ego1": 0.0034778161807223025, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 46.44999999999902, "deviation-heading": 8.353691162845305, "agent_compute-ego0": 0.011820346290721782, "agent_compute-ego1": 0.01390804001731142, "complete-iteration": 0.40519441831717384, "set_robot_commands": 0.0021228587796150097, "deviation-center-line": 1.3715513793431275, "driven_lanedir_consec": 1.760753923528174, "sim_compute_sim_state": 0.009637770704385342, "sim_compute_performance-ego0": 0.0018408232981914484, "sim_compute_performance-ego1": 0.0018267472717386796}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.924372256699431, "get_ui_image": 0.02952784423923413, "step_physics": 0.31230509092567565, "survival_time": 59.99999999999873, "driven_lanedir": 2.477096768971399, "get_state_dump": 0.0060589607311823685, "get_robot_state": 0.006927059850128961, "sim_render-ego0": 0.003542060359729319, "sim_render-ego1": 0.0034778161807223025, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 38.249999999999275, "deviation-heading": 17.605145356012954, "agent_compute-ego0": 0.011820346290721782, "agent_compute-ego1": 0.01390804001731142, "complete-iteration": 0.40519441831717384, "set_robot_commands": 0.0021228587796150097, "deviation-center-line": 2.0795342768194507, "driven_lanedir_consec": 1.0625858637936194, "sim_compute_sim_state": 0.009637770704385342, "sim_compute_performance-ego0": 0.0018408232981914484, "sim_compute_performance-ego1": 0.0018267472717386796}}
set_robot_commands_max	0.002164326738457597
set_robot_commands_mean	0.00213697615426432
set_robot_commands_median	0.0021387415067242346
set_robot_commands_min	0.0021149189049357877
sim_compute_performance-ego0_max	0.0019546924880104797
sim_compute_performance-ego0_mean	0.0018911424652495283
sim_compute_performance-ego0_median	0.0018751613305669143
sim_compute_performance-ego0_min	0.0018408232981914484
sim_compute_performance-ego1_max	0.0018837747724725245
sim_compute_performance-ego1_mean	0.0018602564400947096
sim_compute_performance-ego1_median	0.0018787092213626705
sim_compute_performance-ego1_min	0.0018267472717386796
sim_compute_performance-ego2_max	0.0018849837392891176
sim_compute_performance-ego2_mean	0.0018680038764481413
sim_compute_performance-ego2_median	0.001873362967612642
sim_compute_performance-ego2_min	0.0018456649224426623
sim_compute_performance-ego3_max	0.001935627339384538
sim_compute_performance-ego3_mean	0.001869826392269849
sim_compute_performance-ego3_median	0.001839227819323639
sim_compute_performance-ego3_min	0.0018346240181013704
sim_compute_sim_state_max	0.03005763553362107
sim_compute_sim_state_mean	0.02550296714250009
sim_compute_sim_state_median	0.028260915900745757
sim_compute_sim_state_min	0.009637770704385342
sim_render-ego0_max	0.0036466999117480423
sim_render-ego0_mean	0.0035833192237481014
sim_render-ego0_median	0.0035729305035466456
sim_render-ego0_min	0.003542060359729319
sim_render-ego1_max	0.00357876054254003
sim_render-ego1_mean	0.003536121561933644
sim_render-ego1_median	0.0035375075773037444
sim_render-ego1_min	0.0034778161807223025
sim_render-ego2_max	0.0036490588859157897
sim_render-ego2_mean	0.0035625782537023584
sim_render-ego2_median	0.003525132045062952
sim_render-ego2_min	0.0035135438301283355
sim_render-ego3_max	0.003617470707127097
sim_render-ego3_mean	0.0035593738630021114
sim_render-ego3_median	0.0035476384810067337
sim_render-ego3_min	0.003513012400872503
simulation-passed	1
step_physics_max	1.1250416023546612
step_physics_mean	0.9391706524698408
step_physics_median	1.0511745292876384
step_physics_min	0.31230509092567565
survival_time_max	59.99999999999873
survival_time_mean	59.999999999998735
survival_time_min	59.99999999999873

No reset possible

53870

12645

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

yes

2020-12-02 23:29:33+00:00

2020-12-02 23:33:44+00:00

0:04:11

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.30126260376888214
survival_time_median	7.500000000000023
deviation-center-line_median	0.299446691155192
in-drivable-lane_median	4.10000000000002

other stats

agent_compute-ego0_max	0.011914073096381293
agent_compute-ego0_mean	0.011788279547404789
agent_compute-ego0_median	0.011788279547404789
agent_compute-ego0_min	0.011662485998428285
complete-iteration_max	0.33914437275452375
complete-iteration_mean	0.33906586955648144
complete-iteration_median	0.33906586955648144
complete-iteration_min	0.3389873663584391
deviation-center-line_max	0.5293671975131792
deviation-center-line_mean	0.299446691155192
deviation-center-line_min	0.06952618479720483
deviation-heading_max	3.9407622201365977
deviation-heading_mean	2.3544809712534605
deviation-heading_median	2.3544809712534605
deviation-heading_min	0.7681997223703229
driven_any_max	1.6518254804721375
driven_any_mean	0.8889133981114437
driven_any_median	0.8889133981114437
driven_any_min	0.12600131575074974
driven_lanedir_consec_max	0.5716599291599911
driven_lanedir_consec_mean	0.30126260376888214
driven_lanedir_consec_min	0.0308652783777732
driven_lanedir_max	0.5716599291599911
driven_lanedir_mean	0.30126260376888214
driven_lanedir_median	0.30126260376888214
driven_lanedir_min	0.0308652783777732
get_duckie_state_max	1.412885198333384e-06
get_duckie_state_mean	1.4031546692079247e-06
get_duckie_state_median	1.4031546692079247e-06
get_duckie_state_min	1.3934241400824652e-06
get_robot_state_max	0.003659163581000434
get_robot_state_mean	0.0035900692170799113
get_robot_state_median	0.0035900692170799113
get_robot_state_min	0.0035209748531593887
get_state_dump_max	0.004826476838853624
get_state_dump_mean	0.004617039218280824
get_state_dump_median	0.004617039218280824
get_state_dump_min	0.004407601597708023
get_ui_image_max	0.039425203535291886
get_ui_image_mean	0.03907655846026363
get_ui_image_median	0.03907655846026363
get_ui_image_min	0.03872791338523538
in-drivable-lane_max	6.85000000000004
in-drivable-lane_mean	4.10000000000002
in-drivable-lane_min	1.35
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.12600131575074974, "get_ui_image": 0.039425203535291886, "step_physics": 0.26223276456197103, "survival_time": 2.2, "driven_lanedir": 0.0308652783777732, "get_state_dump": 0.004826476838853624, "get_robot_state": 0.003659163581000434, "sim_render-ego0": 0.0036826292673746742, "get_duckie_state": 1.3934241400824652e-06, "in-drivable-lane": 1.35, "deviation-heading": 0.7681997223703229, "agent_compute-ego0": 0.011914073096381293, "complete-iteration": 0.3389873663584391, "set_robot_commands": 0.0022009743584526908, "deviation-center-line": 0.06952618479720483, "driven_lanedir_consec": 0.0308652783777732, "sim_compute_sim_state": 0.009021732542249892, "sim_compute_performance-ego0": 0.0019493208991156685}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.6518254804721375, "get_ui_image": 0.03872791338523538, "step_physics": 0.26241933696464803, "survival_time": 12.800000000000049, "driven_lanedir": 0.5716599291599911, "get_state_dump": 0.004407601597708023, "get_robot_state": 0.0035209748531593887, "sim_render-ego0": 0.0035887970534743967, "get_duckie_state": 1.412885198333384e-06, "in-drivable-lane": 6.85000000000004, "deviation-heading": 3.9407622201365977, "agent_compute-ego0": 0.011662485998428285, "complete-iteration": 0.33914437275452375, "set_robot_commands": 0.0020569307794830677, "deviation-center-line": 0.5293671975131792, "driven_lanedir_consec": 0.5716599291599911, "sim_compute_sim_state": 0.010829634239701446, "sim_compute_performance-ego0": 0.0018558975323628823}}
set_robot_commands_max	0.0022009743584526908
set_robot_commands_mean	0.0021289525689678792
set_robot_commands_median	0.0021289525689678792
set_robot_commands_min	0.0020569307794830677
sim_compute_performance-ego0_max	0.0019493208991156685
sim_compute_performance-ego0_mean	0.0019026092157392752
sim_compute_performance-ego0_median	0.0019026092157392752
sim_compute_performance-ego0_min	0.0018558975323628823
sim_compute_sim_state_max	0.010829634239701446
sim_compute_sim_state_mean	0.00992568339097567
sim_compute_sim_state_median	0.00992568339097567
sim_compute_sim_state_min	0.009021732542249892
sim_render-ego0_max	0.0036826292673746742
sim_render-ego0_mean	0.003635713160424536
sim_render-ego0_median	0.003635713160424536
sim_render-ego0_min	0.0035887970534743967
simulation-passed	1
step_physics_max	0.26241933696464803
step_physics_mean	0.2623260507633095
step_physics_median	0.2623260507633095
step_physics_min	0.26223276456197103
survival_time_max	12.800000000000049
survival_time_mean	7.500000000000023
survival_time_min	2.2

No reset possible

53855

12646

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

yes

2020-12-02 23:20:50+00:00

2020-12-02 23:29:04+00:00

0:08:14

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.5998689580392855
survival_time_median	18.700000000000077
deviation-center-line_median	0.6551264016806809
in-drivable-lane_median	12.100000000000076

other stats

agent_compute-ego0_max	0.013623402668879582
agent_compute-ego0_mean	0.012314956172962454
agent_compute-ego0_median	0.012314956172962454
agent_compute-ego0_min	0.011006509677045324
complete-iteration_max	0.3345829531934678
complete-iteration_mean	0.32581264968876905
complete-iteration_median	0.32581264968876905
complete-iteration_min	0.3170423461840703
deviation-center-line_max	1.2243171310112912
deviation-center-line_mean	0.6551264016806809
deviation-center-line_min	0.08593567235007064
deviation-heading_max	10.817503335075962
deviation-heading_mean	5.7348878453406105
deviation-heading_median	5.7348878453406105
deviation-heading_min	0.6522723556052586
driven_any_max	5.253952027063769
driven_any_mean	2.7662893266183395
driven_any_median	2.7662893266183395
driven_any_min	0.2786266261729096
driven_lanedir_consec_max	1.1184952029328294
driven_lanedir_consec_mean	0.5998689580392855
driven_lanedir_consec_min	0.08124271314574161
driven_lanedir_max	1.1184952029328294
driven_lanedir_mean	0.5998689580392855
driven_lanedir_median	0.5998689580392855
driven_lanedir_min	0.08124271314574161
get_duckie_state_max	1.228772676908053e-06
get_duckie_state_mean	1.2029181605055912e-06
get_duckie_state_median	1.2029181605055912e-06
get_duckie_state_min	1.1770636441031294e-06
get_robot_state_max	0.003630757331848145
get_robot_state_mean	0.003567751806581601
get_robot_state_median	0.003567751806581601
get_robot_state_min	0.0035047462813150576
get_state_dump_max	0.0046890882345346305
get_state_dump_mean	0.004575608650020022
get_state_dump_median	0.004575608650020022
get_state_dump_min	0.004462129065505413
get_ui_image_max	0.03772370173380925
get_ui_image_mean	0.03754225276050942
get_ui_image_median	0.03754225276050942
get_ui_image_min	0.03736080378720959
in-drivable-lane_max	22.550000000000153
in-drivable-lane_mean	12.100000000000076
in-drivable-lane_min	1.6499999999999988
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.2786266261729096, "get_ui_image": 0.03772370173380925, "step_physics": 0.237378152517172, "survival_time": 2.549999999999999, "driven_lanedir": 0.08124271314574161, "get_state_dump": 0.0046890882345346305, "get_robot_state": 0.003630757331848145, "sim_render-ego0": 0.004823666352492113, "get_duckie_state": 1.228772676908053e-06, "in-drivable-lane": 1.6499999999999988, "deviation-heading": 0.6522723556052586, "agent_compute-ego0": 0.013623402668879582, "complete-iteration": 0.3170423461840703, "set_robot_commands": 0.003284266361823449, "deviation-center-line": 0.08593567235007064, "driven_lanedir_consec": 0.08124271314574161, "sim_compute_sim_state": 0.009239714879256029, "sim_compute_performance-ego0": 0.002566819007580097}, "LFI-norm-udem1-000-ego0": {"driven_any": 5.253952027063769, "get_ui_image": 0.03736080378720959, "step_physics": 0.2596683293837189, "survival_time": 34.85000000000016, "driven_lanedir": 1.1184952029328294, "get_state_dump": 0.004462129065505413, "get_robot_state": 0.0035047462813150576, "sim_render-ego0": 0.003561461210934002, "get_duckie_state": 1.1770636441031294e-06, "in-drivable-lane": 22.550000000000153, "deviation-heading": 10.817503335075962, "agent_compute-ego0": 0.011006509677045324, "complete-iteration": 0.3345829531934678, "set_robot_commands": 0.0020391896665950216, "deviation-center-line": 1.2243171310112912, "driven_lanedir_consec": 1.1184952029328294, "sim_compute_sim_state": 0.01103928061815934, "sim_compute_performance-ego0": 0.001863210795602006}}
set_robot_commands_max	0.003284266361823449
set_robot_commands_mean	0.0026617280142092353
set_robot_commands_median	0.0026617280142092353
set_robot_commands_min	0.0020391896665950216
sim_compute_performance-ego0_max	0.002566819007580097
sim_compute_performance-ego0_mean	0.0022150149015910513
sim_compute_performance-ego0_median	0.0022150149015910513
sim_compute_performance-ego0_min	0.001863210795602006
sim_compute_sim_state_max	0.01103928061815934
sim_compute_sim_state_mean	0.010139497748707683
sim_compute_sim_state_median	0.010139497748707683
sim_compute_sim_state_min	0.009239714879256029
sim_render-ego0_max	0.004823666352492113
sim_render-ego0_mean	0.004192563781713057
sim_render-ego0_median	0.004192563781713057
sim_render-ego0_min	0.003561461210934002
simulation-passed	1
step_physics_max	0.2596683293837189
step_physics_mean	0.24852324095044548
step_physics_median	0.24852324095044548
step_physics_min	0.237378152517172
survival_time_max	34.85000000000016
survival_time_mean	18.700000000000077
survival_time_min	2.549999999999999

No reset possible

53851

12646

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

yes

2020-12-02 23:17:22+00:00

2020-12-02 23:20:35+00:00

0:03:13

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2495060870450425
survival_time_median	4.699999999999991
deviation-center-line_median	0.1685296127214058
in-drivable-lane_median	2.2999999999999945

other stats

agent_compute-ego0_max	0.01250640551249186
agent_compute-ego0_mean	0.012414319487823835
agent_compute-ego0_median	0.012414319487823835
agent_compute-ego0_min	0.012322233463155812
complete-iteration_max	0.33434436586168076
complete-iteration_mean	0.332467084186744
complete-iteration_median	0.332467084186744
complete-iteration_min	0.33058980251180714
deviation-center-line_max	0.25355726440757503
deviation-center-line_mean	0.1685296127214058
deviation-center-line_min	0.08350196103523654
deviation-heading_max	2.364533760602788
deviation-heading_mean	1.5596509078398302
deviation-heading_median	1.5596509078398302
deviation-heading_min	0.7547680550768723
driven_any_max	1.000578214575964
driven_any_mean	0.6030759871591415
driven_any_median	0.6030759871591415
driven_any_min	0.2055737597423188
driven_lanedir_consec_max	0.444297845292732
driven_lanedir_consec_mean	0.2495060870450425
driven_lanedir_consec_min	0.05471432879735305
driven_lanedir_max	0.444297845292732
driven_lanedir_mean	0.2495060870450425
driven_lanedir_median	0.2495060870450425
driven_lanedir_min	0.05471432879735305
get_duckie_state_max	1.3236341805293645e-06
get_duckie_state_mean	1.2605126333419392e-06
get_duckie_state_median	1.2605126333419392e-06
get_duckie_state_min	1.197391086154514e-06
get_robot_state_max	0.003736967510647244
get_robot_state_mean	0.003654497884699211
get_robot_state_median	0.003654497884699211
get_robot_state_min	0.0035720282587511786
get_state_dump_max	0.004980574713812934
get_state_dump_mean	0.0047591698124034194
get_state_dump_median	0.0047591698124034194
get_state_dump_min	0.004537764910993905
get_ui_image_max	0.0389078246222602
get_ui_image_mean	0.03840411403626774
get_ui_image_median	0.03840411403626774
get_ui_image_min	0.03790040345027529
in-drivable-lane_max	3.299999999999989
in-drivable-lane_mean	2.2999999999999945
in-drivable-lane_min	1.3
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.2055737597423188, "get_ui_image": 0.0389078246222602, "step_physics": 0.25719594955444336, "survival_time": 2.2, "driven_lanedir": 0.05471432879735305, "get_state_dump": 0.004980574713812934, "get_robot_state": 0.003736967510647244, "sim_render-ego0": 0.0037948820326063368, "get_duckie_state": 1.197391086154514e-06, "in-drivable-lane": 1.3, "deviation-heading": 0.7547680550768723, "agent_compute-ego0": 0.01250640551249186, "complete-iteration": 0.33434436586168076, "set_robot_commands": 0.00226543214586046, "deviation-center-line": 0.08350196103523654, "driven_lanedir_consec": 0.05471432879735305, "sim_compute_sim_state": 0.008848836686876084, "sim_compute_performance-ego0": 0.002025540669759114}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.000578214575964, "get_ui_image": 0.03790040345027529, "step_physics": 0.2539200207282757, "survival_time": 7.199999999999982, "driven_lanedir": 0.444297845292732, "get_state_dump": 0.004537764910993905, "get_robot_state": 0.0035720282587511786, "sim_render-ego0": 0.003694162697627626, "get_duckie_state": 1.3236341805293645e-06, "in-drivable-lane": 3.299999999999989, "deviation-heading": 2.364533760602788, "agent_compute-ego0": 0.012322233463155812, "complete-iteration": 0.33058980251180714, "set_robot_commands": 0.0021575681094465585, "deviation-center-line": 0.25355726440757503, "driven_lanedir_consec": 0.444297845292732, "sim_compute_sim_state": 0.01047687366090972, "sim_compute_performance-ego0": 0.0019267164427658608}}
set_robot_commands_max	0.00226543214586046
set_robot_commands_mean	0.002211500127653509
set_robot_commands_median	0.002211500127653509
set_robot_commands_min	0.0021575681094465585
sim_compute_performance-ego0_max	0.002025540669759114
sim_compute_performance-ego0_mean	0.0019761285562624876
sim_compute_performance-ego0_median	0.0019761285562624876
sim_compute_performance-ego0_min	0.0019267164427658608
sim_compute_sim_state_max	0.01047687366090972
sim_compute_sim_state_mean	0.009662855173892902
sim_compute_sim_state_median	0.009662855173892902
sim_compute_sim_state_min	0.008848836686876084
sim_render-ego0_max	0.0037948820326063368
sim_render-ego0_mean	0.003744522365116982
sim_render-ego0_median	0.003744522365116982
sim_render-ego0_min	0.003694162697627626
simulation-passed	1
step_physics_max	0.25719594955444336
step_physics_mean	0.2555579851413595
step_physics_median	0.2555579851413595
step_physics_min	0.2539200207282757
survival_time_max	7.199999999999982
survival_time_mean	4.699999999999991
survival_time_min	2.2

No reset possible

53841

12648

Bea Baselines 🐤

template-pytorch

LFt-sim

success

yes

2020-12-02 23:06:11+00:00

2020-12-02 23:17:04+00:00

0:10:53

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.4394432379242401
survival_time_median	12.32500000000004
deviation-center-line_median	0.47700481542561846
in-drivable-lane_median	7.375000000000035

other stats

agent_compute-ego0_max	0.011910559639098152
agent_compute-ego0_mean	0.011789041847879392
agent_compute-ego0_median	0.011797317582150845
agent_compute-ego0_min	0.011650972588117732
complete-iteration_max	0.310642540916916
complete-iteration_mean	0.25925015139938024
complete-iteration_median	0.25975731659586543
complete-iteration_min	0.2068434314888741
deviation-center-line_max	0.9201174278876558
deviation-center-line_mean	0.5561429330434554
deviation-center-line_min	0.3504446734349288
deviation-heading_max	10.077371338057354
deviation-heading_mean	4.924312133705122
deviation-heading_median	3.6026958542721523
deviation-heading_min	2.4144854882188307
driven_any_max	2.898315644570542
driven_any_mean	1.6133635246317397
driven_any_median	1.312997165089076
driven_any_min	0.9291441237782636
driven_lanedir_consec_max	1.012236589125366
driven_lanedir_consec_mean	0.5498333292632782
driven_lanedir_consec_min	0.30821025207926644
driven_lanedir_max	1.012236589125366
driven_lanedir_mean	0.5498333292632782
driven_lanedir_median	0.4394432379242401
driven_lanedir_min	0.30821025207926644
get_duckie_state_max	1.328906932460608e-06
get_duckie_state_mean	1.229963138214264e-06
get_duckie_state_median	1.2167209743998711e-06
get_duckie_state_min	1.157503671596705e-06
get_robot_state_max	0.0035433785697133223
get_robot_state_mean	0.0034873564088375875
get_robot_state_median	0.003498649845155108
get_robot_state_min	0.0034087473753268128
get_state_dump_max	0.004415961760508863
get_state_dump_mean	0.004340439496143435
get_state_dump_median	0.004341828333267118
get_state_dump_min	0.00426213955753064
get_ui_image_max	0.034994825836299925
get_ui_image_mean	0.02984614627850151
get_ui_image_median	0.029638978127544048
get_ui_image_min	0.02511180302261803
in-drivable-lane_max	15.850000000000165
in-drivable-lane_mean	8.93750000000006
in-drivable-lane_min	5.150000000000005
per-episodes	details {"LF-norm-loop-000-ego0": {"driven_any": 2.898315644570542, "get_ui_image": 0.027981280456964627, "step_physics": 0.1811188762052071, "survival_time": 28.900000000000276, "driven_lanedir": 1.012236589125366, "get_state_dump": 0.004288683695290785, "get_robot_state": 0.0035433785697133223, "sim_render-ego0": 0.0036560842616158657, "get_duckie_state": 1.157503671596705e-06, "in-drivable-lane": 15.850000000000165, "deviation-heading": 10.077371338057354, "agent_compute-ego0": 0.011910501127621875, "complete-iteration": 0.24404956104430095, "set_robot_commands": 0.0021011545250452864, "deviation-center-line": 0.9201174278876558, "driven_lanedir_consec": 1.012236589125366, "sim_compute_sim_state": 0.00750388300274732, "sim_compute_performance-ego0": 0.001876559693990388}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4651148121683055, "get_ui_image": 0.034994825836299925, "step_physics": 0.23515023834021517, "survival_time": 12.850000000000048, "driven_lanedir": 0.46417157794761366, "get_state_dump": 0.004394972971243452, "get_robot_state": 0.0034647431484488554, "sim_render-ego0": 0.0035344750382179436, "get_duckie_state": 1.2161195740219237e-06, "in-drivable-lane": 6.650000000000027, "deviation-heading": 4.508399723938373, "agent_compute-ego0": 0.011650972588117732, "complete-iteration": 0.310642540916916, "set_robot_commands": 0.002024284628934638, "deviation-center-line": 0.3504446734349288, "driven_lanedir_consec": 0.46417157794761366, "sim_compute_sim_state": 0.013534998708917188, "sim_compute_performance-ego0": 0.001818872237390326}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.9291441237782636, "get_ui_image": 0.03129667579812347, "step_physics": 0.20602051543180275, "survival_time": 9.4, "driven_lanedir": 0.4147148979008666, "get_state_dump": 0.00426213955753064, "get_robot_state": 0.0034087473753268128, "sim_render-ego0": 0.003510285937596882, "get_duckie_state": 1.2173223747778192e-06, "in-drivable-lane": 5.150000000000005, "deviation-heading": 2.6969919846059316, "agent_compute-ego0": 0.011910559639098152, "complete-iteration": 0.27546507214742993, "set_robot_commands": 0.002041961780931584, "deviation-center-line": 0.493679972915465, "driven_lanedir_consec": 0.4147148979008666, "sim_compute_sim_state": 0.011139043424495312, "sim_compute_performance-ego0": 0.0018022375762777984}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.1608795180098463, "get_ui_image": 0.02511180302261803, "step_physics": 0.14874315060643706, "survival_time": 11.800000000000033, "driven_lanedir": 0.30821025207926644, "get_state_dump": 0.004415961760508863, "get_robot_state": 0.003532556541861361, "sim_render-ego0": 0.0035711320643686544, "get_duckie_state": 1.328906932460608e-06, "in-drivable-lane": 8.100000000000042, "deviation-heading": 2.4144854882188307, "agent_compute-ego0": 0.01168413403667981, "complete-iteration": 0.2068434314888741, "set_robot_commands": 0.0021232321292539184, "deviation-center-line": 0.460329657935772, "driven_lanedir_consec": 0.30821025207926644, "sim_compute_sim_state": 0.005741467455771402, "sim_compute_performance-ego0": 0.001846909020017471}}
set_robot_commands_max	0.0021232321292539184
set_robot_commands_mean	0.0020726582660413567
set_robot_commands_median	0.002071558152988435
set_robot_commands_min	0.002024284628934638
sim_compute_performance-ego0_max	0.001876559693990388
sim_compute_performance-ego0_mean	0.001836144631918996
sim_compute_performance-ego0_median	0.0018328906287038984
sim_compute_performance-ego0_min	0.0018022375762777984
sim_compute_sim_state_max	0.013534998708917188
sim_compute_sim_state_mean	0.009479848147982806
sim_compute_sim_state_median	0.009321463213621315
sim_compute_sim_state_min	0.005741467455771402
sim_render-ego0_max	0.0036560842616158657
sim_render-ego0_mean	0.003567994325449836
sim_render-ego0_median	0.003552803551293299
sim_render-ego0_min	0.003510285937596882
simulation-passed	1
step_physics_max	0.23515023834021517
step_physics_mean	0.19275819514591555
step_physics_median	0.19356969581850497
step_physics_min	0.14874315060643706
survival_time_max	28.900000000000276
survival_time_mean	15.73750000000009
survival_time_min	9.4

No reset possible

53820

12652

Bea Baselines 🐤

template-pytorch

LFVIv-sim

success

yes

2020-12-02 22:49:38+00:00

2020-12-02 23:05:43+00:00

0:16:05

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.08672258165945501
survival_time_median	9.725000000000051
deviation-center-line_median	0.07049898153719247
in-drivable-lane_median	8.45000000000005

other stats

agent_compute-ego0_max	0.013256324421275743
agent_compute-ego0_mean	0.012942744623789025
agent_compute-ego0_median	0.012942744623789025
agent_compute-ego0_min	0.0126291648263023
agent_compute-ego1_max	0.013129880211570046
agent_compute-ego1_mean	0.01259183892697999
agent_compute-ego1_median	0.01259183892697999
agent_compute-ego1_min	0.012053797642389933
agent_compute-ego2_max	0.01327245452187278
agent_compute-ego2_mean	0.012671333783632747
agent_compute-ego2_median	0.012671333783632747
agent_compute-ego2_min	0.012070213045392715
agent_compute-ego3_max	0.012819177454168149
agent_compute-ego3_mean	0.012320676078270008
agent_compute-ego3_median	0.012320676078270008
agent_compute-ego3_min	0.01182217470237187
complete-iteration_max	1.5377024369580403
complete-iteration_mean	1.4559744087519584
complete-iteration_median	1.4559744087519584
complete-iteration_min	1.3742463805458762
deviation-center-line_max	0.21998756451335297
deviation-center-line_mean	0.08730729117887631
deviation-center-line_min	0.039660659054825305
deviation-heading_max	1.6345977838434222
deviation-heading_mean	0.8889140414729613
deviation-heading_median	0.8251403596405193
deviation-heading_min	0.6016189861540672
driven_any_max	2.5059777030207475
driven_any_mean	0.502999127444291
driven_any_median	0.229345020306139
driven_any_min	0.08613330749720749
driven_lanedir_consec_max	0.12500032862450228
driven_lanedir_consec_mean	0.08910260733273437
driven_lanedir_consec_min	0.04557006531332019
driven_lanedir_max	0.12500032862450228
driven_lanedir_mean	0.08910260733273437
driven_lanedir_median	0.08672258165945501
driven_lanedir_min	0.04557006531332019
get_duckie_state_max	1.1928024746122817e-06
get_duckie_state_mean	1.1816104769190669e-06
get_duckie_state_median	1.1816104769190669e-06
get_duckie_state_min	1.1704184792258525e-06
get_robot_state_max	0.013947824998335403
get_robot_state_mean	0.013837472849336022
get_robot_state_median	0.013837472849336022
get_robot_state_min	0.013727120700336638
get_state_dump_max	0.00949088443409313
get_state_dump_mean	0.009386826103383844
get_state_dump_median	0.009386826103383844
get_state_dump_min	0.00928276777267456
get_ui_image_max	0.05405940966946738
get_ui_image_mean	0.05347828627019734
get_ui_image_median	0.05347828627019734
get_ui_image_min	0.05289716287092729
in-drivable-lane_max	15.700000000000102
in-drivable-lane_mean	8.312500000000052
in-drivable-lane_min	0.0
per-episodes	details {"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.5059777030207475, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.12500032862450228, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.350000000000104, "deviation-heading": 0.7547441266989323, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.06987775375947997, "driven_lanedir_consec": 0.12500032862450228, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 0.17668828699244837, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.04557006531332019, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.700000000000102, "deviation-heading": 0.8690228611869966, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.039660659054825305, "driven_lanedir_consec": 0.04557006531332019, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 0.221782257270239, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.1152078178995819, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.300000000000104, "deviation-heading": 0.8798023541884048, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.079310250668293, "driven_lanedir_consec": 0.1152078178995819, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.267479969191447, "get_ui_image": 0.05405940966946738, "step_physics": 1.3674101957253046, "survival_time": 16.750000000000103, "driven_lanedir": 0.08269737970837587, "get_state_dump": 0.00928276777267456, "get_robot_state": 0.013727120700336638, "sim_render-ego0": 0.0036003043254216513, "sim_render-ego1": 0.0035558023623057772, "sim_render-ego2": 0.0035548110802968345, "sim_render-ego3": 0.0035266436281658356, "get_duckie_state": 1.1928024746122817e-06, "in-drivable-lane": 15.650000000000102, "deviation-heading": 0.6016189861540672, "agent_compute-ego0": 0.0126291648263023, "agent_compute-ego1": 0.012053797642389933, "agent_compute-ego2": 0.012070213045392715, "agent_compute-ego3": 0.01182217470237187, "complete-iteration": 1.5377024369580403, "set_robot_commands": 0.0021240065495173135, "deviation-center-line": 0.071120209314905, "driven_lanedir_consec": 0.08269737970837587, "sim_compute_sim_state": 0.014249935746192932, "sim_compute_performance-ego0": 0.0018596301476160688, "sim_compute_performance-ego1": 0.0018373621361596243, "sim_compute_performance-ego2": 0.0018877663782664708, "sim_compute_performance-ego3": 0.0018895559367679417}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.08613330749720749, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.07276239153796382, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6345977838434222, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.21998756451335297, "driven_lanedir_consec": 0.07276239153796382, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 0.23690778334203905, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.09074778361053416, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.499999999999998, "deviation-heading": 0.7814913067265511, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.059209150285057896, "driven_lanedir_consec": 0.09074778361053416, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.20121237197910127, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.0815858534442162, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.399999999999998, "deviation-heading": 0.7212455004308286, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.09138670317253247, "driven_lanedir_consec": 0.0815858534442162, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.32781134026109854, "get_ui_image": 0.05289716287092729, "step_physics": 1.1878787170756946, "survival_time": 2.6999999999999984, "driven_lanedir": 0.09924923852338052, "get_state_dump": 0.00949088443409313, "get_robot_state": 0.013947824998335403, "sim_render-ego0": 0.003642749786376953, "sim_render-ego1": 0.00381860299543901, "sim_render-ego2": 0.003716291080821644, "sim_render-ego3": 0.003723075173117898, "get_duckie_state": 1.1704184792258525e-06, "in-drivable-lane": 1.599999999999998, "deviation-heading": 0.8687894125544877, "agent_compute-ego0": 0.013256324421275743, "agent_compute-ego1": 0.013129880211570046, "agent_compute-ego2": 0.01327245452187278, "agent_compute-ego3": 0.012819177454168149, "complete-iteration": 1.3742463805458762, "set_robot_commands": 0.0021427371285178444, "deviation-center-line": 0.06790603866256387, "driven_lanedir_consec": 0.09924923852338052, "sim_compute_sim_state": 0.025907291065562856, "sim_compute_performance-ego0": 0.0019515210931951349, "sim_compute_performance-ego1": 0.0019725366072221237, "sim_compute_performance-ego2": 0.001957832683216442, "sim_compute_performance-ego3": 0.0019353433088822795}}
set_robot_commands_max	0.0021427371285178444
set_robot_commands_mean	0.0021333718390175787
set_robot_commands_median	0.0021333718390175787
set_robot_commands_min	0.0021240065495173135
sim_compute_performance-ego0_max	0.0019515210931951349
sim_compute_performance-ego0_mean	0.0019055756204056015
sim_compute_performance-ego0_median	0.0019055756204056015
sim_compute_performance-ego0_min	0.0018596301476160688
sim_compute_performance-ego1_max	0.0019725366072221237
sim_compute_performance-ego1_mean	0.001904949371690874
sim_compute_performance-ego1_median	0.001904949371690874
sim_compute_performance-ego1_min	0.0018373621361596243
sim_compute_performance-ego2_max	0.001957832683216442
sim_compute_performance-ego2_mean	0.001922799530741456
sim_compute_performance-ego2_median	0.001922799530741456
sim_compute_performance-ego2_min	0.0018877663782664708
sim_compute_performance-ego3_max	0.0019353433088822795
sim_compute_performance-ego3_mean	0.0019124496228251104
sim_compute_performance-ego3_median	0.0019124496228251104
sim_compute_performance-ego3_min	0.0018895559367679417
sim_compute_sim_state_max	0.025907291065562856
sim_compute_sim_state_mean	0.020078613405877896
sim_compute_sim_state_median	0.020078613405877896
sim_compute_sim_state_min	0.014249935746192932
sim_render-ego0_max	0.003642749786376953
sim_render-ego0_mean	0.003621527055899302
sim_render-ego0_median	0.003621527055899302
sim_render-ego0_min	0.0036003043254216513
sim_render-ego1_max	0.00381860299543901
sim_render-ego1_mean	0.0036872026788723937
sim_render-ego1_median	0.0036872026788723937
sim_render-ego1_min	0.0035558023623057772
sim_render-ego2_max	0.003716291080821644
sim_render-ego2_mean	0.0036355510805592393
sim_render-ego2_median	0.0036355510805592393
sim_render-ego2_min	0.0035548110802968345
sim_render-ego3_max	0.003723075173117898
sim_render-ego3_mean	0.0036248594006418663
sim_render-ego3_median	0.0036248594006418663
sim_render-ego3_min	0.0035266436281658356
simulation-passed	1
step_physics_max	1.3674101957253046
step_physics_mean	1.2776444564004996
step_physics_median	1.2776444564004996
step_physics_min	1.1878787170756946
survival_time_max	16.750000000000103
survival_time_mean	9.725000000000051
survival_time_min	2.6999999999999984

No reset possible

53806

12654

Bea Baselines 🐤

template-tensorflow

LFVv-sim

success

yes

2020-12-02 22:40:12+00:00

2020-12-02 22:49:24+00:00

0:09:12

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2537880480303647
survival_time_median	4.574999999999992
deviation-center-line_median	0.07605087593766466
in-drivable-lane_median	3.274999999999992

other stats

agent_compute-ego0_max	0.03743722065385566
agent_compute-ego0_mean	0.01952799543766396
agent_compute-ego0_median	0.014016066045235238
agent_compute-ego0_min	0.012642629006329705
agent_compute-npc0_max	0.026515463748610163
agent_compute-npc0_mean	0.022589699500425865
agent_compute-npc0_median	0.02162643031462827
agent_compute-npc0_min	0.02059047362383674
agent_compute-npc1_max	0.05772795677185059
agent_compute-npc1_mean	0.04665288005268078
agent_compute-npc1_median	0.048031402569191126
agent_compute-npc1_min	0.03419928081700059
agent_compute-npc2_max	0.04655893715945157
agent_compute-npc2_mean	0.03847897053856393
agent_compute-npc2_median	0.03454781747331806
agent_compute-npc2_min	0.03433015698292216
agent_compute-npc3_max	0.04603910229422829
agent_compute-npc3_mean	0.040095632067763655
agent_compute-npc3_median	0.040095632067763655
agent_compute-npc3_min	0.03415216184129902
complete-iteration_max	1.2120460575277154
complete-iteration_mean	0.8783436619094085
complete-iteration_median	0.9627153399442026
complete-iteration_min	0.3758979102215135
deviation-center-line_max	0.10132675302433532
deviation-center-line_mean	0.07494566982869583
deviation-center-line_min	0.0463541744151187
deviation-heading_max	1.441470676196115
deviation-heading_mean	0.7195146675298418
deviation-heading_median	0.534887674089113
deviation-heading_min	0.3668126457450268
driven_any_max	1.9494455215110944
driven_any_mean	1.432706283046905
driven_any_median	1.5108009618766636
driven_any_min	0.7597776869231992
driven_lanedir_consec_max	0.34646452238566505
driven_lanedir_consec_mean	0.2576495835855469
driven_lanedir_consec_min	0.17655771589579317
driven_lanedir_max	0.34646452238566505
driven_lanedir_mean	0.2576495835855469
driven_lanedir_median	0.2537880480303647
driven_lanedir_min	0.17655771589579317
get_duckie_state_max	1.4261765913529829e-06
get_duckie_state_mean	1.3157580469352193e-06
get_duckie_state_median	1.3177064763400103e-06
get_duckie_state_min	1.2014426437078735e-06
get_robot_state_max	0.01735659729350697
get_robot_state_mean	0.013837608013998227
get_robot_state_median	0.01546695509435126
get_robot_state_min	0.007059924573783415
get_state_dump_max	0.011028051376342772
get_state_dump_mean	0.009368553946663846
get_state_dump_median	0.010147888995335823
get_state_dump_min	0.006150386419640966
get_ui_image_max	0.05669493891976096
get_ui_image_mean	0.04631879720533624
get_ui_image_median	0.04878801536575386
get_ui_image_min	0.0310042191700763
in-drivable-lane_max	4.09999999999999
in-drivable-lane_mean	3.0999999999999925
in-drivable-lane_min	1.749999999999997
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 0.7597776869231992, "get_ui_image": 0.044345382784233715, "step_physics": 0.5787649975448358, "survival_time": 2.9999999999999973, "driven_lanedir": 0.26539363572756147, "get_state_dump": 0.009427981298477923, "get_robot_state": 0.013926341885426003, "sim_render-ego0": 0.003729433309836466, "sim_render-npc0": 0.003589571499433674, "sim_render-npc1": 0.0035530035613013096, "sim_render-npc2": 0.0035909512003914255, "get_duckie_state": 1.3054394331134734e-06, "in-drivable-lane": 1.749999999999997, "deviation-heading": 0.41367078499277415, "agent_compute-ego0": 0.014249578851168274, "agent_compute-npc0": 0.02101671500284164, "agent_compute-npc1": 0.03419928081700059, "agent_compute-npc2": 0.03433015698292216, "complete-iteration": 0.8070081062004214, "set_robot_commands": 0.0021924542599037044, "deviation-center-line": 0.06424043215326485, "driven_lanedir_consec": 0.26539363572756147, "sim_compute_sim_state": 0.02581065209185491, "sim_compute_performance-ego0": 0.0019279151666359825, "sim_compute_performance-npc0": 0.0019002195264472335, "sim_compute_performance-npc1": 0.001898976623034868, "sim_compute_performance-npc2": 0.001902451280687676}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.8203670755705907, "get_ui_image": 0.05669493891976096, "step_physics": 0.8388685963370583, "survival_time": 5.449999999999989, "driven_lanedir": 0.17655771589579317, "get_state_dump": 0.011028051376342772, "get_robot_state": 0.01735659729350697, "sim_render-ego0": 0.003663446686484597, "sim_render-npc0": 0.003640174865722656, "sim_render-npc1": 0.003671453215859153, "sim_render-npc2": 0.003678009726784446, "sim_render-npc3": 0.003739166259765625, "get_duckie_state": 1.4261765913529829e-06, "in-drivable-lane": 3.999999999999991, "deviation-heading": 1.441470676196115, "agent_compute-ego0": 0.013782553239302204, "agent_compute-npc0": 0.022236145626414905, "agent_compute-npc1": 0.05772795677185059, "agent_compute-npc2": 0.04655893715945157, "agent_compute-npc3": 0.04603910229422829, "complete-iteration": 1.2120460575277154, "set_robot_commands": 0.0022436163642189717, "deviation-center-line": 0.10132675302433532, "driven_lanedir_consec": 0.17655771589579317, "sim_compute_sim_state": 0.06230758103457364, "sim_compute_performance-ego0": 0.0019718040119517935, "sim_compute_performance-npc0": 0.0019077279350974345, "sim_compute_performance-npc1": 0.001910840381275524, "sim_compute_performance-npc2": 0.0019653732126409355, "sim_compute_performance-npc3": 0.0019899498332630505}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.9494455215110944, "get_ui_image": 0.053230647947274, "step_physics": 0.7911086129207238, "survival_time": 5.04999999999999, "driven_lanedir": 0.24218246033316793, "get_state_dump": 0.010867796692193723, "get_robot_state": 0.017007568303276512, "sim_render-ego0": 0.0035516935236313764, "sim_render-npc0": 0.0034790413052428, "sim_render-npc1": 0.0035723003686643114, "sim_render-npc2": 0.0035497534508798635, "sim_render-npc3": 0.0035507655611225204, "get_duckie_state": 1.2014426437078735e-06, "in-drivable-lane": 4.09999999999999, "deviation-heading": 0.3668126457450268, "agent_compute-ego0": 0.012642629006329705, "agent_compute-npc0": 0.02059047362383674, "agent_compute-npc1": 0.048031402569191126, "agent_compute-npc2": 0.03454781747331806, "agent_compute-npc3": 0.03415216184129902, "complete-iteration": 1.1184225736879836, "set_robot_commands": 0.002077820254307167, "deviation-center-line": 0.0463541744151187, "driven_lanedir_consec": 0.24218246033316793, "sim_compute_sim_state": 0.05846911318161909, "sim_compute_performance-ego0": 0.0018541836271099017, "sim_compute_performance-npc0": 0.001821447821224437, "sim_compute_performance-npc1": 0.0018627129349054075, "sim_compute_performance-npc2": 0.0018843225404327991, "sim_compute_performance-npc3": 0.0018752205605600395}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.2012348481827364, "get_ui_image": 0.0310042191700763, "step_physics": 0.24227101831551057, "survival_time": 4.099999999999993, "driven_lanedir": 0.34646452238566505, "get_state_dump": 0.006150386419640966, "get_robot_state": 0.007059924573783415, "sim_render-ego0": 0.003638572003467974, "sim_render-npc0": 0.003613477729889283, "get_duckie_state": 1.3299735195665477e-06, "in-drivable-lane": 2.5499999999999927, "deviation-heading": 0.6561045631854517, "agent_compute-ego0": 0.03743722065385566, "agent_compute-npc0": 0.026515463748610163, "complete-iteration": 0.3758979102215135, "set_robot_commands": 0.0025053139192512236, "deviation-center-line": 0.08786131972206447, "driven_lanedir_consec": 0.34646452238566505, "sim_compute_sim_state": 0.009569768446037567, "sim_compute_performance-ego0": 0.001939408750419157, "sim_compute_performance-npc0": 0.0019031691263957195}}
set_robot_commands_max	0.0025053139192512236
set_robot_commands_mean	0.0022548011994202666
set_robot_commands_median	0.002218035312061338
set_robot_commands_min	0.002077820254307167
sim_compute_performance-ego0_max	0.0019718040119517935
sim_compute_performance-ego0_mean	0.0019233278890292088
sim_compute_performance-ego0_median	0.0019336619585275695
sim_compute_performance-ego0_min	0.0018541836271099017
sim_compute_performance-npc0_max	0.0019077279350974345
sim_compute_performance-npc0_mean	0.0018831411022912064
sim_compute_performance-npc0_median	0.0019016943264214764
sim_compute_performance-npc0_min	0.001821447821224437
sim_compute_performance-npc1_max	0.001910840381275524
sim_compute_performance-npc1_mean	0.0018908433130719333
sim_compute_performance-npc1_median	0.001898976623034868
sim_compute_performance-npc1_min	0.0018627129349054075
sim_compute_performance-npc2_max	0.0019653732126409355
sim_compute_performance-npc2_mean	0.001917382344587137
sim_compute_performance-npc2_median	0.001902451280687676
sim_compute_performance-npc2_min	0.0018843225404327991
sim_compute_performance-npc3_max	0.0019899498332630505
sim_compute_performance-npc3_mean	0.001932585196911545
sim_compute_performance-npc3_median	0.001932585196911545
sim_compute_performance-npc3_min	0.0018752205605600395
sim_compute_sim_state_max	0.06230758103457364
sim_compute_sim_state_mean	0.039039278688521306
sim_compute_sim_state_median	0.042139882636737
sim_compute_sim_state_min	0.009569768446037567
sim_render-ego0_max	0.003729433309836466
sim_render-ego0_mean	0.003645786380855103
sim_render-ego0_median	0.003651009344976285
sim_render-ego0_min	0.0035516935236313764
sim_render-npc0_max	0.003640174865722656
sim_render-npc0_mean	0.003580566350072103
sim_render-npc0_median	0.003601524614661479
sim_render-npc0_min	0.0034790413052428
sim_render-npc1_max	0.003671453215859153
sim_render-npc1_mean	0.0035989190486082575
sim_render-npc1_median	0.0035723003686643114
sim_render-npc1_min	0.0035530035613013096
sim_render-npc2_max	0.003678009726784446
sim_render-npc2_mean	0.0036062381260185783
sim_render-npc2_median	0.0035909512003914255
sim_render-npc2_min	0.0035497534508798635
sim_render-npc3_max	0.003739166259765625
sim_render-npc3_mean	0.003644965910444073
sim_render-npc3_median	0.003644965910444073
sim_render-npc3_min	0.0035507655611225204
simulation-passed	1
step_physics_max	0.8388685963370583
step_physics_mean	0.6127533062795322
step_physics_median	0.6849368052327798
step_physics_min	0.24227101831551057
survival_time_max	5.449999999999989
survival_time_mean	4.399999999999992
survival_time_min	2.9999999999999973

No reset possible

53802

12655

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

2020-12-02 22:37:20+00:00

2020-12-02 22:39:37+00:00

0:02:17

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2423656666233197
survival_time_median	2.3249999999999997
deviation-center-line_median	0.05982798061828995
in-drivable-lane_median	1.1749999999999994

other stats

agent_compute-ego0_max	0.05909080938859419
agent_compute-ego0_mean	0.036501629042327934
agent_compute-ego0_median	0.036501629042327934
agent_compute-ego0_min	0.013912448696061676
complete-iteration_max	0.35470789670944214
complete-iteration_mean	0.3177538531668046
complete-iteration_median	0.3177538531668046
complete-iteration_min	0.28079980962416706
deviation-center-line_max	0.06992466297704801
deviation-center-line_mean	0.05982798061828995
deviation-center-line_min	0.049731298259531896
deviation-heading_max	0.5000886197624697
deviation-heading_mean	0.4757613123271424
deviation-heading_median	0.4757613123271424
deviation-heading_min	0.4514340048918152
driven_any_max	0.6472976014111754
driven_any_mean	0.5137694899234051
driven_any_median	0.5137694899234051
driven_any_min	0.38024137843563466
driven_lanedir_consec_max	0.2790917942077844
driven_lanedir_consec_mean	0.2423656666233197
driven_lanedir_consec_min	0.205639539038855
driven_lanedir_max	0.2790917942077844
driven_lanedir_mean	0.2423656666233197
driven_lanedir_median	0.2423656666233197
driven_lanedir_min	0.205639539038855
get_duckie_state_max	1.3323391185087315e-06
get_duckie_state_mean	1.3001462355017024e-06
get_duckie_state_median	1.3001462355017024e-06
get_duckie_state_min	1.2679533524946731e-06
get_robot_state_max	0.003758284178647128
get_robot_state_mean	0.00365308150250644
get_robot_state_median	0.00365308150250644
get_robot_state_min	0.0035478788263657514
get_state_dump_max	0.004863430153239857
get_state_dump_mean	0.004717959917802861
get_state_dump_median	0.004717959917802861
get_state_dump_min	0.004572489682365866
get_ui_image_max	0.037745670838789505
get_ui_image_mean	0.037625272431263096
get_ui_image_median	0.037625272431263096
get_ui_image_min	0.037504874023736694
in-drivable-lane_max	1.4499999999999988
in-drivable-lane_mean	1.1749999999999994
in-drivable-lane_min	0.8999999999999999
per-episodes	details {"LFI-full-4way-000-ego0": {"driven_any": 0.38024137843563466, "get_ui_image": 0.037745670838789505, "step_physics": 0.2319801612333818, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2790917942077844, "get_state_dump": 0.004863430153239857, "get_robot_state": 0.003758284178647128, "sim_render-ego0": 0.003725956786762584, "get_duckie_state": 1.2679533524946731e-06, "in-drivable-lane": 0.8999999999999999, "deviation-heading": 0.4514340048918152, "agent_compute-ego0": 0.05909080938859419, "complete-iteration": 0.35470789670944214, "set_robot_commands": 0.002238484946164218, "deviation-center-line": 0.06992466297704801, "driven_lanedir_consec": 0.2790917942077844, "sim_compute_sim_state": 0.009233875708146528, "sim_compute_performance-ego0": 0.0019816810434514828}, "LFI-full-udem1-000-ego0": {"driven_any": 0.6472976014111754, "get_ui_image": 0.037504874023736694, "step_physics": 0.20427338282267252, "survival_time": 2.499999999999999, "driven_lanedir": 0.205639539038855, "get_state_dump": 0.004572489682365866, "get_robot_state": 0.0035478788263657514, "sim_render-ego0": 0.0036876482122084673, "get_duckie_state": 1.3323391185087315e-06, "in-drivable-lane": 1.4499999999999988, "deviation-heading": 0.5000886197624697, "agent_compute-ego0": 0.013912448696061676, "complete-iteration": 0.28079980962416706, "set_robot_commands": 0.0021387268515194163, "deviation-center-line": 0.049731298259531896, "driven_lanedir_consec": 0.205639539038855, "sim_compute_sim_state": 0.009146919437483246, "sim_compute_performance-ego0": 0.0019284743888705383}}
set_robot_commands_max	0.002238484946164218
set_robot_commands_mean	0.002188605898841817
set_robot_commands_median	0.002188605898841817
set_robot_commands_min	0.0021387268515194163
sim_compute_performance-ego0_max	0.0019816810434514828
sim_compute_performance-ego0_mean	0.00195507771616101
sim_compute_performance-ego0_median	0.00195507771616101
sim_compute_performance-ego0_min	0.0019284743888705383
sim_compute_sim_state_max	0.009233875708146528
sim_compute_sim_state_mean	0.009190397572814889
sim_compute_sim_state_median	0.009190397572814889
sim_compute_sim_state_min	0.009146919437483246
sim_render-ego0_max	0.003725956786762584
sim_render-ego0_mean	0.003706802499485526
sim_render-ego0_median	0.003706802499485526
sim_render-ego0_min	0.0036876482122084673
simulation-passed	1
step_physics_max	0.2319801612333818
step_physics_mean	0.21812677202802716
step_physics_median	0.21812677202802716
step_physics_min	0.20427338282267252
survival_time_max	2.499999999999999
survival_time_mean	2.3249999999999997
survival_time_min	2.1500000000000004

No reset possible

53797

12655

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

2020-12-02 22:34:30+00:00

2020-12-02 22:36:52+00:00

0:02:22

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2594108386688282
survival_time_median	2.3249999999999997
deviation-center-line_median	0.05874343158091873
in-drivable-lane_median	1.1499999999999997

other stats

agent_compute-ego0_max	0.05879776044325395
agent_compute-ego0_mean	0.036043694843795424
agent_compute-ego0_median	0.036043694843795424
agent_compute-ego0_min	0.013289629244336895
complete-iteration_max	0.33505079421130096
complete-iteration_mean	0.3085493087874802
complete-iteration_median	0.3085493087874802
complete-iteration_min	0.2820478233636594
deviation-center-line_max	0.06775556490230555
deviation-center-line_mean	0.05874343158091873
deviation-center-line_min	0.049731298259531896
deviation-heading_max	0.5000886197624697
deviation-heading_mean	0.46201093187742337
deviation-heading_median	0.46201093187742337
deviation-heading_min	0.4239332439923771
driven_any_max	0.6472976014111754
driven_any_mean	0.5259653753048321
driven_any_median	0.5259653753048321
driven_any_min	0.4046331491984889
driven_lanedir_consec_max	0.31318213829880137
driven_lanedir_consec_mean	0.2594108386688282
driven_lanedir_consec_min	0.205639539038855
driven_lanedir_max	0.31318213829880137
driven_lanedir_mean	0.2594108386688282
driven_lanedir_median	0.2594108386688282
driven_lanedir_min	0.205639539038855
get_duckie_state_max	1.262216007008272e-06
get_duckie_state_mean	1.1919335247998568e-06
get_duckie_state_median	1.1919335247998568e-06
get_duckie_state_min	1.1216510425914417e-06
get_robot_state_max	0.003632783889770508
get_robot_state_mean	0.003572763181200214
get_robot_state_median	0.003572763181200214
get_robot_state_min	0.003512742472629921
get_state_dump_max	0.004580887881192294
get_state_dump_mean	0.0045187624168056
get_state_dump_median	0.0045187624168056
get_state_dump_min	0.004456636952418907
get_ui_image_max	0.03820009123195301
get_ui_image_mean	0.037756575248245675
get_ui_image_median	0.037756575248245675
get_ui_image_min	0.03731305926453834
in-drivable-lane_max	1.4499999999999988
in-drivable-lane_mean	1.1499999999999997
in-drivable-lane_min	0.8499999999999999
per-episodes	details {"LFI-full-4way-000-ego0": {"driven_any": 0.4046331491984889, "get_ui_image": 0.03820009123195301, "step_physics": 0.21277615157040683, "survival_time": 2.1500000000000004, "driven_lanedir": 0.31318213829880137, "get_state_dump": 0.004580887881192294, "get_robot_state": 0.003632783889770508, "sim_render-ego0": 0.003692827441475608, "get_duckie_state": 1.1216510425914417e-06, "in-drivable-lane": 0.8499999999999999, "deviation-heading": 0.4239332439923771, "agent_compute-ego0": 0.05879776044325395, "complete-iteration": 0.33505079421130096, "set_robot_commands": 0.0021575797687877307, "deviation-center-line": 0.06775556490230555, "driven_lanedir_consec": 0.31318213829880137, "sim_compute_sim_state": 0.00919452580538663, "sim_compute_performance-ego0": 0.0019376332109624689}, "LFI-full-udem1-000-ego0": {"driven_any": 0.6472976014111754, "get_ui_image": 0.03731305926453834, "step_physics": 0.20676903631172927, "survival_time": 2.499999999999999, "driven_lanedir": 0.205639539038855, "get_state_dump": 0.004456636952418907, "get_robot_state": 0.003512742472629921, "sim_render-ego0": 0.003595730837653665, "get_duckie_state": 1.262216007008272e-06, "in-drivable-lane": 1.4499999999999988, "deviation-heading": 0.5000886197624697, "agent_compute-ego0": 0.013289629244336895, "complete-iteration": 0.2820478233636594, "set_robot_commands": 0.002080548043344535, "deviation-center-line": 0.049731298259531896, "driven_lanedir_consec": 0.205639539038855, "sim_compute_sim_state": 0.009096528969559014, "sim_compute_performance-ego0": 0.001854550604726754}}
set_robot_commands_max	0.0021575797687877307
set_robot_commands_mean	0.0021190639060661327
set_robot_commands_median	0.0021190639060661327
set_robot_commands_min	0.002080548043344535
sim_compute_performance-ego0_max	0.0019376332109624689
sim_compute_performance-ego0_mean	0.0018960919078446117
sim_compute_performance-ego0_median	0.0018960919078446117
sim_compute_performance-ego0_min	0.001854550604726754
sim_compute_sim_state_max	0.00919452580538663
sim_compute_sim_state_mean	0.009145527387472822
sim_compute_sim_state_median	0.009145527387472822
sim_compute_sim_state_min	0.009096528969559014
sim_render-ego0_max	0.003692827441475608
sim_render-ego0_mean	0.0036442791395646366
sim_render-ego0_median	0.0036442791395646366
sim_render-ego0_min	0.003595730837653665
simulation-passed	1
step_physics_max	0.21277615157040683
step_physics_mean	0.2097725939410681
step_physics_median	0.2097725939410681
step_physics_min	0.20676903631172927
survival_time_max	2.499999999999999
survival_time_mean	2.3249999999999997
survival_time_min	2.1500000000000004

No reset possible

53608

12712

Bea Baselines 🐤

baseline-behavior-cloning

LFVIv-sim

success

yes

2020-12-02 21:10:00+00:00

2020-12-02 22:33:55+00:00

1:23:55

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	8.001862950425226
survival_time_median	59.99999999999873
deviation-center-line_median	2.8250653723789654
in-drivable-lane_median	0.24999999999998845

other stats

agent_compute-ego0_max	0.033910900627345864
agent_compute-ego0_mean	0.03325135017017043
agent_compute-ego0_median	0.03325135017017043
agent_compute-ego0_min	0.03259179971299501
agent_compute-ego1_max	0.03362199646745693
agent_compute-ego1_mean	0.03274526375715778
agent_compute-ego1_median	0.03274526375715778
agent_compute-ego1_min	0.031868531046858634
agent_compute-ego2_max	0.03343223632126426
agent_compute-ego2_mean	0.032644821245604805
agent_compute-ego2_median	0.032644821245604805
agent_compute-ego2_min	0.031857406169945354
agent_compute-ego3_max	0.03282807689225247
agent_compute-ego3_mean	0.032344622477008145
agent_compute-ego3_median	0.032344622477008145
agent_compute-ego3_min	0.03186116806176382
complete-iteration_max	1.1315312343870572
complete-iteration_mean	1.1226635435836498
complete-iteration_median	1.1226635435836498
complete-iteration_min	1.1137958527802427
deviation-center-line_max	6.953126488911857
deviation-center-line_mean	3.9800467478416106
deviation-center-line_min	1.995252279550883
deviation-heading_max	41.46245700705427
deviation-heading_mean	21.776382167376397
deviation-heading_median	14.873179467855088
deviation-heading_min	9.057332406441803
driven_any_max	14.590346671601536
driven_any_mean	7.930683341165914
driven_any_median	8.415175253319164
driven_any_min	0.491555568886973
driven_lanedir_consec_max	14.289296906523838
driven_lanedir_consec_mean	7.6142481301488125
driven_lanedir_consec_min	0.4710403014268969
driven_lanedir_max	14.289296906523838
driven_lanedir_mean	7.6380822941817375
driven_lanedir_median	8.00186552823373
driven_lanedir_min	0.4710403014268969
get_duckie_state_max	1.2165104519020609e-06
get_duckie_state_mean	1.1971550718334494e-06
get_duckie_state_median	1.1971550718334494e-06
get_duckie_state_min	1.177799691764838e-06
get_robot_state_max	0.013753088586634144
get_robot_state_mean	0.013634717236152796
get_robot_state_median	0.013634717236152796
get_robot_state_min	0.013516345885671443
get_state_dump_max	0.009249896629962395
get_state_dump_mean	0.009147911643505494
get_state_dump_median	0.009147911643505494
get_state_dump_min	0.00904592665704859
get_ui_image_max	0.05246790362635222
get_ui_image_mean	0.0521051582944681
get_ui_image_median	0.0521051582944681
get_ui_image_min	0.05174241296258397
in-drivable-lane_max	1.4499999999999948
in-drivable-lane_mean	0.44999999999999385
in-drivable-lane_min	0.0
per-episodes	details {"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274564005348, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 14.28710329263761, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.621844223088113, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 2.868592428738889, "driven_lanedir_consec": 14.28710329263761, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.240089432902503, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 1.9003814960433445, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.215030147960086, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 5.9544361323540524, "driven_lanedir_consec": 1.9003814960433445, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.590261073735824, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 14.289296906523838, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.730272699257808, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 2.7598534943829054, "driven_lanedir_consec": 14.289296906523838, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929038889132118, "get_ui_image": 0.05246790362635222, "step_physics": 0.8536377828583729, "survival_time": 59.99999999999873, "driven_lanedir": 0.8506605764094891, "get_state_dump": 0.009249896629962395, "get_robot_state": 0.013753088586634144, "sim_render-ego0": 0.003602781462530411, "sim_render-ego1": 0.0035503605422528956, "sim_render-ego2": 0.0035643188482915034, "sim_render-ego3": 0.0035358281258639447, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 41.46245700705427, "agent_compute-ego0": 0.03259179971299501, "agent_compute-ego1": 0.031868531046858634, "agent_compute-ego2": 0.031857406169945354, "agent_compute-ego3": 0.03186116806176382, "complete-iteration": 1.1137958527802427, "set_robot_commands": 0.002173376321594086, "deviation-center-line": 6.953126488911857, "driven_lanedir_consec": 0.6898939120510256, "sim_compute_sim_state": 0.02613036618641671, "sim_compute_performance-ego0": 0.0018805449054600497, "sim_compute_performance-ego1": 0.0018353898956019316, "sim_compute_performance-ego2": 0.0018661119459471437, "sim_compute_performance-ego3": 0.0018192471115912724}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590346671601536, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 14.24763229859456, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 9.057332406441803, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 2.487761478855997, "driven_lanedir_consec": 14.24762370028614, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590327041928132, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 14.103349560424114, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.7499999999999822, "deviation-heading": 9.979384463858311, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 2.7815383160190423, "driven_lanedir_consec": 14.103344404807109, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.491555568886973, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 0.4710403014268969, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 0.0, "deviation-heading": 35.12865015489841, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 6.039813363919256, "driven_lanedir_consec": 0.4710403014268969, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.359708487353784, "get_ui_image": 0.05174241296258397, "step_physics": 0.8687292199448483, "survival_time": 59.99999999999873, "driven_lanedir": 0.955193921394044, "get_state_dump": 0.00904592665704859, "get_robot_state": 0.013516345885671443, "sim_render-ego0": 0.003564631512123381, "sim_render-ego1": 0.003543764824275669, "sim_render-ego2": 0.0035545391206638103, "sim_render-ego3": 0.003492281498460349, "get_duckie_state": 1.177799691764838e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 19.01608623645237, "agent_compute-ego0": 0.033910900627345864, "agent_compute-ego1": 0.03362199646745693, "agent_compute-ego2": 0.03343223632126426, "agent_compute-ego3": 0.03282807689225247, "complete-iteration": 1.1315312343870572, "set_robot_commands": 0.0021150616384564987, "deviation-center-line": 1.995252279550883, "driven_lanedir_consec": 0.9253010274145366, "sim_compute_sim_state": 0.024660790194877477, "sim_compute_performance-ego0": 0.001835029786274296, "sim_compute_performance-ego1": 0.0018339409220724876, "sim_compute_performance-ego2": 0.001841869282782028, "sim_compute_performance-ego3": 0.0018520516023151485}}
set_robot_commands_max	0.002173376321594086
set_robot_commands_mean	0.0021442189800252925
set_robot_commands_median	0.0021442189800252925
set_robot_commands_min	0.0021150616384564987
sim_compute_performance-ego0_max	0.0018805449054600497
sim_compute_performance-ego0_mean	0.0018577873458671729
sim_compute_performance-ego0_median	0.0018577873458671729
sim_compute_performance-ego0_min	0.001835029786274296
sim_compute_performance-ego1_max	0.0018353898956019316
sim_compute_performance-ego1_mean	0.0018346654088372096
sim_compute_performance-ego1_median	0.0018346654088372096
sim_compute_performance-ego1_min	0.0018339409220724876
sim_compute_performance-ego2_max	0.0018661119459471437
sim_compute_performance-ego2_mean	0.001853990614364586
sim_compute_performance-ego2_median	0.001853990614364586
sim_compute_performance-ego2_min	0.001841869282782028
sim_compute_performance-ego3_max	0.0018520516023151485
sim_compute_performance-ego3_mean	0.0018356493569532104
sim_compute_performance-ego3_median	0.0018356493569532104
sim_compute_performance-ego3_min	0.0018192471115912724
sim_compute_sim_state_max	0.02613036618641671
sim_compute_sim_state_mean	0.025395578190647097
sim_compute_sim_state_median	0.025395578190647097
sim_compute_sim_state_min	0.024660790194877477
sim_render-ego0_max	0.003602781462530411
sim_render-ego0_mean	0.0035837064873268957
sim_render-ego0_median	0.0035837064873268957
sim_render-ego0_min	0.003564631512123381
sim_render-ego1_max	0.0035503605422528956
sim_render-ego1_mean	0.003547062683264282
sim_render-ego1_median	0.003547062683264282
sim_render-ego1_min	0.003543764824275669
sim_render-ego2_max	0.0035643188482915034
sim_render-ego2_mean	0.003559428984477657
sim_render-ego2_median	0.003559428984477657
sim_render-ego2_min	0.0035545391206638103
sim_render-ego3_max	0.0035358281258639447
sim_render-ego3_mean	0.0035140548121621465
sim_render-ego3_median	0.0035140548121621465
sim_render-ego3_min	0.003492281498460349
simulation-passed	1
step_physics_max	0.8687292199448483
step_physics_mean	0.8611835014016106
step_physics_median	0.8611835014016106
step_physics_min	0.8536377828583729
survival_time_max	59.99999999999873
survival_time_mean	59.99999999999873
survival_time_min	59.99999999999873

No reset possible

53567

12659

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

success

yes

2020-12-02 20:53:00+00:00

2020-12-02 21:09:39+00:00

0:16:39

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.2711067850822737
survival_time_median	7.7499999999999805
deviation-center-line_median	0.12166672773097312
in-drivable-lane_median	5.274999999999984

other stats

agent_compute-ego0_max	0.026121020317077637
agent_compute-ego0_mean	0.016397180382992368
agent_compute-ego0_median	0.01298318590436663
agent_compute-ego0_min	0.01209553269778981
agent_compute-ego1_max	0.026281575361887615
agent_compute-ego1_mean	0.01641391861003485
agent_compute-ego1_median	0.012716849157415284
agent_compute-ego1_min	0.012172017377965591
agent_compute-ego2_max	0.025343337120153964
agent_compute-ego2_mean	0.016221201385182946
agent_compute-ego2_median	0.012142068999154229
agent_compute-ego2_min	0.011178198036240651
agent_compute-ego3_max	0.025558007069123097
agent_compute-ego3_mean	0.017340014126634478
agent_compute-ego3_median	0.014083044660603342
agent_compute-ego3_min	0.012378990650177002
complete-iteration_max	1.1599419942268958
complete-iteration_mean	0.9502795322411884
complete-iteration_median	1.077982887899949
complete-iteration_min	0.31719790626974664
deviation-center-line_max	1.2712449614354393
deviation-center-line_mean	0.2975366148120777
deviation-center-line_min	0.04383894934896015
deviation-heading_max	6.779520012490992
deviation-heading_mean	1.6484185483297118
deviation-heading_median	0.8540727187471719
deviation-heading_min	0.3063923477335874
driven_any_max	2.679198415637278
driven_any_mean	1.358257914612287
driven_any_median	1.428108564290258
driven_any_min	0.1697596830439804
driven_lanedir_consec_max	0.8657439523243192
driven_lanedir_consec_mean	0.3416771086784302
driven_lanedir_consec_min	0.07928748042777523
driven_lanedir_max	0.8657439523243192
driven_lanedir_mean	0.3416771086784302
driven_lanedir_median	0.2711067850822737
driven_lanedir_min	0.07928748042777523
get_duckie_state_max	1.4152282323592749e-06
get_duckie_state_mean	1.3553272516860512e-06
get_duckie_state_median	1.3544515598039686e-06
get_duckie_state_min	1.253801233628217e-06
get_robot_state_max	0.014231311969268017
get_robot_state_mean	0.012791152867232314
get_robot_state_median	0.01369621923991612
get_robot_state_min	0.006738522473503561
get_state_dump_max	0.009579048706935002
get_state_dump_mean	0.008898550403348448
get_state_dump_median	0.009320599692208428
get_state_dump_min	0.00594791524550494
get_ui_image_max	0.04960267207561395
get_ui_image_mean	0.04443716051119737
get_ui_image_median	0.04684500313975328
get_ui_image_min	0.029948860056260053
in-drivable-lane_max	6.849999999999981
in-drivable-lane_mean	4.285714285714274
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.1697596830439804, "get_ui_image": 0.044107956545693536, "step_physics": 0.7650764788900103, "survival_time": 6.949999999999983, "driven_lanedir": 0.15444980778095507, "get_state_dump": 0.009320599692208428, "get_robot_state": 0.01369621923991612, "sim_render-ego0": 0.0036621008600507465, "sim_render-ego1": 0.0035529681614467077, "sim_render-ego2": 0.0036065731729779927, "sim_render-ego3": 0.0034528425761631556, "get_duckie_state": 1.3470649719238282e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.113437304920873, "agent_compute-ego0": 0.01298318590436663, "agent_compute-ego1": 0.012364281926836286, "agent_compute-ego2": 0.012142068999154229, "agent_compute-ego3": 0.012378990650177002, "complete-iteration": 0.9294545275824412, "set_robot_commands": 0.0021833062171936037, "deviation-center-line": 0.9253403924627872, "driven_lanedir_consec": 0.15444980778095507, "sim_compute_sim_state": 0.016840219497680664, "sim_compute_performance-ego0": 0.001863854272024972, "sim_compute_performance-ego1": 0.001926898956298828, "sim_compute_performance-ego2": 0.0018578597477504183, "sim_compute_performance-ego3": 0.0018375175339835031}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.105135619995677, "get_ui_image": 0.044107956545693536, "step_physics": 0.7650764788900103, "survival_time": 6.949999999999983, "driven_lanedir": 0.13889942350534956, "get_state_dump": 0.009320599692208428, "get_robot_state": 0.01369621923991612, "sim_render-ego0": 0.0036621008600507465, "sim_render-ego1": 0.0035529681614467077, "sim_render-ego2": 0.0036065731729779927, "sim_render-ego3": 0.0034528425761631556, "get_duckie_state": 1.3470649719238282e-06, "in-drivable-lane": 6.049999999999984, "deviation-heading": 0.7056790991036815, "agent_compute-ego0": 0.01298318590436663, "agent_compute-ego1": 0.012364281926836286, "agent_compute-ego2": 0.012142068999154229, "agent_compute-ego3": 0.012378990650177002, "complete-iteration": 0.9294545275824412, "set_robot_commands": 0.0021833062171936037, "deviation-center-line": 0.08849475729101529, "driven_lanedir_consec": 0.13889942350534956, "sim_compute_sim_state": 0.016840219497680664, "sim_compute_performance-ego0": 0.001863854272024972, "sim_compute_performance-ego1": 0.001926898956298828, "sim_compute_performance-ego2": 0.0018578597477504183, "sim_compute_performance-ego3": 0.0018375175339835031}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.410587543949015, "get_ui_image": 0.044107956545693536, "step_physics": 0.7650764788900103, "survival_time": 6.949999999999983, "driven_lanedir": 0.16645409715794734, "get_state_dump": 0.009320599692208428, "get_robot_state": 0.01369621923991612, "sim_render-ego0": 0.0036621008600507465, "sim_render-ego1": 0.0035529681614467077, "sim_render-ego2": 0.0036065731729779927, "sim_render-ego3": 0.0034528425761631556, "get_duckie_state": 1.3470649719238282e-06, "in-drivable-lane": 6.1499999999999835, "deviation-heading": 0.48784487897912127, "agent_compute-ego0": 0.01298318590436663, "agent_compute-ego1": 0.012364281926836286, "agent_compute-ego2": 0.012142068999154229, "agent_compute-ego3": 0.012378990650177002, "complete-iteration": 0.9294545275824412, "set_robot_commands": 0.0021833062171936037, "deviation-center-line": 0.04383894934896015, "driven_lanedir_consec": 0.16645409715794734, "sim_compute_sim_state": 0.016840219497680664, "sim_compute_performance-ego0": 0.001863854272024972, "sim_compute_performance-ego1": 0.001926898956298828, "sim_compute_performance-ego2": 0.0018578597477504183, "sim_compute_performance-ego3": 0.0018375175339835031}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1115203799347757, "get_ui_image": 0.044107956545693536, "step_physics": 0.7650764788900103, "survival_time": 6.949999999999983, "driven_lanedir": 0.182509902157054, "get_state_dump": 0.009320599692208428, "get_robot_state": 0.01369621923991612, "sim_render-ego0": 0.0036621008600507465, "sim_render-ego1": 0.0035529681614467077, "sim_render-ego2": 0.0036065731729779927, "sim_render-ego3": 0.0034528425761631556, "get_duckie_state": 1.3470649719238282e-06, "in-drivable-lane": 6.199999999999983, "deviation-heading": 0.3363612785483374, "agent_compute-ego0": 0.01298318590436663, "agent_compute-ego1": 0.012364281926836286, "agent_compute-ego2": 0.012142068999154229, "agent_compute-ego3": 0.012378990650177002, "complete-iteration": 0.9294545275824412, "set_robot_commands": 0.0021833062171936037, "deviation-center-line": 0.054262203954370945, "driven_lanedir_consec": 0.182509902157054, "sim_compute_sim_state": 0.016840219497680664, "sim_compute_performance-ego0": 0.001863854272024972, "sim_compute_performance-ego1": 0.001926898956298828, "sim_compute_performance-ego2": 0.0018578597477504183, "sim_compute_performance-ego3": 0.0018375175339835031}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.4514962968463914, "get_ui_image": 0.04960267207561395, "step_physics": 0.924010035319206, "survival_time": 7.7499999999999805, "driven_lanedir": 0.3223377291248093, "get_state_dump": 0.009579048706935002, "get_robot_state": 0.014231311969268017, "sim_render-ego0": 0.0038098922142615686, "sim_render-ego1": 0.003726488504654322, "sim_render-ego2": 0.003747499906099759, "sim_render-ego3": 0.0036912759145100913, "get_duckie_state": 1.4152282323592749e-06, "in-drivable-lane": 6.34999999999998, "deviation-heading": 0.7115540754381995, "agent_compute-ego0": 0.026121020317077637, "agent_compute-ego1": 0.026281575361887615, "agent_compute-ego2": 0.025343337120153964, "agent_compute-ego3": 0.025558007069123097, "complete-iteration": 1.1599419942268958, "set_robot_commands": 0.002217720716427534, "deviation-center-line": 0.08326974102232218, "driven_lanedir_consec": 0.3223377291248093, "sim_compute_sim_state": 0.0274319419494042, "sim_compute_performance-ego0": 0.00198976504497039, "sim_compute_performance-ego1": 0.0019505803401653585, "sim_compute_performance-ego2": 0.001907519805125701, "sim_compute_performance-ego3": 0.0019144324155954211}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.6032011376937227, "get_ui_image": 0.04960267207561395, "step_physics": 0.924010035319206, "survival_time": 7.7499999999999805, "driven_lanedir": 0.530145896382082, "get_state_dump": 0.009579048706935002, "get_robot_state": 0.014231311969268017, "sim_render-ego0": 0.0038098922142615686, "sim_render-ego1": 0.003726488504654322, "sim_render-ego2": 0.003747499906099759, "sim_render-ego3": 0.0036912759145100913, "get_duckie_state": 1.4152282323592749e-06, "in-drivable-lane": 4.699999999999987, "deviation-heading": 2.392183879138872, "agent_compute-ego0": 0.026121020317077637, "agent_compute-ego1": 0.026281575361887615, "agent_compute-ego2": 0.025343337120153964, "agent_compute-ego3": 0.025558007069123097, "complete-iteration": 1.1599419942268958, "set_robot_commands": 0.002217720716427534, "deviation-center-line": 0.31372880354514265, "driven_lanedir_consec": 0.530145896382082, "sim_compute_sim_state": 0.0274319419494042, "sim_compute_performance-ego0": 0.00198976504497039, "sim_compute_performance-ego1": 0.0019505803401653585, "sim_compute_performance-ego2": 0.001907519805125701, "sim_compute_performance-ego3": 0.0019144324155954211}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.674453630543339, "get_ui_image": 0.04960267207561395, "step_physics": 0.924010035319206, "survival_time": 7.7499999999999805, "driven_lanedir": 0.07928748042777523, "get_state_dump": 0.009579048706935002, "get_robot_state": 0.014231311969268017, "sim_render-ego0": 0.0038098922142615686, "sim_render-ego1": 0.003726488504654322, "sim_render-ego2": 0.003747499906099759, "sim_render-ego3": 0.0036912759145100913, "get_duckie_state": 1.4152282323592749e-06, "in-drivable-lane": 6.849999999999981, "deviation-heading": 0.8766357877016483, "agent_compute-ego0": 0.026121020317077637, "agent_compute-ego1": 0.026281575361887615, "agent_compute-ego2": 0.025343337120153964, "agent_compute-ego3": 0.025558007069123097, "complete-iteration": 1.1599419942268958, "set_robot_commands": 0.002217720716427534, "deviation-center-line": 0.05816399015999119, "driven_lanedir_consec": 0.07928748042777523, "sim_compute_sim_state": 0.0274319419494042, "sim_compute_performance-ego0": 0.00198976504497039, "sim_compute_performance-ego1": 0.0019505803401653585, "sim_compute_performance-ego2": 0.001907519805125701, "sim_compute_performance-ego3": 0.0019144324155954211}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.6742756318610317, "get_ui_image": 0.04960267207561395, "step_physics": 0.924010035319206, "survival_time": 7.7499999999999805, "driven_lanedir": 0.8657439523243192, "get_state_dump": 0.009579048706935002, "get_robot_state": 0.014231311969268017, "sim_render-ego0": 0.0038098922142615686, "sim_render-ego1": 0.003726488504654322, "sim_render-ego2": 0.003747499906099759, "sim_render-ego3": 0.0036912759145100913, "get_duckie_state": 1.4152282323592749e-06, "in-drivable-lane": 4.799999999999983, "deviation-heading": 1.4988262069482414, "agent_compute-ego0": 0.026121020317077637, "agent_compute-ego1": 0.026281575361887615, "agent_compute-ego2": 0.025343337120153964, "agent_compute-ego3": 0.025558007069123097, "complete-iteration": 1.1599419942268958, "set_robot_commands": 0.002217720716427534, "deviation-center-line": 0.2920718548934842, "driven_lanedir_consec": 0.8657439523243192, "sim_compute_sim_state": 0.0274319419494042, "sim_compute_performance-ego0": 0.00198976504497039, "sim_compute_performance-ego1": 0.0019505803401653585, "sim_compute_performance-ego2": 0.001907519805125701, "sim_compute_performance-ego3": 0.0019144324155954211}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.703336068278802, "get_ui_image": 0.04684500313975328, "step_physics": 0.9054376669456622, "survival_time": 8.09999999999998, "driven_lanedir": 0.6929339381585025, "get_state_dump": 0.00927132038982368, "get_robot_state": 0.013472242589377188, "sim_render-ego0": 0.003535320422400726, "sim_render-ego1": 0.003553304204180197, "sim_render-ego2": 0.0034409593219406035, "sim_render-ego3": 0.003607900596103785, "get_duckie_state": 1.3544515598039686e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8961088118337857, "agent_compute-ego0": 0.012238158770134112, "agent_compute-ego1": 0.012716849157415284, "agent_compute-ego2": 0.011178198036240651, "agent_compute-ego3": 0.014083044660603342, "complete-iteration": 1.077982887899949, "set_robot_commands": 0.0021141584665497386, "deviation-center-line": 0.5633987971394339, "driven_lanedir_consec": 0.6929339381585025, "sim_compute_sim_state": 0.022880545423074737, "sim_compute_performance-ego0": 0.0018245939828135484, "sim_compute_performance-ego1": 0.0018307811643448345, "sim_compute_performance-ego2": 0.001800798931004811, "sim_compute_performance-ego3": 0.0018019559193242548}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.679198415637278, "get_ui_image": 0.04684500313975328, "step_physics": 0.9054376669456622, "survival_time": 8.09999999999998, "driven_lanedir": 0.5259782377628714, "get_state_dump": 0.00927132038982368, "get_robot_state": 0.013472242589377188, "sim_render-ego0": 0.003535320422400726, "sim_render-ego1": 0.003553304204180197, "sim_render-ego2": 0.0034409593219406035, "sim_render-ego3": 0.003607900596103785, "get_duckie_state": 1.3544515598039686e-06, "in-drivable-lane": 5.749999999999985, "deviation-heading": 1.7520629793238731, "agent_compute-ego0": 0.012238158770134112, "agent_compute-ego1": 0.012716849157415284, "agent_compute-ego2": 0.011178198036240651, "agent_compute-ego3": 0.014083044660603342, "complete-iteration": 1.077982887899949, "set_robot_commands": 0.0021141584665497386, "deviation-center-line": 0.16231357804150784, "driven_lanedir_consec": 0.5259782377628714, "sim_compute_sim_state": 0.022880545423074737, "sim_compute_performance-ego0": 0.0018245939828135484, "sim_compute_performance-ego1": 0.0018307811643448345, "sim_compute_performance-ego2": 0.001800798931004811, "sim_compute_performance-ego3": 0.0018019559193242548}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7953508188492655, "get_ui_image": 0.04684500313975328, "step_physics": 0.9054376669456622, "survival_time": 8.09999999999998, "driven_lanedir": 0.35599896443419654, "get_state_dump": 0.00927132038982368, "get_robot_state": 0.013472242589377188, "sim_render-ego0": 0.003535320422400726, "sim_render-ego1": 0.003553304204180197, "sim_render-ego2": 0.0034409593219406035, "sim_render-ego3": 0.003607900596103785, "get_duckie_state": 1.3544515598039686e-06, "in-drivable-lane": 6.74999999999998, "deviation-heading": 0.8315096497926955, "agent_compute-ego0": 0.012238158770134112, "agent_compute-ego1": 0.012716849157415284, "agent_compute-ego2": 0.011178198036240651, "agent_compute-ego3": 0.014083044660603342, "complete-iteration": 1.077982887899949, "set_robot_commands": 0.0021141584665497386, "deviation-center-line": 0.1304101283019886, "driven_lanedir_consec": 0.35599896443419654, "sim_compute_sim_state": 0.022880545423074737, "sim_compute_performance-ego0": 0.0018245939828135484, "sim_compute_performance-ego1": 0.0018307811643448345, "sim_compute_performance-ego2": 0.001800798931004811, "sim_compute_performance-ego3": 0.0018019559193242548}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3011394834424732, "get_ui_image": 0.04684500313975328, "step_physics": 0.9054376669456622, "survival_time": 8.09999999999998, "driven_lanedir": 0.2344061643922295, "get_state_dump": 0.00927132038982368, "get_robot_state": 0.013472242589377188, "sim_render-ego0": 0.003535320422400726, "sim_render-ego1": 0.003553304204180197, "sim_render-ego2": 0.0034409593219406035, "sim_render-ego3": 0.003607900596103785, "get_duckie_state": 1.3544515598039686e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.779520012490992, "agent_compute-ego0": 0.012238158770134112, "agent_compute-ego1": 0.012716849157415284, "agent_compute-ego2": 0.011178198036240651, "agent_compute-ego3": 0.014083044660603342, "complete-iteration": 1.077982887899949, "set_robot_commands": 0.0021141584665497386, "deviation-center-line": 1.2712449614354393, "driven_lanedir_consec": 0.2344061643922295, "sim_compute_sim_state": 0.022880545423074737, "sim_compute_performance-ego0": 0.0018245939828135484, "sim_compute_performance-ego1": 0.0018307811643448345, "sim_compute_performance-ego2": 0.001800798931004811, "sim_compute_performance-ego3": 0.0018019559193242548}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.0831401036094772, "get_ui_image": 0.029948860056260053, "step_physics": 0.22747296726002417, "survival_time": 4.199999999999993, "driven_lanedir": 0.2265265221176136, "get_state_dump": 0.00594791524550494, "get_robot_state": 0.006738522473503561, "sim_render-ego0": 0.0034645809846765856, "sim_render-ego1": 0.0034653242896584904, "get_duckie_state": 1.253801233628217e-06, "in-drivable-lane": 3.2999999999999927, "deviation-heading": 0.3063923477335874, "agent_compute-ego0": 0.01209553269778981, "agent_compute-ego1": 0.012172017377965591, "complete-iteration": 0.31719790626974664, "set_robot_commands": 0.0020040315740248735, "deviation-center-line": 0.06605112261268693, "driven_lanedir_consec": 0.2265265221176136, "sim_compute_sim_state": 0.008212078318876378, "sim_compute_performance-ego0": 0.001790329989264993, "sim_compute_performance-ego1": 0.001778417475083295}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.2530159908867935, "get_ui_image": 0.029948860056260053, "step_physics": 0.22747296726002417, "survival_time": 4.199999999999993, "driven_lanedir": 0.3078074057723179, "get_state_dump": 0.00594791524550494, "get_robot_state": 0.006738522473503561, "sim_render-ego0": 0.0034645809846765856, "sim_render-ego1": 0.0034653242896584904, "get_duckie_state": 1.253801233628217e-06, "in-drivable-lane": 3.099999999999994, "deviation-heading": 0.3897433646620584, "agent_compute-ego0": 0.01209553269778981, "agent_compute-ego1": 0.012172017377965591, "complete-iteration": 0.31719790626974664, "set_robot_commands": 0.0020040315740248735, "deviation-center-line": 0.11292332715995766, "driven_lanedir_consec": 0.3078074057723179, "sim_compute_sim_state": 0.008212078318876378, "sim_compute_performance-ego0": 0.001790329989264993, "sim_compute_performance-ego1": 0.001778417475083295}}
set_robot_commands_max	0.002217720716427534
set_robot_commands_mean	0.0021477717677666603
set_robot_commands_median	0.0021833062171936037
set_robot_commands_min	0.0020040315740248735
sim_compute_performance-ego0_max	0.00198976504497039
sim_compute_performance-ego0_mean	0.0018781080841261163
sim_compute_performance-ego0_median	0.001863854272024972
sim_compute_performance-ego0_min	0.001790329989264993
sim_compute_performance-ego1_max	0.0019505803401653585
sim_compute_performance-ego1_mean	0.001884991199528762
sim_compute_performance-ego1_median	0.001926898956298828
sim_compute_performance-ego1_min	0.001778417475083295
sim_compute_performance-ego2_max	0.001907519805125701
sim_compute_performance-ego2_mean	0.0018553928279603103
sim_compute_performance-ego2_median	0.0018578597477504183
sim_compute_performance-ego2_min	0.001800798931004811
sim_compute_performance-ego3_max	0.0019144324155954211
sim_compute_performance-ego3_mean	0.00185130195630106
sim_compute_performance-ego3_median	0.0018375175339835031
sim_compute_performance-ego3_min	0.0018019559193242548
sim_compute_sim_state_max	0.0274319419494042
sim_compute_sim_state_mean	0.02035964172274223
sim_compute_sim_state_median	0.022880545423074737
sim_compute_sim_state_min	0.008212078318876378
sim_render-ego0_max	0.0038098922142615686
sim_render-ego0_mean	0.0036398868540146673
sim_render-ego0_median	0.0036621008600507465
sim_render-ego0_min	0.0034645809846765856
sim_render-ego1_max	0.003726488504654322
sim_render-ego1_mean	0.0035901208614601337
sim_render-ego1_median	0.003553304204180197
sim_render-ego1_min	0.0034653242896584904
sim_render-ego2_max	0.003747499906099759
sim_render-ego2_mean	0.0035983441336727862
sim_render-ego2_median	0.0036065731729779927
sim_render-ego2_min	0.0034409593219406035
sim_render-ego3_max	0.0036912759145100913
sim_render-ego3_mean	0.0035840063622590117
sim_render-ego3_median	0.003607900596103785
sim_render-ego3_min	0.0034528425761631556
simulation-passed	1
step_physics_max	0.924010035319206
step_physics_mean	0.7737887613671115
step_physics_median	0.9054376669456622
step_physics_min	0.22747296726002417
survival_time_max	8.09999999999998
survival_time_mean	7.114285714285698
survival_time_min	4.199999999999993

No reset possible

53557

12661

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

success

yes

2020-12-02 20:50:11+00:00

2020-12-02 20:52:26+00:00

0:02:15

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.27870527439052584
survival_time_median	2.1250000000000004
deviation-center-line_median	0.09262121967463514
in-drivable-lane_median	0.95

other stats

agent_compute-ego0_max	0.058986726261320566
agent_compute-ego0_mean	0.035764068459707594
agent_compute-ego0_median	0.035764068459707594
agent_compute-ego0_min	0.012541410658094618
complete-iteration_max	0.3264747176851545
complete-iteration_mean	0.3086248971167065
complete-iteration_median	0.3086248971167065
complete-iteration_min	0.29077507654825846
deviation-center-line_max	0.10116664005748356
deviation-center-line_mean	0.09262121967463514
deviation-center-line_min	0.08407579929178674
deviation-heading_max	0.5039005726869622
deviation-heading_mean	0.45913228987441534
deviation-heading_median	0.45913228987441534
deviation-heading_min	0.41436400706186854
driven_any_max	0.38811847224115953
driven_any_mean	0.3720796177899005
driven_any_median	0.3720796177899005
driven_any_min	0.3560407633386415
driven_lanedir_consec_max	0.3375392483693256
driven_lanedir_consec_mean	0.27870527439052584
driven_lanedir_consec_min	0.2198713004117261
driven_lanedir_max	0.3375392483693256
driven_lanedir_mean	0.27870527439052584
driven_lanedir_median	0.27870527439052584
driven_lanedir_min	0.2198713004117261
get_duckie_state_max	1.186416262672061e-06
get_duckie_state_mean	1.1707109118264818e-06
get_duckie_state_median	1.1707109118264818e-06
get_duckie_state_min	1.1550055609809027e-06
get_robot_state_max	0.0035331135704403833
get_robot_state_mean	0.003531352300492544
get_robot_state_median	0.003531352300492544
get_robot_state_min	0.0035295910305447047
get_state_dump_max	0.004409818422226678
get_state_dump_mean	0.004343571549370175
get_state_dump_median	0.004343571549370175
get_state_dump_min	0.004277324676513672
get_ui_image_max	0.038040510813395184
get_ui_image_mean	0.037913145337786
get_ui_image_median	0.037913145337786
get_ui_image_min	0.03778577986217681
in-drivable-lane_max	1.1000000000000003
in-drivable-lane_mean	0.95
in-drivable-lane_min	0.7999999999999996
per-episodes	details {"LFI-norm-4way-000-ego0": {"driven_any": 0.3560407633386415, "get_ui_image": 0.03778577986217681, "step_physics": 0.2056402705964588, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2198713004117261, "get_state_dump": 0.004409818422226678, "get_robot_state": 0.0035331135704403833, "sim_render-ego0": 0.003663931574140276, "get_duckie_state": 1.186416262672061e-06, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 0.41436400706186854, "agent_compute-ego0": 0.058986726261320566, "complete-iteration": 0.3264747176851545, "set_robot_commands": 0.0021241165342785065, "deviation-center-line": 0.10116664005748356, "driven_lanedir_consec": 0.2198713004117261, "sim_compute_sim_state": 0.008372533889043899, "sim_compute_performance-ego0": 0.001882768812633696}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.38811847224115953, "get_ui_image": 0.038040510813395184, "step_physics": 0.21633432176378037, "survival_time": 2.2, "driven_lanedir": 0.3375392483693256, "get_state_dump": 0.004277324676513672, "get_robot_state": 0.0035295910305447047, "sim_render-ego0": 0.00360920164320204, "get_duckie_state": 1.1550055609809027e-06, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.5039005726869622, "agent_compute-ego0": 0.012541410658094618, "complete-iteration": 0.29077507654825846, "set_robot_commands": 0.0020699183146158854, "deviation-center-line": 0.08407579929178674, "driven_lanedir_consec": 0.3375392483693256, "sim_compute_sim_state": 0.00846865971883138, "sim_compute_performance-ego0": 0.001829422844780816}}
set_robot_commands_max	0.0021241165342785065
set_robot_commands_mean	0.002097017424447196
set_robot_commands_median	0.002097017424447196
set_robot_commands_min	0.0020699183146158854
sim_compute_performance-ego0_max	0.001882768812633696
sim_compute_performance-ego0_mean	0.001856095828707256
sim_compute_performance-ego0_median	0.001856095828707256
sim_compute_performance-ego0_min	0.001829422844780816
sim_compute_sim_state_max	0.00846865971883138
sim_compute_sim_state_mean	0.00842059680393764
sim_compute_sim_state_median	0.00842059680393764
sim_compute_sim_state_min	0.008372533889043899
sim_render-ego0_max	0.003663931574140276
sim_render-ego0_mean	0.003636566608671158
sim_render-ego0_median	0.003636566608671158
sim_render-ego0_min	0.00360920164320204
simulation-passed	1
step_physics_max	0.21633432176378037
step_physics_mean	0.2109872961801196
step_physics_median	0.2109872961801196
step_physics_min	0.2056402705964588
survival_time_max	2.2
survival_time_mean	2.1250000000000004
survival_time_min	2.0500000000000007

No reset possible

53521

12664

Bea Baselines 🐤

template-tensorflow

LFVv-sim

success

yes

2020-12-02 20:39:49+00:00

2020-12-02 20:49:48+00:00

0:09:59

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.29791244091532965
survival_time_median	4.124999999999993
deviation-center-line_median	0.13463425630617665
in-drivable-lane_median	1.874999999999996

other stats

agent_compute-ego0_max	0.0250470831990242
agent_compute-ego0_mean	0.015662960818154135
agent_compute-ego0_median	0.012603020142997344
agent_compute-ego0_min	0.012398719787597656
agent_compute-npc0_max	0.022321189939975734
agent_compute-npc0_mean	0.02079494068912909
agent_compute-npc0_median	0.020845247620852367
agent_compute-npc0_min	0.01916807757483588
agent_compute-npc1_max	0.06105169692596832
agent_compute-npc1_mean	0.04657556444782334
agent_compute-npc1_median	0.04648836108221524
agent_compute-npc1_min	0.032186635335286456
agent_compute-npc2_max	0.05662947815734071
agent_compute-npc2_mean	0.04593937288656023
agent_compute-npc2_median	0.04685240206511125
agent_compute-npc2_min	0.03433623843722873
agent_compute-npc3_max	0.049684066277045705
agent_compute-npc3_mean	0.04831985352112483
agent_compute-npc3_median	0.04831985352112483
agent_compute-npc3_min	0.04695564076520395
complete-iteration_max	1.1755843646284465
complete-iteration_mean	0.8364280946065678
complete-iteration_median	0.903844710741552
complete-iteration_min	0.36243859231472014
deviation-center-line_max	0.21626794623771295
deviation-center-line_mean	0.14380999985192494
deviation-center-line_min	0.08970354055763356
deviation-heading_max	1.438961569467785
deviation-heading_mean	1.0528787601094918
deviation-heading_median	0.951754144522244
deviation-heading_min	0.8690451819256945
driven_any_max	3.0401141807165137
driven_any_mean	1.592127042747641
driven_any_median	1.2089477955874006
driven_any_min	0.9104983990992488
driven_lanedir_consec_max	1.1765105444541577
driven_lanedir_consec_mean	0.4757886552882826
driven_lanedir_consec_min	0.13081919486831373
driven_lanedir_max	1.1765105444541577
driven_lanedir_mean	0.4757886552882826
driven_lanedir_median	0.29791244091532965
driven_lanedir_min	0.13081919486831373
get_duckie_state_max	1.322139393199574e-06
get_duckie_state_mean	1.2850712004805217e-06
get_duckie_state_median	1.2884393406375018e-06
get_duckie_state_min	1.2412667274475095e-06
get_robot_state_max	0.017241595627425554
get_robot_state_mean	0.013665447855512346
get_robot_state_median	0.015243279415628185
get_robot_state_min	0.006933636963367462
get_state_dump_max	0.010837859001712524
get_state_dump_mean	0.009259343360782612
get_state_dump_median	0.010147630807125208
get_state_dump_min	0.005904252827167511
get_ui_image_max	0.05572094236101423
get_ui_image_mean	0.04554905550511974
get_ui_image_median	0.047303980156995246
get_ui_image_min	0.031867319345474245
in-drivable-lane_max	6.749999999999981
in-drivable-lane_mean	2.7999999999999927
in-drivable-lane_min	0.6999999999999975
per-episodes	details {"LFV-norm-loop-000-ego0": {"driven_any": 1.271668476060832, "get_ui_image": 0.0427811066309611, "step_physics": 0.5104608085420397, "survival_time": 4.449999999999992, "driven_lanedir": 1.1765105444541577, "get_state_dump": 0.00950029691060384, "get_robot_state": 0.013564554850260415, "sim_render-ego0": 0.0035149600770738388, "sim_render-npc0": 0.00345102416144477, "sim_render-npc1": 0.0034248749415079754, "sim_render-npc2": 0.0034402105543348523, "get_duckie_state": 1.274214850531684e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 1.025658002729611, "agent_compute-ego0": 0.012398719787597656, "agent_compute-npc0": 0.01916807757483588, "agent_compute-npc1": 0.032186635335286456, "agent_compute-npc2": 0.03433623843722873, "complete-iteration": 0.7366245932049221, "set_robot_commands": 0.002046958605448405, "deviation-center-line": 0.21626794623771295, "driven_lanedir_consec": 1.1765105444541577, "sim_compute_sim_state": 0.03293883005777995, "sim_compute_performance-ego0": 0.0018133454852634007, "sim_compute_performance-npc0": 0.001800198025173611, "sim_compute_performance-npc1": 0.001788632074991862, "sim_compute_performance-npc2": 0.0017882135179307726}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.1462271151139694, "get_ui_image": 0.05572094236101423, "step_physics": 0.6849054392282065, "survival_time": 3.7999999999999945, "driven_lanedir": 0.4254890399261191, "get_state_dump": 0.010794964703646574, "get_robot_state": 0.017241595627425554, "sim_render-ego0": 0.003627343611283736, "sim_render-npc0": 0.003516999157992276, "sim_render-npc1": 0.0035603139307591822, "sim_render-npc2": 0.003563518648023729, "sim_render-npc3": 0.0035693304879324777, "get_duckie_state": 1.322139393199574e-06, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 0.8690451819256945, "agent_compute-ego0": 0.012753012892487762, "agent_compute-npc0": 0.021877641801710253, "agent_compute-npc1": 0.06105169692596832, "agent_compute-npc2": 0.05662947815734071, "agent_compute-npc3": 0.049684066277045705, "complete-iteration": 1.0710648282781825, "set_robot_commands": 0.00216106315711876, "deviation-center-line": 0.11815830086222565, "driven_lanedir_consec": 0.4254890399261191, "sim_compute_sim_state": 0.06235386179639148, "sim_compute_performance-ego0": 0.0018792369148947976, "sim_compute_performance-npc0": 0.0018281781828248657, "sim_compute_performance-npc1": 0.0018158609216863456, "sim_compute_performance-npc2": 0.0018545869108918425, "sim_compute_performance-npc3": 0.0018557604257162512}, "LFV-norm-techtrack-000-ego0": {"driven_any": 0.9104983990992488, "get_ui_image": 0.05182685368302939, "step_physics": 0.8331653933594192, "survival_time": 3.399999999999996, "driven_lanedir": 0.1703358419045402, "get_state_dump": 0.010837859001712524, "get_robot_state": 0.016922003980995953, "sim_render-ego0": 0.003589792528014252, "sim_render-npc0": 0.0034984298374341883, "sim_render-npc1": 0.003475123557491579, "sim_render-npc2": 0.00346025522204413, "sim_render-npc3": 0.003448773121488267, "get_duckie_state": 1.3026638307433198e-06, "in-drivable-lane": 1.6499999999999984, "deviation-heading": 1.438961569467785, "agent_compute-ego0": 0.012453027393506922, "agent_compute-npc0": 0.01981285343999448, "agent_compute-npc1": 0.04648836108221524, "agent_compute-npc2": 0.04685240206511125, "agent_compute-npc3": 0.04695564076520395, "complete-iteration": 1.1755843646284465, "set_robot_commands": 0.002020663109378538, "deviation-center-line": 0.15111021175012765, "driven_lanedir_consec": 0.1703358419045402, "sim_compute_sim_state": 0.053384442260299904, "sim_compute_performance-ego0": 0.001859177713808806, "sim_compute_performance-npc0": 0.001824430797411048, "sim_compute_performance-npc1": 0.0018183424852896428, "sim_compute_performance-npc2": 0.0018103606459023297, "sim_compute_performance-npc3": 0.0018057546753814256}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.0401141807165137, "get_ui_image": 0.031867319345474245, "step_physics": 0.2451358452439308, "survival_time": 7.94999999999998, "driven_lanedir": 0.13081919486831373, "get_state_dump": 0.005904252827167511, "get_robot_state": 0.006933636963367462, "sim_render-ego0": 0.00357314795255661, "sim_render-npc0": 0.0035247176885604857, "get_duckie_state": 1.2412667274475095e-06, "in-drivable-lane": 6.749999999999981, "deviation-heading": 0.8778502863148769, "agent_compute-ego0": 0.0250470831990242, "agent_compute-npc0": 0.022321189939975734, "complete-iteration": 0.36243859231472014, "set_robot_commands": 0.0020573362708091736, "deviation-center-line": 0.08970354055763356, "driven_lanedir_consec": 0.13081919486831373, "sim_compute_sim_state": 0.01024637371301651, "sim_compute_performance-ego0": 0.001838065683841705, "sim_compute_performance-npc0": 0.0018205657601356507}}
set_robot_commands_max	0.00216106315711876
set_robot_commands_mean	0.002071505285688719
set_robot_commands_median	0.002052147438128789
set_robot_commands_min	0.002020663109378538
sim_compute_performance-ego0_max	0.0018792369148947976
sim_compute_performance-ego0_mean	0.0018474564494521772
sim_compute_performance-ego0_median	0.0018486216988252556
sim_compute_performance-ego0_min	0.0018133454852634007
sim_compute_performance-npc0_max	0.0018281781828248657
sim_compute_performance-npc0_mean	0.0018183431913862936
sim_compute_performance-npc0_median	0.0018224982787733491
sim_compute_performance-npc0_min	0.001800198025173611
sim_compute_performance-npc1_max	0.0018183424852896428
sim_compute_performance-npc1_mean	0.0018076118273226169
sim_compute_performance-npc1_median	0.0018158609216863456
sim_compute_performance-npc1_min	0.001788632074991862
sim_compute_performance-npc2_max	0.0018545869108918425
sim_compute_performance-npc2_mean	0.0018177203582416485
sim_compute_performance-npc2_median	0.0018103606459023297
sim_compute_performance-npc2_min	0.0017882135179307726
sim_compute_performance-npc3_max	0.0018557604257162512
sim_compute_performance-npc3_mean	0.0018307575505488384
sim_compute_performance-npc3_median	0.0018307575505488384
sim_compute_performance-npc3_min	0.0018057546753814256
sim_compute_sim_state_max	0.06235386179639148
sim_compute_sim_state_mean	0.03973087695687196
sim_compute_sim_state_median	0.04316163615903992
sim_compute_sim_state_min	0.01024637371301651
sim_render-ego0_max	0.003627343611283736
sim_render-ego0_mean	0.003576311042232109
sim_render-ego0_median	0.003581470240285431
sim_render-ego0_min	0.0035149600770738388
sim_render-npc0_max	0.0035247176885604857
sim_render-npc0_mean	0.00349779271135793
sim_render-npc0_median	0.003507714497713232
sim_render-npc0_min	0.00345102416144477
sim_render-npc1_max	0.0035603139307591822
sim_render-npc1_mean	0.003486770809919579
sim_render-npc1_median	0.003475123557491579
sim_render-npc1_min	0.0034248749415079754
sim_render-npc2_max	0.003563518648023729
sim_render-npc2_mean	0.0034879948081342365
sim_render-npc2_median	0.00346025522204413
sim_render-npc2_min	0.0034402105543348523
sim_render-npc3_max	0.0035693304879324777
sim_render-npc3_mean	0.003509051804710372
sim_render-npc3_median	0.003509051804710372
sim_render-npc3_min	0.003448773121488267
simulation-passed	1
step_physics_max	0.8331653933594192
step_physics_mean	0.568416871593399
step_physics_median	0.597683123885123
step_physics_min	0.2451358452439308
survival_time_max	7.94999999999998
survival_time_mean	4.899999999999991
survival_time_min	3.399999999999996

No reset possible

53511

12671

Bea Baselines 🐤

baseline-duckietown

LFP-sim

success

2020-12-02 20:31:03+00:00

2020-12-02 20:39:28+00:00

0:08:25

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

survival_time_median	13.80000000000006
in-drivable-lane_median	0.0
driven_lanedir_consec_median	1.5445468569534393
deviation-center-line_median	0.4933746970444548

other stats

agent_compute-ego0_max	0.012748547320095996
agent_compute-ego0_mean	0.011981475667281772
agent_compute-ego0_median	0.011916275700919503
agent_compute-ego0_min	0.011344803947192084
complete-iteration_max	0.28453186772904304
complete-iteration_mean	0.21735396942070495
complete-iteration_median	0.2116116183200685
complete-iteration_min	0.1616607733136398
deviation-center-line_max	1.1484106324683976
deviation-center-line_mean	0.5834740961654392
deviation-center-line_min	0.19873635810445
deviation-heading_max	2.2561330458154
deviation-heading_mean	1.6878783809013531
deviation-heading_median	1.7949288295242465
deviation-heading_min	0.9055228187415212
driven_any_max	2.119017946135487
driven_any_mean	1.5149080000274209
driven_any_median	1.694154874795639
driven_any_min	0.5523043043829191
driven_lanedir_consec_max	2.090546924306393
driven_lanedir_consec_mean	1.429434689381764
driven_lanedir_consec_min	0.5380981193137854
driven_lanedir_max	2.090546924306393
driven_lanedir_mean	1.429434689381764
driven_lanedir_median	1.5445468569534393
driven_lanedir_min	0.5380981193137854
get_duckie_state_max	0.02369467927775252
get_duckie_state_mean	0.017040153142049333
get_duckie_state_median	0.02021084149057615
get_duckie_state_min	0.004044250309292522
get_robot_state_max	0.0036191153076459777
get_robot_state_mean	0.0035291736222251104
get_robot_state_median	0.0035091652773063496
get_robot_state_min	0.003479248626641765
get_state_dump_max	0.008200098615173899
get_state_dump_mean	0.007228676961060744
get_state_dump_median	0.0077651779695833804
get_state_dump_min	0.0051842532899023155
get_ui_image_max	0.039636357775274314
get_ui_image_mean	0.033555504201284114
get_ui_image_median	0.033960291623352956
get_ui_image_min	0.02666507578315623
in-drivable-lane_max	2.250000000000032
in-drivable-lane_mean	0.562500000000008
in-drivable-lane_min	0.0
per-episodes	details {"LFP-norm-loop-000-ego0": {"driven_any": 2.026069303050395, "get_ui_image": 0.03234055209961871, "step_physics": 0.1083909123680278, "survival_time": 16.300000000000097, "driven_lanedir": 1.753344059162813, "get_state_dump": 0.008200098615173899, "get_robot_state": 0.0035125028102769764, "sim_render-ego0": 0.0036107859480271646, "get_duckie_state": 0.02369467927775252, "in-drivable-lane": 2.250000000000032, "deviation-heading": 2.0265233363017954, "agent_compute-ego0": 0.011344803947192084, "complete-iteration": 0.20311499225254817, "set_robot_commands": 0.0020620669793645174, "deviation-center-line": 0.42358420748634934, "driven_lanedir_consec": 1.753344059162813, "sim_compute_sim_state": 0.008048763333475189, "sim_compute_performance-ego0": 0.001834528161845076}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5523043043829191, "get_ui_image": 0.039636357775274314, "step_physics": 0.18091507452838823, "survival_time": 5.249999999999989, "driven_lanedir": 0.5380981193137854, "get_state_dump": 0.00798414113386622, "get_robot_state": 0.0036191153076459777, "sim_render-ego0": 0.004011282381021751, "get_duckie_state": 0.020785214766016545, "in-drivable-lane": 0.0, "deviation-heading": 0.9055228187415212, "agent_compute-ego0": 0.012748547320095996, "complete-iteration": 0.28453186772904304, "set_robot_commands": 0.0024040375115736475, "deviation-center-line": 0.19873635810445, "driven_lanedir_consec": 0.5380981193137854, "sim_compute_sim_state": 0.010284626258994048, "sim_compute_performance-ego0": 0.0020607844838556252}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.3622404465408828, "get_ui_image": 0.035580031147087195, "step_physics": 0.12040132152876663, "survival_time": 11.300000000000026, "driven_lanedir": 1.335749654744065, "get_state_dump": 0.0075462148053005405, "get_robot_state": 0.003479248626641765, "sim_render-ego0": 0.0035774728800231663, "get_duckie_state": 0.01963646821513575, "in-drivable-lane": 0.0, "deviation-heading": 1.563334322746697, "agent_compute-ego0": 0.012341163231937896, "complete-iteration": 0.22010824438758883, "set_robot_commands": 0.002013943794015221, "deviation-center-line": 0.5631651866025602, "driven_lanedir_consec": 1.335749654744065, "sim_compute_sim_state": 0.013626592274804472, "sim_compute_performance-ego0": 0.001828769230107379}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.119017946135487, "get_ui_image": 0.02666507578315623, "step_physics": 0.09734749024914156, "survival_time": 17.000000000000107, "driven_lanedir": 2.090546924306393, "get_state_dump": 0.0051842532899023155, "get_robot_state": 0.003505827744335723, "sim_render-ego0": 0.0035780336150675576, "get_duckie_state": 0.004044250309292522, "in-drivable-lane": 0.0, "deviation-heading": 2.2561330458154, "agent_compute-ego0": 0.011491388169901112, "complete-iteration": 0.1616607733136398, "set_robot_commands": 0.002040881215652063, "deviation-center-line": 1.1484106324683976, "driven_lanedir_consec": 2.090546924306393, "sim_compute_sim_state": 0.005881367540779002, "sim_compute_performance-ego0": 0.0018475810803276352}}
set_robot_commands_max	0.0024040375115736475
set_robot_commands_mean	0.0021302323751513624
set_robot_commands_median	0.0020514740975082903
set_robot_commands_min	0.002013943794015221
sim_compute_performance-ego0_max	0.0020607844838556252
sim_compute_performance-ego0_mean	0.001892915739033929
sim_compute_performance-ego0_median	0.0018410546210863557
sim_compute_performance-ego0_min	0.001828769230107379
sim_compute_sim_state_max	0.013626592274804472
sim_compute_sim_state_mean	0.009460337352013178
sim_compute_sim_state_median	0.00916669479623462
sim_compute_sim_state_min	0.005881367540779002
sim_render-ego0_max	0.004011282381021751
sim_render-ego0_mean	0.00369439370603491
sim_render-ego0_median	0.0035944097815473613
sim_render-ego0_min	0.0035774728800231663
simulation-passed	1
step_physics_max	0.18091507452838823
step_physics_mean	0.1267636996685811
step_physics_median	0.11439611694839724
step_physics_min	0.09734749024914156
survival_time_max	17.000000000000107
survival_time_mean	12.462500000000055
survival_time_min	5.249999999999989

No reset possible

53483

12681

Bea Baselines 🐤

baseline-duckietown

LFVIt-sim

success

yes

2020-12-02 20:06:49+00:00

2020-12-02 20:30:35+00:00

0:23:46

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	1.24163359771081
survival_time_median	21.250000000000167
deviation-center-line_median	1.0137922684656049
in-drivable-lane_median	7.625000000000087

other stats

agent_compute-ego0_max	0.011541347979755373
agent_compute-ego0_mean	0.011499117076872453
agent_compute-ego0_median	0.011499117076872453
agent_compute-ego0_min	0.011456886173989536
agent_compute-npc0_max	0.0615961664660847
agent_compute-npc0_mean	0.05157341309515193
agent_compute-npc0_median	0.05157341309515193
agent_compute-npc0_min	0.04155065972421917
agent_compute-npc1_max	0.04350900426855697
agent_compute-npc1_mean	0.03851276270301478
agent_compute-npc1_median	0.03851276270301478
agent_compute-npc1_min	0.033516521137472575
agent_compute-npc2_max	0.03974456236626541
agent_compute-npc2_mean	0.03517758220758321
agent_compute-npc2_median	0.03517758220758321
agent_compute-npc2_min	0.03061060204890102
complete-iteration_max	1.1773708811416268
complete-iteration_mean	1.1317884648637095
complete-iteration_median	1.1317884648637095
complete-iteration_min	1.0862060485857925
deviation-center-line_max	1.482680288502738
deviation-center-line_mean	1.0137922684656049
deviation-center-line_min	0.5449042484284715
deviation-heading_max	8.210214037975337
deviation-heading_mean	5.23743502890803
deviation-heading_median	5.23743502890803
deviation-heading_min	2.264656019840723
driven_any_max	4.10371309198244
driven_any_mean	2.679762898667611
driven_any_median	2.679762898667611
driven_any_min	1.255812705352782
driven_lanedir_consec_max	1.941707158390831
driven_lanedir_consec_mean	1.24163359771081
driven_lanedir_consec_min	0.541560037030789
driven_lanedir_max	2.0734888096414448
driven_lanedir_mean	1.4450242416827226
driven_lanedir_median	1.4450242416827226
driven_lanedir_min	0.8165596737240003
get_duckie_state_max	1.2508500808788138e-06
get_duckie_state_mean	1.2331878458246691e-06
get_duckie_state_median	1.2331878458246691e-06
get_duckie_state_min	1.2155256107705245e-06
get_robot_state_max	0.013789042667740036
get_robot_state_mean	0.013697436165745643
get_robot_state_median	0.013697436165745643
get_robot_state_min	0.01360582966375125
get_state_dump_max	0.009230209187873732
get_state_dump_mean	0.009207804643148246
get_state_dump_median	0.009207804643148246
get_state_dump_min	0.00918540009842276
get_ui_image_max	0.05253450226444769
get_ui_image_mean	0.05214310926950039
get_ui_image_median	0.05214310926950039
get_ui_image_min	0.051751716274553085
in-drivable-lane_max	12.800000000000182
in-drivable-lane_mean	7.625000000000087
in-drivable-lane_min	2.4499999999999913
per-episodes	details {"LFVI-norm-4way-000-ego0": {"driven_any": 1.255812705352782, "get_ui_image": 0.05253450226444769, "step_physics": 0.8036170017097799, "survival_time": 10.500000000000014, "driven_lanedir": 0.8165596737240003, "get_state_dump": 0.009230209187873732, "get_robot_state": 0.01360582966375125, "sim_render-ego0": 0.0035806402775913617, "sim_render-npc0": 0.0036397420964534816, "sim_render-npc1": 0.0035725702041698292, "sim_render-npc2": 0.003534307977034582, "get_duckie_state": 1.2508500808788138e-06, "in-drivable-lane": 2.4499999999999913, "deviation-heading": 2.264656019840723, "agent_compute-ego0": 0.011456886173989536, "agent_compute-npc0": 0.0615961664660847, "agent_compute-npc1": 0.033516521137472575, "agent_compute-npc2": 0.03061060204890102, "complete-iteration": 1.0862060485857925, "set_robot_commands": 0.002105841704454467, "deviation-center-line": 0.5449042484284715, "driven_lanedir_consec": 0.541560037030789, "sim_compute_sim_state": 0.03979635351642048, "sim_compute_performance-ego0": 0.0018671067405085992, "sim_compute_performance-npc0": 0.0018322433905578904, "sim_compute_performance-npc1": 0.0018711801953790312, "sim_compute_performance-npc2": 0.001853881854016634}, "LFVI-norm-udem1-000-ego0": {"driven_any": 4.10371309198244, "get_ui_image": 0.051751716274553085, "step_physics": 0.8927931450830421, "survival_time": 32.00000000000032, "driven_lanedir": 2.0734888096414448, "get_state_dump": 0.00918540009842276, "get_robot_state": 0.013789042667740036, "sim_render-ego0": 0.003558952239299899, "sim_render-npc0": 0.003649882332955061, "sim_render-npc1": 0.0035865790386467753, "sim_render-npc2": 0.00372795790852325, "get_duckie_state": 1.2155256107705245e-06, "in-drivable-lane": 12.800000000000182, "deviation-heading": 8.210214037975337, "agent_compute-ego0": 0.011541347979755373, "agent_compute-npc0": 0.04155065972421917, "agent_compute-npc1": 0.04350900426855697, "agent_compute-npc2": 0.03974456236626541, "complete-iteration": 1.1773708811416268, "set_robot_commands": 0.0022497575108235044, "deviation-center-line": 1.482680288502738, "driven_lanedir_consec": 1.941707158390831, "sim_compute_sim_state": 0.042630111557459126, "sim_compute_performance-ego0": 0.0018694750418343149, "sim_compute_performance-npc0": 0.00183016796379863, "sim_compute_performance-npc1": 0.001875339171815774, "sim_compute_performance-npc2": 0.0019581422047012494}}
set_robot_commands_max	0.0022497575108235044
set_robot_commands_mean	0.002177799607638986
set_robot_commands_median	0.002177799607638986
set_robot_commands_min	0.002105841704454467
sim_compute_performance-ego0_max	0.0018694750418343149
sim_compute_performance-ego0_mean	0.001868290891171457
sim_compute_performance-ego0_median	0.001868290891171457
sim_compute_performance-ego0_min	0.0018671067405085992
sim_compute_performance-npc0_max	0.0018322433905578904
sim_compute_performance-npc0_mean	0.00183120567717826
sim_compute_performance-npc0_median	0.00183120567717826
sim_compute_performance-npc0_min	0.00183016796379863
sim_compute_performance-npc1_max	0.001875339171815774
sim_compute_performance-npc1_mean	0.0018732596835974024
sim_compute_performance-npc1_median	0.0018732596835974024
sim_compute_performance-npc1_min	0.0018711801953790312
sim_compute_performance-npc2_max	0.0019581422047012494
sim_compute_performance-npc2_mean	0.0019060120293589416
sim_compute_performance-npc2_median	0.0019060120293589416
sim_compute_performance-npc2_min	0.001853881854016634
sim_compute_sim_state_max	0.042630111557459126
sim_compute_sim_state_mean	0.0412132325369398
sim_compute_sim_state_median	0.0412132325369398
sim_compute_sim_state_min	0.03979635351642048
sim_render-ego0_max	0.0035806402775913617
sim_render-ego0_mean	0.0035697962584456304
sim_render-ego0_median	0.0035697962584456304
sim_render-ego0_min	0.003558952239299899
sim_render-npc0_max	0.003649882332955061
sim_render-npc0_mean	0.003644812214704272
sim_render-npc0_median	0.003644812214704272
sim_render-npc0_min	0.0036397420964534816
sim_render-npc1_max	0.0035865790386467753
sim_render-npc1_mean	0.0035795746214083023
sim_render-npc1_median	0.0035795746214083023
sim_render-npc1_min	0.0035725702041698292
sim_render-npc2_max	0.00372795790852325
sim_render-npc2_mean	0.003631132942778916
sim_render-npc2_median	0.003631132942778916
sim_render-npc2_min	0.003534307977034582
simulation-passed	1
step_physics_max	0.8927931450830421
step_physics_mean	0.848205073396411
step_physics_median	0.848205073396411
step_physics_min	0.8036170017097799
survival_time_max	32.00000000000032
survival_time_mean	21.250000000000167
survival_time_min	10.500000000000014

No reset possible

53472

11122

Olga (Ge Ya) Xu 🇨🇦

sim-exercise-1

LFv-sim

failed

yes

2020-12-02 20:03:07+00:00

2020-12-02 20:06:35+00:00

0:03:28

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53432

12569

Bea Baselines 🐤

straight

LFVmultibodyv-sim

success

yes

2020-12-02 19:30:36+00:00

2020-12-02 20:02:26+00:00

0:31:50

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

driven_lanedir_consec_median	0.24953431315846544
survival_time_median	19.050000000000136
deviation-center-line_median	0.2861230318523591
in-drivable-lane_median	14.425000000000091

other stats

agent_compute-ego0_max	0.010291219264902968
agent_compute-ego0_mean	0.009809246387132157
agent_compute-ego0_median	0.009852066714102062
agent_compute-ego0_min	0.009432836906197143
agent_compute-ego1_max	0.009604055323499314
agent_compute-ego1_mean	0.009298902211531896
agent_compute-ego1_median	0.009306520631868546
agent_compute-ego1_min	0.009104607441171338
agent_compute-ego2_max	0.009444766937325532
agent_compute-ego2_mean	0.009040180147359434
agent_compute-ego2_median	0.008939658653285495
agent_compute-ego2_min	0.008736114851467273
agent_compute-ego3_max	0.009406764469845758
agent_compute-ego3_mean	0.009235542375797616
agent_compute-ego3_median	0.009339009773280612
agent_compute-ego3_min	0.008960852884266474
complete-iteration_max	0.9177117739638238
complete-iteration_mean	0.715293465772252
complete-iteration_median	0.8465214786729264
complete-iteration_min	0.23953287043470017
deviation-center-line_max	2.8883367318751323
deviation-center-line_mean	0.4654756077881163
deviation-center-line_min	0.11731056254816756
deviation-heading_max	9.53637056267447
deviation-heading_mean	2.459896536064004
deviation-heading_median	2.058733240137192
deviation-heading_min	0.6633320228960093
driven_any_max	3.442215668400556
driven_any_mean	1.8877202659768888
driven_any_median	1.7594236463124195
driven_any_min	0.1751032386667058
driven_lanedir_consec_max	1.2191359251366878
driven_lanedir_consec_mean	0.3210238973662083
driven_lanedir_consec_min	0.10876620554745164
driven_lanedir_max	1.2191359251366878
driven_lanedir_mean	0.3210238973662083
driven_lanedir_median	0.24953431315846544
driven_lanedir_min	0.10876620554745164
get_duckie_state_max	1.7267592409823802e-06
get_duckie_state_mean	1.6843431031606151e-06
get_duckie_state_median	1.678916172207338e-06
get_duckie_state_min	1.6618537031896583e-06
get_robot_state_max	0.013817079535358028
get_robot_state_mean	0.012754203008834772
get_robot_state_median	0.01366721969289878
get_robot_state_min	0.0070511432404213766
get_state_dump_max	0.0092106643820956
get_state_dump_mean	0.008763861069326466
get_state_dump_median	0.009178081059564738
get_state_dump_min	0.006247486966721555
get_ui_image_max	0.04956101064812647
get_ui_image_mean	0.04456512627118634
get_ui_image_median	0.04846064520131855
get_ui_image_min	0.030759834735951525
in-drivable-lane_max	20.250000000000178
in-drivable-lane_mean	13.221428571428673
in-drivable-lane_min	0.0
per-episodes	details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.229766721220754, "get_ui_image": 0.0425763687317314, "step_physics": 0.4665176581680979, "survival_time": 14.500000000000073, "driven_lanedir": 1.2191359251366878, "get_state_dump": 0.0092106643820956, "get_robot_state": 0.01366721969289878, "sim_render-ego0": 0.0035279214996652504, "sim_render-ego1": 0.003462262989319477, "sim_render-ego2": 0.0034295652330536205, "sim_render-ego3": 0.0034229673470828133, "get_duckie_state": 1.691051365173969e-06, "in-drivable-lane": 6.150000000000087, "deviation-heading": 1.7517032103661068, "agent_compute-ego0": 0.009432836906197143, "agent_compute-ego1": 0.009104607441171338, "agent_compute-ego2": 0.008939658653285495, "agent_compute-ego3": 0.009339009773280612, "complete-iteration": 0.6195274423487818, "set_robot_commands": 0.002016856498324994, "deviation-center-line": 0.6983877028896803, "driven_lanedir_consec": 1.2191359251366878, "sim_compute_sim_state": 0.02142160373045407, "sim_compute_performance-ego0": 0.0018160588962515603, "sim_compute_performance-ego1": 0.001797221370579041, "sim_compute_performance-ego2": 0.0018010106693018752, "sim_compute_performance-ego3": 0.0017895895181242953}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.646908312128407, "get_ui_image": 0.0425763687317314, "step_physics": 0.4665176581680979, "survival_time": 14.500000000000073, "driven_lanedir": 0.10876620554745164, "get_state_dump": 0.0092106643820956, "get_robot_state": 0.01366721969289878, "sim_render-ego0": 0.0035279214996652504, "sim_render-ego1": 0.003462262989319477, "sim_render-ego2": 0.0034295652330536205, "sim_render-ego3": 0.0034229673470828133, "get_duckie_state": 1.691051365173969e-06, "in-drivable-lane": 13.35000000000007, "deviation-heading": 0.7133602103191004, "agent_compute-ego0": 0.009432836906197143, "agent_compute-ego1": 0.009104607441171338, "agent_compute-ego2": 0.008939658653285495, "agent_compute-ego3": 0.009339009773280612, "complete-iteration": 0.6195274423487818, "set_robot_commands": 0.002016856498324994, "deviation-center-line": 0.11731056254816756, "driven_lanedir_consec": 0.10876620554745164, "sim_compute_sim_state": 0.02142160373045407, "sim_compute_performance-ego0": 0.0018160588962515603, "sim_compute_performance-ego1": 0.001797221370579041, "sim_compute_performance-ego2": 0.0018010106693018752, "sim_compute_performance-ego3": 0.0017895895181242953}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.860675626527826, "get_ui_image": 0.0425763687317314, "step_physics": 0.4665176581680979, "survival_time": 14.500000000000073, "driven_lanedir": 0.3392132924039366, "get_state_dump": 0.0092106643820956, "get_robot_state": 0.01366721969289878, "sim_render-ego0": 0.0035279214996652504, "sim_render-ego1": 0.003462262989319477, "sim_render-ego2": 0.0034295652330536205, "sim_render-ego3": 0.0034229673470828133, "get_duckie_state": 1.691051365173969e-06, "in-drivable-lane": 11.100000000000076, "deviation-heading": 2.5953382582797677, "agent_compute-ego0": 0.009432836906197143, "agent_compute-ego1": 0.009104607441171338, "agent_compute-ego2": 0.008939658653285495, "agent_compute-ego3": 0.009339009773280612, "complete-iteration": 0.6195274423487818, "set_robot_commands": 0.002016856498324994, "deviation-center-line": 0.27795155093368007, "driven_lanedir_consec": 0.3392132924039366, "sim_compute_sim_state": 0.02142160373045407, "sim_compute_performance-ego0": 0.0018160588962515603, "sim_compute_performance-ego1": 0.001797221370579041, "sim_compute_performance-ego2": 0.0018010106693018752, "sim_compute_performance-ego3": 0.0017895895181242953}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.760538382756213, "get_ui_image": 0.0425763687317314, "step_physics": 0.4665176581680979, "survival_time": 14.500000000000073, "driven_lanedir": 0.2363593461950628, "get_state_dump": 0.0092106643820956, "get_robot_state": 0.01366721969289878, "sim_render-ego0": 0.0035279214996652504, "sim_render-ego1": 0.003462262989319477, "sim_render-ego2": 0.0034295652330536205, "sim_render-ego3": 0.0034229673470828133, "get_duckie_state": 1.691051365173969e-06, "in-drivable-lane": 12.600000000000067, "deviation-heading": 0.7341305642444136, "agent_compute-ego0": 0.009432836906197143, "agent_compute-ego1": 0.009104607441171338, "agent_compute-ego2": 0.008939658653285495, "agent_compute-ego3": 0.009339009773280612, "complete-iteration": 0.6195274423487818, "set_robot_commands": 0.002016856498324994, "deviation-center-line": 0.17831562439133256, "driven_lanedir_consec": 0.2363593461950628, "sim_compute_sim_state": 0.02142160373045407, "sim_compute_performance-ego0": 0.0018160588962515603, "sim_compute_performance-ego1": 0.001797221370579041, "sim_compute_performance-ego2": 0.0018010106693018752, "sim_compute_performance-ego3": 0.0017895895181242953}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.8579949335229768, "get_ui_image": 0.04956101064812647, "step_physics": 0.7517107844897056, "survival_time": 21.850000000000176, "driven_lanedir": 0.18713263460539165, "get_state_dump": 0.009178081059564738, "get_robot_state": 0.013817079535358028, "sim_render-ego0": 0.0036174423618403743, "sim_render-ego1": 0.0034940705451791147, "sim_render-ego2": 0.003479933629841565, "sim_render-ego3": 0.003389758062144937, "get_duckie_state": 1.6618537031896583e-06, "in-drivable-lane": 20.250000000000178, "deviation-heading": 0.7324313726030873, "agent_compute-ego0": 0.00990184910221187, "agent_compute-ego1": 0.009306520631868546, "agent_compute-ego2": 0.009444766937325532, "agent_compute-ego3": 0.008960852884266474, "complete-iteration": 0.9177117739638238, "set_robot_commands": 0.0020525444588160406, "deviation-center-line": 0.1562241859054152, "driven_lanedir_consec": 0.18713263460539165, "sim_compute_sim_state": 0.02623527343959025, "sim_compute_performance-ego0": 0.0018271175149368912, "sim_compute_performance-ego1": 0.00181052728330708, "sim_compute_performance-ego2": 0.001802304019666698, "sim_compute_performance-ego3": 0.0017858275539798824}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.7583089098686262, "get_ui_image": 0.04956101064812647, "step_physics": 0.7517107844897056, "survival_time": 21.850000000000176, "driven_lanedir": 0.11469561842904864, "get_state_dump": 0.009178081059564738, "get_robot_state": 0.013817079535358028, "sim_render-ego0": 0.0036174423618403743, "sim_render-ego1": 0.0034940705451791147, "sim_render-ego2": 0.003479933629841565, "sim_render-ego3": 0.003389758062144937, "get_duckie_state": 1.6618537031896583e-06, "in-drivable-lane": 19.100000000000172, "deviation-heading": 3.2869755306093342, "agent_compute-ego0": 0.00990184910221187, "agent_compute-ego1": 0.009306520631868546, "agent_compute-ego2": 0.009444766937325532, "agent_compute-ego3": 0.008960852884266474, "complete-iteration": 0.9177117739638238, "set_robot_commands": 0.0020525444588160406, "deviation-center-line": 0.22230022305389, "driven_lanedir_consec": 0.11469561842904864, "sim_compute_sim_state": 0.02623527343959025, "sim_compute_performance-ego0": 0.0018271175149368912, "sim_compute_performance-ego1": 0.00181052728330708, "sim_compute_performance-ego2": 0.001802304019666698, "sim_compute_performance-ego3": 0.0017858275539798824}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 3.442215668400556, "get_ui_image": 0.04956101064812647, "step_physics": 0.7517107844897056, "survival_time": 21.850000000000176, "driven_lanedir": 0.13453267099814892, "get_state_dump": 0.009178081059564738, "get_robot_state": 0.013817079535358028, "sim_render-ego0": 0.0036174423618403743, "sim_render-ego1": 0.0034940705451791147, "sim_render-ego2": 0.003479933629841565, "sim_render-ego3": 0.003389758062144937, "get_duckie_state": 1.6618537031896583e-06, "in-drivable-lane": 17.800000000000136, "deviation-heading": 5.172632164696949, "agent_compute-ego0": 0.00990184910221187, "agent_compute-ego1": 0.009306520631868546, "agent_compute-ego2": 0.009444766937325532, "agent_compute-ego3": 0.008960852884266474, "complete-iteration": 0.9177117739638238, "set_robot_commands": 0.0020525444588160406, "deviation-center-line": 0.34228306809265696, "driven_lanedir_consec": 0.13453267099814892, "sim_compute_sim_state": 0.02623527343959025, "sim_compute_performance-ego0": 0.0018271175149368912, "sim_compute_performance-ego1": 0.00181052728330708, "sim_compute_performance-ego2": 0.001802304019666698, "sim_compute_performance-ego3": 0.0017858275539798824}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.9181948999423152, "get_ui_image": 0.04956101064812647, "step_physics": 0.7517107844897056, "survival_time": 21.850000000000176, "driven_lanedir": 0.262709280121868, "get_state_dump": 0.009178081059564738, "get_robot_state": 0.013817079535358028, "sim_render-ego0": 0.0036174423618403743, "sim_render-ego1": 0.0034940705451791147, "sim_render-ego2": 0.003479933629841565, "sim_render-ego3": 0.003389758062144937, "get_duckie_state": 1.6618537031896583e-06, "in-drivable-lane": 19.700000000000173, "deviation-heading": 1.0736996479694705, "agent_compute-ego0": 0.00990184910221187, "agent_compute-ego1": 0.009306520631868546, "agent_compute-ego2": 0.009444766937325532, "agent_compute-ego3": 0.008960852884266474, "complete-iteration": 0.9177117739638238, "set_robot_commands": 0.0020525444588160406, "deviation-center-line": 0.1585538995141732, "driven_lanedir_consec": 0.262709280121868, "sim_compute_sim_state": 0.02623527343959025, "sim_compute_performance-ego0": 0.0018271175149368912, "sim_compute_performance-ego1": 0.00181052728330708, "sim_compute_performance-ego2": 0.001802304019666698, "sim_compute_performance-ego3": 0.0017858275539798824}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.1751032386667058, "get_ui_image": 0.04846064520131855, "step_physics": 0.6839040786183942, "survival_time": 19.050000000000136, "driven_lanedir": 0.1529477104455761, "get_state_dump": 0.00916102481762152, "get_robot_state": 0.013629839682454214, "sim_render-ego0": 0.0036034777526456024, "sim_render-ego1": 0.003484074982048953, "sim_render-ego2": 0.003387720172941997, "sim_render-ego3": 0.003443422741914919, "get_duckie_state": 1.678916172207338e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.53637056267447, "agent_compute-ego0": 0.009852066714102062, "agent_compute-ego1": 0.009333002005572097, "agent_compute-ego2": 0.008736114851467273, "agent_compute-ego3": 0.009406764469845758, "complete-iteration": 0.8465214786729264, "set_robot_commands": 0.002027322484560662, "deviation-center-line": 2.8883367318751323, "driven_lanedir_consec": 0.1529477104455761, "sim_compute_sim_state": 0.02453747532130536, "sim_compute_performance-ego0": 0.001819017669917401, "sim_compute_performance-ego1": 0.0018199045620663629, "sim_compute_performance-ego2": 0.001786754393452749, "sim_compute_performance-ego3": 0.001821333201143754}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.645955398046833, "get_ui_image": 0.04846064520131855, "step_physics": 0.6839040786183942, "survival_time": 19.050000000000136, "driven_lanedir": 0.365133589389774, "get_state_dump": 0.00916102481762152, "get_robot_state": 0.013629839682454214, "sim_render-ego0": 0.0036034777526456024, "sim_render-ego1": 0.003484074982048953, "sim_render-ego2": 0.003387720172941997, "sim_render-ego3": 0.003443422741914919, "get_duckie_state": 1.678916172207338e-06, "in-drivable-lane": 15.500000000000112, "deviation-heading": 2.6831167407921708, "agent_compute-ego0": 0.009852066714102062, "agent_compute-ego1": 0.009333002005572097, "agent_compute-ego2": 0.008736114851467273, "agent_compute-ego3": 0.009406764469845758, "complete-iteration": 0.8465214786729264, "set_robot_commands": 0.002027322484560662, "deviation-center-line": 0.2942945127710382, "driven_lanedir_consec": 0.365133589389774, "sim_compute_sim_state": 0.02453747532130536, "sim_compute_performance-ego0": 0.001819017669917401, "sim_compute_performance-ego1": 0.0018199045620663629, "sim_compute_performance-ego2": 0.001786754393452749, "sim_compute_performance-ego3": 0.001821333201143754}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.727646817852709, "get_ui_image": 0.04846064520131855, "step_physics": 0.6839040786183942, "survival_time": 19.050000000000136, "driven_lanedir": 0.32665739254340775, "get_state_dump": 0.00916102481762152, "get_robot_state": 0.013629839682454214, "sim_render-ego0": 0.0036034777526456024, "sim_render-ego1": 0.003484074982048953, "sim_render-ego2": 0.003387720172941997, "sim_render-ego3": 0.003443422741914919, "get_duckie_state": 1.678916172207338e-06, "in-drivable-lane": 15.70000000000014, "deviation-heading": 2.3657632699082773, "agent_compute-ego0": 0.009852066714102062, "agent_compute-ego1": 0.009333002005572097, "agent_compute-ego2": 0.008736114851467273, "agent_compute-ego3": 0.009406764469845758, "complete-iteration": 0.8465214786729264, "set_robot_commands": 0.002027322484560662, "deviation-center-line": 0.33939256109920335, "driven_lanedir_consec": 0.32665739254340775, "sim_compute_sim_state": 0.02453747532130536, "sim_compute_performance-ego0": 0.001819017669917401, "sim_compute_performance-ego1": 0.0018199045620663629, "sim_compute_performance-ego2": 0.001786754393452749, "sim_compute_performance-ego3": 0.001821333201143754}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.9823154106571748, "get_ui_image": 0.04846064520131855, "step_physics": 0.6839040786183942, "survival_time": 19.050000000000136, "driven_lanedir": 0.23489620036212375, "get_state_dump": 0.00916102481762152, "get_robot_state": 0.013629839682454214, "sim_render-ego0": 0.0036034777526456024, "sim_render-ego1": 0.003484074982048953, "sim_render-ego2": 0.003387720172941997, "sim_render-ego3": 0.003443422741914919, "get_duckie_state": 1.678916172207338e-06, "in-drivable-lane": 17.200000000000134, "deviation-heading": 0.6661227201041251, "agent_compute-ego0": 0.009852066714102062, "agent_compute-ego1": 0.009333002005572097, "agent_compute-ego2": 0.008736114851467273, "agent_compute-ego3": 0.009406764469845758, "complete-iteration": 0.8465214786729264, "set_robot_commands": 0.002027322484560662, "deviation-center-line": 0.18001976278243104, "driven_lanedir_consec": 0.23489620036212375, "sim_compute_sim_state": 0.02453747532130536, "sim_compute_performance-ego0": 0.001819017669917401, "sim_compute_performance-ego1": 0.0018199045620663629, "sim_compute_performance-ego2": 0.001786754393452749, "sim_compute_performance-ego3": 0.001821333201143754}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.6702031694292854, "get_ui_image": 0.030759834735951525, "step_physics": 0.1510339787665834, "survival_time": 11.700000000000031, "driven_lanedir": 0.4809616977546944, "get_state_dump": 0.006247486966721555, "get_robot_state": 0.0070511432404213766, "sim_render-ego0": 0.003642846168355739, "sim_render-ego1": 0.0035356846261531748, "get_duckie_state": 1.7267592409823802e-06, "in-drivable-lane": 8.350000000000035, "deviation-heading": 0.6633320228960093, "agent_compute-ego0": 0.010291219264902968, "agent_compute-ego1": 0.009604055323499314, "complete-iteration": 0.23953287043470017, "set_robot_commands": 0.002143527091817653, "deviation-center-line": 0.34477399639249395, "driven_lanedir_consec": 0.4809616977546944, "sim_compute_sim_state": 0.009236065884853931, "sim_compute_performance-ego0": 0.00188908374055903, "sim_compute_performance-ego1": 0.0018500683155465631}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.7522562346560586, "get_ui_image": 0.030759834735951525, "step_physics": 0.1510339787665834, "survival_time": 11.700000000000031, "driven_lanedir": 0.331192999193743, "get_state_dump": 0.006247486966721555, "get_robot_state": 0.0070511432404213766, "sim_render-ego0": 0.003642846168355739, "sim_render-ego1": 0.0035356846261531748, "get_duckie_state": 1.7267592409823802e-06, "in-drivable-lane": 8.300000000000036, "deviation-heading": 2.46357522943277, "agent_compute-ego0": 0.010291219264902968, "agent_compute-ego1": 0.009604055323499314, "complete-iteration": 0.23953287043470017, "set_robot_commands": 0.002143527091817653, "deviation-center-line": 0.3185141267843346, "driven_lanedir_consec": 0.331192999193743, "sim_compute_sim_state": 0.009236065884853931, "sim_compute_performance-ego0": 0.00188908374055903, "sim_compute_performance-ego1": 0.0018500683155465631}}
set_robot_commands_max	0.002143527091817653
set_robot_commands_mean	0.0020481391393172917
set_robot_commands_median	0.002027322484560662
set_robot_commands_min	0.002016856498324994
sim_compute_performance-ego0_max	0.00188908374055903
sim_compute_performance-ego0_mean	0.0018304959861101056
sim_compute_performance-ego0_median	0.001819017669917401
sim_compute_performance-ego0_min	0.0018160588962515603
sim_compute_performance-ego1_max	0.0018500683155465631
sim_compute_performance-ego1_mean	0.0018150535353502189
sim_compute_performance-ego1_median	0.00181052728330708
sim_compute_performance-ego1_min	0.001797221370579041
sim_compute_performance-ego2_max	0.001802304019666698
sim_compute_performance-ego2_mean	0.0017966896941404402
sim_compute_performance-ego2_median	0.0018010106693018752
sim_compute_performance-ego2_min	0.001786754393452749
sim_compute_performance-ego3_max	0.001821333201143754
sim_compute_performance-ego3_mean	0.0017989167577493112
sim_compute_performance-ego3_median	0.0017895895181242953
sim_compute_performance-ego3_min	0.0017858275539798824
sim_compute_sim_state_max	0.02623527343959025
sim_compute_sim_state_mean	0.021946395838221895
sim_compute_sim_state_median	0.02453747532130536
sim_compute_sim_state_min	0.009236065884853931
sim_render-ego0_max	0.003642846168355739
sim_render-ego0_mean	0.0035915041995225982
sim_render-ego0_median	0.0036034777526456024
sim_render-ego0_min	0.0035279214996652504
sim_render-ego1_max	0.0035356846261531748
sim_render-ego1_mean	0.0034880716656068944
sim_render-ego1_median	0.003484074982048953
sim_render-ego1_min	0.003462262989319477
sim_render-ego2_max	0.003479933629841565
sim_render-ego2_mean	0.0034324063452790612
sim_render-ego2_median	0.0034295652330536205
sim_render-ego2_min	0.003387720172941997
sim_render-ego3_max	0.003443422741914919
sim_render-ego3_mean	0.0034187160503808896
sim_render-ego3_median	0.0034229673470828133
sim_render-ego3_min	0.003389758062144937
simulation-passed	1
step_physics_max	0.7517107844897056
step_physics_mean	0.5650427173312829
step_physics_median	0.6839040786183942
step_physics_min	0.1510339787665834
survival_time_max	21.850000000000176
survival_time_mean	17.50000000000011
survival_time_min	11.700000000000031

No reset possible

53418

12564

Bea Baselines 🐤

straight

LFVv-sim

aborted

2020-12-02 19:29:26+00:00

2020-12-02 19:30:12+00:00

0:00:46

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53388

12573

Bea Baselines 🐤

straight

LFt-sim

aborted

2020-12-02 19:10:28+00:00

2020-12-02 19:28:50+00:00

0:18:22

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53385

11410

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

LFv-sim

aborted

2020-12-02 18:42:16+00:00

2020-12-02 19:09:53+00:00

0:27:37

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53371

12621

Bea Baselines 🐤

baseline-duckietown

LFVIt-sim

aborted

2020-12-02 18:39:29+00:00

2020-12-02 18:41:47+00:00

0:02:18

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53356

12563

Bea Baselines 🐤

straight

LFv-sim

aborted

2020-12-02 18:38:26+00:00

2020-12-02 18:39:02+00:00

0:00:36

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53336

12577

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 18:31:38+00:00

2020-12-02 18:38:11+00:00

0:06:33

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53322

12544

Bea Baselines 🐤

template-ros

LFVv-sim

aborted

2020-12-02 18:21:57+00:00

2020-12-02 18:31:22+00:00

0:09:25

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53307

12474

Bea Baselines 🐤

straight

LFVv-sim

aborted

2020-12-02 18:08:20+00:00

2020-12-02 18:21:16+00:00

0:12:56

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53281

12473

Bea Baselines 🐤

straight

LFv-sim

aborted

2020-12-02 18:00:36+00:00

2020-12-02 18:07:54+00:00

0:07:18

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53260

12543

Bea Baselines 🐤

template-ros

LFt-sim

aborted

2020-12-02 17:59:08+00:00

2020-12-02 18:00:28+00:00

0:01:20

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53252

12547

Bea Baselines 🐤

template-ros

LFVIv-sim

aborted

2020-12-02 17:57:27+00:00

2020-12-02 17:58:41+00:00

0:01:14

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53247

12475

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 17:54:42+00:00

2020-12-02 17:57:01+00:00

0:02:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139894232491968
- M:video_aido:cmdline(in:/;out:/) 139894233340224
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53243

12480

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 17:52:46+00:00

2020-12-02 17:54:28+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139810065116464
- M:video_aido:cmdline(in:/;out:/) 139810114135136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53228

12483

Bea Baselines 🐤

straight

LFt-sim

error

2020-12-02 17:50:44+00:00

2020-12-02 17:52:10+00:00

0:01:26

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139901545329856
- M:video_aido:cmdline(in:/;out:/) 139901545331680
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53211

12481

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 17:48:48+00:00

2020-12-02 17:50:29+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139943985586960
- M:video_aido:cmdline(in:/;out:/) 139943933280368
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53197

12485

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 17:45:38+00:00

2020-12-02 17:48:34+00:00

0:02:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140304790536000
- M:video_aido:cmdline(in:/;out:/) 140304789576816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53174

12449

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

aborted

2020-12-02 17:36:00+00:00

2020-12-02 17:45:16+00:00

0:09:16

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53167

12450

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

aido5-LFI-full-sim-validation

2020-12-02 17:33:58+00:00

2020-12-02 17:35:37+00:00

0:01:39

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140435405663632
- M:video_aido:cmdline(in:/;out:/) 140435405949056
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53160

12452

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

aido5-LFI-full-sim-validation

2020-12-02 17:31:28+00:00

2020-12-02 17:33:41+00:00

0:02:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139706666305232
- M:video_aido:cmdline(in:/;out:/) 139704511366336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53150

12452

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 17:29:08+00:00

2020-12-02 17:31:07+00:00

0:01:59

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140021812128928
- M:video_aido:cmdline(in:/;out:/) 140021812128832
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53141

12453

Bea Baselines 🐤

template-tensorflow

LFt-sim

error

2020-12-02 17:27:12+00:00

2020-12-02 17:28:41+00:00

0:01:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140190414001728
- M:video_aido:cmdline(in:/;out:/) 140190414003504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53102

12458

Bea Baselines 🐤

template-pytorch

LFv-sim

error

2020-12-02 17:17:56+00:00

2020-12-02 17:26:59+00:00

0:09:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140095045446816
- M:video_aido:cmdline(in:/;out:/) 140095045443696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53083

12460

Bea Baselines 🐤

template-pytorch

LFVIv-sim

host-error

2020-12-02 17:15:43+00:00

2020-12-02 17:17:36+00:00

0:01:53

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53049

12461

Bea Baselines 🐤

template-pytorch

LFP-sim

error

2020-12-02 17:07:05+00:00

2020-12-02 17:15:16+00:00

0:08:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140706404455136
- M:video_aido:cmdline(in:/;out:/) 140706404456288
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

53033

12462

Bea Baselines 🐤

template-pytorch

LFP-sim

error

2020-12-02 16:54:23+00:00

2020-12-02 17:06:36+00:00

0:12:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139944814847648
- M:video_aido:cmdline(in:/;out:/) 139944814803648
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52923

12471

Bea Baselines 🐤

template-pytorch

LFVIt-sim

error

2020-12-02 16:19:14+00:00

2020-12-02 16:53:49+00:00

0:34:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140176681545984
- M:video_aido:cmdline(in:/;out:/) 140176681611120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52867

11410

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

LFv-sim

error

2020-12-02 16:09:12+00:00

2020-12-02 16:18:56+00:00

0:09:44

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139796986806384
- M:video_aido:cmdline(in:/;out:/) 139796986807920
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52856

12429

Bea Baselines 🐤

straight

LFVv-sim

aborted

2020-12-02 16:08:24+00:00

2020-12-02 16:08:59+00:00

0:00:35

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52833

12436

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 16:06:54+00:00

2020-12-02 16:07:46+00:00

0:00:52

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52810

12442

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 16:03:37+00:00

2020-12-02 16:06:41+00:00

0:03:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140027922726480
- M:video_aido:cmdline(in:/;out:/) 140027922725568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52802

12426

Bea Baselines 🐤

template-tensorflow

LFVIt-sim

aborted

aido5-LFI-full-sim-validation

2020-12-02 16:02:42+00:00

2020-12-02 16:03:17+00:00

0:00:35

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52789

12225

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 16:00:53+00:00

2020-12-02 16:02:10+00:00

0:01:17

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52753

12361

Bea Baselines 🐤

baseline-behavior-cloning

LFVIv-sim

aborted

2020-12-02 15:57:41+00:00

2020-12-02 16:00:32+00:00

0:02:51

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52684

11772

Ehsan Ahmadi 🇨🇦

template-random

LFv-sim

aborted

2020-12-02 12:48:27+00:00

2020-12-02 12:48:51+00:00

0:00:24

Uncaught exception: [...]

Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52556

6814

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 12:00:42+00:00

2020-12-02 12:14:24+00:00

0:13:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140114203011872
- M:video_aido:cmdline(in:/;out:/) 140114203012880
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52515

6828

exercise_ros_template

LFv-sim

timeout

2020-12-02 11:52:49+00:00

2020-12-02 11:59:19+00:00

0:06:30

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52492

6841

Himanshu Arora 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:48:01+00:00

2020-12-02 11:52:08+00:00

0:04:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140320138533424
- M:video_aido:cmdline(in:/;out:/) 140320138533232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52433

9240

Liam Paull 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:38:30+00:00

2020-12-02 11:47:42+00:00

0:09:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140531662051744
- M:video_aido:cmdline(in:/;out:/) 140531664504000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52352

9303

Jerome Labonte 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:28:41+00:00

2020-12-02 11:36:48+00:00

0:08:07

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140692377211520
- M:video_aido:cmdline(in:/;out:/) 140692377212960
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52279

9328

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:17:35+00:00

2020-12-02 11:28:00+00:00

0:10:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139966172223856
- M:video_aido:cmdline(in:/;out:/) 139966172224864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52256

9370

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 11:14:50+00:00

2020-12-02 11:17:14+00:00

0:02:24

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140470424145392
- M:video_aido:cmdline(in:/;out:/) 140470424155664
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52151

9773

exercise_ros_template

LFv-sim

error

2020-12-02 11:02:09+00:00

2020-12-02 11:12:44+00:00

0:10:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140317603158528
- M:video_aido:cmdline(in:/;out:/) 140317603548896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52123

9776

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:58:08+00:00

2020-12-02 11:01:51+00:00

0:03:43

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140208039425312
- M:video_aido:cmdline(in:/;out:/) 140208039426608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

52061

10025

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 10:46:29+00:00

2020-12-02 10:53:25+00:00

0:06:56

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140314990464880
- M:video_aido:cmdline(in:/;out:/) 140315015842496
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51983

10048

Jean-Sébastien Grondin 🇨🇦

sim-exercise-1

LFv-sim

host-error

2020-12-02 10:35:31+00:00

2020-12-02 10:45:39+00:00

0:10:08

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51938

10057

sim-exercise-1

LFv-sim

error

2020-12-02 10:30:05+00:00

2020-12-02 10:34:57+00:00

0:04:52

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140204526618176
- M:video_aido:cmdline(in:/;out:/) 140204527007440
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51903

10365

Anthony Courchesne 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:27:09+00:00

2020-12-02 10:29:24+00:00

0:02:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140510674195648
- M:video_aido:cmdline(in:/;out:/) 140510674197280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51850

10718

exercise_ros_template

LFv-sim

failed

2020-12-02 10:21:07+00:00

2020-12-02 10:24:03+00:00

0:02:56

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51806

10733

Dishank Bansal 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 10:15:37+00:00

2020-12-02 10:20:54+00:00

0:05:17

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139875592580064
- M:video_aido:cmdline(in:/;out:/) 139875592591824
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51784

10759

exercise_ros_template

LFv-sim

error

2020-12-02 10:12:51+00:00

2020-12-02 10:15:19+00:00

0:02:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140377592973776
- M:video_aido:cmdline(in:/;out:/) 140377592973728
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51744

10773

exercise_ros_template

LFv-sim

error

2020-12-02 10:08:13+00:00

2020-12-02 10:11:32+00:00

0:03:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139933232868896
- M:video_aido:cmdline(in:/;out:/) 139933233257968
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51728

10770

exercise_ros_template

LFv-sim

error

2020-12-02 10:05:36+00:00

2020-12-02 10:07:56+00:00

0:02:20

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140247414007120
- M:video_aido:cmdline(in:/;out:/) 140242963620768
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51645

10803

exercise_ros_template

LFv-sim

error

2020-12-02 09:57:13+00:00

2020-12-02 10:05:13+00:00

0:08:00

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139905554990224
- M:video_aido:cmdline(in:/;out:/) 139905555003088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51616

10809

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:53:40+00:00

2020-12-02 09:56:55+00:00

0:03:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140083717898400
- M:video_aido:cmdline(in:/;out:/) 140083718725840
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51589

10822

exercise_ros_template

LFv-sim

error

2020-12-02 09:50:12+00:00

2020-12-02 09:53:23+00:00

0:03:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139733259863712
- M:video_aido:cmdline(in:/;out:/) 139733260109088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51565

10933

template-pytorch

LFv-sim

aborted

2020-12-02 09:47:54+00:00

2020-12-02 09:48:42+00:00

0:00:48

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51542

10837

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:44:50+00:00

2020-12-02 09:47:24+00:00

0:02:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139863270053680
- M:video_aido:cmdline(in:/;out:/) 139863270054688
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51518

10845

Daniil Lisus

sim-exercise-1

LFv-sim

error

2020-12-02 09:42:48+00:00

2020-12-02 09:44:22+00:00

0:01:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139932363648976
- M:video_aido:cmdline(in:/;out:/) 139937185888624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51471

10857

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:36:54+00:00

2020-12-02 09:40:59+00:00

0:04:05

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140056424248848
- M:video_aido:cmdline(in:/;out:/) 140056424782240
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51347

10887

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:25:08+00:00

2020-12-02 09:35:58+00:00

0:10:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139966083420272
- M:video_aido:cmdline(in:/;out:/) 139966083423632
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51335

11010

template-pytorch

LFv-sim

aborted

2020-12-02 09:23:54+00:00

2020-12-02 09:24:35+00:00

0:00:41

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51309

10898

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:20:05+00:00

2020-12-02 09:23:26+00:00

0:03:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139870516699824
- M:video_aido:cmdline(in:/;out:/) 139870516700400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51235

10918

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 09:11:58+00:00

2020-12-02 09:18:47+00:00

0:06:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139925967446320
- M:video_aido:cmdline(in:/;out:/) 139925967447328
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51218

11012

template-pytorch

LFv-sim

aborted

2020-12-02 09:09:00+00:00

2020-12-02 09:10:29+00:00

0:01:29

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51191

10926

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:05:28+00:00

2020-12-02 09:08:40+00:00

0:03:12

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140315582544336
- M:video_aido:cmdline(in:/;out:/) 140315582568672
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51143

10956

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 09:00:55+00:00

2020-12-02 09:04:40+00:00

0:03:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139632962612720
- M:video_aido:cmdline(in:/;out:/) 139632962564544
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

51059

10963

Himanshu Arora 🇨🇦

sim-exercise-1

LFv-sim

error

2020-12-02 08:51:11+00:00

2020-12-02 08:59:33+00:00

0:08:22

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139937571790608
- M:video_aido:cmdline(in:/;out:/) 139937572188272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50983

11011

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:43:10+00:00

2020-12-02 08:51:01+00:00

0:07:51

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139708651017648
- M:video_aido:cmdline(in:/;out:/) 139708651462464
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50905

11022

exercise_ros_template

LFv-sim

error

2020-12-02 08:32:11+00:00

2020-12-02 08:42:30+00:00

0:10:19

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140092474500864
- M:video_aido:cmdline(in:/;out:/) 140092474501872
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50839

11037

exercise_ros_template

LFv-sim

error

2020-12-02 08:25:11+00:00

2020-12-02 08:32:00+00:00

0:06:49

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140663823195104
- M:video_aido:cmdline(in:/;out:/) 140663823208992
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50773

11056

Bhavya Patwa 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:17:42+00:00

2020-12-02 08:24:37+00:00

0:06:55

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139719501028272
- M:video_aido:cmdline(in:/;out:/) 139719500328816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50739

11157

template-pytorch

LFv-sim

error

2020-12-02 08:14:55+00:00

2020-12-02 08:17:18+00:00

0:02:23

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140096358626592
- M:video_aido:cmdline(in:/;out:/) 140096358628512
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50674

11091

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 08:10:27+00:00

2020-12-02 08:14:40+00:00

0:04:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140111377088768
- M:video_aido:cmdline(in:/;out:/) 140111377091696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50622

11129

sim-exercise-1

LFv-sim

host-error

2020-12-02 08:07:20+00:00

2020-12-02 08:10:11+00:00

0:02:51

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50569

11286

template-pytorch

LFv-sim

error

2020-12-02 08:03:50+00:00

2020-12-02 08:07:11+00:00

0:03:21

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140015193775120
- M:video_aido:cmdline(in:/;out:/) 140015193775456
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50503

11125

exercise_ros_template

LFv-sim

failed

2020-12-02 07:59:02+00:00

2020-12-02 08:03:12+00:00

0:04:10

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50460

11152

Dishank Bansal 🇨🇦

sim-exercise-1

LFv-sim

failed

2020-12-02 07:51:34+00:00

2020-12-02 07:54:20+00:00

0:02:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50420

11289

template-pytorch

LFv-sim

error

2020-12-02 07:47:07+00:00

2020-12-02 07:49:43+00:00

0:02:36

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140338363222816
- M:video_aido:cmdline(in:/;out:/) 140343088006960
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50387

11142

Ayman Shams 🇨🇦

exercise_ros_template

LFv-sim

failed

2020-12-02 07:42:05+00:00

2020-12-02 07:46:10+00:00

0:04:05

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50311

11150

template-pytorch

LFv-sim

error

2020-12-02 07:33:01+00:00

2020-12-02 07:41:38+00:00

0:08:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140238836540320
- M:video_aido:cmdline(in:/;out:/) 140238124772224
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50217

11282

template-pytorch

LFv-sim

error

2020-12-02 07:21:06+00:00

2020-12-02 07:32:04+00:00

0:10:58

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140581760026800
- M:video_aido:cmdline(in:/;out:/) 140581760027856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50117

11296

template-pytorch

LFv-sim

error

2020-12-02 07:09:15+00:00

2020-12-02 07:19:44+00:00

0:10:29

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139798374196896
- M:video_aido:cmdline(in:/;out:/) 139798051494880
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50081

11438

Charlie Gauthier 🇨🇦

baseline-RL-sim-pytorch

LFv-sim

failed

2020-12-02 07:03:54+00:00

2020-12-02 07:08:40+00:00

0:04:46

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 27, in init
              ||     self.model.load("model", directory="./models")
              ||   File "/workspace/model.py", line 236, in load
              ||     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              ||     with _open_file_like(f, 'rb') as opened_file:
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              ||     return _open_file(name_or_buffer, mode)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              ||     super(_open_file, self).__init__(open(name, mode))
              || FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 27, in init
              || |     self.model.load("model", directory="./models")
              || |   File "/workspace/model.py", line 236, in load
              || |     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              || |     with _open_file_like(f, 'rb') as opened_file:
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              || |     return _open_file(name_or_buffer, mode)
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              || |     super(_open_file, self).__init__(open(name, mode))
              || | FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

50000

11348

Bhavya Patwa 🇨🇦

sim-exercise-1

LFv-sim

timeout

2020-12-02 06:53:22+00:00

2020-12-02 07:02:14+00:00

0:08:52

Timeout because eval [...]

Timeout because evaluator contacted us

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49977

11353

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 06:49:54+00:00

2020-12-02 06:52:11+00:00

0:02:17

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139685149278512
- M:video_aido:cmdline(in:/;out:/) 139685148079296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49913

11369

Yishu Malhotra 🇨🇦

exercise_ros_template

LFv-sim

error

2020-12-02 06:41:00+00:00

2020-12-02 06:48:02+00:00

0:07:02

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139994940177232
- M:video_aido:cmdline(in:/;out:/) 139994983541488
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49787

11440

Anastasiya Nikolskaya 🇷🇺

JetBrains Research

LFv-sim

error

2020-12-02 06:24:40+00:00

2020-12-02 06:35:33+00:00

0:10:53

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139997006863904
- M:video_aido:cmdline(in:/;out:/) 139997006860544
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49681

11480

sim-exercise-2

LFv-sim

error

2020-12-02 06:08:54+00:00

2020-12-02 06:22:07+00:00

0:13:13

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140386890037616
- M:video_aido:cmdline(in:/;out:/) 140387690865856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49606

11538

Jean-Sébastien Grondin 🇨🇦

exercise_state_estimation

LFv-sim

error

2020-12-02 05:58:12+00:00

2020-12-02 06:08:44+00:00

0:10:32

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140461300099008
- M:video_aido:cmdline(in:/;out:/) 140461298428512
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49534

11560

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

error

2020-12-02 05:48:25+00:00

2020-12-02 05:57:41+00:00

0:09:16

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139775189480592
- M:video_aido:cmdline(in:/;out:/) 139775189479776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49467

11581

Yishu Malhotra 🇨🇦

exercise_state_estimation

LFv-sim

error

2020-12-02 05:39:48+00:00

2020-12-02 05:47:52+00:00

0:08:04

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140075303357552
- M:video_aido:cmdline(in:/;out:/) 140075303355632
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49417

11598

exercise_state_estimation

LFv-sim

error

2020-12-02 05:33:38+00:00

2020-12-02 05:39:15+00:00

0:05:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139860632577360
- M:video_aido:cmdline(in:/;out:/) 139860489122624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49378

11633

Yishu Malhotra 🇨🇦

sim-exercise-2

LFv-sim

error

2020-12-02 05:29:21+00:00

2020-12-02 05:32:55+00:00

0:03:34

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140557606186240
- M:video_aido:cmdline(in:/;out:/) 140557606155744
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49326

11627

Philippe Reddy 🇨🇦

sim-exercise-2

LFv-sim

host-error

2020-12-02 05:22:49+00:00

2020-12-02 05:28:56+00:00

0:06:07

The container "evalu [...]

The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49226

11705

brian wong

baseline-RL-sim-pytorch

LFv-sim

error

2020-12-02 05:11:01+00:00

2020-12-02 05:22:26+00:00

0:11:25

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140568085451728
- M:video_aido:cmdline(in:/;out:/) 140568085454560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49138

12231

Bea Baselines 🐤

baseline-behavior-cloning

LFv-sim

error

2020-12-02 05:02:28+00:00

2020-12-02 05:10:51+00:00

0:08:23

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139672905918784
- M:video_aido:cmdline(in:/;out:/) 139672905803136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49109

12237

Bea Baselines 🐤

baseline-behavior-cloning

LFVmultibodyv-sim

host-error

2020-12-02 04:59:37+00:00

2020-12-02 05:02:13+00:00

0:02:36

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49089

12236

Bea Baselines 🐤

baseline-behavior-cloning

LFVmultibodyv-sim

host-error

2020-12-02 04:58:32+00:00

2020-12-02 04:59:29+00:00

0:00:57

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49073

12236

Bea Baselines 🐤

baseline-behavior-cloning

LFVmultibodyv-sim

host-error

2020-12-02 04:56:37+00:00

2020-12-02 04:57:48+00:00

0:01:11

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49045

12245

Bea Baselines 🐤

baseline-behavior-cloning

LFVIv-sim

host-error

2020-12-02 04:54:46+00:00

2020-12-02 04:55:56+00:00

0:01:10

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

49010

12292

Bea Baselines 🐤

template-tensorflow

LFVv-sim

error

2020-12-02 04:52:21+00:00

2020-12-02 04:54:24+00:00

0:02:03

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140287852982432
- M:video_aido:cmdline(in:/;out:/) 140287853008832
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48995

12296

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 04:50:56+00:00

2020-12-02 04:51:56+00:00

0:01:00

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48982

12296

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 04:49:32+00:00

2020-12-02 04:50:36+00:00

0:01:04

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48966

12297

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 04:47:56+00:00

2020-12-02 04:49:05+00:00

0:01:09

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48942

12291

Bea Baselines 🐤

template-tensorflow

LFv-sim

error

2020-12-02 04:45:45+00:00

2020-12-02 04:47:25+00:00

0:01:40

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140039328694624
- M:video_aido:cmdline(in:/;out:/) 140039330092608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48909

12295

Bea Baselines 🐤

template-tensorflow

LFP-sim

error

2020-12-02 04:43:48+00:00

2020-12-02 04:45:29+00:00

0:01:41

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139635891184112
- M:video_aido:cmdline(in:/;out:/) 139635890836000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48883

12298

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 04:41:57+00:00

2020-12-02 04:43:34+00:00

0:01:37

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139622843271152
- M:video_aido:cmdline(in:/;out:/) 139622843271488
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48869

12298

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 04:39:57+00:00

2020-12-02 04:41:39+00:00

0:01:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139998347472080
- M:video_aido:cmdline(in:/;out:/) 139998347471024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48844

12303

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 04:37:05+00:00

2020-12-02 04:39:35+00:00

0:02:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140534695957600
- M:video_aido:cmdline(in:/;out:/) 140534696137920
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48834

12305

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

host-error

2020-12-02 04:35:49+00:00

2020-12-02 04:36:53+00:00

0:01:04

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48730

12310

Bea Baselines 🐤

template-pytorch

LFP-sim

error

2020-12-02 04:20:50+00:00

2020-12-02 04:35:12+00:00

0:14:22

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139883570198032
- M:video_aido:cmdline(in:/;out:/) 139883571995696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48590

12273

Bea Baselines 🐤

baseline-duckietown

LFVIv-sim

error

2020-12-02 04:04:06+00:00

2020-12-02 04:20:21+00:00

0:16:15

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139890001839920
- M:video_aido:cmdline(in:/;out:/) 139890001842032
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48545

12258

Bea Baselines 🐤

template-random

LFVIv-sim

error

2020-12-02 04:01:24+00:00

2020-12-02 04:03:35+00:00

0:02:11

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139683711538416
- M:video_aido:cmdline(in:/;out:/) 139683711374960
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48503

12173

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 03:59:18+00:00

2020-12-02 04:01:12+00:00

0:01:54

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140175726721872
- M:video_aido:cmdline(in:/;out:/) 140175726063280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48474

12174

Bea Baselines 🐤

template-tensorflow

LFP-sim

error

2020-12-02 03:56:42+00:00

2020-12-02 03:59:10+00:00

0:02:28

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139832888888096
- M:video_aido:cmdline(in:/;out:/) 139832888715632
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48461

12181

Bea Baselines 🐤

template-tensorflow

LFt-sim

error

2020-12-02 03:54:51+00:00

2020-12-02 03:56:22+00:00

0:01:31

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140306389454512
- M:video_aido:cmdline(in:/;out:/) 140306389451824
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48427

12182

Bea Baselines 🐤

template-tensorflow

LFVv-sim

error

2020-12-02 03:51:40+00:00

2020-12-02 03:54:22+00:00

0:02:42

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139803043690096
- M:video_aido:cmdline(in:/;out:/) 139803043689760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48413

12201

Bea Baselines 🐤

baseline-behavior-cloning

LFv-sim

failed

2020-12-02 03:50:51+00:00

2020-12-02 03:51:32+00:00

0:00:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48248

11410

Frank (Chude) Qian 🇨🇦

challenge-aido_LF-baseline-behavior-cloning

LFv-sim

error

2020-12-02 03:40:22+00:00

2020-12-02 03:50:19+00:00

0:09:57

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139693796714960
- M:video_aido:cmdline(in:/;out:/) 139693796727776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48194

12226

Bea Baselines 🐤

straight

LFt-sim

error

2020-12-02 03:38:44+00:00

2020-12-02 03:40:14+00:00

0:01:30

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140492881226768
- M:video_aido:cmdline(in:/;out:/) 140492881027760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48147

11753

Étienne Boucher 🇨🇦

real-exercise-2

LFv-sim

aborted

2020-12-02 03:37:48+00:00

2020-12-02 03:38:35+00:00

0:00:47

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

48002

12170

Bea Baselines 🐤

template-pytorch

LFVIv-sim

aborted

2020-12-02 03:22:11+00:00

2020-12-02 03:37:37+00:00

0:15:26

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47986

12177

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 03:20:50+00:00

2020-12-02 03:21:55+00:00

0:01:05

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47969

12177

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 03:19:13+00:00

2020-12-02 03:20:15+00:00

0:01:02

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47920

12170

Bea Baselines 🐤

template-pytorch

LFVIv-sim

error

2020-12-02 03:15:44+00:00

2020-12-02 03:18:54+00:00

0:03:10

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139717538492864
- M:video_aido:cmdline(in:/;out:/) 139717538505248
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47893

12176

Bea Baselines 🐤

template-tensorflow

LFVmultibodyv-sim

host-error

2020-12-02 03:14:03+00:00

2020-12-02 03:15:12+00:00

0:01:09

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47866

12175

Bea Baselines 🐤

template-tensorflow

LFP-sim

error

2020-12-02 03:11:52+00:00

2020-12-02 03:13:30+00:00

0:01:38

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139878364652592
- M:video_aido:cmdline(in:/;out:/) 139878362730160
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47848

12179

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

error

2020-12-02 03:09:40+00:00

2020-12-02 03:11:15+00:00

0:01:35

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140244833956672
- M:video_aido:cmdline(in:/;out:/) 140244834457728
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47824

12184

Bea Baselines 🐤

template-tensorflow

LFVIt-sim

error

2020-12-02 03:06:34+00:00

2020-12-02 03:09:19+00:00

0:02:45

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140099863567952
- M:video_aido:cmdline(in:/;out:/) 140099863567280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47813

12185

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

host-error

2020-12-02 03:05:11+00:00

2020-12-02 03:06:12+00:00

0:01:01

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47793

12185

Bea Baselines 🐤

template-tensorflow

LFVIv-sim

host-error

2020-12-02 03:04:07+00:00

2020-12-02 03:05:04+00:00

0:00:57

InvalidEnvironment: [...]

InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47720

12212

Bea Baselines 🐤

baseline-behavior-cloning

LFVv-sim

failed

2020-12-02 03:00:00+00:00

2020-12-02 03:03:39+00:00

0:03:39

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47686

11882

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 02:57:02+00:00

2020-12-02 02:59:52+00:00

0:02:50

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139913206417632
- M:video_aido:cmdline(in:/;out:/) 139913206730176
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47666

12211

Bea Baselines 🐤

baseline-behavior-cloning

LFt-sim

failed

2020-12-02 02:56:12+00:00

2020-12-02 02:56:53+00:00

0:00:41

InvalidSubmission: T [...]

InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47578

11884

Bea Baselines 🐤

straight

LFVIv-sim

error

2020-12-02 02:49:56+00:00

2020-12-02 02:55:42+00:00

0:05:46

InvalidEvaluator: Tr [...]

InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140020666958848
- M:video_aido:cmdline(in:/;out:/) 140020668152896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47535

11877

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 02:19:08+00:00

2020-12-02 02:49:32+00:00

0:30:24

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47507

12209

Bea Baselines 🐤

baseline-behavior-cloning

LFVIv-sim

aborted

2020-12-02 02:18:09+00:00

2020-12-02 02:18:59+00:00

0:00:50

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47473

11884

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 02:05:59+00:00

2020-12-02 02:17:30+00:00

0:11:31

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47416

12215

Bea Baselines 🐤

baseline-behavior-cloning

LFVIv-sim

aborted

2020-12-02 02:03:19+00:00

2020-12-02 02:05:33+00:00

0:02:14

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47333

11882

Bea Baselines 🐤

straight

LFVIv-sim

aborted

2020-12-02 01:02:55+00:00

2020-12-02 02:03:13+00:00

1:00:18

KeyboardInterrupt: T [...]

KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.

No reset possible

47317

12151

Bea Baselines 🐤

template-pytorch

LFt-sim

host-error