AI Driving Olympics Home Challenges Submissions Jobs

Submission 2864

Submission2864
Competingyes
Challengeaido2-LFVI-sim-testing
UserAlexKaravaev
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22733
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227332864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessyes-0:49:36(hidden)
driven_lanedir_consec_median0.34490724288392616
survival_time_median8.299999999999983
deviation-center-line_median0.2844082112463791
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.11065040329309898
agent_compute-ego_mean0.09735271646905506
agent_compute-ego_median0.0975925588607788
agent_compute-ego_min0.08462515115737915
deviation-center-line_max0.9096830762941096
deviation-center-line_mean0.3505080393703441
deviation-center-line_min0.10713109441989138
deviation-heading_max5.1802862448746
deviation-heading_mean2.501700050715592
deviation-heading_median2.0547499264303988
deviation-heading_min1.461925846621474
driven_any_max1.1745816663524344
driven_any_mean0.7036495206365981
driven_any_median0.6401718380314688
driven_any_min0.18611878673167337
driven_lanedir_consec_max0.8366959265512528
driven_lanedir_consec_mean0.3714446029829952
driven_lanedir_consec_min0.14189238992856845
driven_lanedir_max0.8775842768646558
driven_lanedir_mean0.3931588889305324
driven_lanedir_median0.3601792375305599
driven_lanedir_min0.14189238992856845
in-drivable-lane_max8.30000000000001
in-drivable-lane_mean2.9766666666666923
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.3470269301906939, "sim_physics": 0.10399312922295104, "survival_time": 4.699999999999991, "driven_lanedir": 0.2353081860752302, "sim_render-ego": 0.05524615531272077, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0912343720172314, "deviation-heading": 1.5073552351929695, "set_robot_commands": 0.07742608354446735, "deviation-center-line": 0.21945928675405285, "driven_lanedir_consec": 0.2353081860752302, "sim_compute_sim_state": 0.03254538647671963, "sim_compute_performance-ego": 0.05812761885054568, "sim_compute_robot_state-ego": 0.05802445969683059, "sim_compute_robot_state-npc0": 0.06573566223712678, "sim_compute_robot_state-npc1": 0.06075462635527266, "sim_compute_robot_state-npc2": 0.06038636603253953, "sim_compute_robot_state-npc3": 0.06064897648831631}, "udem1-1-0": {"driven_any": 1.1745337908202838, "sim_physics": 0.10309248367945352, "survival_time": 14.950000000000076, "driven_lanedir": 0.4878267863046961, "sim_render-ego": 0.05277766386667888, "in-drivable-lane": 7.800000000000095, "agent_compute-ego": 0.08462515115737915, "deviation-heading": 2.32672359427828, "set_robot_commands": 0.07405543406804403, "deviation-center-line": 0.2844082112463791, "driven_lanedir_consec": 0.4878267863046961, "sim_compute_sim_state": 0.03227408011754354, "sim_compute_performance-ego": 0.05672042926152547, "sim_compute_robot_state-ego": 0.05790875514348348, "sim_compute_robot_state-npc0": 0.0636698309580485, "sim_compute_robot_state-npc1": 0.058124857743581136, "sim_compute_robot_state-npc2": 0.05783155441284179, "sim_compute_robot_state-npc3": 0.05934781869252523}, "udem1-2-0": {"driven_any": 0.6401718380314688, "sim_physics": 0.1099517747580287, "survival_time": 8.299999999999983, "driven_lanedir": 0.5859820998458034, "sim_render-ego": 0.05366859378584896, "in-drivable-lane": 0, "agent_compute-ego": 0.08479376011584179, "deviation-heading": 2.5720954179737077, "set_robot_commands": 0.07404355543205537, "deviation-center-line": 0.3804975541192602, "driven_lanedir_consec": 0.5859820998458034, "sim_compute_sim_state": 0.03171947777989399, "sim_compute_performance-ego": 0.056397617581378984, "sim_compute_robot_state-ego": 0.0570352508361081, "sim_compute_robot_state-npc0": 0.06314690429044056, "sim_compute_robot_state-npc1": 0.058833415249744093, "sim_compute_robot_state-npc2": 0.058824879577360954, "sim_compute_robot_state-npc3": 0.058685009738048875}, "udem1-3-0": {"driven_any": 1.098176876154381, "sim_physics": 0.11256310258592878, "survival_time": 14.000000000000064, "driven_lanedir": 0.37956793340353023, "sim_render-ego": 0.05703563008989607, "in-drivable-lane": 7.850000000000071, "agent_compute-ego": 0.08868451799665178, "deviation-heading": 2.575814303480508, "set_robot_commands": 0.07447810428483145, "deviation-center-line": 0.2920390691139856, "driven_lanedir_consec": 0.34490724288392616, "sim_compute_sim_state": 0.03296833464077541, "sim_compute_performance-ego": 0.060056275980813166, "sim_compute_robot_state-ego": 0.05968730790274484, "sim_compute_robot_state-npc0": 0.06685860838208879, "sim_compute_robot_state-npc1": 0.0611256514276777, "sim_compute_robot_state-npc2": 0.060373153005327494, "sim_compute_robot_state-npc3": 0.06016996502876282}, "udem1-4-0": {"driven_any": 0.18611878673167337, "sim_physics": 0.10894996715041828, "survival_time": 2.6499999999999986, "driven_lanedir": 0.14377029047279, "sim_render-ego": 0.058208173176027694, "in-drivable-lane": 0, "agent_compute-ego": 0.09353131168293503, "deviation-heading": 1.461925846621474, "set_robot_commands": 0.07658341245831184, "deviation-center-line": 0.14157197074293154, "driven_lanedir_consec": 0.14377029047279, "sim_compute_sim_state": 0.036977223630221386, "sim_compute_performance-ego": 0.06368998311600595, "sim_compute_robot_state-ego": 0.06108705952482404, "sim_compute_robot_state-npc0": 0.07308970757250516, "sim_compute_robot_state-npc1": 0.06468135455869278, "sim_compute_robot_state-npc2": 0.06430900321816499, "sim_compute_robot_state-npc3": 0.06524436428861798}, "udem1-5-0": {"driven_any": 0.3146869979470737, "sim_physics": 0.10752013430875892, "survival_time": 4.249999999999993, "driven_lanedir": 0.2077810978129264, "sim_render-ego": 0.06172337812535903, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09127198107102338, "deviation-heading": 1.778769569664098, "set_robot_commands": 0.0781094887677361, "deviation-center-line": 0.1702941413377449, "driven_lanedir_consec": 0.2077810978129264, "sim_compute_sim_state": 0.035384166941923256, "sim_compute_performance-ego": 0.06492421767290901, "sim_compute_robot_state-ego": 0.0638762025272145, "sim_compute_robot_state-npc0": 0.07353005689733169, "sim_compute_robot_state-npc1": 0.06457736632403205, "sim_compute_robot_state-npc2": 0.06370523396660299, "sim_compute_robot_state-npc3": 0.06402699526618509}, "udem1-6-0": {"driven_any": 0.3267455084338036, "sim_physics": 0.12202158841219816, "survival_time": 4.399999999999992, "driven_lanedir": 0.26583044727868455, "sim_render-ego": 0.06366989016532898, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10265829346396706, "deviation-heading": 1.6940227737614693, "set_robot_commands": 0.07728476415980946, "deviation-center-line": 0.1630523931338232, "driven_lanedir_consec": 0.26583044727868455, "sim_compute_sim_state": 0.03650887987830422, "sim_compute_performance-ego": 0.06569879434325478, "sim_compute_robot_state-ego": 0.06341031735593622, "sim_compute_robot_state-npc0": 0.07323124733838168, "sim_compute_robot_state-npc1": 0.06636006181890314, "sim_compute_robot_state-npc2": 0.06574333526871422, "sim_compute_robot_state-npc3": 0.0653440302068537}, "udem1-7-0": {"driven_any": 1.174567006135251, "sim_physics": 0.11244061708450316, "survival_time": 14.950000000000076, "driven_lanedir": 0.577347039670262, "sim_render-ego": 0.06379940509796142, "in-drivable-lane": 5.100000000000066, "agent_compute-ego": 0.0975925588607788, "deviation-heading": 5.1802862448746, "set_robot_commands": 0.07672936121622721, "deviation-center-line": 0.6130724763052668, "driven_lanedir_consec": 0.5477135673894336, "sim_compute_sim_state": 0.03661362648010254, "sim_compute_performance-ego": 0.06514355023701986, "sim_compute_robot_state-ego": 0.0630748438835144, "sim_compute_robot_state-npc0": 0.07286120017369588, "sim_compute_robot_state-npc1": 0.06620310147603353, "sim_compute_robot_state-npc2": 0.06569144169489542, "sim_compute_robot_state-npc3": 0.06517634789148967}, "udem1-8-0": {"driven_any": 0.2142374790062311, "sim_physics": 0.10722573200861613, "survival_time": 2.9999999999999973, "driven_lanedir": 0.14189238992856845, "sim_render-ego": 0.06242371002833048, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09132999579111736, "deviation-heading": 1.5172152353652426, "set_robot_commands": 0.07564551830291748, "deviation-center-line": 0.10713109441989138, "driven_lanedir_consec": 0.14189238992856845, "sim_compute_sim_state": 0.03605458339055379, "sim_compute_performance-ego": 0.06412200927734375, "sim_compute_robot_state-ego": 0.06129916111628215, "sim_compute_robot_state-npc0": 0.07353275616963705, "sim_compute_robot_state-npc1": 0.06558093229929605, "sim_compute_robot_state-npc2": 0.06403422355651855, "sim_compute_robot_state-npc3": 0.06949938535690307}, "udem1-9-0": {"driven_any": 1.0660704109894847, "sim_physics": 0.1142559708917842, "survival_time": 13.600000000000058, "driven_lanedir": 0.7023872434682448, "sim_render-ego": 0.0654933759394814, "in-drivable-lane": 3.000000000000023, "agent_compute-ego": 0.10307624673142152, "deviation-heading": 4.369672562945492, "set_robot_commands": 0.0766976361765581, "deviation-center-line": 0.7282403662263328, "driven_lanedir_consec": 0.4824850833431664, "sim_compute_sim_state": 0.03662823403582854, "sim_compute_performance-ego": 0.06511246982742758, "sim_compute_robot_state-ego": 0.06317034626708311, "sim_compute_robot_state-npc0": 0.07420160752885482, "sim_compute_robot_state-npc1": 0.06768525435644038, "sim_compute_robot_state-npc2": 0.06446050282786875, "sim_compute_robot_state-npc3": 0.06510394285706912}, "udem1-10-0": {"driven_any": 0.4191703328087611, "sim_physics": 0.1128091726217184, "survival_time": 5.549999999999988, "driven_lanedir": 0.3601792375305599, "sim_render-ego": 0.06331017425468376, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10537291861869194, "deviation-heading": 2.0547499264303988, "set_robot_commands": 0.07737921164916442, "deviation-center-line": 0.2103952943122381, "driven_lanedir_consec": 0.3601792375305599, "sim_compute_sim_state": 0.03507669766743978, "sim_compute_performance-ego": 0.06461088077442066, "sim_compute_robot_state-ego": 0.06320725045762621, "sim_compute_robot_state-npc0": 0.07424179498139802, "sim_compute_robot_state-npc1": 0.06664582200952478, "sim_compute_robot_state-npc2": 0.06445132075129328, "sim_compute_robot_state-npc3": 0.06549944533958091}, "udem1-11-0": {"driven_any": 1.1745816663524344, "sim_physics": 0.10470794041951498, "survival_time": 14.950000000000076, "driven_lanedir": 0.8775842768646558, "sim_render-ego": 0.06398152192433675, "in-drivable-lane": 2.6500000000000377, "agent_compute-ego": 0.10837200164794922, "deviation-heading": 3.862970966172535, "set_robot_commands": 0.07954168955485026, "deviation-center-line": 0.9096830762941096, "driven_lanedir_consec": 0.8366959265512528, "sim_compute_sim_state": 0.03649407386779785, "sim_compute_performance-ego": 0.06503470182418823, "sim_compute_robot_state-ego": 0.06175500949223836, "sim_compute_robot_state-npc0": 0.07630184968312581, "sim_compute_robot_state-npc1": 0.06891561269760133, "sim_compute_robot_state-npc2": 0.06624531269073486, "sim_compute_robot_state-npc3": 0.06628581523895263}, "udem1-12-0": {"driven_any": 0.9937155284082174, "sim_physics": 0.11543208313739206, "survival_time": 12.700000000000044, "driven_lanedir": 0.22746963242855345, "sim_render-ego": 0.06913319629008376, "in-drivable-lane": 8.30000000000001, "agent_compute-ego": 0.11065040329309898, "deviation-heading": 3.0689993370238766, "set_robot_commands": 0.08070626596766194, "deviation-center-line": 0.4568823714451792, "driven_lanedir_consec": 0.2268400164544104, "sim_compute_sim_state": 0.03939892644957295, "sim_compute_performance-ego": 0.06843571681675949, "sim_compute_robot_state-ego": 0.0637638212188961, "sim_compute_robot_state-npc0": 0.07736102520950197, "sim_compute_robot_state-npc1": 0.07022992644723006, "sim_compute_robot_state-npc2": 0.06932115273212823, "sim_compute_robot_state-npc3": 0.06916507116452915}, "udem1-13-0": {"driven_any": 1.1745350522892686, "sim_physics": 0.10512363195419312, "survival_time": 14.950000000000076, "driven_lanedir": 0.5031649228251633, "sim_render-ego": 0.06467283566792806, "in-drivable-lane": 7.850000000000095, "agent_compute-ego": 0.10242635409037272, "deviation-heading": 1.8082417562233568, "set_robot_commands": 0.07773682832717896, "deviation-center-line": 0.4133029034314813, "driven_lanedir_consec": 0.5031649228251633, "sim_compute_sim_state": 0.03740404446919759, "sim_compute_performance-ego": 0.06637513081232707, "sim_compute_robot_state-ego": 0.06210080623626709, "sim_compute_robot_state-npc0": 0.07441365718841553, "sim_compute_robot_state-npc1": 0.06790420611699423, "sim_compute_robot_state-npc2": 0.06714611371358235, "sim_compute_robot_state-npc3": 0.06642958005269368}, "udem1-14-0": {"driven_any": 0.2504046052499478, "sim_physics": 0.10996337558912196, "survival_time": 3.4499999999999957, "driven_lanedir": 0.20129175004831645, "sim_render-ego": 0.06699784942295241, "in-drivable-lane": 0, "agent_compute-ego": 0.10467088049736575, "deviation-heading": 1.74665799072587, "set_robot_commands": 0.07848382687223131, "deviation-center-line": 0.16759038167248522, "driven_lanedir_consec": 0.20129175004831645, "sim_compute_sim_state": 0.03817599061606587, "sim_compute_performance-ego": 0.0671590272931085, "sim_compute_robot_state-ego": 0.06406448543935582, "sim_compute_robot_state-npc0": 0.07557447405828946, "sim_compute_robot_state-npc1": 0.06982034876726675, "sim_compute_robot_state-npc2": 0.06988137355749158, "sim_compute_robot_state-npc3": 0.0693245556043542}}
set_robot_commands_max0.08070626596766194
set_robot_commands_mean0.07699341205213633
set_robot_commands_median0.07728476415980946
set_robot_commands_min0.07404355543205537
sim_compute_performance-ego_max0.06843571681675949
sim_compute_performance-ego_mean0.06344056157793522
sim_compute_performance-ego_median0.06492421767290901
sim_compute_performance-ego_min0.056397617581378984
sim_compute_robot_state-ego_max0.06406448543935582
sim_compute_robot_state-ego_mean0.061564338473227
sim_compute_robot_state-ego_median0.06210080623626709
sim_compute_robot_state-ego_min0.0570352508361081
sim_compute_robot_state-npc0_max0.07736102520950197
sim_compute_robot_state-npc0_mean0.07185002551125613
sim_compute_robot_state-npc0_median0.07353005689733169
sim_compute_robot_state-npc0_min0.06314690429044056
sim_compute_robot_state-npc1_max0.07022992644723006
sim_compute_robot_state-npc1_mean0.06516283584321937
sim_compute_robot_state-npc1_median0.06620310147603353
sim_compute_robot_state-npc1_min0.058124857743581136
sim_compute_robot_state-npc2_max0.06988137355749158
sim_compute_robot_state-npc2_mean0.06416033113373766
sim_compute_robot_state-npc2_median0.06445132075129328
sim_compute_robot_state-npc2_min0.05783155441284179
sim_compute_robot_state-npc3_max0.06949938535690307
sim_compute_robot_state-npc3_mean0.0646634202143255
sim_compute_robot_state-npc3_median0.06524436428861798
sim_compute_robot_state-npc3_min0.058685009738048875
sim_compute_sim_state_max0.03939892644957295
sim_compute_sim_state_mean0.03561491509612935
sim_compute_sim_state_median0.03649407386779785
sim_compute_sim_state_min0.03171947777989399
sim_physics_max0.12202158841219816
sim_physics_mean0.1100033802549721
sim_physics_median0.1099517747580287
sim_physics_min0.10309248367945352
sim_render-ego_max0.06913319629008376
sim_render-ego_mean0.06147610354317456
sim_render-ego_median0.06331017425468376
sim_render-ego_min0.05277766386667888
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.09333333333336
survival_time_min2.6499999999999986
217772864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:57:05(hidden)
driven_lanedir_consec_median0.4486008514259572
survival_time_median6.649999999999984
deviation-center-line_median0.280043766158728
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.09431212598627264
agent_compute-ego_mean0.08776503761908003
agent_compute-ego_median0.08795129696528117
agent_compute-ego_min0.08142077739422138
deviation-center-line_max0.6902114056863212
deviation-center-line_mean0.30277558067514926
deviation-center-line_min0.09670002711673348
deviation-heading_max6.252516001550957
deviation-heading_mean2.616788178489353
deviation-heading_median1.84667542017549
deviation-heading_min1.442955774605443
driven_any_max1.1745633207624238
driven_any_mean0.6972218424428483
driven_any_median0.507579112710053
driven_any_min0.23030349513987863
driven_lanedir_consec_max0.7229904937690446
driven_lanedir_consec_mean0.3783263724195981
driven_lanedir_consec_min0.09335975393867946
driven_lanedir_max0.794351007400731
driven_lanedir_mean0.40971049944937665
driven_lanedir_median0.4486008514259572
driven_lanedir_min0.11194693825708102
in-drivable-lane_max12.40000000000008
in-drivable-lane_mean2.646666666666694
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2305014670437081, "sim_physics": 0.15483548457805926, "survival_time": 3.2499999999999964, "driven_lanedir": 0.11424779705170908, "sim_render-ego": 0.04984607329735389, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08142077739422138, "deviation-heading": 1.5553332205961343, "set_robot_commands": 0.0781583859370305, "deviation-center-line": 0.1224017842990084, "driven_lanedir_consec": 0.11424779705170908, "sim_compute_sim_state": 0.030252882150503303, "sim_compute_performance-ego": 0.054073326404278095, "sim_compute_robot_state-ego": 0.05874085059532752, "sim_compute_robot_state-npc0": 0.060583921579214245, "sim_compute_robot_state-npc1": 0.0550101793729342, "sim_compute_robot_state-npc2": 0.05353890932523287, "sim_compute_robot_state-npc3": 0.05309441273029034}, "udem1-1-0": {"driven_any": 1.174529465459911, "sim_physics": 0.15954689661661783, "survival_time": 14.950000000000076, "driven_lanedir": 0.5152669275168904, "sim_render-ego": 0.05294452428817749, "in-drivable-lane": 7.700000000000095, "agent_compute-ego": 0.08584110021591186, "deviation-heading": 1.8033916128643657, "set_robot_commands": 0.07823357741038005, "deviation-center-line": 0.20414123614539437, "driven_lanedir_consec": 0.5152669275168904, "sim_compute_sim_state": 0.03261167685190836, "sim_compute_performance-ego": 0.057671937942504886, "sim_compute_robot_state-ego": 0.06100849787394206, "sim_compute_robot_state-npc0": 0.05803300857543945, "sim_compute_robot_state-npc1": 0.05886421759923299, "sim_compute_robot_state-npc2": 0.05782464186350505, "sim_compute_robot_state-npc3": 0.05715687354405721}, "udem1-2-0": {"driven_any": 0.507579112710053, "sim_physics": 0.16707965126611235, "survival_time": 6.649999999999984, "driven_lanedir": 0.4678889366531247, "sim_render-ego": 0.053093019284700095, "in-drivable-lane": 0, "agent_compute-ego": 0.08729415190847296, "deviation-heading": 2.151346400712611, "set_robot_commands": 0.0802554116213232, "deviation-center-line": 0.32416370190537247, "driven_lanedir_consec": 0.4678889366531247, "sim_compute_sim_state": 0.03355147964075992, "sim_compute_performance-ego": 0.05798397028356567, "sim_compute_robot_state-ego": 0.061514404483307576, "sim_compute_robot_state-npc0": 0.057907970328080025, "sim_compute_robot_state-npc1": 0.05923248233651757, "sim_compute_robot_state-npc2": 0.05905601852818539, "sim_compute_robot_state-npc3": 0.05922510928677437}, "udem1-3-0": {"driven_any": 1.1745633207624238, "sim_physics": 0.16650293032328287, "survival_time": 14.950000000000076, "driven_lanedir": 0.7672863314077887, "sim_render-ego": 0.052663846015930174, "in-drivable-lane": 2.600000000000036, "agent_compute-ego": 0.08893164873123169, "deviation-heading": 6.252516001550957, "set_robot_commands": 0.07822105805079142, "deviation-center-line": 0.5906945026089208, "driven_lanedir_consec": 0.5741915023071633, "sim_compute_sim_state": 0.03191934108734131, "sim_compute_performance-ego": 0.05782929499944051, "sim_compute_robot_state-ego": 0.06176915168762207, "sim_compute_robot_state-npc0": 0.05778518279393514, "sim_compute_robot_state-npc1": 0.05752764066060384, "sim_compute_robot_state-npc2": 0.05785255670547485, "sim_compute_robot_state-npc3": 0.05774448235829671}, "udem1-4-0": {"driven_any": 0.8812361241621338, "sim_physics": 0.1504356259793307, "survival_time": 11.300000000000026, "driven_lanedir": 0.7084909583706773, "sim_render-ego": 0.05390239605861428, "in-drivable-lane": 1.40000000000002, "agent_compute-ego": 0.08745614511776814, "deviation-heading": 2.7176467423440935, "set_robot_commands": 0.07893793350827377, "deviation-center-line": 0.280043766158728, "driven_lanedir_consec": 0.7084909583706773, "sim_compute_sim_state": 0.032539602929511954, "sim_compute_performance-ego": 0.05714187685367281, "sim_compute_robot_state-ego": 0.06115215647537096, "sim_compute_robot_state-npc0": 0.05771325436313596, "sim_compute_robot_state-npc1": 0.05821346920148461, "sim_compute_robot_state-npc2": 0.0576306170066901, "sim_compute_robot_state-npc3": 0.05721209639996554}, "udem1-5-0": {"driven_any": 0.2745053330620928, "sim_physics": 0.1771099599202474, "survival_time": 3.7499999999999942, "driven_lanedir": 0.1691524701237603, "sim_render-ego": 0.05955971399943034, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.09374043782552084, "deviation-heading": 1.6504087860139658, "set_robot_commands": 0.09199111620585124, "deviation-center-line": 0.136809329938964, "driven_lanedir_consec": 0.1691524701237603, "sim_compute_sim_state": 0.03707043647766113, "sim_compute_performance-ego": 0.0652230421702067, "sim_compute_robot_state-ego": 0.0701195494333903, "sim_compute_robot_state-npc0": 0.06623300234476726, "sim_compute_robot_state-npc1": 0.06472910245259603, "sim_compute_robot_state-npc2": 0.06571852048238118, "sim_compute_robot_state-npc3": 0.06610281944274903}, "udem1-6-0": {"driven_any": 0.29460504812534094, "sim_physics": 0.18507420122623444, "survival_time": 3.999999999999994, "driven_lanedir": 0.25220305649324937, "sim_render-ego": 0.0534832775592804, "in-drivable-lane": 0, "agent_compute-ego": 0.08984801173210144, "deviation-heading": 1.509166998208722, "set_robot_commands": 0.07829373776912689, "deviation-center-line": 0.205480563130493, "driven_lanedir_consec": 0.25220305649324937, "sim_compute_sim_state": 0.033394661545753476, "sim_compute_performance-ego": 0.05776572823524475, "sim_compute_robot_state-ego": 0.06208333969116211, "sim_compute_robot_state-npc0": 0.06035323739051819, "sim_compute_robot_state-npc1": 0.059532341361045835, "sim_compute_robot_state-npc2": 0.058613640069961545, "sim_compute_robot_state-npc3": 0.058701816201210025}, "udem1-7-0": {"driven_any": 1.1745612946707102, "sim_physics": 0.16627472003300986, "survival_time": 14.950000000000076, "driven_lanedir": 0.5181691799626452, "sim_render-ego": 0.053741085529327395, "in-drivable-lane": 6.550000000000086, "agent_compute-ego": 0.08795129696528117, "deviation-heading": 3.723090193274712, "set_robot_commands": 0.08127786795298259, "deviation-center-line": 0.5069818954420743, "driven_lanedir_consec": 0.5102163821950274, "sim_compute_sim_state": 0.03323727289835612, "sim_compute_performance-ego": 0.0592372473080953, "sim_compute_robot_state-ego": 0.06242111603418986, "sim_compute_robot_state-npc0": 0.05957314332326253, "sim_compute_robot_state-npc1": 0.05904196421305338, "sim_compute_robot_state-npc2": 0.05898301919301351, "sim_compute_robot_state-npc3": 0.05903472105662028}, "udem1-8-0": {"driven_any": 0.23030349513987863, "sim_physics": 0.15678585320711136, "survival_time": 3.1999999999999966, "driven_lanedir": 0.1364813639047946, "sim_render-ego": 0.05121258646249771, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.08197817206382751, "deviation-heading": 1.442955774605443, "set_robot_commands": 0.07807199656963348, "deviation-center-line": 0.09670002711673348, "driven_lanedir_consec": 0.1364813639047946, "sim_compute_sim_state": 0.03230929747223854, "sim_compute_performance-ego": 0.058008238673210144, "sim_compute_robot_state-ego": 0.06076705455780029, "sim_compute_robot_state-npc0": 0.05908737704157829, "sim_compute_robot_state-npc1": 0.05769624933600426, "sim_compute_robot_state-npc2": 0.05682320520281792, "sim_compute_robot_state-npc3": 0.05815475806593895}, "udem1-9-0": {"driven_any": 1.1745500283568309, "sim_physics": 0.1731972153981527, "survival_time": 14.950000000000076, "driven_lanedir": 0.7431966205372524, "sim_render-ego": 0.05524632056554159, "in-drivable-lane": 3.500000000000049, "agent_compute-ego": 0.08888879617055258, "deviation-heading": 5.014456378359433, "set_robot_commands": 0.08185568730036417, "deviation-center-line": 0.3991748327521909, "driven_lanedir_consec": 0.563430039908905, "sim_compute_sim_state": 0.033946370283762614, "sim_compute_performance-ego": 0.059812032381693525, "sim_compute_robot_state-ego": 0.06301292975743612, "sim_compute_robot_state-npc0": 0.05975822369257609, "sim_compute_robot_state-npc1": 0.060046252409617105, "sim_compute_robot_state-npc2": 0.05953279813130696, "sim_compute_robot_state-npc3": 0.059956604639689125}, "udem1-10-0": {"driven_any": 0.23835677788764612, "sim_physics": 0.16346027995600845, "survival_time": 3.2999999999999963, "driven_lanedir": 0.17135800088371766, "sim_render-ego": 0.053171020565610946, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09431212598627264, "deviation-heading": 1.84667542017549, "set_robot_commands": 0.080112793228843, "deviation-center-line": 0.18142904647221636, "driven_lanedir_consec": 0.17135800088371766, "sim_compute_sim_state": 0.03591788176334265, "sim_compute_performance-ego": 0.05641955317872943, "sim_compute_robot_state-ego": 0.061481479442480835, "sim_compute_robot_state-npc0": 0.05958081375468861, "sim_compute_robot_state-npc1": 0.05769554051485928, "sim_compute_robot_state-npc2": 0.05910461237936309, "sim_compute_robot_state-npc3": 0.05765179070559415}, "udem1-11-0": {"driven_any": 1.1745529366120315, "sim_physics": 0.15706984361012777, "survival_time": 14.950000000000076, "driven_lanedir": 0.794351007400731, "sim_render-ego": 0.05320623397827148, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.08812806924184163, "deviation-heading": 4.513494310491634, "set_robot_commands": 0.08151013056437174, "deviation-center-line": 0.6902114056863212, "driven_lanedir_consec": 0.7229904937690446, "sim_compute_sim_state": 0.03300864696502685, "sim_compute_performance-ego": 0.058093364238739016, "sim_compute_robot_state-ego": 0.06176980018615723, "sim_compute_robot_state-npc0": 0.05850458383560181, "sim_compute_robot_state-npc1": 0.05901604016621908, "sim_compute_robot_state-npc2": 0.05858098030090332, "sim_compute_robot_state-npc3": 0.05866871198018392}, "udem1-12-0": {"driven_any": 1.174521776856088, "sim_physics": 0.16804766098658244, "survival_time": 14.950000000000076, "driven_lanedir": 0.11194693825708102, "sim_render-ego": 0.05214903275171916, "in-drivable-lane": 12.40000000000008, "agent_compute-ego": 0.08630368232727051, "deviation-heading": 1.931797379944655, "set_robot_commands": 0.07809344371159871, "deviation-center-line": 0.2981279728535613, "driven_lanedir_consec": 0.09335975393867946, "sim_compute_sim_state": 0.03240801413853963, "sim_compute_performance-ego": 0.057023430665334066, "sim_compute_robot_state-ego": 0.060998686949412025, "sim_compute_robot_state-npc0": 0.05708981355031331, "sim_compute_robot_state-npc1": 0.05745810349782308, "sim_compute_robot_state-npc2": 0.057131280104319254, "sim_compute_robot_state-npc3": 0.05693314790725708}, "udem1-13-0": {"driven_any": 0.48748180986890094, "sim_physics": 0.17341163381934166, "survival_time": 6.399999999999985, "driven_lanedir": 0.4486008514259572, "sim_render-ego": 0.054353274405002594, "in-drivable-lane": 0, "agent_compute-ego": 0.08939776383340359, "deviation-heading": 1.5480646191867196, "set_robot_commands": 0.08363263122737408, "deviation-center-line": 0.3018581769185956, "driven_lanedir_consec": 0.4486008514259572, "sim_compute_sim_state": 0.03376232646405697, "sim_compute_performance-ego": 0.05938902497291565, "sim_compute_robot_state-ego": 0.06451643630862236, "sim_compute_robot_state-npc0": 0.059894049540162086, "sim_compute_robot_state-npc1": 0.06043077073991299, "sim_compute_robot_state-npc2": 0.05976698733866215, "sim_compute_robot_state-npc3": 0.0603014025837183}, "udem1-14-0": {"driven_any": 0.2664796459249768, "sim_physics": 0.15671861335022808, "survival_time": 3.649999999999995, "driven_lanedir": 0.2270170517512704, "sim_render-ego": 0.05241716397951727, "in-drivable-lane": 0, "agent_compute-ego": 0.0849833847725228, "deviation-heading": 1.5914788390113634, "set_robot_commands": 0.07823582871319497, "deviation-center-line": 0.20341546869866545, "driven_lanedir_consec": 0.2270170517512704, "sim_compute_sim_state": 0.03272948526356318, "sim_compute_performance-ego": 0.05704510375244977, "sim_compute_robot_state-ego": 0.06007049508290748, "sim_compute_robot_state-npc0": 0.057362321304948366, "sim_compute_robot_state-npc1": 0.05693284779378813, "sim_compute_robot_state-npc2": 0.0563502017765829, "sim_compute_robot_state-npc3": 0.05793280470861147}}
set_robot_commands_max0.09199111620585124
set_robot_commands_mean0.080458773318076
set_robot_commands_median0.07893793350827377
set_robot_commands_min0.07807199656963348
sim_compute_performance-ego_max0.0652230421702067
sim_compute_performance-ego_mean0.05818114480400535
sim_compute_performance-ego_median0.05782929499944051
sim_compute_performance-ego_min0.054073326404278095
sim_compute_robot_state-ego_max0.0701195494333903
sim_compute_robot_state-ego_mean0.06209506323727525
sim_compute_robot_state-ego_median0.061514404483307576
sim_compute_robot_state-ego_min0.05874085059532752
sim_compute_robot_state-npc0_max0.06623300234476726
sim_compute_robot_state-npc0_mean0.05929732689454809
sim_compute_robot_state-npc0_median0.05908737704157829
sim_compute_robot_state-npc0_min0.05708981355031331
sim_compute_robot_state-npc1_max0.06472910245259603
sim_compute_robot_state-npc1_mean0.058761813443712826
sim_compute_robot_state-npc1_median0.05886421759923299
sim_compute_robot_state-npc1_min0.0550101793729342
sim_compute_robot_state-npc2_max0.06571852048238118
sim_compute_robot_state-npc2_mean0.05843386589389333
sim_compute_robot_state-npc2_median0.05858098030090332
sim_compute_robot_state-npc2_min0.05353890932523287
sim_compute_robot_state-npc3_max0.06610281944274903
sim_compute_robot_state-npc3_mean0.0585247701073971
sim_compute_robot_state-npc3_median0.05815475806593895
sim_compute_robot_state-npc3_min0.05309441273029034
sim_compute_sim_state_max0.03707043647766113
sim_compute_sim_state_mean0.0332439583954884
sim_compute_sim_state_median0.03300864696502685
sim_compute_sim_state_min0.030252882150503303
sim_physics_max0.18507420122623444
sim_physics_mean0.16503670468469647
sim_physics_median0.16627472003300986
sim_physics_min0.1504356259793307
sim_render-ego_max0.05955971399943034
sim_render-ego_mean0.053399304582731656
sim_render-ego_median0.053171020565610946
sim_render-ego_min0.04984607329735389
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.013333333333362
survival_time_min3.1999999999999966
217592864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7357-job21759/logs/challenges-runner/stdout.html'
(hidden)
217382864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:29:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-38-104-5317-job21738/logs/challenges-runner/stdout.html'
(hidden)
216812864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:23
I can see how the jo [...]
I can see how the job 21681 is timeout because passed 3923 seconds and the timeout is 3600.0.
(hidden)
216662864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:26:39
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 484, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7357-job21666/logs/challenges-runner/stdout.log'
(hidden)
211652864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
211192864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-38-104-5376-job21119/logs/challenges-runner/stdout.log'
(hidden)
210882864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-38-104-5317-job21088/logs/challenges-runner/stdout.log'
(hidden)
210132864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:43
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-42-167-7194-job21013/logs/challenges-runner/stdout.log'
(hidden)
209602864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:59:28
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-40-253-32059-job20960/logs/challenges-runner/stdout.log'
(hidden)
202722864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
200602864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:16(hidden)
driven_lanedir_consec_median0.16355504072820604
survival_time_median5.09999999999999
deviation-center-line_median0.3320181914238461
in-drivable-lane_median0.7499999999999973


other stats
agent_compute-ego_max0.08913375817093194
agent_compute-ego_mean0.08636060788559749
agent_compute-ego_median0.08623122453689575
agent_compute-ego_min0.08437741619266875
deviation-center-line_max0.5394843378381039
deviation-center-line_mean0.31601110429195534
deviation-center-line_min0.15728683077571157
deviation-heading_max6.1296317398383815
deviation-heading_mean3.259491556613792
deviation-heading_median2.250279003863863
deviation-heading_min1.4633151437657874
driven_any_max1.1744540876302565
driven_any_mean0.6394214974445563
driven_any_median0.38296073543178816
driven_any_min0.20214373332493035
driven_lanedir_consec_max0.5583889530727832
driven_lanedir_consec_mean0.26573666126612017
driven_lanedir_consec_min0.13626732720899715
driven_lanedir_max0.7259602390719311
driven_lanedir_mean0.3417754987709787
driven_lanedir_median0.3188564113516352
driven_lanedir_min0.1516155739689793
in-drivable-lane_max7.350000000000024
in-drivable-lane_mean2.3600000000000145
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2632127769528376, "sim_physics": 0.092589894386187, "survival_time": 3.649999999999995, "driven_lanedir": 0.1516155739689793, "sim_render-ego": 0.054896011744460016, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.08437741619266875, "deviation-heading": 1.5379693428073518, "set_robot_commands": 0.07417056331895802, "deviation-center-line": 0.15728683077571157, "driven_lanedir_consec": 0.1516155739689793, "sim_compute_sim_state": 0.03306716435576138, "sim_compute_performance-ego": 0.05959744649390652, "sim_compute_robot_state-ego": 0.05977050245624699, "sim_compute_robot_state-npc0": 0.06617295578734515, "sim_compute_robot_state-npc1": 0.0603572865055032, "sim_compute_robot_state-npc2": 0.06017812637433614, "sim_compute_robot_state-npc3": 0.05987252274604693}, "udem1-1-0": {"driven_any": 0.38296073543178816, "sim_physics": 0.1007934481489892, "survival_time": 5.09999999999999, "driven_lanedir": 0.3188564113516352, "sim_render-ego": 0.0574799939697864, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08913375817093194, "deviation-heading": 2.250279003863863, "set_robot_commands": 0.0780794059529024, "deviation-center-line": 0.3320181914238461, "driven_lanedir_consec": 0.3188564113516352, "sim_compute_sim_state": 0.03175864032670563, "sim_compute_performance-ego": 0.058616275880851, "sim_compute_robot_state-ego": 0.0598139482385972, "sim_compute_robot_state-npc0": 0.06565700792798809, "sim_compute_robot_state-npc1": 0.05973647622501149, "sim_compute_robot_state-npc2": 0.05922332230736227, "sim_compute_robot_state-npc3": 0.058619602053773166}, "udem1-2-0": {"driven_any": 1.1744540876302565, "sim_physics": 0.11962167819341024, "survival_time": 14.950000000000076, "driven_lanedir": 0.7259602390719311, "sim_render-ego": 0.0546096404393514, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.08466081062952678, "deviation-heading": 4.9162625527935795, "set_robot_commands": 0.07575571695963541, "deviation-center-line": 0.5394843378381039, "driven_lanedir_consec": 0.5583889530727832, "sim_compute_sim_state": 0.033345677852630616, "sim_compute_performance-ego": 0.05780149539311727, "sim_compute_robot_state-ego": 0.05971322615941366, "sim_compute_robot_state-npc0": 0.06428064584732056, "sim_compute_robot_state-npc1": 0.059567866325378416, "sim_compute_robot_state-npc2": 0.059676063060760495, "sim_compute_robot_state-npc3": 0.05986997683842977}, "udem1-3-0": {"driven_any": 1.174336153882969, "sim_physics": 0.12273629109064738, "survival_time": 14.950000000000076, "driven_lanedir": 0.34889022873414177, "sim_render-ego": 0.0577048134803772, "in-drivable-lane": 7.350000000000024, "agent_compute-ego": 0.08623122453689575, "deviation-heading": 6.1296317398383815, "set_robot_commands": 0.07701377630233765, "deviation-center-line": 0.39068203974832666, "driven_lanedir_consec": 0.13626732720899715, "sim_compute_sim_state": 0.03432941595713297, "sim_compute_performance-ego": 0.06087490240732829, "sim_compute_robot_state-ego": 0.061403363545735674, "sim_compute_robot_state-npc0": 0.06751477638880411, "sim_compute_robot_state-npc1": 0.06271460056304931, "sim_compute_robot_state-npc2": 0.061342109044392905, "sim_compute_robot_state-npc3": 0.06124816258748372}, "udem1-4-0": {"driven_any": 0.20214373332493035, "sim_physics": 0.10039252147339936, "survival_time": 2.849999999999998, "driven_lanedir": 0.16355504072820604, "sim_render-ego": 0.055959538409584446, "in-drivable-lane": 0, "agent_compute-ego": 0.08739982989796422, "deviation-heading": 1.4633151437657874, "set_robot_commands": 0.07689171088369269, "deviation-center-line": 0.16058412167378844, "driven_lanedir_consec": 0.16355504072820604, "sim_compute_sim_state": 0.033557247697261344, "sim_compute_performance-ego": 0.061801379187065256, "sim_compute_robot_state-ego": 0.06117644644620126, "sim_compute_robot_state-npc0": 0.06724163523891516, "sim_compute_robot_state-npc1": 0.06166939986379523, "sim_compute_robot_state-npc2": 0.061312064789889154, "sim_compute_robot_state-npc3": 0.06005923789844178}}
set_robot_commands_max0.0780794059529024
set_robot_commands_mean0.07638223468350522
set_robot_commands_median0.07689171088369269
set_robot_commands_min0.07417056331895802
sim_compute_performance-ego_max0.061801379187065256
sim_compute_performance-ego_mean0.05973829987245367
sim_compute_performance-ego_median0.05959744649390652
sim_compute_performance-ego_min0.05780149539311727
sim_compute_robot_state-ego_max0.061403363545735674
sim_compute_robot_state-ego_mean0.06037549736923895
sim_compute_robot_state-ego_median0.0598139482385972
sim_compute_robot_state-ego_min0.05971322615941366
sim_compute_robot_state-npc0_max0.06751477638880411
sim_compute_robot_state-npc0_mean0.0661734042380746
sim_compute_robot_state-npc0_median0.06617295578734515
sim_compute_robot_state-npc0_min0.06428064584732056
sim_compute_robot_state-npc1_max0.06271460056304931
sim_compute_robot_state-npc1_mean0.060809125896547536
sim_compute_robot_state-npc1_median0.0603572865055032
sim_compute_robot_state-npc1_min0.059567866325378416
sim_compute_robot_state-npc2_max0.061342109044392905
sim_compute_robot_state-npc2_mean0.06034633711534819
sim_compute_robot_state-npc2_median0.06017812637433614
sim_compute_robot_state-npc2_min0.05922332230736227
sim_compute_robot_state-npc3_max0.06124816258748372
sim_compute_robot_state-npc3_mean0.059933900424835075
sim_compute_robot_state-npc3_median0.05987252274604693
sim_compute_robot_state-npc3_min0.058619602053773166
sim_compute_sim_state_max0.03432941595713297
sim_compute_sim_state_mean0.033211629237898395
sim_compute_sim_state_median0.033345677852630616
sim_compute_sim_state_min0.03175864032670563
sim_physics_max0.12273629109064738
sim_physics_mean0.10722676665852664
sim_physics_median0.1007934481489892
sim_physics_min0.092589894386187
sim_render-ego_max0.0577048134803772
sim_render-ego_mean0.056129999608711886
sim_render-ego_median0.055959538409584446
sim_render-ego_min0.0546096404393514
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.30000000000003
survival_time_min2.849999999999998
200472864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:01:24
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20047-828550', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
198142864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:21:18(hidden)
driven_lanedir_consec_median0.5098151968740181
survival_time_median7.599999999999981
deviation-center-line_median0.32973887033682625
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.10772430340449016
agent_compute-ego_mean0.09993800007106152
agent_compute-ego_median0.09948975642522176
agent_compute-ego_min0.08762909236707185
deviation-center-line_max0.8134771194113879
deviation-center-line_mean0.4471832283307705
deviation-center-line_min0.14976205368646
deviation-heading_max6.56252528533073
deviation-heading_mean3.6370469597660473
deviation-heading_median2.295541164109353
deviation-heading_min1.4294845174705906
driven_any_max1.177878013530824
driven_any_mean0.7035042213305598
driven_any_median0.5872196676413705
driven_any_min0.20549712544006327
driven_lanedir_consec_max0.7146618921245373
driven_lanedir_consec_mean0.4696045182173504
driven_lanedir_consec_min0.16563121789065471
driven_lanedir_max0.7481007026415067
driven_lanedir_mean0.4840951988470145
driven_lanedir_median0.5098151968740181
driven_lanedir_min0.16563121789065471
in-drivable-lane_max2.9500000000000366
in-drivable-lane_mean1.3200000000000145
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.3690618595887867, "sim_physics": 0.04446635684188532, "survival_time": 4.899999999999991, "driven_lanedir": 0.269695655264812, "sim_render-ego": 0.06096030254753269, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09839356432155688, "deviation-heading": 1.6897782391483704, "set_robot_commands": 0.0940121533919354, "deviation-center-line": 0.19140880087795248, "driven_lanedir_consec": 0.269695655264812, "sim_compute_sim_state": 0.035958183055021326, "sim_compute_performance-ego": 0.06578371719438203, "sim_compute_robot_state-ego": 0.06684122280198701, "sim_compute_robot_state-npc0": 0.06606077174751127, "sim_compute_robot_state-npc1": 0.06812774648471755, "sim_compute_robot_state-npc2": 0.06393151137293601, "sim_compute_robot_state-npc3": 0.06731438150211257}, "udem1-1-0": {"driven_any": 0.5872196676413705, "sim_physics": 0.0442758531946885, "survival_time": 7.599999999999981, "driven_lanedir": 0.5098151968740181, "sim_render-ego": 0.06359415148433886, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10645328383696706, "deviation-heading": 2.295541164109353, "set_robot_commands": 0.10108994653350428, "deviation-center-line": 0.32973887033682625, "driven_lanedir_consec": 0.5098151968740181, "sim_compute_sim_state": 0.039253674055400645, "sim_compute_performance-ego": 0.07101995537155553, "sim_compute_robot_state-ego": 0.07437745364088762, "sim_compute_robot_state-npc0": 0.0695958906098416, "sim_compute_robot_state-npc1": 0.07030810807880603, "sim_compute_robot_state-npc2": 0.07099415440308421, "sim_compute_robot_state-npc3": 0.07292066279210542}, "udem1-2-0": {"driven_any": 1.177864440451755, "sim_physics": 0.04269285360972087, "survival_time": 14.950000000000076, "driven_lanedir": 0.7272332215640811, "sim_render-ego": 0.06332522392272949, "in-drivable-lane": 2.9500000000000366, "agent_compute-ego": 0.10772430340449016, "deviation-heading": 6.56252528533073, "set_robot_commands": 0.1005677819252014, "deviation-center-line": 0.8134771194113879, "driven_lanedir_consec": 0.6882186289327301, "sim_compute_sim_state": 0.03852393945058187, "sim_compute_performance-ego": 0.06918526331583659, "sim_compute_robot_state-ego": 0.07180768728256226, "sim_compute_robot_state-npc0": 0.0683545192082723, "sim_compute_robot_state-npc1": 0.06933375914891561, "sim_compute_robot_state-npc2": 0.06950148661931356, "sim_compute_robot_state-npc3": 0.06943157354990641}, "udem1-3-0": {"driven_any": 1.177878013530824, "sim_physics": 0.04280190467834473, "survival_time": 14.950000000000076, "driven_lanedir": 0.7481007026415067, "sim_render-ego": 0.061336777210235595, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.09948975642522176, "deviation-heading": 6.207905592771192, "set_robot_commands": 0.100059122244517, "deviation-center-line": 0.7515292973412259, "driven_lanedir_consec": 0.7146618921245373, "sim_compute_sim_state": 0.038104658921559655, "sim_compute_performance-ego": 0.06731061617533365, "sim_compute_robot_state-ego": 0.07096880038579305, "sim_compute_robot_state-npc0": 0.06793652772903443, "sim_compute_robot_state-npc1": 0.06834995190302531, "sim_compute_robot_state-npc2": 0.06859107494354248, "sim_compute_robot_state-npc3": 0.06838201602300008}, "udem1-4-0": {"driven_any": 0.20549712544006327, "sim_physics": 0.03792891167757804, "survival_time": 2.849999999999998, "driven_lanedir": 0.16563121789065471, "sim_render-ego": 0.056168832276996816, "in-drivable-lane": 0, "agent_compute-ego": 0.08762909236707185, "deviation-heading": 1.4294845174705906, "set_robot_commands": 0.08490482966105144, "deviation-center-line": 0.14976205368646, "driven_lanedir_consec": 0.16563121789065471, "sim_compute_sim_state": 0.03530280213606985, "sim_compute_performance-ego": 0.06054039587054336, "sim_compute_robot_state-ego": 0.0623396028552139, "sim_compute_robot_state-npc0": 0.06171536445617676, "sim_compute_robot_state-npc1": 0.06189278134128504, "sim_compute_robot_state-npc2": 0.060015958652161715, "sim_compute_robot_state-npc3": 0.061053309524268434}}
set_robot_commands_max0.10108994653350428
set_robot_commands_mean0.0961267667512419
set_robot_commands_median0.100059122244517
set_robot_commands_min0.08490482966105144
sim_compute_performance-ego_max0.07101995537155553
sim_compute_performance-ego_mean0.06676798958553024
sim_compute_performance-ego_median0.06731061617533365
sim_compute_performance-ego_min0.06054039587054336
sim_compute_robot_state-ego_max0.07437745364088762
sim_compute_robot_state-ego_mean0.06926695339328877
sim_compute_robot_state-ego_median0.07096880038579305
sim_compute_robot_state-ego_min0.0623396028552139
sim_compute_robot_state-npc0_max0.0695958906098416
sim_compute_robot_state-npc0_mean0.06673261475016726
sim_compute_robot_state-npc0_median0.06793652772903443
sim_compute_robot_state-npc0_min0.06171536445617676
sim_compute_robot_state-npc1_max0.07030810807880603
sim_compute_robot_state-npc1_mean0.06760246939134991
sim_compute_robot_state-npc1_median0.06834995190302531
sim_compute_robot_state-npc1_min0.06189278134128504
sim_compute_robot_state-npc2_max0.07099415440308421
sim_compute_robot_state-npc2_mean0.06660683719820759
sim_compute_robot_state-npc2_median0.06859107494354248
sim_compute_robot_state-npc2_min0.060015958652161715
sim_compute_robot_state-npc3_max0.07292066279210542
sim_compute_robot_state-npc3_mean0.06782038867827858
sim_compute_robot_state-npc3_median0.06838201602300008
sim_compute_robot_state-npc3_min0.061053309524268434
sim_compute_sim_state_max0.039253674055400645
sim_compute_sim_state_mean0.037428651523726666
sim_compute_sim_state_median0.038104658921559655
sim_compute_sim_state_min0.03530280213606985
sim_physics_max0.04446635684188532
sim_physics_mean0.04243317600044349
sim_physics_median0.04280190467834473
sim_physics_min0.03792891167757804
sim_render-ego_max0.06359415148433886
sim_render-ego_mean0.06107705748836669
sim_render-ego_median0.061336777210235595
sim_render-ego_min0.056168832276996816
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.050000000000026
survival_time_min2.849999999999998
197402864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:16:04(hidden)
driven_lanedir_consec_median0.5212014589658032
survival_time_median7.94999999999998
deviation-center-line_median0.2955133977628583
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.09572968659577548
agent_compute-ego_mean0.09035075976372628
agent_compute-ego_median0.09062474886576334
agent_compute-ego_min0.08532822506982575
deviation-center-line_max0.7366965615153422
deviation-center-line_mean0.34773694784671605
deviation-center-line_min0.14430479664563575
deviation-heading_max5.90437919809173
deviation-heading_mean2.717474536579165
deviation-heading_median2.101612859527424
deviation-heading_min1.6864380637330638
driven_any_max1.1778665776504738
driven_any_mean0.7251962190527131
driven_any_median0.6153510473436055
driven_any_min0.300755678597302
driven_lanedir_consec_max0.6895549122274085
driven_lanedir_consec_mean0.45671615135380816
driven_lanedir_consec_min0.20139438323473555
driven_lanedir_max0.7402319781101943
driven_lanedir_mean0.46685156453036536
driven_lanedir_median0.5212014589658032
driven_lanedir_min0.20139438323473555
in-drivable-lane_max7.550000000000095
in-drivable-lane_mean2.290000000000027
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.300755678597302, "sim_physics": 0.029889692494898663, "survival_time": 4.049999999999994, "driven_lanedir": 0.20139438323473555, "sim_render-ego": 0.06130886666568709, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09572968659577548, "deviation-heading": 1.7533534598364835, "set_robot_commands": 0.07652220313931689, "deviation-center-line": 0.1793714737951731, "driven_lanedir_consec": 0.20139438323473555, "sim_compute_sim_state": 0.036662125293119456, "sim_compute_performance-ego": 0.06242664949393567, "sim_compute_robot_state-ego": 0.06179471957830735, "sim_compute_robot_state-npc0": 0.06894995548107007, "sim_compute_robot_state-npc1": 0.06479551762710382, "sim_compute_robot_state-npc2": 0.06270803051230348, "sim_compute_robot_state-npc3": 0.06428957868505407}, "udem1-1-0": {"driven_any": 1.1778454023898517, "sim_physics": 0.026573224067687987, "survival_time": 14.950000000000076, "driven_lanedir": 0.5212014589658032, "sim_render-ego": 0.06257699966430665, "in-drivable-lane": 7.550000000000095, "agent_compute-ego": 0.09062474886576334, "deviation-heading": 2.101612859527424, "set_robot_commands": 0.07515790144602458, "deviation-center-line": 0.2955133977628583, "driven_lanedir_consec": 0.5212014589658032, "sim_compute_sim_state": 0.03599207560221354, "sim_compute_performance-ego": 0.0632963482538859, "sim_compute_robot_state-ego": 0.06119513829549154, "sim_compute_robot_state-npc0": 0.07008857170740763, "sim_compute_robot_state-npc1": 0.06341439882914225, "sim_compute_robot_state-npc2": 0.06406973759333293, "sim_compute_robot_state-npc3": 0.06458544095357259}, "udem1-2-0": {"driven_any": 1.1778665776504738, "sim_physics": 0.027258809407552084, "survival_time": 14.950000000000076, "driven_lanedir": 0.7402319781101943, "sim_render-ego": 0.05776013692220052, "in-drivable-lane": 3.200000000000043, "agent_compute-ego": 0.0912549368540446, "deviation-heading": 5.90437919809173, "set_robot_commands": 0.07282136122385661, "deviation-center-line": 0.7366965615153422, "driven_lanedir_consec": 0.6895549122274085, "sim_compute_sim_state": 0.03360250393549601, "sim_compute_performance-ego": 0.05932704528172811, "sim_compute_robot_state-ego": 0.05886972268422445, "sim_compute_robot_state-npc0": 0.06609163363774617, "sim_compute_robot_state-npc1": 0.06093074798583984, "sim_compute_robot_state-npc2": 0.060738157431284585, "sim_compute_robot_state-npc3": 0.06137371937433878}, "udem1-3-0": {"driven_any": 0.6153510473436055, "sim_physics": 0.02867290058975699, "survival_time": 7.94999999999998, "driven_lanedir": 0.5709796314886919, "sim_render-ego": 0.05818050312546064, "in-drivable-lane": 0, "agent_compute-ego": 0.08532822506982575, "deviation-heading": 2.141589101707121, "set_robot_commands": 0.07368187934347668, "deviation-center-line": 0.3827985095145709, "driven_lanedir_consec": 0.5709796314886919, "sim_compute_sim_state": 0.033760367699389185, "sim_compute_performance-ego": 0.060223264514275315, "sim_compute_robot_state-ego": 0.05920933477533688, "sim_compute_robot_state-npc0": 0.06618904317699888, "sim_compute_robot_state-npc1": 0.06078312082110711, "sim_compute_robot_state-npc2": 0.06027821025008675, "sim_compute_robot_state-npc3": 0.06080596252057537}, "udem1-4-0": {"driven_any": 0.3541623892823333, "sim_physics": 0.02892092948264264, "survival_time": 4.699999999999991, "driven_lanedir": 0.300450370852402, "sim_render-ego": 0.06017342019588389, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08881620143322234, "deviation-heading": 1.6864380637330638, "set_robot_commands": 0.07546457584868087, "deviation-center-line": 0.14430479664563575, "driven_lanedir_consec": 0.300450370852402, "sim_compute_sim_state": 0.035000035103331224, "sim_compute_performance-ego": 0.06183049780257205, "sim_compute_robot_state-ego": 0.060681928979589586, "sim_compute_robot_state-npc0": 0.06968586495582094, "sim_compute_robot_state-npc1": 0.06355062951432898, "sim_compute_robot_state-npc2": 0.0635954978618216, "sim_compute_robot_state-npc3": 0.06282639249842217}}
set_robot_commands_max0.07652220313931689
set_robot_commands_mean0.07472958420027113
set_robot_commands_median0.07515790144602458
set_robot_commands_min0.07282136122385661
sim_compute_performance-ego_max0.0632963482538859
sim_compute_performance-ego_mean0.061420761069279406
sim_compute_performance-ego_median0.06183049780257205
sim_compute_performance-ego_min0.05932704528172811
sim_compute_robot_state-ego_max0.06179471957830735
sim_compute_robot_state-ego_mean0.06035016886258996
sim_compute_robot_state-ego_median0.060681928979589586
sim_compute_robot_state-ego_min0.05886972268422445
sim_compute_robot_state-npc0_max0.07008857170740763
sim_compute_robot_state-npc0_mean0.06820101379180873
sim_compute_robot_state-npc0_median0.06894995548107007
sim_compute_robot_state-npc0_min0.06609163363774617
sim_compute_robot_state-npc1_max0.06479551762710382
sim_compute_robot_state-npc1_mean0.0626948829555044
sim_compute_robot_state-npc1_median0.06341439882914225
sim_compute_robot_state-npc1_min0.06078312082110711
sim_compute_robot_state-npc2_max0.06406973759333293
sim_compute_robot_state-npc2_mean0.06227792672976586
sim_compute_robot_state-npc2_median0.06270803051230348
sim_compute_robot_state-npc2_min0.06027821025008675
sim_compute_robot_state-npc3_max0.06458544095357259
sim_compute_robot_state-npc3_mean0.06277621880639259
sim_compute_robot_state-npc3_median0.06282639249842217
sim_compute_robot_state-npc3_min0.06080596252057537
sim_compute_sim_state_max0.036662125293119456
sim_compute_sim_state_mean0.03500342152670989
sim_compute_sim_state_median0.035000035103331224
sim_compute_sim_state_min0.03360250393549601
sim_physics_max0.029889692494898663
sim_physics_mean0.028263111208507673
sim_physics_median0.02867290058975699
sim_physics_min0.026573224067687987
sim_render-ego_max0.06257699966430665
sim_render-ego_mean0.05999998531470776
sim_render-ego_median0.06017342019588389
sim_render-ego_min0.05776013692220052
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.320000000000023
survival_time_min4.049999999999994
193002864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:15:40(hidden)
driven_lanedir_consec_median0.5252700443809122
survival_time_median7.649999999999981
deviation-center-line_median0.268238349309945
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.0927034854888916
agent_compute-ego_mean0.08723954107790989
agent_compute-ego_median0.08882425075922257
agent_compute-ego_min0.08089470210140698
deviation-center-line_max0.7864098133942451
deviation-center-line_mean0.3751605719838896
deviation-center-line_min0.08164448954011275
deviation-heading_max5.323594012355624
deviation-heading_mean2.491266054244653
deviation-heading_median1.5953760999652924
deviation-heading_min1.2849157254218122
driven_any_max1.1778709889665755
driven_any_mean0.7010930227665352
driven_any_median0.5912439850575423
driven_any_min0.2697786501172441
driven_lanedir_consec_max0.9188340186941426
driven_lanedir_consec_mean0.5092427839171586
driven_lanedir_consec_min0.19616175601121033
driven_lanedir_max0.919988755509419
driven_lanedir_mean0.511950704693963
driven_lanedir_median0.5252700443809122
driven_lanedir_min0.19616175601121033
in-drivable-lane_max4.100000000000041
in-drivable-lane_mean1.5100000000000091
in-drivable-lane_min0.09999999999999964
per-episodes
details{"udem1-0-0": {"driven_any": 0.2887080953258889, "sim_physics": 0.03400811476585192, "survival_time": 3.899999999999994, "driven_lanedir": 0.23565671890108095, "sim_render-ego": 0.053876989927047335, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08882425075922257, "deviation-heading": 1.5086883237597932, "set_robot_commands": 0.07553287041492951, "deviation-center-line": 0.12390772133765578, "driven_lanedir_consec": 0.23565671890108095, "sim_compute_sim_state": 0.03385509588779547, "sim_compute_performance-ego": 0.059728218958928034, "sim_compute_robot_state-ego": 0.061420932794228576, "sim_compute_robot_state-npc0": 0.06255174294496194, "sim_compute_robot_state-npc1": 0.059778693394783214, "sim_compute_robot_state-npc2": 0.06119255224863688, "sim_compute_robot_state-npc3": 0.05948309714977558}, "udem1-1-0": {"driven_any": 0.5912439850575423, "sim_physics": 0.03095827694811852, "survival_time": 7.649999999999981, "driven_lanedir": 0.5252700443809122, "sim_render-ego": 0.05244475564146354, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08910332941541485, "deviation-heading": 1.5953760999652924, "set_robot_commands": 0.07523915502760145, "deviation-center-line": 0.268238349309945, "driven_lanedir_consec": 0.5252700443809122, "sim_compute_sim_state": 0.03270053707696254, "sim_compute_performance-ego": 0.05633845983767042, "sim_compute_robot_state-ego": 0.059254284777672465, "sim_compute_robot_state-npc0": 0.06239113309024985, "sim_compute_robot_state-npc1": 0.059233882068808565, "sim_compute_robot_state-npc2": 0.0589244817596635, "sim_compute_robot_state-npc3": 0.05714037371616738}, "udem1-2-0": {"driven_any": 1.1778633943654246, "sim_physics": 0.02928803284962972, "survival_time": 14.950000000000076, "driven_lanedir": 0.682676248667192, "sim_render-ego": 0.05182402133941651, "in-drivable-lane": 4.100000000000041, "agent_compute-ego": 0.0927034854888916, "deviation-heading": 5.323594012355624, "set_robot_commands": 0.07376822074254354, "deviation-center-line": 0.6156024863374898, "driven_lanedir_consec": 0.6702913815984473, "sim_compute_sim_state": 0.031602209409077965, "sim_compute_performance-ego": 0.05556420962015788, "sim_compute_robot_state-ego": 0.05585814476013184, "sim_compute_robot_state-npc0": 0.059833868344624834, "sim_compute_robot_state-npc1": 0.05684687693913778, "sim_compute_robot_state-npc2": 0.056471229394276935, "sim_compute_robot_state-npc3": 0.05696076949437459}, "udem1-3-0": {"driven_any": 1.1778709889665755, "sim_physics": 0.027839356263478596, "survival_time": 14.950000000000076, "driven_lanedir": 0.919988755509419, "sim_render-ego": 0.05156599998474121, "in-drivable-lane": 2.500000000000009, "agent_compute-ego": 0.08467193762461345, "deviation-heading": 2.7437561097207435, "set_robot_commands": 0.07266956488291422, "deviation-center-line": 0.7864098133942451, "driven_lanedir_consec": 0.9188340186941426, "sim_compute_sim_state": 0.0312550679842631, "sim_compute_performance-ego": 0.0551243003209432, "sim_compute_robot_state-ego": 0.057291646798451744, "sim_compute_robot_state-npc0": 0.05822808583577474, "sim_compute_robot_state-npc1": 0.05626468499501546, "sim_compute_robot_state-npc2": 0.05579797029495239, "sim_compute_robot_state-npc3": 0.05529135386149089}, "udem1-4-0": {"driven_any": 0.2697786501172441, "sim_physics": 0.02679783677401608, "survival_time": 3.649999999999995, "driven_lanedir": 0.19616175601121033, "sim_render-ego": 0.04952067218414725, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08089470210140698, "deviation-heading": 1.2849157254218122, "set_robot_commands": 0.07032227516174316, "deviation-center-line": 0.08164448954011275, "driven_lanedir_consec": 0.19616175601121033, "sim_compute_sim_state": 0.030620359394648303, "sim_compute_performance-ego": 0.05517665980613395, "sim_compute_robot_state-ego": 0.05461807120336245, "sim_compute_robot_state-npc0": 0.05652412323102559, "sim_compute_robot_state-npc1": 0.053014849963253494, "sim_compute_robot_state-npc2": 0.05511369770520354, "sim_compute_robot_state-npc3": 0.05433112954440182}}
set_robot_commands_max0.07553287041492951
set_robot_commands_mean0.07350641724594638
set_robot_commands_median0.07376822074254354
set_robot_commands_min0.07032227516174316
sim_compute_performance-ego_max0.059728218958928034
sim_compute_performance-ego_mean0.05638636970876669
sim_compute_performance-ego_median0.05556420962015788
sim_compute_performance-ego_min0.0551243003209432
sim_compute_robot_state-ego_max0.061420932794228576
sim_compute_robot_state-ego_mean0.057688616066769415
sim_compute_robot_state-ego_median0.057291646798451744
sim_compute_robot_state-ego_min0.05461807120336245
sim_compute_robot_state-npc0_max0.06255174294496194
sim_compute_robot_state-npc0_mean0.05990579068932739
sim_compute_robot_state-npc0_median0.059833868344624834
sim_compute_robot_state-npc0_min0.05652412323102559
sim_compute_robot_state-npc1_max0.059778693394783214
sim_compute_robot_state-npc1_mean0.0570277974721997
sim_compute_robot_state-npc1_median0.05684687693913778
sim_compute_robot_state-npc1_min0.053014849963253494
sim_compute_robot_state-npc2_max0.06119255224863688
sim_compute_robot_state-npc2_mean0.05749998628054664
sim_compute_robot_state-npc2_median0.056471229394276935
sim_compute_robot_state-npc2_min0.05511369770520354
sim_compute_robot_state-npc3_max0.05948309714977558
sim_compute_robot_state-npc3_mean0.05664134475324205
sim_compute_robot_state-npc3_median0.05696076949437459
sim_compute_robot_state-npc3_min0.05433112954440182
sim_compute_sim_state_max0.03385509588779547
sim_compute_sim_state_mean0.03200665395054948
sim_compute_sim_state_median0.031602209409077965
sim_compute_sim_state_min0.030620359394648303
sim_physics_max0.03400811476585192
sim_physics_mean0.029778323520218968
sim_physics_median0.02928803284962972
sim_physics_min0.02679783677401608
sim_render-ego_max0.053876989927047335
sim_render-ego_mean0.05184648781536316
sim_render-ego_median0.05182402133941651
sim_render-ego_min0.04952067218414725
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.020000000000024
survival_time_min3.649999999999995
185872864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:24:06
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
(hidden)
185672864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:25:02
Waited 1202 seconds [...]
Waited 1202 seconds for container to finish. Giving up. 
(hidden)
185632864AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:25:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
    uploaded = upload_files(wd, aws_config)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
    uploaded = upload(aws_config, toupload)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1172, in upload
    copy_to_cache(realfile, sha256hex)
  File "/project/src/duckietown_challenges_runner/runner_cache.py", line 39, in copy_to_cache
    msg = 'Copying %s to cache %s' % (friendly_size(os.stat(fn).st_size), have)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2864/step1-simulation-ip-172-31-25-98-9205-job18563/tmp/tmpjgq9nig1/attempts/udem1-1-0.attempt1/drawing.html'
(hidden)