AI Driving Olympics Home Challenges Submissions Jobs

Submission 2698

Submission2698
Competingyes
Challengeaido2-LFVI-sim-testing
UserKonstantin Chayka
Date submitted
Completecomplete
Resulterror
Jobsstep1-simulation: 22819
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
228192698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes-0:52:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
217602698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:51:27(hidden)
driven_lanedir_consec_median0.26897986430285936
survival_time_median4.94999999999999
deviation-center-line_median0.23201677970567
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.08837924581585509
agent_compute-ego_mean0.08469400771532992
agent_compute-ego_median0.08487581512303029
agent_compute-ego_min0.08124936103820801
deviation-center-line_max1.371040975353535
deviation-center-line_mean0.423534742397397
deviation-center-line_min0.11068809342680222
deviation-heading_max5.876058854462256
deviation-heading_mean2.1642598166353952
deviation-heading_median1.9871541583380812
deviation-heading_min0.5286957449450764
driven_any_max2.3488348518586797
driven_any_mean0.8805087537126413
driven_any_median0.7418597586883019
driven_any_min0.21153329129324583
driven_lanedir_consec_max1.4207119128920318
driven_lanedir_consec_mean0.5234610639073595
driven_lanedir_consec_min0.17982449484824214
driven_lanedir_max2.008761748306352
driven_lanedir_mean0.6382586817815119
driven_lanedir_median0.4222718400681744
driven_lanedir_min0.18145862701147888
in-drivable-lane_max3.500000000000024
in-drivable-lane_mean0.7866666666666698
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7570363112533882, "sim_physics": 0.22087184665272536, "survival_time": 5.14999999999999, "driven_lanedir": 0.46022022950792296, "sim_render-ego": 0.0693718414862179, "in-drivable-lane": 0.8499999999999981, "agent_compute-ego": 0.08487581512303029, "deviation-heading": 2.209376887678384, "set_robot_commands": 0.10163084511618012, "deviation-center-line": 0.4401214778553918, "driven_lanedir_consec": 0.21750833460823585, "sim_compute_sim_state": 0.040765917416915154, "sim_compute_performance-ego": 0.0695634883584328, "sim_compute_robot_state-ego": 0.07638844471533322, "sim_compute_robot_state-npc0": 0.07242552053581164, "sim_compute_robot_state-npc1": 0.07337870875608574, "sim_compute_robot_state-npc2": 0.07264501377216821, "sim_compute_robot_state-npc3": 0.07229175845396171}, "udem1-1-0": {"driven_any": 0.7418597586883019, "sim_physics": 0.24298986039980497, "survival_time": 4.94999999999999, "driven_lanedir": 0.6638207049179472, "sim_render-ego": 0.0693812370300293, "in-drivable-lane": 0, "agent_compute-ego": 0.08837924581585509, "deviation-heading": 1.8231211521989776, "set_robot_commands": 0.10892899831136069, "deviation-center-line": 0.2652548453371599, "driven_lanedir_consec": 0.6638207049179472, "sim_compute_sim_state": 0.043164246010057854, "sim_compute_performance-ego": 0.07683837052547571, "sim_compute_robot_state-ego": 0.08506342377325501, "sim_compute_robot_state-npc0": 0.07592344284057617, "sim_compute_robot_state-npc1": 0.07684641895872174, "sim_compute_robot_state-npc2": 0.07758492171162307, "sim_compute_robot_state-npc3": 0.07519517041215992}, "udem1-2-0": {"driven_any": 0.5489454593207354, "sim_physics": 0.22989628156026204, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4222718400681744, "sim_render-ego": 0.07313657442728679, "in-drivable-lane": 0, "agent_compute-ego": 0.08124936103820801, "deviation-heading": 1.9871541583380812, "set_robot_commands": 0.1010088062286377, "deviation-center-line": 0.23201677970567, "driven_lanedir_consec": 0.4222718400681744, "sim_compute_sim_state": 0.04255357106526693, "sim_compute_performance-ego": 0.0751569398244222, "sim_compute_robot_state-ego": 0.07765964190165202, "sim_compute_robot_state-npc0": 0.07268621126810709, "sim_compute_robot_state-npc1": 0.07286102612813314, "sim_compute_robot_state-npc2": 0.07293388048807779, "sim_compute_robot_state-npc3": 0.07448301633199056}, "udem1-3-0": {"driven_any": 0.2838533216575648, "sim_physics": 0.2291357744307745, "survival_time": 2.1000000000000005, "driven_lanedir": 0.26897986430285936, "sim_render-ego": 0.07094264598119826, "in-drivable-lane": 0, "agent_compute-ego": 0.08573784146990095, "deviation-heading": 0.5286957449450764, "set_robot_commands": 0.10045813946496872, "deviation-center-line": 0.18423762918535097, "driven_lanedir_consec": 0.26897986430285936, "sim_compute_sim_state": 0.041982866468883696, "sim_compute_performance-ego": 0.07537086804707845, "sim_compute_robot_state-ego": 0.07505058674585252, "sim_compute_robot_state-npc0": 0.07507428668794178, "sim_compute_robot_state-npc1": 0.07440251963479179, "sim_compute_robot_state-npc2": 0.07500941980452765, "sim_compute_robot_state-npc3": 0.07603514762151808}, "udem1-4-0": {"driven_any": 2.3488348518586797, "sim_physics": 0.21591806014378864, "survival_time": 14.950000000000076, "driven_lanedir": 1.6704492671217632, "sim_render-ego": 0.06807569503784179, "in-drivable-lane": 2.450000000000035, "agent_compute-ego": 0.08492926994959514, "deviation-heading": 5.354360722017447, "set_robot_commands": 0.10707393010457356, "deviation-center-line": 1.1181515913136686, "driven_lanedir_consec": 1.4013431034682162, "sim_compute_sim_state": 0.042137495676676434, "sim_compute_performance-ego": 0.07412284930547078, "sim_compute_robot_state-ego": 0.08159304777781169, "sim_compute_robot_state-npc0": 0.07539489189783732, "sim_compute_robot_state-npc1": 0.07645613193511963, "sim_compute_robot_state-npc2": 0.07487233877182006, "sim_compute_robot_state-npc3": 0.07699924310048421}, "udem1-5-0": {"driven_any": 0.7899734180552008, "sim_physics": 0.23092829840523857, "survival_time": 5.249999999999989, "driven_lanedir": 0.40323252659784337, "sim_render-ego": 0.06979344458807082, "in-drivable-lane": 1.4999999999999958, "agent_compute-ego": 0.08377737317766462, "deviation-heading": 2.446122014797115, "set_robot_commands": 0.10593542598542711, "deviation-center-line": 0.39583105134006213, "driven_lanedir_consec": 0.17982449484824214, "sim_compute_sim_state": 0.042332733245123, "sim_compute_performance-ego": 0.0776115303947812, "sim_compute_robot_state-ego": 0.08558951105390276, "sim_compute_robot_state-npc0": 0.07758951641264417, "sim_compute_robot_state-npc1": 0.07663764726547968, "sim_compute_robot_state-npc2": 0.07633648826962426, "sim_compute_robot_state-npc3": 0.077208677927653}, "udem1-6-0": {"driven_any": 2.212352952575204, "sim_physics": 0.22239002944729852, "survival_time": 14.100000000000064, "driven_lanedir": 2.008761748306352, "sim_render-ego": 0.06888540501290179, "in-drivable-lane": 0.350000000000005, "agent_compute-ego": 0.08322177795653647, "deviation-heading": 3.923670577605858, "set_robot_commands": 0.10357855989577924, "deviation-center-line": 1.371040975353535, "driven_lanedir_consec": 1.4207119128920318, "sim_compute_sim_state": 0.0413173479391328, "sim_compute_performance-ego": 0.07798862541820986, "sim_compute_robot_state-ego": 0.0827576015012484, "sim_compute_robot_state-npc0": 0.07404156187747388, "sim_compute_robot_state-npc1": 0.07493214827057318, "sim_compute_robot_state-npc2": 0.0754777505888161, "sim_compute_robot_state-npc3": 0.0744942528136233}, "udem1-7-0": {"driven_any": 0.8142156273465649, "sim_physics": 0.24162687637187816, "survival_time": 5.399999999999989, "driven_lanedir": 0.5581460103033158, "sim_render-ego": 0.06847099904660825, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.08449013365639581, "deviation-heading": 2.163156848151377, "set_robot_commands": 0.10337020953496295, "deviation-center-line": 0.28455938550047083, "driven_lanedir_consec": 0.48898425400301426, "sim_compute_sim_state": 0.04129987292819553, "sim_compute_performance-ego": 0.07394543179759273, "sim_compute_robot_state-ego": 0.08147421148088244, "sim_compute_robot_state-npc0": 0.07472284855665984, "sim_compute_robot_state-npc1": 0.07569702024813052, "sim_compute_robot_state-npc2": 0.07553400375224927, "sim_compute_robot_state-npc3": 0.0730848025392603}, "udem1-8-0": {"driven_any": 2.34867678671763, "sim_physics": 0.22158355633417764, "survival_time": 14.950000000000076, "driven_lanedir": 1.4539642714065528, "sim_render-ego": 0.07120156208674112, "in-drivable-lane": 3.500000000000024, "agent_compute-ego": 0.08530524174372354, "deviation-heading": 5.876058854462256, "set_robot_commands": 0.11229994376500448, "deviation-center-line": 1.0979912717877682, "driven_lanedir_consec": 1.200600259305142, "sim_compute_sim_state": 0.04247512976328532, "sim_compute_performance-ego": 0.0775346573193868, "sim_compute_robot_state-ego": 0.08401493549346924, "sim_compute_robot_state-npc0": 0.0761800201733907, "sim_compute_robot_state-npc1": 0.0761854902903239, "sim_compute_robot_state-npc2": 0.0751823099454244, "sim_compute_robot_state-npc3": 0.07614025990168254}, "udem1-9-0": {"driven_any": 0.2758088459994388, "sim_physics": 0.2679606647026248, "survival_time": 2.0500000000000007, "driven_lanedir": 0.230723652491037, "sim_render-ego": 0.06835794448852539, "in-drivable-lane": 0, "agent_compute-ego": 0.08654568253493891, "deviation-heading": 0.96572569722068, "set_robot_commands": 0.1041751140501441, "deviation-center-line": 0.11068809342680222, "driven_lanedir_consec": 0.230723652491037, "sim_compute_sim_state": 0.0441498116749089, "sim_compute_performance-ego": 0.07600057415845918, "sim_compute_robot_state-ego": 0.07966752168608875, "sim_compute_robot_state-npc0": 0.07611508485747547, "sim_compute_robot_state-npc1": 0.07606141741682844, "sim_compute_robot_state-npc2": 0.07455093686173601, "sim_compute_robot_state-npc3": 0.0752009531346763}, "udem1-10-0": {"driven_any": 0.4767200322346447, "sim_physics": 0.21215649084611377, "survival_time": 3.2999999999999963, "driven_lanedir": 0.45509084911246656, "sim_render-ego": 0.06671223495945786, "in-drivable-lane": 0, "agent_compute-ego": 0.08139849431586987, "deviation-heading": 0.887396890501525, "set_robot_commands": 0.09368039261211047, "deviation-center-line": 0.21747953892093536, "driven_lanedir_consec": 0.45509084911246656, "sim_compute_sim_state": 0.04094239075978597, "sim_compute_performance-ego": 0.07159614562988281, "sim_compute_robot_state-ego": 0.0767808249502471, "sim_compute_robot_state-npc0": 0.07435172615629254, "sim_compute_robot_state-npc1": 0.0745268590522535, "sim_compute_robot_state-npc2": 0.0711432695388794, "sim_compute_robot_state-npc3": 0.07117502978353789}, "udem1-11-0": {"driven_any": 0.26777129583468867, "sim_physics": 0.21459805965423584, "survival_time": 2.000000000000001, "driven_lanedir": 0.24678400532891143, "sim_render-ego": 0.06938487887382508, "in-drivable-lane": 0, "agent_compute-ego": 0.08503487110137939, "deviation-heading": 0.5563148484114218, "set_robot_commands": 0.10013986229896546, "deviation-center-line": 0.1842223096183376, "driven_lanedir_consec": 0.24678400532891143, "sim_compute_sim_state": 0.03907457590103149, "sim_compute_performance-ego": 0.07191388607025147, "sim_compute_robot_state-ego": 0.07767710089683533, "sim_compute_robot_state-npc0": 0.07293475270271302, "sim_compute_robot_state-npc1": 0.07576728463172913, "sim_compute_robot_state-npc2": 0.0765555202960968, "sim_compute_robot_state-npc3": 0.07259440422058105}, "udem1-12-0": {"driven_any": 0.3079463691881248, "sim_physics": 0.23513069682651097, "survival_time": 2.25, "driven_lanedir": 0.2513475189202812, "sim_render-ego": 0.07328800095452202, "in-drivable-lane": 0, "agent_compute-ego": 0.08662067519293891, "deviation-heading": 1.091603283997008, "set_robot_commands": 0.10610418319702147, "deviation-center-line": 0.1518869961210991, "driven_lanedir_consec": 0.2513475189202812, "sim_compute_sim_state": 0.043060392803616, "sim_compute_performance-ego": 0.0773660765753852, "sim_compute_robot_state-ego": 0.08334887822469075, "sim_compute_robot_state-npc0": 0.07242579989963108, "sim_compute_robot_state-npc1": 0.07241088549296061, "sim_compute_robot_state-npc2": 0.07749429278903537, "sim_compute_robot_state-npc3": 0.07401303715176052}, "udem1-13-0": {"driven_any": 0.21153329129324583, "sim_physics": 0.20977017373749704, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18145862701147888, "sim_render-ego": 0.07086227156899193, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08408432295828154, "deviation-heading": 0.5619553201193092, "set_robot_commands": 0.10184987386067708, "deviation-center-line": 0.14234269376170486, "driven_lanedir_consec": 0.18145862701147888, "sim_compute_sim_state": 0.04152715567386511, "sim_compute_performance-ego": 0.07557978774562027, "sim_compute_robot_state-ego": 0.08043526158188329, "sim_compute_robot_state-npc0": 0.0715901923902107, "sim_compute_robot_state-npc1": 0.07474837881146056, "sim_compute_robot_state-npc2": 0.07132599570534447, "sim_compute_robot_state-npc3": 0.07351627494349625}, "udem1-14-0": {"driven_any": 0.8221029836662049, "sim_physics": 0.23810701195253145, "survival_time": 5.449999999999989, "driven_lanedir": 0.29862911132577263, "sim_render-ego": 0.06814817988544429, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.08476000969563055, "deviation-heading": 2.0891842490864123, "set_robot_commands": 0.10672548714034054, "deviation-center-line": 0.1571964967329998, "driven_lanedir_consec": 0.2224665373323531, "sim_compute_sim_state": 0.042473659602873914, "sim_compute_performance-ego": 0.07391719861861763, "sim_compute_robot_state-ego": 0.08391152390646278, "sim_compute_robot_state-npc0": 0.07664742819759823, "sim_compute_robot_state-npc1": 0.07451763284315757, "sim_compute_robot_state-npc2": 0.0734477458743874, "sim_compute_robot_state-npc3": 0.07444918483769128}}
set_robot_commands_max0.11229994376500448
set_robot_commands_mean0.10379731810441026
set_robot_commands_median0.10357855989577924
set_robot_commands_min0.09368039261211047
sim_compute_performance-ego_max0.07798862541820986
sim_compute_performance-ego_mean0.07496709531927115
sim_compute_performance-ego_median0.07537086804707845
sim_compute_performance-ego_min0.0695634883584328
sim_compute_robot_state-ego_max0.08558951105390276
sim_compute_robot_state-ego_mean0.08076083437930769
sim_compute_robot_state-ego_median0.08147421148088244
sim_compute_robot_state-ego_min0.07505058674585252
sim_compute_robot_state-npc0_max0.07758951641264417
sim_compute_robot_state-npc0_mean0.07454021896362423
sim_compute_robot_state-npc0_median0.07472284855665984
sim_compute_robot_state-npc0_min0.0715901923902107
sim_compute_robot_state-npc1_max0.07684641895872174
sim_compute_robot_state-npc1_mean0.07502863798238328
sim_compute_robot_state-npc1_median0.07493214827057318
sim_compute_robot_state-npc1_min0.07241088549296061
sim_compute_robot_state-npc2_max0.07758492171162307
sim_compute_robot_state-npc2_mean0.07467292587798736
sim_compute_robot_state-npc2_median0.07500941980452765
sim_compute_robot_state-npc2_min0.0711432695388794
sim_compute_robot_state-npc3_max0.077208677927653
sim_compute_robot_state-npc3_mean0.07445874754493848
sim_compute_robot_state-npc3_median0.07448301633199056
sim_compute_robot_state-npc3_min0.07117502978353789
sim_compute_sim_state_max0.0441498116749089
sim_compute_sim_state_mean0.041950477795307875
sim_compute_sim_state_median0.042137495676676434
sim_compute_sim_state_min0.03907457590103149
sim_physics_max0.2679606647026248
sim_physics_mean0.22887091209769747
sim_physics_median0.2291357744307745
sim_physics_min0.20977017373749704
sim_render-ego_max0.07328800095452202
sim_render-ego_mean0.06973419436184417
sim_render-ego_median0.0693812370300293
sim_render-ego_min0.06671223495945786
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.82000000000001
survival_time_min1.6500000000000008
217272698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:56:44
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-40-253-32125-job21727/logs/challenges-runner/stdout.html'
(hidden)
217012698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:35:08
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-40-253-31940-job21701/logs/challenges-runner/stdout.html'
(hidden)
216992698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:45:10(hidden)
driven_lanedir_consec_median0.4893472427718472
survival_time_median7.199999999999982
deviation-center-line_median0.3408762468326392
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07362564404805501
agent_compute-ego_mean0.06733991888124716
agent_compute-ego_median0.06692502763536241
agent_compute-ego_min0.06212300520676833
deviation-center-line_max1.2961848098233058
deviation-center-line_mean0.5995129362477524
deviation-center-line_min0.08909316101846403
deviation-heading_max8.351580361636948
deviation-heading_mean3.0240864536295526
deviation-heading_median2.72333900833849
deviation-heading_min0.43069314187159025
driven_any_max2.349071505123117
driven_any_mean1.2421148322425262
driven_any_median1.1032915830984469
driven_any_min0.15533836782672705
driven_lanedir_consec_max2.2080967942981067
driven_lanedir_consec_mean0.8221620714730806
driven_lanedir_consec_min0.14003479098386817
driven_lanedir_max2.208623786259766
driven_lanedir_mean1.0319197710412198
driven_lanedir_median0.6357704724260033
driven_lanedir_min0.14003479098386817
in-drivable-lane_max2.300000000000013
in-drivable-lane_mean0.40666666666666734
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3321584285973005, "sim_physics": 0.10600027958552044, "survival_time": 14.950000000000076, "driven_lanedir": 2.1503351278298783, "sim_render-ego": 0.055828810532887775, "in-drivable-lane": 0, "agent_compute-ego": 0.06330905437469482, "deviation-heading": 4.86964591694968, "set_robot_commands": 0.07584365685780843, "deviation-center-line": 0.8807603992892908, "driven_lanedir_consec": 1.749339358866027, "sim_compute_sim_state": 0.033757911523183186, "sim_compute_performance-ego": 0.06056183497111003, "sim_compute_robot_state-ego": 0.05968418836593628, "sim_compute_robot_state-npc0": 0.06636214971542359, "sim_compute_robot_state-npc1": 0.060892449220021565, "sim_compute_robot_state-npc2": 0.060815452734629315, "sim_compute_robot_state-npc3": 0.06138550678888957}, "udem1-1-0": {"driven_any": 0.3079416950046758, "sim_physics": 0.10752337243821886, "survival_time": 2.25, "driven_lanedir": 0.2567980049143417, "sim_render-ego": 0.05942732493082682, "in-drivable-lane": 0, "agent_compute-ego": 0.06692502763536241, "deviation-heading": 1.1246870534418054, "set_robot_commands": 0.07756860521104601, "deviation-center-line": 0.14321336752481542, "driven_lanedir_consec": 0.2567980049143417, "sim_compute_sim_state": 0.032906421025594074, "sim_compute_performance-ego": 0.05903449588351779, "sim_compute_robot_state-ego": 0.059343110190497504, "sim_compute_robot_state-npc0": 0.06603817939758301, "sim_compute_robot_state-npc1": 0.06152096854315864, "sim_compute_robot_state-npc2": 0.061757961908976235, "sim_compute_robot_state-npc3": 0.062442408667670354}, "udem1-2-0": {"driven_any": 0.15533836782672705, "sim_physics": 0.1430624906833355, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14003479098386817, "sim_render-ego": 0.05892439071948712, "in-drivable-lane": 0, "agent_compute-ego": 0.06212300520676833, "deviation-heading": 0.43069314187159025, "set_robot_commands": 0.07750415802001953, "deviation-center-line": 0.12192796668478072, "driven_lanedir_consec": 0.14003479098386817, "sim_compute_sim_state": 0.03396212137662447, "sim_compute_performance-ego": 0.06039944978860708, "sim_compute_robot_state-ego": 0.059259313803452715, "sim_compute_robot_state-npc0": 0.068442335495582, "sim_compute_robot_state-npc1": 0.06510675870455228, "sim_compute_robot_state-npc2": 0.062354399607731745, "sim_compute_robot_state-npc3": 0.06503795660459079}, "udem1-3-0": {"driven_any": 0.26776251096357, "sim_physics": 0.11680573225021362, "survival_time": 2.000000000000001, "driven_lanedir": 0.24609124519093917, "sim_render-ego": 0.05733353495597839, "in-drivable-lane": 0, "agent_compute-ego": 0.0659275233745575, "deviation-heading": 0.5648809342771656, "set_robot_commands": 0.07977487444877625, "deviation-center-line": 0.1770577988065218, "driven_lanedir_consec": 0.24609124519093917, "sim_compute_sim_state": 0.034915375709533694, "sim_compute_performance-ego": 0.06054726839065552, "sim_compute_robot_state-ego": 0.060810768604278566, "sim_compute_robot_state-npc0": 0.06587273478507996, "sim_compute_robot_state-npc1": 0.0633370578289032, "sim_compute_robot_state-npc2": 0.062268197536468506, "sim_compute_robot_state-npc3": 0.06448929309844971}, "udem1-4-0": {"driven_any": 2.349071505123117, "sim_physics": 0.1108725142478943, "survival_time": 14.950000000000076, "driven_lanedir": 2.208623786259766, "sim_render-ego": 0.05706547260284424, "in-drivable-lane": 0, "agent_compute-ego": 0.06428122440973917, "deviation-heading": 4.413416733705978, "set_robot_commands": 0.07563874085744222, "deviation-center-line": 1.2120768995871796, "driven_lanedir_consec": 2.2080967942981067, "sim_compute_sim_state": 0.03413541316986084, "sim_compute_performance-ego": 0.06186140537261963, "sim_compute_robot_state-ego": 0.060738179683685306, "sim_compute_robot_state-npc0": 0.06618265708287557, "sim_compute_robot_state-npc1": 0.06195499579111735, "sim_compute_robot_state-npc2": 0.06102020899454753, "sim_compute_robot_state-npc3": 0.061697081724802656}, "udem1-5-0": {"driven_any": 2.348794694412871, "sim_physics": 0.11228066921234132, "survival_time": 14.950000000000076, "driven_lanedir": 1.928863995770194, "sim_render-ego": 0.058902831077575685, "in-drivable-lane": 1.000000000000001, "agent_compute-ego": 0.06576690117518107, "deviation-heading": 5.005954450605859, "set_robot_commands": 0.0755749241511027, "deviation-center-line": 1.2961848098233058, "driven_lanedir_consec": 0.81064048817923, "sim_compute_sim_state": 0.0350571076075236, "sim_compute_performance-ego": 0.061582987308502195, "sim_compute_robot_state-ego": 0.06220597346623739, "sim_compute_robot_state-npc0": 0.06803155342737834, "sim_compute_robot_state-npc1": 0.0656892720858256, "sim_compute_robot_state-npc2": 0.06284541924794515, "sim_compute_robot_state-npc3": 0.06299300988515218}, "udem1-6-0": {"driven_any": 1.4730968568511178, "sim_physics": 0.1182880389062982, "survival_time": 9.5, "driven_lanedir": 1.3746420645417643, "sim_render-ego": 0.06018626689910889, "in-drivable-lane": 0, "agent_compute-ego": 0.06545290068576211, "deviation-heading": 2.8337820109254475, "set_robot_commands": 0.07538708385668302, "deviation-center-line": 0.7543134050453174, "driven_lanedir_consec": 1.366152076247256, "sim_compute_sim_state": 0.03561626359036094, "sim_compute_performance-ego": 0.06163206853364643, "sim_compute_robot_state-ego": 0.06205877128400301, "sim_compute_robot_state-npc0": 0.06847102140125476, "sim_compute_robot_state-npc1": 0.0628404466729415, "sim_compute_robot_state-npc2": 0.06162550951305189, "sim_compute_robot_state-npc3": 0.0628394791954442}, "udem1-7-0": {"driven_any": 2.3489232489178034, "sim_physics": 0.11787768205006915, "survival_time": 14.950000000000076, "driven_lanedir": 1.986113203881544, "sim_render-ego": 0.06113999207814535, "in-drivable-lane": 0.5500000000000043, "agent_compute-ego": 0.06810131311416626, "deviation-heading": 5.701184359064706, "set_robot_commands": 0.07570236921310425, "deviation-center-line": 1.122015765746282, "driven_lanedir_consec": 1.227246652831152, "sim_compute_sim_state": 0.03527437051137288, "sim_compute_performance-ego": 0.06384396632512411, "sim_compute_robot_state-ego": 0.06224829514821371, "sim_compute_robot_state-npc0": 0.06977628787358602, "sim_compute_robot_state-npc1": 0.06576336622238159, "sim_compute_robot_state-npc2": 0.06451091210047404, "sim_compute_robot_state-npc3": 0.06397102991739909}, "udem1-8-0": {"driven_any": 2.3484893639963547, "sim_physics": 0.11433678150177, "survival_time": 14.950000000000076, "driven_lanedir": 1.422076094041115, "sim_render-ego": 0.06247303565343221, "in-drivable-lane": 2.300000000000013, "agent_compute-ego": 0.06894224007924397, "deviation-heading": 8.351580361636948, "set_robot_commands": 0.0776118000348409, "deviation-center-line": 1.209034661849355, "driven_lanedir_consec": 0.7102956564033764, "sim_compute_sim_state": 0.036198544502258304, "sim_compute_performance-ego": 0.06467981656392416, "sim_compute_robot_state-ego": 0.0633970053990682, "sim_compute_robot_state-npc0": 0.07281092961629232, "sim_compute_robot_state-npc1": 0.06642974535624187, "sim_compute_robot_state-npc2": 0.06592131773630779, "sim_compute_robot_state-npc3": 0.06516603310902913}, "udem1-9-0": {"driven_any": 0.24365777895547175, "sim_physics": 0.1246131690772804, "survival_time": 1.850000000000001, "driven_lanedir": 0.19804214239622153, "sim_render-ego": 0.06230485761487806, "in-drivable-lane": 0, "agent_compute-ego": 0.07108593631435085, "deviation-heading": 0.9085523368423573, "set_robot_commands": 0.07844682641931482, "deviation-center-line": 0.08909316101846403, "driven_lanedir_consec": 0.19804214239622153, "sim_compute_sim_state": 0.03700601732408678, "sim_compute_performance-ego": 0.06225383603895033, "sim_compute_robot_state-ego": 0.06241935652655524, "sim_compute_robot_state-npc0": 0.06741538563290157, "sim_compute_robot_state-npc1": 0.06256323891717035, "sim_compute_robot_state-npc2": 0.06554803332766972, "sim_compute_robot_state-npc3": 0.06384129781980773}, "udem1-10-0": {"driven_any": 2.348967931694552, "sim_physics": 0.10913063526153564, "survival_time": 14.950000000000076, "driven_lanedir": 2.067118918372553, "sim_render-ego": 0.06317690849304199, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06895245869954426, "deviation-heading": 6.119027866099151, "set_robot_commands": 0.07778310537338257, "deviation-center-line": 1.0788072335846577, "driven_lanedir_consec": 2.066059900003733, "sim_compute_sim_state": 0.03667987902959187, "sim_compute_performance-ego": 0.06468027671178182, "sim_compute_robot_state-ego": 0.06388675212860108, "sim_compute_robot_state-npc0": 0.07123951355616252, "sim_compute_robot_state-npc1": 0.06642776012420654, "sim_compute_robot_state-npc2": 0.06657277743021647, "sim_compute_robot_state-npc3": 0.06541037321090698}, "udem1-11-0": {"driven_any": 0.48475428343664057, "sim_physics": 0.10414888609701128, "survival_time": 3.349999999999996, "driven_lanedir": 0.4450598117470866, "sim_render-ego": 0.05746438254171343, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06370897079581644, "deviation-heading": 0.6328140712175128, "set_robot_commands": 0.07655661141694482, "deviation-center-line": 0.3408762468326392, "driven_lanedir_consec": 0.4450598117470866, "sim_compute_sim_state": 0.03281044604173347, "sim_compute_performance-ego": 0.06102513911119148, "sim_compute_robot_state-ego": 0.05895102202002682, "sim_compute_robot_state-npc0": 0.06518398469953395, "sim_compute_robot_state-npc1": 0.06218816984945269, "sim_compute_robot_state-npc2": 0.060437455106137405, "sim_compute_robot_state-npc3": 0.05936315166416453}, "udem1-12-0": {"driven_any": 0.30793922375251453, "sim_physics": 0.12694976594712998, "survival_time": 2.25, "driven_lanedir": 0.2386506321002644, "sim_render-ego": 0.06229017575581868, "in-drivable-lane": 0, "agent_compute-ego": 0.06948419676886665, "deviation-heading": 1.10737989543659, "set_robot_commands": 0.07509833971659342, "deviation-center-line": 0.14108589656009168, "driven_lanedir_consec": 0.2386506321002644, "sim_compute_sim_state": 0.033837212456597224, "sim_compute_performance-ego": 0.062011003494262695, "sim_compute_robot_state-ego": 0.06058603392706977, "sim_compute_robot_state-npc0": 0.06937443415323893, "sim_compute_robot_state-npc1": 0.06385552088419597, "sim_compute_robot_state-npc2": 0.062578550974528, "sim_compute_robot_state-npc3": 0.06312748061286079}, "udem1-13-0": {"driven_any": 0.21153501100673563, "sim_physics": 0.11275089870799672, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1805762751627582, "sim_render-ego": 0.06854529814286665, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07362564404805501, "deviation-heading": 0.5743586640300092, "set_robot_commands": 0.07533157955516469, "deviation-center-line": 0.14310934114788937, "driven_lanedir_consec": 0.1805762751627582, "sim_compute_sim_state": 0.03785940372582638, "sim_compute_performance-ego": 0.0629119078318278, "sim_compute_robot_state-ego": 0.06354770515904282, "sim_compute_robot_state-npc0": 0.07454805663137724, "sim_compute_robot_state-npc1": 0.06818927418101918, "sim_compute_robot_state-npc2": 0.06462020585031221, "sim_compute_robot_state-npc3": 0.06693931781884396}, "udem1-14-0": {"driven_any": 1.1032915830984469, "sim_physics": 0.1162260158194436, "survival_time": 7.199999999999982, "driven_lanedir": 0.6357704724260033, "sim_render-ego": 0.06491742034753163, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.0724123865365982, "deviation-heading": 2.72333900833849, "set_robot_commands": 0.07988596459229787, "deviation-center-line": 0.28313709021569394, "driven_lanedir_consec": 0.4893472427718472, "sim_compute_sim_state": 0.03787183264891306, "sim_compute_performance-ego": 0.06621743241945903, "sim_compute_robot_state-ego": 0.06361965669525994, "sim_compute_robot_state-npc0": 0.07386181089613172, "sim_compute_robot_state-npc1": 0.06976313061184353, "sim_compute_robot_state-npc2": 0.06903109285566542, "sim_compute_robot_state-npc3": 0.06749581462807125}}
set_robot_commands_max0.07988596459229787
set_robot_commands_mean0.07691390931496808
set_robot_commands_median0.07655661141694482
set_robot_commands_min0.07509833971659342
sim_compute_performance-ego_max0.06621743241945903
sim_compute_performance-ego_mean0.062216192583012
sim_compute_performance-ego_median0.06186140537261963
sim_compute_performance-ego_min0.05903449588351779
sim_compute_robot_state-ego_max0.06388675212860108
sim_compute_robot_state-ego_mean0.06151707549346189
sim_compute_robot_state-ego_median0.06205877128400301
sim_compute_robot_state-ego_min0.05895102202002682
sim_compute_robot_state-npc0_max0.07454805663137724
sim_compute_robot_state-npc0_mean0.0689074022909601
sim_compute_robot_state-npc0_median0.068442335495582
sim_compute_robot_state-npc0_min0.06518398469953395
sim_compute_robot_state-npc1_max0.06976313061184353
sim_compute_robot_state-npc1_mean0.06443481033286878
sim_compute_robot_state-npc1_median0.06385552088419597
sim_compute_robot_state-npc1_min0.060892449220021565
sim_compute_robot_state-npc2_max0.06903109285566542
sim_compute_robot_state-npc2_mean0.0634604996616441
sim_compute_robot_state-npc2_median0.062578550974528
sim_compute_robot_state-npc2_min0.060437455106137405
sim_compute_robot_state-npc3_max0.06749581462807125
sim_compute_robot_state-npc3_mean0.06374661564973885
sim_compute_robot_state-npc3_median0.06384129781980773
sim_compute_robot_state-npc3_min0.05936315166416453
sim_compute_sim_state_max0.03787183264891306
sim_compute_sim_state_mean0.03519255468287072
sim_compute_sim_state_median0.0350571076075236
sim_compute_sim_state_min0.03281044604173347
sim_physics_max0.1430624906833355
sim_physics_mean0.11605779545240394
sim_physics_median0.11433678150177
sim_physics_min0.10414888609701128
sim_render-ego_max0.06854529814286665
sim_render-ego_mean0.060665380156409134
sim_render-ego_median0.06018626689910889
sim_render-ego_min0.055828810532887775
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.070000000000029
survival_time_min1.3000000000000005
212142698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:47:36(hidden)
driven_lanedir_consec_median0.4878975189904211
survival_time_median3.699999999999995
deviation-center-line_median0.2792429083881596
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09743229618156532
agent_compute-ego_mean0.08101935793871223
agent_compute-ego_median0.08110137232418718
agent_compute-ego_min0.07168565710929975
deviation-center-line_max1.0747264973139123
deviation-center-line_mean0.4240960541601113
deviation-center-line_min0.12752675513551276
deviation-heading_max7.077108283739539
deviation-heading_mean2.169556983940427
deviation-heading_median1.1318560642289706
deviation-heading_min0.4652867569783595
driven_any_max2.3485836140930574
driven_any_mean0.8746172920577286
driven_any_median0.5410011518959885
driven_any_min0.22759295601088403
driven_lanedir_consec_max1.390931506293643
driven_lanedir_consec_mean0.5412214513570281
driven_lanedir_consec_min0.17808928546947866
driven_lanedir_max1.7259898823655082
driven_lanedir_mean0.6682432423273608
driven_lanedir_median0.4878975189904211
driven_lanedir_min0.19901987486126593
in-drivable-lane_max4.400000000000036
in-drivable-lane_mean0.5633333333333357
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6847010777030386, "sim_physics": 0.23024836246003497, "survival_time": 4.699999999999991, "driven_lanedir": 0.41342648224236744, "sim_render-ego": 0.0666137604003257, "in-drivable-lane": 0.6999999999999986, "agent_compute-ego": 0.08202886074147325, "deviation-heading": 2.2885615805360615, "set_robot_commands": 0.100890540062113, "deviation-center-line": 0.372561255360072, "driven_lanedir_consec": 0.17808928546947866, "sim_compute_sim_state": 0.04190477665434492, "sim_compute_performance-ego": 0.07214814551333164, "sim_compute_robot_state-ego": 0.07691531485699593, "sim_compute_robot_state-npc0": 0.07344888879897747, "sim_compute_robot_state-npc1": 0.07094835727772814, "sim_compute_robot_state-npc2": 0.07355243094423984, "sim_compute_robot_state-npc3": 0.07270910131170395}, "udem1-1-0": {"driven_any": 0.27580289776644235, "sim_physics": 0.2042763872844417, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2154561828969488, "sim_render-ego": 0.06925706165592845, "in-drivable-lane": 0, "agent_compute-ego": 0.0796183144173971, "deviation-heading": 1.1318560642289706, "set_robot_commands": 0.09611747323012934, "deviation-center-line": 0.12752675513551276, "driven_lanedir_consec": 0.2154561828969488, "sim_compute_sim_state": 0.041061552559457176, "sim_compute_performance-ego": 0.07018593462502085, "sim_compute_robot_state-ego": 0.07749863368708913, "sim_compute_robot_state-npc0": 0.07217432231437869, "sim_compute_robot_state-npc1": 0.06903917615006609, "sim_compute_robot_state-npc2": 0.06621800980916838, "sim_compute_robot_state-npc3": 0.06753489447803032}, "udem1-2-0": {"driven_any": 0.7338432667233183, "sim_physics": 0.23415969829170072, "survival_time": 4.899999999999991, "driven_lanedir": 0.7129389700771076, "sim_render-ego": 0.0674019176132825, "in-drivable-lane": 0, "agent_compute-ego": 0.08011274921650789, "deviation-heading": 0.9364955169078832, "set_robot_commands": 0.09838234891696852, "deviation-center-line": 0.5309100765129598, "driven_lanedir_consec": 0.7129389700771076, "sim_compute_sim_state": 0.040153544776293695, "sim_compute_performance-ego": 0.07513873674431626, "sim_compute_robot_state-ego": 0.08100939770134127, "sim_compute_robot_state-npc0": 0.07054049141552983, "sim_compute_robot_state-npc1": 0.07149874920747717, "sim_compute_robot_state-npc2": 0.06979912397812824, "sim_compute_robot_state-npc3": 0.07321757199812909}, "udem1-3-0": {"driven_any": 0.4124261213163431, "sim_physics": 0.22550912972154288, "survival_time": 2.8999999999999977, "driven_lanedir": 0.40303745482711584, "sim_render-ego": 0.06853432901974382, "in-drivable-lane": 0, "agent_compute-ego": 0.08110137232418718, "deviation-heading": 0.4652867569783595, "set_robot_commands": 0.09852720951211864, "deviation-center-line": 0.29709848498943614, "driven_lanedir_consec": 0.40303745482711584, "sim_compute_sim_state": 0.04112464395062677, "sim_compute_performance-ego": 0.07221249876351192, "sim_compute_robot_state-ego": 0.07914929554380219, "sim_compute_robot_state-npc0": 0.0698011168118181, "sim_compute_robot_state-npc1": 0.07125834349928231, "sim_compute_robot_state-npc2": 0.07002738837538094, "sim_compute_robot_state-npc3": 0.06973575312515785}, "udem1-4-0": {"driven_any": 2.0756965818282698, "sim_physics": 0.2089327983136447, "survival_time": 13.250000000000052, "driven_lanedir": 1.7259898823655082, "sim_render-ego": 0.06676686304920125, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08192581680585753, "deviation-heading": 5.716646459298363, "set_robot_commands": 0.10312750564431244, "deviation-center-line": 1.0747264973139123, "driven_lanedir_consec": 1.390931506293643, "sim_compute_sim_state": 0.04151124234469432, "sim_compute_performance-ego": 0.07530648753328144, "sim_compute_robot_state-ego": 0.08027364173025456, "sim_compute_robot_state-npc0": 0.07406804696568903, "sim_compute_robot_state-npc1": 0.07425896356690605, "sim_compute_robot_state-npc2": 0.07489817997194687, "sim_compute_robot_state-npc3": 0.07425760323146605}, "udem1-5-0": {"driven_any": 1.770242733833722, "sim_physics": 0.22024351174610823, "survival_time": 11.350000000000026, "driven_lanedir": 1.3374757899894223, "sim_render-ego": 0.06749584181193213, "in-drivable-lane": 0.9000000000000041, "agent_compute-ego": 0.09743229618156532, "deviation-heading": 4.797079472159773, "set_robot_commands": 0.1023301647623205, "deviation-center-line": 0.8785614475115767, "driven_lanedir_consec": 0.6067178855192505, "sim_compute_sim_state": 0.0410834009951957, "sim_compute_performance-ego": 0.0729565988028102, "sim_compute_robot_state-ego": 0.08183330481272962, "sim_compute_robot_state-npc0": 0.07312928422432113, "sim_compute_robot_state-npc1": 0.07340182921959965, "sim_compute_robot_state-npc2": 0.07307280212772051, "sim_compute_robot_state-npc3": 0.08229317329003422}, "udem1-6-0": {"driven_any": 1.4088213721703489, "sim_physics": 0.22226279646485717, "survival_time": 9.099999999999994, "driven_lanedir": 1.312748034545511, "sim_render-ego": 0.06436505553486584, "in-drivable-lane": 0, "agent_compute-ego": 0.07774692184322483, "deviation-heading": 2.66850745102207, "set_robot_commands": 0.09948031980912764, "deviation-center-line": 0.7353242781678043, "driven_lanedir_consec": 1.3077571851546488, "sim_compute_sim_state": 0.04125065724928301, "sim_compute_performance-ego": 0.0729157308955769, "sim_compute_robot_state-ego": 0.07777958649855393, "sim_compute_robot_state-npc0": 0.07260989749824608, "sim_compute_robot_state-npc1": 0.07217727781652095, "sim_compute_robot_state-npc2": 0.07370614874493944, "sim_compute_robot_state-npc3": 0.07130238774058582}, "udem1-7-0": {"driven_any": 0.5329699785722835, "sim_physics": 0.19352059494959165, "survival_time": 3.649999999999995, "driven_lanedir": 0.4715320639823852, "sim_render-ego": 0.06097483308347937, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.07168565710929975, "deviation-heading": 1.214087374854396, "set_robot_commands": 0.08447069337923233, "deviation-center-line": 0.15761774120379077, "driven_lanedir_consec": 0.4715320639823852, "sim_compute_sim_state": 0.035931211628326, "sim_compute_performance-ego": 0.06309993299719406, "sim_compute_robot_state-ego": 0.06560191389632551, "sim_compute_robot_state-npc0": 0.06363397755034983, "sim_compute_robot_state-npc1": 0.06194218217510067, "sim_compute_robot_state-npc2": 0.06194051977706282, "sim_compute_robot_state-npc3": 0.06570638042606719}, "udem1-8-0": {"driven_any": 2.3485836140930574, "sim_physics": 0.20504639943440756, "survival_time": 14.950000000000076, "driven_lanedir": 1.1813184935985008, "sim_render-ego": 0.06448144992192587, "in-drivable-lane": 4.400000000000036, "agent_compute-ego": 0.08861807743708293, "deviation-heading": 7.077108283739539, "set_robot_commands": 0.0982005794843038, "deviation-center-line": 0.932604892324344, "driven_lanedir_consec": 0.6430264862986768, "sim_compute_sim_state": 0.04185766776402791, "sim_compute_performance-ego": 0.06870257139205932, "sim_compute_robot_state-ego": 0.07789751132329305, "sim_compute_robot_state-npc0": 0.06985198179880778, "sim_compute_robot_state-npc1": 0.06937778393427531, "sim_compute_robot_state-npc2": 0.07045893828074137, "sim_compute_robot_state-npc3": 0.07128286918004353}, "udem1-9-0": {"driven_any": 0.5410011518959885, "sim_physics": 0.2622815016153696, "survival_time": 3.699999999999995, "driven_lanedir": 0.5165952647151523, "sim_render-ego": 0.06977129626918484, "in-drivable-lane": 0, "agent_compute-ego": 0.08299991891190812, "deviation-heading": 0.9622578067474432, "set_robot_commands": 0.1035729098964382, "deviation-center-line": 0.2792429083881596, "driven_lanedir_consec": 0.5165952647151523, "sim_compute_sim_state": 0.04271176054671004, "sim_compute_performance-ego": 0.07477204219715015, "sim_compute_robot_state-ego": 0.08483413747839026, "sim_compute_robot_state-npc0": 0.07357322203146445, "sim_compute_robot_state-npc1": 0.07385774560876794, "sim_compute_robot_state-npc2": 0.07576874784521155, "sim_compute_robot_state-npc3": 0.07212566040657661}, "udem1-10-0": {"driven_any": 0.5088702393806737, "sim_physics": 0.20343189239501952, "survival_time": 3.4999999999999956, "driven_lanedir": 0.49456213701977225, "sim_render-ego": 0.06432121481214251, "in-drivable-lane": 0, "agent_compute-ego": 0.07430761541639055, "deviation-heading": 0.8023629772469781, "set_robot_commands": 0.09523625033242362, "deviation-center-line": 0.24904394601214777, "driven_lanedir_consec": 0.49456213701977225, "sim_compute_sim_state": 0.04024928637913295, "sim_compute_performance-ego": 0.07034611361367361, "sim_compute_robot_state-ego": 0.07542426926749093, "sim_compute_robot_state-npc0": 0.06890828609466552, "sim_compute_robot_state-npc1": 0.06923983778272357, "sim_compute_robot_state-npc2": 0.07001099245888846, "sim_compute_robot_state-npc3": 0.07193687302725656}, "udem1-11-0": {"driven_any": 0.267764688010751, "sim_physics": 0.20121302008628844, "survival_time": 2.000000000000001, "driven_lanedir": 0.2494100006579436, "sim_render-ego": 0.06813135743141174, "in-drivable-lane": 0, "agent_compute-ego": 0.08233171105384826, "deviation-heading": 0.5036417042654908, "set_robot_commands": 0.09897263646125794, "deviation-center-line": 0.1767387359669518, "driven_lanedir_consec": 0.2494100006579436, "sim_compute_sim_state": 0.04000703692436218, "sim_compute_performance-ego": 0.07230669856071473, "sim_compute_robot_state-ego": 0.07589067816734314, "sim_compute_robot_state-npc0": 0.07130052447319031, "sim_compute_robot_state-npc1": 0.06831561923027038, "sim_compute_robot_state-npc2": 0.0687574326992035, "sim_compute_robot_state-npc3": 0.07369110584259034}, "udem1-12-0": {"driven_any": 0.5249380226866707, "sim_physics": 0.21770279275046456, "survival_time": 3.599999999999995, "driven_lanedir": 0.4878975189904211, "sim_render-ego": 0.06583684351709154, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07736744814448887, "deviation-heading": 1.0545271198156572, "set_robot_commands": 0.10518177019225226, "deviation-center-line": 0.2450545113059586, "driven_lanedir_consec": 0.4878975189904211, "sim_compute_sim_state": 0.039982000986735024, "sim_compute_performance-ego": 0.06964347428745693, "sim_compute_robot_state-ego": 0.0746235450108846, "sim_compute_robot_state-npc0": 0.0705259342988332, "sim_compute_robot_state-npc1": 0.07125816080305311, "sim_compute_robot_state-npc2": 0.0725919140709771, "sim_compute_robot_state-npc3": 0.07223990890714857}, "udem1-13-0": {"driven_any": 0.22759295601088403, "sim_physics": 0.19038219451904295, "survival_time": 1.7500000000000009, "driven_lanedir": 0.19901987486126593, "sim_render-ego": 0.06160041264125279, "in-drivable-lane": 0, "agent_compute-ego": 0.07652619225638253, "deviation-heading": 0.5573709084582352, "set_robot_commands": 0.0970571654183524, "deviation-center-line": 0.1369421233443076, "driven_lanedir_consec": 0.19901987486126593, "sim_compute_sim_state": 0.03473574774605887, "sim_compute_performance-ego": 0.06877775192260742, "sim_compute_robot_state-ego": 0.06772114889962333, "sim_compute_robot_state-npc0": 0.06461094447544642, "sim_compute_robot_state-npc1": 0.06406654630388532, "sim_compute_robot_state-npc2": 0.0643542902810233, "sim_compute_robot_state-npc3": 0.06178030286516462}, "udem1-14-0": {"driven_any": 0.8060046788741394, "sim_physics": 0.2129626407801548, "survival_time": 5.349999999999989, "driven_lanedir": 0.30224048414099025, "sim_render-ego": 0.0636466663574504, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.08148741722106934, "deviation-heading": 2.367565282847181, "set_robot_commands": 0.09795792303352711, "deviation-center-line": 0.16748715886473503, "driven_lanedir_consec": 0.24134995359161304, "sim_compute_sim_state": 0.037074933542269414, "sim_compute_performance-ego": 0.06841133242455598, "sim_compute_robot_state-ego": 0.07790180678679565, "sim_compute_robot_state-npc0": 0.06680453826333875, "sim_compute_robot_state-npc1": 0.06771811815065758, "sim_compute_robot_state-npc2": 0.08412372063253527, "sim_compute_robot_state-npc3": 0.06953450229680427}}
set_robot_commands_max0.10518177019225226
set_robot_commands_mean0.09863369934232516
set_robot_commands_median0.09852720951211864
set_robot_commands_min0.08447069337923233
sim_compute_performance-ego_max0.07530648753328144
sim_compute_performance-ego_mean0.07112827001821742
sim_compute_performance-ego_median0.07214814551333164
sim_compute_performance-ego_min0.06309993299719406
sim_compute_robot_state-ego_max0.08483413747839026
sim_compute_robot_state-ego_mean0.07695694571072755
sim_compute_robot_state-ego_median0.07777958649855393
sim_compute_robot_state-ego_min0.06560191389632551
sim_compute_robot_state-npc0_max0.07406804696568903
sim_compute_robot_state-npc0_mean0.07033209713433711
sim_compute_robot_state-npc0_median0.07054049141552983
sim_compute_robot_state-npc0_min0.06363397755034983
sim_compute_robot_state-npc1_max0.07425896356690605
sim_compute_robot_state-npc1_mean0.06989057938175429
sim_compute_robot_state-npc1_median0.07094835727772814
sim_compute_robot_state-npc1_min0.06194218217510067
sim_compute_robot_state-npc2_max0.08412372063253527
sim_compute_robot_state-npc2_mean0.07128537599981118
sim_compute_robot_state-npc2_median0.07045893828074137
sim_compute_robot_state-npc2_min0.06194051977706282
sim_compute_robot_state-npc3_max0.08229317329003422
sim_compute_robot_state-npc3_mean0.07128987254178394
sim_compute_robot_state-npc3_median0.07193687302725656
sim_compute_robot_state-npc3_min0.06178030286516462
sim_compute_sim_state_max0.04271176054671004
sim_compute_sim_state_mean0.0400426309365012
sim_compute_sim_state_median0.041061552559457176
sim_compute_sim_state_min0.03473574774605887
sim_physics_max0.2622815016153696
sim_physics_mean0.21547824805417795
sim_physics_median0.2129626407801548
sim_physics_min0.19038219451904295
sim_render-ego_max0.06977129626918484
sim_render-ego_mean0.06594659354128125
sim_render-ego_median0.0666137604003257
sim_render-ego_min0.06097483308347937
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.78333333333334
survival_time_min1.7500000000000009
211682698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:57:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-25-98-2348-job21168/logs/challenges-runner/stdout.log'
(hidden)
211252698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:47:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-38-104-5317-job21125/logs/challenges-runner/stdout.log'
(hidden)
210922698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:42:32
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-40-253-32059-job21092/logs/challenges-runner/stdout.log'
(hidden)
210752698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:09:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2698/step1-simulation-ip-172-31-25-98-2470-job21075/logs/challenges-runner/stdout.log'
(hidden)
204392698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:14:57(hidden)
driven_lanedir_consec_median0.6256422646922535
survival_time_median5.1999999999999895
deviation-center-line_median0.4152439116427565
in-drivable-lane_median0.6999999999999988


other stats
agent_compute-ego_max0.06486199182622573
agent_compute-ego_mean0.060857331719104936
agent_compute-ego_median0.06337015674664424
agent_compute-ego_min0.054447571436564125
deviation-center-line_max1.2117226619873809
deviation-center-line_mean0.5951944462890751
deviation-center-line_min0.14695551452821648
deviation-heading_max5.904587513264206
deviation-heading_mean3.186427371703546
deviation-heading_median1.9544271535980131
deviation-heading_min0.5392687809284806
driven_any_max2.3486701522086784
driven_any_mean1.2111405333805343
driven_any_median0.7818617197277746
driven_any_min0.21946224571431225
driven_lanedir_consec_max1.1267193226658485
driven_lanedir_consec_mean0.619020683109756
driven_lanedir_consec_min0.16518033977971425
driven_lanedir_max1.7695840990632146
driven_lanedir_mean0.880308696360623
driven_lanedir_median0.6256422646922535
driven_lanedir_min0.1946734360384572
in-drivable-lane_max1.8000000000000052
in-drivable-lane_mean0.9200000000000014
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6382205496671358, "sim_physics": 0.13159520788626236, "survival_time": 4.399999999999992, "driven_lanedir": 0.3800788961212376, "sim_render-ego": 0.05080122568390586, "in-drivable-lane": 0.6999999999999988, "agent_compute-ego": 0.06354548985307867, "deviation-heading": 1.9544271535980131, "set_robot_commands": 0.07384869456291199, "deviation-center-line": 0.4152439116427565, "driven_lanedir_consec": 0.16518033977971425, "sim_compute_sim_state": 0.030291695486415516, "sim_compute_performance-ego": 0.054790713570334694, "sim_compute_robot_state-ego": 0.056232433427463875, "sim_compute_robot_state-npc0": 0.05299366604198109, "sim_compute_robot_state-npc1": 0.05240990627895702, "sim_compute_robot_state-npc2": 0.05209215662696145, "sim_compute_robot_state-npc3": 0.05121555111624978}, "udem1-1-0": {"driven_any": 0.7818617197277746, "sim_physics": 0.13786576573665327, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6256422646922535, "sim_render-ego": 0.05037064506457402, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.06337015674664424, "deviation-heading": 1.6860490515633453, "set_robot_commands": 0.07491108545890221, "deviation-center-line": 0.197605428330531, "driven_lanedir_consec": 0.6256422646922535, "sim_compute_sim_state": 0.029599774342316847, "sim_compute_performance-ego": 0.05389525110904987, "sim_compute_robot_state-ego": 0.06239044666290283, "sim_compute_robot_state-npc0": 0.05605516754663908, "sim_compute_robot_state-npc1": 0.05526105715678288, "sim_compute_robot_state-npc2": 0.05304055947523851, "sim_compute_robot_state-npc3": 0.05459099549513597}, "udem1-2-0": {"driven_any": 2.3486701522086784, "sim_physics": 0.15331519842147828, "survival_time": 14.950000000000076, "driven_lanedir": 1.7695840990632146, "sim_render-ego": 0.04691533088684082, "in-drivable-lane": 1.6500000000000048, "agent_compute-ego": 0.05806144873301188, "deviation-heading": 5.904587513264206, "set_robot_commands": 0.06921576261520386, "deviation-center-line": 1.2117226619873809, "driven_lanedir_consec": 1.1267193226658485, "sim_compute_sim_state": 0.028273920218149826, "sim_compute_performance-ego": 0.0504502542813619, "sim_compute_robot_state-ego": 0.052591152985890705, "sim_compute_robot_state-npc0": 0.052167157332102455, "sim_compute_robot_state-npc1": 0.050245398680369056, "sim_compute_robot_state-npc2": 0.051393611431121825, "sim_compute_robot_state-npc3": 0.05088935136795044}, "udem1-3-0": {"driven_any": 0.21946224571431225, "sim_physics": 0.15162517743952134, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1946734360384572, "sim_render-ego": 0.053107661359450394, "in-drivable-lane": 0, "agent_compute-ego": 0.06486199182622573, "deviation-heading": 0.5392687809284806, "set_robot_commands": 0.07662615355323343, "deviation-center-line": 0.14695551452821648, "driven_lanedir_consec": 0.1946734360384572, "sim_compute_sim_state": 0.03053840468911564, "sim_compute_performance-ego": 0.05073894472683177, "sim_compute_robot_state-ego": 0.05531410609974581, "sim_compute_robot_state-npc0": 0.05701364489162669, "sim_compute_robot_state-npc1": 0.0545953161576215, "sim_compute_robot_state-npc2": 0.05548620925230138, "sim_compute_robot_state-npc3": 0.05295409875757554}, "udem1-4-0": {"driven_any": 2.0674879995847717, "sim_physics": 0.13699563976490137, "survival_time": 13.200000000000053, "driven_lanedir": 1.4315647858879526, "sim_render-ego": 0.044105737498312286, "in-drivable-lane": 1.8000000000000052, "agent_compute-ego": 0.054447571436564125, "deviation-heading": 5.847804359163685, "set_robot_commands": 0.06477762984507011, "deviation-center-line": 1.0044447149564912, "driven_lanedir_consec": 0.9828880523725072, "sim_compute_sim_state": 0.02690172285744638, "sim_compute_performance-ego": 0.047829325451995384, "sim_compute_robot_state-ego": 0.04988799673138243, "sim_compute_robot_state-npc0": 0.04935017769986933, "sim_compute_robot_state-npc1": 0.04795406352389942, "sim_compute_robot_state-npc2": 0.04834866523742676, "sim_compute_robot_state-npc3": 0.04857939752665433}}
set_robot_commands_max0.07662615355323343
set_robot_commands_mean0.07187586520706432
set_robot_commands_median0.07384869456291199
set_robot_commands_min0.06477762984507011
sim_compute_performance-ego_max0.054790713570334694
sim_compute_performance-ego_mean0.051540897827914725
sim_compute_performance-ego_median0.05073894472683177
sim_compute_performance-ego_min0.047829325451995384
sim_compute_robot_state-ego_max0.06239044666290283
sim_compute_robot_state-ego_mean0.05528322718147712
sim_compute_robot_state-ego_median0.05531410609974581
sim_compute_robot_state-ego_min0.04988799673138243
sim_compute_robot_state-npc0_max0.05701364489162669
sim_compute_robot_state-npc0_mean0.05351596270244373
sim_compute_robot_state-npc0_median0.05299366604198109
sim_compute_robot_state-npc0_min0.04935017769986933
sim_compute_robot_state-npc1_max0.05526105715678288
sim_compute_robot_state-npc1_mean0.05209314835952598
sim_compute_robot_state-npc1_median0.05240990627895702
sim_compute_robot_state-npc1_min0.04795406352389942
sim_compute_robot_state-npc2_max0.05548620925230138
sim_compute_robot_state-npc2_mean0.05207224040460998
sim_compute_robot_state-npc2_median0.05209215662696145
sim_compute_robot_state-npc2_min0.04834866523742676
sim_compute_robot_state-npc3_max0.05459099549513597
sim_compute_robot_state-npc3_mean0.05164587885271321
sim_compute_robot_state-npc3_median0.05121555111624978
sim_compute_robot_state-npc3_min0.04857939752665433
sim_compute_sim_state_max0.03053840468911564
sim_compute_sim_state_mean0.02912110351868884
sim_compute_sim_state_median0.029599774342316847
sim_compute_sim_state_min0.02690172285744638
sim_physics_max0.15331519842147828
sim_physics_mean0.14227939784976334
sim_physics_median0.13786576573665327
sim_physics_min0.13159520788626236
sim_render-ego_max0.053107661359450394
sim_render-ego_mean0.04906012009861667
sim_render-ego_median0.05037064506457402
sim_render-ego_min0.044105737498312286
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.890000000000024
survival_time_min1.7000000000000008
204242698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:01:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20424-537887', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
203992698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationtimeoutno-0:29:39
Timeout because eval [...]
Timeout because evaluator contacted us
(hidden)
203752698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:04:11
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20375-397196', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
200732698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:18:59(hidden)
driven_lanedir_consec_median0.5828104728384891
survival_time_median4.749999999999991
deviation-center-line_median0.3593970064543642
in-drivable-lane_median0.2499999999999991


other stats
agent_compute-ego_max0.08809613359385524
agent_compute-ego_mean0.08583374622062825
agent_compute-ego_median0.08622377259390694
agent_compute-ego_min0.08289570331573487
deviation-center-line_max0.7578748550826134
deviation-center-line_mean0.4252836859734712
deviation-center-line_min0.22938217902489977
deviation-heading_max5.132185448566655
deviation-heading_mean2.3478866467603523
deviation-heading_median1.9403769043008492
deviation-heading_min0.6508983147339267
driven_any_max2.3482389694868884
driven_any_mean0.981275740590954
driven_any_median0.709620412324745
driven_any_min0.45249693401610186
driven_lanedir_consec_max1.3948860516607122
driven_lanedir_consec_mean0.6517150026926075
driven_lanedir_consec_min0.17239946904909442
driven_lanedir_max1.3948860516607122
driven_lanedir_mean0.7006971328499124
driven_lanedir_median0.5828104728384891
driven_lanedir_min0.39586095762811646
in-drivable-lane_max4.100000000000048
in-drivable-lane_mean0.9400000000000092
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.6301880486356805, "sim_physics": 0.23142735437415113, "survival_time": 4.3499999999999925, "driven_lanedir": 0.39586095762811646, "sim_render-ego": 0.07044427696315722, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.08809613359385524, "deviation-heading": 2.5288019023517396, "set_robot_commands": 0.11169895358469296, "deviation-center-line": 0.4483494781443147, "driven_lanedir_consec": 0.17239946904909442, "sim_compute_sim_state": 0.04319884585238051, "sim_compute_performance-ego": 0.07951176029512252, "sim_compute_robot_state-ego": 0.08976989504934728, "sim_compute_robot_state-npc0": 0.07581757677012477, "sim_compute_robot_state-npc1": 0.07450804765197053, "sim_compute_robot_state-npc2": 0.07577869535862715, "sim_compute_robot_state-npc3": 0.07577998884792986}, "udem1-1-0": {"driven_any": 0.709620412324745, "sim_physics": 0.2003134476511102, "survival_time": 4.749999999999991, "driven_lanedir": 0.5828104728384891, "sim_render-ego": 0.07123530036524722, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.08653010318153782, "deviation-heading": 1.9403769043008492, "set_robot_commands": 0.10392483410082363, "deviation-center-line": 0.22938217902489977, "driven_lanedir_consec": 0.5828104728384891, "sim_compute_sim_state": 0.04097030288294742, "sim_compute_performance-ego": 0.07361961665906404, "sim_compute_robot_state-ego": 0.08252721334758557, "sim_compute_robot_state-npc0": 0.07586070612857217, "sim_compute_robot_state-npc1": 0.07651464311700118, "sim_compute_robot_state-npc2": 0.0740091323852539, "sim_compute_robot_state-npc3": 0.07495956671865363}, "udem1-2-0": {"driven_any": 0.7658343384913548, "sim_physics": 0.2190346928203807, "survival_time": 5.09999999999999, "driven_lanedir": 0.7100810577737608, "sim_render-ego": 0.06827557320688285, "in-drivable-lane": 0, "agent_compute-ego": 0.08542301841810637, "deviation-heading": 1.4871706638485918, "set_robot_commands": 0.1061180970248054, "deviation-center-line": 0.3593970064543642, "driven_lanedir_consec": 0.6886318955662583, "sim_compute_sim_state": 0.0429687079261331, "sim_compute_performance-ego": 0.0753389924180274, "sim_compute_robot_state-ego": 0.08360616599812228, "sim_compute_robot_state-npc0": 0.07413431008656819, "sim_compute_robot_state-npc1": 0.07508329316681507, "sim_compute_robot_state-npc2": 0.07480999535205317, "sim_compute_robot_state-npc3": 0.07342355625302184}, "udem1-3-0": {"driven_any": 0.45249693401610186, "sim_physics": 0.2041582909841386, "survival_time": 3.149999999999997, "driven_lanedir": 0.4198471243484836, "sim_render-ego": 0.06933394689408559, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.08622377259390694, "deviation-heading": 0.6508983147339267, "set_robot_commands": 0.10676115656655932, "deviation-center-line": 0.3314149111611641, "driven_lanedir_consec": 0.4198471243484836, "sim_compute_sim_state": 0.04244618945651584, "sim_compute_performance-ego": 0.07526687970237127, "sim_compute_robot_state-ego": 0.079268251146589, "sim_compute_robot_state-npc0": 0.07238727524167016, "sim_compute_robot_state-npc1": 0.07353041664002434, "sim_compute_robot_state-npc2": 0.0756001245407831, "sim_compute_robot_state-npc3": 0.07488474013313415}, "udem1-4-0": {"driven_any": 2.3482389694868884, "sim_physics": 0.2428627785046895, "survival_time": 14.950000000000076, "driven_lanedir": 1.3948860516607122, "sim_render-ego": 0.0683492120107015, "in-drivable-lane": 4.100000000000048, "agent_compute-ego": 0.08289570331573487, "deviation-heading": 5.132185448566655, "set_robot_commands": 0.10660394112269084, "deviation-center-line": 0.7578748550826134, "driven_lanedir_consec": 1.3948860516607122, "sim_compute_sim_state": 0.04462448596954346, "sim_compute_performance-ego": 0.07622801542282104, "sim_compute_robot_state-ego": 0.08451764424641928, "sim_compute_robot_state-npc0": 0.07487389246622721, "sim_compute_robot_state-npc1": 0.0739982295036316, "sim_compute_robot_state-npc2": 0.07560788869857787, "sim_compute_robot_state-npc3": 0.07462878545125326}}
set_robot_commands_max0.11169895358469296
set_robot_commands_mean0.10702139647991445
set_robot_commands_median0.10660394112269084
set_robot_commands_min0.10392483410082363
sim_compute_performance-ego_max0.07951176029512252
sim_compute_performance-ego_mean0.07599305289948124
sim_compute_performance-ego_median0.0753389924180274
sim_compute_performance-ego_min0.07361961665906404
sim_compute_robot_state-ego_max0.08976989504934728
sim_compute_robot_state-ego_mean0.08393783395761267
sim_compute_robot_state-ego_median0.08360616599812228
sim_compute_robot_state-ego_min0.079268251146589
sim_compute_robot_state-npc0_max0.07586070612857217
sim_compute_robot_state-npc0_mean0.0746147521386325
sim_compute_robot_state-npc0_median0.07487389246622721
sim_compute_robot_state-npc0_min0.07238727524167016
sim_compute_robot_state-npc1_max0.07651464311700118
sim_compute_robot_state-npc1_mean0.07472692601588855
sim_compute_robot_state-npc1_median0.07450804765197053
sim_compute_robot_state-npc1_min0.07353041664002434
sim_compute_robot_state-npc2_max0.07577869535862715
sim_compute_robot_state-npc2_mean0.07516116726705904
sim_compute_robot_state-npc2_median0.0756001245407831
sim_compute_robot_state-npc2_min0.0740091323852539
sim_compute_robot_state-npc3_max0.07577998884792986
sim_compute_robot_state-npc3_mean0.07473532748079854
sim_compute_robot_state-npc3_median0.07488474013313415
sim_compute_robot_state-npc3_min0.07342355625302184
sim_compute_sim_state_max0.04462448596954346
sim_compute_sim_state_mean0.04284170641750407
sim_compute_sim_state_median0.0429687079261331
sim_compute_sim_state_min0.04097030288294742
sim_physics_max0.2428627785046895
sim_physics_mean0.2195593128668941
sim_physics_median0.2190346928203807
sim_physics_min0.2003134476511102
sim_render-ego_max0.07123530036524722
sim_render-ego_mean0.06952766188801487
sim_render-ego_median0.06933394689408559
sim_render-ego_min0.06827557320688285
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.460000000000011
survival_time_min3.149999999999997
198282698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:12:24(hidden)
driven_lanedir_consec_median0.20196476931509144
survival_time_median3.899999999999994
deviation-center-line_median0.13579188546069812
in-drivable-lane_median0


other stats
agent_compute-ego_max0.08333459252216777
agent_compute-ego_mean0.0773472295014392
agent_compute-ego_median0.07784191156044984
agent_compute-ego_min0.06913622429496363
deviation-center-line_max1.0691710859923156
deviation-center-line_mean0.39727257508095526
deviation-center-line_min0.11576092170039644
deviation-heading_max5.110236499659155
deviation-heading_mean1.6043957737987882
deviation-heading_median0.7437819421590548
deviation-heading_min0.5214667938027785
driven_any_max1.91363348929201
driven_any_mean0.7414837320457457
driven_any_median0.5688685670295942
driven_any_min0.19401072418745632
driven_lanedir_consec_max1.427840252441052
driven_lanedir_consec_mean0.5372449500754062
driven_lanedir_consec_min0.1337089548344874
driven_lanedir_max1.6063273307065389
driven_lanedir_mean0.5729423657285035
driven_lanedir_median0.20196476931509144
driven_lanedir_min0.1337089548344874
in-drivable-lane_max2.499999999999994
in-drivable-lane_mean0.5499999999999995
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.5688685670295942, "sim_physics": 0.04942018252152663, "survival_time": 3.899999999999994, "driven_lanedir": 0.1337089548344874, "sim_render-ego": 0.06283321747413048, "in-drivable-lane": 2.499999999999994, "agent_compute-ego": 0.07784191156044984, "deviation-heading": 0.5540002661322662, "set_robot_commands": 0.09446548192928998, "deviation-center-line": 0.13579188546069812, "driven_lanedir_consec": 0.1337089548344874, "sim_compute_sim_state": 0.0369643828807733, "sim_compute_performance-ego": 0.06655854139572535, "sim_compute_robot_state-ego": 0.06877048504658234, "sim_compute_robot_state-npc0": 0.0651107873672094, "sim_compute_robot_state-npc1": 0.06436498348529522, "sim_compute_robot_state-npc2": 0.06682708018865341, "sim_compute_robot_state-npc3": 0.06524704969846286}, "udem1-1-0": {"driven_any": 0.2583002897390766, "sim_physics": 0.03642156877015766, "survival_time": 1.900000000000001, "driven_lanedir": 0.20196476931509144, "sim_render-ego": 0.05096481975756193, "in-drivable-lane": 0, "agent_compute-ego": 0.06913622429496363, "deviation-heading": 1.092493367240685, "set_robot_commands": 0.07743522995396664, "deviation-center-line": 0.11576092170039644, "driven_lanedir_consec": 0.20196476931509144, "sim_compute_sim_state": 0.03404708285080759, "sim_compute_performance-ego": 0.056932581098456135, "sim_compute_robot_state-ego": 0.056624343520716616, "sim_compute_robot_state-npc0": 0.06078180513883892, "sim_compute_robot_state-npc1": 0.06157575782976652, "sim_compute_robot_state-npc2": 0.05905569854535555, "sim_compute_robot_state-npc3": 0.05906123864023309}, "udem1-2-0": {"driven_any": 0.7726055899805913, "sim_physics": 0.05256632496328915, "survival_time": 5.09999999999999, "driven_lanedir": 0.7597232449019115, "sim_render-ego": 0.06495357962215648, "in-drivable-lane": 0, "agent_compute-ego": 0.08082847735461067, "deviation-heading": 0.7437819421590548, "set_robot_commands": 0.1009216402091232, "deviation-center-line": 0.5453392234425578, "driven_lanedir_consec": 0.7597232449019115, "sim_compute_sim_state": 0.04011364310395484, "sim_compute_performance-ego": 0.07026080056732777, "sim_compute_robot_state-ego": 0.07750139984430052, "sim_compute_robot_state-npc0": 0.07168397482703714, "sim_compute_robot_state-npc1": 0.07187369524263869, "sim_compute_robot_state-npc2": 0.06996678371055454, "sim_compute_robot_state-npc3": 0.06946990069221048}, "udem1-3-0": {"driven_any": 0.19401072418745632, "sim_physics": 0.04438775380452474, "survival_time": 1.5000000000000009, "driven_lanedir": 0.16298752888448864, "sim_render-ego": 0.06133123238881429, "in-drivable-lane": 0, "agent_compute-ego": 0.07559494177500407, "deviation-heading": 0.5214667938027785, "set_robot_commands": 0.09024439652760824, "deviation-center-line": 0.12029975880880844, "driven_lanedir_consec": 0.16298752888448864, "sim_compute_sim_state": 0.04432329336802165, "sim_compute_performance-ego": 0.06454325517018636, "sim_compute_robot_state-ego": 0.06748818556467692, "sim_compute_robot_state-npc0": 0.0671176830927531, "sim_compute_robot_state-npc1": 0.07252813180287679, "sim_compute_robot_state-npc2": 0.0667712926864624, "sim_compute_robot_state-npc3": 0.06648504734039307}, "udem1-4-0": {"driven_any": 1.91363348929201, "sim_physics": 0.0413861059751667, "survival_time": 12.200000000000038, "driven_lanedir": 1.6063273307065389, "sim_render-ego": 0.06395566365757926, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08333459252216777, "deviation-heading": 5.110236499659155, "set_robot_commands": 0.09165856193323604, "deviation-center-line": 1.0691710859923156, "driven_lanedir_consec": 1.427840252441052, "sim_compute_sim_state": 0.03738631283650633, "sim_compute_performance-ego": 0.06381339518750301, "sim_compute_robot_state-ego": 0.06728443454523556, "sim_compute_robot_state-npc0": 0.0654529294029611, "sim_compute_robot_state-npc1": 0.06448007607069171, "sim_compute_robot_state-npc2": 0.06382835888471759, "sim_compute_robot_state-npc3": 0.06340705273581333}}
set_robot_commands_max0.1009216402091232
set_robot_commands_mean0.09094506211064482
set_robot_commands_median0.09165856193323604
set_robot_commands_min0.07743522995396664
sim_compute_performance-ego_max0.07026080056732777
sim_compute_performance-ego_mean0.06442171468383971
sim_compute_performance-ego_median0.06454325517018636
sim_compute_performance-ego_min0.056932581098456135
sim_compute_robot_state-ego_max0.07750139984430052
sim_compute_robot_state-ego_mean0.06753376970430239
sim_compute_robot_state-ego_median0.06748818556467692
sim_compute_robot_state-ego_min0.056624343520716616
sim_compute_robot_state-npc0_max0.07168397482703714
sim_compute_robot_state-npc0_mean0.06602943596575994
sim_compute_robot_state-npc0_median0.0654529294029611
sim_compute_robot_state-npc0_min0.06078180513883892
sim_compute_robot_state-npc1_max0.07252813180287679
sim_compute_robot_state-npc1_mean0.06696452888625379
sim_compute_robot_state-npc1_median0.06448007607069171
sim_compute_robot_state-npc1_min0.06157575782976652
sim_compute_robot_state-npc2_max0.06996678371055454
sim_compute_robot_state-npc2_mean0.0652898428031487
sim_compute_robot_state-npc2_median0.0667712926864624
sim_compute_robot_state-npc2_min0.05905569854535555
sim_compute_robot_state-npc3_max0.06946990069221048
sim_compute_robot_state-npc3_mean0.06473405782142257
sim_compute_robot_state-npc3_median0.06524704969846286
sim_compute_robot_state-npc3_min0.05906123864023309
sim_compute_sim_state_max0.04432329336802165
sim_compute_sim_state_mean0.03856694300801274
sim_compute_sim_state_median0.03738631283650633
sim_compute_sim_state_min0.03404708285080759
sim_physics_max0.05256632496328915
sim_physics_mean0.044836387206932976
sim_physics_median0.04438775380452474
sim_physics_min0.03642156877015766
sim_render-ego_max0.06495357962215648
sim_render-ego_mean0.06080770258004849
sim_render-ego_median0.06283321747413048
sim_render-ego_min0.05096481975756193
simulation-passed1
survival_time_max12.200000000000038
survival_time_mean4.920000000000004
survival_time_min1.5000000000000009
197752698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:17:45(hidden)
driven_lanedir_consec_median0.502985479731668
survival_time_median3.699999999999995
deviation-center-line_median0.380356223432903
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.07923016945521037
agent_compute-ego_mean0.07595346827666537
agent_compute-ego_median0.07572676983964084
agent_compute-ego_min0.07224778226903968
deviation-center-line_max1.4995651005145367
deviation-center-line_mean0.6596874891601018
deviation-center-line_min0.08469223849141466
deviation-heading_max4.476753375315642
deviation-heading_mean1.891266901002552
deviation-heading_median0.9632364497437982
deviation-heading_min0.48270453305988537
driven_any_max2.3555900293468506
driven_any_mean1.1401604425744445
driven_any_median0.5476055759773761
driven_any_min0.20205401655657387
driven_lanedir_consec_max2.2844840179440737
driven_lanedir_consec_mean0.9305112401928404
driven_lanedir_consec_min0.15447964879458542
driven_lanedir_max2.290542122911593
driven_lanedir_mean1.0050004773605692
driven_lanedir_median0.502985479731668
driven_lanedir_min0.15447964879458542
in-drivable-lane_max1.6500000000000234
in-drivable-lane_mean0.4100000000000046
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.353347319925085, "sim_physics": 0.03929014603296916, "survival_time": 14.950000000000076, "driven_lanedir": 2.290542122911593, "sim_render-ego": 0.0604302438100179, "in-drivable-lane": 0, "agent_compute-ego": 0.0749340303738912, "deviation-heading": 2.9144101493377543, "set_robot_commands": 0.09080188512802125, "deviation-center-line": 1.4995651005145367, "driven_lanedir_consec": 2.2844840179440737, "sim_compute_sim_state": 0.039151933193206784, "sim_compute_performance-ego": 0.06698151429494222, "sim_compute_robot_state-ego": 0.06900471607844035, "sim_compute_robot_state-npc0": 0.06751068512598674, "sim_compute_robot_state-npc1": 0.06730270783106486, "sim_compute_robot_state-npc2": 0.0685167400042216, "sim_compute_robot_state-npc3": 0.06821264346440634}, "udem1-1-0": {"driven_any": 0.24220527106633655, "sim_physics": 0.0430962774488661, "survival_time": 1.800000000000001, "driven_lanedir": 0.15447964879458542, "sim_render-ego": 0.06735496388541327, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.07923016945521037, "deviation-heading": 0.9632364497437982, "set_robot_commands": 0.09915592273076376, "deviation-center-line": 0.08469223849141466, "driven_lanedir_consec": 0.15447964879458542, "sim_compute_sim_state": 0.03932902548048231, "sim_compute_performance-ego": 0.06975126928753322, "sim_compute_robot_state-ego": 0.07459205389022827, "sim_compute_robot_state-npc0": 0.0683899654282464, "sim_compute_robot_state-npc1": 0.07073797782262166, "sim_compute_robot_state-npc2": 0.07096195883221096, "sim_compute_robot_state-npc3": 0.07084947162204319}, "udem1-2-0": {"driven_any": 0.5476055759773761, "sim_physics": 0.04711711406707764, "survival_time": 3.699999999999995, "driven_lanedir": 0.502985479731668, "sim_render-ego": 0.06232912798185606, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.07224778226903968, "deviation-heading": 0.6192299975556795, "set_robot_commands": 0.0971530514794427, "deviation-center-line": 0.380356223432903, "driven_lanedir_consec": 0.502985479731668, "sim_compute_sim_state": 0.036323856663059546, "sim_compute_performance-ego": 0.06657183492505872, "sim_compute_robot_state-ego": 0.06679373496287577, "sim_compute_robot_state-npc0": 0.06275341639647612, "sim_compute_robot_state-npc1": 0.06496837654629269, "sim_compute_robot_state-npc2": 0.0650042488768294, "sim_compute_robot_state-npc3": 0.06653968063560692}, "udem1-3-0": {"driven_any": 0.20205401655657387, "sim_physics": 0.0463739518196352, "survival_time": 1.5500000000000007, "driven_lanedir": 0.17949643978172936, "sim_render-ego": 0.062302489434519125, "in-drivable-lane": 0, "agent_compute-ego": 0.07762858944554482, "deviation-heading": 0.48270453305988537, "set_robot_commands": 0.0926628343520626, "deviation-center-line": 0.1291530253786712, "driven_lanedir_consec": 0.17949643978172936, "sim_compute_sim_state": 0.03895981081070438, "sim_compute_performance-ego": 0.06235791790869928, "sim_compute_robot_state-ego": 0.07552542994099279, "sim_compute_robot_state-npc0": 0.06971606900615077, "sim_compute_robot_state-npc1": 0.06460663580125378, "sim_compute_robot_state-npc2": 0.06660278381839875, "sim_compute_robot_state-npc3": 0.07079016008684712}, "udem1-4-0": {"driven_any": 2.3555900293468506, "sim_physics": 0.04255266971014016, "survival_time": 14.950000000000076, "driven_lanedir": 1.8974986955832704, "sim_render-ego": 0.06175933394543702, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.07572676983964084, "deviation-heading": 4.476753375315642, "set_robot_commands": 0.0936104517716628, "deviation-center-line": 1.2046708579829837, "driven_lanedir_consec": 1.5311106147121465, "sim_compute_sim_state": 0.037292889528051265, "sim_compute_performance-ego": 0.06796233550361964, "sim_compute_robot_state-ego": 0.0700046314443633, "sim_compute_robot_state-npc0": 0.06717784269198925, "sim_compute_robot_state-npc1": 0.06500670503214451, "sim_compute_robot_state-npc2": 0.06635659036030339, "sim_compute_robot_state-npc3": 0.06700965393347086}}
set_robot_commands_max0.09915592273076376
set_robot_commands_mean0.0946768290923906
set_robot_commands_median0.0936104517716628
set_robot_commands_min0.09080188512802125
sim_compute_performance-ego_max0.06975126928753322
sim_compute_performance-ego_mean0.06672497438397061
sim_compute_performance-ego_median0.06698151429494222
sim_compute_performance-ego_min0.06235791790869928
sim_compute_robot_state-ego_max0.07552542994099279
sim_compute_robot_state-ego_mean0.0711841132633801
sim_compute_robot_state-ego_median0.0700046314443633
sim_compute_robot_state-ego_min0.06679373496287577
sim_compute_robot_state-npc0_max0.06971606900615077
sim_compute_robot_state-npc0_mean0.06710959572976985
sim_compute_robot_state-npc0_median0.06751068512598674
sim_compute_robot_state-npc0_min0.06275341639647612
sim_compute_robot_state-npc1_max0.07073797782262166
sim_compute_robot_state-npc1_mean0.0665244806066755
sim_compute_robot_state-npc1_median0.06500670503214451
sim_compute_robot_state-npc1_min0.06460663580125378
sim_compute_robot_state-npc2_max0.07096195883221096
sim_compute_robot_state-npc2_mean0.06748846437839282
sim_compute_robot_state-npc2_median0.06660278381839875
sim_compute_robot_state-npc2_min0.0650042488768294
sim_compute_robot_state-npc3_max0.07084947162204319
sim_compute_robot_state-npc3_mean0.06868032194847488
sim_compute_robot_state-npc3_median0.06821264346440634
sim_compute_robot_state-npc3_min0.06653968063560692
sim_compute_sim_state_max0.03932902548048231
sim_compute_sim_state_mean0.038211503135100855
sim_compute_sim_state_median0.03895981081070438
sim_compute_sim_state_min0.036323856663059546
sim_physics_max0.04711711406707764
sim_physics_mean0.04368603181573765
sim_physics_median0.0430962774488661
sim_physics_min0.03929014603296916
sim_render-ego_max0.06735496388541327
sim_render-ego_mean0.06283523181144868
sim_render-ego_median0.062302489434519125
sim_render-ego_min0.0604302438100179
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.390000000000031
survival_time_min1.5500000000000007
197672698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:06:52
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job19767-19735', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
194112698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:25:25(hidden)
driven_lanedir_consec_median0.48167024965285254
survival_time_median8.999999999999993
deviation-center-line_median0.5715166911228277
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.10192205111185708
agent_compute-ego_mean0.09834526995824412
agent_compute-ego_median0.1014428234869434
agent_compute-ego_min0.08760370810826619
deviation-center-line_max1.1604163553310656
deviation-center-line_mean0.5752455976023899
deviation-center-line_min0.07925615207888295
deviation-heading_max5.07765016395297
deviation-heading_mean2.609698248118849
deviation-heading_median3.136009607349262
deviation-heading_min0.7344741687723938
driven_any_max2.2510830346725648
driven_any_mean1.2107447426435267
driven_any_median1.3885456141412982
driven_any_min0.22615521940554537
driven_lanedir_consec_max1.3400662913985528
driven_lanedir_consec_mean0.6518899353349388
driven_lanedir_consec_min0.18069530534391953
driven_lanedir_max1.8947880860307853
driven_lanedir_mean0.9340802992933972
driven_lanedir_median1.0478834148972591
driven_lanedir_min0.18069530534391953
in-drivable-lane_max2.9000000000000377
in-drivable-lane_mean0.9000000000000083
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.3885456141412982, "sim_physics": 0.06014684306250678, "survival_time": 8.999999999999993, "driven_lanedir": 1.0478834148972591, "sim_render-ego": 0.07836300664477878, "in-drivable-lane": 0.8000000000000069, "agent_compute-ego": 0.10192205111185708, "deviation-heading": 3.363100899867679, "set_robot_commands": 0.1325057586034139, "deviation-center-line": 0.5715166911228277, "driven_lanedir_consec": 0.48167024965285254, "sim_compute_sim_state": 0.04810683064990574, "sim_compute_performance-ego": 0.08597342703077528, "sim_compute_robot_state-ego": 0.0940994660059611, "sim_compute_robot_state-npc0": 0.08740673065185547, "sim_compute_robot_state-npc1": 0.08557639651828342, "sim_compute_robot_state-npc2": 0.08547247780693902, "sim_compute_robot_state-npc3": 0.08704563776652018}, "udem1-1-0": {"driven_any": 0.22615521940554537, "sim_physics": 0.05526475345387178, "survival_time": 1.7000000000000008, "driven_lanedir": 0.18069530534391953, "sim_render-ego": 0.07802426113801844, "in-drivable-lane": 0, "agent_compute-ego": 0.09900640038882984, "deviation-heading": 0.73725640065194, "set_robot_commands": 0.13440842488232782, "deviation-center-line": 0.07925615207888295, "driven_lanedir_consec": 0.18069530534391953, "sim_compute_sim_state": 0.04670077912947711, "sim_compute_performance-ego": 0.08297869738410502, "sim_compute_robot_state-ego": 0.1027597188949585, "sim_compute_robot_state-npc0": 0.08538605185116038, "sim_compute_robot_state-npc1": 0.08083876441506778, "sim_compute_robot_state-npc2": 0.08232437161838307, "sim_compute_robot_state-npc3": 0.08420827809502096}, "udem1-2-0": {"driven_any": 2.2510830346725648, "sim_physics": 0.054101808921440495, "survival_time": 14.300000000000068, "driven_lanedir": 1.8947880860307853, "sim_render-ego": 0.07630899569371363, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10175136669532404, "deviation-heading": 5.07765016395297, "set_robot_commands": 0.12801593917233128, "deviation-center-line": 1.1604163553310656, "driven_lanedir_consec": 1.051783798281825, "sim_compute_sim_state": 0.04640866409648548, "sim_compute_performance-ego": 0.08350136646857628, "sim_compute_robot_state-ego": 0.0930166778030929, "sim_compute_robot_state-npc0": 0.08251694949356826, "sim_compute_robot_state-npc1": 0.08325990930303827, "sim_compute_robot_state-npc2": 0.08316792641486322, "sim_compute_robot_state-npc3": 0.08319064537128368}, "udem1-3-0": {"driven_any": 0.2422398150462939, "sim_physics": 0.0371150705549452, "survival_time": 1.800000000000001, "driven_lanedir": 0.2052340319975441, "sim_render-ego": 0.061589029100206166, "in-drivable-lane": 0, "agent_compute-ego": 0.08760370810826619, "deviation-heading": 0.7344741687723938, "set_robot_commands": 0.09239388836754692, "deviation-center-line": 0.09684690249679152, "driven_lanedir_consec": 0.2052340319975441, "sim_compute_sim_state": 0.036071558793385826, "sim_compute_performance-ego": 0.06298038694593641, "sim_compute_robot_state-ego": 0.06841690672768487, "sim_compute_robot_state-npc0": 0.06385752889845106, "sim_compute_robot_state-npc1": 0.06438816918267144, "sim_compute_robot_state-npc2": 0.06514157189263238, "sim_compute_robot_state-npc3": 0.06306534343295628}, "udem1-4-0": {"driven_any": 1.9457000299519311, "sim_physics": 0.05517466029813213, "survival_time": 12.40000000000004, "driven_lanedir": 1.3418006581974773, "sim_render-ego": 0.0772141275867339, "in-drivable-lane": 2.9000000000000377, "agent_compute-ego": 0.1014428234869434, "deviation-heading": 3.136009607349262, "set_robot_commands": 0.13473974889324558, "deviation-center-line": 0.968191886982382, "driven_lanedir_consec": 1.3400662913985528, "sim_compute_sim_state": 0.04763917000063004, "sim_compute_performance-ego": 0.08413035446597684, "sim_compute_robot_state-ego": 0.0915760003751324, "sim_compute_robot_state-npc0": 0.0864271963796308, "sim_compute_robot_state-npc1": 0.08523377872282459, "sim_compute_robot_state-npc2": 0.08585704526593609, "sim_compute_robot_state-npc3": 0.0855534028622412}}
set_robot_commands_max0.13473974889324558
set_robot_commands_mean0.12441275198377308
set_robot_commands_median0.1325057586034139
set_robot_commands_min0.09239388836754692
sim_compute_performance-ego_max0.08597342703077528
sim_compute_performance-ego_mean0.07991284645907397
sim_compute_performance-ego_median0.08350136646857628
sim_compute_performance-ego_min0.06298038694593641
sim_compute_robot_state-ego_max0.1027597188949585
sim_compute_robot_state-ego_mean0.08997375396136595
sim_compute_robot_state-ego_median0.0930166778030929
sim_compute_robot_state-ego_min0.06841690672768487
sim_compute_robot_state-npc0_max0.08740673065185547
sim_compute_robot_state-npc0_mean0.0811188914549332
sim_compute_robot_state-npc0_median0.08538605185116038
sim_compute_robot_state-npc0_min0.06385752889845106
sim_compute_robot_state-npc1_max0.08557639651828342
sim_compute_robot_state-npc1_mean0.0798594036283771
sim_compute_robot_state-npc1_median0.08325990930303827
sim_compute_robot_state-npc1_min0.06438816918267144
sim_compute_robot_state-npc2_max0.08585704526593609
sim_compute_robot_state-npc2_mean0.08039267859975074
sim_compute_robot_state-npc2_median0.08316792641486322
sim_compute_robot_state-npc2_min0.06514157189263238
sim_compute_robot_state-npc3_max0.08704563776652018
sim_compute_robot_state-npc3_mean0.08061266150560446
sim_compute_robot_state-npc3_median0.08420827809502096
sim_compute_robot_state-npc3_min0.06306534343295628
sim_compute_sim_state_max0.04810683064990574
sim_compute_sim_state_mean0.04498540053397684
sim_compute_sim_state_median0.04670077912947711
sim_compute_sim_state_min0.036071558793385826
sim_physics_max0.06014684306250678
sim_physics_mean0.05236062725817928
sim_physics_median0.05517466029813213
sim_physics_min0.0371150705549452
sim_render-ego_max0.07836300664477878
sim_render-ego_mean0.07429988403269018
sim_render-ego_median0.0772141275867339
sim_render-ego_min0.061589029100206166
simulation-passed1
survival_time_max14.300000000000068
survival_time_mean7.84000000000002
survival_time_min1.7000000000000008
186752698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:15:57(hidden)
driven_lanedir_consec_median0.4815980559959536
survival_time_median3.8499999999999943
deviation-center-line_median0.23830823642185708
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05885589122772217
agent_compute-ego_mean0.05777585908761111
agent_compute-ego_median0.05827163095059602
agent_compute-ego_min0.055669881502787275
deviation-center-line_max0.689319188683665
deviation-center-line_mean0.3516970841645242
deviation-center-line_min0.0617285052614659
deviation-heading_max3.202119035997067
deviation-heading_mean1.3439542601474346
deviation-heading_median0.9612719961366532
deviation-heading_min0.7086877401907453
driven_any_max1.8332233566719396
driven_any_mean0.8138227792512552
driven_any_median0.5717087289574438
driven_any_min0.19400436941882152
driven_lanedir_consec_max1.3671717862768835
driven_lanedir_consec_mean0.6821907831098335
driven_lanedir_consec_min0.14436378503763603
driven_lanedir_max1.373958070081588
driven_lanedir_mean0.6841767034940824
driven_lanedir_median0.4815980559959536
driven_lanedir_min0.14436378503763603
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean0.4800000000000056
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1475890170100271, "sim_physics": 0.02475247224171956, "survival_time": 7.499999999999981, "driven_lanedir": 1.1259563487477773, "sim_render-ego": 0.05102372964223226, "in-drivable-lane": 0, "agent_compute-ego": 0.055669881502787275, "deviation-heading": 1.1266639642126148, "set_robot_commands": 0.07072511831919352, "deviation-center-line": 0.6211574840637624, "driven_lanedir_consec": 1.1228130306312358, "sim_compute_sim_state": 0.02953587532043457, "sim_compute_performance-ego": 0.05202654679616292, "sim_compute_robot_state-ego": 0.05338795026143392, "sim_compute_robot_state-npc0": 0.05568091074625651, "sim_compute_robot_state-npc1": 0.05363128185272217, "sim_compute_robot_state-npc2": 0.05209211031595866, "sim_compute_robot_state-npc3": 0.05321952978769938}, "udem1-1-0": {"driven_any": 0.19400436941882152, "sim_physics": 0.026282612482706705, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14436378503763603, "sim_render-ego": 0.05355116526285807, "in-drivable-lane": 0, "agent_compute-ego": 0.05885589122772217, "deviation-heading": 0.7086877401907453, "set_robot_commands": 0.07084172566731771, "deviation-center-line": 0.0617285052614659, "driven_lanedir_consec": 0.14436378503763603, "sim_compute_sim_state": 0.031938783327738446, "sim_compute_performance-ego": 0.05100995699564616, "sim_compute_robot_state-ego": 0.05347025394439697, "sim_compute_robot_state-npc0": 0.05931520462036133, "sim_compute_robot_state-npc1": 0.05570268630981445, "sim_compute_robot_state-npc2": 0.055336197217305504, "sim_compute_robot_state-npc3": 0.05458062489827474}, "udem1-2-0": {"driven_any": 0.5717087289574438, "sim_physics": 0.030887430364435368, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4815980559959536, "sim_render-ego": 0.05551463597780698, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.05858634663866712, "deviation-heading": 0.9612719961366532, "set_robot_commands": 0.0730011494128735, "deviation-center-line": 0.23830823642185708, "driven_lanedir_consec": 0.4815980559959536, "sim_compute_sim_state": 0.03217026784822538, "sim_compute_performance-ego": 0.054524886143672, "sim_compute_robot_state-ego": 0.05655317182664747, "sim_compute_robot_state-npc0": 0.05896931809264344, "sim_compute_robot_state-npc1": 0.05667837254412762, "sim_compute_robot_state-npc2": 0.05693208706843388, "sim_compute_robot_state-npc3": 0.056973596671959024}, "udem1-3-0": {"driven_any": 0.32258842419804373, "sim_physics": 0.026266310525977093, "survival_time": 2.3, "driven_lanedir": 0.29500725760745783, "sim_render-ego": 0.052415293195973274, "in-drivable-lane": 0, "agent_compute-ego": 0.05827163095059602, "deviation-heading": 0.7210285642000925, "set_robot_commands": 0.07114940622578496, "deviation-center-line": 0.1479720063918705, "driven_lanedir_consec": 0.29500725760745783, "sim_compute_sim_state": 0.030197179835775623, "sim_compute_performance-ego": 0.055375897366067635, "sim_compute_robot_state-ego": 0.054640189461086106, "sim_compute_robot_state-npc0": 0.05782346103502357, "sim_compute_robot_state-npc1": 0.058458680691926376, "sim_compute_robot_state-npc2": 0.05521162696506666, "sim_compute_robot_state-npc3": 0.05534725603849992}, "udem1-4-0": {"driven_any": 1.8332233566719396, "sim_physics": 0.025689952393882293, "survival_time": 11.700000000000031, "driven_lanedir": 1.373958070081588, "sim_render-ego": 0.05512827481978979, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.05749554511828301, "deviation-heading": 3.202119035997067, "set_robot_commands": 0.07270824399768797, "deviation-center-line": 0.689319188683665, "driven_lanedir_consec": 1.3671717862768835, "sim_compute_sim_state": 0.03182157797691149, "sim_compute_performance-ego": 0.05519170536954179, "sim_compute_robot_state-ego": 0.055922386992690906, "sim_compute_robot_state-npc0": 0.05963351991441515, "sim_compute_robot_state-npc1": 0.05692523666936109, "sim_compute_robot_state-npc2": 0.056228812943156965, "sim_compute_robot_state-npc3": 0.05656739789196569}}
set_robot_commands_max0.0730011494128735
set_robot_commands_mean0.07168512872457153
set_robot_commands_median0.07114940622578496
set_robot_commands_min0.07072511831919352
sim_compute_performance-ego_max0.055375897366067635
sim_compute_performance-ego_mean0.053625798534218096
sim_compute_performance-ego_median0.054524886143672
sim_compute_performance-ego_min0.05100995699564616
sim_compute_robot_state-ego_max0.05655317182664747
sim_compute_robot_state-ego_mean0.05479479049725108
sim_compute_robot_state-ego_median0.054640189461086106
sim_compute_robot_state-ego_min0.05338795026143392
sim_compute_robot_state-npc0_max0.05963351991441515
sim_compute_robot_state-npc0_mean0.05828448288174
sim_compute_robot_state-npc0_median0.05896931809264344
sim_compute_robot_state-npc0_min0.05568091074625651
sim_compute_robot_state-npc1_max0.058458680691926376
sim_compute_robot_state-npc1_mean0.056279251613590354
sim_compute_robot_state-npc1_median0.05667837254412762
sim_compute_robot_state-npc1_min0.05363128185272217
sim_compute_robot_state-npc2_max0.05693208706843388
sim_compute_robot_state-npc2_mean0.05516016690198433
sim_compute_robot_state-npc2_median0.055336197217305504
sim_compute_robot_state-npc2_min0.05209211031595866
sim_compute_robot_state-npc3_max0.056973596671959024
sim_compute_robot_state-npc3_mean0.05533768105767976
sim_compute_robot_state-npc3_median0.05534725603849992
sim_compute_robot_state-npc3_min0.05321952978769938
sim_compute_sim_state_max0.03217026784822538
sim_compute_sim_state_mean0.0311327368618171
sim_compute_sim_state_median0.03182157797691149
sim_compute_sim_state_min0.02953587532043457
sim_physics_max0.030887430364435368
sim_physics_mean0.026775755601744205
sim_physics_median0.026266310525977093
sim_physics_min0.02475247224171956
sim_render-ego_max0.05551463597780698
sim_render-ego_mean0.053526619779732075
sim_render-ego_median0.05355116526285807
sim_render-ego_min0.05102372964223226
simulation-passed1
survival_time_max11.700000000000031
survival_time_mean5.370000000000002
survival_time_min1.5000000000000009
183382698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:21:11
Waited 1201 seconds [...]
Waited 1201 seconds for container to finish. Giving up. 
(hidden)
183372698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:13:20
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job18337-250357', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
(hidden)
180812698Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:12:45(hidden)
driven_lanedir_consec_median0.5835406751676895
survival_time_median2.3499999999999996
deviation-center-line_median0.1671427897682715
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.06855170270229907
agent_compute-ego_mean0.06414962726373687
agent_compute-ego_median0.0669260025024414
agent_compute-ego_min0.05194724630985864
deviation-center-line_max0.8620148178664631
deviation-center-line_mean0.24958116447159345
deviation-center-line_min0.011547782898684205
deviation-heading_max2.475189773524768
deviation-heading_mean0.9461433622979266
deviation-heading_median0.3052830039808098
deviation-heading_min0.22707741313120897
driven_any_max3.5487685385480994
driven_any_mean1.2906995242263997
driven_any_median0.7230792901911808
driven_any_min0.17614376848588753
driven_lanedir_consec_max2.1957022152086445
driven_lanedir_consec_mean0.7312009568576066
driven_lanedir_consec_min0.08620546151357478
driven_lanedir_max2.934516434724503
driven_lanedir_mean0.8959993088726803
driven_lanedir_median0.5835406751676895
driven_lanedir_min0.08620546151357478
in-drivable-lane_max3.049999999999991
in-drivable-lane_mean0.9199999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7230792901911808, "sim_physics": 0.03393585631187926, "survival_time": 2.3499999999999996, "driven_lanedir": 0.7130493303589853, "sim_render-ego": 0.05484787961269947, "in-drivable-lane": 0, "agent_compute-ego": 0.06855170270229907, "deviation-heading": 0.3052830039808098, "set_robot_commands": 0.08052472358054304, "deviation-center-line": 0.1874330423765657, "driven_lanedir_consec": 0.6278717897994752, "sim_compute_sim_state": 0.03266602881411289, "sim_compute_performance-ego": 0.05640641679155066, "sim_compute_robot_state-ego": 0.059768382539140415, "sim_compute_robot_state-npc0": 0.05873636489218854, "sim_compute_robot_state-npc1": 0.05744628196066998, "sim_compute_robot_state-npc2": 0.060177447948049995, "sim_compute_robot_state-npc3": 0.05832790313883031}, "udem1-1-0": {"driven_any": 0.2564288654535997, "sim_physics": 0.03016127645969391, "survival_time": 0.8000000000000002, "driven_lanedir": 0.162684642598649, "sim_render-ego": 0.05690599977970123, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.0660582035779953, "deviation-heading": 0.2810841704554417, "set_robot_commands": 0.07204006612300873, "deviation-center-line": 0.01976738944798275, "driven_lanedir_consec": 0.162684642598649, "sim_compute_sim_state": 0.0317508727312088, "sim_compute_performance-ego": 0.05798730254173279, "sim_compute_robot_state-ego": 0.051087647676467896, "sim_compute_robot_state-npc0": 0.05610203742980957, "sim_compute_robot_state-npc1": 0.05154009163379669, "sim_compute_robot_state-npc2": 0.05635590851306915, "sim_compute_robot_state-npc3": 0.05090799927711487}, "udem1-2-0": {"driven_any": 1.7490771584532314, "sim_physics": 0.03404636120577471, "survival_time": 5.449999999999989, "driven_lanedir": 0.5835406751676895, "sim_render-ego": 0.05758404075552564, "in-drivable-lane": 3.049999999999991, "agent_compute-ego": 0.0672649812260899, "deviation-heading": 1.4420824503974043, "set_robot_commands": 0.080326299054907, "deviation-center-line": 0.1671427897682715, "driven_lanedir_consec": 0.5835406751676895, "sim_compute_sim_state": 0.03367361672427676, "sim_compute_performance-ego": 0.05813286501333254, "sim_compute_robot_state-ego": 0.06131691014001129, "sim_compute_robot_state-npc0": 0.06059716819623195, "sim_compute_robot_state-npc1": 0.05877269079925817, "sim_compute_robot_state-npc2": 0.059430358606740966, "sim_compute_robot_state-npc3": 0.058572421380139274}, "udem1-3-0": {"driven_any": 0.17614376848588753, "sim_physics": 0.032040617682717064, "survival_time": 0.5499999999999999, "driven_lanedir": 0.08620546151357478, "sim_render-ego": 0.06002473831176758, "in-drivable-lane": 0.14999999999999997, "agent_compute-ego": 0.0669260025024414, "deviation-heading": 0.22707741313120897, "set_robot_commands": 0.0823221206665039, "deviation-center-line": 0.011547782898684205, "driven_lanedir_consec": 0.08620546151357478, "sim_compute_sim_state": 0.033440806648947975, "sim_compute_performance-ego": 0.05817270278930664, "sim_compute_robot_state-ego": 0.06047472086819736, "sim_compute_robot_state-npc0": 0.061665643345225944, "sim_compute_robot_state-npc1": 0.05399463393471458, "sim_compute_robot_state-npc2": 0.057669509540904655, "sim_compute_robot_state-npc3": 0.0520095174962824}, "udem1-4-0": {"driven_any": 3.5487685385480994, "sim_physics": 0.02526984711038581, "survival_time": 11.050000000000022, "driven_lanedir": 2.934516434724503, "sim_render-ego": 0.04574752285469711, "in-drivable-lane": 1.2500000000000002, "agent_compute-ego": 0.05194724630985864, "deviation-heading": 2.475189773524768, "set_robot_commands": 0.06357345106375163, "deviation-center-line": 0.8620148178664631, "driven_lanedir_consec": 2.1957022152086445, "sim_compute_sim_state": 0.026206308899961447, "sim_compute_performance-ego": 0.0464626437398643, "sim_compute_robot_state-ego": 0.04792257132033957, "sim_compute_robot_state-npc0": 0.04786956795739912, "sim_compute_robot_state-npc1": 0.04663758040553304, "sim_compute_robot_state-npc2": 0.04641970142519851, "sim_compute_robot_state-npc3": 0.046745776051309855}}
set_robot_commands_max0.0823221206665039
set_robot_commands_mean0.07575733209774285
set_robot_commands_median0.080326299054907
set_robot_commands_min0.06357345106375163
sim_compute_performance-ego_max0.05817270278930664
sim_compute_performance-ego_mean0.05543238617515739
sim_compute_performance-ego_median0.05798730254173279
sim_compute_performance-ego_min0.0464626437398643
sim_compute_robot_state-ego_max0.06131691014001129
sim_compute_robot_state-ego_mean0.056114046508831304
sim_compute_robot_state-ego_median0.059768382539140415
sim_compute_robot_state-ego_min0.04792257132033957
sim_compute_robot_state-npc0_max0.061665643345225944
sim_compute_robot_state-npc0_mean0.056994156364171024
sim_compute_robot_state-npc0_median0.05873636489218854
sim_compute_robot_state-npc0_min0.04786956795739912
sim_compute_robot_state-npc1_max0.05877269079925817
sim_compute_robot_state-npc1_mean0.05367825574679449
sim_compute_robot_state-npc1_median0.05399463393471458
sim_compute_robot_state-npc1_min0.04663758040553304
sim_compute_robot_state-npc2_max0.060177447948049995
sim_compute_robot_state-npc2_mean0.05601058520679266
sim_compute_robot_state-npc2_median0.057669509540904655
sim_compute_robot_state-npc2_min0.04641970142519851
sim_compute_robot_state-npc3_max0.058572421380139274
sim_compute_robot_state-npc3_mean0.05331272346873535
sim_compute_robot_state-npc3_median0.0520095174962824
sim_compute_robot_state-npc3_min0.046745776051309855
sim_compute_sim_state_max0.03367361672427676
sim_compute_sim_state_mean0.031547526763701574
sim_compute_sim_state_median0.03266602881411289
sim_compute_sim_state_min0.026206308899961447
sim_physics_max0.03404636120577471
sim_physics_mean0.03109079175409015
sim_physics_median0.032040617682717064
sim_physics_min0.02526984711038581
sim_render-ego_max0.06002473831176758
sim_render-ego_mean0.0550220362628782
sim_render-ego_median0.05690599977970123
sim_render-ego_min0.04574752285469711
simulation-passed1
survival_time_max11.050000000000022
survival_time_mean4.040000000000002
survival_time_min0.5499999999999999