AI Driving Olympics Home Challenges Submissions Jobs

Submission 2774

Submission2774
Competingyes
Challengeaido2-LFVI-sim-testing
UserBhairav Mehta
Date submitted
Complete
DetailsEvaluation is complete.
Sisters
Result💜
Jobsstep1-simulation: 22776
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
Blessing50
User priority

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
227762774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes-0:08:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
217622774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:45:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48214660419058974
survival_time_median4.749999999999991
deviation-center-line_median0.4165397000046918
in-drivable-lane_median0.34999999999999876


other stats
agent_compute-ego_max0.11778285696699813
agent_compute-ego_mean0.1001532780819602
agent_compute-ego_median0.09893473636272342
agent_compute-ego_min0.09368770519892376
deviation-center-line_max1.317964902067039
deviation-center-line_mean0.6402641724281001
deviation-center-line_min0.10523693665754068
deviation-heading_max7.610239705921293
deviation-heading_mean2.8824016001357804
deviation-heading_median2.251793896932395
deviation-heading_min0.5018008729480092
driven_any_max2.348836179858712
driven_any_mean1.203052710493549
driven_any_median0.7096642910216798
driven_any_min0.21956329083315024
driven_lanedir_consec_max1.513034097609825
driven_lanedir_consec_mean0.6681374606658456
driven_lanedir_consec_min0.193032006309092
driven_lanedir_max1.9333719180716569
driven_lanedir_mean0.9220587229373084
driven_lanedir_median0.6150622726640255
driven_lanedir_min0.193032006309092
in-drivable-lane_max2.300000000000014
in-drivable-lane_mean0.7900000000000047
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.3410363661504894, "sim_physics": 0.1124951434135437, "survival_time": 14.950000000000076, "driven_lanedir": 1.6714364575723155, "sim_render-ego": 0.06431891838709514, "in-drivable-lane": 1.8500000000000103, "agent_compute-ego": 0.09368770519892376, "deviation-heading": 6.299646452555532, "set_robot_commands": 0.07715376138687134, "deviation-center-line": 1.2420730797685848, "driven_lanedir_consec": 0.8116040876008214, "sim_compute_sim_state": 0.0380686092376709, "sim_compute_performance-ego": 0.06568524281183878, "sim_compute_robot_state-ego": 0.06282884041468302, "sim_compute_robot_state-npc0": 0.07392267227172851, "sim_compute_robot_state-npc1": 0.06843913873036703, "sim_compute_robot_state-npc2": 0.06780873696009318, "sim_compute_robot_state-npc3": 0.06735211213429769}, "udem1-1-0": {"driven_any": 2.3488066015656868, "sim_physics": 0.11548770825068155, "survival_time": 14.950000000000076, "driven_lanedir": 1.79021562660412, "sim_render-ego": 0.06694967269897462, "in-drivable-lane": 1.800000000000014, "agent_compute-ego": 0.09635555346806844, "deviation-heading": 5.4832127665231205, "set_robot_commands": 0.07691657940546671, "deviation-center-line": 1.24847282286057, "driven_lanedir_consec": 1.1008287181422975, "sim_compute_sim_state": 0.0385064442952474, "sim_compute_performance-ego": 0.06682938814163208, "sim_compute_robot_state-ego": 0.06352305809656779, "sim_compute_robot_state-npc0": 0.07474244276682536, "sim_compute_robot_state-npc1": 0.07014883041381836, "sim_compute_robot_state-npc2": 0.06936673800150553, "sim_compute_robot_state-npc3": 0.06931012789408365}, "udem1-2-0": {"driven_any": 0.6374004948914639, "sim_physics": 0.13017819094103436, "survival_time": 4.299999999999993, "driven_lanedir": 0.6150622726640255, "sim_render-ego": 0.06797546841377436, "in-drivable-lane": 0, "agent_compute-ego": 0.09893473636272342, "deviation-heading": 0.8930024331717549, "set_robot_commands": 0.0783760991207389, "deviation-center-line": 0.4763755367982289, "driven_lanedir_consec": 0.6150622726640255, "sim_compute_sim_state": 0.039990682934605795, "sim_compute_performance-ego": 0.06926028118577114, "sim_compute_robot_state-ego": 0.06395735574323078, "sim_compute_robot_state-npc0": 0.0752690309701964, "sim_compute_robot_state-npc1": 0.0682534422985343, "sim_compute_robot_state-npc2": 0.06940970587175946, "sim_compute_robot_state-npc3": 0.07076383468716643}, "udem1-3-0": {"driven_any": 0.32402843487189315, "sim_physics": 0.11769906003424462, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3121896547212488, "sim_render-ego": 0.06915495243478328, "in-drivable-lane": 0, "agent_compute-ego": 0.10491924082979244, "deviation-heading": 0.5018008729480092, "set_robot_commands": 0.07729115891963878, "deviation-center-line": 0.24276577342895117, "driven_lanedir_consec": 0.3121896547212488, "sim_compute_sim_state": 0.0397832342918883, "sim_compute_performance-ego": 0.06890025544673839, "sim_compute_robot_state-ego": 0.06127159646216859, "sim_compute_robot_state-npc0": 0.0768881452844498, "sim_compute_robot_state-npc1": 0.07030968970440804, "sim_compute_robot_state-npc2": 0.07096677130841195, "sim_compute_robot_state-npc3": 0.07233954490499293}, "udem1-4-0": {"driven_any": 2.3168551675130007, "sim_physics": 0.11765993732517048, "survival_time": 14.750000000000076, "driven_lanedir": 1.9333719180716569, "sim_render-ego": 0.06699231842816886, "in-drivable-lane": 1.050000000000015, "agent_compute-ego": 0.09672472759828728, "deviation-heading": 4.714782316147758, "set_robot_commands": 0.07697994668604964, "deviation-center-line": 1.317964902067039, "driven_lanedir_consec": 1.513034097609825, "sim_compute_sim_state": 0.0396348508737855, "sim_compute_performance-ego": 0.0681881322699078, "sim_compute_robot_state-ego": 0.06365800146329201, "sim_compute_robot_state-npc0": 0.07477909185118595, "sim_compute_robot_state-npc1": 0.06969707295046014, "sim_compute_robot_state-npc2": 0.06973703594531043, "sim_compute_robot_state-npc3": 0.06866806725324211}, "udem1-5-0": {"driven_any": 1.6096956279539163, "sim_physics": 0.13010124653433833, "survival_time": 10.350000000000012, "driven_lanedir": 1.4782593215259845, "sim_render-ego": 0.06588535723478897, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09557197750478552, "deviation-heading": 2.251793896932395, "set_robot_commands": 0.07692151253926005, "deviation-center-line": 1.1378862016687965, "driven_lanedir_consec": 1.2894019841274356, "sim_compute_sim_state": 0.03898103916702639, "sim_compute_performance-ego": 0.06727189718237246, "sim_compute_robot_state-ego": 0.06201053817491024, "sim_compute_robot_state-npc0": 0.07465788362106839, "sim_compute_robot_state-npc1": 0.06978696671085081, "sim_compute_robot_state-npc2": 0.07011077369468799, "sim_compute_robot_state-npc3": 0.06938701781673708}, "udem1-6-0": {"driven_any": 0.49278861329348583, "sim_physics": 0.13224780208924236, "survival_time": 3.399999999999996, "driven_lanedir": 0.48214660419058974, "sim_render-ego": 0.06726702872444601, "in-drivable-lane": 0, "agent_compute-ego": 0.09584457032820758, "deviation-heading": 0.5958984571541799, "set_robot_commands": 0.0771951955907485, "deviation-center-line": 0.3236926548028083, "driven_lanedir_consec": 0.48214660419058974, "sim_compute_sim_state": 0.03751016714993645, "sim_compute_performance-ego": 0.06803904561435475, "sim_compute_robot_state-ego": 0.06350591954062967, "sim_compute_robot_state-npc0": 0.0742464731721317, "sim_compute_robot_state-npc1": 0.06841226535684922, "sim_compute_robot_state-npc2": 0.06915412580265719, "sim_compute_robot_state-npc3": 0.06804140175090116}, "udem1-7-0": {"driven_any": 2.348836179858712, "sim_physics": 0.12163315852483114, "survival_time": 14.950000000000076, "driven_lanedir": 1.6577102612736918, "sim_render-ego": 0.0672424602508545, "in-drivable-lane": 2.000000000000024, "agent_compute-ego": 0.10045309940973918, "deviation-heading": 6.194192808164675, "set_robot_commands": 0.07765183448791504, "deviation-center-line": 0.7811296372589338, "driven_lanedir_consec": 1.0749507675284526, "sim_compute_sim_state": 0.03918168067932129, "sim_compute_performance-ego": 0.0675723679860433, "sim_compute_robot_state-ego": 0.0645080288251241, "sim_compute_robot_state-npc0": 0.07567518234252929, "sim_compute_robot_state-npc1": 0.06986900726954143, "sim_compute_robot_state-npc2": 0.06928850809733073, "sim_compute_robot_state-npc3": 0.06889655033747355}, "udem1-8-0": {"driven_any": 2.348474320220354, "sim_physics": 0.11535480658213296, "survival_time": 14.950000000000076, "driven_lanedir": 1.4941146250005812, "sim_render-ego": 0.06538669427235921, "in-drivable-lane": 2.300000000000014, "agent_compute-ego": 0.09686134258906048, "deviation-heading": 7.610239705921293, "set_robot_commands": 0.07657598654429118, "deviation-center-line": 1.253159729887583, "driven_lanedir_consec": 0.7615376533149805, "sim_compute_sim_state": 0.037763574918111165, "sim_compute_performance-ego": 0.0653185256322225, "sim_compute_robot_state-ego": 0.06366637865702311, "sim_compute_robot_state-npc0": 0.07472034374872843, "sim_compute_robot_state-npc1": 0.0685817551612854, "sim_compute_robot_state-npc2": 0.06760847568511963, "sim_compute_robot_state-npc3": 0.06735612233479818}, "udem1-9-0": {"driven_any": 0.2436633002955186, "sim_physics": 0.13553377099939296, "survival_time": 1.850000000000001, "driven_lanedir": 0.20200607766569312, "sim_render-ego": 0.06932689048148491, "in-drivable-lane": 0, "agent_compute-ego": 0.11778285696699813, "deviation-heading": 0.9295139773375768, "set_robot_commands": 0.07675364855173472, "deviation-center-line": 0.10523693665754068, "driven_lanedir_consec": 0.20200607766569312, "sim_compute_sim_state": 0.0372641473203092, "sim_compute_performance-ego": 0.06739410838565311, "sim_compute_robot_state-ego": 0.06599820626748575, "sim_compute_robot_state-npc0": 0.0746216580674455, "sim_compute_robot_state-npc1": 0.06722432858235128, "sim_compute_robot_state-npc2": 0.0652168828087884, "sim_compute_robot_state-npc3": 0.06527273719375198}, "udem1-10-0": {"driven_any": 0.5570698498647547, "sim_physics": 0.11253374814987184, "survival_time": 3.7999999999999945, "driven_lanedir": 0.463904314799662, "sim_render-ego": 0.06364719177547254, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.09626452860079314, "deviation-heading": 1.0884367518510212, "set_robot_commands": 0.07606354198957745, "deviation-center-line": 0.20309548800144023, "driven_lanedir_consec": 0.463904314799662, "sim_compute_sim_state": 0.03860295132586831, "sim_compute_performance-ego": 0.0644403288238927, "sim_compute_robot_state-ego": 0.06278985425045616, "sim_compute_robot_state-npc0": 0.0738814818231683, "sim_compute_robot_state-npc1": 0.06779210191023977, "sim_compute_robot_state-npc2": 0.0672211113728975, "sim_compute_robot_state-npc3": 0.0668225884437561}, "udem1-11-0": {"driven_any": 0.49278999911906174, "sim_physics": 0.1102967612883624, "survival_time": 3.399999999999996, "driven_lanedir": 0.4455847848845207, "sim_render-ego": 0.06544213084613576, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.10090946800568525, "deviation-heading": 0.6191208468971858, "set_robot_commands": 0.07735620176090914, "deviation-center-line": 0.32594028718606854, "driven_lanedir_consec": 0.4455847848845207, "sim_compute_sim_state": 0.038372513125924504, "sim_compute_performance-ego": 0.06697597924400778, "sim_compute_robot_state-ego": 0.06415890244876638, "sim_compute_robot_state-npc0": 0.0744650679476121, "sim_compute_robot_state-npc1": 0.06812127548105576, "sim_compute_robot_state-npc2": 0.06886818479089175, "sim_compute_robot_state-npc3": 0.0696682193700005}, "udem1-12-0": {"driven_any": 1.055118119950063, "sim_physics": 0.11946729646212811, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6327617778746157, "sim_render-ego": 0.06590192041535309, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10483826070592024, "deviation-heading": 3.0726767410149014, "set_robot_commands": 0.07585872429004614, "deviation-center-line": 0.4165397000046918, "driven_lanedir_consec": 0.4701274378065379, "sim_compute_sim_state": 0.03766964138418004, "sim_compute_performance-ego": 0.06489312130471935, "sim_compute_robot_state-ego": 0.06308420326398767, "sim_compute_robot_state-npc0": 0.07362631611202074, "sim_compute_robot_state-npc1": 0.06784329552581345, "sim_compute_robot_state-npc2": 0.06736381848653157, "sim_compute_robot_state-npc3": 0.06821318121923917}, "udem1-13-0": {"driven_any": 0.21956329083315024, "sim_physics": 0.11851044262156768, "survival_time": 1.7000000000000008, "driven_lanedir": 0.193032006309092, "sim_render-ego": 0.06651801221510943, "in-drivable-lane": 0, "agent_compute-ego": 0.10232444370494168, "deviation-heading": 0.5904923420271754, "set_robot_commands": 0.07662600629469928, "deviation-center-line": 0.1470462045883447, "driven_lanedir_consec": 0.193032006309092, "sim_compute_sim_state": 0.03985933696522432, "sim_compute_performance-ego": 0.06593026133144603, "sim_compute_robot_state-ego": 0.06279865433188046, "sim_compute_robot_state-npc0": 0.07488789979149313, "sim_compute_robot_state-npc1": 0.06977927684783936, "sim_compute_robot_state-npc2": 0.07202762715956744, "sim_compute_robot_state-npc3": 0.07064646833083209}, "udem1-14-0": {"driven_any": 0.7096642910216798, "sim_physics": 0.12120836910448576, "survival_time": 4.749999999999991, "driven_lanedir": 0.4590851409018279, "sim_render-ego": 0.06801201167859529, "in-drivable-lane": 0.6500000000000001, "agent_compute-ego": 0.10082665995547646, "deviation-heading": 2.391213633390133, "set_robot_commands": 0.07689546785856548, "deviation-center-line": 0.38258363144192176, "driven_lanedir_consec": 0.286651448622503, "sim_compute_sim_state": 0.03961772165800396, "sim_compute_performance-ego": 0.06760007205762361, "sim_compute_robot_state-ego": 0.06366935780173853, "sim_compute_robot_state-npc0": 0.07422436413012053, "sim_compute_robot_state-npc1": 0.06934435493067691, "sim_compute_robot_state-npc2": 0.06900989883824399, "sim_compute_robot_state-npc3": 0.06976636083502519}}
set_robot_commands_max0.0783760991207389
set_robot_commands_mean0.07697437769510082
set_robot_commands_median0.07692151253926005
set_robot_commands_min0.07585872429004614
sim_compute_performance-ego_max0.06926028118577114
sim_compute_performance-ego_mean0.06695326716121491
sim_compute_performance-ego_median0.06727189718237246
sim_compute_performance-ego_min0.0644403288238927
sim_compute_robot_state-ego_max0.06599820626748575
sim_compute_robot_state-ego_mean0.06342859304946295
sim_compute_robot_state-ego_median0.06352305809656779
sim_compute_robot_state-ego_min0.06127159646216859
sim_compute_robot_state-npc0_max0.0768881452844498
sim_compute_robot_state-npc0_mean0.07470720359338028
sim_compute_robot_state-npc0_median0.07465788362106839
sim_compute_robot_state-npc0_min0.07362631611202074
sim_compute_robot_state-npc1_max0.07030968970440804
sim_compute_robot_state-npc1_mean0.06890685345827276
sim_compute_robot_state-npc1_median0.0685817551612854
sim_compute_robot_state-npc1_min0.06722432858235128
sim_compute_robot_state-npc2_max0.07202762715956744
sim_compute_robot_state-npc2_mean0.06887722632158645
sim_compute_robot_state-npc2_median0.06915412580265719
sim_compute_robot_state-npc2_min0.0652168828087884
sim_compute_robot_state-npc3_max0.07233954490499293
sim_compute_robot_state-npc3_mean0.06883362230041984
sim_compute_robot_state-npc3_median0.06889655033747355
sim_compute_robot_state-npc3_min0.06527273719375198
sim_compute_sim_state_max0.039990682934605795
sim_compute_sim_state_mean0.03872043968847357
sim_compute_sim_state_median0.03860295132586831
sim_compute_sim_state_min0.0372641473203092
sim_physics_max0.13553377099939296
sim_physics_mean0.12069382948806856
sim_physics_median0.11851044262156768
sim_physics_min0.1102967612883624
sim_render-ego_max0.06932689048148491
sim_render-ego_mean0.06666806855049306
sim_render-ego_median0.06694967269897462
sim_render-ego_min0.06364719177547254
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.8233333333333555
survival_time_min1.7000000000000008
217422774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:27:01
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-40-253-32059-job21742/logs/challenges-runner/stdout.html'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
216752774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationtimeoutno-1:05:19
I can see how the jo [...]
I can see how the job 21675 is timeout because passed 3919 seconds and the timeout is 3600.0.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
212842774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:53:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4861461122154971
survival_time_median3.7999999999999945
deviation-center-line_median0.3338167565194672
in-drivable-lane_median0.14999999999999947


other stats
agent_compute-ego_max0.1096583698310104
agent_compute-ego_mean0.10006205838080756
agent_compute-ego_median0.09883115330680473
agent_compute-ego_min0.08973806244986397
deviation-center-line_max1.3961355591934264
deviation-center-line_mean0.538268945838615
deviation-center-line_min0.10868944755534243
deviation-heading_max7.710127968597522
deviation-heading_mean2.2975389110061935
deviation-heading_median1.0613091398983183
deviation-heading_min0.5432258830302972
driven_any_max2.3487608095422123
driven_any_mean1.0337929281894636
driven_any_median0.5570661499927073
driven_any_min0.17134950861771794
driven_lanedir_consec_max2.117170658807209
driven_lanedir_consec_mean0.6681033819799187
driven_lanedir_consec_min0.13711492274865522
driven_lanedir_max2.121566667868982
driven_lanedir_mean0.8029247296399056
driven_lanedir_median0.4861461122154971
driven_lanedir_min0.13711492274865522
in-drivable-lane_max2.8000000000000336
in-drivable-lane_mean0.7300000000000038
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.341417208873324, "sim_physics": 0.2066521167755127, "survival_time": 14.950000000000076, "driven_lanedir": 2.121566667868982, "sim_render-ego": 0.06413936456044515, "in-drivable-lane": 0.6500000000000092, "agent_compute-ego": 0.09827680985132851, "deviation-heading": 3.5383092052690603, "set_robot_commands": 0.10013026158014932, "deviation-center-line": 1.3961355591934264, "driven_lanedir_consec": 2.117170658807209, "sim_compute_sim_state": 0.0396470061937968, "sim_compute_performance-ego": 0.07185616890589396, "sim_compute_robot_state-ego": 0.07639563004175821, "sim_compute_robot_state-npc0": 0.07083611249923706, "sim_compute_robot_state-npc1": 0.07057806730270386, "sim_compute_robot_state-npc2": 0.07024249712626139, "sim_compute_robot_state-npc3": 0.07073301633199056}, "udem1-1-0": {"driven_any": 0.3561556757625332, "sim_physics": 0.20569110384174424, "survival_time": 2.549999999999999, "driven_lanedir": 0.3070653384519195, "sim_render-ego": 0.06424566811206293, "in-drivable-lane": 0, "agent_compute-ego": 0.1095441088956945, "deviation-heading": 1.1291962175642734, "set_robot_commands": 0.093140069176169, "deviation-center-line": 0.14818647281819008, "driven_lanedir_consec": 0.3070653384519195, "sim_compute_sim_state": 0.04119076915815765, "sim_compute_performance-ego": 0.07306974074419807, "sim_compute_robot_state-ego": 0.07207661516526166, "sim_compute_robot_state-npc0": 0.06939508400711358, "sim_compute_robot_state-npc1": 0.0672619015562768, "sim_compute_robot_state-npc2": 0.0706943530662387, "sim_compute_robot_state-npc3": 0.07233620157428816}, "udem1-2-0": {"driven_any": 0.5570661499927073, "sim_physics": 0.22237405651494077, "survival_time": 3.7999999999999945, "driven_lanedir": 0.5046832902056324, "sim_render-ego": 0.06635918429023341, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09655623059523732, "deviation-heading": 0.7685941780761518, "set_robot_commands": 0.09282471631702624, "deviation-center-line": 0.3654622178006246, "driven_lanedir_consec": 0.5046832902056324, "sim_compute_sim_state": 0.04098630265185708, "sim_compute_performance-ego": 0.06948807365015934, "sim_compute_robot_state-ego": 0.07516021791257356, "sim_compute_robot_state-npc0": 0.06953161954879761, "sim_compute_robot_state-npc1": 0.06740229694466841, "sim_compute_robot_state-npc2": 0.07061236155660529, "sim_compute_robot_state-npc3": 0.0707114715325205}, "udem1-3-0": {"driven_any": 0.2115205325419034, "sim_physics": 0.23266187581149017, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1854689114276924, "sim_render-ego": 0.06424750703753847, "in-drivable-lane": 0, "agent_compute-ego": 0.10501834118005002, "deviation-heading": 0.5452695039032753, "set_robot_commands": 0.0988931366891572, "deviation-center-line": 0.14479594800188628, "driven_lanedir_consec": 0.1854689114276924, "sim_compute_sim_state": 0.03598101211316658, "sim_compute_performance-ego": 0.06951447689171994, "sim_compute_robot_state-ego": 0.08103264461864125, "sim_compute_robot_state-npc0": 0.06659771456862941, "sim_compute_robot_state-npc1": 0.07390482497937752, "sim_compute_robot_state-npc2": 0.06897756547638864, "sim_compute_robot_state-npc3": 0.07179172833760579}, "udem1-4-0": {"driven_any": 1.898913412757509, "sim_physics": 0.21263646196436, "survival_time": 12.150000000000038, "driven_lanedir": 1.3041629909584107, "sim_render-ego": 0.06391036461410209, "in-drivable-lane": 2.8000000000000336, "agent_compute-ego": 0.10660265600730362, "deviation-heading": 3.4477643358156884, "set_robot_commands": 0.10141327057355716, "deviation-center-line": 0.724021292703352, "driven_lanedir_consec": 1.3041629909584107, "sim_compute_sim_state": 0.04045388335553707, "sim_compute_performance-ego": 0.0724165626023532, "sim_compute_robot_state-ego": 0.07746405464140967, "sim_compute_robot_state-npc0": 0.07127452681584613, "sim_compute_robot_state-npc1": 0.0710725980531041, "sim_compute_robot_state-npc2": 0.07115230540679807, "sim_compute_robot_state-npc3": 0.07108499287577813}, "udem1-5-0": {"driven_any": 2.3487608095422123, "sim_physics": 0.203824569384257, "survival_time": 14.950000000000076, "driven_lanedir": 1.8408582553993644, "sim_render-ego": 0.06464611530303956, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.10288424491882324, "deviation-heading": 6.4057031026244555, "set_robot_commands": 0.1034600297609965, "deviation-center-line": 1.3585639702969143, "driven_lanedir_consec": 0.8524637150376144, "sim_compute_sim_state": 0.04061438798904419, "sim_compute_performance-ego": 0.07125288804372151, "sim_compute_robot_state-ego": 0.07684166510899862, "sim_compute_robot_state-npc0": 0.07185669183731079, "sim_compute_robot_state-npc1": 0.07147404034932454, "sim_compute_robot_state-npc2": 0.0725985582669576, "sim_compute_robot_state-npc3": 0.07242504437764485}, "udem1-6-0": {"driven_any": 0.7660210752634931, "sim_physics": 0.2522922450420903, "survival_time": 5.09999999999999, "driven_lanedir": 0.7553414455252458, "sim_render-ego": 0.0713722542220471, "in-drivable-lane": 0, "agent_compute-ego": 0.1096583698310104, "deviation-heading": 0.6922254654292563, "set_robot_commands": 0.1109470713372324, "deviation-center-line": 0.557426647013065, "driven_lanedir_consec": 0.7546677416314009, "sim_compute_sim_state": 0.04148624223821303, "sim_compute_performance-ego": 0.07633712946199904, "sim_compute_robot_state-ego": 0.08760741177727194, "sim_compute_robot_state-npc0": 0.07725764255897671, "sim_compute_robot_state-npc1": 0.07609234136693618, "sim_compute_robot_state-npc2": 0.07506303927477669, "sim_compute_robot_state-npc3": 0.07343703625248928}, "udem1-7-0": {"driven_any": 0.5168908432031573, "sim_physics": 0.2086571908332932, "survival_time": 3.5499999999999954, "driven_lanedir": 0.4861461122154971, "sim_render-ego": 0.062453988572241555, "in-drivable-lane": 0, "agent_compute-ego": 0.09806107131528184, "deviation-heading": 1.0877324599610454, "set_robot_commands": 0.09326049643503108, "deviation-center-line": 0.17363964912195726, "driven_lanedir_consec": 0.4861461122154971, "sim_compute_sim_state": 0.039077470000361055, "sim_compute_performance-ego": 0.07244846182809749, "sim_compute_robot_state-ego": 0.07545784829368055, "sim_compute_robot_state-npc0": 0.06791195063523843, "sim_compute_robot_state-npc1": 0.06954832479987345, "sim_compute_robot_state-npc2": 0.06663535010646766, "sim_compute_robot_state-npc3": 0.0710556104149617}, "udem1-8-0": {"driven_any": 2.3483963094398725, "sim_physics": 0.20710108041763303, "survival_time": 14.950000000000076, "driven_lanedir": 1.4040808575133044, "sim_render-ego": 0.06317493995030721, "in-drivable-lane": 2.750000000000015, "agent_compute-ego": 0.09912317355473836, "deviation-heading": 7.710127968597522, "set_robot_commands": 0.09799426952997844, "deviation-center-line": 1.17791273128002, "driven_lanedir_consec": 0.7241104352278693, "sim_compute_sim_state": 0.041020575364430746, "sim_compute_performance-ego": 0.07319972515106202, "sim_compute_robot_state-ego": 0.07671822468439737, "sim_compute_robot_state-npc0": 0.07090082009633382, "sim_compute_robot_state-npc1": 0.07064936558405559, "sim_compute_robot_state-npc2": 0.07235679149627686, "sim_compute_robot_state-npc3": 0.07161166588465373}, "udem1-9-0": {"driven_any": 0.4767202525280974, "sim_physics": 0.23511938254038492, "survival_time": 3.2999999999999963, "driven_lanedir": 0.4601997825063924, "sim_render-ego": 0.06315627965060147, "in-drivable-lane": 0, "agent_compute-ego": 0.0997123501517556, "deviation-heading": 0.8038978018698708, "set_robot_commands": 0.09940946824622876, "deviation-center-line": 0.21081252472111064, "driven_lanedir_consec": 0.4601997825063924, "sim_compute_sim_state": 0.03973821076479825, "sim_compute_performance-ego": 0.06970338387922807, "sim_compute_robot_state-ego": 0.07491254806518555, "sim_compute_robot_state-npc0": 0.07049263246131665, "sim_compute_robot_state-npc1": 0.06947853709712173, "sim_compute_robot_state-npc2": 0.06967436183582652, "sim_compute_robot_state-npc3": 0.0712031415014556}, "udem1-10-0": {"driven_any": 0.508863281369693, "sim_physics": 0.18604742118290493, "survival_time": 3.4999999999999956, "driven_lanedir": 0.4561563585552963, "sim_render-ego": 0.06145693234034947, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09795709337506976, "deviation-heading": 0.97107490716412, "set_robot_commands": 0.09864423615591866, "deviation-center-line": 0.21651149088243615, "driven_lanedir_consec": 0.4561563585552963, "sim_compute_sim_state": 0.038571769850594656, "sim_compute_performance-ego": 0.0682642766407558, "sim_compute_robot_state-ego": 0.07389026028769356, "sim_compute_robot_state-npc0": 0.07165378161839077, "sim_compute_robot_state-npc1": 0.06952783039637975, "sim_compute_robot_state-npc2": 0.06923908165522984, "sim_compute_robot_state-npc3": 0.06892899785723006}, "udem1-11-0": {"driven_any": 0.4365420130779862, "sim_physics": 0.2162286922579906, "survival_time": 3.049999999999997, "driven_lanedir": 0.4259902722023541, "sim_render-ego": 0.0616077868664851, "in-drivable-lane": 0, "agent_compute-ego": 0.09883115330680473, "deviation-heading": 0.5432258830302972, "set_robot_commands": 0.09772330033974568, "deviation-center-line": 0.3338167565194672, "driven_lanedir_consec": 0.4259902722023541, "sim_compute_sim_state": 0.03897223316255163, "sim_compute_performance-ego": 0.06948006739381885, "sim_compute_robot_state-ego": 0.07365977959554704, "sim_compute_robot_state-npc0": 0.06782618507010038, "sim_compute_robot_state-npc1": 0.07134526674864722, "sim_compute_robot_state-npc2": 0.06975663685407794, "sim_compute_robot_state-npc3": 0.06970905085079006}, "udem1-12-0": {"driven_any": 0.5730502586387246, "sim_physics": 0.19207583940946135, "survival_time": 3.899999999999994, "driven_lanedir": 0.40594850510344593, "sim_render-ego": 0.056441028912862144, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09138828363174048, "deviation-heading": 1.0613091398983183, "set_robot_commands": 0.08858917309687687, "deviation-center-line": 0.2396508659293193, "driven_lanedir_consec": 0.40594850510344593, "sim_compute_sim_state": 0.0339888089742416, "sim_compute_performance-ego": 0.06175266473721235, "sim_compute_robot_state-ego": 0.06680134015205579, "sim_compute_robot_state-npc0": 0.061747926932114824, "sim_compute_robot_state-npc1": 0.06132485622014755, "sim_compute_robot_state-npc2": 0.06021595918215238, "sim_compute_robot_state-npc3": 0.05998973357371795}, "udem1-13-0": {"driven_any": 1.9952265912330192, "sim_physics": 0.1956810614641975, "survival_time": 12.750000000000046, "driven_lanedir": 1.2490872339163943, "sim_render-ego": 0.06278929803885666, "in-drivable-lane": 2.75, "agent_compute-ego": 0.09757892664741068, "deviation-heading": 5.0483062056248045, "set_robot_commands": 0.09598280495288324, "deviation-center-line": 0.9184086137421128, "driven_lanedir_consec": 0.9002016946193916, "sim_compute_sim_state": 0.0375892022076775, "sim_compute_performance-ego": 0.06951493842929017, "sim_compute_robot_state-ego": 0.07324926151948817, "sim_compute_robot_state-npc0": 0.06939990006241144, "sim_compute_robot_state-npc1": 0.068907662933948, "sim_compute_robot_state-npc2": 0.07025883057538201, "sim_compute_robot_state-npc3": 0.06974825391582415}, "udem1-14-0": {"driven_any": 0.17134950861771794, "sim_physics": 0.20382252761295863, "survival_time": 1.4000000000000006, "driven_lanedir": 0.13711492274865522, "sim_render-ego": 0.060487406594412665, "in-drivable-lane": 0, "agent_compute-ego": 0.08973806244986397, "deviation-heading": 0.7103472902647608, "set_robot_commands": 0.09041105849402292, "deviation-center-line": 0.10868944755534243, "driven_lanedir_consec": 0.13711492274865522, "sim_compute_sim_state": 0.03591221570968628, "sim_compute_performance-ego": 0.06379742281777519, "sim_compute_robot_state-ego": 0.07364122356687273, "sim_compute_robot_state-npc0": 0.06664934328624181, "sim_compute_robot_state-npc1": 0.06580563953944615, "sim_compute_robot_state-npc2": 0.06639659404754639, "sim_compute_robot_state-npc3": 0.06636091641017369}}
set_robot_commands_max0.1109470713372324
set_robot_commands_mean0.09752155751233156
set_robot_commands_median0.09799426952997844
set_robot_commands_min0.08858917309687687
sim_compute_performance-ego_max0.07633712946199904
sim_compute_performance-ego_mean0.07013973207848564
sim_compute_performance-ego_median0.06970338387922807
sim_compute_performance-ego_min0.06175266473721235
sim_compute_robot_state-ego_max0.08760741177727194
sim_compute_robot_state-ego_mean0.07566058169538903
sim_compute_robot_state-ego_median0.07516021791257356
sim_compute_robot_state-ego_min0.06680134015205579
sim_compute_robot_state-npc0_max0.07725764255897671
sim_compute_robot_state-npc0_mean0.06955546213320396
sim_compute_robot_state-npc0_median0.06953161954879761
sim_compute_robot_state-npc0_min0.061747926932114824
sim_compute_robot_state-npc1_max0.07609234136693618
sim_compute_robot_state-npc1_mean0.06962490359146739
sim_compute_robot_state-npc1_median0.06954832479987345
sim_compute_robot_state-npc1_min0.06132485622014755
sim_compute_robot_state-npc2_max0.07506303927477669
sim_compute_robot_state-npc2_mean0.06959161906179907
sim_compute_robot_state-npc2_median0.07024249712626139
sim_compute_robot_state-npc2_min0.06021595918215238
sim_compute_robot_state-npc3_max0.07343703625248928
sim_compute_robot_state-npc3_mean0.07007512411274161
sim_compute_robot_state-npc3_median0.0710556104149617
sim_compute_robot_state-npc3_min0.05998973357371795
sim_compute_sim_state_max0.04148624223821303
sim_compute_sim_state_mean0.039015339315607606
sim_compute_sim_state_median0.0396470061937968
sim_compute_sim_state_min0.0339888089742416
sim_physics_max0.2522922450420903
sim_physics_mean0.21205770833688128
sim_physics_median0.20710108041763303
sim_physics_min0.18604742118290493
sim_render-ego_max0.0713722542220471
sim_render-ego_mean0.06336587460437232
sim_render-ego_median0.06317493995030721
sim_render-ego_min0.056441028912862144
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.770000000000019
survival_time_min1.4000000000000006
212112774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:58:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-25-98-2470-job21211/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211732774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:57:13
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-38-104-5376-job21173/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211712774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:57:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-42-167-7357-job21171/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
211212774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:55:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-38-104-5197-job21121/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210862774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:57:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-42-167-7227-job21086/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
210252774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:55:16
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2774/step1-simulation-ip-172-31-25-98-2348-job21025/logs/challenges-runner/stdout.log'
Hidden. If you are the author, please login using the top-right link or use the dashboard.
203912774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:31:50Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6967083669810288
survival_time_median12.800000000000049
deviation-center-line_median0.5055575973466313
in-drivable-lane_median0.9500000000000136


other stats
agent_compute-ego_max0.11771807140774196
agent_compute-ego_mean0.1147719122560052
agent_compute-ego_median0.11445948441823324
agent_compute-ego_min0.11161056280136109
deviation-center-line_max1.484986755411322
deviation-center-line_mean0.8179648868135121
deviation-center-line_min0.31227709963721445
deviation-heading_max6.693215807942304
deviation-heading_mean4.152738064382175
deviation-heading_median3.643725187102529
deviation-heading_min1.7979059764405578
driven_any_max2.3485777223340354
driven_any_mean1.614487925302463
driven_any_median2.003020513954248
driven_any_min0.662941123925887
driven_lanedir_consec_max1.5547689563669989
driven_lanedir_consec_mean0.8277970060829007
driven_lanedir_consec_min0.24140381529034105
driven_lanedir_max1.8224189220979872
driven_lanedir_mean1.061701692527512
driven_lanedir_median0.8722066221979858
driven_lanedir_min0.44799325550004826
in-drivable-lane_max5.7000000000000295
in-drivable-lane_mean1.91000000000001
in-drivable-lane_min0.49999999999999933
per-episodes
details{"udem1-0-0": {"driven_any": 0.662941123925887, "sim_physics": 0.20794872972700332, "survival_time": 4.499999999999992, "driven_lanedir": 0.44799325550004826, "sim_render-ego": 0.07359162436591254, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.11771807140774196, "deviation-heading": 2.087365100564611, "set_robot_commands": 0.11297207673390706, "deviation-center-line": 0.388620360815666, "driven_lanedir_consec": 0.24140381529034105, "sim_compute_sim_state": 0.04624024232228597, "sim_compute_performance-ego": 0.07868518564436171, "sim_compute_robot_state-ego": 0.08823464711507162, "sim_compute_robot_state-npc0": 0.08158551057179769, "sim_compute_robot_state-npc1": 0.07961555322011311, "sim_compute_robot_state-npc2": 0.08046415117051867, "sim_compute_robot_state-npc3": 0.07955042256249321}, "udem1-1-0": {"driven_any": 2.003020513954248, "sim_physics": 0.27647959161549807, "survival_time": 12.800000000000049, "driven_lanedir": 0.8722066221979858, "sim_render-ego": 0.07273410353809595, "in-drivable-lane": 5.7000000000000295, "agent_compute-ego": 0.11357477679848672, "deviation-heading": 3.643725187102529, "set_robot_commands": 0.11561399511992931, "deviation-center-line": 0.5055575973466313, "driven_lanedir_consec": 0.6967083669810288, "sim_compute_sim_state": 0.0450246874243021, "sim_compute_performance-ego": 0.08098073396831751, "sim_compute_robot_state-ego": 0.09056850336492062, "sim_compute_robot_state-npc0": 0.08026297483593225, "sim_compute_robot_state-npc1": 0.07992941699922085, "sim_compute_robot_state-npc2": 0.08128921035677195, "sim_compute_robot_state-npc3": 0.07940219063311815}, "udem1-2-0": {"driven_any": 2.3483691054830182, "sim_physics": 0.2681403915087382, "survival_time": 14.950000000000076, "driven_lanedir": 1.670885541519227, "sim_render-ego": 0.07242970069249471, "in-drivable-lane": 1.7000000000000108, "agent_compute-ego": 0.11445948441823324, "deviation-heading": 6.693215807942304, "set_robot_commands": 0.11399492899576824, "deviation-center-line": 1.484986755411322, "driven_lanedir_consec": 1.1510997704538226, "sim_compute_sim_state": 0.04582558870315552, "sim_compute_performance-ego": 0.07939011176427205, "sim_compute_robot_state-ego": 0.0883777912457784, "sim_compute_robot_state-npc0": 0.0811615260442098, "sim_compute_robot_state-npc1": 0.07959033966064454, "sim_compute_robot_state-npc2": 0.08102381149927775, "sim_compute_robot_state-npc3": 0.0794432290395101}, "udem1-3-0": {"driven_any": 0.7095311608151288, "sim_physics": 0.24937923832943565, "survival_time": 4.749999999999991, "driven_lanedir": 0.49500412132231175, "sim_render-ego": 0.07556229892529939, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.11649666585420308, "deviation-heading": 1.7979059764405578, "set_robot_commands": 0.11292855614110044, "deviation-center-line": 0.31227709963721445, "driven_lanedir_consec": 0.49500412132231175, "sim_compute_sim_state": 0.04347275181820518, "sim_compute_performance-ego": 0.07971961372777035, "sim_compute_robot_state-ego": 0.09103125522011205, "sim_compute_robot_state-npc0": 0.07878106769762541, "sim_compute_robot_state-npc1": 0.07563619864614386, "sim_compute_robot_state-npc2": 0.07851387576053018, "sim_compute_robot_state-npc3": 0.07809608359085886}, "udem1-4-0": {"driven_any": 2.3485777223340354, "sim_physics": 0.2550891121228536, "survival_time": 14.950000000000076, "driven_lanedir": 1.8224189220979872, "sim_render-ego": 0.06847242752710979, "in-drivable-lane": 0.9500000000000136, "agent_compute-ego": 0.11161056280136109, "deviation-heading": 6.541478249860876, "set_robot_commands": 0.108498694896698, "deviation-center-line": 1.3983826208567272, "driven_lanedir_consec": 1.5547689563669989, "sim_compute_sim_state": 0.04285642941792806, "sim_compute_performance-ego": 0.07462133566538492, "sim_compute_robot_state-ego": 0.08498293002446493, "sim_compute_robot_state-npc0": 0.07656595865885417, "sim_compute_robot_state-npc1": 0.07658342043558757, "sim_compute_robot_state-npc2": 0.07981063604354859, "sim_compute_robot_state-npc3": 0.07629494825998942}}
set_robot_commands_max0.11561399511992931
set_robot_commands_mean0.1128016503774806
set_robot_commands_median0.11297207673390706
set_robot_commands_min0.108498694896698
sim_compute_performance-ego_max0.08098073396831751
sim_compute_performance-ego_mean0.07867939615402131
sim_compute_performance-ego_median0.07939011176427205
sim_compute_performance-ego_min0.07462133566538492
sim_compute_robot_state-ego_max0.09103125522011205
sim_compute_robot_state-ego_mean0.08863902539406952
sim_compute_robot_state-ego_median0.0883777912457784
sim_compute_robot_state-ego_min0.08498293002446493
sim_compute_robot_state-npc0_max0.08158551057179769
sim_compute_robot_state-npc0_mean0.07967140756168387
sim_compute_robot_state-npc0_median0.08026297483593225
sim_compute_robot_state-npc0_min0.07656595865885417
sim_compute_robot_state-npc1_max0.07992941699922085
sim_compute_robot_state-npc1_mean0.07827098579234198
sim_compute_robot_state-npc1_median0.07959033966064454
sim_compute_robot_state-npc1_min0.07563619864614386
sim_compute_robot_state-npc2_max0.08128921035677195
sim_compute_robot_state-npc2_mean0.08022033696612943
sim_compute_robot_state-npc2_median0.08046415117051867
sim_compute_robot_state-npc2_min0.07851387576053018
sim_compute_robot_state-npc3_max0.07955042256249321
sim_compute_robot_state-npc3_mean0.07855737481719396
sim_compute_robot_state-npc3_median0.07940219063311815
sim_compute_robot_state-npc3_min0.07629494825998942
sim_compute_sim_state_max0.04624024232228597
sim_compute_sim_state_mean0.04468393993717536
sim_compute_sim_state_median0.0450246874243021
sim_compute_sim_state_min0.04285642941792806
sim_physics_max0.27647959161549807
sim_physics_mean0.2514074126607057
sim_physics_median0.2550891121228536
sim_physics_min0.20794872972700332
sim_render-ego_max0.07556229892529939
sim_render-ego_mean0.07255803100978249
sim_render-ego_median0.07273410353809595
sim_render-ego_min0.06847242752710979
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.390000000000038
survival_time_min4.499999999999992
203352774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationhost-errorno-0:23:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 990, in run_docker
    return subprocess.check_output(cmd0, cwd=cwd, stderr=sys.stderr)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 478, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/project/src/duckietown_challenges_runner/runner.py", line 573, in run_single
    write_logs(wd, project, services=config['services'])
  File "/project/src/duckietown_challenges_runner/runner.py", line 899, in write_logs
    container_id = get_id_for_service(wd, project, service)
  File "/project/src/duckietown_challenges_runner/runner.py", line 585, in get_id_for_service
    o = run_docker(wd, project, cmd, get_output=True)
  File "/project/src/duckietown_challenges_runner/runner.py", line 998, in run_docker
    raise DockerComposeFail(msg) from e
duckietown_challenges_runner.runner.DockerComposeFail: Could not run ['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']:

   >  Command '['docker-compose', '-p', 'job20335-883341', 'ps', '-q', 'solution']' returned non-zero exit status 1.

stdout | 

stderr | 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
200652774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:20:48Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4610916151723656
survival_time_median4.849999999999991
deviation-center-line_median0.45276698352946704
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.10740617794149064
agent_compute-ego_mean0.0974848856270518
agent_compute-ego_median0.096357758512202
agent_compute-ego_min0.0888194751739502
deviation-center-line_max0.8920565985855058
deviation-center-line_mean0.48665771018907816
deviation-center-line_min0.14878517045151526
deviation-heading_max5.590394782413816
deviation-heading_mean2.409177872207663
deviation-heading_median1.88827014016829
deviation-heading_min0.5387737474023465
driven_any_max2.3481774496539756
driven_any_mean1.0344466349959816
driven_any_median0.7192216566210685
driven_any_min0.21946392917965632
driven_lanedir_consec_max1.069865675058762
driven_lanedir_consec_mean0.6191910085715143
driven_lanedir_consec_min0.19553454300342188
driven_lanedir_max1.5416723159581756
driven_lanedir_mean0.767947028079514
driven_lanedir_median0.5715709912048453
driven_lanedir_min0.19553454300342188
in-drivable-lane_max2.9500000000000375
in-drivable-lane_mean0.8700000000000084
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.7192216566210685, "sim_physics": 0.1689629751382415, "survival_time": 4.849999999999991, "driven_lanedir": 0.5715709912048453, "sim_render-ego": 0.05945467211536525, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.096357758512202, "deviation-heading": 1.88827014016829, "set_robot_commands": 0.09270533089785232, "deviation-center-line": 0.45276698352946704, "driven_lanedir_consec": 0.37282484425229906, "sim_compute_sim_state": 0.038741283810015806, "sim_compute_performance-ego": 0.06619467931924407, "sim_compute_robot_state-ego": 0.0716333168069112, "sim_compute_robot_state-npc0": 0.06770825386047363, "sim_compute_robot_state-npc1": 0.06736286153498384, "sim_compute_robot_state-npc2": 0.07119387449677457, "sim_compute_robot_state-npc3": 0.06805651949853012}, "udem1-1-0": {"driven_any": 0.49269325732533115, "sim_physics": 0.19289657298256369, "survival_time": 3.399999999999996, "driven_lanedir": 0.4610916151723656, "sim_render-ego": 0.07153643580044017, "in-drivable-lane": 0, "agent_compute-ego": 0.10740617794149064, "deviation-heading": 1.1009792762837594, "set_robot_commands": 0.10758546170066384, "deviation-center-line": 0.22231101114908083, "driven_lanedir_consec": 0.4610916151723656, "sim_compute_sim_state": 0.04134117154514089, "sim_compute_performance-ego": 0.0755239164128023, "sim_compute_robot_state-ego": 0.08622941900702084, "sim_compute_robot_state-npc0": 0.07506196288501515, "sim_compute_robot_state-npc1": 0.07389005142099717, "sim_compute_robot_state-npc2": 0.07289907160927267, "sim_compute_robot_state-npc3": 0.07438559041303747}, "udem1-2-0": {"driven_any": 2.3481774496539756, "sim_physics": 0.19945947885513304, "survival_time": 14.950000000000076, "driven_lanedir": 1.5416723159581756, "sim_render-ego": 0.058152720133463544, "in-drivable-lane": 2.9500000000000375, "agent_compute-ego": 0.0888194751739502, "deviation-heading": 5.590394782413816, "set_robot_commands": 0.0914736827214559, "deviation-center-line": 0.8920565985855058, "driven_lanedir_consec": 0.9966383653707234, "sim_compute_sim_state": 0.0374313481648763, "sim_compute_performance-ego": 0.06605641762415568, "sim_compute_robot_state-ego": 0.06949221928914388, "sim_compute_robot_state-npc0": 0.06721139748891194, "sim_compute_robot_state-npc1": 0.0660956358909607, "sim_compute_robot_state-npc2": 0.06559297482172648, "sim_compute_robot_state-npc3": 0.06510388771692911}, "udem1-3-0": {"driven_any": 0.21946392917965632, "sim_physics": 0.17837156267727122, "survival_time": 1.7000000000000008, "driven_lanedir": 0.19553454300342188, "sim_render-ego": 0.05897978474112118, "in-drivable-lane": 0, "agent_compute-ego": 0.09934999662287096, "deviation-heading": 0.5387737474023465, "set_robot_commands": 0.09515185215893912, "deviation-center-line": 0.14878517045151526, "driven_lanedir_consec": 0.19553454300342188, "sim_compute_sim_state": 0.04157113327699549, "sim_compute_performance-ego": 0.06533599601072423, "sim_compute_robot_state-ego": 0.06749247803407557, "sim_compute_robot_state-npc0": 0.06542510144850787, "sim_compute_robot_state-npc1": 0.06549784015206729, "sim_compute_robot_state-npc2": 0.07089714442982394, "sim_compute_robot_state-npc3": 0.06852858908036176}, "udem1-4-0": {"driven_any": 1.3926768821998767, "sim_physics": 0.21406842205259535, "survival_time": 8.999999999999993, "driven_lanedir": 1.069865675058762, "sim_render-ego": 0.06567460828357273, "in-drivable-lane": 1.100000000000004, "agent_compute-ego": 0.09549101988474527, "deviation-heading": 2.927471414770104, "set_robot_commands": 0.09785147110621134, "deviation-center-line": 0.717368787229822, "driven_lanedir_consec": 1.069865675058762, "sim_compute_sim_state": 0.03894011576970418, "sim_compute_performance-ego": 0.07078109449810452, "sim_compute_robot_state-ego": 0.07896152072482639, "sim_compute_robot_state-npc0": 0.07110564046435885, "sim_compute_robot_state-npc1": 0.07201767630047268, "sim_compute_robot_state-npc2": 0.07041087812847562, "sim_compute_robot_state-npc3": 0.06952949629889595}}
set_robot_commands_max0.10758546170066384
set_robot_commands_mean0.0969535597170245
set_robot_commands_median0.09515185215893912
set_robot_commands_min0.0914736827214559
sim_compute_performance-ego_max0.0755239164128023
sim_compute_performance-ego_mean0.06877842077300615
sim_compute_performance-ego_median0.06619467931924407
sim_compute_performance-ego_min0.06533599601072423
sim_compute_robot_state-ego_max0.08622941900702084
sim_compute_robot_state-ego_mean0.07476179077239556
sim_compute_robot_state-ego_median0.0716333168069112
sim_compute_robot_state-ego_min0.06749247803407557
sim_compute_robot_state-npc0_max0.07506196288501515
sim_compute_robot_state-npc0_mean0.06930247122945349
sim_compute_robot_state-npc0_median0.06770825386047363
sim_compute_robot_state-npc0_min0.06542510144850787
sim_compute_robot_state-npc1_max0.07389005142099717
sim_compute_robot_state-npc1_mean0.06897281305989633
sim_compute_robot_state-npc1_median0.06736286153498384
sim_compute_robot_state-npc1_min0.06549784015206729
sim_compute_robot_state-npc2_max0.07289907160927267
sim_compute_robot_state-npc2_mean0.07019878869721466
sim_compute_robot_state-npc2_median0.07089714442982394
sim_compute_robot_state-npc2_min0.06559297482172648
sim_compute_robot_state-npc3_max0.07438559041303747
sim_compute_robot_state-npc3_mean0.06912081660155087
sim_compute_robot_state-npc3_median0.06852858908036176
sim_compute_robot_state-npc3_min0.06510388771692911
sim_compute_sim_state_max0.04157113327699549
sim_compute_sim_state_mean0.039605010513346535
sim_compute_sim_state_median0.03894011576970418
sim_compute_sim_state_min0.0374313481648763
sim_physics_max0.21406842205259535
sim_physics_mean0.190751802341161
sim_physics_median0.19289657298256369
sim_physics_min0.1689629751382415
sim_render-ego_max0.07153643580044017
sim_render-ego_mean0.06275964421479258
sim_render-ego_median0.05945467211536525
sim_render-ego_min0.058152720133463544
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.780000000000011
survival_time_min1.7000000000000008
198222774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:12:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.42186106715242166
survival_time_median2.9499999999999975
deviation-center-line_median0.31278767714674827
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1115667491123594
agent_compute-ego_mean0.09814469877180113
agent_compute-ego_median0.09407040628336244
agent_compute-ego_min0.0894833973475865
deviation-center-line_max1.0228254274877162
deviation-center-line_mean0.455328779463981
deviation-center-line_min0.11643773622478042
deviation-heading_max3.1540921157692985
deviation-heading_mean1.3770876533588017
deviation-heading_median1.083136422655638
deviation-heading_min0.3712307156782793
driven_any_max2.353231854835941
driven_any_mean1.0228479167817304
driven_any_median0.42708232911306454
driven_any_min0.18597679405018971
driven_lanedir_consec_max1.6382759928586106
driven_lanedir_consec_mean0.6762341135713246
driven_lanedir_consec_min0.1556426116467451
driven_lanedir_max1.6382759928586106
driven_lanedir_mean0.716809154704448
driven_lanedir_median0.42186106715242166
driven_lanedir_min0.1556426116467451
in-drivable-lane_max6.900000000000028
in-drivable-lane_mean1.550000000000005
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.353231854835941, "sim_physics": 0.026419595082600913, "survival_time": 14.950000000000076, "driven_lanedir": 1.0741023524133573, "sim_render-ego": 0.0559535805384318, "in-drivable-lane": 6.900000000000028, "agent_compute-ego": 0.09267618020375568, "deviation-heading": 3.1540921157692985, "set_robot_commands": 0.07813843091328938, "deviation-center-line": 0.6821322526721486, "driven_lanedir_consec": 0.8712271467477407, "sim_compute_sim_state": 0.03324484586715698, "sim_compute_performance-ego": 0.058565997282663984, "sim_compute_robot_state-ego": 0.05888923724492391, "sim_compute_robot_state-npc0": 0.06634110530217488, "sim_compute_robot_state-npc1": 0.06094538768132528, "sim_compute_robot_state-npc2": 0.05962437232335409, "sim_compute_robot_state-npc3": 0.060202155907948814}, "udem1-1-0": {"driven_any": 0.3386596346004692, "sim_physics": 0.026935160160064697, "survival_time": 2.3999999999999995, "driven_lanedir": 0.2941637494511049, "sim_render-ego": 0.05946885049343109, "in-drivable-lane": 0, "agent_compute-ego": 0.10292676091194151, "deviation-heading": 1.083136422655638, "set_robot_commands": 0.07592783371607463, "deviation-center-line": 0.14246080378851145, "driven_lanedir_consec": 0.2941637494511049, "sim_compute_sim_state": 0.033684685826301575, "sim_compute_performance-ego": 0.05919855833053589, "sim_compute_robot_state-ego": 0.05900935331980387, "sim_compute_robot_state-npc0": 0.06553980211416881, "sim_compute_robot_state-npc1": 0.06160317361354828, "sim_compute_robot_state-npc2": 0.06080986062685648, "sim_compute_robot_state-npc3": 0.06105671326319376}, "udem1-2-0": {"driven_any": 0.42708232911306454, "sim_physics": 0.03144692566435216, "survival_time": 2.9499999999999975, "driven_lanedir": 0.42186106715242166, "sim_render-ego": 0.056916451050063314, "in-drivable-lane": 0, "agent_compute-ego": 0.09407040628336244, "deviation-heading": 0.3712307156782793, "set_robot_commands": 0.07686648530475164, "deviation-center-line": 0.31278767714674827, "driven_lanedir_consec": 0.42186106715242166, "sim_compute_sim_state": 0.03263755167944957, "sim_compute_performance-ego": 0.060464697369074415, "sim_compute_robot_state-ego": 0.06064894239781266, "sim_compute_robot_state-npc0": 0.06339502334594727, "sim_compute_robot_state-npc1": 0.060276512372291695, "sim_compute_robot_state-npc2": 0.05884307925984011, "sim_compute_robot_state-npc3": 0.059132677013591185}, "udem1-3-0": {"driven_any": 0.18597679405018971, "sim_physics": 0.029009465513558225, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1556426116467451, "sim_render-ego": 0.06250034529587319, "in-drivable-lane": 0, "agent_compute-ego": 0.1115667491123594, "deviation-heading": 0.5088861088147644, "set_robot_commands": 0.07619048809183054, "deviation-center-line": 0.11643773622478042, "driven_lanedir_consec": 0.1556426116467451, "sim_compute_sim_state": 0.032310855799707876, "sim_compute_performance-ego": 0.062137858621005355, "sim_compute_robot_state-ego": 0.06304407119750977, "sim_compute_robot_state-npc0": 0.06865454542225805, "sim_compute_robot_state-npc1": 0.061933279037475586, "sim_compute_robot_state-npc2": 0.05840668185003873, "sim_compute_robot_state-npc3": 0.05845561520806674}, "udem1-4-0": {"driven_any": 1.809288971308987, "sim_physics": 0.027522658888911783, "survival_time": 11.55000000000003, "driven_lanedir": 1.6382759928586106, "sim_render-ego": 0.055148073089071166, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.0894833973475865, "deviation-heading": 1.7680929038760267, "set_robot_commands": 0.07664058321998232, "deviation-center-line": 1.0228254274877162, "driven_lanedir_consec": 1.6382759928586106, "sim_compute_sim_state": 0.03331927303627972, "sim_compute_performance-ego": 0.05988685702864742, "sim_compute_robot_state-ego": 0.06122898333000414, "sim_compute_robot_state-npc0": 0.06492460754526642, "sim_compute_robot_state-npc1": 0.060843104407900854, "sim_compute_robot_state-npc2": 0.05993039473826751, "sim_compute_robot_state-npc3": 0.05978627122325814}}
set_robot_commands_max0.07813843091328938
set_robot_commands_mean0.07675276424918571
set_robot_commands_median0.07664058321998232
set_robot_commands_min0.07592783371607463
sim_compute_performance-ego_max0.062137858621005355
sim_compute_performance-ego_mean0.06005079372638541
sim_compute_performance-ego_median0.05988685702864742
sim_compute_performance-ego_min0.058565997282663984
sim_compute_robot_state-ego_max0.06304407119750977
sim_compute_robot_state-ego_mean0.06056411749801087
sim_compute_robot_state-ego_median0.06064894239781266
sim_compute_robot_state-ego_min0.05888923724492391
sim_compute_robot_state-npc0_max0.06865454542225805
sim_compute_robot_state-npc0_mean0.06577101674596308
sim_compute_robot_state-npc0_median0.06553980211416881
sim_compute_robot_state-npc0_min0.06339502334594727
sim_compute_robot_state-npc1_max0.061933279037475586
sim_compute_robot_state-npc1_mean0.061120291422508334
sim_compute_robot_state-npc1_median0.06094538768132528
sim_compute_robot_state-npc1_min0.060276512372291695
sim_compute_robot_state-npc2_max0.06080986062685648
sim_compute_robot_state-npc2_mean0.05952287775967139
sim_compute_robot_state-npc2_median0.05962437232335409
sim_compute_robot_state-npc2_min0.05840668185003873
sim_compute_robot_state-npc3_max0.06105671326319376
sim_compute_robot_state-npc3_mean0.05972668652321174
sim_compute_robot_state-npc3_median0.05978627122325814
sim_compute_robot_state-npc3_min0.05845561520806674
sim_compute_sim_state_max0.033684685826301575
sim_compute_sim_state_mean0.03303944244177914
sim_compute_sim_state_median0.03324484586715698
sim_compute_sim_state_min0.032310855799707876
sim_physics_max0.03144692566435216
sim_physics_mean0.02826676106189755
sim_physics_median0.027522658888911783
sim_physics_min0.026419595082600913
sim_render-ego_max0.06250034529587319
sim_render-ego_mean0.05799746009337411
sim_render-ego_median0.056916451050063314
sim_render-ego_min0.055148073089071166
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.660000000000021
survival_time_min1.4500000000000006
197612774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:09:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.42023600843424624
survival_time_median2.9499999999999975
deviation-center-line_median0.30614354212515077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1212325154281244
agent_compute-ego_mean0.09497400387891168
agent_compute-ego_median0.090438150141361
agent_compute-ego_min0.0831487019191726
deviation-center-line_max1.1274627052597173
deviation-center-line_mean0.4569305829796095
deviation-center-line_min0.12359623261482168
deviation-heading_max1.6898248523475965
deviation-heading_mean0.960921381851567
deviation-heading_median1.0794684601744635
deviation-heading_min0.4163948185728488
driven_any_max1.873595510596352
driven_any_mean0.7785899908083372
driven_any_median0.4270811131348941
driven_any_min0.2583041074646399
driven_lanedir_consec_max1.7179069684975172
driven_lanedir_consec_mean0.7271457338135366
driven_lanedir_consec_min0.2301576351919188
driven_lanedir_max1.7179069684975172
driven_lanedir_mean0.7272050454401864
driven_lanedir_median0.42023600843424624
driven_lanedir_min0.2301576351919188
in-drivable-lane_max0.7999999999999972
in-drivable-lane_mean0.15999999999999942
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.0515610722580937, "sim_physics": 0.02687308214006633, "survival_time": 6.849999999999984, "driven_lanedir": 1.0299528814544023, "sim_render-ego": 0.05554091669347165, "in-drivable-lane": 0, "agent_compute-ego": 0.090438150141361, "deviation-heading": 1.0794684601744635, "set_robot_commands": 0.07812869287755368, "deviation-center-line": 0.5564443313504773, "driven_lanedir_consec": 1.0296563233211538, "sim_compute_sim_state": 0.03297494449754701, "sim_compute_performance-ego": 0.058539627242262346, "sim_compute_robot_state-ego": 0.05985713875206718, "sim_compute_robot_state-npc0": 0.06635062189867896, "sim_compute_robot_state-npc1": 0.0596800320339899, "sim_compute_robot_state-npc2": 0.0598004003510858, "sim_compute_robot_state-npc3": 0.05919382345937464}, "udem1-1-0": {"driven_any": 0.2824081505877065, "sim_physics": 0.025614284887546447, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2301576351919188, "sim_render-ego": 0.06427696856056772, "in-drivable-lane": 0, "agent_compute-ego": 0.1212325154281244, "deviation-heading": 1.089349013400306, "set_robot_commands": 0.07740883129398997, "deviation-center-line": 0.12359623261482168, "driven_lanedir_consec": 0.2301576351919188, "sim_compute_sim_state": 0.032798993878248264, "sim_compute_performance-ego": 0.0630350229216785, "sim_compute_robot_state-ego": 0.061703530753531105, "sim_compute_robot_state-npc0": 0.06715143599161287, "sim_compute_robot_state-npc1": 0.06280903118412669, "sim_compute_robot_state-npc2": 0.06179048956894293, "sim_compute_robot_state-npc3": 0.061774608565539846}, "udem1-2-0": {"driven_any": 0.4270811131348941, "sim_physics": 0.029677128387709795, "survival_time": 2.9499999999999975, "driven_lanedir": 0.42023600843424624, "sim_render-ego": 0.055902836686473785, "in-drivable-lane": 0, "agent_compute-ego": 0.08705929982460152, "deviation-heading": 0.4163948185728488, "set_robot_commands": 0.07400707875267934, "deviation-center-line": 0.30614354212515077, "driven_lanedir_consec": 0.42023600843424624, "sim_compute_sim_state": 0.03203079255960756, "sim_compute_performance-ego": 0.0575006048558122, "sim_compute_robot_state-ego": 0.057796437861555715, "sim_compute_robot_state-npc0": 0.06352171251329325, "sim_compute_robot_state-npc1": 0.057264170404207906, "sim_compute_robot_state-npc2": 0.05648506293862553, "sim_compute_robot_state-npc3": 0.05734320010169078}, "udem1-3-0": {"driven_any": 0.2583041074646399, "sim_physics": 0.025415985207808644, "survival_time": 1.900000000000001, "driven_lanedir": 0.2377717336228471, "sim_render-ego": 0.052258849143981934, "in-drivable-lane": 0, "agent_compute-ego": 0.09299135208129884, "deviation-heading": 0.5295697647626202, "set_robot_commands": 0.07206016465237267, "deviation-center-line": 0.1710061035478807, "driven_lanedir_consec": 0.2377717336228471, "sim_compute_sim_state": 0.030386943566171748, "sim_compute_performance-ego": 0.055436667643095315, "sim_compute_robot_state-ego": 0.05616550069106253, "sim_compute_robot_state-npc0": 0.05872264033869693, "sim_compute_robot_state-npc1": 0.05625743614999872, "sim_compute_robot_state-npc2": 0.05554733150883725, "sim_compute_robot_state-npc3": 0.05462569939462762}, "udem1-4-0": {"driven_any": 1.873595510596352, "sim_physics": 0.02523119679055952, "survival_time": 11.950000000000037, "driven_lanedir": 1.7179069684975172, "sim_render-ego": 0.05348592422996106, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.0831487019191726, "deviation-heading": 1.6898248523475965, "set_robot_commands": 0.07458644432004027, "deviation-center-line": 1.1274627052597173, "driven_lanedir_consec": 1.7179069684975172, "sim_compute_sim_state": 0.03142763680493981, "sim_compute_performance-ego": 0.05691846344760272, "sim_compute_robot_state-ego": 0.057570210061811504, "sim_compute_robot_state-npc0": 0.0616160167311026, "sim_compute_robot_state-npc1": 0.056859983061148034, "sim_compute_robot_state-npc2": 0.05655478034558156, "sim_compute_robot_state-npc3": 0.05680768459910628}}
set_robot_commands_max0.07812869287755368
set_robot_commands_mean0.07523824237932719
set_robot_commands_median0.07458644432004027
set_robot_commands_min0.07206016465237267
sim_compute_performance-ego_max0.0630350229216785
sim_compute_performance-ego_mean0.05828607722209021
sim_compute_performance-ego_median0.0575006048558122
sim_compute_performance-ego_min0.055436667643095315
sim_compute_robot_state-ego_max0.061703530753531105
sim_compute_robot_state-ego_mean0.0586185636240056
sim_compute_robot_state-ego_median0.057796437861555715
sim_compute_robot_state-ego_min0.05616550069106253
sim_compute_robot_state-npc0_max0.06715143599161287
sim_compute_robot_state-npc0_mean0.06347248549467693
sim_compute_robot_state-npc0_median0.06352171251329325
sim_compute_robot_state-npc0_min0.05872264033869693
sim_compute_robot_state-npc1_max0.06280903118412669
sim_compute_robot_state-npc1_mean0.05857413056669425
sim_compute_robot_state-npc1_median0.057264170404207906
sim_compute_robot_state-npc1_min0.05625743614999872
sim_compute_robot_state-npc2_max0.06179048956894293
sim_compute_robot_state-npc2_mean0.05803561294261461
sim_compute_robot_state-npc2_median0.05655478034558156
sim_compute_robot_state-npc2_min0.05554733150883725
sim_compute_robot_state-npc3_max0.061774608565539846
sim_compute_robot_state-npc3_mean0.05794900322406784
sim_compute_robot_state-npc3_median0.05734320010169078
sim_compute_robot_state-npc3_min0.05462569939462762
sim_compute_sim_state_max0.03297494449754701
sim_compute_sim_state_mean0.03192386226130288
sim_compute_sim_state_median0.03203079255960756
sim_compute_sim_state_min0.030386943566171748
sim_physics_max0.029677128387709795
sim_physics_mean0.026562335482738147
sim_physics_median0.025614284887546447
sim_physics_min0.02523119679055952
sim_render-ego_max0.06427696856056772
sim_render-ego_mean0.056293099062891226
sim_render-ego_median0.05554091669347165
sim_render-ego_min0.052258849143981934
simulation-passed1
survival_time_max11.950000000000037
survival_time_mean5.140000000000003
survival_time_min1.900000000000001
193682774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:10:58Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4889045976301556
survival_time_median3.7499999999999942
deviation-center-line_median0.2494193891551898
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.18203642493800112
agent_compute-ego_mean0.11285260173464928
agent_compute-ego_median0.09988494962453842
agent_compute-ego_min0.08051202456156413
deviation-center-line_max0.8174959711140002
deviation-center-line_mean0.3412901636139237
deviation-center-line_min0.061484482735035824
deviation-heading_max2.410473163343411
deviation-heading_mean1.0316416677847595
deviation-heading_median0.7178167934226656
deviation-heading_min0.6154549109027005
driven_any_max1.7931247675942137
driven_any_mean0.7239204058527922
driven_any_median0.5556420301227285
driven_any_min0.2100687594789937
driven_lanedir_consec_max1.322879282392715
driven_lanedir_consec_mean0.5971083304892798
driven_lanedir_consec_min0.15553543067421716
driven_lanedir_max1.322879282392715
driven_lanedir_mean0.5971083304892798
driven_lanedir_median0.4889045976301556
driven_lanedir_min0.15553543067421716
in-drivable-lane_max2.450000000000027
in-drivable-lane_mean0.5600000000000052
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.8024578660913457, "sim_physics": 0.030701596781892597, "survival_time": 5.299999999999989, "driven_lanedir": 0.7928125336696206, "sim_render-ego": 0.053886975882188326, "in-drivable-lane": 0, "agent_compute-ego": 0.08243555392859117, "deviation-heading": 0.6154549109027005, "set_robot_commands": 0.07517484448990731, "deviation-center-line": 0.46705431232259825, "driven_lanedir_consec": 0.7928125336696206, "sim_compute_sim_state": 0.032701078450904704, "sim_compute_performance-ego": 0.05687374213956437, "sim_compute_robot_state-ego": 0.05911520966943705, "sim_compute_robot_state-npc0": 0.06093674785685989, "sim_compute_robot_state-npc1": 0.05879423753270563, "sim_compute_robot_state-npc2": 0.056752661489090826, "sim_compute_robot_state-npc3": 0.0579493540637898}, "udem1-1-0": {"driven_any": 0.2100687594789937, "sim_physics": 0.026714012026786804, "survival_time": 1.6000000000000008, "driven_lanedir": 0.15553543067421716, "sim_render-ego": 0.05109453201293945, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09988494962453842, "deviation-heading": 0.686281068649473, "set_robot_commands": 0.07469300180673599, "deviation-center-line": 0.061484482735035824, "driven_lanedir_consec": 0.15553543067421716, "sim_compute_sim_state": 0.030074067413806915, "sim_compute_performance-ego": 0.05578035116195679, "sim_compute_robot_state-ego": 0.05704943835735321, "sim_compute_robot_state-npc0": 0.06026715785264969, "sim_compute_robot_state-npc1": 0.05553588271141052, "sim_compute_robot_state-npc2": 0.05464760959148407, "sim_compute_robot_state-npc3": 0.05336063355207443}, "udem1-2-0": {"driven_any": 0.5556420301227285, "sim_physics": 0.03112672487894694, "survival_time": 3.7499999999999942, "driven_lanedir": 0.4889045976301556, "sim_render-ego": 0.051865126291910806, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08051202456156413, "deviation-heading": 0.7178167934226656, "set_robot_commands": 0.07338123321533203, "deviation-center-line": 0.2494193891551898, "driven_lanedir_consec": 0.4889045976301556, "sim_compute_sim_state": 0.03129786809285482, "sim_compute_performance-ego": 0.056684172948201494, "sim_compute_robot_state-ego": 0.05729689598083496, "sim_compute_robot_state-npc0": 0.05713977813720703, "sim_compute_robot_state-npc1": 0.05534258842468262, "sim_compute_robot_state-npc2": 0.05578409512837728, "sim_compute_robot_state-npc3": 0.054671192169189455}, "udem1-3-0": {"driven_any": 0.2583086059766794, "sim_physics": 0.06273985536474931, "survival_time": 1.900000000000001, "driven_lanedir": 0.22540980807969113, "sim_render-ego": 0.0794541082884136, "in-drivable-lane": 0, "agent_compute-ego": 0.18203642493800112, "deviation-heading": 0.7281824026055476, "set_robot_commands": 0.10463773576836836, "deviation-center-line": 0.11099666274279454, "driven_lanedir_consec": 0.22540980807969113, "sim_compute_sim_state": 0.04619688736765008, "sim_compute_performance-ego": 0.08150221799549304, "sim_compute_robot_state-ego": 0.0929119022268998, "sim_compute_robot_state-npc0": 0.08220146831713225, "sim_compute_robot_state-npc1": 0.08045024620859247, "sim_compute_robot_state-npc2": 0.07968677345075105, "sim_compute_robot_state-npc3": 0.08207203839954577}, "udem1-4-0": {"driven_any": 1.7931247675942137, "sim_physics": 0.0392562343564096, "survival_time": 11.450000000000028, "driven_lanedir": 1.322879282392715, "sim_render-ego": 0.0645485455292281, "in-drivable-lane": 2.450000000000027, "agent_compute-ego": 0.11939405562055164, "deviation-heading": 2.410473163343411, "set_robot_commands": 0.08955171847447557, "deviation-center-line": 0.8174959711140002, "driven_lanedir_consec": 1.322879282392715, "sim_compute_sim_state": 0.03965831219369147, "sim_compute_performance-ego": 0.06922223682486854, "sim_compute_robot_state-ego": 0.07155061392804941, "sim_compute_robot_state-npc0": 0.07096935463784564, "sim_compute_robot_state-npc1": 0.07025267671809966, "sim_compute_robot_state-npc2": 0.06932447466787812, "sim_compute_robot_state-npc3": 0.06978578338456466}}
set_robot_commands_max0.10463773576836836
set_robot_commands_mean0.08348770675096386
set_robot_commands_median0.07517484448990731
set_robot_commands_min0.07338123321533203
sim_compute_performance-ego_max0.08150221799549304
sim_compute_performance-ego_mean0.06401254421401684
sim_compute_performance-ego_median0.05687374213956437
sim_compute_performance-ego_min0.05578035116195679
sim_compute_robot_state-ego_max0.0929119022268998
sim_compute_robot_state-ego_mean0.06758481203251489
sim_compute_robot_state-ego_median0.05911520966943705
sim_compute_robot_state-ego_min0.05704943835735321
sim_compute_robot_state-npc0_max0.08220146831713225
sim_compute_robot_state-npc0_mean0.06630290136033891
sim_compute_robot_state-npc0_median0.06093674785685989
sim_compute_robot_state-npc0_min0.05713977813720703
sim_compute_robot_state-npc1_max0.08045024620859247
sim_compute_robot_state-npc1_mean0.06407512631909817
sim_compute_robot_state-npc1_median0.05879423753270563
sim_compute_robot_state-npc1_min0.05534258842468262
sim_compute_robot_state-npc2_max0.07968677345075105
sim_compute_robot_state-npc2_mean0.06323912286551628
sim_compute_robot_state-npc2_median0.056752661489090826
sim_compute_robot_state-npc2_min0.05464760959148407
sim_compute_robot_state-npc3_max0.08207203839954577
sim_compute_robot_state-npc3_mean0.06356780031383283
sim_compute_robot_state-npc3_median0.0579493540637898
sim_compute_robot_state-npc3_min0.05336063355207443
sim_compute_sim_state_max0.04619688736765008
sim_compute_sim_state_mean0.035985642703781594
sim_compute_sim_state_median0.032701078450904704
sim_compute_sim_state_min0.030074067413806915
sim_physics_max0.06273985536474931
sim_physics_mean0.038107684681757056
sim_physics_median0.03112672487894694
sim_physics_min0.026714012026786804
sim_render-ego_max0.0794541082884136
sim_render-ego_mean0.06016985760093606
sim_render-ego_median0.053886975882188326
sim_render-ego_min0.05109453201293945
simulation-passed1
survival_time_max11.450000000000028
survival_time_mean4.8000000000000025
survival_time_min1.6000000000000008
186392774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerrorno-0:20:51
Waited 1204 seconds [...]
Waited 1204 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
183022774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:15:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4540502728846909
survival_time_median3.1999999999999966
deviation-center-line_median0.22698975199905927
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11511581391096117
agent_compute-ego_mean0.09323186986788692
agent_compute-ego_median0.08747080362068033
agent_compute-ego_min0.08455282352009758
deviation-center-line_max1.122770328408013
deviation-center-line_mean0.39455694296543414
deviation-center-line_min0.061484482735035824
deviation-heading_max1.7515583150703116
deviation-heading_mean0.8696659578340522
deviation-heading_median0.686281068649473
deviation-heading_min0.6039379396433869
driven_any_max1.9137618835790884
driven_any_mean0.7255472131373584
driven_any_median0.46725830739746904
driven_any_min0.2100687594789937
driven_lanedir_consec_max1.8087658700528475
driven_lanedir_consec_mean0.6823780979841139
driven_lanedir_consec_min0.15553543067421716
driven_lanedir_max1.8087658700528475
driven_lanedir_mean0.6823780979841139
driven_lanedir_median0.4540502728846909
driven_lanedir_min0.15553543067421716
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.09999999999999969
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.8024578660913457, "sim_physics": 0.03052538071038588, "survival_time": 5.299999999999989, "driven_lanedir": 0.7928125336696206, "sim_render-ego": 0.06125773348898258, "in-drivable-lane": 0, "agent_compute-ego": 0.08747080362068033, "deviation-heading": 0.6154549109027005, "set_robot_commands": 0.07589818846504644, "deviation-center-line": 0.46705431232259825, "driven_lanedir_consec": 0.7928125336696206, "sim_compute_sim_state": 0.03523933437635314, "sim_compute_performance-ego": 0.06196665988778168, "sim_compute_robot_state-ego": 0.0601286640707052, "sim_compute_robot_state-npc0": 0.06602599710788366, "sim_compute_robot_state-npc1": 0.0625695507481413, "sim_compute_robot_state-npc2": 0.06155661367020517, "sim_compute_robot_state-npc3": 0.06243032554410539}, "udem1-1-0": {"driven_any": 0.2100687594789937, "sim_physics": 0.029189668595790863, "survival_time": 1.6000000000000008, "driven_lanedir": 0.15553543067421716, "sim_render-ego": 0.06590135395526886, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.11511581391096117, "deviation-heading": 0.686281068649473, "set_robot_commands": 0.07524563372135162, "deviation-center-line": 0.061484482735035824, "driven_lanedir_consec": 0.15553543067421716, "sim_compute_sim_state": 0.036872707307338715, "sim_compute_performance-ego": 0.0642012283205986, "sim_compute_robot_state-ego": 0.06093776226043701, "sim_compute_robot_state-npc0": 0.06836199760437012, "sim_compute_robot_state-npc1": 0.06533607840538025, "sim_compute_robot_state-npc2": 0.06316442042589188, "sim_compute_robot_state-npc3": 0.06404640525579453}, "udem1-2-0": {"driven_any": 0.46725830739746904, "sim_physics": 0.03153824061155319, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4540502728846909, "sim_render-ego": 0.059684041887521744, "in-drivable-lane": 0, "agent_compute-ego": 0.08460836485028267, "deviation-heading": 0.6039379396433869, "set_robot_commands": 0.0737558901309967, "deviation-center-line": 0.22698975199905927, "driven_lanedir_consec": 0.4540502728846909, "sim_compute_sim_state": 0.033066220581531525, "sim_compute_performance-ego": 0.0584699846804142, "sim_compute_robot_state-ego": 0.05842188745737076, "sim_compute_robot_state-npc0": 0.06320219486951828, "sim_compute_robot_state-npc1": 0.05958719179034233, "sim_compute_robot_state-npc2": 0.05928262695670128, "sim_compute_robot_state-npc3": 0.05845487862825394}, "udem1-3-0": {"driven_any": 0.2341892491398951, "sim_physics": 0.027115331377301898, "survival_time": 1.7500000000000009, "driven_lanedir": 0.20072638263919296, "sim_render-ego": 0.06081314086914062, "in-drivable-lane": 0, "agent_compute-ego": 0.0944115434374128, "deviation-heading": 0.6910975549043895, "set_robot_commands": 0.07376283918108259, "deviation-center-line": 0.09448583936246437, "driven_lanedir_consec": 0.20072638263919296, "sim_compute_sim_state": 0.03423896517072405, "sim_compute_performance-ego": 0.06172881807599749, "sim_compute_robot_state-ego": 0.06154407773699079, "sim_compute_robot_state-npc0": 0.06288206917898996, "sim_compute_robot_state-npc1": 0.060037667410714285, "sim_compute_robot_state-npc2": 0.06021124976021903, "sim_compute_robot_state-npc3": 0.061395086560930526}, "udem1-4-0": {"driven_any": 1.9137618835790884, "sim_physics": 0.026373881785596003, "survival_time": 12.200000000000038, "driven_lanedir": 1.8087658700528475, "sim_render-ego": 0.059361923913486665, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08455282352009758, "deviation-heading": 1.7515583150703116, "set_robot_commands": 0.07602553778007383, "deviation-center-line": 1.122770328408013, "driven_lanedir_consec": 1.8087658700528475, "sim_compute_sim_state": 0.03410226497493806, "sim_compute_performance-ego": 0.06041501389175165, "sim_compute_robot_state-ego": 0.05953143268335061, "sim_compute_robot_state-npc0": 0.06430238485336304, "sim_compute_robot_state-npc1": 0.06070162331471678, "sim_compute_robot_state-npc2": 0.05999117405688176, "sim_compute_robot_state-npc3": 0.05972750753652854}}
set_robot_commands_max0.07602553778007383
set_robot_commands_mean0.07493761785571022
set_robot_commands_median0.07524563372135162
set_robot_commands_min0.0737558901309967
sim_compute_performance-ego_max0.0642012283205986
sim_compute_performance-ego_mean0.06135634097130872
sim_compute_performance-ego_median0.06172881807599749
sim_compute_performance-ego_min0.0584699846804142
sim_compute_robot_state-ego_max0.06154407773699079
sim_compute_robot_state-ego_mean0.060112764841770874
sim_compute_robot_state-ego_median0.0601286640707052
sim_compute_robot_state-ego_min0.05842188745737076
sim_compute_robot_state-npc0_max0.06836199760437012
sim_compute_robot_state-npc0_mean0.06495492872282502
sim_compute_robot_state-npc0_median0.06430238485336304
sim_compute_robot_state-npc0_min0.06288206917898996
sim_compute_robot_state-npc1_max0.06533607840538025
sim_compute_robot_state-npc1_mean0.06164642233385899
sim_compute_robot_state-npc1_median0.06070162331471678
sim_compute_robot_state-npc1_min0.05958719179034233
sim_compute_robot_state-npc2_max0.06316442042589188
sim_compute_robot_state-npc2_mean0.06084121697397983
sim_compute_robot_state-npc2_median0.06021124976021903
sim_compute_robot_state-npc2_min0.05928262695670128
sim_compute_robot_state-npc3_max0.06404640525579453
sim_compute_robot_state-npc3_mean0.06121084070512258
sim_compute_robot_state-npc3_median0.061395086560930526
sim_compute_robot_state-npc3_min0.05845487862825394
sim_compute_sim_state_max0.036872707307338715
sim_compute_sim_state_mean0.0347038984821771
sim_compute_sim_state_median0.03423896517072405
sim_compute_sim_state_min0.033066220581531525
sim_physics_max0.03153824061155319
sim_physics_mean0.02894850061612557
sim_physics_median0.029189668595790863
sim_physics_min0.026373881785596003
sim_render-ego_max0.06590135395526886
sim_render-ego_mean0.061403638822880094
sim_render-ego_median0.06081314086914062
sim_render-ego_min0.059361923913486665
simulation-passed1
survival_time_max12.200000000000038
survival_time_mean4.810000000000005
survival_time_min1.6000000000000008
181142774Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationsuccessno-0:19:04Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4889943633784548
survival_time_median1.950000000000001
deviation-center-line_median0.08659758588892237
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.1685032844543457
agent_compute-ego_mean0.12331817828902727
agent_compute-ego_median0.1141039652702136
agent_compute-ego_min0.10138110045729012
deviation-center-line_max0.9923366481853576
deviation-center-line_mean0.2782537710548752
deviation-center-line_min0.010776416729113076
deviation-heading_max2.1179065227298635
deviation-heading_mean0.7331846624671297
deviation-heading_median0.3455394508313924
deviation-heading_min0.19766162675531468
driven_any_max3.550213317634584
driven_any_mean1.1659213814568978
driven_any_median0.6260681720816922
driven_any_min0.19214123254178303
driven_lanedir_consec_max2.345131808668012
driven_lanedir_consec_mean0.7984471252078583
driven_lanedir_consec_min0.0943513509863787
driven_lanedir_max3.346128622167555
driven_lanedir_mean0.999005194385824
driven_lanedir_median0.4889943633784548
driven_lanedir_min0.0943513509863787
in-drivable-lane_max1.050000000000001
in-drivable-lane_mean0.34
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.9159310553654052, "sim_physics": 0.04759716165476832, "survival_time": 2.8999999999999977, "driven_lanedir": 0.9072675893139894, "sim_render-ego": 0.06833624017649684, "in-drivable-lane": 0, "agent_compute-ego": 0.10138110045729012, "deviation-heading": 0.3455394508313924, "set_robot_commands": 0.10678188143105342, "deviation-center-line": 0.2804936636899147, "driven_lanedir_consec": 0.9071398385423646, "sim_compute_sim_state": 0.042139521960554455, "sim_compute_performance-ego": 0.07626718077166326, "sim_compute_robot_state-ego": 0.08312268503781023, "sim_compute_robot_state-npc0": 0.07482445651087268, "sim_compute_robot_state-npc1": 0.07980960401995428, "sim_compute_robot_state-npc2": 0.07697458924918339, "sim_compute_robot_state-npc3": 0.0762782096862793}, "udem1-1-0": {"driven_any": 0.19214123254178303, "sim_physics": 0.04741472005844116, "survival_time": 0.6, "driven_lanedir": 0.0943513509863787, "sim_render-ego": 0.07465686400731404, "in-drivable-lane": 0.2, "agent_compute-ego": 0.1685032844543457, "deviation-heading": 0.19766162675531468, "set_robot_commands": 0.10943361123402912, "deviation-center-line": 0.010776416729113076, "driven_lanedir_consec": 0.0943513509863787, "sim_compute_sim_state": 0.04257923364639282, "sim_compute_performance-ego": 0.07294150193532307, "sim_compute_robot_state-ego": 0.08287692070007324, "sim_compute_robot_state-npc0": 0.07212990522384644, "sim_compute_robot_state-npc1": 0.07504679759343465, "sim_compute_robot_state-npc2": 0.0773742397626241, "sim_compute_robot_state-npc3": 0.07496865590413411}, "udem1-2-0": {"driven_any": 0.6260681720816922, "sim_physics": 0.04567972207680727, "survival_time": 1.950000000000001, "driven_lanedir": 0.4889943633784548, "sim_render-ego": 0.07326961786319049, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1141039652702136, "deviation-heading": 0.7099954996867134, "set_robot_commands": 0.11429334909487994, "deviation-center-line": 0.08659758588892237, "driven_lanedir_consec": 0.4889943633784548, "sim_compute_sim_state": 0.042713104150234125, "sim_compute_performance-ego": 0.07549309730529785, "sim_compute_robot_state-ego": 0.08206507487174793, "sim_compute_robot_state-npc0": 0.07529318638336964, "sim_compute_robot_state-npc1": 0.07245400624397473, "sim_compute_robot_state-npc2": 0.07455669916593112, "sim_compute_robot_state-npc3": 0.07534046050829765}, "udem1-3-0": {"driven_any": 3.550213317634584, "sim_physics": 0.04360535349781157, "survival_time": 11.050000000000022, "driven_lanedir": 3.346128622167555, "sim_render-ego": 0.07159861396340762, "in-drivable-lane": 0.2499999999999991, "agent_compute-ego": 0.10692994842701908, "deviation-heading": 2.1179065227298635, "set_robot_commands": 0.1094053169181444, "deviation-center-line": 0.9923366481853576, "driven_lanedir_consec": 2.345131808668012, "sim_compute_sim_state": 0.04260825571431294, "sim_compute_performance-ego": 0.07507655955008252, "sim_compute_robot_state-ego": 0.07927901712478017, "sim_compute_robot_state-npc0": 0.07420145224661849, "sim_compute_robot_state-npc1": 0.07475449704476611, "sim_compute_robot_state-npc2": 0.07512265416831453, "sim_compute_robot_state-npc3": 0.07625872409181897}, "udem1-4-0": {"driven_any": 0.545253129661026, "sim_physics": 0.04523324966430664, "survival_time": 1.7000000000000008, "driven_lanedir": 0.15828404608274127, "sim_render-ego": 0.07110638478223015, "in-drivable-lane": 1.050000000000001, "agent_compute-ego": 0.1256725928362678, "deviation-heading": 0.2948202123323641, "set_robot_commands": 0.099678355104783, "deviation-center-line": 0.02106454078106815, "driven_lanedir_consec": 0.15661826446408167, "sim_compute_sim_state": 0.04149613660924575, "sim_compute_performance-ego": 0.06872134348925422, "sim_compute_robot_state-ego": 0.07420431165134206, "sim_compute_robot_state-npc0": 0.06880677447599523, "sim_compute_robot_state-npc1": 0.07242430658901439, "sim_compute_robot_state-npc2": 0.07345682031968061, "sim_compute_robot_state-npc3": 0.07340164745555204}}
set_robot_commands_max0.11429334909487994
set_robot_commands_mean0.10791850275657797
set_robot_commands_median0.1094053169181444
set_robot_commands_min0.099678355104783
sim_compute_performance-ego_max0.07626718077166326
sim_compute_performance-ego_mean0.07369993661032419
sim_compute_performance-ego_median0.07507655955008252
sim_compute_performance-ego_min0.06872134348925422
sim_compute_robot_state-ego_max0.08312268503781023
sim_compute_robot_state-ego_mean0.08030960187715072
sim_compute_robot_state-ego_median0.08206507487174793
sim_compute_robot_state-ego_min0.07420431165134206
sim_compute_robot_state-npc0_max0.07529318638336964
sim_compute_robot_state-npc0_mean0.07305115496814049
sim_compute_robot_state-npc0_median0.07420145224661849
sim_compute_robot_state-npc0_min0.06880677447599523
sim_compute_robot_state-npc1_max0.07980960401995428
sim_compute_robot_state-npc1_mean0.07489784229822884
sim_compute_robot_state-npc1_median0.07475449704476611
sim_compute_robot_state-npc1_min0.07242430658901439
sim_compute_robot_state-npc2_max0.0773742397626241
sim_compute_robot_state-npc2_mean0.07549700053314676
sim_compute_robot_state-npc2_median0.07512265416831453
sim_compute_robot_state-npc2_min0.07345682031968061
sim_compute_robot_state-npc3_max0.0762782096862793
sim_compute_robot_state-npc3_mean0.07524953952921641
sim_compute_robot_state-npc3_median0.07534046050829765
sim_compute_robot_state-npc3_min0.07340164745555204
sim_compute_sim_state_max0.042713104150234125
sim_compute_sim_state_mean0.042307250416148016
sim_compute_sim_state_median0.04257923364639282
sim_compute_sim_state_min0.04149613660924575
sim_physics_max0.04759716165476832
sim_physics_mean0.04590604139042699
sim_physics_median0.04567972207680727
sim_physics_min0.04360535349781157
sim_render-ego_max0.07465686400731404
sim_render-ego_mean0.07179354415852782
sim_render-ego_median0.07159861396340762
sim_render-ego_min0.06833624017649684
simulation-passed1
survival_time_max11.050000000000022
survival_time_mean3.640000000000004
survival_time_min0.6