AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1207

evaluator1207
ownerI don't have one 😀
machineip-172-31-40-253
processip-172-31-40-253-3847
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success14
# timeout
# failed
# error13
# aborted
# host-error1
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors91%
RAM total (MB)60.0 GB
RAM free (MB)56.4 GB
Disk (MB)96.9 GB
Disk available (MB)46.1 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230783553AmaurXRunning the real lane following -- without challenge containeraido2-LFV-sim-testingstep1-simulationerroryes12070:06:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230192377Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-testingstep1-simulationsuccessyes12070:29:27(hidden)
driven_lanedir_consec_median0.4295977528045558
survival_time_median3.7499999999999942
deviation-center-line_median0.16525966154163726
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.06964980810880661
agent_compute-ego_mean0.06370677889882928
agent_compute-ego_median0.06426587525536032
agent_compute-ego_min0.057423023240906854
deviation-center-line_max0.44830395948846297
deviation-center-line_mean0.17891237550140934
deviation-center-line_min0.10012774388669717
deviation-heading_max1.272726254754917
deviation-heading_mean0.5883512828498624
deviation-heading_median0.5156622477370731
deviation-heading_min0.2495279988048577
driven_any_max2.0298273185719493
driven_any_mean1.0098349503422042
driven_any_median1.0248273191286312
driven_any_min0.3648701917101209
driven_lanedir_consec_max1.211071354427033
driven_lanedir_consec_mean0.6125599618319294
driven_lanedir_consec_min0.32721267753615213
driven_lanedir_max1.211071354427033
driven_lanedir_mean0.6125599618319294
driven_lanedir_median0.4295977528045558
driven_lanedir_min0.32721267753615213
in-drivable-lane_max4.249999999999985
in-drivable-lane_mean1.2033333333333296
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1771785461739318, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.06237254077441072, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.05988680826474543, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.09804084203014636, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03707967718986616, "sim_compute_performance-ego": 0.06854550805810379, "sim_compute_robot_state-ego": 0.07130100302500268, "sim_compute_robot_state-npc0": 0.06536698014768835, "sim_compute_robot_state-npc1": 0.06764278019944282, "sim_compute_robot_state-npc2": 0.06680025139900103, "sim_compute_robot_state-npc3": 0.06765945316994026}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.15756037428572373, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.057813180459512246, "in-drivable-lane": 0, "agent_compute-ego": 0.05954426043742412, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.0911558061032682, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03551011472134977, "sim_compute_performance-ego": 0.06391222412521774, "sim_compute_robot_state-ego": 0.061564419720623945, "sim_compute_robot_state-npc0": 0.06724905967712402, "sim_compute_robot_state-npc1": 0.06741528253297548, "sim_compute_robot_state-npc2": 0.06371018048879262, "sim_compute_robot_state-npc3": 0.06160971280690786}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.15979171650750296, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.0552915803023747, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.057423023240906854, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.08544308585780007, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.035165171538080485, "sim_compute_performance-ego": 0.06372510748250144, "sim_compute_robot_state-ego": 0.06820572912693024, "sim_compute_robot_state-npc0": 0.0632713862827846, "sim_compute_robot_state-npc1": 0.06357124447822571, "sim_compute_robot_state-npc2": 0.06469536253384181, "sim_compute_robot_state-npc3": 0.06355673926217216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.1658642590045929, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.06572959678513664, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06011446458952768, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.09424558069024767, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03822559118270874, "sim_compute_performance-ego": 0.06436075695923396, "sim_compute_robot_state-ego": 0.0696533705507006, "sim_compute_robot_state-npc0": 0.06921209820679255, "sim_compute_robot_state-npc1": 0.06812990989003863, "sim_compute_robot_state-npc2": 0.06855521031788417, "sim_compute_robot_state-npc3": 0.06976360508373805}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.19080091267824173, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06563552469015121, "in-drivable-lane": 0, "agent_compute-ego": 0.06964980810880661, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.10518090426921844, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04264979809522629, "sim_compute_performance-ego": 0.07319007068872452, "sim_compute_robot_state-ego": 0.08477694541215897, "sim_compute_robot_state-npc0": 0.07423854619264603, "sim_compute_robot_state-npc1": 0.07672356069087982, "sim_compute_robot_state-npc2": 0.07665587216615677, "sim_compute_robot_state-npc3": 0.07560074329376221}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0548273189057833, "sim_physics": 0.17475623279422908, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3963714216744775, "sim_render-ego": 0.06475336830337326, "in-drivable-lane": 1.7499999999999971, "agent_compute-ego": 0.0659879833072811, "deviation-heading": 1.272726254754917, "set_robot_commands": 0.10176002205192268, "deviation-center-line": 0.20372147663934215, "driven_lanedir_consec": 0.3963714216744775, "sim_compute_sim_state": 0.038688953820761145, "sim_compute_performance-ego": 0.0734505219893022, "sim_compute_robot_state-ego": 0.07970291298705262, "sim_compute_robot_state-npc0": 0.07148391859872001, "sim_compute_robot_state-npc1": 0.0722972262989391, "sim_compute_robot_state-npc2": 0.07119433601181228, "sim_compute_robot_state-npc3": 0.06829344452201545}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9948273195001682, "sim_physics": 0.15652815609762114, "survival_time": 3.649999999999995, "driven_lanedir": 0.6530046235032079, "sim_render-ego": 0.06115302321029036, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06394566248541009, "deviation-heading": 0.8187446392859457, "set_robot_commands": 0.09614379765236214, "deviation-center-line": 0.19436286934102945, "driven_lanedir_consec": 0.6530046235032079, "sim_compute_sim_state": 0.03885316195553296, "sim_compute_performance-ego": 0.0688059199346255, "sim_compute_robot_state-ego": 0.07318120786588486, "sim_compute_robot_state-npc0": 0.06661191051953459, "sim_compute_robot_state-npc1": 0.06965935393555524, "sim_compute_robot_state-npc2": 0.07111017997950723, "sim_compute_robot_state-npc3": 0.07129546060954055}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.0298273185719493, "sim_physics": 0.18736032700874436, "survival_time": 7.099999999999983, "driven_lanedir": 0.741234184731216, "sim_render-ego": 0.06407987399840019, "in-drivable-lane": 4.249999999999985, "agent_compute-ego": 0.06563132413676087, "deviation-heading": 0.5416787058937298, "set_robot_commands": 0.10116228083489646, "deviation-center-line": 0.21649269357451997, "driven_lanedir_consec": 0.741234184731216, "sim_compute_sim_state": 0.04147259953995826, "sim_compute_performance-ego": 0.0718407714870614, "sim_compute_robot_state-ego": 0.07872488297207254, "sim_compute_robot_state-npc0": 0.07170204713310994, "sim_compute_robot_state-npc1": 0.07100059952534421, "sim_compute_robot_state-npc2": 0.07251831847177424, "sim_compute_robot_state-npc3": 0.07284513997360015}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0248273191286528, "sim_physics": 0.15889360109965006, "survival_time": 3.7499999999999942, "driven_lanedir": 0.38223306402252977, "sim_render-ego": 0.0633326816558838, "in-drivable-lane": 2.099999999999994, "agent_compute-ego": 0.06563564618428548, "deviation-heading": 0.41826512024881946, "set_robot_commands": 0.09921127319335936, "deviation-center-line": 0.14440586530294292, "driven_lanedir_consec": 0.38223306402252977, "sim_compute_sim_state": 0.03951605478922526, "sim_compute_performance-ego": 0.0712567965189616, "sim_compute_robot_state-ego": 0.0756987476348877, "sim_compute_robot_state-npc0": 0.06900405883789062, "sim_compute_robot_state-npc1": 0.06913928667704264, "sim_compute_robot_state-npc2": 0.0713950252532959, "sim_compute_robot_state-npc3": 0.07011337916056315}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.4548365617710395, "sim_physics": 0.1733114139453785, "survival_time": 1.850000000000001, "driven_lanedir": 0.43889108545437505, "sim_render-ego": 0.0582147031217008, "in-drivable-lane": 0, "agent_compute-ego": 0.060069573892129434, "deviation-heading": 0.491310634741224, "set_robot_commands": 0.0996196849926098, "deviation-center-line": 0.11665316537398888, "driven_lanedir_consec": 0.43889108545437505, "sim_compute_sim_state": 0.039001426181277714, "sim_compute_performance-ego": 0.06872554083128234, "sim_compute_robot_state-ego": 0.07258920411805848, "sim_compute_robot_state-npc0": 0.0674774389009218, "sim_compute_robot_state-npc1": 0.06595929893287453, "sim_compute_robot_state-npc2": 0.06922377766789617, "sim_compute_robot_state-npc3": 0.06950911960086308}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3648701917101209, "sim_physics": 0.22243431306654407, "survival_time": 1.5500000000000007, "driven_lanedir": 0.34552145550754965, "sim_render-ego": 0.06407014016182191, "in-drivable-lane": 0, "agent_compute-ego": 0.06653946445834252, "deviation-heading": 0.5070424162880827, "set_robot_commands": 0.10276282987286968, "deviation-center-line": 0.10012774388669717, "driven_lanedir_consec": 0.34552145550754965, "sim_compute_sim_state": 0.04073271443766932, "sim_compute_performance-ego": 0.07401910135822912, "sim_compute_robot_state-ego": 0.0854919264393468, "sim_compute_robot_state-npc0": 0.07244193938470656, "sim_compute_robot_state-npc1": 0.0733921604771768, "sim_compute_robot_state-npc2": 0.0719542887903029, "sim_compute_robot_state-npc3": 0.06869043073346538}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4098472254790875, "sim_physics": 0.1617263064664953, "survival_time": 1.7000000000000008, "driven_lanedir": 0.4054410153244894, "sim_render-ego": 0.06064285250271067, "in-drivable-lane": 0, "agent_compute-ego": 0.06426587525536032, "deviation-heading": 0.2495279988048577, "set_robot_commands": 0.09466158642488368, "deviation-center-line": 0.16731811540993266, "driven_lanedir_consec": 0.4054410153244894, "sim_compute_sim_state": 0.03822943743537454, "sim_compute_performance-ego": 0.06986604017369888, "sim_compute_robot_state-ego": 0.0754256528966567, "sim_compute_robot_state-npc0": 0.06775200366973877, "sim_compute_robot_state-npc1": 0.06844136294196634, "sim_compute_robot_state-npc2": 0.06934970967909869, "sim_compute_robot_state-npc3": 0.0722207041347728}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0248273191286312, "sim_physics": 0.1479312260945638, "survival_time": 3.7499999999999942, "driven_lanedir": 0.32721267753615213, "sim_render-ego": 0.05926061630249024, "in-drivable-lane": 2.299999999999994, "agent_compute-ego": 0.06370999018351237, "deviation-heading": 0.3112188917063982, "set_robot_commands": 0.09476211229960124, "deviation-center-line": 0.16525966154163726, "driven_lanedir_consec": 0.32721267753615213, "sim_compute_sim_state": 0.03852919896443685, "sim_compute_performance-ego": 0.06767628033955891, "sim_compute_robot_state-ego": 0.07201109250386556, "sim_compute_robot_state-npc0": 0.06804041862487793, "sim_compute_robot_state-npc1": 0.07024582227071126, "sim_compute_robot_state-npc2": 0.06791179974873861, "sim_compute_robot_state-npc3": 0.06832898457845052}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.5798273185719856, "sim_physics": 0.1685384682246617, "survival_time": 5.599999999999988, "driven_lanedir": 1.211071354427033, "sim_render-ego": 0.06312943143504006, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.06784123820917946, "deviation-heading": 1.0143384205991224, "set_robot_commands": 0.09629139517034804, "deviation-center-line": 0.44830395948846297, "driven_lanedir_consec": 1.211071354427033, "sim_compute_sim_state": 0.03901236397879464, "sim_compute_performance-ego": 0.06798134318419866, "sim_compute_robot_state-ego": 0.07704817823001317, "sim_compute_robot_state-npc0": 0.06915429447378431, "sim_compute_robot_state-npc1": 0.06981987186840602, "sim_compute_robot_state-npc2": 0.06979520193168096, "sim_compute_robot_state-npc3": 0.06876347533294133}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.2198273185919868, "sim_physics": 0.2065768377347426, "survival_time": 4.399999999999992, "driven_lanedir": 0.41711373203649504, "sim_render-ego": 0.06569519909945401, "in-drivable-lane": 2.5999999999999917, "agent_compute-ego": 0.06535656072876671, "deviation-heading": 0.5811284097850438, "set_robot_commands": 0.10416370088403876, "deviation-center-line": 0.13226882250813252, "driven_lanedir_consec": 0.41711373203649504, "sim_compute_sim_state": 0.04150789705189792, "sim_compute_performance-ego": 0.07480762763456865, "sim_compute_robot_state-ego": 0.0860214585607702, "sim_compute_robot_state-npc0": 0.07220091332088817, "sim_compute_robot_state-npc1": 0.07444809783588756, "sim_compute_robot_state-npc2": 0.0753856518051841, "sim_compute_robot_state-npc3": 0.07300882718779823}}
set_robot_commands_max0.10518090426921844
set_robot_commands_mean0.09764032682183818
set_robot_commands_median0.09804084203014636
set_robot_commands_min0.08544308585780007
sim_compute_performance-ego_max0.07480762763456865
sim_compute_performance-ego_mean0.0694775740510179
sim_compute_performance-ego_median0.0688059199346255
sim_compute_performance-ego_min0.06372510748250144
sim_compute_robot_state-ego_max0.0860214585607702
sim_compute_robot_state-ego_mean0.075426448802935
sim_compute_robot_state-ego_median0.0754256528966567
sim_compute_robot_state-ego_min0.061564419720623945
sim_compute_robot_state-npc0_max0.07423854619264603
sim_compute_robot_state-npc0_mean0.06901380093141388
sim_compute_robot_state-npc0_median0.06900405883789062
sim_compute_robot_state-npc0_min0.0632713862827846
sim_compute_robot_state-npc1_max0.07672356069087982
sim_compute_robot_state-npc1_mean0.06985905723703106
sim_compute_robot_state-npc1_median0.06965935393555524
sim_compute_robot_state-npc1_min0.06357124447822571
sim_compute_robot_state-npc2_max0.07665587216615677
sim_compute_robot_state-npc2_mean0.07001701108299783
sim_compute_robot_state-npc2_median0.06979520193168096
sim_compute_robot_state-npc2_min0.06371018048879262
sim_compute_robot_state-npc3_max0.07560074329376221
sim_compute_robot_state-npc3_mean0.06941728129670208
sim_compute_robot_state-npc3_median0.06950911960086308
sim_compute_robot_state-npc3_min0.06160971280690786
sim_compute_sim_state_max0.04264979809522629
sim_compute_sim_state_mean0.03894494405881067
sim_compute_sim_state_median0.03885316195553296
sim_compute_sim_state_min0.035165171538080485
sim_physics_max0.22243431306654407
sim_physics_mean0.1739501794121749
sim_physics_median0.1685384682246617
sim_physics_min0.1479312260945638
sim_render-ego_max0.06572959678513664
sim_render-ego_mean0.062078287520183385
sim_render-ego_median0.06312943143504006
sim_render-ego_min0.0552915803023747
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean3.6999999999999944
survival_time_min1.5500000000000007
230132386Andrea CensiBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessyes12070:05:56(hidden)
driven_lanedir_consec_median0.10243356431880146
survival_time_median1.2000000000000004
deviation-center-line_median0.09139112657864563
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1808286820139204
agent_compute-ego_mean0.17302257988876077
agent_compute-ego_median0.17710119485855105
agent_compute-ego_min0.16251902146772904
deviation-center-line_max0.10065287437833442
deviation-center-line_mean0.08036808080754614
deviation-center-line_min0.05294630778405477
deviation-heading_max0.8604781208701127
deviation-heading_mean0.7000878458600679
deviation-heading_median0.8421934669579203
deviation-heading_min0.45821945989996904
driven_any_max0.23210399873603735
driven_any_mean0.17369759877143962
driven_any_median0.1496532208666917
driven_any_min0.13200129962281487
driven_lanedir_consec_max0.1520497363763882
driven_lanedir_consec_mean0.1069820585065818
driven_lanedir_consec_min0.06838962042552188
driven_lanedir_max0.1520497363763882
driven_lanedir_mean0.1069820585065818
driven_lanedir_median0.10243356431880146
driven_lanedir_min0.06838962042552188
in-drivable-lane_max0.5000000000000004
in-drivable-lane_mean0.1100000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23210399873603735, "sim_physics": 0.200907792363848, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1520497363763882, "sim_render-ego": 0.06342545577457973, "in-drivable-lane": 0, "agent_compute-ego": 0.1808286820139204, "deviation-heading": 0.8604781208701127, "set_robot_commands": 0.10670325585774013, "deviation-center-line": 0.09139112657864563, "driven_lanedir_consec": 0.1520497363763882, "sim_compute_sim_state": 0.04205132382256644, "sim_compute_performance-ego": 0.07077802079064506, "sim_compute_robot_state-ego": 0.08166083267756871, "sim_compute_robot_state-npc0": 0.07369688579014369, "sim_compute_robot_state-npc1": 0.07248187065124512, "sim_compute_robot_state-npc2": 0.07510006427764893, "sim_compute_robot_state-npc3": 0.07088339328765869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22071879784110057, "sim_physics": 0.17836886463743268, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09305503935479333, "sim_render-ego": 0.06477712139938817, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.16740612550215286, "deviation-heading": 0.8448485042809317, "set_robot_commands": 0.09423562252160277, "deviation-center-line": 0.06281944109801588, "driven_lanedir_consec": 0.09305503935479333, "sim_compute_sim_state": 0.04083128408952193, "sim_compute_performance-ego": 0.07558307503208969, "sim_compute_robot_state-ego": 0.07522903789173473, "sim_compute_robot_state-npc0": 0.0733338486064564, "sim_compute_robot_state-npc1": 0.07154359962000992, "sim_compute_robot_state-npc2": 0.06824237650090997, "sim_compute_robot_state-npc3": 0.0687015201106216}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13200129962281487, "sim_physics": 0.1768371517008001, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10243356431880146, "sim_render-ego": 0.05487381328235973, "in-drivable-lane": 0, "agent_compute-ego": 0.16251902146772904, "deviation-heading": 0.45821945989996904, "set_robot_commands": 0.0978654297915372, "deviation-center-line": 0.09403065419867994, "driven_lanedir_consec": 0.10243356431880146, "sim_compute_sim_state": 0.04089112715287642, "sim_compute_performance-ego": 0.07085185701196844, "sim_compute_robot_state-ego": 0.07382699576291171, "sim_compute_robot_state-npc0": 0.0687356645410711, "sim_compute_robot_state-npc1": 0.07203943079168146, "sim_compute_robot_state-npc2": 0.07016009634191339, "sim_compute_robot_state-npc3": 0.07000279426574707}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1496532208666917, "sim_physics": 0.20780510703722635, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11898233205740416, "sim_render-ego": 0.06614850958188374, "in-drivable-lane": 0, "agent_compute-ego": 0.1772578756014506, "deviation-heading": 0.4946996772914054, "set_robot_commands": 0.09590362509091696, "deviation-center-line": 0.10065287437833442, "driven_lanedir_consec": 0.11898233205740416, "sim_compute_sim_state": 0.03983258207639059, "sim_compute_performance-ego": 0.07439212997754414, "sim_compute_robot_state-ego": 0.08086741964022319, "sim_compute_robot_state-npc0": 0.07047455509503682, "sim_compute_robot_state-npc1": 0.0720101793607076, "sim_compute_robot_state-npc2": 0.0734884242216746, "sim_compute_robot_state-npc3": 0.07002477844556172}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13401067679055356, "sim_physics": 0.20198566714922583, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06838962042552188, "sim_render-ego": 0.06537866592407227, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17710119485855105, "deviation-heading": 0.8421934669579203, "set_robot_commands": 0.10286795099576314, "deviation-center-line": 0.05294630778405477, "driven_lanedir_consec": 0.06838962042552188, "sim_compute_sim_state": 0.04173702001571655, "sim_compute_performance-ego": 0.07035640875498454, "sim_compute_robot_state-ego": 0.07967092593510945, "sim_compute_robot_state-npc0": 0.07127020756403606, "sim_compute_robot_state-npc1": 0.06994714339574178, "sim_compute_robot_state-npc2": 0.0691079596678416, "sim_compute_robot_state-npc3": 0.0779515008131663}}
set_robot_commands_max0.10670325585774013
set_robot_commands_mean0.09951517685151204
set_robot_commands_median0.0978654297915372
set_robot_commands_min0.09423562252160277
sim_compute_performance-ego_max0.07558307503208969
sim_compute_performance-ego_mean0.07239229831344637
sim_compute_performance-ego_median0.07085185701196844
sim_compute_performance-ego_min0.07035640875498454
sim_compute_robot_state-ego_max0.08166083267756871
sim_compute_robot_state-ego_mean0.07825104238150955
sim_compute_robot_state-ego_median0.07967092593510945
sim_compute_robot_state-ego_min0.07382699576291171
sim_compute_robot_state-npc0_max0.07369688579014369
sim_compute_robot_state-npc0_mean0.07150223231934881
sim_compute_robot_state-npc0_median0.07127020756403606
sim_compute_robot_state-npc0_min0.0687356645410711
sim_compute_robot_state-npc1_max0.07248187065124512
sim_compute_robot_state-npc1_mean0.07160444476387717
sim_compute_robot_state-npc1_median0.0720101793607076
sim_compute_robot_state-npc1_min0.06994714339574178
sim_compute_robot_state-npc2_max0.07510006427764893
sim_compute_robot_state-npc2_mean0.0712197842019977
sim_compute_robot_state-npc2_median0.07016009634191339
sim_compute_robot_state-npc2_min0.06824237650090997
sim_compute_robot_state-npc3_max0.0779515008131663
sim_compute_robot_state-npc3_mean0.07151279738455107
sim_compute_robot_state-npc3_median0.07002477844556172
sim_compute_robot_state-npc3_min0.0687015201106216
sim_compute_sim_state_max0.04205132382256644
sim_compute_sim_state_mean0.041068667431414387
sim_compute_sim_state_median0.04089112715287642
sim_compute_sim_state_min0.03983258207639059
sim_physics_max0.20780510703722635
sim_physics_mean0.1931809165777066
sim_physics_median0.200907792363848
sim_physics_min0.1768371517008001
sim_render-ego_max0.06614850958188374
sim_render-ego_mean0.06292071319245672
sim_render-ego_median0.06477712139938817
sim_render-ego_min0.05487381328235973
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3100000000000005
survival_time_min1.1000000000000003
230092392Liam Paullrandom_agentaido2-LF-sim-validationstep1-simulationsuccessyes12070:05:39(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.147974910736084
agent_compute-ego_mean0.1400220173585139
agent_compute-ego_median0.13719997582612214
agent_compute-ego_min0.134748052148258
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12067676473546912, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06234610963750769, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13719997582612214, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10635624991522896, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.039837554649070454, "sim_compute_performance-ego": 0.06790813251777932, "sim_compute_robot_state-ego": 0.07909512961352314}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12434901910669664, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06588711925581389, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14472055435180664, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10400188202951469, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.039982753641465134, "sim_compute_performance-ego": 0.07500831286112468, "sim_compute_robot_state-ego": 0.09299260027268354}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.1250608247869155, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06290493291967056, "in-drivable-lane": 0, "agent_compute-ego": 0.134748052148258, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10046989777508904, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04130216205821318, "sim_compute_performance-ego": 0.0716552033143885, "sim_compute_robot_state-ego": 0.08087672906763413}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.12533047676086426, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06287504196166992, "in-drivable-lane": 0, "agent_compute-ego": 0.147974910736084, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0980360221862793, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.039474048614501954, "sim_compute_performance-ego": 0.07103989601135254, "sim_compute_robot_state-ego": 0.08389497756958007}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09968359259110464, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06383277494696123, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1354665937302988, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0965078571174718, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037422952772695806, "sim_compute_performance-ego": 0.07034353666667696, "sim_compute_robot_state-ego": 0.0752665543858009}}
set_robot_commands_max0.10635624991522896
set_robot_commands_mean0.10107438180471676
set_robot_commands_median0.10046989777508904
set_robot_commands_min0.0965078571174718
sim_compute_performance-ego_max0.07500831286112468
sim_compute_performance-ego_mean0.0711910162742644
sim_compute_performance-ego_median0.07103989601135254
sim_compute_performance-ego_min0.06790813251777932
sim_compute_robot_state-ego_max0.09299260027268354
sim_compute_robot_state-ego_mean0.08242519818184435
sim_compute_robot_state-ego_median0.08087672906763413
sim_compute_robot_state-ego_min0.0752665543858009
sim_compute_sim_state_max0.04130216205821318
sim_compute_sim_state_mean0.039603894347189306
sim_compute_sim_state_median0.039837554649070454
sim_compute_sim_state_min0.037422952772695806
sim_physics_max0.12533047676086426
sim_physics_mean0.11902013559621
sim_physics_median0.12434901910669664
sim_physics_min0.09968359259110464
sim_render-ego_max0.06588711925581389
sim_render-ego_mean0.06356919574432465
sim_render-ego_median0.06290493291967056
sim_render-ego_min0.06234610963750769
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
229972407vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerroryes12070:06:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229722443Jacopo Tanirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessyes12070:31:01(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16722194506571844
agent_compute-ego_mean0.156397677146723
agent_compute-ego_median0.15397003330761874
agent_compute-ego_min0.14718160846016623
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1842850944663905, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06257108797000933, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15397003330761874, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09476546396183062, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.035986658893054045, "sim_compute_performance-ego": 0.06804596623287926, "sim_compute_robot_state-ego": 0.07399900351898579, "sim_compute_robot_state-npc0": 0.06907651997819732, "sim_compute_robot_state-npc1": 0.07032777991475939, "sim_compute_robot_state-npc2": 0.06592767449873912, "sim_compute_robot_state-npc3": 0.06460548050795929}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2283307569367545, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06655513388769967, "in-drivable-lane": 0, "agent_compute-ego": 0.1666585717882429, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10015562602451868, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04201396022524152, "sim_compute_performance-ego": 0.0713720406804766, "sim_compute_robot_state-ego": 0.0824567334992545, "sim_compute_robot_state-npc0": 0.07094841344015938, "sim_compute_robot_state-npc1": 0.0742525543485369, "sim_compute_robot_state-npc2": 0.07209922586168561, "sim_compute_robot_state-npc3": 0.07609885931015015}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.19834946891636523, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0695742472861577, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16305812122752367, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10040039692110228, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04040974320717229, "sim_compute_performance-ego": 0.07102754046616044, "sim_compute_robot_state-ego": 0.07676100267947299, "sim_compute_robot_state-npc0": 0.0719196009404451, "sim_compute_robot_state-npc1": 0.07141532944244089, "sim_compute_robot_state-npc2": 0.0726843296902851, "sim_compute_robot_state-npc3": 0.07345060468877404}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.1931402335564295, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05889975527922312, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15390782058238983, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.0977311929066976, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.038101136684417725, "sim_compute_performance-ego": 0.06988384823004405, "sim_compute_robot_state-ego": 0.07611844937006633, "sim_compute_robot_state-npc0": 0.06970613201459248, "sim_compute_robot_state-npc1": 0.07253833611806233, "sim_compute_robot_state-npc2": 0.06788947681585948, "sim_compute_robot_state-npc3": 0.06834089756011963}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1980260894412086, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06301837875729516, "in-drivable-lane": 0, "agent_compute-ego": 0.15897234280904135, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.095352570215861, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03782377924237933, "sim_compute_performance-ego": 0.07013080233619326, "sim_compute_robot_state-ego": 0.07363406817118327, "sim_compute_robot_state-npc0": 0.06980569022042411, "sim_compute_robot_state-npc1": 0.07261940411158971, "sim_compute_robot_state-npc2": 0.07008000782557897, "sim_compute_robot_state-npc3": 0.06836785588945661}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.203996215751785, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06271861127750603, "in-drivable-lane": 2, "agent_compute-ego": 0.15800981892797047, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.09801517989107236, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04001798030145154, "sim_compute_performance-ego": 0.07133056303698146, "sim_compute_robot_state-ego": 0.07863844511751643, "sim_compute_robot_state-npc0": 0.06905841827392578, "sim_compute_robot_state-npc1": 0.07078269712939234, "sim_compute_robot_state-npc2": 0.07079041646626182, "sim_compute_robot_state-npc3": 0.07250153804253676}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2051212070057693, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.061628804623501975, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14925430816354104, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09431846396436969, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.0382951278130985, "sim_compute_performance-ego": 0.06620945976775827, "sim_compute_robot_state-ego": 0.07352233395993131, "sim_compute_robot_state-npc0": 0.07672594125988413, "sim_compute_robot_state-npc1": 0.06772145021308973, "sim_compute_robot_state-npc2": 0.07151989797944004, "sim_compute_robot_state-npc3": 0.0694707620491102}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.20525562286376953, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06102067947387695, "in-drivable-lane": 0, "agent_compute-ego": 0.151539306640625, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09516477108001709, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03948815822601318, "sim_compute_performance-ego": 0.06630090236663819, "sim_compute_robot_state-ego": 0.07105167388916016, "sim_compute_robot_state-npc0": 0.06939900398254395, "sim_compute_robot_state-npc1": 0.06909412860870362, "sim_compute_robot_state-npc2": 0.06847365379333496, "sim_compute_robot_state-npc3": 0.06674327850341796}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.23332378038993248, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06745843703930195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16722194506571844, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.10699975490570068, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04192429322462816, "sim_compute_performance-ego": 0.07541423119031467, "sim_compute_robot_state-ego": 0.08770690514491154, "sim_compute_robot_state-npc0": 0.07367177192981426, "sim_compute_robot_state-npc1": 0.07333363478000347, "sim_compute_robot_state-npc2": 0.07281445539914645, "sim_compute_robot_state-npc3": 0.07466728870685284}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2414106955895057, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06662397201244648, "in-drivable-lane": 0, "agent_compute-ego": 0.16252249020796555, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09817108741173378, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.040324706297654375, "sim_compute_performance-ego": 0.07334412978245662, "sim_compute_robot_state-ego": 0.07767229813795823, "sim_compute_robot_state-npc0": 0.07155010333428016, "sim_compute_robot_state-npc1": 0.07578729666196383, "sim_compute_robot_state-npc2": 0.07444368875943698, "sim_compute_robot_state-npc3": 0.07069266759432279}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2006264708258889, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06342648376118053, "in-drivable-lane": 0, "agent_compute-ego": 0.14718160846016623, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10354530811309814, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.0380151705308394, "sim_compute_performance-ego": 0.07033882357857445, "sim_compute_robot_state-ego": 0.07408400015397505, "sim_compute_robot_state-npc0": 0.06580479578538374, "sim_compute_robot_state-npc1": 0.07109386270696466, "sim_compute_robot_state-npc2": 0.07200832800431685, "sim_compute_robot_state-npc3": 0.06819708780808882}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.17453941822052002, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06271063327789307, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1537902069091797, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.09294427871704102, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.037311339378356935, "sim_compute_performance-ego": 0.06797646045684815, "sim_compute_robot_state-ego": 0.07400153636932373, "sim_compute_robot_state-npc0": 0.06761928081512451, "sim_compute_robot_state-npc1": 0.06517164707183838, "sim_compute_robot_state-npc2": 0.06578044414520264, "sim_compute_robot_state-npc3": 0.06474825859069824}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.20067748363981855, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.061021272172319126, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1514436716729022, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09447940613361117, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03998952977200772, "sim_compute_performance-ego": 0.06893517869584104, "sim_compute_robot_state-ego": 0.0750314453814892, "sim_compute_robot_state-npc0": 0.06744057320533915, "sim_compute_robot_state-npc1": 0.06684420971160239, "sim_compute_robot_state-npc2": 0.07023898337749725, "sim_compute_robot_state-npc3": 0.06872883502473222}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.2069228887557983, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06417755438731267, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1573143463868361, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0968733659157386, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04015142642534696, "sim_compute_performance-ego": 0.07060102774546696, "sim_compute_robot_state-ego": 0.0784544302867009, "sim_compute_robot_state-npc0": 0.07124351996641892, "sim_compute_robot_state-npc1": 0.07042103547316331, "sim_compute_robot_state-npc2": 0.06921963508312519, "sim_compute_robot_state-npc3": 0.07040005463820237}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1793178263164702, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.061737046922956194, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1511205650511242, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.0928757349650065, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03913474082946777, "sim_compute_performance-ego": 0.06761943499247233, "sim_compute_robot_state-ego": 0.07170276187715076, "sim_compute_robot_state-npc0": 0.06691044171651205, "sim_compute_robot_state-npc1": 0.06895176115490141, "sim_compute_robot_state-npc2": 0.06869666235787528, "sim_compute_robot_state-npc3": 0.06877732503981818}}
set_robot_commands_max0.10699975490570068
set_robot_commands_mean0.09745284007515992
set_robot_commands_median0.0968733659157386
set_robot_commands_min0.0928757349650065
sim_compute_performance-ego_max0.07541423119031467
sim_compute_performance-ego_mean0.06990202730394038
sim_compute_performance-ego_median0.07013080233619326
sim_compute_performance-ego_min0.06620945976775827
sim_compute_robot_state-ego_max0.08770690514491154
sim_compute_robot_state-ego_mean0.07632233917047201
sim_compute_robot_state-ego_median0.0750314453814892
sim_compute_robot_state-ego_min0.07105167388916016
sim_compute_robot_state-npc0_max0.07672594125988413
sim_compute_robot_state-npc0_mean0.07005868045753633
sim_compute_robot_state-npc0_median0.06970613201459248
sim_compute_robot_state-npc0_min0.06580479578538374
sim_compute_robot_state-npc1_max0.07578729666196383
sim_compute_robot_state-npc1_mean0.07069034182980082
sim_compute_robot_state-npc1_median0.07078269712939234
sim_compute_robot_state-npc1_min0.06517164707183838
sim_compute_robot_state-npc2_max0.07444368875943698
sim_compute_robot_state-npc2_mean0.0701777920038524
sim_compute_robot_state-npc2_median0.07023898337749725
sim_compute_robot_state-npc2_min0.06578044414520264
sim_compute_robot_state-npc3_max0.07609885931015015
sim_compute_robot_state-npc3_mean0.06971938626361601
sim_compute_robot_state-npc3_median0.06877732503981818
sim_compute_robot_state-npc3_min0.06460548050795929
sim_compute_sim_state_max0.04201396022524152
sim_compute_sim_state_mean0.039265850070075305
sim_compute_sim_state_median0.03948815822601318
sim_compute_sim_state_min0.035986658893054045
sim_physics_max0.2414106955895057
sim_physics_mean0.2035548835117605
sim_physics_median0.20067748363981855
sim_physics_min0.17453941822052002
sim_render-ego_max0.0695742472861577
sim_render-ego_mean0.063542806541912
sim_render-ego_median0.06271861127750603
sim_render-ego_min0.05889975527922312
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
229382499Liam Paullchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessyes12070:18:42(hidden)
driven_lanedir_consec_median0.23356919140029575
survival_time_median1.5500000000000007
deviation-center-line_median0.1056904917896022
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19315692901611328
agent_compute-ego_mean0.1737490270390965
agent_compute-ego_median0.17483253479003907
agent_compute-ego_min0.1381561448497157
deviation-center-line_max0.14784202605609845
deviation-center-line_mean0.1016079030861103
deviation-center-line_min0.05974673579480917
deviation-heading_max1.0307177433761603
deviation-heading_mean0.6222654881876274
deviation-heading_median0.6903017356270803
deviation-heading_min0.38203308049776047
driven_any_max0.4279219069518986
driven_any_mean0.2793720663780102
driven_any_median0.2876357061084567
driven_any_min0.16104946337865889
driven_lanedir_consec_max0.34351695401031046
driven_lanedir_consec_mean0.2327139818594781
driven_lanedir_consec_min0.12786081395086368
driven_lanedir_max0.34351695401031046
driven_lanedir_mean0.2327139818594781
driven_lanedir_median0.23356919140029575
driven_lanedir_min0.12786081395086368
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.013333333333333345
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.29308239412902776, "sim_physics": 0.15178110522608604, "survival_time": 1.5500000000000007, "driven_lanedir": 0.23356919140029575, "sim_render-ego": 0.04900947693855532, "in-drivable-lane": 0, "agent_compute-ego": 0.1381561448497157, "deviation-heading": 0.7439854412495074, "set_robot_commands": 0.07121364531978484, "deviation-center-line": 0.1056904917896022, "driven_lanedir_consec": 0.23356919140029575, "sim_compute_sim_state": 0.0302642083937122, "sim_compute_performance-ego": 0.05538477436188729, "sim_compute_robot_state-ego": 0.05721196051566831, "sim_compute_robot_state-npc0": 0.053957085455617594, "sim_compute_robot_state-npc1": 0.05319519196787188, "sim_compute_robot_state-npc2": 0.053082681471301664, "sim_compute_robot_state-npc3": 0.05312667354460685}, "udem1-1-0": {"driven_any": 0.2284815620051714, "sim_physics": 0.2225224494934082, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15821868998250865, "sim_render-ego": 0.06909192085266114, "in-drivable-lane": 0, "agent_compute-ego": 0.1816263866424561, "deviation-heading": 0.8174248432739096, "set_robot_commands": 0.09649744987487792, "deviation-center-line": 0.08450918276400904, "driven_lanedir_consec": 0.15821868998250865, "sim_compute_sim_state": 0.039737672805786134, "sim_compute_performance-ego": 0.06993693351745606, "sim_compute_robot_state-ego": 0.07385391235351563, "sim_compute_robot_state-npc0": 0.07545166969299316, "sim_compute_robot_state-npc1": 0.07532422065734863, "sim_compute_robot_state-npc2": 0.07405117034912109, "sim_compute_robot_state-npc3": 0.07711867332458495}, "udem1-2-0": {"driven_any": 0.26355228945583303, "sim_physics": 0.24589232740731076, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2301646997373283, "sim_render-ego": 0.06320523393565211, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.17011315247108197, "deviation-heading": 0.38203308049776047, "set_robot_commands": 0.09684808500881852, "deviation-center-line": 0.12401551369024284, "driven_lanedir_consec": 0.2301646997373283, "sim_compute_sim_state": 0.03904153560769969, "sim_compute_performance-ego": 0.06739442101840315, "sim_compute_robot_state-ego": 0.07309449130091174, "sim_compute_robot_state-npc0": 0.0728066954119452, "sim_compute_robot_state-npc1": 0.07532511908432533, "sim_compute_robot_state-npc2": 0.07289402238253889, "sim_compute_robot_state-npc3": 0.07165672039163523}, "udem1-3-0": {"driven_any": 0.2876357061084567, "sim_physics": 0.22014321050336283, "survival_time": 1.5500000000000007, "driven_lanedir": 0.25578312034093775, "sim_render-ego": 0.06620401720846852, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18328944329292543, "deviation-heading": 0.390587270603202, "set_robot_commands": 0.0965855352340206, "deviation-center-line": 0.1211910163215702, "driven_lanedir_consec": 0.25578312034093775, "sim_compute_sim_state": 0.037820285366427515, "sim_compute_performance-ego": 0.07151488334901872, "sim_compute_robot_state-ego": 0.07867107852812737, "sim_compute_robot_state-npc0": 0.06912718280669182, "sim_compute_robot_state-npc1": 0.06860716881290559, "sim_compute_robot_state-npc2": 0.07100420613442698, "sim_compute_robot_state-npc3": 0.06763729741496424}, "udem1-4-0": {"driven_any": 0.2322239410415205, "sim_physics": 0.20612090110778808, "survival_time": 1.2500000000000004, "driven_lanedir": 0.18608610279804896, "sim_render-ego": 0.06591239929199219, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.19315692901611328, "deviation-heading": 0.5694330133359564, "set_robot_commands": 0.10228744506835938, "deviation-center-line": 0.07334749754760075, "driven_lanedir_consec": 0.18608610279804896, "sim_compute_sim_state": 0.03869771957397461, "sim_compute_performance-ego": 0.07424585342407226, "sim_compute_robot_state-ego": 0.0864449405670166, "sim_compute_robot_state-npc0": 0.06945788383483886, "sim_compute_robot_state-npc1": 0.06712491989135742, "sim_compute_robot_state-npc2": 0.0689844799041748, "sim_compute_robot_state-npc3": 0.0685588264465332}, "udem1-5-0": {"driven_any": 0.4279219069518986, "sim_physics": 0.1786985009215599, "survival_time": 2.1500000000000004, "driven_lanedir": 0.34351695401031046, "sim_render-ego": 0.05645311710446379, "in-drivable-lane": 0, "agent_compute-ego": 0.165311430775842, "deviation-heading": 1.0307177433761603, "set_robot_commands": 0.0973985749621724, "deviation-center-line": 0.14784202605609845, "driven_lanedir_consec": 0.34351695401031046, "sim_compute_sim_state": 0.03771707623503929, "sim_compute_performance-ego": 0.06643812600956407, "sim_compute_robot_state-ego": 0.0688355800717376, "sim_compute_robot_state-npc0": 0.06621160063632699, "sim_compute_robot_state-npc1": 0.06224532460057458, "sim_compute_robot_state-npc2": 0.06674935651379962, "sim_compute_robot_state-npc3": 0.06371896765952886}, "udem1-6-0": {"driven_any": 0.32791765141157314, "sim_physics": 0.20442749559879303, "survival_time": 1.6000000000000008, "driven_lanedir": 0.2976733937831195, "sim_render-ego": 0.05369427055120468, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15281646698713303, "deviation-heading": 0.3942546474000477, "set_robot_commands": 0.08179318904876709, "deviation-center-line": 0.1297403120666079, "driven_lanedir_consec": 0.2976733937831195, "sim_compute_sim_state": 0.0409713014960289, "sim_compute_performance-ego": 0.06084734946489334, "sim_compute_robot_state-ego": 0.06588172167539597, "sim_compute_robot_state-npc0": 0.0634879544377327, "sim_compute_robot_state-npc1": 0.060547031462192535, "sim_compute_robot_state-npc2": 0.062170274555683136, "sim_compute_robot_state-npc3": 0.06109467148780823}, "udem1-7-0": {"driven_any": 0.29971256233919347, "sim_physics": 0.20614001967690207, "survival_time": 1.6500000000000008, "driven_lanedir": 0.27496127583922836, "sim_render-ego": 0.06523409034266617, "in-drivable-lane": 0, "agent_compute-ego": 0.187471071879069, "deviation-heading": 0.4837785304442438, "set_robot_commands": 0.09528779983520508, "deviation-center-line": 0.12453589118076168, "driven_lanedir_consec": 0.27496127583922836, "sim_compute_sim_state": 0.040794574853145714, "sim_compute_performance-ego": 0.07122788284764145, "sim_compute_robot_state-ego": 0.07654815731626569, "sim_compute_robot_state-npc0": 0.06592676133820505, "sim_compute_robot_state-npc1": 0.06942692669955167, "sim_compute_robot_state-npc2": 0.06921252337369052, "sim_compute_robot_state-npc3": 0.06927501794063684}, "udem1-8-0": {"driven_any": 0.35146341821273697, "sim_physics": 0.201917957615208, "survival_time": 1.850000000000001, "driven_lanedir": 0.2995063827009914, "sim_render-ego": 0.06301201356423868, "in-drivable-lane": 0, "agent_compute-ego": 0.17779716929873904, "deviation-heading": 0.7416122555313746, "set_robot_commands": 0.0966817366110312, "deviation-center-line": 0.08542788847761074, "driven_lanedir_consec": 0.2995063827009914, "sim_compute_sim_state": 0.03813396273432551, "sim_compute_performance-ego": 0.07025727710208378, "sim_compute_robot_state-ego": 0.0805643893576957, "sim_compute_robot_state-npc0": 0.06974825987944731, "sim_compute_robot_state-npc1": 0.07146040168968407, "sim_compute_robot_state-npc2": 0.07025064004434121, "sim_compute_robot_state-npc3": 0.06851888991690971}, "udem1-9-0": {"driven_any": 0.24672877535585777, "sim_physics": 0.22735318770775428, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19458025238182872, "sim_render-ego": 0.06296314642979549, "in-drivable-lane": 0, "agent_compute-ego": 0.18431086723621076, "deviation-heading": 0.6903017356270803, "set_robot_commands": 0.09465212088364822, "deviation-center-line": 0.07463114417353597, "driven_lanedir_consec": 0.19458025238182872, "sim_compute_sim_state": 0.04153126936692458, "sim_compute_performance-ego": 0.07225681268251859, "sim_compute_robot_state-ego": 0.07885127801161546, "sim_compute_robot_state-npc0": 0.06738584775191087, "sim_compute_robot_state-npc1": 0.07496245090778057, "sim_compute_robot_state-npc2": 0.06989763333247258, "sim_compute_robot_state-npc3": 0.07143503886002761}, "udem1-10-0": {"driven_any": 0.18146533780324453, "sim_physics": 0.20863033377605936, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12786081395086368, "sim_render-ego": 0.060758352279663086, "in-drivable-lane": 0, "agent_compute-ego": 0.16582918167114258, "deviation-heading": 0.7309471410531787, "set_robot_commands": 0.09323986716892407, "deviation-center-line": 0.05974673579480917, "driven_lanedir_consec": 0.12786081395086368, "sim_compute_sim_state": 0.03956064970596977, "sim_compute_performance-ego": 0.06477921942005986, "sim_compute_robot_state-ego": 0.07108133772145146, "sim_compute_robot_state-npc0": 0.06969419769618822, "sim_compute_robot_state-npc1": 0.06980616113413936, "sim_compute_robot_state-npc2": 0.07084088740141495, "sim_compute_robot_state-npc3": 0.06603725060172703}, "udem1-11-0": {"driven_any": 0.16104946337865889, "sim_physics": 0.18767731189727785, "survival_time": 1.0000000000000002, "driven_lanedir": 0.13489778064275493, "sim_render-ego": 0.06099039316177368, "in-drivable-lane": 0, "agent_compute-ego": 0.17483253479003907, "deviation-heading": 0.4069992131871475, "set_robot_commands": 0.0911582350730896, "deviation-center-line": 0.09231785175860296, "driven_lanedir_consec": 0.13489778064275493, "sim_compute_sim_state": 0.03781082630157471, "sim_compute_performance-ego": 0.0656701922416687, "sim_compute_robot_state-ego": 0.07020400762557984, "sim_compute_robot_state-npc0": 0.06629047393798829, "sim_compute_robot_state-npc1": 0.07088220119476318, "sim_compute_robot_state-npc2": 0.06545730829238891, "sim_compute_robot_state-npc3": 0.06628654003143311}, "udem1-12-0": {"driven_any": 0.32501390100994193, "sim_physics": 0.21169635908944265, "survival_time": 1.7500000000000009, "driven_lanedir": 0.26857354569688074, "sim_render-ego": 0.06142142159598214, "in-drivable-lane": 0, "agent_compute-ego": 0.1719043459211077, "deviation-heading": 0.771831903546438, "set_robot_commands": 0.09874271665300642, "deviation-center-line": 0.11733222491398004, "driven_lanedir_consec": 0.26857354569688074, "sim_compute_sim_state": 0.03743924413408552, "sim_compute_performance-ego": 0.06603930337088448, "sim_compute_robot_state-ego": 0.07026177133832659, "sim_compute_robot_state-npc0": 0.06925198010035924, "sim_compute_robot_state-npc1": 0.06869684628077916, "sim_compute_robot_state-npc2": 0.0698432377406529, "sim_compute_robot_state-npc3": 0.07042653220040458}, "udem1-13-0": {"driven_any": 0.2190551355517376, "sim_physics": 0.22305987431452823, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19209629605724743, "sim_render-ego": 0.07014789031102107, "in-drivable-lane": 0, "agent_compute-ego": 0.19122484097113976, "deviation-heading": 0.4223293331536395, "set_robot_commands": 0.1044158752147968, "deviation-center-line": 0.10577969460776926, "driven_lanedir_consec": 0.19209629605724743, "sim_compute_sim_state": 0.041993911449725814, "sim_compute_performance-ego": 0.07708454132080078, "sim_compute_robot_state-ego": 0.08367727353022648, "sim_compute_robot_state-npc0": 0.07515120506286621, "sim_compute_robot_state-npc1": 0.07596665162306565, "sim_compute_robot_state-npc2": 0.07563622181232159, "sim_compute_robot_state-npc3": 0.07381323667672965}, "udem1-14-0": {"driven_any": 0.3452769509153013, "sim_physics": 0.18660100301106772, "survival_time": 1.800000000000001, "driven_lanedir": 0.29322122856982724, "sim_render-ego": 0.06274625990125868, "in-drivable-lane": 0, "agent_compute-ego": 0.1683954397837321, "deviation-heading": 0.7577461705347642, "set_robot_commands": 0.0965947111447652, "deviation-center-line": 0.0780110751488531, "driven_lanedir_consec": 0.29322122856982724, "sim_compute_sim_state": 0.038612584273020424, "sim_compute_performance-ego": 0.06677275233798557, "sim_compute_robot_state-ego": 0.07030588388442993, "sim_compute_robot_state-npc0": 0.06657452715767755, "sim_compute_robot_state-npc1": 0.06857308414247301, "sim_compute_robot_state-npc2": 0.06744116544723511, "sim_compute_robot_state-npc3": 0.065569625960456}}
set_robot_commands_max0.1044158752147968
set_robot_commands_mean0.09422646580675116
set_robot_commands_median0.0965855352340206
set_robot_commands_min0.07121364531978484
sim_compute_performance-ego_max0.07708454132080078
sim_compute_performance-ego_mean0.06799002149792921
sim_compute_performance-ego_median0.06739442101840315
sim_compute_performance-ego_min0.05538477436188729
sim_compute_robot_state-ego_max0.0864449405670166
sim_compute_robot_state-ego_mean0.07369918558653096
sim_compute_robot_state-ego_median0.07309449130091174
sim_compute_robot_state-ego_min0.05721196051566831
sim_compute_robot_state-npc0_max0.07545166969299316
sim_compute_robot_state-npc0_mean0.06803488834671927
sim_compute_robot_state-npc0_median0.06912718280669182
sim_compute_robot_state-npc0_min0.053957085455617594
sim_compute_robot_state-npc1_max0.07596665162306565
sim_compute_robot_state-npc1_mean0.06880958000992085
sim_compute_robot_state-npc1_median0.06942692669955167
sim_compute_robot_state-npc1_min0.05319519196787188
sim_compute_robot_state-npc2_max0.07563622181232159
sim_compute_robot_state-npc2_mean0.0685010539170376
sim_compute_robot_state-npc2_median0.0698432377406529
sim_compute_robot_state-npc2_min0.053082681471301664
sim_compute_robot_state-npc3_max0.07711867332458495
sim_compute_robot_state-npc3_mean0.06761826416386575
sim_compute_robot_state-npc3_median0.06851888991690971
sim_compute_robot_state-npc3_min0.05312667354460685
sim_compute_sim_state_max0.041993911449725814
sim_compute_sim_state_mean0.038675121486496024
sim_compute_sim_state_median0.03869771957397461
sim_compute_sim_state_min0.0302642083937122
sim_physics_max0.24589232740731076
sim_physics_mean0.2055108024897699
sim_physics_median0.20614001967690207
sim_physics_min0.15178110522608604
sim_render-ego_max0.07014789031102107
sim_render-ego_mean0.06205626689795979
sim_render-ego_median0.06296314642979549
sim_render-ego_min0.04900947693855532
simulation-passed1
survival_time_max2.1500000000000004
survival_time_mean1.5066666666666673
survival_time_min1.0000000000000002
229322508RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-testingstep1-simulationerroryes12070:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229232517Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes12070:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229162525Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryes12070:02:56
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228912564AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryes12070:18:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228882573AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerroryes12070:01:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228682604Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationsuccessyes12070:16:02(hidden)
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.0796766482608419
agent_compute-ego_mean0.06789568675222589
agent_compute-ego_median0.07104745778170499
agent_compute-ego_min0.0495123646476052
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11975589940245722, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06626347756721604, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.0796766482608419, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10430742989123708, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04000649653689962, "sim_compute_performance-ego": 0.07626351168457891, "sim_compute_robot_state-ego": 0.08303544890712684}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.08541197379430135, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05194445451100667, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.05810101826985677, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.07769948244094849, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.03186353842417399, "sim_compute_performance-ego": 0.0552812655766805, "sim_compute_robot_state-ego": 0.06294197638829549}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.07981392470273105, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.044191501357338646, "in-drivable-lane": 0, "agent_compute-ego": 0.0495123646476052, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.07222391258586537, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.031738996505737305, "sim_compute_performance-ego": 0.05027002638036555, "sim_compute_robot_state-ego": 0.05377158251675693}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12398286163806917, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06721216936906178, "in-drivable-lane": 0, "agent_compute-ego": 0.07331390678882599, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.103341743350029, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04125900069872538, "sim_compute_performance-ego": 0.0780398299296697, "sim_compute_robot_state-ego": 0.08177986244360606}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.10326993983724844, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.05674744688946268, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.0669032801752505, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09026097214740256, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.03578910102014956, "sim_compute_performance-ego": 0.06282088549240776, "sim_compute_robot_state-ego": 0.07019070438716722}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.12008462349573772, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.06780778368314107, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07347775499025981, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.10693439841270448, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.04249215126037598, "sim_compute_performance-ego": 0.07368778189023335, "sim_compute_robot_state-ego": 0.07818615436553955}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.09764131215902476, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.060174266497294106, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06931069875374818, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.09653771840609036, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.038412842995081194, "sim_compute_performance-ego": 0.06719597180684407, "sim_compute_robot_state-ego": 0.08073656986921261}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.0807397791317531, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.04874316709382193, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.054390673126493184, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.07286905816623143, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.03051134943962097, "sim_compute_performance-ego": 0.05292690226009914, "sim_compute_robot_state-ego": 0.05706801584788731}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.11125437144575448, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.06258480028174389, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.07275818682265008, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.10032874414290505, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.0383841443335873, "sim_compute_performance-ego": 0.07169849571140333, "sim_compute_robot_state-ego": 0.08356809890133211}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.11403040452436967, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.06049831130287864, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.07162981033325196, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.09581118496981536, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03934292576529763, "sim_compute_performance-ego": 0.06956261721524325, "sim_compute_robot_state-ego": 0.07572201815518466}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.11251043279965718, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.058925857146581016, "in-drivable-lane": 0, "agent_compute-ego": 0.06425014138221741, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.08978629112243652, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.034360130627950035, "sim_compute_performance-ego": 0.06844439109166463, "sim_compute_robot_state-ego": 0.07043453057607015}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.10014026195971996, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.06122109797093776, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.07104745778170499, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.0974467419958734, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03925995393232866, "sim_compute_performance-ego": 0.06842124616944945, "sim_compute_robot_state-ego": 0.0755316870553153}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.11184316635131836, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.06458903312683105, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.07173400402069091, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.1030643892288208, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03937092781066895, "sim_compute_performance-ego": 0.07258841037750244, "sim_compute_robot_state-ego": 0.08201473712921142}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.11494285326737624, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.0634382046186007, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0706115594277015, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09925077511714056, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.0395273520396306, "sim_compute_performance-ego": 0.0734861814058744, "sim_compute_robot_state-ego": 0.0823068435375507}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.11582197966399016, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.06099980407290989, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.07171779650228995, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.09823369979858398, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.04044506284925672, "sim_compute_performance-ego": 0.07068993868651213, "sim_compute_robot_state-ego": 0.07903605037265354}}
set_robot_commands_max0.10693439841270448
set_robot_commands_mean0.09387310278507228
set_robot_commands_median0.0974467419958734
set_robot_commands_min0.07222391258586537
sim_compute_performance-ego_max0.0780398299296697
sim_compute_performance-ego_mean0.06742516371190191
sim_compute_performance-ego_median0.06956261721524325
sim_compute_performance-ego_min0.05027002638036555
sim_compute_robot_state-ego_max0.08356809890133211
sim_compute_robot_state-ego_mean0.07442161869686066
sim_compute_robot_state-ego_median0.07818615436553955
sim_compute_robot_state-ego_min0.05377158251675693
sim_compute_sim_state_max0.04249215126037598
sim_compute_sim_state_mean0.037517598282632264
sim_compute_sim_state_median0.03925995393232866
sim_compute_sim_state_min0.03051134943962097
sim_physics_max0.12398286163806917
sim_physics_mean0.1060829189449006
sim_physics_median0.11184316635131836
sim_physics_min0.07981392470273105
sim_render-ego_max0.06780778368314107
sim_render-ego_mean0.05968942503258839
sim_render-ego_median0.06099980407290989
sim_render-ego_min0.044191501357338646
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
228452632Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessyes12070:21:55(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.17054445743560792
agent_compute-ego_mean0.15326900174606975
agent_compute-ego_median0.15365346100019373
agent_compute-ego_min0.1249864282487314
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16348443649433278, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06416797637939453, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16034608417087132, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10043999000831888, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04100902875264486, "sim_compute_performance-ego": 0.07378695187745271, "sim_compute_robot_state-ego": 0.08079169856177436, "sim_compute_robot_state-npc0": 0.07089449299706353, "sim_compute_robot_state-npc1": 0.07239009715892651, "sim_compute_robot_state-npc2": 0.07412245980015507, "sim_compute_robot_state-npc3": 0.07327725710692229}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.16930325508117677, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06259916305541992, "in-drivable-lane": 0, "agent_compute-ego": 0.14750585556030274, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09780652046203614, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03561881065368652, "sim_compute_performance-ego": 0.06515002250671387, "sim_compute_robot_state-ego": 0.06999045372009277, "sim_compute_robot_state-npc0": 0.06673898696899414, "sim_compute_robot_state-npc1": 0.0647242546081543, "sim_compute_robot_state-npc2": 0.06279389381408691, "sim_compute_robot_state-npc3": 0.06452648162841797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17538484774137797, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06296993556775544, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15589091024900736, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09442387129131116, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04118630760594418, "sim_compute_performance-ego": 0.07120095428667571, "sim_compute_robot_state-ego": 0.07413538192447863, "sim_compute_robot_state-npc0": 0.0686658589463485, "sim_compute_robot_state-npc1": 0.06996680874573558, "sim_compute_robot_state-npc2": 0.06975354960090235, "sim_compute_robot_state-npc3": 0.07196068450024254}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.13972686212274094, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.048859578144701224, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1249864282487314, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.07220172580284408, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.029550923576837855, "sim_compute_performance-ego": 0.05181491224071647, "sim_compute_robot_state-ego": 0.05829531331605549, "sim_compute_robot_state-npc0": 0.05625427221950097, "sim_compute_robot_state-npc1": 0.0519520874264874, "sim_compute_robot_state-npc2": 0.05394067945359629, "sim_compute_robot_state-npc3": 0.052316529841362674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1667208927018302, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.061234048434666226, "in-drivable-lane": 0, "agent_compute-ego": 0.15052098887307302, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0911848885672433, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.038007378578186035, "sim_compute_performance-ego": 0.07079241105488368, "sim_compute_robot_state-ego": 0.07859313488006592, "sim_compute_robot_state-npc0": 0.06840340580259051, "sim_compute_robot_state-npc1": 0.06475199971880231, "sim_compute_robot_state-npc2": 0.06608551740646362, "sim_compute_robot_state-npc3": 0.06706563064030238}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16203442326298467, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.06320001460887768, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.15742290019989014, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09993437925974528, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03996821686073586, "sim_compute_performance-ego": 0.07102621926201715, "sim_compute_robot_state-ego": 0.07386537392934163, "sim_compute_robot_state-npc0": 0.07060350312127008, "sim_compute_robot_state-npc1": 0.07128676220222756, "sim_compute_robot_state-npc2": 0.07213054762946235, "sim_compute_robot_state-npc3": 0.06865302721659343}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.1622398164537218, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.062223076820373535, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.15244521918120207, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0972786302919741, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.03803525589130543, "sim_compute_performance-ego": 0.06803182760874431, "sim_compute_robot_state-ego": 0.07395947421038593, "sim_compute_robot_state-npc0": 0.07038294827496563, "sim_compute_robot_state-npc1": 0.07271314550329137, "sim_compute_robot_state-npc2": 0.07147438437850387, "sim_compute_robot_state-npc3": 0.0707653628455268}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.20495394070943196, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06384898821512858, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14745496643914116, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.09754731390211316, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04187631077236599, "sim_compute_performance-ego": 0.07063974804348416, "sim_compute_robot_state-ego": 0.077951357099745, "sim_compute_robot_state-npc0": 0.07152888509962294, "sim_compute_robot_state-npc1": 0.07113474739922418, "sim_compute_robot_state-npc2": 0.07200446658664279, "sim_compute_robot_state-npc3": 0.07075606452094184}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.1709906070128731, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06162524741628896, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.15365346100019373, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.09675001579782236, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03893574942713198, "sim_compute_performance-ego": 0.0710401846014935, "sim_compute_robot_state-ego": 0.0777132511138916, "sim_compute_robot_state-npc0": 0.06749173869257388, "sim_compute_robot_state-npc1": 0.06731511198956033, "sim_compute_robot_state-npc2": 0.07060890612394913, "sim_compute_robot_state-npc3": 0.06937271097432011}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.184713134765625, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06288336753845215, "in-drivable-lane": 0, "agent_compute-ego": 0.15382501602172852, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09075130462646484, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.039897584915161134, "sim_compute_performance-ego": 0.06748695850372315, "sim_compute_robot_state-ego": 0.07230766296386719, "sim_compute_robot_state-npc0": 0.06720998287200927, "sim_compute_robot_state-npc1": 0.0643012523651123, "sim_compute_robot_state-npc2": 0.06503701686859131, "sim_compute_robot_state-npc3": 0.07049318313598633}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.21479833126068115, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06699057817459106, "in-drivable-lane": 0, "agent_compute-ego": 0.16798851490020753, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.09449297189712524, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03875377178192139, "sim_compute_performance-ego": 0.08129211664199829, "sim_compute_robot_state-ego": 0.0838469386100769, "sim_compute_robot_state-npc0": 0.07304362058639527, "sim_compute_robot_state-npc1": 0.06919090747833252, "sim_compute_robot_state-npc2": 0.07149168252944946, "sim_compute_robot_state-npc3": 0.07332719564437866}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.16415821878533615, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0613970254596911, "in-drivable-lane": 0, "agent_compute-ego": 0.14191298735769173, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09167397649664628, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04297247685884174, "sim_compute_performance-ego": 0.06953400059750206, "sim_compute_robot_state-ego": 0.07280958326239335, "sim_compute_robot_state-npc0": 0.06513826470626027, "sim_compute_robot_state-npc1": 0.06501465094716925, "sim_compute_robot_state-npc2": 0.0682814874147114, "sim_compute_robot_state-npc3": 0.06693343112343236}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.17449150562286378, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06645752906799317, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17054445743560792, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10473747730255129, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.042783594131469725, "sim_compute_performance-ego": 0.07626745700836182, "sim_compute_robot_state-ego": 0.08475580215454101, "sim_compute_robot_state-npc0": 0.07400274276733398, "sim_compute_robot_state-npc1": 0.07219197273254395, "sim_compute_robot_state-npc2": 0.07308565616607667, "sim_compute_robot_state-npc3": 0.07276169776916504}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2366520816629583, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06544137001037598, "in-drivable-lane": 0, "agent_compute-ego": 0.1617100563916293, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.10754326256838712, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04129770669070157, "sim_compute_performance-ego": 0.07317307862368497, "sim_compute_robot_state-ego": 0.08480786193500865, "sim_compute_robot_state-npc0": 0.06855694814161821, "sim_compute_robot_state-npc1": 0.0713449174707586, "sim_compute_robot_state-npc2": 0.07422280311584473, "sim_compute_robot_state-npc3": 0.07499588619578969}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2032301766531808, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.06693460016834493, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.15282718016176808, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.09649444599540866, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03975336405695701, "sim_compute_performance-ego": 0.067400937177697, "sim_compute_robot_state-ego": 0.07587818710171447, "sim_compute_robot_state-npc0": 0.06841966084071568, "sim_compute_robot_state-npc1": 0.06842096484437281, "sim_compute_robot_state-npc2": 0.07308107979443608, "sim_compute_robot_state-npc3": 0.0695439455460529}}
set_robot_commands_max0.10754326256838712
set_robot_commands_mean0.09555071828466614
set_robot_commands_median0.09675001579782236
set_robot_commands_min0.07220172580284408
sim_compute_performance-ego_max0.08129211664199829
sim_compute_performance-ego_mean0.06990918533567658
sim_compute_performance-ego_median0.07079241105488368
sim_compute_performance-ego_min0.05181491224071647
sim_compute_robot_state-ego_max0.08480786193500865
sim_compute_robot_state-ego_mean0.07598009831889553
sim_compute_robot_state-ego_median0.07587818710171447
sim_compute_robot_state-ego_min0.05829531331605549
sim_compute_robot_state-npc0_max0.07400274276733398
sim_compute_robot_state-npc0_mean0.06848902080248419
sim_compute_robot_state-npc0_median0.06855694814161821
sim_compute_robot_state-npc0_min0.05625427221950097
sim_compute_robot_state-npc1_max0.07271314550329137
sim_compute_robot_state-npc1_mean0.06777997870604661
sim_compute_robot_state-npc1_median0.06919090747833252
sim_compute_robot_state-npc1_min0.0519520874264874
sim_compute_robot_state-npc2_max0.07422280311584473
sim_compute_robot_state-npc2_mean0.06920760871219148
sim_compute_robot_state-npc2_median0.07147438437850387
sim_compute_robot_state-npc2_min0.05394067945359629
sim_compute_robot_state-npc3_max0.07499588619578969
sim_compute_robot_state-npc3_mean0.06911660591262898
sim_compute_robot_state-npc3_median0.07049318313598633
sim_compute_robot_state-npc3_min0.052316529841362674
sim_compute_sim_state_max0.04297247685884174
sim_compute_sim_state_mean0.03930976537025942
sim_compute_sim_state_median0.039897584915161134
sim_compute_sim_state_min0.029550923576837855
sim_physics_max0.2366520816629583
sim_physics_mean0.1795255020220744
sim_physics_median0.1709906070128731
sim_physics_min0.13972686212274094
sim_render-ego_max0.06699057817459106
sim_render-ego_mean0.06272216660413696
sim_render-ego_median0.06296993556775544
sim_render-ego_min0.048859578144701224
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
228252690Konstantin Chaykachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12070:33:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227902758Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessyes12070:25:39(hidden)
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.07432775884061246
agent_compute-ego_mean0.06975004347226439
agent_compute-ego_median0.06882601724544042
agent_compute-ego_min0.06565781270176911
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1540208265814983, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05997373688388878, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06882601724544042, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09592004225287638, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03983219240752744, "sim_compute_performance-ego": 0.06814802532464685, "sim_compute_robot_state-ego": 0.07158260949900452, "sim_compute_robot_state-npc0": 0.07195853179609271, "sim_compute_robot_state-npc1": 0.06645745962438449, "sim_compute_robot_state-npc2": 0.07073905770207795, "sim_compute_robot_state-npc3": 0.06792111463949714}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.18080736696720123, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.0596233531832695, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06865407526493073, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.09778907895088196, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04177996516227722, "sim_compute_performance-ego": 0.06946403533220291, "sim_compute_robot_state-ego": 0.07639049738645554, "sim_compute_robot_state-npc0": 0.07028883695602417, "sim_compute_robot_state-npc1": 0.07002780586481094, "sim_compute_robot_state-npc2": 0.07062426209449768, "sim_compute_robot_state-npc3": 0.0713689923286438}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.17743856173295242, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.06101412498033964, "in-drivable-lane": 0, "agent_compute-ego": 0.06756363923733051, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.09201855384386502, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.039723061598264255, "sim_compute_performance-ego": 0.06740517341173612, "sim_compute_robot_state-ego": 0.06961554747361404, "sim_compute_robot_state-npc0": 0.07009500723618728, "sim_compute_robot_state-npc1": 0.0695504225217379, "sim_compute_robot_state-npc2": 0.06943411551989041, "sim_compute_robot_state-npc3": 0.06916749935883743}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.18078195664190477, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.0632013479868571, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0690075735892019, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.09663544675355316, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04020143324329007, "sim_compute_performance-ego": 0.06882720608865062, "sim_compute_robot_state-ego": 0.0734566257845971, "sim_compute_robot_state-npc0": 0.07140036808547154, "sim_compute_robot_state-npc1": 0.0715378253690658, "sim_compute_robot_state-npc2": 0.07095216679316695, "sim_compute_robot_state-npc3": 0.07208017892734979}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.16157871200924828, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06246841521490188, "in-drivable-lane": 0, "agent_compute-ego": 0.07285218011765253, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.09561602274576823, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.0383491629645938, "sim_compute_performance-ego": 0.06572297641209193, "sim_compute_robot_state-ego": 0.07067956243242536, "sim_compute_robot_state-npc0": 0.0666666030883789, "sim_compute_robot_state-npc1": 0.07030345144725982, "sim_compute_robot_state-npc2": 0.0674788270677839, "sim_compute_robot_state-npc3": 0.06575374376206171}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.15671748169197525, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.056938742803148, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.06565781270176911, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.08969351279834085, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.03472676355976704, "sim_compute_performance-ego": 0.06353610803273098, "sim_compute_robot_state-ego": 0.06892952643150141, "sim_compute_robot_state-npc0": 0.06311877305842628, "sim_compute_robot_state-npc1": 0.06125996723647945, "sim_compute_robot_state-npc2": 0.061518511496299555, "sim_compute_robot_state-npc3": 0.06377241237104432}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.15509009077435448, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.060111681620279946, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0679771587962196, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.09259143329802014, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.03744381098520188, "sim_compute_performance-ego": 0.06857428664252871, "sim_compute_robot_state-ego": 0.07153810773577009, "sim_compute_robot_state-npc0": 0.06985156592868623, "sim_compute_robot_state-npc1": 0.06849339746293567, "sim_compute_robot_state-npc2": 0.06984922999427431, "sim_compute_robot_state-npc3": 0.0720046843801226}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.19648959185626055, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06424295580064929, "in-drivable-lane": 0, "agent_compute-ego": 0.07432775884061246, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.10320934089454444, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.03856238158973488, "sim_compute_performance-ego": 0.0739033351073394, "sim_compute_robot_state-ego": 0.08515744595914274, "sim_compute_robot_state-npc0": 0.07339002312840642, "sim_compute_robot_state-npc1": 0.07267796026693808, "sim_compute_robot_state-npc2": 0.07246800048931225, "sim_compute_robot_state-npc3": 0.07285673231691928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.17439686258633932, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06420793135960896, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07364252540800306, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.10411360528733996, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.03990657130877177, "sim_compute_performance-ego": 0.07189069191614787, "sim_compute_robot_state-ego": 0.08072119620111254, "sim_compute_robot_state-npc0": 0.07177453570895725, "sim_compute_robot_state-npc1": 0.07211274902025859, "sim_compute_robot_state-npc2": 0.06965064340167576, "sim_compute_robot_state-npc3": 0.07236040963066949}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.20863887751213855, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.0636183168286475, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07071336407527745, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.09759873764537204, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.036861475383009865, "sim_compute_performance-ego": 0.07197020878301602, "sim_compute_robot_state-ego": 0.07690778179703472, "sim_compute_robot_state-npc0": 0.06816396980642159, "sim_compute_robot_state-npc1": 0.06920572753264526, "sim_compute_robot_state-npc2": 0.07026394282545999, "sim_compute_robot_state-npc3": 0.06869303400271407}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.21313930440832068, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.058762938887984666, "in-drivable-lane": 0, "agent_compute-ego": 0.06730907051651566, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.09256628707603172, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.04048465799402307, "sim_compute_performance-ego": 0.0655067143616853, "sim_compute_robot_state-ego": 0.0721876444639983, "sim_compute_robot_state-npc0": 0.0649390662157977, "sim_compute_robot_state-npc1": 0.06510766347249348, "sim_compute_robot_state-npc2": 0.06521411295290347, "sim_compute_robot_state-npc3": 0.06896437538994683}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.15246843338012694, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06276453018188477, "in-drivable-lane": 0, "agent_compute-ego": 0.06786126136779785, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.0901283359527588, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.037719135284423826, "sim_compute_performance-ego": 0.0628310775756836, "sim_compute_robot_state-ego": 0.06911808967590333, "sim_compute_robot_state-npc0": 0.06791640281677246, "sim_compute_robot_state-npc1": 0.06374403953552246, "sim_compute_robot_state-npc2": 0.06541704177856446, "sim_compute_robot_state-npc3": 0.06672852516174316}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1762189190342741, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06442303477593188, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07290980950841364, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10194483343160378, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.03994434284714033, "sim_compute_performance-ego": 0.07450340828805599, "sim_compute_robot_state-ego": 0.0804070031867837, "sim_compute_robot_state-npc0": 0.07229701078163003, "sim_compute_robot_state-npc1": 0.07149638769761571, "sim_compute_robot_state-npc2": 0.07093394927258762, "sim_compute_robot_state-npc3": 0.07184551796823177}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.1800591253465222, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06275711521025627, "in-drivable-lane": 0, "agent_compute-ego": 0.06881255488241872, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.09695117704329952, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.03855878306973365, "sim_compute_performance-ego": 0.06869995978570753, "sim_compute_robot_state-ego": 0.07127148105252173, "sim_compute_robot_state-npc0": 0.0685418882677632, "sim_compute_robot_state-npc1": 0.07089544880774713, "sim_compute_robot_state-npc2": 0.07301961991094774, "sim_compute_robot_state-npc3": 0.06938422879865093}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.19452392353731043, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06313891971812528, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07013585053238214, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.09775773684183756, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.040839466394162645, "sim_compute_performance-ego": 0.06529936135983934, "sim_compute_robot_state-ego": 0.07334041595458984, "sim_compute_robot_state-npc0": 0.06933931275910023, "sim_compute_robot_state-npc1": 0.071853894813388, "sim_compute_robot_state-npc2": 0.06977493155236338, "sim_compute_robot_state-npc3": 0.06770693554597743}}
set_robot_commands_max0.10411360528733996
set_robot_commands_mean0.0963022763210729
set_robot_commands_median0.09663544675355316
set_robot_commands_min0.08969351279834085
sim_compute_performance-ego_max0.07450340828805599
sim_compute_performance-ego_mean0.06841883789480421
sim_compute_performance-ego_median0.06857428664252871
sim_compute_performance-ego_min0.0628310775756836
sim_compute_robot_state-ego_max0.08515744595914274
sim_compute_robot_state-ego_mean0.07408690233563033
sim_compute_robot_state-ego_median0.0721876444639983
sim_compute_robot_state-ego_min0.06892952643150141
sim_compute_robot_state-npc0_max0.07339002312840642
sim_compute_robot_state-npc0_mean0.06931612637560773
sim_compute_robot_state-npc0_median0.06985156592868623
sim_compute_robot_state-npc0_min0.06311877305842628
sim_compute_robot_state-npc1_max0.07267796026693808
sim_compute_robot_state-npc1_mean0.06898161337821886
sim_compute_robot_state-npc1_median0.07002780586481094
sim_compute_robot_state-npc1_min0.06125996723647945
sim_compute_robot_state-npc2_max0.07301961991094774
sim_compute_robot_state-npc2_mean0.06915589419012035
sim_compute_robot_state-npc2_median0.06984922999427431
sim_compute_robot_state-npc2_min0.061518511496299555
sim_compute_robot_state-npc3_max0.07285673231691928
sim_compute_robot_state-npc3_mean0.069373892305494
sim_compute_robot_state-npc3_median0.06916749935883743
sim_compute_robot_state-npc3_min0.06377241237104432
sim_compute_sim_state_max0.04177996516227722
sim_compute_sim_state_mean0.038995546919461464
sim_compute_sim_state_median0.039723061598264255
sim_compute_sim_state_min0.03472676355976704
sim_physics_max0.21313930440832068
sim_physics_mean0.17749133560402847
sim_physics_median0.17743856173295242
sim_physics_min0.15246843338012694
sim_render-ego_max0.06442303477593188
sim_render-ego_mean0.061816476362384895
sim_render-ego_median0.06275711521025627
sim_render-ego_min0.056938742803148
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
227862762Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-erroryes12070:00:06
Error while running [...]
Error while running Docker Compose:

Could not run ['docker-compose', '-p', 'job22786-636773', 'pull']:

   >  Command '['docker-compose', '-p', 'job22786-636773', 'pull']' returned non-zero exit status 255.

stdout | 

stderr | [3499] Failed to execute script docker-compose
stderr | Traceback (most recent call last):
stderr |   File "bin/docker-compose", line 6, in <module>
stderr |   File "compose/cli/main.py", line 71, in main
stderr |   File "compose/cli/main.py", line 124, in perform_command
stderr |   File "compose/cli/command.py", line 41, in project_from_options
stderr |   File "compose/cli/command.py", line 109, in get_project
stderr |   File "compose/config/config.py", line 283, in find
stderr |   File "compose/config/config.py", line 310, in get_default_config_files
stderr |   File "compose/config/config.py", line 346, in find_candidates_in_parent_dirs
stderr |   File "posixpath.py", line 376, in abspath
stderr | FileNotFoundError: [Errno 2] No such file or directory
stderr | 
(hidden)
227532826Liam Paullchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessyes12070:32:35(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.17503853142261505
agent_compute-ego_mean0.1616996486587731
agent_compute-ego_median0.16267921707846902
agent_compute-ego_min0.14329748153686522
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.24190238155896152, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06837659847887256, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16933427883099905, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.1078747163845014, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04059939746615253, "sim_compute_performance-ego": 0.07509958593151238, "sim_compute_robot_state-ego": 0.08658451973637447, "sim_compute_robot_state-npc0": 0.07452456558806987, "sim_compute_robot_state-npc1": 0.07428433019903642, "sim_compute_robot_state-npc2": 0.07502128504499604, "sim_compute_robot_state-npc3": 0.07359993306896355}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2213175126484462, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06724798679351807, "in-drivable-lane": 0, "agent_compute-ego": 0.17040954317365373, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10447372709001812, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04100292069571359, "sim_compute_performance-ego": 0.07221246617180961, "sim_compute_robot_state-ego": 0.08044728210994176, "sim_compute_robot_state-npc0": 0.07470400844301496, "sim_compute_robot_state-npc1": 0.07312654597418648, "sim_compute_robot_state-npc2": 0.0715107832636152, "sim_compute_robot_state-npc3": 0.07234995705740792}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.2089520658104165, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06708352311143598, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16503314138616174, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10455103522365532, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04099220905489134, "sim_compute_performance-ego": 0.0739899028852148, "sim_compute_robot_state-ego": 0.08472587992844072, "sim_compute_robot_state-npc0": 0.07468117788000014, "sim_compute_robot_state-npc1": 0.07381924842167827, "sim_compute_robot_state-npc2": 0.07324514574217565, "sim_compute_robot_state-npc3": 0.07409904998483009}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.24297440548737845, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.0673045168320338, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.17503853142261505, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10869709153970082, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04334000746409098, "sim_compute_performance-ego": 0.07461315393447876, "sim_compute_robot_state-ego": 0.08880828817685445, "sim_compute_robot_state-npc0": 0.07520978649457295, "sim_compute_robot_state-npc1": 0.07805013656616211, "sim_compute_robot_state-npc2": 0.07355680068333943, "sim_compute_robot_state-npc3": 0.07453201214472453}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.23331678481329057, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06787588482811338, "in-drivable-lane": 0, "agent_compute-ego": 0.174367280233474, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.11362730889093307, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.043800456183297296, "sim_compute_performance-ego": 0.07624313944862002, "sim_compute_robot_state-ego": 0.08888275282723564, "sim_compute_robot_state-npc0": 0.07780563263666063, "sim_compute_robot_state-npc1": 0.07789668582734607, "sim_compute_robot_state-npc2": 0.08009172621227446, "sim_compute_robot_state-npc3": 0.07440700985136486}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.2296221427574843, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06651998993879307, "in-drivable-lane": 2, "agent_compute-ego": 0.1661674176861426, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10541931455006856, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.041540832576637494, "sim_compute_performance-ego": 0.07415972641128266, "sim_compute_robot_state-ego": 0.08228771700830517, "sim_compute_robot_state-npc0": 0.07411146449471662, "sim_compute_robot_state-npc1": 0.07392770658710046, "sim_compute_robot_state-npc2": 0.07286546330252093, "sim_compute_robot_state-npc3": 0.0739904663519945}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.211460134358082, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.0629593307532153, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15849983807906365, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.09656974644336884, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042041077197176736, "sim_compute_performance-ego": 0.07118459812645773, "sim_compute_robot_state-ego": 0.07727286422136918, "sim_compute_robot_state-npc0": 0.06916949124012178, "sim_compute_robot_state-npc1": 0.06975884576445644, "sim_compute_robot_state-npc2": 0.06833722521957841, "sim_compute_robot_state-npc3": 0.07080699170677407}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.21209826946258545, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06312098026275635, "in-drivable-lane": 0, "agent_compute-ego": 0.14329748153686522, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.09266141891479492, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03849190711975098, "sim_compute_performance-ego": 0.06596234798431397, "sim_compute_robot_state-ego": 0.06990399837493896, "sim_compute_robot_state-npc0": 0.0662151288986206, "sim_compute_robot_state-npc1": 0.0689169979095459, "sim_compute_robot_state-npc2": 0.0704302453994751, "sim_compute_robot_state-npc3": 0.06821877479553223}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1861679508135869, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06302736355708195, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15932984077013457, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.0985938677420983, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03962328342291025, "sim_compute_performance-ego": 0.06916679785801814, "sim_compute_robot_state-ego": 0.07313522467246422, "sim_compute_robot_state-npc0": 0.07074390924893893, "sim_compute_robot_state-npc1": 0.07074678402680618, "sim_compute_robot_state-npc2": 0.07216124351208027, "sim_compute_robot_state-npc3": 0.06717104178208572}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.22933509716620812, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06367901655343863, "in-drivable-lane": 0, "agent_compute-ego": 0.15621323768909162, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09923061957726112, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.04063542072589581, "sim_compute_performance-ego": 0.06412511605482835, "sim_compute_robot_state-ego": 0.0736994926746075, "sim_compute_robot_state-npc0": 0.06700860537015475, "sim_compute_robot_state-npc1": 0.07145221416766827, "sim_compute_robot_state-npc2": 0.06968254309434158, "sim_compute_robot_state-npc3": 0.07190390733572152}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.20011992888017135, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06140307946638627, "in-drivable-lane": 0, "agent_compute-ego": 0.16267921707846902, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.09430048682472925, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03961896896362305, "sim_compute_performance-ego": 0.06663214076649059, "sim_compute_robot_state-ego": 0.0740671157836914, "sim_compute_robot_state-npc0": 0.06950640678405762, "sim_compute_robot_state-npc1": 0.06467446413907138, "sim_compute_robot_state-npc2": 0.0688620155507868, "sim_compute_robot_state-npc3": 0.07256188175894997}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.2167334890365601, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06541077613830566, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16791627883911134, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.10590073585510254, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04037092685699463, "sim_compute_performance-ego": 0.07113199710845947, "sim_compute_robot_state-ego": 0.08040196895599365, "sim_compute_robot_state-npc0": 0.07548116207122803, "sim_compute_robot_state-npc1": 0.07278655052185058, "sim_compute_robot_state-npc2": 0.07131700992584228, "sim_compute_robot_state-npc3": 0.07201198577880859}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2003512940508254, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.0630185325094994, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15175351183465186, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.098077581283894, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.039169882206206624, "sim_compute_performance-ego": 0.0710801418791426, "sim_compute_robot_state-ego": 0.07393046642871613, "sim_compute_robot_state-npc0": 0.06866304164237165, "sim_compute_robot_state-npc1": 0.07016004400050387, "sim_compute_robot_state-npc2": 0.06939416996976162, "sim_compute_robot_state-npc3": 0.07023952108748416}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.1976577639579773, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.0623513597708482, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14942414943988508, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.0986908353292025, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03967227844091562, "sim_compute_performance-ego": 0.06678574818831223, "sim_compute_robot_state-ego": 0.0733109712600708, "sim_compute_robot_state-npc0": 0.06788832866228543, "sim_compute_robot_state-npc1": 0.07110820366786076, "sim_compute_robot_state-npc2": 0.0679028584406926, "sim_compute_robot_state-npc3": 0.06762800308374259}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.18841309320359004, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06030330657958984, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1560309818812779, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09567794572739374, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03802407128470285, "sim_compute_performance-ego": 0.07011439232599168, "sim_compute_robot_state-ego": 0.07565754027593703, "sim_compute_robot_state-npc0": 0.0696953432900565, "sim_compute_robot_state-npc1": 0.06885545594351632, "sim_compute_robot_state-npc2": 0.06692738305954705, "sim_compute_robot_state-npc3": 0.06964860870724633}}
set_robot_commands_max0.11362730889093307
set_robot_commands_mean0.1016230954251148
set_robot_commands_median0.09923061957726112
set_robot_commands_min0.09266141891479492
sim_compute_performance-ego_max0.07624313944862002
sim_compute_performance-ego_mean0.07083341700499554
sim_compute_performance-ego_median0.07113199710845947
sim_compute_performance-ego_min0.06412511605482835
sim_compute_robot_state-ego_max0.08888275282723564
sim_compute_robot_state-ego_mean0.07887440549566273
sim_compute_robot_state-ego_median0.07727286422136918
sim_compute_robot_state-ego_min0.06990399837493896
sim_compute_robot_state-npc0_max0.07780563263666063
sim_compute_robot_state-npc0_mean0.07169387018299136
sim_compute_robot_state-npc0_median0.07074390924893893
sim_compute_robot_state-npc0_min0.0662151288986206
sim_compute_robot_state-npc1_max0.07805013656616211
sim_compute_robot_state-npc1_mean0.0719709475811193
sim_compute_robot_state-npc1_median0.07145221416766827
sim_compute_robot_state-npc1_min0.06467446413907138
sim_compute_robot_state-npc2_max0.08009172621227446
sim_compute_robot_state-npc2_mean0.07142039322806851
sim_compute_robot_state-npc2_median0.07131700992584228
sim_compute_robot_state-npc2_min0.06692738305954705
sim_compute_robot_state-npc3_max0.07453201214472453
sim_compute_robot_state-npc3_mean0.07154460963304204
sim_compute_robot_state-npc3_median0.07201198577880859
sim_compute_robot_state-npc3_min0.06717104178208572
sim_compute_sim_state_max0.043800456183297296
sim_compute_sim_state_mean0.04059490931059732
sim_compute_sim_state_median0.04059939746615253
sim_compute_sim_state_min0.03802407128470285
sim_physics_max0.24297440548737845
sim_physics_mean0.2146948209337043
sim_physics_median0.21209826946258545
sim_physics_min0.1861679508135869
sim_render-ego_max0.06837659847887256
sim_render-ego_mean0.06464548303825922
sim_render-ego_median0.06367901655343863
sim_render-ego_min0.06030330657958984
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
227502831AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12070:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227462836AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryes12070:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227212910MYFtestaido2-LF-sim-validationstep1-simulationsuccessyes12070:23:33(hidden)
driven_lanedir_consec_median3.2065315568472017
survival_time_median14.950000000000076
deviation-center-line_median0.6608662324231004
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1776868895198522
agent_compute-ego_mean0.16642249273271598
agent_compute-ego_median0.16349775314331055
agent_compute-ego_min0.15786476055781046
deviation-center-line_max0.8947094063964482
deviation-center-line_mean0.5601569562906171
deviation-center-line_min0.24879541822873455
deviation-heading_max3.316687353563192
deviation-heading_mean2.197042721001047
deviation-heading_median2.533543265062995
deviation-heading_min0.9274711434407208
driven_any_max3.553873881851535
driven_any_mean2.912025450197535
driven_any_median3.3353525505639396
driven_any_min0.9590752174546616
driven_lanedir_consec_max3.5420373155740235
driven_lanedir_consec_mean2.7261508561196304
driven_lanedir_consec_min0.9330035469255824
driven_lanedir_max3.5420373155740235
driven_lanedir_mean2.7261508561196304
driven_lanedir_median3.2065315568472017
driven_lanedir_min0.9330035469255824
in-drivable-lane_max2.4000000000000012
in-drivable-lane_mean0.48000000000000026
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.328490288240608, "sim_physics": 0.10597785631815591, "survival_time": 14.950000000000076, "driven_lanedir": 2.6351257552160514, "sim_render-ego": 0.061685988903045656, "in-drivable-lane": 2.4000000000000012, "agent_compute-ego": 0.15912100632985432, "deviation-heading": 3.316687353563192, "set_robot_commands": 0.09200509468714396, "deviation-center-line": 0.6608662324231004, "driven_lanedir_consec": 2.6351257552160514, "sim_compute_sim_state": 0.03743572155634562, "sim_compute_performance-ego": 0.06813088099161783, "sim_compute_robot_state-ego": 0.07354091882705688}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.553873881851535, "sim_physics": 0.09959388573964437, "survival_time": 14.950000000000076, "driven_lanedir": 3.5420373155740235, "sim_render-ego": 0.06009815295537313, "in-drivable-lane": 0, "agent_compute-ego": 0.15786476055781046, "deviation-heading": 1.0286281516695048, "set_robot_commands": 0.0938202182451884, "deviation-center-line": 0.3039988426937896, "driven_lanedir_consec": 3.5420373155740235, "sim_compute_sim_state": 0.03835430463155111, "sim_compute_performance-ego": 0.06861550410588582, "sim_compute_robot_state-ego": 0.0735232694943746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.38333531287693, "sim_physics": 0.1142594067255656, "survival_time": 14.950000000000076, "driven_lanedir": 3.3140561060352924, "sim_render-ego": 0.06249160528182984, "in-drivable-lane": 0, "agent_compute-ego": 0.16349775314331055, "deviation-heading": 2.533543265062995, "set_robot_commands": 0.09754361391067504, "deviation-center-line": 0.6924148817110127, "driven_lanedir_consec": 3.3140561060352924, "sim_compute_sim_state": 0.041495993932088214, "sim_compute_performance-ego": 0.07120678345362345, "sim_compute_robot_state-ego": 0.07796769301096598}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9590752174546616, "sim_physics": 0.11875482355610709, "survival_time": 4.449999999999992, "driven_lanedir": 0.9330035469255824, "sim_render-ego": 0.06857802894678008, "in-drivable-lane": 0, "agent_compute-ego": 0.1776868895198522, "deviation-heading": 0.9274711434407208, "set_robot_commands": 0.1040013050765134, "deviation-center-line": 0.24879541822873455, "driven_lanedir_consec": 0.9330035469255824, "sim_compute_sim_state": 0.04247332690806871, "sim_compute_performance-ego": 0.07492650492807452, "sim_compute_robot_state-ego": 0.08257946807346987}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.3353525505639396, "sim_physics": 0.11430821180343628, "survival_time": 14.950000000000076, "driven_lanedir": 3.2065315568472017, "sim_render-ego": 0.0674154019355774, "in-drivable-lane": 0, "agent_compute-ego": 0.1739420541127523, "deviation-heading": 3.1788836912688234, "set_robot_commands": 0.10545117378234864, "deviation-center-line": 0.8947094063964482, "driven_lanedir_consec": 3.2065315568472017, "sim_compute_sim_state": 0.04174989620844523, "sim_compute_performance-ego": 0.07373270034790039, "sim_compute_robot_state-ego": 0.08126854260762532}}
set_robot_commands_max0.10545117378234864
set_robot_commands_mean0.09856428114037388
set_robot_commands_median0.09754361391067504
set_robot_commands_min0.09200509468714396
sim_compute_performance-ego_max0.07492650492807452
sim_compute_performance-ego_mean0.07132247476542039
sim_compute_performance-ego_median0.07120678345362345
sim_compute_performance-ego_min0.06813088099161783
sim_compute_robot_state-ego_max0.08257946807346987
sim_compute_robot_state-ego_mean0.07777597840269854
sim_compute_robot_state-ego_median0.07796769301096598
sim_compute_robot_state-ego_min0.0735232694943746
sim_compute_sim_state_max0.04247332690806871
sim_compute_sim_state_mean0.04030184864729978
sim_compute_sim_state_median0.041495993932088214
sim_compute_sim_state_min0.03743572155634562
sim_physics_max0.11875482355610709
sim_physics_mean0.11057883682858186
sim_physics_median0.1142594067255656
sim_physics_min0.09959388573964437
sim_render-ego_max0.06857802894678008
sim_render-ego_mean0.06405383560452123
sim_render-ego_median0.06249160528182984
sim_render-ego_min0.06009815295537313
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.85000000000006
survival_time_min4.449999999999992
226962952Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes12070:22:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226343063Andrea Censirotationaido2-LFVI-sim-validationstep1-simulationsuccessyes12070:37:05(hidden)
driven_lanedir_consec_median0.000305044676884636
survival_time_median14.950000000000076
deviation-center-line_median0.4891046565937845
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.15654685099919638
agent_compute-ego_mean0.15515980195999146
agent_compute-ego_median0.15556374073028564
agent_compute-ego_min0.1525131313006083
deviation-center-line_max0.6113246250082045
deviation-center-line_mean0.4225460275157091
deviation-center-line_min0.020737627062439232
deviation-heading_max5.830135897709594
deviation-heading_mean5.684570550707688
deviation-heading_median5.657649106857694
deviation-heading_min5.536662996854866
driven_any_max0.02647867283405392
driven_any_mean0.024864239592253624
driven_any_median0.02593019554120814
driven_any_min0.02216545266138003
driven_lanedir_consec_max0.002162616049345756
driven_lanedir_consec_mean-0.0004886462276792348
driven_lanedir_consec_min-0.0036402347654349576
driven_lanedir_max0.002162616049345756
driven_lanedir_mean-0.0004886462276792348
driven_lanedir_median0.000305044676884636
driven_lanedir_min-0.0036402347654349576
in-drivable-lane_max7.650000000000043
in-drivable-lane_mean7.600000000000042
in-drivable-lane_min7.550000000000044
per-episodes
details{"udem1-0-0": {"driven_any": 0.02647867283405392, "sim_physics": 0.19089327017466223, "survival_time": 14.950000000000076, "driven_lanedir": 0.002162616049345756, "sim_render-ego": 0.06302229086558024, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.15556374073028564, "deviation-heading": 5.657649106857694, "set_robot_commands": 0.09884076515833536, "deviation-center-line": 0.561012181201902, "driven_lanedir_consec": 0.002162616049345756, "sim_compute_sim_state": 0.039439262549082435, "sim_compute_performance-ego": 0.06963777860005696, "sim_compute_robot_state-ego": 0.074398725827535, "sim_compute_robot_state-npc0": 0.06983048597971599, "sim_compute_robot_state-npc1": 0.06944490591684978, "sim_compute_robot_state-npc2": 0.06962353150049845, "sim_compute_robot_state-npc3": 0.06919933398564657}, "udem1-1-0": {"driven_any": 0.02593019554120814, "sim_physics": 0.20286035776138303, "survival_time": 14.950000000000076, "driven_lanedir": -0.0036402347654349576, "sim_render-ego": 0.06266499201456706, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.15478568871815998, "deviation-heading": 5.795316370396738, "set_robot_commands": 0.09711106459299725, "deviation-center-line": 0.6113246250082045, "driven_lanedir_consec": -0.0036402347654349576, "sim_compute_sim_state": 0.038844245274861654, "sim_compute_performance-ego": 0.06830163399378458, "sim_compute_robot_state-ego": 0.07329256534576416, "sim_compute_robot_state-npc0": 0.06876020113627115, "sim_compute_robot_state-npc1": 0.06832564353942872, "sim_compute_robot_state-npc2": 0.06931315739949544, "sim_compute_robot_state-npc3": 0.06895219405492146}, "udem1-2-0": {"driven_any": 0.02380440467243486, "sim_physics": 0.18972459316253665, "survival_time": 14.950000000000076, "driven_lanedir": 0.0017436411031614971, "sim_render-ego": 0.06299083471298218, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.1525131313006083, "deviation-heading": 5.6030883817195525, "set_robot_commands": 0.0960243574778239, "deviation-center-line": 0.4891046565937845, "driven_lanedir_consec": 0.0017436411031614971, "sim_compute_sim_state": 0.039229941368103025, "sim_compute_performance-ego": 0.06829575777053833, "sim_compute_robot_state-ego": 0.07406152486801147, "sim_compute_robot_state-npc0": 0.06943959792455037, "sim_compute_robot_state-npc1": 0.06908557812372844, "sim_compute_robot_state-npc2": 0.06909600734710693, "sim_compute_robot_state-npc3": 0.07063842535018922}, "udem1-3-0": {"driven_any": 0.02216545266138003, "sim_physics": 0.19260472615559895, "survival_time": 14.950000000000076, "driven_lanedir": -0.003014298202353105, "sim_render-ego": 0.0632344675064087, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.15654685099919638, "deviation-heading": 5.536662996854866, "set_robot_commands": 0.1002322467168172, "deviation-center-line": 0.4305510477122152, "driven_lanedir_consec": -0.003014298202353105, "sim_compute_sim_state": 0.03851029396057129, "sim_compute_performance-ego": 0.06892403920491537, "sim_compute_robot_state-ego": 0.07397625048955282, "sim_compute_robot_state-npc0": 0.06884946743647258, "sim_compute_robot_state-npc1": 0.06806499083836873, "sim_compute_robot_state-npc2": 0.0688560422261556, "sim_compute_robot_state-npc3": 0.06886681715647379}, "udem1-4-0": {"driven_any": 0.02594247225219117, "sim_physics": 0.1980738425254822, "survival_time": 14.950000000000076, "driven_lanedir": 0.000305044676884636, "sim_render-ego": 0.0619713028271993, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.15638959805170696, "deviation-heading": 5.830135897709594, "set_robot_commands": 0.0978343677520752, "deviation-center-line": 0.020737627062439232, "driven_lanedir_consec": 0.000305044676884636, "sim_compute_sim_state": 0.03804886817932129, "sim_compute_performance-ego": 0.06796612977981567, "sim_compute_robot_state-ego": 0.0746860162417094, "sim_compute_robot_state-npc0": 0.0698667558034261, "sim_compute_robot_state-npc1": 0.06989970842997233, "sim_compute_robot_state-npc2": 0.06904610951741537, "sim_compute_robot_state-npc3": 0.06942482550938923}}
set_robot_commands_max0.1002322467168172
set_robot_commands_mean0.09800856033960978
set_robot_commands_median0.0978343677520752
set_robot_commands_min0.0960243574778239
sim_compute_performance-ego_max0.06963777860005696
sim_compute_performance-ego_mean0.06862506786982218
sim_compute_performance-ego_median0.06830163399378458
sim_compute_performance-ego_min0.06796612977981567
sim_compute_robot_state-ego_max0.0746860162417094
sim_compute_robot_state-ego_mean0.07408301655451457
sim_compute_robot_state-ego_median0.07406152486801147
sim_compute_robot_state-ego_min0.07329256534576416
sim_compute_robot_state-npc0_max0.0698667558034261
sim_compute_robot_state-npc0_mean0.06934930165608724
sim_compute_robot_state-npc0_median0.06943959792455037
sim_compute_robot_state-npc0_min0.06876020113627115
sim_compute_robot_state-npc1_max0.06989970842997233
sim_compute_robot_state-npc1_mean0.0689641653696696
sim_compute_robot_state-npc1_median0.06908557812372844
sim_compute_robot_state-npc1_min0.06806499083836873
sim_compute_robot_state-npc2_max0.06962353150049845
sim_compute_robot_state-npc2_mean0.06918696959813435
sim_compute_robot_state-npc2_median0.06909600734710693
sim_compute_robot_state-npc2_min0.0688560422261556
sim_compute_robot_state-npc3_max0.07063842535018922
sim_compute_robot_state-npc3_mean0.06941631921132405
sim_compute_robot_state-npc3_median0.06919933398564657
sim_compute_robot_state-npc3_min0.06886681715647379
sim_compute_sim_state_max0.039439262549082435
sim_compute_sim_state_mean0.038814522266387944
sim_compute_sim_state_median0.038844245274861654
sim_compute_sim_state_min0.03804886817932129
sim_physics_max0.20286035776138303
sim_physics_mean0.19483135795593265
sim_physics_median0.19260472615559895
sim_physics_min0.18972459316253665
sim_render-ego_max0.0632344675064087
sim_render-ego_mean0.0627767775853475
sim_render-ego_median0.06299083471298218
sim_render-ego_min0.0619713028271993
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
226203099awoo424Baseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationerroryes12070:19:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225993120RamiNaimv_d_1.75_no_cacheaido2-LF-sim-validationstep1-simulationsuccessyes12070:22:30(hidden)
driven_lanedir_consec_median0.775474084857974
survival_time_median10.95000000000002
deviation-center-line_median0.7810550239043568
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1619716180513983
agent_compute-ego_mean0.1520702888423573
agent_compute-ego_median0.1493155574798584
agent_compute-ego_min0.14219609604162328
deviation-center-line_max0.99646481510951
deviation-center-line_mean0.8354176220802868
deviation-center-line_min0.7516347002825855
deviation-heading_max3.6960886554507417
deviation-heading_mean2.0010681997366953
deviation-heading_median1.6404488404498012
deviation-heading_min0.7114199227459679
driven_any_max1.342392432966991
driven_any_mean0.9970974806463052
driven_any_median0.9749991436488198
driven_any_min0.5938700805453045
driven_lanedir_consec_max1.2738787058522747
driven_lanedir_consec_mean0.8571951711124779
driven_lanedir_consec_min0.5901381226082245
driven_lanedir_max1.2738787058522747
driven_lanedir_mean0.8571951711124779
driven_lanedir_median0.775474084857974
driven_lanedir_min0.5901381226082245
in-drivable-lane_max6.050000000000075
in-drivable-lane_mean1.210000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3380029733210768, "sim_physics": 0.14030089298884074, "survival_time": 14.950000000000076, "driven_lanedir": 1.2738787058522747, "sim_render-ego": 0.06913095871607462, "in-drivable-lane": 0, "agent_compute-ego": 0.16096760193506876, "deviation-heading": 3.6960886554507417, "set_robot_commands": 0.11329406261444092, "deviation-center-line": 0.8879413316290364, "driven_lanedir_consec": 1.2738787058522747, "sim_compute_sim_state": 0.043373262882232665, "sim_compute_performance-ego": 0.077909521261851, "sim_compute_robot_state-ego": 0.09150251706441244}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.342392432966991, "sim_physics": 0.12280195713043213, "survival_time": 14.950000000000076, "driven_lanedir": 0.775474084857974, "sim_render-ego": 0.06911956151326497, "in-drivable-lane": 6.050000000000075, "agent_compute-ego": 0.1493155574798584, "deviation-heading": 1.2951030177081482, "set_robot_commands": 0.11386958519617715, "deviation-center-line": 0.99646481510951, "driven_lanedir_consec": 0.775474084857974, "sim_compute_sim_state": 0.04334999163945516, "sim_compute_performance-ego": 0.0779108730951945, "sim_compute_robot_state-ego": 0.08930564959843953}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5938700805453045, "sim_physics": 0.1268334564040689, "survival_time": 6.799999999999984, "driven_lanedir": 0.5901381226082245, "sim_render-ego": 0.07101171682862674, "in-drivable-lane": 0, "agent_compute-ego": 0.14219609604162328, "deviation-heading": 0.7114199227459679, "set_robot_commands": 0.11524311759892632, "deviation-center-line": 0.7810550239043568, "driven_lanedir_consec": 0.5901381226082245, "sim_compute_sim_state": 0.044344523373772114, "sim_compute_performance-ego": 0.07985785428215475, "sim_compute_robot_state-ego": 0.09269376887994654}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7362227727493343, "sim_physics": 0.1322120549436101, "survival_time": 8.349999999999984, "driven_lanedir": 0.717290350525492, "sim_render-ego": 0.06743864384953847, "in-drivable-lane": 0, "agent_compute-ego": 0.1459005707038377, "deviation-heading": 1.6404488404498012, "set_robot_commands": 0.11484419371553524, "deviation-center-line": 0.7516347002825855, "driven_lanedir_consec": 0.717290350525492, "sim_compute_sim_state": 0.04237748762804591, "sim_compute_performance-ego": 0.07733697662810365, "sim_compute_robot_state-ego": 0.08948739274533209}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9749991436488198, "sim_physics": 0.1286920717317764, "survival_time": 10.95000000000002, "driven_lanedir": 0.9291945917184248, "sim_render-ego": 0.06885966644983858, "in-drivable-lane": 0, "agent_compute-ego": 0.1619716180513983, "deviation-heading": 2.6622805623288164, "set_robot_commands": 0.11571303459062968, "deviation-center-line": 0.7599922394759461, "driven_lanedir_consec": 0.9291945917184248, "sim_compute_sim_state": 0.043516589081995016, "sim_compute_performance-ego": 0.07901111367630632, "sim_compute_robot_state-ego": 0.08838755572767562}}
set_robot_commands_max0.11571303459062968
set_robot_commands_mean0.11459279874314184
set_robot_commands_median0.11484419371553524
set_robot_commands_min0.11329406261444092
sim_compute_performance-ego_max0.07985785428215475
sim_compute_performance-ego_mean0.07840526778872203
sim_compute_performance-ego_median0.0779108730951945
sim_compute_performance-ego_min0.07733697662810365
sim_compute_robot_state-ego_max0.09269376887994654
sim_compute_robot_state-ego_mean0.09027537680316124
sim_compute_robot_state-ego_median0.08948739274533209
sim_compute_robot_state-ego_min0.08838755572767562
sim_compute_sim_state_max0.044344523373772114
sim_compute_sim_state_mean0.043392370921100175
sim_compute_sim_state_median0.043373262882232665
sim_compute_sim_state_min0.04237748762804591
sim_physics_max0.14030089298884074
sim_physics_mean0.13016808663974566
sim_physics_median0.1286920717317764
sim_physics_min0.12280195713043213
sim_render-ego_max0.07101171682862674
sim_render-ego_mean0.06911210947146867
sim_render-ego_median0.06911956151326497
sim_render-ego_min0.06743864384953847
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.200000000000028
survival_time_min6.799999999999984
225893137AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes12070:16:43(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17335511105401177
agent_compute-ego_mean0.15376529396208896
agent_compute-ego_median0.1524055367809231
agent_compute-ego_min0.1414956064785228
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1242155498928494, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06364086822227195, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1638414285801075, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10853796535068087, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04129158567499231, "sim_compute_performance-ego": 0.07105420695410834, "sim_compute_robot_state-ego": 0.08210468733752216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12541752703049602, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06261356204163794, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14944739435233323, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09704104591818416, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03872296856898887, "sim_compute_performance-ego": 0.07813531744713877, "sim_compute_robot_state-ego": 0.0957640806833903}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11495736066032858, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05809750276453355, "in-drivable-lane": 0, "agent_compute-ego": 0.1414956064785228, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09549302213332232, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03979281818165498, "sim_compute_performance-ego": 0.06030897533192354, "sim_compute_robot_state-ego": 0.06912690050461713}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11823034286499023, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06256624221801758, "in-drivable-lane": 0, "agent_compute-ego": 0.15992749214172364, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1007875919342041, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03790072441101074, "sim_compute_performance-ego": 0.06395463943481446, "sim_compute_robot_state-ego": 0.07066272735595704}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11699467671068409, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06050107448915892, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1460556893409053, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.095206423650814, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0393148102337801, "sim_compute_performance-ego": 0.06728532646275774, "sim_compute_robot_state-ego": 0.07481198371211185}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.10400509834289552, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06105700804262745, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.14333908411921287, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09537667157698652, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04067074036111637, "sim_compute_performance-ego": 0.06970146237587442, "sim_compute_robot_state-ego": 0.0706079979332126}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.10527022395815168, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06367439883095878, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.15896413581711905, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10328155755996704, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.03976139851978847, "sim_compute_performance-ego": 0.07059121557644435, "sim_compute_robot_state-ego": 0.08154147437640599}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12855256171453566, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06765676680065337, "in-drivable-lane": 0, "agent_compute-ego": 0.16141257967267716, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.09653306007385254, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04060963221958706, "sim_compute_performance-ego": 0.07659353528703962, "sim_compute_robot_state-ego": 0.08238611902509417}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11313754421169477, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0637434417918577, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.1524055367809231, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09773703752937964, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03793848167031498, "sim_compute_performance-ego": 0.07025647567490399, "sim_compute_robot_state-ego": 0.07342722052234714}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.10374163280833852, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05997933040965687, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.14949938600713555, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.096788874539462, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03805180029435591, "sim_compute_performance-ego": 0.06623237783258612, "sim_compute_robot_state-ego": 0.07023194486444646}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11421982653729328, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.061444338265951574, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15193747235583022, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0948496607991008, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.037667314727585034, "sim_compute_performance-ego": 0.06769664566238205, "sim_compute_robot_state-ego": 0.07406222046195686}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12755405051367624, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06628790072032384, "in-drivable-lane": 0, "agent_compute-ego": 0.17335511105401177, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10736215966088432, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.040863752365112305, "sim_compute_performance-ego": 0.08554095881325859, "sim_compute_robot_state-ego": 0.08128868682043892}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10712395929822736, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.061010342018277035, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15401280160043754, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09963655004314348, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.039110179040946214, "sim_compute_performance-ego": 0.06956085971757478, "sim_compute_robot_state-ego": 0.07696016162049536}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.11799439677485714, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06246961487664117, "in-drivable-lane": 0, "agent_compute-ego": 0.14635705947875977, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.09339225733721698, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.0395704640282525, "sim_compute_performance-ego": 0.06627070462262188, "sim_compute_robot_state-ego": 0.0739807817671034}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.10938513746448592, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06165069926018808, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.15442863165163526, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.09540804928424312, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.03764773116392248, "sim_compute_performance-ego": 0.06796481796339446, "sim_compute_robot_state-ego": 0.07404388165941425}}
set_robot_commands_max0.10853796535068087
set_robot_commands_mean0.09849546182609611
set_robot_commands_median0.096788874539462
set_robot_commands_min0.09339225733721698
sim_compute_performance-ego_max0.08554095881325859
sim_compute_performance-ego_mean0.07007650127712155
sim_compute_performance-ego_median0.06956085971757478
sim_compute_performance-ego_min0.06030897533192354
sim_compute_robot_state-ego_max0.0957640806833903
sim_compute_robot_state-ego_mean0.07673339124296757
sim_compute_robot_state-ego_median0.07406222046195686
sim_compute_robot_state-ego_min0.06912690050461713
sim_compute_sim_state_max0.04129158567499231
sim_compute_sim_state_mean0.039260960097427224
sim_compute_sim_state_median0.0393148102337801
sim_compute_sim_state_min0.03764773116392248
sim_physics_max0.12855256171453566
sim_physics_mean0.11538665925223364
sim_physics_median0.11495736066032858
sim_physics_min0.10374163280833852
sim_render-ego_max0.06765676680065337
sim_render-ego_mean0.06242620605018371
sim_render-ego_median0.06246961487664117
sim_render-ego_min0.05809750276453355
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
225733147ioartchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes12070:07:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225463191JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes12070:25:09(hidden)
driven_lanedir_consec_median2.1708335723068592
survival_time_median14.250000000000068
deviation-center-line_median1.0389498111637927
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.11866572499275208
agent_compute-ego_mean0.11471965528606576
agent_compute-ego_median0.11485828349464818
agent_compute-ego_min0.1120895783106486
deviation-center-line_max1.3034136170074382
deviation-center-line_mean0.8649059552944497
deviation-center-line_min0.30560295173824253
deviation-heading_max4.244823401816831
deviation-heading_mean2.616382895653051
deviation-heading_median3.3887263474007976
deviation-heading_min0.5624650684792731
driven_any_max3.2172569004844633
driven_any_mean2.4469524260866984
driven_any_median3.052674868905486
driven_any_min1.0600995571912413
driven_lanedir_consec_max2.84775760347489
driven_lanedir_consec_mean1.9192590939809429
driven_lanedir_consec_min0.7301108080299653
driven_lanedir_max2.84775760347489
driven_lanedir_mean1.9192590939809429
driven_lanedir_median2.1708335723068592
driven_lanedir_min0.7301108080299653
in-drivable-lane_max3.1500000000000306
in-drivable-lane_mean1.8000000000000074
in-drivable-lane_min0.8500000000000103
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.052674868905486, "sim_physics": 0.13458379193356165, "survival_time": 14.250000000000068, "driven_lanedir": 2.1708335723068592, "sim_render-ego": 0.07107344928540682, "in-drivable-lane": 3.1500000000000306, "agent_compute-ego": 0.11485828349464818, "deviation-heading": 3.3887263474007976, "set_robot_commands": 0.1119780230940434, "deviation-center-line": 1.0389498111637927, "driven_lanedir_consec": 2.1708335723068592, "sim_compute_sim_state": 0.04375335961057429, "sim_compute_performance-ego": 0.07942509818495366, "sim_compute_robot_state-ego": 0.0878397406193248}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0600995571912413, "sim_physics": 0.1272796265129904, "survival_time": 5.14999999999999, "driven_lanedir": 0.7301108080299653, "sim_render-ego": 0.07025377958723643, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.11258075769665173, "deviation-heading": 1.2337705208397771, "set_robot_commands": 0.11390015453968232, "deviation-center-line": 0.30560295173824253, "driven_lanedir_consec": 0.7301108080299653, "sim_compute_sim_state": 0.04539679092110939, "sim_compute_performance-ego": 0.08060153711189344, "sim_compute_robot_state-ego": 0.08881969822263255}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6874755091997962, "sim_physics": 0.1337814971804619, "survival_time": 7.99999999999998, "driven_lanedir": 1.2812903679150107, "sim_render-ego": 0.07144222855567932, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11866572499275208, "deviation-heading": 0.5624650684792731, "set_robot_commands": 0.11813805103302004, "deviation-center-line": 0.5990251535460138, "driven_lanedir_consec": 1.2812903679150107, "sim_compute_sim_state": 0.04444717019796371, "sim_compute_performance-ego": 0.07993469089269638, "sim_compute_robot_state-ego": 0.0924945130944252}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.2172569004844633, "sim_physics": 0.13283394575119015, "survival_time": 14.950000000000076, "driven_lanedir": 2.566303118177988, "sim_render-ego": 0.07139572540918986, "in-drivable-lane": 2.000000000000008, "agent_compute-ego": 0.1120895783106486, "deviation-heading": 4.244823401816831, "set_robot_commands": 0.10878412326176962, "deviation-center-line": 1.077538243016761, "driven_lanedir_consec": 2.566303118177988, "sim_compute_sim_state": 0.043628947734832765, "sim_compute_performance-ego": 0.07915256341298421, "sim_compute_robot_state-ego": 0.08799504121144612}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.217255294652504, "sim_physics": 0.12066758553187051, "survival_time": 14.950000000000076, "driven_lanedir": 2.84775760347489, "sim_render-ego": 0.07091130256652832, "in-drivable-lane": 0.8500000000000103, "agent_compute-ego": 0.11540393193562826, "deviation-heading": 3.652129139728575, "set_robot_commands": 0.11360753854115804, "deviation-center-line": 1.3034136170074382, "driven_lanedir_consec": 2.84775760347489, "sim_compute_sim_state": 0.04315538962682088, "sim_compute_performance-ego": 0.07984337091445923, "sim_compute_robot_state-ego": 0.09003039360046387}}
set_robot_commands_max0.11813805103302004
set_robot_commands_mean0.11328157809393467
set_robot_commands_median0.11360753854115804
set_robot_commands_min0.10878412326176962
sim_compute_performance-ego_max0.08060153711189344
sim_compute_performance-ego_mean0.07979145210339737
sim_compute_performance-ego_median0.07984337091445923
sim_compute_performance-ego_min0.07915256341298421
sim_compute_robot_state-ego_max0.0924945130944252
sim_compute_robot_state-ego_mean0.08943587734965851
sim_compute_robot_state-ego_median0.08881969822263255
sim_compute_robot_state-ego_min0.0878397406193248
sim_compute_sim_state_max0.04539679092110939
sim_compute_sim_state_mean0.0440763316182602
sim_compute_sim_state_median0.04375335961057429
sim_compute_sim_state_min0.04315538962682088
sim_physics_max0.13458379193356165
sim_physics_mean0.1298292893820149
sim_physics_median0.13283394575119015
sim_physics_min0.12066758553187051
sim_render-ego_max0.07144222855567932
sim_render-ego_mean0.07101529708080816
sim_render-ego_median0.07107344928540682
sim_render-ego_min0.07025377958723643
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.460000000000036
survival_time_min5.14999999999999