AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1169

evaluator1169
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success37
# timeout
# failed3
# error47
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.5 GB
Disk (MB)96.9 GB
Disk available (MB)47.5 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230873558kar1989PredictorLastaido2-PREDstep1-simulationsuccessyes11690:00:28(hidden)
error_L10.11772218205910091
error_L20.02143953392240987


230803557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes11690:05:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230352410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryes11690:07:12
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230282369Liam Paullminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessyes11690:26:36(hidden)
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1572352233140365
agent_compute-ego_mean0.13595605158548665
agent_compute-ego_median0.14215392689053102
agent_compute-ego_min0.11347536731966966
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.09592242721173404, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05675690637218009, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14215392689053102, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08941711453225115, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03627225649442605, "sim_compute_performance-ego": 0.06306760945766092, "sim_compute_robot_state-ego": 0.06449515184910178}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10474487372807094, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.06167295319693429, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.15474269390106202, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.09371257850102016, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.03902083124433245, "sim_compute_performance-ego": 0.07011977093560355, "sim_compute_robot_state-ego": 0.07493132012231009}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.10455013381110298, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.059004624684651695, "in-drivable-lane": 0, "agent_compute-ego": 0.13749078114827473, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.0893472671508789, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.037511253356933595, "sim_compute_performance-ego": 0.06856992509629992, "sim_compute_robot_state-ego": 0.0674175845252143}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11872415698092915, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.06429152644198874, "in-drivable-lane": 0, "agent_compute-ego": 0.1572352233140365, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.09909786089606908, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.04774820545445318, "sim_compute_performance-ego": 0.06934194720309714, "sim_compute_robot_state-ego": 0.078100077483965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.09829109553332742, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.05859089986374389, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.14517880901354088, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.08882008404492243, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.036927811086994326, "sim_compute_performance-ego": 0.0633139773590924, "sim_compute_robot_state-ego": 0.06981341479575798}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.10342088767460414, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.056389151300702774, "in-drivable-lane": 0, "agent_compute-ego": 0.1458723613194057, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.09143108640398298, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.037063281876700264, "sim_compute_performance-ego": 0.06354445048740932, "sim_compute_robot_state-ego": 0.06783135277884347}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.10041950118373816, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.05765419778689533, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14354698087128115, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.0922200427928441, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.036962492365232656, "sim_compute_performance-ego": 0.06592633186931342, "sim_compute_robot_state-ego": 0.06831178195039991}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.09780183564061704, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.05558329561482305, "in-drivable-lane": 0, "agent_compute-ego": 0.13129594533339792, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08958671403967816, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03305868480516517, "sim_compute_performance-ego": 0.061823860458705734, "sim_compute_robot_state-ego": 0.06403073538904605}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.10506605307261148, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.05691059695349799, "in-drivable-lane": 0, "agent_compute-ego": 0.14426073763105604, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0891358560985989, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.03685417970021566, "sim_compute_performance-ego": 0.06366237004597981, "sim_compute_robot_state-ego": 0.06947972244686551}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11021935248720471, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.05833298572595569, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14963838155718817, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.08930477197619452, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.037501677222873855, "sim_compute_performance-ego": 0.06739770502283954, "sim_compute_robot_state-ego": 0.06942608045495074}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.07781702115995075, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.045892590776495976, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11602749518298228, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.06958249512068722, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.029007212831339703, "sim_compute_performance-ego": 0.04869504806098588, "sim_compute_robot_state-ego": 0.05025367889929255}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.0832856794198354, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.04538893368509081, "in-drivable-lane": 0, "agent_compute-ego": 0.12249159150653416, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.06773063871595594, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.02775459819369846, "sim_compute_performance-ego": 0.04950284626748827, "sim_compute_robot_state-ego": 0.05155957738558451}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.07296421373490806, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.044202648478446245, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11347536731966966, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.07290187327981852, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.029274124035732353, "sim_compute_performance-ego": 0.054119302214478415, "sim_compute_robot_state-ego": 0.05181171739701745}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.07929427340879279, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.0458046662605415, "in-drivable-lane": 0, "agent_compute-ego": 0.1195574938240698, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.07083348500526558, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03083896232863604, "sim_compute_performance-ego": 0.0504585605556682, "sim_compute_robot_state-ego": 0.05017844701217393}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.07290810074548998, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.04633278767597626, "in-drivable-lane": 0, "agent_compute-ego": 0.11637298496926968, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.07000570772099791, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.029946607178177577, "sim_compute_performance-ego": 0.05035975859867586, "sim_compute_robot_state-ego": 0.05093941550037178}}
set_robot_commands_max0.09909786089606908
set_robot_commands_mean0.0842085050852777
set_robot_commands_median0.08930477197619452
set_robot_commands_min0.06773063871595594
sim_compute_performance-ego_max0.07011977093560355
sim_compute_performance-ego_mean0.06066023090888657
sim_compute_performance-ego_median0.0633139773590924
sim_compute_performance-ego_min0.04869504806098588
sim_compute_robot_state-ego_max0.078100077483965
sim_compute_robot_state-ego_mean0.06323867053272632
sim_compute_robot_state-ego_median0.0674175845252143
sim_compute_robot_state-ego_min0.05017844701217393
sim_compute_sim_state_max0.04774820545445318
sim_compute_sim_state_mean0.03504947854499409
sim_compute_sim_state_median0.03685417970021566
sim_compute_sim_state_min0.02775459819369846
sim_physics_max0.11872415698092915
sim_physics_mean0.09502864038619444
sim_physics_median0.09829109553332742
sim_physics_min0.07290810074548998
sim_render-ego_max0.06429152644198874
sim_render-ego_mean0.05418725098786162
sim_render-ego_median0.05675690637218009
sim_render-ego_min0.044202648478446245
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
230202378Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-validationstep1-simulationsuccessyes11690:09:45(hidden)
driven_lanedir_consec_median0.6707441932890994
survival_time_median3.649999999999995
deviation-center-line_median0.14435558631904788
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.06552887601511818
agent_compute-ego_mean0.06280630281722203
agent_compute-ego_median0.0628955066204071
agent_compute-ego_min0.06104443967342377
deviation-center-line_max0.2085822874042474
deviation-center-line_mean0.1589542518908908
deviation-center-line_min0.10686452122645386
deviation-heading_max0.6191860504142408
deviation-heading_mean0.523857550127959
deviation-heading_median0.5156622477370731
deviation-heading_min0.42218734391092383
driven_any_max1.5798273185720382
driven_any_mean0.9978358087547315
driven_any_median0.9948273195001778
driven_any_min0.3798605253583843
driven_lanedir_consec_max1.2017887891468408
driven_lanedir_consec_mean0.7740609626522831
driven_lanedir_consec_min0.366714522485295
driven_lanedir_max1.2017887891468408
driven_lanedir_mean0.7740609626522831
driven_lanedir_median0.6707441932890994
driven_lanedir_min0.366714522485295
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1640774321882692, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05986731999540982, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0631806687132953, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08712793049746997, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03477472475130264, "sim_compute_performance-ego": 0.06583667454654224, "sim_compute_robot_state-ego": 0.0684784569152414, "sim_compute_robot_state-npc0": 0.06456412681161541, "sim_compute_robot_state-npc1": 0.06558044642618258, "sim_compute_robot_state-npc2": 0.06576648150404839, "sim_compute_robot_state-npc3": 0.06109000232121716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.17349733533086004, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05897752014366356, "in-drivable-lane": 0, "agent_compute-ego": 0.061382023063865865, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08884826866356102, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03321682440268027, "sim_compute_performance-ego": 0.06234375206199852, "sim_compute_robot_state-ego": 0.06749632551863387, "sim_compute_robot_state-npc0": 0.06552347621402226, "sim_compute_robot_state-npc1": 0.06344219800588247, "sim_compute_robot_state-npc2": 0.06538413666390083, "sim_compute_robot_state-npc3": 0.06129148844126109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.1820920216185706, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.06386107632092067, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06552887601511818, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0962388515472412, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03943673201969692, "sim_compute_performance-ego": 0.06948624125548772, "sim_compute_robot_state-ego": 0.07826523695673261, "sim_compute_robot_state-npc0": 0.06734562984534673, "sim_compute_robot_state-npc1": 0.06924572374139513, "sim_compute_robot_state-npc2": 0.07068343673433576, "sim_compute_robot_state-npc3": 0.07058608319078173}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.16953263325350626, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.057742342352867126, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06104443967342377, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08694963157176971, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03599854665143149, "sim_compute_performance-ego": 0.06488257433686938, "sim_compute_robot_state-ego": 0.06835811691624778, "sim_compute_robot_state-npc0": 0.06591954827308655, "sim_compute_robot_state-npc1": 0.06403729958193642, "sim_compute_robot_state-npc2": 0.06547597476414271, "sim_compute_robot_state-npc3": 0.06387626699038915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.18048782646656036, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06472700834274292, "in-drivable-lane": 0, "agent_compute-ego": 0.0628955066204071, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.09321898221969604, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04040811210870743, "sim_compute_performance-ego": 0.06805245578289032, "sim_compute_robot_state-ego": 0.07599849998950958, "sim_compute_robot_state-npc0": 0.07263916730880737, "sim_compute_robot_state-npc1": 0.06910749524831772, "sim_compute_robot_state-npc2": 0.0684482529759407, "sim_compute_robot_state-npc3": 0.07227946817874908}}
set_robot_commands_max0.0962388515472412
set_robot_commands_mean0.0904767328999476
set_robot_commands_median0.08884826866356102
set_robot_commands_min0.08694963157176971
sim_compute_performance-ego_max0.06948624125548772
sim_compute_performance-ego_mean0.06612033959675764
sim_compute_performance-ego_median0.06583667454654224
sim_compute_performance-ego_min0.06234375206199852
sim_compute_robot_state-ego_max0.07826523695673261
sim_compute_robot_state-ego_mean0.07171932725927305
sim_compute_robot_state-ego_median0.0684784569152414
sim_compute_robot_state-ego_min0.06749632551863387
sim_compute_robot_state-npc0_max0.07263916730880737
sim_compute_robot_state-npc0_mean0.06719838969057565
sim_compute_robot_state-npc0_median0.06591954827308655
sim_compute_robot_state-npc0_min0.06456412681161541
sim_compute_robot_state-npc1_max0.06924572374139513
sim_compute_robot_state-npc1_mean0.06628263260074287
sim_compute_robot_state-npc1_median0.06558044642618258
sim_compute_robot_state-npc1_min0.06344219800588247
sim_compute_robot_state-npc2_max0.07068343673433576
sim_compute_robot_state-npc2_mean0.06715165652847369
sim_compute_robot_state-npc2_median0.06576648150404839
sim_compute_robot_state-npc2_min0.06538413666390083
sim_compute_robot_state-npc3_max0.07227946817874908
sim_compute_robot_state-npc3_mean0.06582466182447963
sim_compute_robot_state-npc3_median0.06387626699038915
sim_compute_robot_state-npc3_min0.06109000232121716
sim_compute_sim_state_max0.04040811210870743
sim_compute_sim_state_mean0.03676698798676375
sim_compute_sim_state_median0.03599854665143149
sim_compute_sim_state_min0.03321682440268027
sim_physics_max0.1820920216185706
sim_physics_mean0.1739374497715533
sim_physics_median0.17349733533086004
sim_physics_min0.1640774321882692
sim_render-ego_max0.06472700834274292
sim_render-ego_mean0.06103505343112081
sim_render-ego_median0.05986731999540982
sim_render-ego_min0.057742342352867126
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean3.6599999999999944
survival_time_min1.6000000000000008
230052406vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:15:05(hidden)
driven_lanedir_consec_median0.07491694695314322
survival_time_median1.2000000000000004
deviation-center-line_median0.05640650632522012
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18514677194448617
agent_compute-ego_mean0.15781646682479547
agent_compute-ego_median0.15999878020513625
agent_compute-ego_min0.118154915896329
deviation-center-line_max0.08992127954448668
deviation-center-line_mean0.06199087358005375
deviation-center-line_min0.029898656059950363
deviation-heading_max0.7793216720398054
deviation-heading_mean0.6351662554476409
deviation-heading_median0.627212219486254
deviation-heading_min0.44897143643374027
driven_any_max0.24030167248186943
driven_any_mean0.1637581090455199
driven_any_median0.15335033954569677
driven_any_min0.10719505692270384
driven_lanedir_consec_max0.1105641789865821
driven_lanedir_consec_mean0.0816277105454037
driven_lanedir_consec_min0.04884938601700406
driven_lanedir_max0.1105641789865821
driven_lanedir_mean0.0816277105454037
driven_lanedir_median0.07491694695314322
driven_lanedir_min0.04884938601700406
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21834837244228128, "sim_physics": 0.1967623450539329, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08907174895440817, "sim_render-ego": 0.06126224633419153, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16764759294914475, "deviation-heading": 0.627212219486254, "set_robot_commands": 0.09312995997342197, "deviation-center-line": 0.05640650632522012, "driven_lanedir_consec": 0.08907174895440817, "sim_compute_sim_state": 0.03755643873503714, "sim_compute_performance-ego": 0.0652910362590443, "sim_compute_robot_state-ego": 0.06922458879875415, "sim_compute_robot_state-npc0": 0.06928756742766409, "sim_compute_robot_state-npc1": 0.06901670224738843, "sim_compute_robot_state-npc2": 0.06910524946270567, "sim_compute_robot_state-npc3": 0.06384660258437648}, "udem1-1-0": {"driven_any": 0.2045346177376563, "sim_physics": 0.21124045848846432, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06362435804351518, "sim_render-ego": 0.05997539361317952, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15187825361887614, "deviation-heading": 0.7701213375122605, "set_robot_commands": 0.08562199274698894, "deviation-center-line": 0.052454023176684954, "driven_lanedir_consec": 0.06362435804351518, "sim_compute_sim_state": 0.03502531051635742, "sim_compute_performance-ego": 0.06684813499450684, "sim_compute_robot_state-ego": 0.07066365083058675, "sim_compute_robot_state-npc0": 0.06501454512278239, "sim_compute_robot_state-npc1": 0.06799400647481282, "sim_compute_robot_state-npc2": 0.0674485445022583, "sim_compute_robot_state-npc3": 0.0671061118443807}, "udem1-2-0": {"driven_any": 0.13473286612834703, "sim_physics": 0.21655885378519693, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10476909761056152, "sim_render-ego": 0.05189629963466099, "in-drivable-lane": 0, "agent_compute-ego": 0.15094499360947383, "deviation-heading": 0.44897143643374027, "set_robot_commands": 0.0914754413423084, "deviation-center-line": 0.08931524869683488, "driven_lanedir_consec": 0.10476909761056152, "sim_compute_sim_state": 0.0371892565772647, "sim_compute_performance-ego": 0.05950264703659784, "sim_compute_robot_state-ego": 0.06116531008765811, "sim_compute_robot_state-npc0": 0.06933429127647764, "sim_compute_robot_state-npc1": 0.06236848377046131, "sim_compute_robot_state-npc2": 0.06178171294076102, "sim_compute_robot_state-npc3": 0.06307389622642881}, "udem1-3-0": {"driven_any": 0.14291483300418928, "sim_physics": 0.20723029700192536, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10912498173282748, "sim_render-ego": 0.06438488310033624, "in-drivable-lane": 0, "agent_compute-ego": 0.15604416890577835, "deviation-heading": 0.4972118822697814, "set_robot_commands": 0.07843211564150723, "deviation-center-line": 0.08992127954448668, "driven_lanedir_consec": 0.10912498173282748, "sim_compute_sim_state": 0.03280678662386807, "sim_compute_performance-ego": 0.061022400856018066, "sim_compute_robot_state-ego": 0.06718773191625421, "sim_compute_robot_state-npc0": 0.058065143498507416, "sim_compute_robot_state-npc1": 0.06463762846860019, "sim_compute_robot_state-npc2": 0.05942730470137163, "sim_compute_robot_state-npc3": 0.06262124668468129}, "udem1-4-0": {"driven_any": 0.14178276315110397, "sim_physics": 0.14299599329630533, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0693188667294804, "sim_render-ego": 0.04609111944834391, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1261963744958242, "deviation-heading": 0.680313885491405, "set_robot_commands": 0.0747896134853363, "deviation-center-line": 0.03890204995911767, "driven_lanedir_consec": 0.0693188667294804, "sim_compute_sim_state": 0.029874682426452637, "sim_compute_performance-ego": 0.04906908671061198, "sim_compute_robot_state-ego": 0.04971322417259216, "sim_compute_robot_state-npc0": 0.04903501272201538, "sim_compute_robot_state-npc1": 0.04909228285153707, "sim_compute_robot_state-npc2": 0.04815538724263509, "sim_compute_robot_state-npc3": 0.04800178607304891}, "udem1-5-0": {"driven_any": 0.24030167248186943, "sim_physics": 0.19300576713350084, "survival_time": 1.800000000000001, "driven_lanedir": 0.1105641789865821, "sim_render-ego": 0.062014374468061656, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17956925100750393, "deviation-heading": 0.711522804791074, "set_robot_commands": 0.10417728953891332, "deviation-center-line": 0.05306794922646514, "driven_lanedir_consec": 0.1105641789865821, "sim_compute_sim_state": 0.03960512081782023, "sim_compute_performance-ego": 0.06972606976826985, "sim_compute_robot_state-ego": 0.07638699478573269, "sim_compute_robot_state-npc0": 0.07075058751636082, "sim_compute_robot_state-npc1": 0.07029742002487183, "sim_compute_robot_state-npc2": 0.07434869474834865, "sim_compute_robot_state-npc3": 0.06719831625620525}, "udem1-6-0": {"driven_any": 0.11270150939795494, "sim_physics": 0.19045411348342897, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06620947043494141, "sim_render-ego": 0.058862042427062986, "in-drivable-lane": 0, "agent_compute-ego": 0.15037866830825805, "deviation-heading": 0.574895069984359, "set_robot_commands": 0.08213498592376708, "deviation-center-line": 0.07065463836309144, "driven_lanedir_consec": 0.06620947043494141, "sim_compute_sim_state": 0.03247301578521729, "sim_compute_performance-ego": 0.06199867725372314, "sim_compute_robot_state-ego": 0.06565209627151489, "sim_compute_robot_state-npc0": 0.060965991020202635, "sim_compute_robot_state-npc1": 0.06060079336166382, "sim_compute_robot_state-npc2": 0.05721924304962158, "sim_compute_robot_state-npc3": 0.05729689598083496}, "udem1-7-0": {"driven_any": 0.1336149242666562, "sim_physics": 0.21235532561937967, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0899961456494276, "sim_render-ego": 0.05789129932721456, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16155225038528442, "deviation-heading": 0.60752994107739, "set_robot_commands": 0.09001559019088745, "deviation-center-line": 0.0882865571900123, "driven_lanedir_consec": 0.0899961456494276, "sim_compute_sim_state": 0.04108725984891256, "sim_compute_performance-ego": 0.06840490301450093, "sim_compute_robot_state-ego": 0.06754019856452942, "sim_compute_robot_state-npc0": 0.06690749526023865, "sim_compute_robot_state-npc1": 0.06699289878209432, "sim_compute_robot_state-npc2": 0.06943117578824361, "sim_compute_robot_state-npc3": 0.06530254085858662}, "udem1-8-0": {"driven_any": 0.20575347714638212, "sim_physics": 0.18548818677663803, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09245911790688988, "sim_render-ego": 0.05860523134469986, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15143319219350815, "deviation-heading": 0.6593124368300722, "set_robot_commands": 0.0878848284482956, "deviation-center-line": 0.033001617047254836, "driven_lanedir_consec": 0.09245911790688988, "sim_compute_sim_state": 0.03576713055372238, "sim_compute_performance-ego": 0.06470448523759842, "sim_compute_robot_state-ego": 0.06826051324605942, "sim_compute_robot_state-npc0": 0.06687108427286148, "sim_compute_robot_state-npc1": 0.06426393985748291, "sim_compute_robot_state-npc2": 0.06699295341968536, "sim_compute_robot_state-npc3": 0.07018020749092102}, "udem1-9-0": {"driven_any": 0.17686662190033278, "sim_physics": 0.2169735176222665, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04884938601700406, "sim_render-ego": 0.0617398875100272, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1668195469038827, "deviation-heading": 0.6923571091860621, "set_robot_commands": 0.09687695332935878, "deviation-center-line": 0.029898656059950363, "driven_lanedir_consec": 0.04884938601700406, "sim_compute_sim_state": 0.04075289624077933, "sim_compute_performance-ego": 0.06619696957724434, "sim_compute_robot_state-ego": 0.07085728645324707, "sim_compute_robot_state-npc0": 0.06189301184245518, "sim_compute_robot_state-npc1": 0.06631543806621007, "sim_compute_robot_state-npc2": 0.06424848522458758, "sim_compute_robot_state-npc3": 0.06439448254449028}, "udem1-10-0": {"driven_any": 0.15335033954569677, "sim_physics": 0.2030539313952128, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07491694695314322, "sim_render-ego": 0.057423253854115806, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17715569337209067, "deviation-heading": 0.7793216720398054, "set_robot_commands": 0.10232097903887433, "deviation-center-line": 0.04275711231950694, "driven_lanedir_consec": 0.07491694695314322, "sim_compute_sim_state": 0.033921251694361367, "sim_compute_performance-ego": 0.060446312030156456, "sim_compute_robot_state-ego": 0.07092122236887614, "sim_compute_robot_state-npc0": 0.06298848986625671, "sim_compute_robot_state-npc1": 0.061445653438568115, "sim_compute_robot_state-npc2": 0.06188386678695679, "sim_compute_robot_state-npc3": 0.05842725435892741}, "udem1-11-0": {"driven_any": 0.10719505692270384, "sim_physics": 0.21713595163254512, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0674366373970412, "sim_render-ego": 0.05815075692676362, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15999878020513625, "deviation-heading": 0.5780098992841516, "set_robot_commands": 0.09121677989051456, "deviation-center-line": 0.08622719415032296, "driven_lanedir_consec": 0.0674366373970412, "sim_compute_sim_state": 0.04015445709228515, "sim_compute_performance-ego": 0.06592631340026855, "sim_compute_robot_state-ego": 0.07653329485938662, "sim_compute_robot_state-npc0": 0.06967479842049736, "sim_compute_robot_state-npc1": 0.06270709491911389, "sim_compute_robot_state-npc2": 0.0628298010144915, "sim_compute_robot_state-npc3": 0.06476589611598424}, "udem1-12-0": {"driven_any": 0.20919584393940505, "sim_physics": 0.2149935469907873, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07322233861989269, "sim_render-ego": 0.06237471804899328, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16432654857635498, "deviation-heading": 0.6127680654042019, "set_robot_commands": 0.09123527302461512, "deviation-center-line": 0.05481453918108437, "driven_lanedir_consec": 0.07322233861989269, "sim_compute_sim_state": 0.037078331498538744, "sim_compute_performance-ego": 0.06237503360299503, "sim_compute_robot_state-ego": 0.066009521484375, "sim_compute_robot_state-npc0": 0.06444218579460592, "sim_compute_robot_state-npc1": 0.07045869266285616, "sim_compute_robot_state-npc2": 0.063881516456604, "sim_compute_robot_state-npc3": 0.06285198295817655}, "udem1-13-0": {"driven_any": 0.11094558254280916, "sim_physics": 0.1505636410279707, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05763463362986565, "sim_render-ego": 0.04346928813240745, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.118154915896329, "deviation-heading": 0.591563002444139, "set_robot_commands": 0.0661415620283647, "deviation-center-line": 0.0738916195200361, "driven_lanedir_consec": 0.05763463362986565, "sim_compute_sim_state": 0.025178356604142624, "sim_compute_performance-ego": 0.044275337999517266, "sim_compute_robot_state-ego": 0.04792765053835782, "sim_compute_robot_state-npc0": 0.04482061212713069, "sim_compute_robot_state-npc1": 0.04463608698411421, "sim_compute_robot_state-npc2": 0.04669378020546653, "sim_compute_robot_state-npc3": 0.04427168586037376}, "udem1-14-0": {"driven_any": 0.16413315507541087, "sim_physics": 0.1957005262374878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10721774951547491, "sim_render-ego": 0.058618820630587064, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18514677194448617, "deviation-heading": 0.6963830694799161, "set_robot_commands": 0.0939657504741962, "deviation-center-line": 0.07026411294073753, "driven_lanedir_consec": 0.10721774951547491, "sim_compute_sim_state": 0.03878279832693247, "sim_compute_performance-ego": 0.06641199038578914, "sim_compute_robot_state-ego": 0.0687640355183528, "sim_compute_robot_state-npc0": 0.06968150689051701, "sim_compute_robot_state-npc1": 0.06584469171670768, "sim_compute_robot_state-npc2": 0.06341825998746432, "sim_compute_robot_state-npc3": 0.06728531764103816}}
set_robot_commands_max0.10417728953891332
set_robot_commands_mean0.08862794100515665
set_robot_commands_median0.09121677989051456
set_robot_commands_min0.0661415620283647
sim_compute_performance-ego_max0.06972606976826985
sim_compute_performance-ego_mean0.06214662654178948
sim_compute_performance-ego_median0.06470448523759842
sim_compute_performance-ego_min0.044275337999517266
sim_compute_robot_state-ego_max0.07653329485938662
sim_compute_robot_state-ego_mean0.06645382132641849
sim_compute_robot_state-ego_median0.06826051324605942
sim_compute_robot_state-ego_min0.04792765053835782
sim_compute_robot_state-npc0_max0.07075058751636082
sim_compute_robot_state-npc0_mean0.0633154882039049
sim_compute_robot_state-npc0_median0.06501454512278239
sim_compute_robot_state-npc0_min0.04482061212713069
sim_compute_robot_state-npc1_max0.07045869266285616
sim_compute_robot_state-npc1_mean0.06311145424176552
sim_compute_robot_state-npc1_median0.06463762846860019
sim_compute_robot_state-npc1_min0.04463608698411421
sim_compute_robot_state-npc2_max0.07434869474834865
sim_compute_robot_state-npc2_mean0.06245773170208012
sim_compute_robot_state-npc2_median0.06341825998746432
sim_compute_robot_state-npc2_min0.04669378020546653
sim_compute_robot_state-npc3_max0.07018020749092102
sim_compute_robot_state-npc3_mean0.06177494823189696
sim_compute_robot_state-npc3_median0.06384660258437648
sim_compute_robot_state-npc3_min0.04427168586037376
sim_compute_sim_state_max0.04108725984891256
sim_compute_sim_state_mean0.03581687288944614
sim_compute_sim_state_median0.037078331498538744
sim_compute_sim_state_min0.025178356604142624
sim_physics_max0.21713595163254512
sim_physics_mean0.19696749703633615
sim_physics_median0.2030539313952128
sim_physics_min0.14299599329630533
sim_render-ego_max0.06438488310033624
sim_render-ego_mean0.05751730765337639
sim_render-ego_median0.058618820630587064
sim_render-ego_min0.04346928813240745
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.323333333333334
survival_time_min1.0000000000000002
229912412jp18813100494Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes11690:13:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229882417Andrea Censirandom_agentaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:45(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.14468092254445522
agent_compute-ego_mean0.1308318340220193
agent_compute-ego_median0.1295960302706118
agent_compute-ego_min0.12213953803567323
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1076204600157561, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05772285991244846, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1295960302706118, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09321753184000652, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037863987463491934, "sim_compute_performance-ego": 0.06376502690491853, "sim_compute_robot_state-ego": 0.07028130690256755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10682015325508866, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05676682790120443, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12731181873994715, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08656997306674134, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.035748107760560276, "sim_compute_performance-ego": 0.06023240556903914, "sim_compute_robot_state-ego": 0.06740412525102205}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10718690647798426, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.053937336977790386, "in-drivable-lane": 0, "agent_compute-ego": 0.12213953803567323, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08536829667932846, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03676623456618365, "sim_compute_performance-ego": 0.06134493210736443, "sim_compute_robot_state-ego": 0.07186105672050924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11015021324157714, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05966569900512695, "in-drivable-lane": 0, "agent_compute-ego": 0.1304308605194092, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08796448707580566, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03649927139282227, "sim_compute_performance-ego": 0.06304806709289551, "sim_compute_robot_state-ego": 0.06287601470947266}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10528943206690534, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06073552143724659, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14468092254445522, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09367075751099406, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03727357598799694, "sim_compute_performance-ego": 0.06319448917726928, "sim_compute_robot_state-ego": 0.0722095272209071}}
set_robot_commands_max0.09367075751099406
set_robot_commands_mean0.08935820923457521
set_robot_commands_median0.08796448707580566
set_robot_commands_min0.08536829667932846
sim_compute_performance-ego_max0.06376502690491853
sim_compute_performance-ego_mean0.06231698417029737
sim_compute_performance-ego_median0.06304806709289551
sim_compute_performance-ego_min0.06023240556903914
sim_compute_robot_state-ego_max0.0722095272209071
sim_compute_robot_state-ego_mean0.06892640616089571
sim_compute_robot_state-ego_median0.07028130690256755
sim_compute_robot_state-ego_min0.06287601470947266
sim_compute_sim_state_max0.037863987463491934
sim_compute_sim_state_mean0.03683023543421101
sim_compute_sim_state_median0.03676623456618365
sim_compute_sim_state_min0.035748107760560276
sim_physics_max0.11015021324157714
sim_physics_mean0.1074134330114623
sim_physics_median0.10718690647798426
sim_physics_min0.10528943206690534
sim_render-ego_max0.06073552143724659
sim_render-ego_mean0.05776564904676336
sim_render-ego_median0.05772285991244846
sim_render-ego_min0.053937336977790386
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
229692447enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11690:22:46(hidden)
driven_lanedir_consec_median-1.339366254383536
survival_time_median14.950000000000076
deviation-center-line_median1.4012763877174623
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.16230473359425862
agent_compute-ego_mean0.15666086371739704
agent_compute-ego_median0.1584425481160482
agent_compute-ego_min0.14875588655471805
deviation-center-line_max1.5195321274570266
deviation-center-line_mean1.174486624766163
deviation-center-line_min0.26894128230124625
deviation-heading_max8.502617994731201
deviation-heading_mean7.58692926837743
deviation-heading_median8.166880118443489
deviation-heading_min5.592005976497815
driven_any_max4.378506444052819
driven_any_mean4.37850644405281
driven_any_median4.37850644405281
driven_any_min4.378506444052802
driven_lanedir_consec_max-1.3108775667725403
driven_lanedir_consec_mean-1.3430087925060197
driven_lanedir_consec_min-1.375791811242363
driven_lanedir_max-1.339366254383536
driven_lanedir_mean-2.3543334685387003
driven_lanedir_median-2.5973993077066466
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.5700000000000194
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.10768850644429524, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.060281148751576745, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15947402318318685, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09014412641525268, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.037864320278167725, "sim_compute_performance-ego": 0.06637497266133627, "sim_compute_robot_state-ego": 0.07115665753682454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.11003500620524088, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.05879507621129354, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.1584425481160482, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.08890501578648885, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.03743621031443278, "sim_compute_performance-ego": 0.0655603035291036, "sim_compute_robot_state-ego": 0.07081924597422282}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.09606300354003906, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.06144879897435506, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.14875588655471805, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.08191430568695068, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.03447505394617716, "sim_compute_performance-ego": 0.05969450871149699, "sim_compute_robot_state-ego": 0.0660016663869222}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1097927474975586, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.0574702262878418, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.1543271271387736, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.08922839403152466, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.03897859255472819, "sim_compute_performance-ego": 0.06676249265670776, "sim_compute_robot_state-ego": 0.07030021508534749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.10564478079477946, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.05999253829320272, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.16230473359425862, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.09055798371632894, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.03919533252716065, "sim_compute_performance-ego": 0.06788738489151001, "sim_compute_robot_state-ego": 0.07092122157414754}}
set_robot_commands_max0.09055798371632894
set_robot_commands_mean0.08814996512730916
set_robot_commands_median0.08922839403152466
set_robot_commands_min0.08191430568695068
sim_compute_performance-ego_max0.06788738489151001
sim_compute_performance-ego_mean0.06525593249003094
sim_compute_performance-ego_median0.06637497266133627
sim_compute_performance-ego_min0.05969450871149699
sim_compute_robot_state-ego_max0.07115665753682454
sim_compute_robot_state-ego_mean0.06983980131149292
sim_compute_robot_state-ego_median0.07081924597422282
sim_compute_robot_state-ego_min0.0660016663869222
sim_compute_sim_state_max0.03919533252716065
sim_compute_sim_state_mean0.0375899019241333
sim_compute_sim_state_median0.037864320278167725
sim_compute_sim_state_min0.03447505394617716
sim_physics_max0.11003500620524088
sim_physics_mean0.10584480889638263
sim_physics_median0.10768850644429524
sim_physics_min0.09606300354003906
sim_render-ego_max0.06144879897435506
sim_render-ego_mean0.05959755770365397
sim_render-ego_median0.05999253829320272
sim_render-ego_min0.0574702262878418
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
229552472Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:10(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.14565808243221706
agent_compute-ego_mean0.13631657833298827
agent_compute-ego_median0.13562668800354005
agent_compute-ego_min0.12634257893813283
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.15821173014464202, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05563365088568793, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14565808243221706, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08642429334146005, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.036166513407671894, "sim_compute_performance-ego": 0.06291518387971101, "sim_compute_robot_state-ego": 0.06601080188044796, "sim_compute_robot_state-npc0": 0.06401440832349989, "sim_compute_robot_state-npc1": 0.06293187318024812, "sim_compute_robot_state-npc2": 0.06268769723397714, "sim_compute_robot_state-npc3": 0.061932259135776095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1606271457672119, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.054636049270629886, "in-drivable-lane": 0, "agent_compute-ego": 0.13562668800354005, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09244461059570312, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03521843910217285, "sim_compute_performance-ego": 0.05779995918273926, "sim_compute_robot_state-ego": 0.05590242385864258, "sim_compute_robot_state-npc0": 0.06620275497436523, "sim_compute_robot_state-npc1": 0.08011174201965332, "sim_compute_robot_state-npc2": 0.06284611701965331, "sim_compute_robot_state-npc3": 0.0591876220703125}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12700644292329488, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.04688173532485962, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.12634257893813283, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08046422506633558, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.029713737337212817, "sim_compute_performance-ego": 0.052965989238337466, "sim_compute_robot_state-ego": 0.055323748212111626, "sim_compute_robot_state-npc0": 0.05610183979335584, "sim_compute_robot_state-npc1": 0.05460271709843686, "sim_compute_robot_state-npc2": 0.05724144295642251, "sim_compute_robot_state-npc3": 0.0546414946254931}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18573508383352547, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05700436724892145, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13899476316910755, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08832041824920268, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03740670711179323, "sim_compute_performance-ego": 0.06295156177086166, "sim_compute_robot_state-ego": 0.066396752490273, "sim_compute_robot_state-npc0": 0.06496730031846445, "sim_compute_robot_state-npc1": 0.06433687934392615, "sim_compute_robot_state-npc2": 0.06893576247782647, "sim_compute_robot_state-npc3": 0.06463940535919575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1558683259146554, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05609491041728428, "in-drivable-lane": 0, "agent_compute-ego": 0.13496077912194387, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08738267421722412, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03717180660792759, "sim_compute_performance-ego": 0.06099998950958252, "sim_compute_robot_state-ego": 0.06271012340273176, "sim_compute_robot_state-npc0": 0.06099933385848999, "sim_compute_robot_state-npc1": 0.08293798140117101, "sim_compute_robot_state-npc2": 0.06154865026473999, "sim_compute_robot_state-npc3": 0.06306268487657819}}
set_robot_commands_max0.09244461059570312
set_robot_commands_mean0.08700724429398511
set_robot_commands_median0.08738267421722412
set_robot_commands_min0.08046422506633558
sim_compute_performance-ego_max0.06295156177086166
sim_compute_performance-ego_mean0.05952653671624638
sim_compute_performance-ego_median0.06099998950958252
sim_compute_performance-ego_min0.052965989238337466
sim_compute_robot_state-ego_max0.066396752490273
sim_compute_robot_state-ego_mean0.06126876996884138
sim_compute_robot_state-ego_median0.06271012340273176
sim_compute_robot_state-ego_min0.055323748212111626
sim_compute_robot_state-npc0_max0.06620275497436523
sim_compute_robot_state-npc0_mean0.062457127453635075
sim_compute_robot_state-npc0_median0.06401440832349989
sim_compute_robot_state-npc0_min0.05610183979335584
sim_compute_robot_state-npc1_max0.08293798140117101
sim_compute_robot_state-npc1_mean0.0689842386086871
sim_compute_robot_state-npc1_median0.06433687934392615
sim_compute_robot_state-npc1_min0.05460271709843686
sim_compute_robot_state-npc2_max0.06893576247782647
sim_compute_robot_state-npc2_mean0.06265193399052389
sim_compute_robot_state-npc2_median0.06268769723397714
sim_compute_robot_state-npc2_min0.05724144295642251
sim_compute_robot_state-npc3_max0.06463940535919575
sim_compute_robot_state-npc3_mean0.06069269321347113
sim_compute_robot_state-npc3_median0.061932259135776095
sim_compute_robot_state-npc3_min0.0546414946254931
sim_compute_sim_state_max0.03740670711179323
sim_compute_sim_state_mean0.035135440713355684
sim_compute_sim_state_median0.036166513407671894
sim_compute_sim_state_min0.029713737337212817
sim_physics_max0.18573508383352547
sim_physics_mean0.1574897457166659
sim_physics_median0.15821173014464202
sim_physics_min0.12700644292329488
sim_render-ego_max0.05700436724892145
sim_render-ego_mean0.054050142629476626
sim_render-ego_median0.05563365088568793
sim_render-ego_min0.04688173532485962
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
229502484Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryes11690:01:22
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229352503RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerroryes11690:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229202512RamiNaimchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229142528Liam Paullbaseline-IL-sim-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11690:03:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229002551Andrea Censichallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryes11690:11:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228942561AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:32(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07335840100827425
agent_compute-ego_mean0.06896229195626642
agent_compute-ego_median0.07018094261487325
agent_compute-ego_min0.06239583889643351
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11121665256124148, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.060719469903220594, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.068386198769153, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09335710632968956, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0394919623791332, "sim_compute_performance-ego": 0.06682284113386987, "sim_compute_robot_state-ego": 0.07330119777733171}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10624462763468424, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.0564763863881429, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06239583889643351, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.0862854798634847, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.037352542082468666, "sim_compute_performance-ego": 0.061874922116597494, "sim_compute_robot_state-ego": 0.06756792465845744}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.14028200236233798, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06270514835010875, "in-drivable-lane": 0, "agent_compute-ego": 0.0704900784925981, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09526532346552068, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03897812149741433, "sim_compute_performance-ego": 0.07625582001426003, "sim_compute_robot_state-ego": 0.0899157307364724}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.11159890393416089, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05581318338712057, "in-drivable-lane": 0, "agent_compute-ego": 0.07018094261487325, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0944691151380539, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03677787880102793, "sim_compute_performance-ego": 0.06092542906602224, "sim_compute_robot_state-ego": 0.06812359889348348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.10988779689954677, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.058256284050319504, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07335840100827425, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.0874632337818975, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0365890938302745, "sim_compute_performance-ego": 0.06198041853697404, "sim_compute_robot_state-ego": 0.06775163567584494}}
set_robot_commands_max0.09526532346552068
set_robot_commands_mean0.09136805171572927
set_robot_commands_median0.09335710632968956
set_robot_commands_min0.0862854798634847
sim_compute_performance-ego_max0.07625582001426003
sim_compute_performance-ego_mean0.06557188617354473
sim_compute_performance-ego_median0.06198041853697404
sim_compute_performance-ego_min0.06092542906602224
sim_compute_robot_state-ego_max0.0899157307364724
sim_compute_robot_state-ego_mean0.073332017548318
sim_compute_robot_state-ego_median0.06812359889348348
sim_compute_robot_state-ego_min0.06756792465845744
sim_compute_sim_state_max0.0394919623791332
sim_compute_sim_state_mean0.03783791971806373
sim_compute_sim_state_median0.037352542082468666
sim_compute_sim_state_min0.0365890938302745
sim_physics_max0.14028200236233798
sim_physics_mean0.11584599667839428
sim_physics_median0.11121665256124148
sim_physics_min0.10624462763468424
sim_render-ego_max0.06270514835010875
sim_render-ego_mean0.05879409441578246
sim_render-ego_median0.058256284050319504
sim_render-ego_min0.05581318338712057
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
228642612Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:24:33(hidden)
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.1182025764502731
agent_compute-ego_mean0.07218527742849506
agent_compute-ego_median0.06858522464067508
agent_compute-ego_min0.055423399981330425
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.17883500133652286, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0584233381662024, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.06463591449231987, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.08577713334416769, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.037531683243900896, "sim_compute_performance-ego": 0.06391948389719768, "sim_compute_robot_state-ego": 0.07123779676046717, "sim_compute_robot_state-npc0": 0.06489387764988175, "sim_compute_robot_state-npc1": 0.06331586550517254, "sim_compute_robot_state-npc2": 0.06257144514336643, "sim_compute_robot_state-npc3": 0.06279304515884583}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23798551382841887, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06869525379604763, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07832737322206851, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.1071468989054362, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04101046809443721, "sim_compute_performance-ego": 0.07112035044917354, "sim_compute_robot_state-ego": 0.07480189535352919, "sim_compute_robot_state-npc0": 0.07268694595054344, "sim_compute_robot_state-npc1": 0.07303886943393284, "sim_compute_robot_state-npc2": 0.07496632470024957, "sim_compute_robot_state-npc3": 0.07361095039932816}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.1974443105550913, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06241538891425499, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.06858522464067508, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.08893310718047313, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.037116472537700944, "sim_compute_performance-ego": 0.06509231604062594, "sim_compute_robot_state-ego": 0.07130264318906344, "sim_compute_robot_state-npc0": 0.06616582931616367, "sim_compute_robot_state-npc1": 0.06552791901123829, "sim_compute_robot_state-npc2": 0.06631394227345784, "sim_compute_robot_state-npc3": 0.065575394874964}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.20377247375354432, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06002271802801835, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.06670985723796644, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.08838319778442383, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.036127918644955286, "sim_compute_performance-ego": 0.06419750263816432, "sim_compute_robot_state-ego": 0.06676478971514785, "sim_compute_robot_state-npc0": 0.06667746159068325, "sim_compute_robot_state-npc1": 0.06615903503016422, "sim_compute_robot_state-npc2": 0.06477302417420504, "sim_compute_robot_state-npc3": 0.06414328541672021}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.1984773718792459, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.05932931278062904, "in-drivable-lane": 0, "agent_compute-ego": 0.07181513827780019, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09556900936624278, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.0350753639055335, "sim_compute_performance-ego": 0.06727783576301906, "sim_compute_robot_state-ego": 0.07390937597855278, "sim_compute_robot_state-npc0": 0.06843996047973633, "sim_compute_robot_state-npc1": 0.06818456235139267, "sim_compute_robot_state-npc2": 0.18459471412326975, "sim_compute_robot_state-npc3": 0.06369316059610118}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.16499077806285783, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.05248020677005544, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.1182025764502731, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.08117310439839083, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.033624880454119516, "sim_compute_performance-ego": 0.05637503839006611, "sim_compute_robot_state-ego": 0.060294730990540744, "sim_compute_robot_state-npc0": 0.060158736565533805, "sim_compute_robot_state-npc1": 0.05897352742213829, "sim_compute_robot_state-npc2": 0.05925734837849935, "sim_compute_robot_state-npc3": 0.060294177017959895}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.16780497006007605, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.05462495258876256, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.06246045657566616, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.0823299561228071, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03312497309276036, "sim_compute_performance-ego": 0.0610404542514256, "sim_compute_robot_state-ego": 0.06297503198896136, "sim_compute_robot_state-npc0": 0.059922095707484656, "sim_compute_robot_state-npc1": 0.06074068716594151, "sim_compute_robot_state-npc2": 0.05891319683619907, "sim_compute_robot_state-npc3": 0.05983597721372332}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20091888675950975, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.05903211358475358, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06831390890356613, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.09137611519800472, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.036463574187396326, "sim_compute_performance-ego": 0.06679608070687072, "sim_compute_robot_state-ego": 0.07907395166893529, "sim_compute_robot_state-npc0": 0.07055724810247552, "sim_compute_robot_state-npc1": 0.06620511943346834, "sim_compute_robot_state-npc2": 0.06762623460325476, "sim_compute_robot_state-npc3": 0.06700992910829309}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.19624717291011368, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06219665948734727, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.0715740530989891, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.0979364555935527, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.039325689160546594, "sim_compute_performance-ego": 0.06728293452151986, "sim_compute_robot_state-ego": 0.07608327754708223, "sim_compute_robot_state-npc0": 0.07211226917976557, "sim_compute_robot_state-npc1": 0.07026178060575973, "sim_compute_robot_state-npc2": 0.06738817414572072, "sim_compute_robot_state-npc3": 0.06714277489240779}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.21634794198549712, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06582980889540452, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07020743993612436, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09335700365213248, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.03265473475823036, "sim_compute_performance-ego": 0.06209869568164532, "sim_compute_robot_state-ego": 0.06267233078296368, "sim_compute_robot_state-npc0": 0.06574597725501427, "sim_compute_robot_state-npc1": 0.06554730121905987, "sim_compute_robot_state-npc2": 0.06354972032400277, "sim_compute_robot_state-npc3": 0.06097202117626484}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.17440004666646322, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.05832966486612956, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06714889526367188, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09157020568847656, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.037905941009521486, "sim_compute_performance-ego": 0.06643189748128255, "sim_compute_robot_state-ego": 0.06670793533325195, "sim_compute_robot_state-npc0": 0.06693431536356607, "sim_compute_robot_state-npc1": 0.06619016647338867, "sim_compute_robot_state-npc2": 0.06830972989400227, "sim_compute_robot_state-npc3": 0.06821299235026042}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.16676324889773414, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.05391951969691685, "in-drivable-lane": 0, "agent_compute-ego": 0.06054502441769555, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.08312990551903135, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.031479869570050924, "sim_compute_performance-ego": 0.05435985610598609, "sim_compute_robot_state-ego": 0.05537143207731701, "sim_compute_robot_state-npc0": 0.05798929078238351, "sim_compute_robot_state-npc1": 0.056662616275605704, "sim_compute_robot_state-npc2": 0.0566919417608352, "sim_compute_robot_state-npc3": 0.058520566849481495}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.19464606462522996, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.05476085529770962, "in-drivable-lane": 1.15, "agent_compute-ego": 0.08149958211322163, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.08734471298927485, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.031736872916997866, "sim_compute_performance-ego": 0.05632791408272677, "sim_compute_robot_state-ego": 0.0803770242735397, "sim_compute_robot_state-npc0": 0.06277882775595021, "sim_compute_robot_state-npc1": 0.07397959398668866, "sim_compute_robot_state-npc2": 0.06278911856717842, "sim_compute_robot_state-npc3": 0.05542041534601256}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.1639129945210048, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.04902153355734689, "in-drivable-lane": 0, "agent_compute-ego": 0.07733031681605748, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.07930760724203927, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04580478157315936, "sim_compute_performance-ego": 0.05222690956933158, "sim_compute_robot_state-ego": 0.05570435523986816, "sim_compute_robot_state-npc0": 0.053854167461395264, "sim_compute_robot_state-npc1": 0.05543012278420584, "sim_compute_robot_state-npc2": 0.0686456561088562, "sim_compute_robot_state-npc3": 0.08756314856665474}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.1665807705299527, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.047918268278533335, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.055423399981330425, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0752409112219717, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.029193798700968426, "sim_compute_performance-ego": 0.05081833577623554, "sim_compute_robot_state-ego": 0.053795333002127854, "sim_compute_robot_state-npc0": 0.05575078608942967, "sim_compute_robot_state-npc1": 0.05264792722814223, "sim_compute_robot_state-npc2": 0.05182823012856876, "sim_compute_robot_state-npc3": 0.05162605117349064}}
set_robot_commands_max0.1071468989054362
set_robot_commands_mean0.08857168828042836
set_robot_commands_median0.08838319778442383
set_robot_commands_min0.0752409112219717
sim_compute_performance-ego_max0.07112035044917354
sim_compute_performance-ego_mean0.06169104035701805
sim_compute_performance-ego_median0.06391948389719768
sim_compute_performance-ego_min0.05081833577623554
sim_compute_robot_state-ego_max0.0803770242735397
sim_compute_robot_state-ego_mean0.06740479359342322
sim_compute_robot_state-ego_median0.06676478971514785
sim_compute_robot_state-ego_min0.053795333002127854
sim_compute_robot_state-npc0_max0.07268694595054344
sim_compute_robot_state-npc0_mean0.06431118595000046
sim_compute_robot_state-npc0_median0.06574597725501427
sim_compute_robot_state-npc0_min0.053854167461395264
sim_compute_robot_state-npc1_max0.07397959398668866
sim_compute_robot_state-npc1_mean0.0641910062617533
sim_compute_robot_state-npc1_median0.06554730121905987
sim_compute_robot_state-npc1_min0.05264792722814223
sim_compute_robot_state-npc2_max0.18459471412326975
sim_compute_robot_state-npc2_mean0.07188125341077775
sim_compute_robot_state-npc2_median0.06477302417420504
sim_compute_robot_state-npc2_min0.05182823012856876
sim_compute_robot_state-npc3_max0.08756314856665474
sim_compute_robot_state-npc3_mean0.06442759267603389
sim_compute_robot_state-npc3_median0.06369316059610118
sim_compute_robot_state-npc3_min0.05162605117349064
sim_compute_sim_state_max0.04580478157315936
sim_compute_sim_state_mean0.03587846812335193
sim_compute_sim_state_median0.036127918644955286
sim_compute_sim_state_min0.029193798700968426
sim_physics_max0.23798551382841887
sim_physics_mean0.1886085030914175
sim_physics_median0.19464606462522996
sim_physics_min0.1639129945210048
sim_render-ego_max0.06869525379604763
sim_render-ego_mean0.0577999729805408
sim_render-ego_median0.0584233381662024
sim_render-ego_min0.047918268278533335
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
228592621Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:14(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1534561061859131
agent_compute-ego_mean0.1414709274175197
agent_compute-ego_median0.14478258396449842
agent_compute-ego_min0.11568454333714076
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16723294169814498, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06265779336293538, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14904036786821154, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09616708755493164, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.039799902174207896, "sim_compute_performance-ego": 0.06770446123900237, "sim_compute_robot_state-ego": 0.07606213181107133, "sim_compute_robot_state-npc0": 0.06834197044372559, "sim_compute_robot_state-npc1": 0.06981298217067013, "sim_compute_robot_state-npc2": 0.06802170806460911, "sim_compute_robot_state-npc3": 0.06818524554923729}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1938871192932129, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06411319732666015, "in-drivable-lane": 0, "agent_compute-ego": 0.1534561061859131, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0921469497680664, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0388402271270752, "sim_compute_performance-ego": 0.06790167808532716, "sim_compute_robot_state-ego": 0.07621310234069824, "sim_compute_robot_state-npc0": 0.06792044639587402, "sim_compute_robot_state-npc1": 0.06836292266845703, "sim_compute_robot_state-npc2": 0.06869984626770019, "sim_compute_robot_state-npc3": 0.06871854782104492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17380189895629883, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05855465562720048, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14478258396449842, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08797462676700793, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03692041572771574, "sim_compute_performance-ego": 0.06629693194439537, "sim_compute_robot_state-ego": 0.06878463531795301, "sim_compute_robot_state-npc0": 0.06442823221808985, "sim_compute_robot_state-npc1": 0.06438963350496794, "sim_compute_robot_state-npc2": 0.06297585525010761, "sim_compute_robot_state-npc3": 0.0636587425282127}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17755194253559353, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05686872518515285, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1443910357318347, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09232374988024748, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03674666791022578, "sim_compute_performance-ego": 0.06376471096956277, "sim_compute_robot_state-ego": 0.06789554523516304, "sim_compute_robot_state-npc0": 0.06666616548465777, "sim_compute_robot_state-npc1": 0.06476785563215424, "sim_compute_robot_state-npc2": 0.0658590944507454, "sim_compute_robot_state-npc3": 0.06617600404763524}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12418924910681588, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04441388164247785, "in-drivable-lane": 0, "agent_compute-ego": 0.11568454333714076, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07291548592703682, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02986724036080497, "sim_compute_performance-ego": 0.049084254673549106, "sim_compute_robot_state-ego": 0.09195435898644584, "sim_compute_robot_state-npc0": 0.050221996647971015, "sim_compute_robot_state-npc1": 0.05239453486033848, "sim_compute_robot_state-npc2": 0.05204435757228306, "sim_compute_robot_state-npc3": 0.05192406688417707}}
set_robot_commands_max0.09616708755493164
set_robot_commands_mean0.08830557997945807
set_robot_commands_median0.0921469497680664
set_robot_commands_min0.07291548592703682
sim_compute_performance-ego_max0.06790167808532716
sim_compute_performance-ego_mean0.06295040738236736
sim_compute_performance-ego_median0.06629693194439537
sim_compute_performance-ego_min0.049084254673549106
sim_compute_robot_state-ego_max0.09195435898644584
sim_compute_robot_state-ego_mean0.07618195473826629
sim_compute_robot_state-ego_median0.07606213181107133
sim_compute_robot_state-ego_min0.06789554523516304
sim_compute_robot_state-npc0_max0.06834197044372559
sim_compute_robot_state-npc0_mean0.06351576223806364
sim_compute_robot_state-npc0_median0.06666616548465777
sim_compute_robot_state-npc0_min0.050221996647971015
sim_compute_robot_state-npc1_max0.06981298217067013
sim_compute_robot_state-npc1_mean0.06394558576731757
sim_compute_robot_state-npc1_median0.06476785563215424
sim_compute_robot_state-npc1_min0.05239453486033848
sim_compute_robot_state-npc2_max0.06869984626770019
sim_compute_robot_state-npc2_mean0.06352017232108907
sim_compute_robot_state-npc2_median0.0658590944507454
sim_compute_robot_state-npc2_min0.05204435757228306
sim_compute_robot_state-npc3_max0.06871854782104492
sim_compute_robot_state-npc3_mean0.06373252136606143
sim_compute_robot_state-npc3_median0.06617600404763524
sim_compute_robot_state-npc3_min0.05192406688417707
sim_compute_sim_state_max0.039799902174207896
sim_compute_sim_state_mean0.03643489066000592
sim_compute_sim_state_median0.03692041572771574
sim_compute_sim_state_min0.02986724036080497
sim_physics_max0.1938871192932129
sim_physics_mean0.1673326303180132
sim_physics_median0.17380189895629883
sim_physics_min0.12418924910681588
sim_render-ego_max0.06411319732666015
sim_render-ego_mean0.057321650628885334
sim_render-ego_median0.05855465562720048
sim_render-ego_min0.04441388164247785
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
228462633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:14(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.17755488838468278
agent_compute-ego_mean0.15240288644407302
agent_compute-ego_median0.14812106132507324
agent_compute-ego_min0.1389357198642779
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1474917906301993, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05718990166982015, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14799557350299977, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08671904934777154, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037823504871792264, "sim_compute_performance-ego": 0.06051652078275328, "sim_compute_robot_state-ego": 0.06581000487009685, "sim_compute_robot_state-npc0": 0.06700247746926767, "sim_compute_robot_state-npc1": 0.06862560466483787, "sim_compute_robot_state-npc2": 0.06452735265096028, "sim_compute_robot_state-npc3": 0.06447519637920239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1798582363128662, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0553582763671875, "in-drivable-lane": 0, "agent_compute-ego": 0.14812106132507324, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09095892906188964, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041527013778686526, "sim_compute_performance-ego": 0.05951970100402832, "sim_compute_robot_state-ego": 0.06276653289794921, "sim_compute_robot_state-npc0": 0.06634442329406738, "sim_compute_robot_state-npc1": 0.0697330379486084, "sim_compute_robot_state-npc2": 0.07164067268371582, "sim_compute_robot_state-npc3": 0.06951704025268554}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1732350368248789, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.061908085095255, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14940718914333145, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08969562618356001, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0374992991748609, "sim_compute_performance-ego": 0.07082227970424451, "sim_compute_robot_state-ego": 0.07192142699894152, "sim_compute_robot_state-npc0": 0.0634148120880127, "sim_compute_robot_state-npc1": 0.0668225696212367, "sim_compute_robot_state-npc2": 0.06538675019615575, "sim_compute_robot_state-npc3": 0.06416409894039757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17432209208041807, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05549545227726803, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1389357198642779, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0860226848457433, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0353407980520514, "sim_compute_performance-ego": 0.06215010111844992, "sim_compute_robot_state-ego": 0.06773116316976427, "sim_compute_robot_state-npc0": 0.06430658811255346, "sim_compute_robot_state-npc1": 0.06344874901107594, "sim_compute_robot_state-npc2": 0.063851552673533, "sim_compute_robot_state-npc3": 0.06429938726787325}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1675068395478385, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05958873885018485, "in-drivable-lane": 0, "agent_compute-ego": 0.17755488838468278, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0904221705027989, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.039251361574445455, "sim_compute_performance-ego": 0.06594703027180263, "sim_compute_robot_state-ego": 0.07235567910330636, "sim_compute_robot_state-npc0": 0.06686457565852574, "sim_compute_robot_state-npc1": 0.06242257356643677, "sim_compute_robot_state-npc2": 0.06847038439341954, "sim_compute_robot_state-npc3": 0.07189409221921648}}
set_robot_commands_max0.09095892906188964
set_robot_commands_mean0.08876369198835268
set_robot_commands_median0.08969562618356001
set_robot_commands_min0.0860226848457433
sim_compute_performance-ego_max0.07082227970424451
sim_compute_performance-ego_mean0.06379112657625574
sim_compute_performance-ego_median0.06215010111844992
sim_compute_performance-ego_min0.05951970100402832
sim_compute_robot_state-ego_max0.07235567910330636
sim_compute_robot_state-ego_mean0.06811696140801164
sim_compute_robot_state-ego_median0.06773116316976427
sim_compute_robot_state-ego_min0.06276653289794921
sim_compute_robot_state-npc0_max0.06700247746926767
sim_compute_robot_state-npc0_mean0.06558657532448539
sim_compute_robot_state-npc0_median0.06634442329406738
sim_compute_robot_state-npc0_min0.0634148120880127
sim_compute_robot_state-npc1_max0.0697330379486084
sim_compute_robot_state-npc1_mean0.06621050696243913
sim_compute_robot_state-npc1_median0.0668225696212367
sim_compute_robot_state-npc1_min0.06242257356643677
sim_compute_robot_state-npc2_max0.07164067268371582
sim_compute_robot_state-npc2_mean0.06677534251955689
sim_compute_robot_state-npc2_median0.06538675019615575
sim_compute_robot_state-npc2_min0.063851552673533
sim_compute_robot_state-npc3_max0.07189409221921648
sim_compute_robot_state-npc3_mean0.06686996301187505
sim_compute_robot_state-npc3_median0.06447519637920239
sim_compute_robot_state-npc3_min0.06416409894039757
sim_compute_sim_state_max0.041527013778686526
sim_compute_sim_state_mean0.038288395490367305
sim_compute_sim_state_median0.037823504871792264
sim_compute_sim_state_min0.0353407980520514
sim_physics_max0.1798582363128662
sim_physics_mean0.1684827990792402
sim_physics_median0.1732350368248789
sim_physics_min0.1474917906301993
sim_render-ego_max0.061908085095255
sim_render-ego_mean0.05790809085194311
sim_render-ego_median0.05718990166982015
sim_render-ego_min0.0553582763671875
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
228402656zamatorychallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:15:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228382664RamiNaimModidfied configaido2-LF-sim-testingstep1-simulationerroryes11690:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228362668RamiNaimModidfied configaido2-LFV-sim-testingstep1-simulationerroryes11690:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228342669RamiNaimModidfied configaido2-LFV-sim-validationstep1-simulationerroryes11690:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228332672RamiNaimModidfied configaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228322673RamiNaimModidfied configaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228142708RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessyes11690:31:13(hidden)
driven_lanedir_consec_median0.9602362195441052
survival_time_median14.950000000000076
deviation-center-line_median1.021174797456825
in-drivable-lane_median2.000000000000014


other stats
agent_compute-ego_max0.0938571432362432
agent_compute-ego_mean0.09003650160916912
agent_compute-ego_median0.09168352444966632
agent_compute-ego_min0.08523769060770671
deviation-center-line_max1.1865681824346217
deviation-center-line_mean0.8422476215084849
deviation-center-line_min0.22683483670237156
deviation-heading_max7.407076536464438
deviation-heading_mean5.131962918230649
deviation-heading_median6.918808897111082
deviation-heading_min1.7999697601183915
driven_any_max2.3486040874619123
driven_any_mean1.8037203711095755
driven_any_median2.34853514961698
driven_any_min0.870297727821699
driven_lanedir_consec_max1.1675097080656451
driven_lanedir_consec_mean0.8914021715212262
driven_lanedir_consec_min0.4567130552402529
driven_lanedir_max1.6272722403920228
driven_lanedir_mean1.2062607784220605
driven_lanedir_median1.3949694402438109
driven_lanedir_min0.4567130552402529
in-drivable-lane_max2.9000000000000163
in-drivable-lane_mean1.790000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.102609716283609, "sim_physics": 0.19969594478607175, "survival_time": 7.299999999999982, "driven_lanedir": 0.9926581727749428, "sim_render-ego": 0.06827630245522277, "in-drivable-lane": 0, "agent_compute-ego": 0.08733000983930614, "deviation-heading": 2.356275461590165, "set_robot_commands": 0.1067028911146399, "deviation-center-line": 0.6919579175542566, "driven_lanedir_consec": 0.9926581727749428, "sim_compute_sim_state": 0.04228615760803223, "sim_compute_performance-ego": 0.07619614143894143, "sim_compute_robot_state-ego": 0.0840391165589633, "sim_compute_robot_state-npc0": 0.07720329826825285, "sim_compute_robot_state-npc1": 0.07738273437709024, "sim_compute_robot_state-npc2": 0.07755920495072456, "sim_compute_robot_state-npc3": 0.07746556033826854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486040874619123, "sim_physics": 0.18007017135620118, "survival_time": 14.950000000000076, "driven_lanedir": 1.6272722403920228, "sim_render-ego": 0.06299665768941244, "in-drivable-lane": 2.000000000000014, "agent_compute-ego": 0.08523769060770671, "deviation-heading": 6.918808897111082, "set_robot_commands": 0.1002035148938497, "deviation-center-line": 1.021174797456825, "driven_lanedir_consec": 1.1675097080656451, "sim_compute_sim_state": 0.039476267496744794, "sim_compute_performance-ego": 0.07073665301005046, "sim_compute_robot_state-ego": 0.07598819335301717, "sim_compute_robot_state-npc0": 0.07347880125045776, "sim_compute_robot_state-npc1": 0.06996205965677897, "sim_compute_robot_state-npc2": 0.0703823455174764, "sim_compute_robot_state-npc3": 0.0801578942934672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34853514961698, "sim_physics": 0.21263033787409463, "survival_time": 14.950000000000076, "driven_lanedir": 1.559690983459272, "sim_render-ego": 0.0698622989654541, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09207413991292318, "deviation-heading": 7.177683935869171, "set_robot_commands": 0.116681067943573, "deviation-center-line": 1.1865681824346217, "driven_lanedir_consec": 0.9602362195441052, "sim_compute_sim_state": 0.04474099079767863, "sim_compute_performance-ego": 0.07698423067728678, "sim_compute_robot_state-ego": 0.08749618291854859, "sim_compute_robot_state-npc0": 0.07919610897699991, "sim_compute_robot_state-npc1": 0.08090429147084555, "sim_compute_robot_state-npc2": 0.07916534662246705, "sim_compute_robot_state-npc3": 0.08194517612457275}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485551743636783, "sim_physics": 0.215033225218455, "survival_time": 14.950000000000076, "driven_lanedir": 1.3949694402438109, "sim_render-ego": 0.06965188423792522, "in-drivable-lane": 2.9000000000000163, "agent_compute-ego": 0.09168352444966632, "deviation-heading": 7.407076536464438, "set_robot_commands": 0.110607004960378, "deviation-center-line": 1.0847023733943495, "driven_lanedir_consec": 0.8798937019811857, "sim_compute_sim_state": 0.04389683961868286, "sim_compute_performance-ego": 0.0781196101506551, "sim_compute_robot_state-ego": 0.08688937584559123, "sim_compute_robot_state-npc0": 0.07749598105748494, "sim_compute_robot_state-npc1": 0.07634430329004924, "sim_compute_robot_state-npc2": 0.07618060191472371, "sim_compute_robot_state-npc3": 0.07653478066126505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.870297727821699, "sim_physics": 0.2109789869059687, "survival_time": 5.749999999999988, "driven_lanedir": 0.4567130552402529, "sim_render-ego": 0.07200115452642027, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0938571432362432, "deviation-heading": 1.7999697601183915, "set_robot_commands": 0.11676840574845024, "deviation-center-line": 0.22683483670237156, "driven_lanedir_consec": 0.4567130552402529, "sim_compute_sim_state": 0.045192871923032014, "sim_compute_performance-ego": 0.07922624090443486, "sim_compute_robot_state-ego": 0.08332344967385998, "sim_compute_robot_state-npc0": 0.07942629067794137, "sim_compute_robot_state-npc1": 0.0771606673365054, "sim_compute_robot_state-npc2": 0.07840663661127505, "sim_compute_robot_state-npc3": 0.0770810894344164}}
set_robot_commands_max0.11676840574845024
set_robot_commands_mean0.11019257693217815
set_robot_commands_median0.110607004960378
set_robot_commands_min0.1002035148938497
sim_compute_performance-ego_max0.07922624090443486
sim_compute_performance-ego_mean0.07625257523627373
sim_compute_performance-ego_median0.07698423067728678
sim_compute_performance-ego_min0.07073665301005046
sim_compute_robot_state-ego_max0.08749618291854859
sim_compute_robot_state-ego_mean0.08354726366999606
sim_compute_robot_state-ego_median0.0840391165589633
sim_compute_robot_state-ego_min0.07598819335301717
sim_compute_robot_state-npc0_max0.07942629067794137
sim_compute_robot_state-npc0_mean0.07736009604622737
sim_compute_robot_state-npc0_median0.07749598105748494
sim_compute_robot_state-npc0_min0.07347880125045776
sim_compute_robot_state-npc1_max0.08090429147084555
sim_compute_robot_state-npc1_mean0.07635081122625388
sim_compute_robot_state-npc1_median0.0771606673365054
sim_compute_robot_state-npc1_min0.06996205965677897
sim_compute_robot_state-npc2_max0.07916534662246705
sim_compute_robot_state-npc2_mean0.07633882712333336
sim_compute_robot_state-npc2_median0.07755920495072456
sim_compute_robot_state-npc2_min0.0703823455174764
sim_compute_robot_state-npc3_max0.08194517612457275
sim_compute_robot_state-npc3_mean0.07863690017039798
sim_compute_robot_state-npc3_median0.07746556033826854
sim_compute_robot_state-npc3_min0.07653478066126505
sim_compute_sim_state_max0.045192871923032014
sim_compute_sim_state_mean0.043118625488834106
sim_compute_sim_state_median0.04389683961868286
sim_compute_sim_state_min0.039476267496744794
sim_physics_max0.215033225218455
sim_physics_mean0.20368173322815825
sim_physics_median0.2109789869059687
sim_physics_min0.18007017135620118
sim_render-ego_max0.07200115452642027
sim_render-ego_mean0.06855765957488695
sim_render-ego_median0.06965188423792522
sim_render-ego_min0.06299665768941244
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.58000000000004
survival_time_min5.749999999999988
228042727jp18813100494test for ppoaido2-LFV-sim-testingstep1-simulationerroryes11690:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
227972742RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailedyes11690:01:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227832770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:07:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227792778RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerroryes11690:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227692792RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationfailedyes11690:01:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227632809Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:38(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1559074350765773
agent_compute-ego_mean0.1499730514809082
agent_compute-ego_median0.1486142309088456
agent_compute-ego_min0.14205538749694824
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14510134414390283, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05809372442739981, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14748904440138075, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09429979765856708, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03778462498276322, "sim_compute_performance-ego": 0.061406736020688656, "sim_compute_robot_state-ego": 0.06499405701955159, "sim_compute_robot_state-npc0": 0.07010740704006618, "sim_compute_robot_state-npc1": 0.06767352863594338, "sim_compute_robot_state-npc2": 0.06557511841809308, "sim_compute_robot_state-npc3": 0.06733031184585006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.16853354454040528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.059233083724975585, "in-drivable-lane": 0, "agent_compute-ego": 0.14205538749694824, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08395487785339356, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03897865295410157, "sim_compute_performance-ego": 0.06436549186706543, "sim_compute_robot_state-ego": 0.07243961334228516, "sim_compute_robot_state-npc0": 0.06808126449584961, "sim_compute_robot_state-npc1": 0.06930939674377441, "sim_compute_robot_state-npc2": 0.06777627944946289, "sim_compute_robot_state-npc3": 0.07024139404296875}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17166478696622348, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06126999541332847, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1486142309088456, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09309128083680804, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03787882077066522, "sim_compute_performance-ego": 0.06754340309845774, "sim_compute_robot_state-ego": 0.07014299066443193, "sim_compute_robot_state-npc0": 0.06648039817810059, "sim_compute_robot_state-npc1": 0.06371013428035535, "sim_compute_robot_state-npc2": 0.06884633239946868, "sim_compute_robot_state-npc3": 0.06831363941493787}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18433020990106125, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06066191950930825, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15579915952078904, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09552024587800231, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03861528408678272, "sim_compute_performance-ego": 0.06733104247081129, "sim_compute_robot_state-ego": 0.07582670223863819, "sim_compute_robot_state-npc0": 0.07070825069765502, "sim_compute_robot_state-npc1": 0.06713490848299823, "sim_compute_robot_state-npc2": 0.06675769105742249, "sim_compute_robot_state-npc3": 0.0690347242958938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.14658770390919276, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05775103398731777, "in-drivable-lane": 0, "agent_compute-ego": 0.1559074350765773, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08932435512542725, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.035695944513593404, "sim_compute_performance-ego": 0.06526746068681989, "sim_compute_robot_state-ego": 0.07160726615360805, "sim_compute_robot_state-npc0": 0.07116939340318952, "sim_compute_robot_state-npc1": 0.06779411009379796, "sim_compute_robot_state-npc2": 0.06299062286104475, "sim_compute_robot_state-npc3": 0.06655628340584892}}
set_robot_commands_max0.09552024587800231
set_robot_commands_mean0.09123811147043966
set_robot_commands_median0.09309128083680804
set_robot_commands_min0.08395487785339356
sim_compute_performance-ego_max0.06754340309845774
sim_compute_performance-ego_mean0.0651828268287686
sim_compute_performance-ego_median0.06526746068681989
sim_compute_performance-ego_min0.061406736020688656
sim_compute_robot_state-ego_max0.07582670223863819
sim_compute_robot_state-ego_mean0.07100212588370299
sim_compute_robot_state-ego_median0.07160726615360805
sim_compute_robot_state-ego_min0.06499405701955159
sim_compute_robot_state-npc0_max0.07116939340318952
sim_compute_robot_state-npc0_mean0.06930934276297218
sim_compute_robot_state-npc0_median0.07010740704006618
sim_compute_robot_state-npc0_min0.06648039817810059
sim_compute_robot_state-npc1_max0.06930939674377441
sim_compute_robot_state-npc1_mean0.06712441564737386
sim_compute_robot_state-npc1_median0.06767352863594338
sim_compute_robot_state-npc1_min0.06371013428035535
sim_compute_robot_state-npc2_max0.06884633239946868
sim_compute_robot_state-npc2_mean0.06638920883709838
sim_compute_robot_state-npc2_median0.06675769105742249
sim_compute_robot_state-npc2_min0.06299062286104475
sim_compute_robot_state-npc3_max0.07024139404296875
sim_compute_robot_state-npc3_mean0.06829527060109988
sim_compute_robot_state-npc3_median0.06831363941493787
sim_compute_robot_state-npc3_min0.06655628340584892
sim_compute_sim_state_max0.03897865295410157
sim_compute_sim_state_mean0.037790665461581226
sim_compute_sim_state_median0.03787882077066522
sim_compute_sim_state_min0.035695944513593404
sim_physics_max0.18433020990106125
sim_physics_mean0.1632435178921571
sim_physics_median0.16853354454040528
sim_physics_min0.14510134414390283
sim_render-ego_max0.06126999541332847
sim_render-ego_mean0.05940195141246598
sim_render-ego_median0.059233083724975585
sim_render-ego_min0.05775103398731777
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
227602819Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:27(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15226617513918408
agent_compute-ego_mean0.14444131860046333
agent_compute-ego_median0.14464850425720216
agent_compute-ego_min0.13723482805139878
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10430833145424172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05900004616490117, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1487106791249028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09096628648263436, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971023912783022, "sim_compute_performance-ego": 0.06606966919369167, "sim_compute_robot_state-ego": 0.07431791888342963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10403157215492398, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060144840502271465, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15226617513918408, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08579170002656825, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03728515494103525, "sim_compute_performance-ego": 0.06455132540534525, "sim_compute_robot_state-ego": 0.06786246860728544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10839073798235724, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05524265064912684, "in-drivable-lane": 0, "agent_compute-ego": 0.13723482805139878, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0963271084953757, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0372778247384464, "sim_compute_performance-ego": 0.05286411678089815, "sim_compute_robot_state-ego": 0.06323925186606015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11692477226257324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.055064363479614256, "in-drivable-lane": 0, "agent_compute-ego": 0.14464850425720216, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08280410766601562, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03682717323303222, "sim_compute_performance-ego": 0.06430780410766601, "sim_compute_robot_state-ego": 0.06965743064880371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09983240199994438, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05774584902992731, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13934640642962878, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08488985858386076, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03511207314986217, "sim_compute_performance-ego": 0.06217827978013437, "sim_compute_robot_state-ego": 0.06558218786988078}}
set_robot_commands_max0.0963271084953757
set_robot_commands_mean0.08815581225089093
set_robot_commands_median0.08579170002656825
set_robot_commands_min0.08280410766601562
sim_compute_performance-ego_max0.06606966919369167
sim_compute_performance-ego_mean0.06199423905354708
sim_compute_performance-ego_median0.06430780410766601
sim_compute_performance-ego_min0.05286411678089815
sim_compute_robot_state-ego_max0.07431791888342963
sim_compute_robot_state-ego_mean0.06813185157509194
sim_compute_robot_state-ego_median0.06786246860728544
sim_compute_robot_state-ego_min0.06323925186606015
sim_compute_sim_state_max0.03971023912783022
sim_compute_sim_state_mean0.03724249303804125
sim_compute_sim_state_median0.0372778247384464
sim_compute_sim_state_min0.03511207314986217
sim_physics_max0.11692477226257324
sim_physics_mean0.10669756317080813
sim_physics_median0.10430833145424172
sim_physics_min0.09983240199994438
sim_render-ego_max0.060144840502271465
sim_render-ego_mean0.0574395499651682
sim_render-ego_median0.05774584902992731
sim_render-ego_min0.055064363479614256
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
227542823Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:06(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.15595546855202205
agent_compute-ego_mean0.14596976042591217
agent_compute-ego_median0.14207749707358225
agent_compute-ego_min0.13884836656075936
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1458232800165812, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05868619018130832, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13884836656075936, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09211504017865216, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037284268273247614, "sim_compute_performance-ego": 0.06601948649794967, "sim_compute_robot_state-ego": 0.0673741411279749, "sim_compute_robot_state-npc0": 0.06222545659100568, "sim_compute_robot_state-npc1": 0.06492252703066226, "sim_compute_robot_state-npc2": 0.0637532737520006, "sim_compute_robot_state-npc3": 0.06451940978014911}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18890170097351075, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.060622606277465824, "in-drivable-lane": 0, "agent_compute-ego": 0.15157960891723632, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08953378677368164, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035479459762573246, "sim_compute_performance-ego": 0.0655416202545166, "sim_compute_robot_state-ego": 0.0664102840423584, "sim_compute_robot_state-npc0": 0.06467576026916504, "sim_compute_robot_state-npc1": 0.06622018814086914, "sim_compute_robot_state-npc2": 0.06514637947082519, "sim_compute_robot_state-npc3": 0.06683792114257812}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.15931676563463712, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05520483067161158, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14138786102596082, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08366188250089947, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03713033701244153, "sim_compute_performance-ego": 0.061776895272104365, "sim_compute_robot_state-ego": 0.0678449178996839, "sim_compute_robot_state-npc0": 0.06307367588344373, "sim_compute_robot_state-npc1": 0.06254569166585018, "sim_compute_robot_state-npc2": 0.06476194921292756, "sim_compute_robot_state-npc3": 0.06156619912699649}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18522678749470772, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.061763896217829066, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15595546855202205, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09329423723341544, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03887544704388968, "sim_compute_performance-ego": 0.06996500642993782, "sim_compute_robot_state-ego": 0.07591260234011879, "sim_compute_robot_state-npc0": 0.0686301792724223, "sim_compute_robot_state-npc1": 0.06718306601802006, "sim_compute_robot_state-npc2": 0.07018521465832674, "sim_compute_robot_state-npc3": 0.06788197650185114}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.16896741730826242, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06107671771730695, "in-drivable-lane": 0, "agent_compute-ego": 0.14207749707358225, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08752220017569405, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.050330093928745816, "sim_compute_performance-ego": 0.06659397057124547, "sim_compute_robot_state-ego": 0.07504447868892125, "sim_compute_robot_state-npc0": 0.06805997235434395, "sim_compute_robot_state-npc1": 0.07056593894958496, "sim_compute_robot_state-npc2": 0.07016749041421073, "sim_compute_robot_state-npc3": 0.07104979242597308}}
set_robot_commands_max0.09329423723341544
set_robot_commands_mean0.08922542937246855
set_robot_commands_median0.08953378677368164
set_robot_commands_min0.08366188250089947
sim_compute_performance-ego_max0.06996500642993782
sim_compute_performance-ego_mean0.06597939580515078
sim_compute_performance-ego_median0.06601948649794967
sim_compute_performance-ego_min0.061776895272104365
sim_compute_robot_state-ego_max0.07591260234011879
sim_compute_robot_state-ego_mean0.07051728481981145
sim_compute_robot_state-ego_median0.0678449178996839
sim_compute_robot_state-ego_min0.0664102840423584
sim_compute_robot_state-npc0_max0.0686301792724223
sim_compute_robot_state-npc0_mean0.06533300887407614
sim_compute_robot_state-npc0_median0.06467576026916504
sim_compute_robot_state-npc0_min0.06222545659100568
sim_compute_robot_state-npc1_max0.07056593894958496
sim_compute_robot_state-npc1_mean0.06628748236099732
sim_compute_robot_state-npc1_median0.06622018814086914
sim_compute_robot_state-npc1_min0.06254569166585018
sim_compute_robot_state-npc2_max0.07018521465832674
sim_compute_robot_state-npc2_mean0.06680286150165816
sim_compute_robot_state-npc2_median0.06514637947082519
sim_compute_robot_state-npc2_min0.0637532737520006
sim_compute_robot_state-npc3_max0.07104979242597308
sim_compute_robot_state-npc3_mean0.06637105979550958
sim_compute_robot_state-npc3_median0.06683792114257812
sim_compute_robot_state-npc3_min0.06156619912699649
sim_compute_sim_state_max0.050330093928745816
sim_compute_sim_state_mean0.039819921204179584
sim_compute_sim_state_median0.037284268273247614
sim_compute_sim_state_min0.035479459762573246
sim_physics_max0.18890170097351075
sim_physics_mean0.16964719028553987
sim_physics_median0.16896741730826242
sim_physics_min0.1458232800165812
sim_render-ego_max0.061763896217829066
sim_render-ego_mean0.05947084821310435
sim_render-ego_median0.060622606277465824
sim_render-ego_min0.05520483067161158
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
227492832AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes11690:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227452835AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227432844AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes11690:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227412851AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227392851AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227382852AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227252881Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessyes11690:17:39(hidden)
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.1482979797181629
agent_compute-ego_mean0.14588299976676952
agent_compute-ego_median0.14574089797411097
agent_compute-ego_min0.14342349038707267
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.15695819237249362, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05963070101017574, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14342349038707267, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08734116794394074, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03668187333525513, "sim_compute_performance-ego": 0.0650164789433102, "sim_compute_robot_state-ego": 0.07090188616471325, "sim_compute_robot_state-npc0": 0.06577892783734439, "sim_compute_robot_state-npc1": 0.06411214698132851, "sim_compute_robot_state-npc2": 0.06558819468930471, "sim_compute_robot_state-npc3": 0.06437573330007869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.1766417102208213, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.05932898748488653, "in-drivable-lane": 0, "agent_compute-ego": 0.1482979797181629, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.08988079570588611, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.037908160497271824, "sim_compute_performance-ego": 0.07130238744947645, "sim_compute_robot_state-ego": 0.07214847443595765, "sim_compute_robot_state-npc0": 0.0702479188404386, "sim_compute_robot_state-npc1": 0.0703021004086449, "sim_compute_robot_state-npc2": 0.06627434775942848, "sim_compute_robot_state-npc3": 0.06407720323592897}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.1603261555565728, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.05931348058912489, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14522811147901746, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0909968736436632, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.0376341003841824, "sim_compute_performance-ego": 0.06510992262098525, "sim_compute_robot_state-ego": 0.06911187065972223, "sim_compute_robot_state-npc0": 0.06749868922763401, "sim_compute_robot_state-npc1": 0.06374116155836318, "sim_compute_robot_state-npc2": 0.06320112970140246, "sim_compute_robot_state-npc3": 0.06395583682590061}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.16556838031188684, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.05902793550271592, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.14574089797411097, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.08951417751575945, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.03741940704908239, "sim_compute_performance-ego": 0.06456921507136613, "sim_compute_robot_state-ego": 0.07045380640689129, "sim_compute_robot_state-npc0": 0.06675630121187132, "sim_compute_robot_state-npc1": 0.06694721406505953, "sim_compute_robot_state-npc2": 0.0642062244327387, "sim_compute_robot_state-npc3": 0.06531034636607368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.1529825528462728, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.05588086446126302, "in-drivable-lane": 0, "agent_compute-ego": 0.14672451927548363, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.08554129751901778, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.034632868236965604, "sim_compute_performance-ego": 0.06459725849212163, "sim_compute_robot_state-ego": 0.06810735899304586, "sim_compute_robot_state-npc0": 0.06509120880611359, "sim_compute_robot_state-npc1": 0.06304209194486103, "sim_compute_robot_state-npc2": 0.06112901369730631, "sim_compute_robot_state-npc3": 0.0610498171004038}}
set_robot_commands_max0.0909968736436632
set_robot_commands_mean0.08865486246565346
set_robot_commands_median0.08951417751575945
set_robot_commands_min0.08554129751901778
sim_compute_performance-ego_max0.07130238744947645
sim_compute_performance-ego_mean0.06611905251545193
sim_compute_performance-ego_median0.0650164789433102
sim_compute_performance-ego_min0.06456921507136613
sim_compute_robot_state-ego_max0.07214847443595765
sim_compute_robot_state-ego_mean0.07014467933206606
sim_compute_robot_state-ego_median0.07045380640689129
sim_compute_robot_state-ego_min0.06810735899304586
sim_compute_robot_state-npc0_max0.0702479188404386
sim_compute_robot_state-npc0_mean0.06707460918468038
sim_compute_robot_state-npc0_median0.06675630121187132
sim_compute_robot_state-npc0_min0.06509120880611359
sim_compute_robot_state-npc1_max0.0703021004086449
sim_compute_robot_state-npc1_mean0.06562894299165144
sim_compute_robot_state-npc1_median0.06411214698132851
sim_compute_robot_state-npc1_min0.06304209194486103
sim_compute_robot_state-npc2_max0.06627434775942848
sim_compute_robot_state-npc2_mean0.06407978205603614
sim_compute_robot_state-npc2_median0.0642062244327387
sim_compute_robot_state-npc2_min0.06112901369730631
sim_compute_robot_state-npc3_max0.06531034636607368
sim_compute_robot_state-npc3_mean0.06375378736567715
sim_compute_robot_state-npc3_median0.06407720323592897
sim_compute_robot_state-npc3_min0.0610498171004038
sim_compute_sim_state_max0.037908160497271824
sim_compute_sim_state_mean0.03685528190055147
sim_compute_sim_state_median0.03741940704908239
sim_compute_sim_state_min0.034632868236965604
sim_physics_max0.1766417102208213
sim_physics_mean0.16249539826160947
sim_physics_median0.1603261555565728
sim_physics_min0.1529825528462728
sim_render-ego_max0.05963070101017574
sim_render-ego_mean0.058636393809633224
sim_render-ego_median0.05931348058912489
sim_render-ego_min0.05588086446126302
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
226842977Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes11690:46:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226772989Bnaichchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11690:06:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226733002Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226663003Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226583019Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes11690:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226473031Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes11690:01:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226323051Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes11690:03:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226263078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11690:08:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226053114almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11690:27:03(hidden)
driven_lanedir_consec_median2.185353061495548
survival_time_median14.950000000000076
deviation-center-line_median0.9435008220616988
in-drivable-lane_median0


other stats
agent_compute-ego_max0.28572375535964967
agent_compute-ego_mean0.2666672357657017
agent_compute-ego_median0.256938803990682
agent_compute-ego_min0.25221720774968465
deviation-center-line_max0.9822461139602914
deviation-center-line_mean0.8606329948319832
deviation-center-line_min0.5558214411706502
deviation-heading_max3.2600620014175123
deviation-heading_mean2.7476538296717954
deviation-heading_median2.654186664499502
deviation-heading_min2.334890485276209
driven_any_max2.3249545528410955
driven_any_mean2.168326033245046
driven_any_median2.226723976325144
driven_any_min1.9668256472301673
driven_lanedir_consec_max2.27781394553347
driven_lanedir_consec_mean2.0950503876198985
driven_lanedir_consec_min1.8348894432223557
driven_lanedir_max2.27781394553347
driven_lanedir_mean2.0950503876198985
driven_lanedir_median2.185353061495548
driven_lanedir_min1.8348894432223557
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean0.20000000000000284
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9668256472301673, "sim_physics": 0.12550162919711716, "survival_time": 13.65000000000006, "driven_lanedir": 1.899485956723519, "sim_render-ego": 0.06567252075279152, "in-drivable-lane": 0, "agent_compute-ego": 0.28487812555753267, "deviation-heading": 2.93529075502866, "set_robot_commands": 0.09840394376398442, "deviation-center-line": 0.5558214411706502, "driven_lanedir_consec": 1.899485956723519, "sim_compute_sim_state": 0.04072246184715858, "sim_compute_performance-ego": 0.0730905864701603, "sim_compute_robot_state-ego": 0.07988009610018887}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.321044713767219, "sim_physics": 0.11436676184336345, "survival_time": 14.950000000000076, "driven_lanedir": 2.2777095311245996, "sim_render-ego": 0.0660379449526469, "in-drivable-lane": 0, "agent_compute-ego": 0.28572375535964967, "deviation-heading": 2.5538392421370943, "set_robot_commands": 0.1003089435895284, "deviation-center-line": 0.9709933754294416, "driven_lanedir_consec": 2.2777095311245996, "sim_compute_sim_state": 0.04115877389907837, "sim_compute_performance-ego": 0.07202286799748739, "sim_compute_robot_state-ego": 0.08049248774846395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3249545528410955, "sim_physics": 0.10777249972025552, "survival_time": 14.950000000000076, "driven_lanedir": 2.27781394553347, "sim_render-ego": 0.057764697869618735, "in-drivable-lane": 0, "agent_compute-ego": 0.256938803990682, "deviation-heading": 2.654186664499502, "set_robot_commands": 0.09034234126408897, "deviation-center-line": 0.9435008220616988, "driven_lanedir_consec": 2.27781394553347, "sim_compute_sim_state": 0.03809483289718628, "sim_compute_performance-ego": 0.06409759998321533, "sim_compute_robot_state-ego": 0.06853599468866985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0020812760616047, "sim_physics": 0.10309399843215944, "survival_time": 14.950000000000076, "driven_lanedir": 1.8348894432223557, "sim_render-ego": 0.05772845347722371, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.25221720774968465, "deviation-heading": 3.2600620014175123, "set_robot_commands": 0.08923460880915324, "deviation-center-line": 0.8506032215378343, "driven_lanedir_consec": 1.8348894432223557, "sim_compute_sim_state": 0.03678608973821004, "sim_compute_performance-ego": 0.0691389004389445, "sim_compute_robot_state-ego": 0.07210917949676514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.226723976325144, "sim_physics": 0.10789947907129924, "survival_time": 14.950000000000076, "driven_lanedir": 2.185353061495548, "sim_render-ego": 0.06056863069534302, "in-drivable-lane": 0, "agent_compute-ego": 0.25357828617095945, "deviation-heading": 2.334890485276209, "set_robot_commands": 0.09022313435872396, "deviation-center-line": 0.9822461139602914, "driven_lanedir_consec": 2.185353061495548, "sim_compute_sim_state": 0.037215991020202635, "sim_compute_performance-ego": 0.0681192684173584, "sim_compute_robot_state-ego": 0.07108312129974365}}
set_robot_commands_max0.1003089435895284
set_robot_commands_mean0.0937025943570958
set_robot_commands_median0.09034234126408897
set_robot_commands_min0.08923460880915324
sim_compute_performance-ego_max0.0730905864701603
sim_compute_performance-ego_mean0.06929384466143318
sim_compute_performance-ego_median0.0691389004389445
sim_compute_performance-ego_min0.06409759998321533
sim_compute_robot_state-ego_max0.08049248774846395
sim_compute_robot_state-ego_mean0.07442017586676629
sim_compute_robot_state-ego_median0.07210917949676514
sim_compute_robot_state-ego_min0.06853599468866985
sim_compute_sim_state_max0.04115877389907837
sim_compute_sim_state_mean0.03879562988036718
sim_compute_sim_state_median0.03809483289718628
sim_compute_sim_state_min0.03678608973821004
sim_physics_max0.12550162919711716
sim_physics_mean0.11172687365283895
sim_physics_median0.10789947907129924
sim_physics_min0.10309399843215944
sim_render-ego_max0.0660379449526469
sim_render-ego_mean0.061554449549524784
sim_render-ego_median0.06056863069534302
sim_render-ego_min0.05772845347722371
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.690000000000072
survival_time_min13.65000000000006
225913129almasipBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessyes11690:21:34(hidden)
driven_lanedir_consec_median1.16856000774427
survival_time_median6.349999999999985
deviation-center-line_median0.261454195067992
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.317485676037045
agent_compute-ego_mean0.2834679131972922
agent_compute-ego_median0.27834692892137464
agent_compute-ego_min0.26769306109501767
deviation-center-line_max0.9937739318733424
deviation-center-line_mean0.3858564961356631
deviation-center-line_min0.1812231171505083
deviation-heading_max3.8466902743659857
deviation-heading_mean1.4336950455195177
deviation-heading_median0.9695337732365992
deviation-heading_min0.6082458187507025
driven_any_max3.676583339028152
driven_any_mean1.7037200613580763
driven_any_median1.6279652113260263
driven_any_min0.4131691185990866
driven_lanedir_consec_max3.343597617415085
driven_lanedir_consec_mean1.3788437844171837
driven_lanedir_consec_min0.3826134589156941
driven_lanedir_max3.343597617415085
driven_lanedir_mean1.3845739374030934
driven_lanedir_median1.181930880706367
driven_lanedir_min0.3826134589156941
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean1.049999999999999
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1318692695106831, "sim_physics": 0.17917161721449631, "survival_time": 4.549999999999992, "driven_lanedir": 0.7628928668010202, "sim_render-ego": 0.06362644394675454, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.27834692892137464, "deviation-heading": 0.6082458187507025, "set_robot_commands": 0.09718789897122226, "deviation-center-line": 0.18672340840732257, "driven_lanedir_consec": 0.7628928668010202, "sim_compute_sim_state": 0.04096486542251084, "sim_compute_performance-ego": 0.06959338502569513, "sim_compute_robot_state-ego": 0.07444040329901727, "sim_compute_robot_state-npc0": 0.07453418302012015, "sim_compute_robot_state-npc1": 0.07145873530880435, "sim_compute_robot_state-npc2": 0.06739550894433326, "sim_compute_robot_state-npc3": 0.07110863203530783}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.676583339028152, "sim_physics": 0.19607020457585653, "survival_time": 14.950000000000076, "driven_lanedir": 3.343597617415085, "sim_render-ego": 0.06474701960881551, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.2859421396255493, "deviation-heading": 3.8466902743659857, "set_robot_commands": 0.09752729574839274, "deviation-center-line": 0.9937739318733424, "driven_lanedir_consec": 3.343597617415085, "sim_compute_sim_state": 0.039962621529897054, "sim_compute_performance-ego": 0.07278361638387044, "sim_compute_robot_state-ego": 0.07829826593399047, "sim_compute_robot_state-npc0": 0.0723578929901123, "sim_compute_robot_state-npc1": 0.07154470761617025, "sim_compute_robot_state-npc2": 0.07185405254364013, "sim_compute_robot_state-npc3": 0.07172663370768229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6690133683264354, "sim_physics": 0.170373876278217, "survival_time": 6.499999999999985, "driven_lanedir": 1.181930880706367, "sim_render-ego": 0.06336484872377836, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.26769306109501767, "deviation-heading": 0.9695337732365992, "set_robot_commands": 0.09318355596982517, "deviation-center-line": 0.261454195067992, "driven_lanedir_consec": 1.16856000774427, "sim_compute_sim_state": 0.038661749546344465, "sim_compute_performance-ego": 0.07028356882242057, "sim_compute_robot_state-ego": 0.0740081475331233, "sim_compute_robot_state-npc0": 0.06866020606114315, "sim_compute_robot_state-npc1": 0.06780773126162015, "sim_compute_robot_state-npc2": 0.06831292189084566, "sim_compute_robot_state-npc3": 0.06916013864370493}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6279652113260263, "sim_physics": 0.19669378273130403, "survival_time": 6.349999999999985, "driven_lanedir": 1.2518348631773013, "sim_render-ego": 0.0663460915482889, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.317485676037045, "deviation-heading": 1.076518730305054, "set_robot_commands": 0.0970139954033799, "deviation-center-line": 0.30610782817915033, "driven_lanedir_consec": 1.236554971209848, "sim_compute_sim_state": 0.04111687217171737, "sim_compute_performance-ego": 0.07763962858305203, "sim_compute_robot_state-ego": 0.08117839858287901, "sim_compute_robot_state-npc0": 0.07106538644925815, "sim_compute_robot_state-npc1": 0.07153979061156746, "sim_compute_robot_state-npc2": 0.07328325556957815, "sim_compute_robot_state-npc3": 0.07432144270168514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4131691185990866, "sim_physics": 0.1824802946537099, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3826134589156941, "sim_render-ego": 0.06134634829582052, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.26787176030747434, "deviation-heading": 0.6674866309392474, "set_robot_commands": 0.0917362152261937, "deviation-center-line": 0.1812231171505083, "driven_lanedir_consec": 0.3826134589156941, "sim_compute_sim_state": 0.03951794035891269, "sim_compute_performance-ego": 0.07144335482982879, "sim_compute_robot_state-ego": 0.07529659981423235, "sim_compute_robot_state-npc0": 0.07196412187941531, "sim_compute_robot_state-npc1": 0.0716857707246821, "sim_compute_robot_state-npc2": 0.06979329535301695, "sim_compute_robot_state-npc3": 0.06791410547621707}}
set_robot_commands_max0.09752729574839274
set_robot_commands_mean0.09532979226380275
set_robot_commands_median0.0970139954033799
set_robot_commands_min0.0917362152261937
sim_compute_performance-ego_max0.07763962858305203
sim_compute_performance-ego_mean0.07234871072897339
sim_compute_performance-ego_median0.07144335482982879
sim_compute_performance-ego_min0.06959338502569513
sim_compute_robot_state-ego_max0.08117839858287901
sim_compute_robot_state-ego_mean0.07664436303264849
sim_compute_robot_state-ego_median0.07529659981423235
sim_compute_robot_state-ego_min0.0740081475331233
sim_compute_robot_state-npc0_max0.07453418302012015
sim_compute_robot_state-npc0_mean0.07171635808000981
sim_compute_robot_state-npc0_median0.07196412187941531
sim_compute_robot_state-npc0_min0.06866020606114315
sim_compute_robot_state-npc1_max0.0716857707246821
sim_compute_robot_state-npc1_mean0.07080734710456886
sim_compute_robot_state-npc1_median0.07153979061156746
sim_compute_robot_state-npc1_min0.06780773126162015
sim_compute_robot_state-npc2_max0.07328325556957815
sim_compute_robot_state-npc2_mean0.07012780686028283
sim_compute_robot_state-npc2_median0.06979329535301695
sim_compute_robot_state-npc2_min0.06739550894433326
sim_compute_robot_state-npc3_max0.07432144270168514
sim_compute_robot_state-npc3_mean0.07084619051291945
sim_compute_robot_state-npc3_median0.07110863203530783
sim_compute_robot_state-npc3_min0.06791410547621707
sim_compute_sim_state_max0.04111687217171737
sim_compute_sim_state_mean0.04004480980587648
sim_compute_sim_state_median0.039962621529897054
sim_compute_sim_state_min0.038661749546344465
sim_physics_max0.19669378273130403
sim_physics_mean0.18495795509071672
sim_physics_median0.1824802946537099
sim_physics_min0.170373876278217
sim_render-ego_max0.0663460915482889
sim_render-ego_mean0.06388615042469156
sim_render-ego_median0.06362644394675454
sim_render-ego_min0.06134634829582052
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.940000000000009
survival_time_min2.3499999999999996
225523185jp18813100494First test - THaido2-LF-sim-testingstep1-simulationerroryes11690:29:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225413195JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes11690:08:07(hidden)
driven_lanedir_consec_median0.6920724731953904
survival_time_median3.999999999999994
deviation-center-line_median0.2344202649171729
in-drivable-lane_median0.6999999999999975


other stats
agent_compute-ego_max0.11095846110376818
agent_compute-ego_mean0.10805905903605165
agent_compute-ego_median0.10989526682679758
agent_compute-ego_min0.10198181867599489
deviation-center-line_max0.6179791521957764
deviation-center-line_mean0.28226346712945316
deviation-center-line_min0.12321310762075308
deviation-heading_max1.3808930492427236
deviation-heading_mean0.7404860802660196
deviation-heading_median0.585094901543844
deviation-heading_min0.2909049870120278
driven_any_max2.128820712372678
driven_any_mean0.9941443397815296
driven_any_median1.0247402910688082
driven_any_min0.312040871215342
driven_lanedir_consec_max1.6140708931485974
driven_lanedir_consec_mean0.7506079719491037
driven_lanedir_consec_min0.3063101498086782
driven_lanedir_max1.6140708931485974
driven_lanedir_mean0.7506079719491037
driven_lanedir_median0.6920724731953904
driven_lanedir_min0.3063101498086782
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.7299999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0953025972027035, "sim_physics": 0.12091727866682896, "survival_time": 4.299999999999993, "driven_lanedir": 0.6920724731953904, "sim_render-ego": 0.06806608133537825, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.10995813580446465, "deviation-heading": 0.3443619430804727, "set_robot_commands": 0.10368213819902997, "deviation-center-line": 0.2344202649171729, "driven_lanedir_consec": 0.6920724731953904, "sim_compute_sim_state": 0.04178746633751448, "sim_compute_performance-ego": 0.07154757754747258, "sim_compute_robot_state-ego": 0.07671415528585744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0247402910688082, "sim_physics": 0.11499017775058748, "survival_time": 3.999999999999994, "driven_lanedir": 0.7527271628855262, "sim_render-ego": 0.06318644285202027, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10198181867599489, "deviation-heading": 1.1011755204510298, "set_robot_commands": 0.11489853858947754, "deviation-center-line": 0.2881328674723111, "driven_lanedir_consec": 0.7527271628855262, "sim_compute_sim_state": 0.04066879153251648, "sim_compute_performance-ego": 0.07649149596691132, "sim_compute_robot_state-ego": 0.0788007915019989}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.312040871215342, "sim_physics": 0.13957401801799907, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3063101498086782, "sim_render-ego": 0.06597886414363466, "in-drivable-lane": 0, "agent_compute-ego": 0.11095846110376818, "deviation-heading": 0.2909049870120278, "set_robot_commands": 0.10233324971692316, "deviation-center-line": 0.14757194344125227, "driven_lanedir_consec": 0.3063101498086782, "sim_compute_sim_state": 0.04384497938484981, "sim_compute_performance-ego": 0.0752502885358087, "sim_compute_robot_state-ego": 0.08258096925143538}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4098172270481152, "sim_physics": 0.13124869267145792, "survival_time": 1.800000000000001, "driven_lanedir": 0.3878591807073266, "sim_render-ego": 0.06691813468933105, "in-drivable-lane": 0, "agent_compute-ego": 0.10750161276923284, "deviation-heading": 0.585094901543844, "set_robot_commands": 0.11168216996722752, "deviation-center-line": 0.12321310762075308, "driven_lanedir_consec": 0.3878591807073266, "sim_compute_sim_state": 0.04315455092324151, "sim_compute_performance-ego": 0.07439152399698894, "sim_compute_robot_state-ego": 0.08240810367796156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.128820712372678, "sim_physics": 0.12075197321813812, "survival_time": 7.94999999999998, "driven_lanedir": 1.6140708931485974, "sim_render-ego": 0.06879470633260859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10989526682679758, "deviation-heading": 1.3808930492427236, "set_robot_commands": 0.10756664006215222, "deviation-center-line": 0.6179791521957764, "driven_lanedir_consec": 1.6140708931485974, "sim_compute_sim_state": 0.04432784236452115, "sim_compute_performance-ego": 0.07552501840411492, "sim_compute_robot_state-ego": 0.08393438507176046}}
set_robot_commands_max0.11489853858947754
set_robot_commands_mean0.10803254730696207
set_robot_commands_median0.10756664006215222
set_robot_commands_min0.10233324971692316
sim_compute_performance-ego_max0.07649149596691132
sim_compute_performance-ego_mean0.07464118089025928
sim_compute_performance-ego_median0.0752502885358087
sim_compute_performance-ego_min0.07154757754747258
sim_compute_robot_state-ego_max0.08393438507176046
sim_compute_robot_state-ego_mean0.08088768095780274
sim_compute_robot_state-ego_median0.08240810367796156
sim_compute_robot_state-ego_min0.07671415528585744
sim_compute_sim_state_max0.04432784236452115
sim_compute_sim_state_mean0.04275672610852869
sim_compute_sim_state_median0.04315455092324151
sim_compute_sim_state_min0.04066879153251648
sim_physics_max0.13957401801799907
sim_physics_mean0.1254964280650023
sim_physics_median0.12091727866682896
sim_physics_min0.11499017775058748
sim_render-ego_max0.06879470633260859
sim_render-ego_mean0.06658884587059456
sim_render-ego_median0.06691813468933105
sim_render-ego_min0.06318644285202027
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean3.8999999999999937
survival_time_min1.4500000000000006
225323206Masachallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11690:16:46(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.1786513749290915
agent_compute-ego_mean0.15511499553906033
agent_compute-ego_median0.15421850802534717
agent_compute-ego_min0.11623128822871616
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13090297469386347, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06537042282245777, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1634766569843999, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10200279730337636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04054001525596336, "sim_compute_performance-ego": 0.07363123363918728, "sim_compute_robot_state-ego": 0.08463266160753039}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12238131317437864, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06139179304534314, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15154617907954196, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.097060666364782, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04071442753660912, "sim_compute_performance-ego": 0.0688319112740311, "sim_compute_robot_state-ego": 0.07585417523103602}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14113751579733455, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07002411169164321, "in-drivable-lane": 0, "agent_compute-ego": 0.1786513749290915, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10744397780474496, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04417044976178337, "sim_compute_performance-ego": 0.07728802456575282, "sim_compute_robot_state-ego": 0.0939787836635814}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13242959022521972, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05832149505615234, "in-drivable-lane": 0, "agent_compute-ego": 0.15406731605529786, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09924959182739258, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03535835266113281, "sim_compute_performance-ego": 0.06810334205627441, "sim_compute_robot_state-ego": 0.07241825103759765}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12005576604529272, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06051766721508171, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1570009249675123, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10113134565232676, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03917969631243356, "sim_compute_performance-ego": 0.07023061076297035, "sim_compute_robot_state-ego": 0.0783809136740769}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1183214284935776, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06255046688780493, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15386468050431232, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09103096747884944, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038152159476766784, "sim_compute_performance-ego": 0.06904157327145946, "sim_compute_robot_state-ego": 0.07460363057194924}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11440151504107884, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06487809334482465, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1778689750603267, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10350126028060912, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04193691270692008, "sim_compute_performance-ego": 0.07234878199441093, "sim_compute_robot_state-ego": 0.08581473997661046}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13488984107971191, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06528980391366142, "in-drivable-lane": 0, "agent_compute-ego": 0.16036438941955566, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10076136816115606, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.043496892565772646, "sim_compute_performance-ego": 0.07254217919849214, "sim_compute_robot_state-ego": 0.08162582488287062}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11515435525926492, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0646961907208976, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15421850802534717, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1007219169099452, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.039628259206222274, "sim_compute_performance-ego": 0.06549430701692226, "sim_compute_robot_state-ego": 0.06895461324918067}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11664018630981446, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06300766251303933, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1502367539839311, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09209509329362348, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.0407971902327104, "sim_compute_performance-ego": 0.0679886211048473, "sim_compute_robot_state-ego": 0.07497472763061523}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11014222479485848, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05945420574832272, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15672748119800123, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10148693679215072, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.039686298989630366, "sim_compute_performance-ego": 0.06494466979782303, "sim_compute_robot_state-ego": 0.06995265205185135}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12621081726891653, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.043009979384286065, "in-drivable-lane": 0, "agent_compute-ego": 0.11623128822871616, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.07045072317123413, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02983286551066807, "sim_compute_performance-ego": 0.05280645404543195, "sim_compute_robot_state-ego": 0.05368912220001221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10853787964465572, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05786459586199592, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1476902073504878, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.1026014206456203, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04034359314862419, "sim_compute_performance-ego": 0.06512239867565679, "sim_compute_robot_state-ego": 0.07003468158198338}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09216491381327312, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05247796906365289, "in-drivable-lane": 0, "agent_compute-ego": 0.1407825681898329, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07400597466362847, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03179698520236545, "sim_compute_performance-ego": 0.05449600572939272, "sim_compute_robot_state-ego": 0.06576668774640118}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1217414187450035, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06764821678984399, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16399762910955093, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10235999612247244, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04244034196816239, "sim_compute_performance-ego": 0.07420291152654909, "sim_compute_robot_state-ego": 0.08231404949637021}}
set_robot_commands_max0.10744397780474496
set_robot_commands_mean0.09639360243146082
set_robot_commands_median0.10076136816115606
set_robot_commands_min0.07045072317123413
sim_compute_performance-ego_max0.07728802456575282
sim_compute_performance-ego_mean0.06780486831061344
sim_compute_performance-ego_median0.0688319112740311
sim_compute_performance-ego_min0.05280645404543195
sim_compute_robot_state-ego_max0.0939787836635814
sim_compute_robot_state-ego_mean0.07553303430677778
sim_compute_robot_state-ego_median0.07497472763061523
sim_compute_robot_state-ego_min0.05368912220001221
sim_compute_sim_state_max0.04417044976178337
sim_compute_sim_state_mean0.03920496270238432
sim_compute_sim_state_median0.04034359314862419
sim_compute_sim_state_min0.02983286551066807
sim_physics_max0.14113751579733455
sim_physics_mean0.12034078269241628
sim_physics_median0.12005576604529272
sim_physics_min0.09216491381327312
sim_render-ego_max0.07002411169164321
sim_render-ego_mean0.06110017827060051
sim_render-ego_median0.06255046688780493
sim_render-ego_min0.043009979384286065
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
225243213AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:10(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1523418192769967
agent_compute-ego_mean0.1255693496385237
agent_compute-ego_median0.11704172134399414
agent_compute-ego_min0.10625041232389562
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0715391856652719, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.045529060893588595, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.10837856045475712, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08159289095136854, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03139298492007785, "sim_compute_performance-ego": 0.053111632664998375, "sim_compute_robot_state-ego": 0.04936827553643121}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10686406434751024, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060640970865885414, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1523418192769967, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09730026768703089, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0385898001053754, "sim_compute_performance-ego": 0.06931004337235994, "sim_compute_robot_state-ego": 0.06845976324642405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0823670275071088, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04233037724214442, "in-drivable-lane": 0, "agent_compute-ego": 0.10625041232389562, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07123013103709501, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.029606931349810434, "sim_compute_performance-ego": 0.04578675943262437, "sim_compute_robot_state-ego": 0.04991796437431784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07517236709594727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.044176855087280274, "in-drivable-lane": 0, "agent_compute-ego": 0.11704172134399414, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08052803993225098, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.028458967208862304, "sim_compute_performance-ego": 0.047406549453735354, "sim_compute_robot_state-ego": 0.05383511543273926}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10986017275460158, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0643488334704049, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14383423479297494, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09211137626744524, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03770142567308643, "sim_compute_performance-ego": 0.06857167316388481, "sim_compute_robot_state-ego": 0.07225940800920318}}
set_robot_commands_max0.09730026768703089
set_robot_commands_mean0.08455254117503813
set_robot_commands_median0.08159289095136854
set_robot_commands_min0.07123013103709501
sim_compute_performance-ego_max0.06931004337235994
sim_compute_performance-ego_mean0.05683733161752057
sim_compute_performance-ego_median0.053111632664998375
sim_compute_performance-ego_min0.04578675943262437
sim_compute_robot_state-ego_max0.07225940800920318
sim_compute_robot_state-ego_mean0.05876810531982311
sim_compute_robot_state-ego_median0.05383511543273926
sim_compute_robot_state-ego_min0.04936827553643121
sim_compute_sim_state_max0.0385898001053754
sim_compute_sim_state_mean0.03315002185144249
sim_compute_sim_state_median0.03139298492007785
sim_compute_sim_state_min0.028458967208862304
sim_physics_max0.10986017275460158
sim_physics_mean0.08916056347408795
sim_physics_median0.0823670275071088
sim_physics_min0.0715391856652719
sim_render-ego_max0.0643488334704049
sim_render-ego_mean0.05140521951186072
sim_render-ego_median0.045529060893588595
sim_render-ego_min0.04233037724214442
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225223220AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationerroryes11690:06:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225133226JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:09:44(hidden)
driven_lanedir_consec_median0.6482690555669561
survival_time_median4.799999999999991
deviation-center-line_median0.33137449973274535
in-drivable-lane_median0.6000000000000001


other stats
agent_compute-ego_max0.10008593227552331
agent_compute-ego_mean0.08257744671541331
agent_compute-ego_median0.08585424201433049
agent_compute-ego_min0.06445349817690642
deviation-center-line_max0.8629816460472337
deviation-center-line_mean0.4052350147373122
deviation-center-line_min0.1232226529796871
deviation-heading_max2.5270421322989316
deviation-heading_mean1.6944073723452333
deviation-heading_median1.3114128255977453
deviation-heading_min1.2772414530099196
driven_any_max2.547563587267358
driven_any_mean1.2489296114351005
driven_any_median1.0806560931556195
driven_any_min0.48079344307760785
driven_lanedir_consec_max2.030429428861149
driven_lanedir_consec_mean0.8410103149601313
driven_lanedir_consec_min0.14330318763051497
driven_lanedir_max2.030429428861149
driven_lanedir_mean0.8968134692823696
driven_lanedir_median0.7507516272566102
driven_lanedir_min0.19840401404062505
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean0.829999999999998
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0806560931556195, "sim_physics": 0.1112196445465088, "survival_time": 4.799999999999991, "driven_lanedir": 0.7507516272566102, "sim_render-ego": 0.0632547711332639, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09027464936176936, "deviation-heading": 2.5270421322989316, "set_robot_commands": 0.1148828516403834, "deviation-center-line": 0.33137449973274535, "driven_lanedir_consec": 0.6482690555669561, "sim_compute_sim_state": 0.04267106205224991, "sim_compute_performance-ego": 0.06957327822844188, "sim_compute_robot_state-ego": 0.07245216518640518}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.48080622790521776, "sim_physics": 0.1674722899561343, "survival_time": 2.3, "driven_lanedir": 0.19840401404062505, "sim_render-ego": 0.06491121520166812, "in-drivable-lane": 0.6000000000000001, "agent_compute-ego": 0.10008593227552331, "deviation-heading": 1.2800259505804874, "set_robot_commands": 0.11440334112747856, "deviation-center-line": 0.1232226529796871, "driven_lanedir_consec": 0.14330318763051497, "sim_compute_sim_state": 0.04254971379819124, "sim_compute_performance-ego": 0.0759600660075312, "sim_compute_robot_state-ego": 0.08566067529761273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.547563587267358, "sim_physics": 0.12529881277749705, "survival_time": 10.750000000000018, "driven_lanedir": 2.030429428861149, "sim_render-ego": 0.0645471173663472, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.08585424201433049, "deviation-heading": 1.2772414530099196, "set_robot_commands": 0.11549674743829771, "deviation-center-line": 0.8629816460472337, "driven_lanedir_consec": 2.030429428861149, "sim_compute_sim_state": 0.04396556920783464, "sim_compute_performance-ego": 0.07288735079210858, "sim_compute_robot_state-ego": 0.08039799512818802}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6548287057696982, "sim_physics": 0.094287912610551, "survival_time": 7.099999999999983, "driven_lanedir": 1.2596261670471434, "sim_render-ego": 0.05527513799533038, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.07221891174853688, "deviation-heading": 2.0763145002390835, "set_robot_commands": 0.09694066685690007, "deviation-center-line": 0.558399371643866, "driven_lanedir_consec": 1.228205201818661, "sim_compute_sim_state": 0.03685598642053738, "sim_compute_performance-ego": 0.06083144604320258, "sim_compute_robot_state-ego": 0.0652010591936783}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.48079344307760785, "sim_physics": 0.09346389770507812, "survival_time": 2.3, "driven_lanedir": 0.24485610920632128, "sim_render-ego": 0.04644012451171875, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.06445349817690642, "deviation-heading": 1.3114128255977453, "set_robot_commands": 0.08780003630596658, "deviation-center-line": 0.1501969032830292, "driven_lanedir_consec": 0.154844700923376, "sim_compute_sim_state": 0.03197144943734874, "sim_compute_performance-ego": 0.05303421227828316, "sim_compute_robot_state-ego": 0.05722616548123567}}
set_robot_commands_max0.11549674743829771
set_robot_commands_mean0.10590472867380528
set_robot_commands_median0.11440334112747856
set_robot_commands_min0.08780003630596658
sim_compute_performance-ego_max0.0759600660075312
sim_compute_performance-ego_mean0.06645727066991347
sim_compute_performance-ego_median0.06957327822844188
sim_compute_performance-ego_min0.05303421227828316
sim_compute_robot_state-ego_max0.08566067529761273
sim_compute_robot_state-ego_mean0.07218761205742398
sim_compute_robot_state-ego_median0.07245216518640518
sim_compute_robot_state-ego_min0.05722616548123567
sim_compute_sim_state_max0.04396556920783464
sim_compute_sim_state_mean0.03960275618323238
sim_compute_sim_state_median0.04254971379819124
sim_compute_sim_state_min0.03197144943734874
sim_physics_max0.1674722899561343
sim_physics_mean0.11834851151915383
sim_physics_median0.1112196445465088
sim_physics_min0.09346389770507812
sim_render-ego_max0.06491121520166812
sim_render-ego_mean0.05888567324166567
sim_render-ego_median0.0632547711332639
sim_render-ego_min0.04644012451171875
simulation-passed1
survival_time_max10.750000000000018
survival_time_mean5.449999999999998
survival_time_min2.3
225013236JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:16:52(hidden)
driven_lanedir_consec_median1.8585602455264372
survival_time_median8.14999999999998
deviation-center-line_median0.7394696972120545
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09078086619396286
agent_compute-ego_mean0.08750102503842552
agent_compute-ego_median0.08810589479845624
agent_compute-ego_min0.08190862386504565
deviation-center-line_max1.330102370170228
deviation-center-line_mean0.7757390305529259
deviation-center-line_min0.156616058950106
deviation-heading_max2.931919980092094
deviation-heading_mean1.6699672337849407
deviation-heading_median1.651951162872906
deviation-heading_min0.33411079807072414
driven_any_max3.574678085296573
driven_any_mean1.9851000130474856
driven_any_median1.9116486550772611
driven_any_min0.4441832066089127
driven_lanedir_consec_max2.9865400109974503
driven_lanedir_consec_mean1.743345148237858
driven_lanedir_consec_min0.42357196576766665
driven_lanedir_max2.9865400109974503
driven_lanedir_mean1.743345148237858
driven_lanedir_median1.8585602455264372
driven_lanedir_min0.42357196576766665
in-drivable-lane_max1.8500000000000263
in-drivable-lane_mean0.6800000000000088
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9515731520694257, "sim_physics": 0.13011445482093167, "survival_time": 12.450000000000042, "driven_lanedir": 2.4083866619267673, "sim_render-ego": 0.0655557764581887, "in-drivable-lane": 1.5500000000000176, "agent_compute-ego": 0.09078086619396286, "deviation-heading": 2.931919980092094, "set_robot_commands": 0.11337530660820772, "deviation-center-line": 1.1071364179412364, "driven_lanedir_consec": 2.4083866619267673, "sim_compute_sim_state": 0.043550624426110206, "sim_compute_performance-ego": 0.07248600994247988, "sim_compute_robot_state-ego": 0.08021995724444408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9116486550772611, "sim_physics": 0.11311910196316025, "survival_time": 8.14999999999998, "driven_lanedir": 1.8585602455264372, "sim_render-ego": 0.06138913470543235, "in-drivable-lane": 0, "agent_compute-ego": 0.08190862386504565, "deviation-heading": 1.651951162872906, "set_robot_commands": 0.11235505817857988, "deviation-center-line": 0.7394696972120545, "driven_lanedir_consec": 1.8585602455264372, "sim_compute_sim_state": 0.043208561060618766, "sim_compute_performance-ego": 0.06687280005472569, "sim_compute_robot_state-ego": 0.07257761984515043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0434169661852573, "sim_physics": 0.12795669617860214, "survival_time": 4.599999999999992, "driven_lanedir": 1.039666856970968, "sim_render-ego": 0.06676072400549184, "in-drivable-lane": 0, "agent_compute-ego": 0.08970581707747086, "deviation-heading": 0.33411079807072414, "set_robot_commands": 0.1253545750742373, "deviation-center-line": 0.5453706084910053, "driven_lanedir_consec": 1.039666856970968, "sim_compute_sim_state": 0.044272422790527344, "sim_compute_performance-ego": 0.0744995785796124, "sim_compute_robot_state-ego": 0.08745465330455614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4441832066089127, "sim_physics": 0.1279981857122377, "survival_time": 2.1500000000000004, "driven_lanedir": 0.42357196576766665, "sim_render-ego": 0.06724884898163551, "in-drivable-lane": 0, "agent_compute-ego": 0.08810589479845624, "deviation-heading": 0.6350053948141431, "set_robot_commands": 0.1116138779839804, "deviation-center-line": 0.156616058950106, "driven_lanedir_consec": 0.42357196576766665, "sim_compute_sim_state": 0.04400884827902151, "sim_compute_performance-ego": 0.07449071906333746, "sim_compute_robot_state-ego": 0.07890796661376953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.574678085296573, "sim_physics": 0.108406978448232, "survival_time": 14.950000000000076, "driven_lanedir": 2.9865400109974503, "sim_render-ego": 0.061812231540679934, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.08700392325719197, "deviation-heading": 2.796848833074837, "set_robot_commands": 0.11447627941767374, "deviation-center-line": 1.330102370170228, "driven_lanedir_consec": 2.9865400109974503, "sim_compute_sim_state": 0.04303218841552734, "sim_compute_performance-ego": 0.07070357958475748, "sim_compute_robot_state-ego": 0.07434128046035766}}
set_robot_commands_max0.1253545750742373
set_robot_commands_mean0.1154350194525358
set_robot_commands_median0.11337530660820772
set_robot_commands_min0.1116138779839804
sim_compute_performance-ego_max0.0744995785796124
sim_compute_performance-ego_mean0.07181053744498259
sim_compute_performance-ego_median0.07248600994247988
sim_compute_performance-ego_min0.06687280005472569
sim_compute_robot_state-ego_max0.08745465330455614
sim_compute_robot_state-ego_mean0.07870029549365556
sim_compute_robot_state-ego_median0.07890796661376953
sim_compute_robot_state-ego_min0.07257761984515043
sim_compute_sim_state_max0.044272422790527344
sim_compute_sim_state_mean0.04361452899436104
sim_compute_sim_state_median0.043550624426110206
sim_compute_sim_state_min0.04303218841552734
sim_physics_max0.13011445482093167
sim_physics_mean0.12151908342463276
sim_physics_median0.12795669617860214
sim_physics_min0.108406978448232
sim_render-ego_max0.06724884898163551
sim_render-ego_mean0.06455334313828567
sim_render-ego_median0.0655557764581887
sim_render-ego_min0.06138913470543235
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.460000000000019
survival_time_min2.1500000000000004
224993238jp18813100494Second test - THaido2-LF-sim-validationstep1-simulationerroryes11690:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224923248Brian Chuang challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:08(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.14806357552023494
agent_compute-ego_mean0.13165739632433948
agent_compute-ego_median0.1288252274195353
agent_compute-ego_min0.11186427116394045
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0875094422587642, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05218831698099772, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1288252274195353, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08165085315704346, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03477229895415129, "sim_compute_performance-ego": 0.05629045874984176, "sim_compute_robot_state-ego": 0.05844326372499819}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08829712400249407, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04918077412773581, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12705770193361768, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0726468048843683, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.033991121778301166, "sim_compute_performance-ego": 0.05434441566467285, "sim_compute_robot_state-ego": 0.05536261726828182}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11748273232403925, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05948803004096536, "in-drivable-lane": 0, "agent_compute-ego": 0.14806357552023494, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09703836721532486, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04054150861852309, "sim_compute_performance-ego": 0.063217653947718, "sim_compute_robot_state-ego": 0.07143064106211942}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08561182022094727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04756854057312012, "in-drivable-lane": 0, "agent_compute-ego": 0.11186427116394045, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07453076362609863, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02890833854675293, "sim_compute_performance-ego": 0.05135771751403809, "sim_compute_robot_state-ego": 0.05411564826965332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11329761939712718, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05827133866805065, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14247620558436913, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08844134777407103, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03665709193748764, "sim_compute_performance-ego": 0.06503508362589003, "sim_compute_robot_state-ego": 0.0723754484442216}}
set_robot_commands_max0.09703836721532486
set_robot_commands_mean0.08286162733138125
set_robot_commands_median0.08165085315704346
set_robot_commands_min0.0726468048843683
sim_compute_performance-ego_max0.06503508362589003
sim_compute_performance-ego_mean0.05804906590043215
sim_compute_performance-ego_median0.05629045874984176
sim_compute_performance-ego_min0.05135771751403809
sim_compute_robot_state-ego_max0.0723754484442216
sim_compute_robot_state-ego_mean0.06234552375385487
sim_compute_robot_state-ego_median0.05844326372499819
sim_compute_robot_state-ego_min0.05411564826965332
sim_compute_sim_state_max0.04054150861852309
sim_compute_sim_state_mean0.034974071967043226
sim_compute_sim_state_median0.03477229895415129
sim_compute_sim_state_min0.02890833854675293
sim_physics_max0.11748273232403925
sim_physics_mean0.0984397476406744
sim_physics_median0.08829712400249407
sim_physics_min0.08561182022094727
sim_render-ego_max0.05948803004096536
sim_render-ego_mean0.05333940007817393
sim_render-ego_median0.05218831698099772
sim_render-ego_min0.04756854057312012
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
224793268ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:17:02(hidden)
driven_lanedir_consec_median1.2305190031201856
survival_time_median8.899999999999991
deviation-center-line_median0.5771458850482323
in-drivable-lane_median1.6999999999999955


other stats
agent_compute-ego_max0.10172563172428986
agent_compute-ego_mean0.0989053062811897
agent_compute-ego_median0.09892491330491736
agent_compute-ego_min0.09690403247225111
deviation-center-line_max1.1488111156355547
deviation-center-line_mean0.6488031212511529
deviation-center-line_min0.34884787027557723
deviation-heading_max3.61599883232021
deviation-heading_mean1.7260666402917764
deviation-heading_median1.4218969858349213
deviation-heading_min0.3112599289821271
driven_any_max3.4035761096508277
driven_any_mean1.8946471986219724
driven_any_median2.0834330562964634
driven_any_min0.7621458305230319
driven_lanedir_consec_max2.786543911691145
driven_lanedir_consec_mean1.4692902725397083
driven_lanedir_consec_min0.758467835111603
driven_lanedir_max2.786543911691145
driven_lanedir_mean1.4692902725397083
driven_lanedir_median1.2305190031201856
driven_lanedir_min0.758467835111603
in-drivable-lane_max2.800000000000005
in-drivable-lane_mean1.34
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0834330562964634, "sim_physics": 0.11412759577290396, "survival_time": 8.899999999999991, "driven_lanedir": 1.2305190031201856, "sim_render-ego": 0.061742475863253134, "in-drivable-lane": 2.800000000000005, "agent_compute-ego": 0.09720663140329082, "deviation-heading": 2.1694395159240227, "set_robot_commands": 0.09528927320844673, "deviation-center-line": 0.5771458850482323, "driven_lanedir_consec": 1.2305190031201856, "sim_compute_sim_state": 0.03827882348821404, "sim_compute_performance-ego": 0.06992528947551599, "sim_compute_robot_state-ego": 0.07240149814091372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0678561329190914, "sim_physics": 0.11921270857466028, "survival_time": 4.699999999999991, "driven_lanedir": 0.8981067716987119, "sim_render-ego": 0.06484188932053586, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09892491330491736, "deviation-heading": 1.1117379383976007, "set_robot_commands": 0.10449194400868515, "deviation-center-line": 0.34884787027557723, "driven_lanedir_consec": 0.8981067716987119, "sim_compute_sim_state": 0.040589669917492154, "sim_compute_performance-ego": 0.07760083675384521, "sim_compute_robot_state-ego": 0.08545771304597245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7621458305230319, "sim_physics": 0.11311588080033012, "survival_time": 3.4499999999999957, "driven_lanedir": 0.758467835111603, "sim_render-ego": 0.061401014742643936, "in-drivable-lane": 0, "agent_compute-ego": 0.09690403247225111, "deviation-heading": 0.3112599289821271, "set_robot_commands": 0.09756624871406004, "deviation-center-line": 0.41225298137550304, "driven_lanedir_consec": 0.758467835111603, "sim_compute_sim_state": 0.03884257095447485, "sim_compute_performance-ego": 0.06795479249263155, "sim_compute_robot_state-ego": 0.07825438181559245}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4035761096508277, "sim_physics": 0.11565114908051072, "survival_time": 14.250000000000068, "driven_lanedir": 2.786543911691145, "sim_render-ego": 0.06242092366804156, "in-drivable-lane": 1.7000000000000002, "agent_compute-ego": 0.0997653225011993, "deviation-heading": 3.61599883232021, "set_robot_commands": 0.09614342053731284, "deviation-center-line": 1.1488111156355547, "driven_lanedir_consec": 2.786543911691145, "sim_compute_sim_state": 0.03905590626231411, "sim_compute_performance-ego": 0.07031122676113195, "sim_compute_robot_state-ego": 0.07502928114773934}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1562248637204484, "sim_physics": 0.1180384341484862, "survival_time": 9.149999999999997, "driven_lanedir": 1.672813841076897, "sim_render-ego": 0.06259278912361854, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.10172563172428986, "deviation-heading": 1.4218969858349213, "set_robot_commands": 0.09687611314116933, "deviation-center-line": 0.7569577539208971, "driven_lanedir_consec": 1.672813841076897, "sim_compute_sim_state": 0.04012774118308812, "sim_compute_performance-ego": 0.06982239608556196, "sim_compute_robot_state-ego": 0.07419703436679527}}
set_robot_commands_max0.10449194400868515
set_robot_commands_mean0.0980733999219348
set_robot_commands_median0.09687611314116933
set_robot_commands_min0.09528927320844673
sim_compute_performance-ego_max0.07760083675384521
sim_compute_performance-ego_mean0.07112290831373733
sim_compute_performance-ego_median0.06992528947551599
sim_compute_performance-ego_min0.06795479249263155
sim_compute_robot_state-ego_max0.08545771304597245
sim_compute_robot_state-ego_mean0.07706798170340265
sim_compute_robot_state-ego_median0.07502928114773934
sim_compute_robot_state-ego_min0.07240149814091372
sim_compute_sim_state_max0.040589669917492154
sim_compute_sim_state_mean0.03937894236111666
sim_compute_sim_state_median0.03905590626231411
sim_compute_sim_state_min0.03827882348821404
sim_physics_max0.11921270857466028
sim_physics_mean0.11602915367537828
sim_physics_median0.11565114908051072
sim_physics_min0.11311588080033012
sim_render-ego_max0.06484188932053586
sim_render-ego_mean0.06259981854361861
sim_render-ego_median0.06242092366804156
sim_render-ego_min0.061401014742643936
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean8.090000000000009
survival_time_min3.4499999999999957
224543335MYFtestaido2-LFVI-sim-validationstep1-simulationerroryes11690:21:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224463295ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:09:00(hidden)
driven_lanedir_consec_median0.6665613794166414
survival_time_median4.449999999999992
deviation-center-line_median0.27506318261736495
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.13133786827005367
agent_compute-ego_mean0.10958869698914982
agent_compute-ego_median0.10602452641441708
agent_compute-ego_min0.09961463896076332
deviation-center-line_max0.5405466971129735
deviation-center-line_mean0.29571370825500976
deviation-center-line_min0.14577080707330664
deviation-heading_max1.1772769095730584
deviation-heading_mean0.6219946012733388
deviation-heading_median0.5979885370116356
deviation-heading_min0.3130597775476315
driven_any_max1.6793181334201532
driven_any_mean0.909008083111998
driven_any_median1.0067176412812215
driven_any_min0.3830463924283936
driven_lanedir_consec_max1.2866980510543735
driven_lanedir_consec_mean0.7030867622842658
driven_lanedir_consec_min0.3783827855885713
driven_lanedir_max1.2866980510543735
driven_lanedir_mean0.7030867622842658
driven_lanedir_median0.6665613794166414
driven_lanedir_min0.3783827855885713
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.7399999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0439998689644476, "sim_physics": 0.13015370471503146, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6665613794166414, "sim_render-ego": 0.07065531258941979, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.13133786827005367, "deviation-heading": 0.37092426295100417, "set_robot_commands": 0.11001646646889308, "deviation-center-line": 0.27506318261736495, "driven_lanedir_consec": 0.6665613794166414, "sim_compute_sim_state": 0.04295575746925928, "sim_compute_performance-ego": 0.07345034999232139, "sim_compute_robot_state-ego": 0.08779208890853389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0067176412812215, "sim_physics": 0.13158570514636092, "survival_time": 4.449999999999992, "driven_lanedir": 0.7726470000832769, "sim_render-ego": 0.06766855046990213, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09961463896076332, "deviation-heading": 1.1772769095730584, "set_robot_commands": 0.10496531443649464, "deviation-center-line": 0.3156839638895037, "driven_lanedir_consec": 0.7726470000832769, "sim_compute_sim_state": 0.04170803273661753, "sim_compute_performance-ego": 0.07615993531902185, "sim_compute_robot_state-ego": 0.08146597026439195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3830463924283936, "sim_physics": 0.13339745370965256, "survival_time": 1.900000000000001, "driven_lanedir": 0.3783827855885713, "sim_render-ego": 0.06137202915392424, "in-drivable-lane": 0, "agent_compute-ego": 0.1026848554611206, "deviation-heading": 0.3130597775476315, "set_robot_commands": 0.10008700270401805, "deviation-center-line": 0.20150389058190016, "driven_lanedir_consec": 0.3783827855885713, "sim_compute_sim_state": 0.041579522584614, "sim_compute_performance-ego": 0.07098876175127532, "sim_compute_robot_state-ego": 0.07685181969090511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4319583794657741, "sim_physics": 0.124965162504287, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4111445952784658, "sim_render-ego": 0.06486619654155913, "in-drivable-lane": 0, "agent_compute-ego": 0.10602452641441708, "deviation-heading": 0.6507235192833651, "set_robot_commands": 0.10434051354726157, "deviation-center-line": 0.14577080707330664, "driven_lanedir_consec": 0.4111445952784658, "sim_compute_sim_state": 0.040420061066037134, "sim_compute_performance-ego": 0.06979412691933769, "sim_compute_robot_state-ego": 0.07560365540640694}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6793181334201532, "sim_physics": 0.12437489794360268, "survival_time": 7.199999999999982, "driven_lanedir": 1.2866980510543735, "sim_render-ego": 0.06501300467385186, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10828159583939446, "deviation-heading": 0.5979885370116356, "set_robot_commands": 0.10258388353718652, "deviation-center-line": 0.5405466971129735, "driven_lanedir_consec": 1.2866980510543735, "sim_compute_sim_state": 0.04086485008398691, "sim_compute_performance-ego": 0.07392720381418864, "sim_compute_robot_state-ego": 0.08219448394245571}}
set_robot_commands_max0.11001646646889308
set_robot_commands_mean0.10439863613877076
set_robot_commands_median0.10434051354726157
set_robot_commands_min0.10008700270401805
sim_compute_performance-ego_max0.07615993531902185
sim_compute_performance-ego_mean0.07286407555922898
sim_compute_performance-ego_median0.07345034999232139
sim_compute_performance-ego_min0.06979412691933769
sim_compute_robot_state-ego_max0.08779208890853389
sim_compute_robot_state-ego_mean0.08078160364253872
sim_compute_robot_state-ego_median0.08146597026439195
sim_compute_robot_state-ego_min0.07560365540640694
sim_compute_sim_state_max0.04295575746925928
sim_compute_sim_state_mean0.041505644788102966
sim_compute_sim_state_median0.041579522584614
sim_compute_sim_state_min0.040420061066037134
sim_physics_max0.13339745370965256
sim_physics_mean0.12889538480378693
sim_physics_median0.13015370471503146
sim_physics_min0.12437489794360268
sim_render-ego_max0.07065531258941979
sim_render-ego_mean0.06591501868573144
sim_render-ego_median0.06501300467385186
sim_render-ego_min0.06137202915392424
simulation-passed1
survival_time_max7.199999999999982
survival_time_mean4.059999999999993
survival_time_min1.900000000000001
224403300ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:08:34(hidden)
driven_lanedir_consec_median0.4108623025159917
survival_time_median2.2
deviation-center-line_median0.17608683739206069
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1161846626888622
agent_compute-ego_mean0.1065970033854839
agent_compute-ego_median0.10513032807244196
agent_compute-ego_min0.09789851132561178
deviation-center-line_max0.553006586721707
deviation-center-line_mean0.25167707733840106
deviation-center-line_min0.1230563934255246
deviation-heading_max1.353610693525513
deviation-heading_mean0.8401519300419471
deviation-heading_median0.7074316092927606
deviation-heading_min0.3145163536332646
driven_any_max1.1657013383876025
driven_any_mean0.63752855441504
driven_any_median0.4447815158042768
driven_any_min0.3341398229437414
driven_lanedir_consec_max1.0434182104988623
driven_lanedir_consec_mean0.5573910485118122
driven_lanedir_consec_min0.3284215252184426
driven_lanedir_max1.0434182104988623
driven_lanedir_mean0.5573910485118122
driven_lanedir_median0.4108623025159917
driven_lanedir_min0.3284215252184426
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.1399999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4447815158042768, "sim_physics": 0.14357539740475742, "survival_time": 2.2, "driven_lanedir": 0.4108623025159917, "sim_render-ego": 0.06835265593095259, "in-drivable-lane": 0, "agent_compute-ego": 0.1161846626888622, "deviation-heading": 0.7063746991018894, "set_robot_commands": 0.1107547554102811, "deviation-center-line": 0.15953890453813732, "driven_lanedir_consec": 0.4108623025159917, "sim_compute_sim_state": 0.042578009041872894, "sim_compute_performance-ego": 0.0821873437274586, "sim_compute_robot_state-ego": 0.08426532962105492}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8844282098528133, "sim_physics": 0.12575247016134142, "survival_time": 3.949999999999994, "driven_lanedir": 0.6753190495150517, "sim_render-ego": 0.06606724896008455, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1007549702366696, "deviation-heading": 1.1188262946563077, "set_robot_commands": 0.1018355949015557, "deviation-center-line": 0.24669666461457568, "driven_lanedir_consec": 0.6753190495150517, "sim_compute_sim_state": 0.040934843353078336, "sim_compute_performance-ego": 0.0750313076791884, "sim_compute_robot_state-ego": 0.07969949215273314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3341398229437414, "sim_physics": 0.121652554063236, "survival_time": 1.7000000000000008, "driven_lanedir": 0.328934154810713, "sim_render-ego": 0.06535426308127011, "in-drivable-lane": 0, "agent_compute-ego": 0.09789851132561178, "deviation-heading": 0.3145163536332646, "set_robot_commands": 0.09681362965527704, "deviation-center-line": 0.17608683739206069, "driven_lanedir_consec": 0.328934154810713, "sim_compute_sim_state": 0.04149777749005486, "sim_compute_performance-ego": 0.0757823341033038, "sim_compute_robot_state-ego": 0.07920744839836569}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3585918850867666, "sim_physics": 0.1465895242161221, "survival_time": 1.800000000000001, "driven_lanedir": 0.3284215252184426, "sim_render-ego": 0.07163292169570923, "in-drivable-lane": 0, "agent_compute-ego": 0.10513032807244196, "deviation-heading": 0.7074316092927606, "set_robot_commands": 0.1057207120789422, "deviation-center-line": 0.1230563934255246, "driven_lanedir_consec": 0.3284215252184426, "sim_compute_sim_state": 0.04634696907467312, "sim_compute_performance-ego": 0.07658784919314915, "sim_compute_robot_state-ego": 0.08306401305728489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1657013383876025, "sim_physics": 0.1416974792293474, "survival_time": 5.09999999999999, "driven_lanedir": 1.0434182104988623, "sim_render-ego": 0.06556390079797483, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.11301654460383397, "deviation-heading": 1.353610693525513, "set_robot_commands": 0.1080380491181916, "deviation-center-line": 0.553006586721707, "driven_lanedir_consec": 1.0434182104988623, "sim_compute_sim_state": 0.04353268240012374, "sim_compute_performance-ego": 0.07612160140392828, "sim_compute_robot_state-ego": 0.0833505345325844}}
set_robot_commands_max0.1107547554102811
set_robot_commands_mean0.10463254823284954
set_robot_commands_median0.1057207120789422
set_robot_commands_min0.09681362965527704
sim_compute_performance-ego_max0.0821873437274586
sim_compute_performance-ego_mean0.07714208722140564
sim_compute_performance-ego_median0.07612160140392828
sim_compute_performance-ego_min0.0750313076791884
sim_compute_robot_state-ego_max0.08426532962105492
sim_compute_robot_state-ego_mean0.08191736355240462
sim_compute_robot_state-ego_median0.08306401305728489
sim_compute_robot_state-ego_min0.07920744839836569
sim_compute_sim_state_max0.04634696907467312
sim_compute_sim_state_mean0.042978056271960594
sim_compute_sim_state_median0.042578009041872894
sim_compute_sim_state_min0.040934843353078336
sim_physics_max0.1465895242161221
sim_physics_mean0.13585348501496086
sim_physics_median0.1416974792293474
sim_physics_min0.121652554063236
sim_render-ego_max0.07163292169570923
sim_render-ego_mean0.06739419809319827
sim_render-ego_median0.06606724896008455
sim_render-ego_min0.06535426308127011
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.949999999999997
survival_time_min1.7000000000000008
224253312awoo424Roasted duckaido2-LF-sim-validationstep1-simulationsuccessyes11690:16:34(hidden)
driven_lanedir_consec_median0.3496541027899869
survival_time_median5.299999999999989
deviation-center-line_median0.29817832962587804
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.2677252552726052
agent_compute-ego_mean0.22035048683258687
agent_compute-ego_median0.2103179175898714
agent_compute-ego_min0.18094515582742213
deviation-center-line_max0.8910330182524215
deviation-center-line_mean0.4264780459482808
deviation-center-line_min0.28077402334016544
deviation-heading_max2.0821930316740573
deviation-heading_mean1.7659753763307156
deviation-heading_median1.8813395939057316
deviation-heading_min1.0820895466826623
driven_any_max1.1012533152257715
driven_any_mean0.5689374927274462
driven_any_median0.39804664955665897
driven_any_min0.1893884857933168
driven_lanedir_consec_max1.0649032250946142
driven_lanedir_consec_mean0.5019902993930894
driven_lanedir_consec_min0.1722477218334686
driven_lanedir_max1.0649032250946142
driven_lanedir_mean0.5019902993930894
driven_lanedir_median0.3496541027899869
driven_lanedir_min0.1722477218334686
in-drivable-lane_max1.7500000000000249
in-drivable-lane_mean0.4700000000000054
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1012533152257715, "sim_physics": 0.09658172845840454, "survival_time": 14.950000000000076, "driven_lanedir": 1.0649032250946142, "sim_render-ego": 0.05737500429153442, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.18985747098922728, "deviation-heading": 2.0821930316740573, "set_robot_commands": 0.0832806921005249, "deviation-center-line": 0.8910330182524215, "driven_lanedir_consec": 1.0649032250946142, "sim_compute_sim_state": 0.03434476534525553, "sim_compute_performance-ego": 0.060694024562835694, "sim_compute_robot_state-ego": 0.0643535057703654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8532875463606754, "sim_physics": 0.08834603496882469, "survival_time": 10.95000000000002, "driven_lanedir": 0.6785838987704491, "sim_render-ego": 0.05195739280143285, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.18094515582742213, "deviation-heading": 1.8813395939057316, "set_robot_commands": 0.08122290541592254, "deviation-center-line": 0.3717255384421089, "driven_lanedir_consec": 0.6785838987704491, "sim_compute_sim_state": 0.034273477449809034, "sim_compute_performance-ego": 0.0581164784627418, "sim_compute_robot_state-ego": 0.06008780492495184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1893884857933168, "sim_physics": 0.1053327343680642, "survival_time": 2.7499999999999982, "driven_lanedir": 0.1722477218334686, "sim_render-ego": 0.057742977142333986, "in-drivable-lane": 0, "agent_compute-ego": 0.2677252552726052, "deviation-heading": 1.0820895466826623, "set_robot_commands": 0.0925160451368852, "deviation-center-line": 0.29817832962587804, "driven_lanedir_consec": 0.1722477218334686, "sim_compute_sim_state": 0.03598507967862216, "sim_compute_performance-ego": 0.06122544462030584, "sim_compute_robot_state-ego": 0.06192522482438521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.302711466700808, "sim_physics": 0.08022321006398142, "survival_time": 4.049999999999994, "driven_lanedir": 0.2445625484769285, "sim_render-ego": 0.06316284191461256, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.25290663448380835, "deviation-heading": 1.9969904799270992, "set_robot_commands": 0.06967232551103757, "deviation-center-line": 0.28077402334016544, "driven_lanedir_consec": 0.2445625484769285, "sim_compute_sim_state": 0.04143663394598313, "sim_compute_performance-ego": 0.065232147405177, "sim_compute_robot_state-ego": 0.05850335992412803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39804664955665897, "sim_physics": 0.11368137710499314, "survival_time": 5.299999999999989, "driven_lanedir": 0.3496541027899869, "sim_render-ego": 0.05758777429472725, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2103179175898714, "deviation-heading": 1.7872642294640269, "set_robot_commands": 0.09248955519694202, "deviation-center-line": 0.29067932008082964, "driven_lanedir_consec": 0.3496541027899869, "sim_compute_sim_state": 0.03839026082236812, "sim_compute_performance-ego": 0.06169818707232205, "sim_compute_robot_state-ego": 0.06745851264809663}}
set_robot_commands_max0.0925160451368852
set_robot_commands_mean0.08383630467226245
set_robot_commands_median0.0832806921005249
set_robot_commands_min0.06967232551103757
sim_compute_performance-ego_max0.065232147405177
sim_compute_performance-ego_mean0.06139325642467648
sim_compute_performance-ego_median0.06122544462030584
sim_compute_performance-ego_min0.0581164784627418
sim_compute_robot_state-ego_max0.06745851264809663
sim_compute_robot_state-ego_mean0.062465681618385414
sim_compute_robot_state-ego_median0.06192522482438521
sim_compute_robot_state-ego_min0.05850335992412803
sim_compute_sim_state_max0.04143663394598313
sim_compute_sim_state_mean0.0368860434484076
sim_compute_sim_state_median0.03598507967862216
sim_compute_sim_state_min0.034273477449809034
sim_physics_max0.11368137710499314
sim_physics_mean0.0968330169928536
sim_physics_median0.09658172845840454
sim_physics_min0.08022321006398142
sim_render-ego_max0.06316284191461256
sim_render-ego_mean0.05756519808892822
sim_render-ego_median0.05758777429472725
sim_render-ego_min0.05195739280143285
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.600000000000016
survival_time_min2.7499999999999982
224193319jp18813100494RL - TH - shiaido2-LF-sim-validationstep1-simulationerroryes11690:01:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224053330JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11690:20:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223903342JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:35:36(hidden)
driven_lanedir_consec_median2.6061195165241595
survival_time_median14.950000000000076
deviation-center-line_median0.9158554167971322
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.3332826638221741
agent_compute-ego_mean0.3065102955500285
agent_compute-ego_median0.3126683608690898
agent_compute-ego_min0.2709287230173747
deviation-center-line_max1.3900540864280544
deviation-center-line_mean1.0478876261231291
deviation-center-line_min0.8170491003396274
deviation-heading_max3.2814669740520683
deviation-heading_mean2.280953131159643
deviation-heading_median2.235364113960447
deviation-heading_min1.2850574087601645
driven_any_max2.878026120260703
driven_any_mean2.713939627368959
driven_any_median2.667858048351088
driven_any_min2.5107444223692195
driven_lanedir_consec_max2.7234767923157013
driven_lanedir_consec_mean2.5578402399429794
driven_lanedir_consec_min2.26727702033328
driven_lanedir_max2.7234767923157013
driven_lanedir_mean2.5578402399429794
driven_lanedir_median2.6061195165241595
driven_lanedir_min2.26727702033328
in-drivable-lane_max2.150000000000002
in-drivable-lane_mean0.8000000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5107444223692195, "sim_physics": 0.15085184176762895, "survival_time": 14.950000000000076, "driven_lanedir": 2.26727702033328, "sim_render-ego": 0.07198540846506754, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.2709287230173747, "deviation-heading": 3.2814669740520683, "set_robot_commands": 0.12256356239318848, "deviation-center-line": 0.8170491003396274, "driven_lanedir_consec": 2.26727702033328, "sim_compute_sim_state": 0.046000825564066566, "sim_compute_performance-ego": 0.07941846927007039, "sim_compute_robot_state-ego": 0.09270612637201946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8519477342001416, "sim_physics": 0.15287224610646566, "survival_time": 14.950000000000076, "driven_lanedir": 2.7234767923157013, "sim_render-ego": 0.07266729990641276, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.3332826638221741, "deviation-heading": 2.139728816373815, "set_robot_commands": 0.12005263408025106, "deviation-center-line": 1.3900540864280544, "driven_lanedir_consec": 2.7234767923157013, "sim_compute_sim_state": 0.0458188247680664, "sim_compute_performance-ego": 0.08290475447972616, "sim_compute_robot_state-ego": 0.0951720635096232}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.878026120260703, "sim_physics": 0.13622482776641845, "survival_time": 14.950000000000076, "driven_lanedir": 2.5775981565066965, "sim_render-ego": 0.07277334849039714, "in-drivable-lane": 2.150000000000002, "agent_compute-ego": 0.3126683608690898, "deviation-heading": 1.2850574087601645, "set_robot_commands": 0.11943259477615356, "deviation-center-line": 1.2397826767779554, "driven_lanedir_consec": 2.5775981565066965, "sim_compute_sim_state": 0.04607876062393188, "sim_compute_performance-ego": 0.08166768789291382, "sim_compute_robot_state-ego": 0.0933917530377706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.667858048351088, "sim_physics": 0.1460714817047119, "survival_time": 14.950000000000076, "driven_lanedir": 2.61472971403506, "sim_render-ego": 0.07214704672495524, "in-drivable-lane": 0, "agent_compute-ego": 0.2984927678108215, "deviation-heading": 2.4631483426517207, "set_robot_commands": 0.11639736175537108, "deviation-center-line": 0.876696850272876, "driven_lanedir_consec": 2.61472971403506, "sim_compute_sim_state": 0.045822412967681886, "sim_compute_performance-ego": 0.08229336659113566, "sim_compute_robot_state-ego": 0.0901212708155314}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6611218116636426, "sim_physics": 0.14282263278961185, "survival_time": 14.950000000000076, "driven_lanedir": 2.6061195165241595, "sim_render-ego": 0.07049689054489136, "in-drivable-lane": 0, "agent_compute-ego": 0.31717896223068237, "deviation-heading": 2.235364113960447, "set_robot_commands": 0.1152267034848531, "deviation-center-line": 0.9158554167971322, "driven_lanedir_consec": 2.6061195165241595, "sim_compute_sim_state": 0.046239012082417805, "sim_compute_performance-ego": 0.08189732869466146, "sim_compute_robot_state-ego": 0.08969166278839111}}
set_robot_commands_max0.12256356239318848
set_robot_commands_mean0.11873457129796346
set_robot_commands_median0.11943259477615356
set_robot_commands_min0.1152267034848531
sim_compute_performance-ego_max0.08290475447972616
sim_compute_performance-ego_mean0.0816363213857015
sim_compute_performance-ego_median0.08189732869466146
sim_compute_performance-ego_min0.07941846927007039
sim_compute_robot_state-ego_max0.0951720635096232
sim_compute_robot_state-ego_mean0.09221657530466716
sim_compute_robot_state-ego_median0.09270612637201946
sim_compute_robot_state-ego_min0.08969166278839111
sim_compute_sim_state_max0.046239012082417805
sim_compute_sim_state_mean0.04599196720123291
sim_compute_sim_state_median0.046000825564066566
sim_compute_sim_state_min0.0458188247680664
sim_physics_max0.15287224610646566
sim_physics_mean0.14576860602696734
sim_physics_median0.1460714817047119
sim_physics_min0.13622482776641845
sim_render-ego_max0.07277334849039714
sim_render-ego_mean0.07201399882634481
sim_render-ego_median0.07214704672495524
sim_render-ego_min0.07049689054489136
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
223863344JBRRussiaJetBrains Researchaido2-LFV-sim-validationstep1-simulationerroryes11690:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
223823347JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationerroryes11690:05:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223743363AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11690:16:35(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17625309983078313
agent_compute-ego_mean0.15459522755965524
agent_compute-ego_median0.15913964252845914
agent_compute-ego_min0.11782347679138185
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10983236630757648, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059388447690893104, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14248813081670691, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08965456485748291, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037076989809672035, "sim_compute_performance-ego": 0.06754017759252477, "sim_compute_robot_state-ego": 0.07998771137661403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10508386761534448, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.059158442067165, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1466529416102989, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09053615027782964, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03900088048448749, "sim_compute_performance-ego": 0.06624575222239774, "sim_compute_robot_state-ego": 0.07221005944644704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08880361388711368, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0493316650390625, "in-drivable-lane": 0, "agent_compute-ego": 0.1291334208320169, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07567940038793228, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03082150571486529, "sim_compute_performance-ego": 0.06274975047392004, "sim_compute_robot_state-ego": 0.06573097846087288}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07724232673645019, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.048953218460083006, "in-drivable-lane": 0, "agent_compute-ego": 0.11782347679138185, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08277896881103515, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.029877471923828124, "sim_compute_performance-ego": 0.05374107360839843, "sim_compute_robot_state-ego": 0.05405324935913086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10078196284137196, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0524642799474016, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13160768038109888, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08093705961975871, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.033087911485116694, "sim_compute_performance-ego": 0.05503167985360834, "sim_compute_robot_state-ego": 0.06110450587695158}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1323069747613401, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.08080041651823083, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.17625309983078313, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10486830497274592, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04270637278654137, "sim_compute_performance-ego": 0.07426549950424506, "sim_compute_robot_state-ego": 0.0872695591984963}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12183875271252224, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0678783016545432, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1536087989807129, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08759051987103053, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.09751888683864048, "sim_compute_performance-ego": 0.08345099432127816, "sim_compute_robot_state-ego": 0.07750268919127327}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14024296261015393, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06504759334382557, "in-drivable-lane": 0, "agent_compute-ego": 0.15718892642429896, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10432834852309454, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04183324178059896, "sim_compute_performance-ego": 0.07316789172944568, "sim_compute_robot_state-ego": 0.08615052132379442}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13296533439118982, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0676324286703336, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16495981458890235, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10585327875816215, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04138175107664981, "sim_compute_performance-ego": 0.0708601111072605, "sim_compute_robot_state-ego": 0.07635310948905298}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12120715921575372, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06971504471518776, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1628161083568226, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10491611740805884, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04113696705211293, "sim_compute_performance-ego": 0.07315218665383079, "sim_compute_robot_state-ego": 0.0805058089169589}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.1356029293753884, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06802021683036506, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17218447660470937, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.112020443012188, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04333586197394829, "sim_compute_performance-ego": 0.08476135637853052, "sim_compute_robot_state-ego": 0.08814864344411082}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15191222088677542, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.07176744086401803, "in-drivable-lane": 0, "agent_compute-ego": 0.17163033144814627, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10452603442328316, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0447989957673209, "sim_compute_performance-ego": 0.08191582134791783, "sim_compute_robot_state-ego": 0.09024468490055627}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11540967810387703, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06473155115164962, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15913964252845914, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0994402333801868, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04328115313660865, "sim_compute_performance-ego": 0.06938658508599974, "sim_compute_robot_state-ego": 0.07348286404329188}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12501410201743798, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0639389091067844, "in-drivable-lane": 0, "agent_compute-ego": 0.16648387025903771, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10176829938535337, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04093382093641493, "sim_compute_performance-ego": 0.06913186885692456, "sim_compute_robot_state-ego": 0.07721867384733977}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12180633872163062, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06943307203405044, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16695769394145293, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.104967851264804, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04252606513453465, "sim_compute_performance-ego": 0.07723571973688462, "sim_compute_robot_state-ego": 0.08720116054310519}}
set_robot_commands_max0.112020443012188
set_robot_commands_mean0.09665770499686306
set_robot_commands_median0.10176829938535337
set_robot_commands_min0.07567940038793228
sim_compute_performance-ego_max0.08476135637853052
sim_compute_performance-ego_mean0.07084243123154448
sim_compute_performance-ego_median0.0708601111072605
sim_compute_performance-ego_min0.05374107360839843
sim_compute_robot_state-ego_max0.09024468490055627
sim_compute_robot_state-ego_mean0.07714428129453307
sim_compute_robot_state-ego_median0.07750268919127327
sim_compute_robot_state-ego_min0.05405324935913086
sim_compute_sim_state_max0.09751888683864048
sim_compute_sim_state_mean0.04328785839342271
sim_compute_sim_state_median0.04138175107664981
sim_compute_sim_state_min0.029877471923828124
sim_physics_max0.15191222088677542
sim_physics_mean0.11867003934559509
sim_physics_median0.12180633872163062
sim_physics_min0.07724232673645019
sim_render-ego_max0.08080041651823083
sim_render-ego_mean0.06388406853957292
sim_render-ego_median0.06504759334382557
sim_render-ego_min0.048953218460083006
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
223573386jp18813100494RL-TH-shiaido2-LFVI-sim-validationstep1-simulationsuccessyes11690:36:49(hidden)
driven_lanedir_consec_median3.0961941803608934
survival_time_median14.950000000000076
deviation-center-line_median0.9555568126403592
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17341103792190551
agent_compute-ego_mean0.16679463847478232
agent_compute-ego_median0.16866087039311728
agent_compute-ego_min0.15788953145345053
deviation-center-line_max1.2876072210642098
deviation-center-line_mean0.8275123667626163
deviation-center-line_min0.4165220148816433
deviation-heading_max16.99759519832536
deviation-heading_mean6.125951093256273
deviation-heading_median3.163097478713258
deviation-heading_min1.8789318174933505
driven_any_max3.9707506625282454
driven_any_mean2.750455990614764
driven_any_median3.166379558689082
driven_any_min0.1357204919218267
driven_lanedir_consec_max3.9062146074302166
driven_lanedir_consec_mean2.556285663248601
driven_lanedir_consec_min0.12068109296077888
driven_lanedir_max3.9062146074302166
driven_lanedir_mean2.6884372731658495
driven_lanedir_median3.0963689487710204
driven_lanedir_min0.12068109296077888
in-drivable-lane_max4.25000000000006
in-drivable-lane_mean0.8900000000000127
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.630389718202428, "sim_physics": 0.17873452186584474, "survival_time": 14.950000000000076, "driven_lanedir": 2.5423281923934073, "sim_render-ego": 0.055167959531148274, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.15788953145345053, "deviation-heading": 5.632204681719905, "set_robot_commands": 0.08382343133290608, "deviation-center-line": 0.9555568126403592, "driven_lanedir_consec": 2.3094997466357805, "sim_compute_sim_state": 0.035568127632141115, "sim_compute_performance-ego": 0.06035219351450602, "sim_compute_robot_state-ego": 0.0652646787961324, "sim_compute_robot_state-npc0": 0.06238325675328573, "sim_compute_robot_state-npc1": 0.062117741107940674, "sim_compute_robot_state-npc2": 0.06113009611765544, "sim_compute_robot_state-npc3": 0.06056814750035604}, "udem1-1-0": {"driven_any": 0.1357204919218267, "sim_physics": 0.2028897205988566, "survival_time": 14.950000000000076, "driven_lanedir": 0.12068109296077888, "sim_render-ego": 0.061084957122802735, "in-drivable-lane": 0, "agent_compute-ego": 0.1722736994425456, "deviation-heading": 16.99759519832536, "set_robot_commands": 0.08945998986562093, "deviation-center-line": 0.4165220148816433, "driven_lanedir_consec": 0.12068109296077888, "sim_compute_sim_state": 0.036806494394938154, "sim_compute_performance-ego": 0.06343329826990764, "sim_compute_robot_state-ego": 0.06873017152150472, "sim_compute_robot_state-npc0": 0.06524298906326294, "sim_compute_robot_state-npc1": 0.06480679035186768, "sim_compute_robot_state-npc2": 0.06442842245101929, "sim_compute_robot_state-npc3": 0.06496115287144978}, "udem1-2-0": {"driven_any": 3.849039521732238, "sim_physics": 0.1942102289199829, "survival_time": 14.950000000000076, "driven_lanedir": 3.776593524273823, "sim_render-ego": 0.06043704350789388, "in-drivable-lane": 0, "agent_compute-ego": 0.17341103792190551, "deviation-heading": 3.163097478713258, "set_robot_commands": 0.09244399070739746, "deviation-center-line": 1.2876072210642098, "driven_lanedir_consec": 3.348838688855335, "sim_compute_sim_state": 0.036699516773223875, "sim_compute_performance-ego": 0.06569170951843262, "sim_compute_robot_state-ego": 0.07259090026219686, "sim_compute_robot_state-npc0": 0.06773422718048096, "sim_compute_robot_state-npc1": 0.06733093659083049, "sim_compute_robot_state-npc2": 0.06589390595753987, "sim_compute_robot_state-npc3": 0.06584122737248739}, "udem1-3-0": {"driven_any": 3.9707506625282454, "sim_physics": 0.1954219388961792, "survival_time": 14.950000000000076, "driven_lanedir": 3.9062146074302166, "sim_render-ego": 0.0598202363650004, "in-drivable-lane": 0, "agent_compute-ego": 0.16866087039311728, "deviation-heading": 2.95792629002949, "set_robot_commands": 0.09247800906499228, "deviation-center-line": 1.0349443222002073, "driven_lanedir_consec": 3.9062146074302166, "sim_compute_sim_state": 0.03599563121795654, "sim_compute_performance-ego": 0.06641101757685343, "sim_compute_robot_state-ego": 0.07093421300252278, "sim_compute_robot_state-npc0": 0.06557390213012695, "sim_compute_robot_state-npc1": 0.06434804677963257, "sim_compute_robot_state-npc2": 0.06417282660802205, "sim_compute_robot_state-npc3": 0.06414253870646158}, "udem1-4-0": {"driven_any": 3.166379558689082, "sim_physics": 0.17110615412394206, "survival_time": 14.950000000000076, "driven_lanedir": 3.0963689487710204, "sim_render-ego": 0.05771746953328451, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.16173805316289266, "deviation-heading": 1.8789318174933505, "set_robot_commands": 0.09154293696085612, "deviation-center-line": 0.4429314630266619, "driven_lanedir_consec": 3.0961941803608934, "sim_compute_sim_state": 0.035366469224294025, "sim_compute_performance-ego": 0.06258252302805582, "sim_compute_robot_state-ego": 0.06580291191736858, "sim_compute_robot_state-npc0": 0.06336495796839396, "sim_compute_robot_state-npc1": 0.06352715333302816, "sim_compute_robot_state-npc2": 0.061151315371195475, "sim_compute_robot_state-npc3": 0.06241880178451538}}
set_robot_commands_max0.09247800906499228
set_robot_commands_mean0.08994967158635457
set_robot_commands_median0.09154293696085612
set_robot_commands_min0.08382343133290608
sim_compute_performance-ego_max0.06641101757685343
sim_compute_performance-ego_mean0.0636941483815511
sim_compute_performance-ego_median0.06343329826990764
sim_compute_performance-ego_min0.06035219351450602
sim_compute_robot_state-ego_max0.07259090026219686
sim_compute_robot_state-ego_mean0.06866457509994507
sim_compute_robot_state-ego_median0.06873017152150472
sim_compute_robot_state-ego_min0.0652646787961324
sim_compute_robot_state-npc0_max0.06773422718048096
sim_compute_robot_state-npc0_mean0.06485986661911011
sim_compute_robot_state-npc0_median0.06524298906326294
sim_compute_robot_state-npc0_min0.06238325675328573
sim_compute_robot_state-npc1_max0.06733093659083049
sim_compute_robot_state-npc1_mean0.06442613363265992
sim_compute_robot_state-npc1_median0.06434804677963257
sim_compute_robot_state-npc1_min0.062117741107940674
sim_compute_robot_state-npc2_max0.06589390595753987
sim_compute_robot_state-npc2_mean0.06335531330108642
sim_compute_robot_state-npc2_median0.06417282660802205
sim_compute_robot_state-npc2_min0.06113009611765544
sim_compute_robot_state-npc3_max0.06584122737248739
sim_compute_robot_state-npc3_mean0.06358637364705402
sim_compute_robot_state-npc3_median0.06414253870646158
sim_compute_robot_state-npc3_min0.06056814750035604
sim_compute_sim_state_max0.036806494394938154
sim_compute_sim_state_mean0.03608724784851074
sim_compute_sim_state_median0.03599563121795654
sim_compute_sim_state_min0.035366469224294025
sim_physics_max0.2028897205988566
sim_physics_mean0.1884725128809611
sim_physics_median0.1942102289199829
sim_physics_min0.17110615412394206
sim_render-ego_max0.061084957122802735
sim_render-ego_mean0.05884553321202596
sim_render-ego_median0.0598202363650004
sim_render-ego_min0.055167959531148274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
223423397jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11690:56:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223393399jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11690:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223293409jp18813100494RL - TH -hhkaido2-LFV-sim-testingstep1-simulationerroryes11690:17:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223273411jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223203417jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationsuccessyes11690:12:01(hidden)
driven_lanedir_consec_median1.1990896621369949
survival_time_median8.549999999999986
deviation-center-line_median0.27984287863563906
in-drivable-lane_median1.1999999999999955


other stats
agent_compute-ego_max0.1624285991375263
agent_compute-ego_mean0.15493356553984156
agent_compute-ego_median0.15610548885919714
agent_compute-ego_min0.14761669454518814
deviation-center-line_max0.5867373025751078
deviation-center-line_mean0.329920399140803
deviation-center-line_min0.18228241241353563
deviation-heading_max1.4726043676634242
deviation-heading_mean1.1330413833210462
deviation-heading_median1.0470324603828471
deviation-heading_min0.8392455185368155
driven_any_max1.9784423091100856
driven_any_mean1.4691073891236293
driven_any_median1.611422185622498
driven_any_min0.5427627763159826
driven_lanedir_consec_max1.4342644357938217
driven_lanedir_consec_mean1.0156611891593452
driven_lanedir_consec_min0.5028995304197132
driven_lanedir_max1.4342644357938217
driven_lanedir_mean1.0156611891593452
driven_lanedir_median1.1990896621369949
driven_lanedir_min0.5028995304197132
in-drivable-lane_max4.949999999999991
in-drivable-lane_mean1.880000000000002
in-drivable-lane_min0.09999999999999964
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9784423091100856, "sim_physics": 0.09543951213011267, "survival_time": 8.549999999999986, "driven_lanedir": 0.731133519841413, "sim_render-ego": 0.05136656621743363, "in-drivable-lane": 4.949999999999991, "agent_compute-ego": 0.14761669454518814, "deviation-heading": 1.3078445591894818, "set_robot_commands": 0.08489760320786147, "deviation-center-line": 0.20443047512808832, "driven_lanedir_consec": 0.731133519841413, "sim_compute_sim_state": 0.03352126043442397, "sim_compute_performance-ego": 0.05846241761369315, "sim_compute_robot_state-ego": 0.062159041912235015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5427627763159826, "sim_physics": 0.10609556344839242, "survival_time": 3.2499999999999964, "driven_lanedir": 0.5028995304197132, "sim_render-ego": 0.064739440037654, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1624285991375263, "deviation-heading": 0.8392455185368155, "set_robot_commands": 0.08852981053865873, "deviation-center-line": 0.18228241241353563, "driven_lanedir_consec": 0.5028995304197132, "sim_compute_sim_state": 0.03605962900015024, "sim_compute_performance-ego": 0.0631716801570012, "sim_compute_robot_state-ego": 0.0710330266218919}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6004115710229994, "sim_physics": 0.095704436983381, "survival_time": 8.74999999999999, "driven_lanedir": 1.4342644357938217, "sim_render-ego": 0.05364257676260812, "in-drivable-lane": 0.9500000000000092, "agent_compute-ego": 0.14961215700422015, "deviation-heading": 1.0470324603828471, "set_robot_commands": 0.08118879863194058, "deviation-center-line": 0.5867373025751078, "driven_lanedir_consec": 1.4342644357938217, "sim_compute_sim_state": 0.03518272399902344, "sim_compute_performance-ego": 0.0597028078351702, "sim_compute_robot_state-ego": 0.062009216036115374}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.611422185622498, "sim_physics": 0.09981834247548094, "survival_time": 9.299999999999995, "driven_lanedir": 1.210918797604784, "sim_render-ego": 0.05737256234691989, "in-drivable-lane": 2.2000000000000144, "agent_compute-ego": 0.15610548885919714, "deviation-heading": 1.4726043676634242, "set_robot_commands": 0.08433630389551963, "deviation-center-line": 0.3963089269516444, "driven_lanedir_consec": 1.210918797604784, "sim_compute_sim_state": 0.0362281709588984, "sim_compute_performance-ego": 0.062062096852128226, "sim_compute_robot_state-ego": 0.06656066961185907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6124981035465813, "sim_physics": 0.10289881706237793, "survival_time": 6.249999999999986, "driven_lanedir": 1.1990896621369949, "sim_render-ego": 0.05704084396362305, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.15890488815307618, "deviation-heading": 0.9984800108326628, "set_robot_commands": 0.08485345077514649, "deviation-center-line": 0.27984287863563906, "driven_lanedir_consec": 1.1990896621369949, "sim_compute_sim_state": 0.03516554641723633, "sim_compute_performance-ego": 0.06255588150024415, "sim_compute_robot_state-ego": 0.06437260437011719}}
set_robot_commands_max0.08852981053865873
set_robot_commands_mean0.08476119340982538
set_robot_commands_median0.08485345077514649
set_robot_commands_min0.08118879863194058
sim_compute_performance-ego_max0.0631716801570012
sim_compute_performance-ego_mean0.06119097679164739
sim_compute_performance-ego_median0.062062096852128226
sim_compute_performance-ego_min0.05846241761369315
sim_compute_robot_state-ego_max0.0710330266218919
sim_compute_robot_state-ego_mean0.0652269117104437
sim_compute_robot_state-ego_median0.06437260437011719
sim_compute_robot_state-ego_min0.062009216036115374
sim_compute_sim_state_max0.0362281709588984
sim_compute_sim_state_mean0.03523146616194648
sim_compute_sim_state_median0.03518272399902344
sim_compute_sim_state_min0.03352126043442397
sim_physics_max0.10609556344839242
sim_physics_mean0.09999133441994898
sim_physics_median0.09981834247548094
sim_physics_min0.09543951213011267
sim_render-ego_max0.064739440037654
sim_render-ego_mean0.056832397865647734
sim_render-ego_median0.05704084396362305
sim_render-ego_min0.05136656621743363
simulation-passed1
survival_time_max9.299999999999995
survival_time_mean7.21999999999999
survival_time_min3.2499999999999964
223113425jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11690:29:15(hidden)
driven_lanedir_consec_median2.4789233115106395
survival_time_median14.950000000000076
deviation-center-line_median0.8146285309217326
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1705783176422119
agent_compute-ego_mean0.16478800010681152
agent_compute-ego_median0.16434234937032063
agent_compute-ego_min0.15866530338923138
deviation-center-line_max1.2012396017870604
deviation-center-line_mean0.7501260074558616
deviation-center-line_min0.09089593761882547
deviation-heading_max6.751529529551556
deviation-heading_mean3.400992125160336
deviation-heading_median3.427825313648924
deviation-heading_min0.5354470537706654
driven_any_max3.0602502735561883
driven_any_mean2.3595528287629848
driven_any_median2.747648771459853
driven_any_min0.3817472176788552
driven_lanedir_consec_max3.0094047492365696
driven_lanedir_consec_mean2.1861404317235182
driven_lanedir_consec_min0.3169746578615049
driven_lanedir_max3.0094047492365696
driven_lanedir_mean2.1861404317235182
driven_lanedir_median2.4789233115106395
driven_lanedir_min0.3169746578615049
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.24999999999999917
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5549718370774266, "sim_physics": 0.1532482536633809, "survival_time": 14.950000000000076, "driven_lanedir": 2.4789233115106395, "sim_render-ego": 0.057849442958831786, "in-drivable-lane": 0, "agent_compute-ego": 0.15866530338923138, "deviation-heading": 3.764395459495874, "set_robot_commands": 0.09113444010416669, "deviation-center-line": 0.915717854733624, "driven_lanedir_consec": 2.4789233115106395, "sim_compute_sim_state": 0.035156273047129316, "sim_compute_performance-ego": 0.0603924838701884, "sim_compute_robot_state-ego": 0.06471064408620199, "sim_compute_robot_state-npc0": 0.06319768269856771, "sim_compute_robot_state-npc1": 0.06814368565877278, "sim_compute_robot_state-npc2": 0.06147315343221029, "sim_compute_robot_state-npc3": 0.06128411134084066}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3817472176788552, "sim_physics": 0.1742067813873291, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3169746578615049, "sim_render-ego": 0.05756244659423828, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1705783176422119, "deviation-heading": 0.5354470537706654, "set_robot_commands": 0.09034584999084472, "deviation-center-line": 0.09089593761882547, "driven_lanedir_consec": 0.3169746578615049, "sim_compute_sim_state": 0.041628999710083006, "sim_compute_performance-ego": 0.06301189422607421, "sim_compute_robot_state-ego": 0.06833938598632812, "sim_compute_robot_state-npc0": 0.0647934627532959, "sim_compute_robot_state-npc1": 0.06505700111389161, "sim_compute_robot_state-npc2": 0.06329429626464844, "sim_compute_robot_state-npc3": 0.06462483406066895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.053146044042598, "sim_physics": 0.1655573852856954, "survival_time": 14.950000000000076, "driven_lanedir": 2.9731439422185693, "sim_render-ego": 0.05644808689753215, "in-drivable-lane": 0, "agent_compute-ego": 0.16434234937032063, "deviation-heading": 3.427825313648924, "set_robot_commands": 0.09247412919998169, "deviation-center-line": 0.8146285309217326, "driven_lanedir_consec": 2.9731439422185693, "sim_compute_sim_state": 0.036865094502766926, "sim_compute_performance-ego": 0.06655084292093913, "sim_compute_robot_state-ego": 0.06864944775899251, "sim_compute_robot_state-npc0": 0.06681225220362345, "sim_compute_robot_state-npc1": 0.06554112911224365, "sim_compute_robot_state-npc2": 0.06293324947357178, "sim_compute_robot_state-npc3": 0.06550121068954468}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0602502735561883, "sim_physics": 0.1594786524772644, "survival_time": 14.950000000000076, "driven_lanedir": 3.0094047492365696, "sim_render-ego": 0.058335607846577965, "in-drivable-lane": 0, "agent_compute-ego": 0.16205903132756552, "deviation-heading": 2.5257632693346603, "set_robot_commands": 0.09020399808883668, "deviation-center-line": 0.7281481122180655, "driven_lanedir_consec": 3.0094047492365696, "sim_compute_sim_state": 0.037278894583384195, "sim_compute_performance-ego": 0.06412381649017335, "sim_compute_robot_state-ego": 0.06947394847869873, "sim_compute_robot_state-npc0": 0.06753857533137003, "sim_compute_robot_state-npc1": 0.06515476226806641, "sim_compute_robot_state-npc2": 0.06511690457661946, "sim_compute_robot_state-npc3": 0.06483456214269002}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.747648771459853, "sim_physics": 0.15322364966074625, "survival_time": 14.950000000000076, "driven_lanedir": 2.1522554977903083, "sim_render-ego": 0.058053767681121825, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.1682949988047282, "deviation-heading": 6.751529529551556, "set_robot_commands": 0.08714262088139851, "deviation-center-line": 1.2012396017870604, "driven_lanedir_consec": 2.1522554977903083, "sim_compute_sim_state": 0.03667447566986084, "sim_compute_performance-ego": 0.06472389777501424, "sim_compute_robot_state-ego": 0.06963449875513712, "sim_compute_robot_state-npc0": 0.06588028748830159, "sim_compute_robot_state-npc1": 0.06497968196868896, "sim_compute_robot_state-npc2": 0.06372095425923666, "sim_compute_robot_state-npc3": 0.06542930761973063}}
set_robot_commands_max0.09247412919998169
set_robot_commands_mean0.09026020765304564
set_robot_commands_median0.09034584999084472
set_robot_commands_min0.08714262088139851
sim_compute_performance-ego_max0.06655084292093913
sim_compute_performance-ego_mean0.06376058705647787
sim_compute_performance-ego_median0.06412381649017335
sim_compute_performance-ego_min0.0603924838701884
sim_compute_robot_state-ego_max0.06963449875513712
sim_compute_robot_state-ego_mean0.0681615850130717
sim_compute_robot_state-ego_median0.06864944775899251
sim_compute_robot_state-ego_min0.06471064408620199
sim_compute_robot_state-npc0_max0.06753857533137003
sim_compute_robot_state-npc0_mean0.06564445209503174
sim_compute_robot_state-npc0_median0.06588028748830159
sim_compute_robot_state-npc0_min0.06319768269856771
sim_compute_robot_state-npc1_max0.06814368565877278
sim_compute_robot_state-npc1_mean0.06577525202433268
sim_compute_robot_state-npc1_median0.06515476226806641
sim_compute_robot_state-npc1_min0.06497968196868896
sim_compute_robot_state-npc2_max0.06511690457661946
sim_compute_robot_state-npc2_mean0.06330771160125732
sim_compute_robot_state-npc2_median0.06329429626464844
sim_compute_robot_state-npc2_min0.06147315343221029
sim_compute_robot_state-npc3_max0.06550121068954468
sim_compute_robot_state-npc3_mean0.06433480517069498
sim_compute_robot_state-npc3_median0.06483456214269002
sim_compute_robot_state-npc3_min0.06128411134084066
sim_compute_sim_state_max0.041628999710083006
sim_compute_sim_state_mean0.037520747502644856
sim_compute_sim_state_median0.036865094502766926
sim_compute_sim_state_min0.035156273047129316
sim_physics_max0.1742067813873291
sim_physics_mean0.16114294449488323
sim_physics_median0.1594786524772644
sim_physics_min0.15322364966074625
sim_render-ego_max0.058335607846577965
sim_render-ego_mean0.0576498703956604
sim_render-ego_median0.057849442958831786
sim_render-ego_min0.05644808689753215
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.21000000000006
survival_time_min1.2500000000000004
222903441jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11690:36:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222783486Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationsuccessyes11691 day, 3:25:00(hidden)
driven_lanedir_consec_median-0.0005547867508171045
survival_time_median14.950000000000076
deviation-center-line_median0.08595713175886957
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.13974887609481812
agent_compute-ego_mean0.13582511425018312
agent_compute-ego_median0.13518306334813435
agent_compute-ego_min0.13214000940322876
deviation-center-line_max0.7597786156362132
deviation-center-line_mean0.137541590585692
deviation-center-line_min0.020107537896167912
deviation-heading_max6.008014579834853
deviation-heading_mean1.6389251291896465
deviation-heading_median0.6889255803568087
deviation-heading_min0.5598167528005288
driven_any_max1.7412714014715316
driven_any_mean0.41538596054319776
driven_any_median0.1383959973831592
driven_any_min0.0805342731040154
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.00046586963337973407
driven_lanedir_consec_min-0.003361806018059577
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.00046586963337973407
driven_lanedir_median-0.0005547867508171045
driven_lanedir_min-0.003361806018059577
in-drivable-lane_max7.350000000000034
in-drivable-lane_mean1.5900000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5038800776994324, "sim_physics": 0.08392632820389488, "survival_time": 4.399999999999992, "driven_lanedir": 0.13592142442974575, "sim_render-ego": 0.048557099970904266, "in-drivable-lane": 2.049999999999997, "agent_compute-ego": 0.1312993900342421, "deviation-heading": 1.7051910529504986, "set_robot_commands": 0.07270857420834628, "deviation-center-line": 0.09279921224004846, "driven_lanedir_consec": 0.13592142442974575, "sim_compute_sim_state": 0.029801807620308617, "sim_compute_performance-ego": 0.05540900880640203, "sim_compute_robot_state-ego": 0.0584821186282418}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16791318770452632, "sim_physics": 0.07447624206542969, "survival_time": 1.7500000000000009, "driven_lanedir": 0.05941689814203566, "sim_render-ego": 0.040719522748674665, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.10583064215523856, "deviation-heading": 0.5598167528005288, "set_robot_commands": 0.05759268488202776, "deviation-center-line": 0.020781659785830305, "driven_lanedir_consec": 0.05941689814203566, "sim_compute_sim_state": 0.02500808579581125, "sim_compute_performance-ego": 0.043497140066964285, "sim_compute_robot_state-ego": 0.046521786281040735}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08765276996396464, "sim_physics": 0.13313346817379906, "survival_time": 1.0500000000000005, "driven_lanedir": 0.04260023322783857, "sim_render-ego": 0.06388014838809059, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.21252366474696568, "deviation-heading": 0.7095420485643351, "set_robot_commands": 0.09975165412539529, "deviation-center-line": 0.08614051989203497, "driven_lanedir_consec": 0.04260023322783857, "sim_compute_sim_state": 0.044624896276564824, "sim_compute_performance-ego": 0.07173551831926618, "sim_compute_robot_state-ego": 0.07800077256702241}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7881445431910101, "sim_physics": 0.07496494869534061, "survival_time": 6.949999999999983, "driven_lanedir": 0.22066563163820965, "sim_render-ego": 0.04709026453306349, "in-drivable-lane": 3.3999999999999924, "agent_compute-ego": 0.13460954316228413, "deviation-heading": 2.753064961008922, "set_robot_commands": 0.0794995277048015, "deviation-center-line": 0.17055937617903916, "driven_lanedir_consec": 0.22066563163820965, "sim_compute_sim_state": 0.029550715316113807, "sim_compute_performance-ego": 0.048857086854015325, "sim_compute_robot_state-ego": 0.052302171858094576}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7412714014715316, "sim_physics": 0.1062314518292745, "survival_time": 14.950000000000076, "driven_lanedir": 0.51331558806727, "sim_render-ego": 0.06049908399581909, "in-drivable-lane": 7.300000000000031, "agent_compute-ego": 0.17329620997111003, "deviation-heading": 5.74023226638551, "set_robot_commands": 0.09741279045740764, "deviation-center-line": 0.27492654119400867, "driven_lanedir_consec": 0.51331558806727, "sim_compute_sim_state": 0.03927523930867513, "sim_compute_performance-ego": 0.0669243876139323, "sim_compute_robot_state-ego": 0.07474176486333212}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.557911234276148, "sim_physics": 0.11294092098871866, "survival_time": 14.950000000000076, "driven_lanedir": 0.42581248291793594, "sim_render-ego": 0.062470107078552245, "in-drivable-lane": 7.350000000000034, "agent_compute-ego": 0.17377737840016683, "deviation-heading": 6.008014579834853, "set_robot_commands": 0.09801504055658976, "deviation-center-line": 0.7597786156362132, "driven_lanedir_consec": 0.42581248291793594, "sim_compute_sim_state": 0.03958724101384481, "sim_compute_performance-ego": 0.06886623064676921, "sim_compute_robot_state-ego": 0.0752490242322286}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.10922150382791856, "sim_physics": 0.09719058183523324, "survival_time": 1.3000000000000005, "driven_lanedir": 0.055059273435346334, "sim_render-ego": 0.051204828115609974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13746167146242583, "deviation-heading": 0.6889255803568087, "set_robot_commands": 0.0832131184064425, "deviation-center-line": 0.08034492463725701, "driven_lanedir_consec": 0.055059273435346334, "sim_compute_sim_state": 0.03494805556077223, "sim_compute_performance-ego": 0.05807793140411377, "sim_compute_robot_state-ego": 0.06146007317763109}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09061793871792163, "sim_physics": 0.09232519973408092, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04439818477793844, "sim_render-ego": 0.05031388456171209, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13847096399827438, "deviation-heading": 0.6839085651163759, "set_robot_commands": 0.07593378153714267, "deviation-center-line": 0.08020827764323984, "driven_lanedir_consec": 0.04439818477793844, "sim_compute_sim_state": 0.032801823182539505, "sim_compute_performance-ego": 0.05191075801849365, "sim_compute_robot_state-ego": 0.05699934742667458}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1383959973831592, "sim_physics": 0.1368484405370859, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06898920083905447, "sim_render-ego": 0.07078351424290584, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.20302185645470253, "deviation-heading": 0.7464558385619143, "set_robot_commands": 0.09680418784801775, "deviation-center-line": 0.041222223349834386, "driven_lanedir_consec": 0.06898920083905447, "sim_compute_sim_state": 0.040751007887033314, "sim_compute_performance-ego": 0.08164682755103478, "sim_compute_robot_state-ego": 0.08620279568892258}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12899113256320577, "sim_physics": 0.12640927314758302, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08327415222066659, "sim_render-ego": 0.0670548439025879, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18000207901000975, "deviation-heading": 0.6886070008504351, "set_robot_commands": 0.09794439315795898, "deviation-center-line": 0.08595713175886957, "driven_lanedir_consec": 0.08327415222066659, "sim_compute_sim_state": 0.03864916801452637, "sim_compute_performance-ego": 0.06932332038879395, "sim_compute_robot_state-ego": 0.0752395248413086}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.10517680898684446, "sim_physics": 0.11911591239597488, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06490158909721544, "sim_render-ego": 0.06402565085369608, "in-drivable-lane": 0, "agent_compute-ego": 0.16096617864525836, "deviation-heading": 0.6304787133211814, "set_robot_commands": 0.09883214079815408, "deviation-center-line": 0.09916630870260223, "driven_lanedir_consec": 0.06490158909721544, "sim_compute_sim_state": 0.04160481950511103, "sim_compute_performance-ego": 0.06906277200450069, "sim_compute_robot_state-ego": 0.07222379808840544}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13570423172329227, "sim_physics": 0.126186591607553, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06953231503639734, "sim_render-ego": 0.06494779940004702, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17610977314136647, "deviation-heading": 0.6754887089324252, "set_robot_commands": 0.09450968106587727, "deviation-center-line": 0.06044908742203052, "driven_lanedir_consec": 0.06953231503639734, "sim_compute_sim_state": 0.03871098271122685, "sim_compute_performance-ego": 0.06765250806455259, "sim_compute_robot_state-ego": 0.07666304376390246}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.4501557007619454, "sim_physics": 0.1288058785505073, "survival_time": 4.299999999999993, "driven_lanedir": 0.1611389032344389, "sim_render-ego": 0.06735319037770116, "in-drivable-lane": 1.849999999999997, "agent_compute-ego": 0.2007856812588004, "deviation-heading": 1.7083408854773945, "set_robot_commands": 0.10963306593340497, "deviation-center-line": 0.0844184477464415, "driven_lanedir_consec": 0.1611389032344389, "sim_compute_sim_state": 0.04259567759757818, "sim_compute_performance-ego": 0.07755910795788433, "sim_compute_robot_state-ego": 0.08666661728260129}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1452186067730508, "sim_physics": 0.1332230644841348, "survival_time": 1.5500000000000007, "driven_lanedir": 0.03458168885303836, "sim_render-ego": 0.06850897881292528, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.2051946347759616, "deviation-heading": 0.6879993118879137, "set_robot_commands": 0.1064949881645941, "deviation-center-line": 0.020107537896167912, "driven_lanedir_consec": 0.03458168885303836, "sim_compute_sim_state": 0.04576783795510569, "sim_compute_performance-ego": 0.07885657587359028, "sim_compute_robot_state-ego": 0.08697739724190004}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.0805342731040154, "sim_physics": 0.11965610764243384, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04653848407813177, "sim_render-ego": 0.0595804669640281, "in-drivable-lane": 0, "agent_compute-ego": 0.1547629182988947, "deviation-heading": 0.5978106717955998, "set_robot_commands": 0.09718504819003018, "deviation-center-line": 0.1062639947017614, "driven_lanedir_consec": 0.04653848407813177, "sim_compute_sim_state": 0.040003635666587135, "sim_compute_performance-ego": 0.0669183839451183, "sim_compute_robot_state-ego": 0.07104962522333319}}
set_robot_commands_max0.07707885185877482
set_robot_commands_mean0.07548526016871135
set_robot_commands_median0.07563153425852458
set_robot_commands_min0.07328295866648356
sim_compute_performance-ego_max0.06136019468307495
sim_compute_performance-ego_mean0.06035742839177449
sim_compute_performance-ego_median0.05994773387908935
sim_compute_performance-ego_min0.05958258549372355
sim_compute_robot_state-ego_max0.06217957894007365
sim_compute_robot_state-ego_mean0.06082349761327107
sim_compute_robot_state-ego_median0.06056402047475179
sim_compute_robot_state-ego_min0.06000970760981242
sim_compute_sim_state_max0.038775881131490074
sim_compute_sim_state_mean0.03804562266667684
sim_compute_sim_state_median0.03842011133829753
sim_compute_sim_state_min0.037121593952178955
sim_physics_max0.05798179785410563
sim_physics_mean0.05681725295384725
sim_physics_median0.05732198238372803
sim_physics_min0.05505349636077881
sim_render-ego_max0.05726299206415812
sim_render-ego_mean0.0559770671526591
sim_render-ego_median0.05569203456242879
sim_render-ego_min0.055478870073954266
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
222703491Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11691 day, 4:15:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222623516jp18813100494Second test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessyes11690:21:15(hidden)
driven_lanedir_consec_median1.0328325337918964
survival_time_median14.950000000000076
deviation-center-line_median0.8392144281375854
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16511745850245158
agent_compute-ego_mean0.15846323702253767
agent_compute-ego_median0.15900044712593886
agent_compute-ego_min0.14799310440240904
deviation-center-line_max1.57377995654447
deviation-center-line_mean0.865559805771654
deviation-center-line_min0.18496563734886728
deviation-heading_max4.004765313771469
deviation-heading_mean2.0308289158991455
deviation-heading_median1.7642265469798744
deviation-heading_min0.948149445292733
driven_any_max1.9219346725617432
driven_any_mean1.4991572119331416
driven_any_median1.7528162542818746
driven_any_min0.9524352508948164
driven_lanedir_consec_max1.6401451217007263
driven_lanedir_consec_mean1.0398631418425317
driven_lanedir_consec_min0.5423023023607837
driven_lanedir_max1.6401451217007263
driven_lanedir_mean1.0601325192632054
driven_lanedir_median1.0328325337918964
driven_lanedir_min0.5423023023607837
in-drivable-lane_max6.049999999999988
in-drivable-lane_mean1.5899999999999963
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.792479434189623, "sim_physics": 0.09462983802307484, "survival_time": 8.599999999999987, "driven_lanedir": 0.7364170368464507, "sim_render-ego": 0.054211482059123905, "in-drivable-lane": 6.049999999999988, "agent_compute-ego": 0.14799310440240904, "deviation-heading": 0.948149445292733, "set_robot_commands": 0.08400636218314947, "deviation-center-line": 0.18496563734886728, "driven_lanedir_consec": 0.7364170368464507, "sim_compute_sim_state": 0.0360064756038577, "sim_compute_performance-ego": 0.06024790503257929, "sim_compute_robot_state-ego": 0.0637306903683862}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9524352508948164, "sim_physics": 0.11037824710210165, "survival_time": 14.950000000000076, "driven_lanedir": 0.5423023023607837, "sim_render-ego": 0.060856415430704754, "in-drivable-lane": 0, "agent_compute-ego": 0.16135262250900267, "deviation-heading": 1.7642265469798744, "set_robot_commands": 0.0910523557662964, "deviation-center-line": 0.8392144281375854, "driven_lanedir_consec": 0.5423023023607837, "sim_compute_sim_state": 0.03752377986907959, "sim_compute_performance-ego": 0.0661162288983663, "sim_compute_robot_state-ego": 0.07178863445917766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9219346725617432, "sim_physics": 0.09823384046554566, "survival_time": 14.950000000000076, "driven_lanedir": 1.6401451217007263, "sim_render-ego": 0.0595707114537557, "in-drivable-lane": 0, "agent_compute-ego": 0.15885255257288614, "deviation-heading": 2.255800088849635, "set_robot_commands": 0.09126749833424888, "deviation-center-line": 1.2687407568495153, "driven_lanedir_consec": 1.6401451217007263, "sim_compute_sim_state": 0.037908584276835126, "sim_compute_performance-ego": 0.06760000467300414, "sim_compute_robot_state-ego": 0.07124161720275879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0761204477376498, "sim_physics": 0.10611399014790852, "survival_time": 6.149999999999986, "driven_lanedir": 1.0328325337918964, "sim_render-ego": 0.0591616921308564, "in-drivable-lane": 0, "agent_compute-ego": 0.15900044712593886, "deviation-heading": 1.1812031846020177, "set_robot_commands": 0.08911367354354238, "deviation-center-line": 0.461098249977832, "driven_lanedir_consec": 1.0328325337918964, "sim_compute_sim_state": 0.03668747103311182, "sim_compute_performance-ego": 0.06675238919451953, "sim_compute_robot_state-ego": 0.07439405355996233}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7528162542818746, "sim_physics": 0.10247782150904336, "survival_time": 14.950000000000076, "driven_lanedir": 1.348965601616169, "sim_render-ego": 0.05954940319061279, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.16511745850245158, "deviation-heading": 4.004765313771469, "set_robot_commands": 0.09373553117116291, "deviation-center-line": 1.57377995654447, "driven_lanedir_consec": 1.2476187145128013, "sim_compute_sim_state": 0.038272020816802976, "sim_compute_performance-ego": 0.06743561347325643, "sim_compute_robot_state-ego": 0.07263184626897176}}
set_robot_commands_max0.09373553117116291
set_robot_commands_mean0.08983508419968
set_robot_commands_median0.0910523557662964
set_robot_commands_min0.08400636218314947
sim_compute_performance-ego_max0.06760000467300414
sim_compute_performance-ego_mean0.06563042825434515
sim_compute_performance-ego_median0.06675238919451953
sim_compute_performance-ego_min0.06024790503257929
sim_compute_robot_state-ego_max0.07439405355996233
sim_compute_robot_state-ego_mean0.07075736837185134
sim_compute_robot_state-ego_median0.07178863445917766
sim_compute_robot_state-ego_min0.0637306903683862
sim_compute_sim_state_max0.038272020816802976
sim_compute_sim_state_mean0.03727966631993744
sim_compute_sim_state_median0.03752377986907959
sim_compute_sim_state_min0.0360064756038577
sim_physics_max0.11037824710210165
sim_physics_mean0.1023667474495348
sim_physics_median0.10247782150904336
sim_physics_min0.09462983802307484
sim_render-ego_max0.060856415430704754
sim_render-ego_mean0.05866994085301071
sim_render-ego_median0.05954940319061279
sim_render-ego_min0.054211482059123905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.92000000000004
survival_time_min6.149999999999986
222583517Bea BaselinesStraight maxaido2-LF-sim-validationstep1-simulationsuccessyes11690:04:55(hidden)
driven_lanedir_consec_median0.6618324868125249
survival_time_median2.1000000000000005
deviation-center-line_median0.09250602665006584
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.15481834642348752
agent_compute-ego_mean0.14717569689565008
agent_compute-ego_median0.14553618431091309
agent_compute-ego_min0.13904554503304617
deviation-center-line_max0.21439068356235536
deviation-center-line_mean0.12258369343422797
deviation-center-line_min0.0744010530149505
deviation-heading_max0.5686442582449269
deviation-heading_mean0.3103675930817716
deviation-heading_median0.25395078679676
deviation-heading_min0.17582209342949345
driven_any_max1.575892401948956
driven_any_mean0.8642098067399473
driven_any_median1.0038564958116647
driven_any_min0.26972689326339405
driven_lanedir_consec_max1.1723086623342591
driven_lanedir_consec_mean0.6830346826605466
driven_lanedir_consec_min0.2605911739016977
driven_lanedir_max1.1723086623342591
driven_lanedir_mean0.6830346826605466
driven_lanedir_median0.6618324868125249
driven_lanedir_min0.2605911739016977
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.10020028409503756, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.0599254880632673, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.15136638141813732, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.08784676733471099, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.03492116928100586, "sim_compute_performance-ego": 0.060641669091724214, "sim_compute_robot_state-ego": 0.06804553667704265}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.10005232833680652, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.05957605725242978, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13904554503304617, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.08526499498458136, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.03659413542066302, "sim_compute_performance-ego": 0.06708971659342448, "sim_compute_robot_state-ego": 0.06778626214890253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.10705603659152985, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.05854539573192597, "in-drivable-lane": 0, "agent_compute-ego": 0.14553618431091309, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.09283143281936646, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.03548361361026764, "sim_compute_performance-ego": 0.06418916583061218, "sim_compute_robot_state-ego": 0.06696945428848267}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.10759379552758258, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.06204308634218962, "in-drivable-lane": 0, "agent_compute-ego": 0.14511202729266623, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.08788836520651112, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.03489448713219684, "sim_compute_performance-ego": 0.06701747230861498, "sim_compute_robot_state-ego": 0.07161693987639053}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.10876998593730312, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.0625239456853559, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15481834642348752, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.09637498471044724, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.04016650492145169, "sim_compute_performance-ego": 0.07596082072104177, "sim_compute_robot_state-ego": 0.07402391587534259}}
set_robot_commands_max0.09637498471044724
set_robot_commands_mean0.09004130901112344
set_robot_commands_median0.08788836520651112
set_robot_commands_min0.08526499498458136
sim_compute_performance-ego_max0.07596082072104177
sim_compute_performance-ego_mean0.06697976890908353
sim_compute_performance-ego_median0.06701747230861498
sim_compute_performance-ego_min0.060641669091724214
sim_compute_robot_state-ego_max0.07402391587534259
sim_compute_robot_state-ego_mean0.06968842177323219
sim_compute_robot_state-ego_median0.06804553667704265
sim_compute_robot_state-ego_min0.06696945428848267
sim_compute_sim_state_max0.04016650492145169
sim_compute_sim_state_mean0.03641198207311701
sim_compute_sim_state_median0.03548361361026764
sim_compute_sim_state_min0.03489448713219684
sim_physics_max0.10876998593730312
sim_physics_mean0.10473448609765192
sim_physics_median0.10705603659152985
sim_physics_min0.10005232833680652
sim_render-ego_max0.0625239456853559
sim_render-ego_mean0.06052279461503371
sim_render-ego_median0.0599254880632673
sim_render-ego_min0.05854539573192597
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean1.8499999999999996
survival_time_min0.8000000000000002
222523512Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:15:36(hidden)
driven_lanedir_consec_median0.12739082416299574
survival_time_median1.3000000000000005
deviation-center-line_median0.08166444632038598
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18476768462888657
agent_compute-ego_mean0.16376106652265052
agent_compute-ego_median0.15784091949462892
agent_compute-ego_min0.1470374365647634
deviation-center-line_max0.10535131406181696
deviation-center-line_mean0.07920742144300794
deviation-center-line_min0.04917145582597334
deviation-heading_max0.8944037859209665
deviation-heading_mean0.6835739505179455
deviation-heading_median0.7143094752986094
deviation-heading_min0.43743511397729734
driven_any_max0.27551261256002413
driven_any_mean0.18207307865933367
driven_any_median0.1694214624294807
driven_any_min0.1291760435692988
driven_lanedir_consec_max0.16044635668179685
driven_lanedir_consec_mean0.11784383872015912
driven_lanedir_consec_min0.04857885231725145
driven_lanedir_max0.16044635668179685
driven_lanedir_mean0.11784383872015912
driven_lanedir_median0.12739082416299574
driven_lanedir_min0.04857885231725145
in-drivable-lane_max0.6500000000000005
in-drivable-lane_mean0.09333333333333342
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22820709281725776, "sim_physics": 0.1834951639175415, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13280530497373566, "sim_render-ego": 0.0544139305750529, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15784091949462892, "deviation-heading": 0.8433953108880111, "set_robot_commands": 0.09036743640899658, "deviation-center-line": 0.08166444632038598, "driven_lanedir_consec": 0.13280530497373566, "sim_compute_sim_state": 0.036406358083089195, "sim_compute_performance-ego": 0.060034624735514325, "sim_compute_robot_state-ego": 0.06399655342102051, "sim_compute_robot_state-npc0": 0.06115816434224446, "sim_compute_robot_state-npc1": 0.06027337710062663, "sim_compute_robot_state-npc2": 0.056591184933980306, "sim_compute_robot_state-npc3": 0.057327795028686526}, "udem1-1-0": {"driven_any": 0.20266776554092908, "sim_physics": 0.2099245861172676, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04857885231725145, "sim_render-ego": 0.058185845613479614, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.15606805682182312, "deviation-heading": 0.7143094752986094, "set_robot_commands": 0.08968508243560791, "deviation-center-line": 0.04917145582597334, "driven_lanedir_consec": 0.04857885231725145, "sim_compute_sim_state": 0.03775376081466675, "sim_compute_performance-ego": 0.06416727602481842, "sim_compute_robot_state-ego": 0.06575394421815872, "sim_compute_robot_state-npc0": 0.062373265624046326, "sim_compute_robot_state-npc1": 0.06619405746459961, "sim_compute_robot_state-npc2": 0.06731273233890533, "sim_compute_robot_state-npc3": 0.06713659316301346}, "udem1-2-0": {"driven_any": 0.16108849671358594, "sim_physics": 0.2465995450814565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13188257778266976, "sim_render-ego": 0.05705118179321289, "in-drivable-lane": 0, "agent_compute-ego": 0.15444488326708475, "deviation-heading": 0.45036973196732893, "set_robot_commands": 0.0851011872291565, "deviation-center-line": 0.10535131406181696, "driven_lanedir_consec": 0.13188257778266976, "sim_compute_sim_state": 0.036276797453562416, "sim_compute_performance-ego": 0.06125849485397339, "sim_compute_robot_state-ego": 0.07144211729367574, "sim_compute_robot_state-npc0": 0.06509377559026082, "sim_compute_robot_state-npc1": 0.06627131501833598, "sim_compute_robot_state-npc2": 0.06189813216527303, "sim_compute_robot_state-npc3": 0.0652672251065572}, "udem1-3-0": {"driven_any": 0.153655082107214, "sim_physics": 0.2216716508070628, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1255962524250125, "sim_render-ego": 0.06339550018310547, "in-drivable-lane": 0, "agent_compute-ego": 0.17390645543734232, "deviation-heading": 0.46834646323296336, "set_robot_commands": 0.09079898397127788, "deviation-center-line": 0.1030498142655799, "driven_lanedir_consec": 0.1255962524250125, "sim_compute_sim_state": 0.03971850872039795, "sim_compute_performance-ego": 0.06715959310531616, "sim_compute_robot_state-ego": 0.07341389854749043, "sim_compute_robot_state-npc0": 0.0682414174079895, "sim_compute_robot_state-npc1": 0.06819952527681987, "sim_compute_robot_state-npc2": 0.06979599595069885, "sim_compute_robot_state-npc3": 0.07064475615819295}, "udem1-4-0": {"driven_any": 0.13981664554712356, "sim_physics": 0.1873867304428764, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07507866194597557, "sim_render-ego": 0.05360462354577106, "in-drivable-lane": 0, "agent_compute-ego": 0.1537732041400412, "deviation-heading": 0.8402456780060235, "set_robot_commands": 0.0822650556978972, "deviation-center-line": 0.05739454977041497, "driven_lanedir_consec": 0.07507866194597557, "sim_compute_sim_state": 0.03527833067852518, "sim_compute_performance-ego": 0.05989587825277577, "sim_compute_robot_state-ego": 0.06680842067884363, "sim_compute_robot_state-npc0": 0.060166545536207115, "sim_compute_robot_state-npc1": 0.062391923821490745, "sim_compute_robot_state-npc2": 0.0617777679277503, "sim_compute_robot_state-npc3": 0.062472809915957245}, "udem1-5-0": {"driven_any": 0.23020312238328677, "sim_physics": 0.1799452006816864, "survival_time": 1.6000000000000008, "driven_lanedir": 0.14795033168175253, "sim_render-ego": 0.05333881825208664, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16148369014263153, "deviation-heading": 0.8944037859209665, "set_robot_commands": 0.08640874177217484, "deviation-center-line": 0.07849734496098351, "driven_lanedir_consec": 0.14795033168175253, "sim_compute_sim_state": 0.034599244594573975, "sim_compute_performance-ego": 0.06113458424806595, "sim_compute_robot_state-ego": 0.0637613832950592, "sim_compute_robot_state-npc0": 0.06151715666055679, "sim_compute_robot_state-npc1": 0.06007233262062073, "sim_compute_robot_state-npc2": 0.05678988993167877, "sim_compute_robot_state-npc3": 0.059908583760261536}, "udem1-6-0": {"driven_any": 0.13739141656015158, "sim_physics": 0.2450716599174168, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09810265379317862, "sim_render-ego": 0.06367431516232698, "in-drivable-lane": 0, "agent_compute-ego": 0.17728295533553415, "deviation-heading": 0.6108547854404713, "set_robot_commands": 0.0936152105746062, "deviation-center-line": 0.08590157493301563, "driven_lanedir_consec": 0.09810265379317862, "sim_compute_sim_state": 0.04091674348582392, "sim_compute_performance-ego": 0.07417300473088803, "sim_compute_robot_state-ego": 0.07740012459132982, "sim_compute_robot_state-npc0": 0.07035036708997644, "sim_compute_robot_state-npc1": 0.07043027877807617, "sim_compute_robot_state-npc2": 0.07130860245746115, "sim_compute_robot_state-npc3": 0.07309508323669434}, "udem1-7-0": {"driven_any": 0.1694214624294807, "sim_physics": 0.21872691007760856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1354027287524724, "sim_render-ego": 0.06375100979438195, "in-drivable-lane": 0, "agent_compute-ego": 0.1842745267427885, "deviation-heading": 0.5525010321613538, "set_robot_commands": 0.09460028318258432, "deviation-center-line": 0.0949205639516543, "driven_lanedir_consec": 0.1354027287524724, "sim_compute_sim_state": 0.04129774753863995, "sim_compute_performance-ego": 0.06762821857745831, "sim_compute_robot_state-ego": 0.07003931815807636, "sim_compute_robot_state-npc0": 0.06882540996258076, "sim_compute_robot_state-npc1": 0.0661164980668288, "sim_compute_robot_state-npc2": 0.06576743492713341, "sim_compute_robot_state-npc3": 0.0720811073596661}, "udem1-8-0": {"driven_any": 0.2256162089827095, "sim_physics": 0.20383083435796925, "survival_time": 1.5500000000000007, "driven_lanedir": 0.16044635668179685, "sim_render-ego": 0.08630955603814894, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18476768462888657, "deviation-heading": 0.8103928587691155, "set_robot_commands": 0.10080790519714355, "deviation-center-line": 0.06310404878870934, "driven_lanedir_consec": 0.16044635668179685, "sim_compute_sim_state": 0.041854712270921274, "sim_compute_performance-ego": 0.07348091371597783, "sim_compute_robot_state-ego": 0.07741732751169512, "sim_compute_robot_state-npc0": 0.07033335008928852, "sim_compute_robot_state-npc1": 0.06813362336927845, "sim_compute_robot_state-npc2": 0.07089711004687894, "sim_compute_robot_state-npc3": 0.0700593763782132}, "udem1-9-0": {"driven_any": 0.20596055415287937, "sim_physics": 0.21258903466738188, "survival_time": 1.3000000000000005, "driven_lanedir": 0.147810754938138, "sim_render-ego": 0.06223408992473896, "in-drivable-lane": 0, "agent_compute-ego": 0.16989333813007065, "deviation-heading": 0.7948395610973749, "set_robot_commands": 0.09164064664107102, "deviation-center-line": 0.07148292926011672, "driven_lanedir_consec": 0.147810754938138, "sim_compute_sim_state": 0.03518346639779898, "sim_compute_performance-ego": 0.05952900189619798, "sim_compute_robot_state-ego": 0.0678318922336285, "sim_compute_robot_state-npc0": 0.06877581889812763, "sim_compute_robot_state-npc1": 0.06732782033773568, "sim_compute_robot_state-npc2": 0.06256372195023757, "sim_compute_robot_state-npc3": 0.06251335144042969}, "udem1-10-0": {"driven_any": 0.1578030648975387, "sim_physics": 0.1920095185438792, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09526607341585414, "sim_render-ego": 0.056928286949793495, "in-drivable-lane": 0, "agent_compute-ego": 0.1470374365647634, "deviation-heading": 0.8862955888299321, "set_robot_commands": 0.08811499675114949, "deviation-center-line": 0.061250469156920714, "driven_lanedir_consec": 0.09526607341585414, "sim_compute_sim_state": 0.03323671221733093, "sim_compute_performance-ego": 0.06305602192878723, "sim_compute_robot_state-ego": 0.06821711858113606, "sim_compute_robot_state-npc0": 0.063358207543691, "sim_compute_robot_state-npc1": 0.06131940086682638, "sim_compute_robot_state-npc2": 0.06275618076324463, "sim_compute_robot_state-npc3": 0.06009323398272196}, "udem1-11-0": {"driven_any": 0.13793227142857434, "sim_physics": 0.19893321990966795, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11048060583341623, "sim_render-ego": 0.05994168519973755, "in-drivable-lane": 0, "agent_compute-ego": 0.15378785133361816, "deviation-heading": 0.43743511397729734, "set_robot_commands": 0.08749377727508545, "deviation-center-line": 0.08821708648511872, "driven_lanedir_consec": 0.11048060583341623, "sim_compute_sim_state": 0.03764940500259399, "sim_compute_performance-ego": 0.06956921815872193, "sim_compute_robot_state-ego": 0.06914379596710205, "sim_compute_robot_state-npc0": 0.06340347528457642, "sim_compute_robot_state-npc1": 0.06586630344390869, "sim_compute_robot_state-npc2": 0.06317163705825805, "sim_compute_robot_state-npc3": 0.06167234182357788}, "udem1-12-0": {"driven_any": 0.27551261256002413, "sim_physics": 0.20536517485594136, "survival_time": 1.950000000000001, "driven_lanedir": 0.12739082416299574, "sim_render-ego": 0.0622259286733774, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15656353265811235, "deviation-heading": 0.74269506660919, "set_robot_commands": 0.09189469997699444, "deviation-center-line": 0.07470024164204528, "driven_lanedir_consec": 0.12739082416299574, "sim_compute_sim_state": 0.03925157815982134, "sim_compute_performance-ego": 0.06508259284190643, "sim_compute_robot_state-ego": 0.06824753834651066, "sim_compute_robot_state-npc0": 0.06805254862858699, "sim_compute_robot_state-npc1": 0.06465753530844665, "sim_compute_robot_state-npc2": 0.06743106475243202, "sim_compute_robot_state-npc3": 0.06574153288816795}, "udem1-13-0": {"driven_any": 0.1291760435692988, "sim_physics": 0.23081208311993143, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0942065850756637, "sim_render-ego": 0.06618307984393576, "in-drivable-lane": 0, "agent_compute-ego": 0.1679232535154923, "deviation-heading": 0.5577150912322762, "set_robot_commands": 0.09401935079823368, "deviation-center-line": 0.09018753673738882, "driven_lanedir_consec": 0.0942065850756637, "sim_compute_sim_state": 0.04008720232092816, "sim_compute_performance-ego": 0.07644500939742378, "sim_compute_robot_state-ego": 0.08027637523153554, "sim_compute_robot_state-npc0": 0.0705157466556715, "sim_compute_robot_state-npc1": 0.07382007267164148, "sim_compute_robot_state-npc2": 0.07391806270765222, "sim_compute_robot_state-npc3": 0.0680133467135222}, "udem1-14-0": {"driven_any": 0.1766443401999513, "sim_physics": 0.17793035507202148, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13665901702247374, "sim_render-ego": 0.052847614994755494, "in-drivable-lane": 0, "agent_compute-ego": 0.15736820962693956, "deviation-heading": 0.6498097143382661, "set_robot_commands": 0.08727086031878437, "deviation-center-line": 0.08321794548499498, "driven_lanedir_consec": 0.13665901702247374, "sim_compute_sim_state": 0.03515297395211679, "sim_compute_performance-ego": 0.05821320745680067, "sim_compute_robot_state-ego": 0.06405391516508879, "sim_compute_robot_state-npc0": 0.06519661126313386, "sim_compute_robot_state-npc1": 0.06736838376080548, "sim_compute_robot_state-npc2": 0.06322754753960504, "sim_compute_robot_state-npc3": 0.06369072419625742}}
set_robot_commands_max0.10080790519714355
set_robot_commands_mean0.09027228121538423
set_robot_commands_median0.09036743640899658
set_robot_commands_min0.0822650556978972
sim_compute_performance-ego_max0.07644500939742378
sim_compute_performance-ego_mean0.06538850932830843
sim_compute_performance-ego_median0.06416727602481842
sim_compute_performance-ego_min0.05821320745680067
sim_compute_robot_state-ego_max0.08027637523153554
sim_compute_robot_state-ego_mean0.06985358154935675
sim_compute_robot_state-ego_median0.06824753834651066
sim_compute_robot_state-ego_min0.0637613832950592
sim_compute_robot_state-npc0_max0.0705157466556715
sim_compute_robot_state-npc0_mean0.06582412403846255
sim_compute_robot_state-npc0_median0.06519661126313386
sim_compute_robot_state-npc0_min0.060166545536207115
sim_compute_robot_state-npc1_max0.07382007267164148
sim_compute_robot_state-npc1_mean0.06589616319373609
sim_compute_robot_state-npc1_median0.06619405746459961
sim_compute_robot_state-npc1_min0.06007233262062073
sim_compute_robot_state-npc2_max0.07391806270765222
sim_compute_robot_state-npc2_mean0.06501380436341264
sim_compute_robot_state-npc2_median0.06322754753960504
sim_compute_robot_state-npc2_min0.056591184933980306
sim_compute_robot_state-npc3_max0.07309508323669434
sim_compute_robot_state-npc3_mean0.06531452407679465
sim_compute_robot_state-npc3_median0.0652672251065572
sim_compute_robot_state-npc3_min0.057327795028686526
sim_compute_sim_state_max0.041854712270921274
sim_compute_sim_state_mean0.03764423611271939
sim_compute_sim_state_median0.03764940500259399
sim_compute_sim_state_min0.03323671221733093
sim_physics_max0.2465995450814565
sim_physics_mean0.20761944450464723
sim_physics_median0.20536517485594136
sim_physics_min0.17793035507202148
sim_render-ego_max0.08630955603814894
sim_render-ego_mean0.06093903110292701
sim_render-ego_median0.05994168519973755
sim_render-ego_min0.052847614994755494
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3466666666666671
survival_time_min1.0000000000000002
222462751RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationfailedyes11690:01:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
222422516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222272894almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes11690:11:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)