AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1169

evaluator1169
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success37
# timeout
# failed3
# error47
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.5 GB
Disk (MB)96.9 GB
Disk available (MB)47.5 GB
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230873558kar1989PredictorLastaido2-PREDstep1-simulationsuccessno11690:00:28Hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11772218205910091
error_L20.02143953392240987


230803557AmaurXRunning the real lane following -- without challenge containeraido2-LFVI-sim-validationstep1-simulationerroryes11690:05:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230352410jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerroryes11690:07:12
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230282369Liam Paullminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessyes11690:26:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1572352233140365
agent_compute-ego_mean0.13595605158548665
agent_compute-ego_median0.14215392689053102
agent_compute-ego_min0.11347536731966966
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.09592242721173404, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05675690637218009, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14215392689053102, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08941711453225115, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03627225649442605, "sim_compute_performance-ego": 0.06306760945766092, "sim_compute_robot_state-ego": 0.06449515184910178}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.10474487372807094, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.06167295319693429, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.15474269390106202, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.09371257850102016, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.03902083124433245, "sim_compute_performance-ego": 0.07011977093560355, "sim_compute_robot_state-ego": 0.07493132012231009}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.10455013381110298, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.059004624684651695, "in-drivable-lane": 0, "agent_compute-ego": 0.13749078114827473, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.0893472671508789, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.037511253356933595, "sim_compute_performance-ego": 0.06856992509629992, "sim_compute_robot_state-ego": 0.0674175845252143}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.11872415698092915, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.06429152644198874, "in-drivable-lane": 0, "agent_compute-ego": 0.1572352233140365, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.09909786089606908, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.04774820545445318, "sim_compute_performance-ego": 0.06934194720309714, "sim_compute_robot_state-ego": 0.078100077483965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.09829109553332742, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.05859089986374389, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.14517880901354088, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.08882008404492243, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.036927811086994326, "sim_compute_performance-ego": 0.0633139773590924, "sim_compute_robot_state-ego": 0.06981341479575798}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.10342088767460414, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.056389151300702774, "in-drivable-lane": 0, "agent_compute-ego": 0.1458723613194057, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.09143108640398298, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.037063281876700264, "sim_compute_performance-ego": 0.06354445048740932, "sim_compute_robot_state-ego": 0.06783135277884347}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.10041950118373816, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.05765419778689533, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.14354698087128115, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.0922200427928441, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.036962492365232656, "sim_compute_performance-ego": 0.06592633186931342, "sim_compute_robot_state-ego": 0.06831178195039991}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.09780183564061704, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.05558329561482305, "in-drivable-lane": 0, "agent_compute-ego": 0.13129594533339792, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.08958671403967816, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.03305868480516517, "sim_compute_performance-ego": 0.061823860458705734, "sim_compute_robot_state-ego": 0.06403073538904605}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.10506605307261148, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.05691059695349799, "in-drivable-lane": 0, "agent_compute-ego": 0.14426073763105604, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.0891358560985989, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.03685417970021566, "sim_compute_performance-ego": 0.06366237004597981, "sim_compute_robot_state-ego": 0.06947972244686551}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.11021935248720471, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.05833298572595569, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.14963838155718817, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.08930477197619452, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.037501677222873855, "sim_compute_performance-ego": 0.06739770502283954, "sim_compute_robot_state-ego": 0.06942608045495074}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.07781702115995075, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.045892590776495976, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.11602749518298228, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.06958249512068722, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.029007212831339703, "sim_compute_performance-ego": 0.04869504806098588, "sim_compute_robot_state-ego": 0.05025367889929255}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.0832856794198354, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.04538893368509081, "in-drivable-lane": 0, "agent_compute-ego": 0.12249159150653416, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.06773063871595594, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.02775459819369846, "sim_compute_performance-ego": 0.04950284626748827, "sim_compute_robot_state-ego": 0.05155957738558451}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.07296421373490806, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.044202648478446245, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.11347536731966966, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.07290187327981852, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.029274124035732353, "sim_compute_performance-ego": 0.054119302214478415, "sim_compute_robot_state-ego": 0.05181171739701745}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.07929427340879279, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.0458046662605415, "in-drivable-lane": 0, "agent_compute-ego": 0.1195574938240698, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.07083348500526558, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.03083896232863604, "sim_compute_performance-ego": 0.0504585605556682, "sim_compute_robot_state-ego": 0.05017844701217393}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.07290810074548998, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.04633278767597626, "in-drivable-lane": 0, "agent_compute-ego": 0.11637298496926968, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.07000570772099791, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.029946607178177577, "sim_compute_performance-ego": 0.05035975859867586, "sim_compute_robot_state-ego": 0.05093941550037178}}
set_robot_commands_max0.09909786089606908
set_robot_commands_mean0.0842085050852777
set_robot_commands_median0.08930477197619452
set_robot_commands_min0.06773063871595594
sim_compute_performance-ego_max0.07011977093560355
sim_compute_performance-ego_mean0.06066023090888657
sim_compute_performance-ego_median0.0633139773590924
sim_compute_performance-ego_min0.04869504806098588
sim_compute_robot_state-ego_max0.078100077483965
sim_compute_robot_state-ego_mean0.06323867053272632
sim_compute_robot_state-ego_median0.0674175845252143
sim_compute_robot_state-ego_min0.05017844701217393
sim_compute_sim_state_max0.04774820545445318
sim_compute_sim_state_mean0.03504947854499409
sim_compute_sim_state_median0.03685417970021566
sim_compute_sim_state_min0.02775459819369846
sim_physics_max0.11872415698092915
sim_physics_mean0.09502864038619444
sim_physics_median0.09829109553332742
sim_physics_min0.07290810074548998
sim_render-ego_max0.06429152644198874
sim_render-ego_mean0.05418725098786162
sim_render-ego_median0.05675690637218009
sim_render-ego_min0.044202648478446245
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
230202378Liam Paullminimal_agent_python2 (Python 2)aido2-LFV-sim-validationstep1-simulationsuccessyes11690:09:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6707441932890994
survival_time_median3.649999999999995
deviation-center-line_median0.14435558631904788
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.06552887601511818
agent_compute-ego_mean0.06280630281722203
agent_compute-ego_median0.0628955066204071
agent_compute-ego_min0.06104443967342377
deviation-center-line_max0.2085822874042474
deviation-center-line_mean0.1589542518908908
deviation-center-line_min0.10686452122645386
deviation-heading_max0.6191860504142408
deviation-heading_mean0.523857550127959
deviation-heading_median0.5156622477370731
deviation-heading_min0.42218734391092383
driven_any_max1.5798273185720382
driven_any_mean0.9978358087547315
driven_any_median0.9948273195001778
driven_any_min0.3798605253583843
driven_lanedir_consec_max1.2017887891468408
driven_lanedir_consec_mean0.7740609626522831
driven_lanedir_consec_min0.366714522485295
driven_lanedir_max1.2017887891468408
driven_lanedir_mean0.7740609626522831
driven_lanedir_median0.6707441932890994
driven_lanedir_min0.366714522485295
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.6699999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1640774321882692, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05986731999540982, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0631806687132953, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08712793049746997, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03477472475130264, "sim_compute_performance-ego": 0.06583667454654224, "sim_compute_robot_state-ego": 0.0684784569152414, "sim_compute_robot_state-npc0": 0.06456412681161541, "sim_compute_robot_state-npc1": 0.06558044642618258, "sim_compute_robot_state-npc2": 0.06576648150404839, "sim_compute_robot_state-npc3": 0.06109000232121716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.17349733533086004, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05897752014366356, "in-drivable-lane": 0, "agent_compute-ego": 0.061382023063865865, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08884826866356102, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03321682440268027, "sim_compute_performance-ego": 0.06234375206199852, "sim_compute_robot_state-ego": 0.06749632551863387, "sim_compute_robot_state-npc0": 0.06552347621402226, "sim_compute_robot_state-npc1": 0.06344219800588247, "sim_compute_robot_state-npc2": 0.06538413666390083, "sim_compute_robot_state-npc3": 0.06129148844126109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.1820920216185706, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.06386107632092067, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06552887601511818, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0962388515472412, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03943673201969692, "sim_compute_performance-ego": 0.06948624125548772, "sim_compute_robot_state-ego": 0.07826523695673261, "sim_compute_robot_state-npc0": 0.06734562984534673, "sim_compute_robot_state-npc1": 0.06924572374139513, "sim_compute_robot_state-npc2": 0.07068343673433576, "sim_compute_robot_state-npc3": 0.07058608319078173}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.16953263325350626, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.057742342352867126, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06104443967342377, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08694963157176971, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03599854665143149, "sim_compute_performance-ego": 0.06488257433686938, "sim_compute_robot_state-ego": 0.06835811691624778, "sim_compute_robot_state-npc0": 0.06591954827308655, "sim_compute_robot_state-npc1": 0.06403729958193642, "sim_compute_robot_state-npc2": 0.06547597476414271, "sim_compute_robot_state-npc3": 0.06387626699038915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.18048782646656036, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06472700834274292, "in-drivable-lane": 0, "agent_compute-ego": 0.0628955066204071, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.09321898221969604, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04040811210870743, "sim_compute_performance-ego": 0.06805245578289032, "sim_compute_robot_state-ego": 0.07599849998950958, "sim_compute_robot_state-npc0": 0.07263916730880737, "sim_compute_robot_state-npc1": 0.06910749524831772, "sim_compute_robot_state-npc2": 0.0684482529759407, "sim_compute_robot_state-npc3": 0.07227946817874908}}
set_robot_commands_max0.0962388515472412
set_robot_commands_mean0.0904767328999476
set_robot_commands_median0.08884826866356102
set_robot_commands_min0.08694963157176971
sim_compute_performance-ego_max0.06948624125548772
sim_compute_performance-ego_mean0.06612033959675764
sim_compute_performance-ego_median0.06583667454654224
sim_compute_performance-ego_min0.06234375206199852
sim_compute_robot_state-ego_max0.07826523695673261
sim_compute_robot_state-ego_mean0.07171932725927305
sim_compute_robot_state-ego_median0.0684784569152414
sim_compute_robot_state-ego_min0.06749632551863387
sim_compute_robot_state-npc0_max0.07263916730880737
sim_compute_robot_state-npc0_mean0.06719838969057565
sim_compute_robot_state-npc0_median0.06591954827308655
sim_compute_robot_state-npc0_min0.06456412681161541
sim_compute_robot_state-npc1_max0.06924572374139513
sim_compute_robot_state-npc1_mean0.06628263260074287
sim_compute_robot_state-npc1_median0.06558044642618258
sim_compute_robot_state-npc1_min0.06344219800588247
sim_compute_robot_state-npc2_max0.07068343673433576
sim_compute_robot_state-npc2_mean0.06715165652847369
sim_compute_robot_state-npc2_median0.06576648150404839
sim_compute_robot_state-npc2_min0.06538413666390083
sim_compute_robot_state-npc3_max0.07227946817874908
sim_compute_robot_state-npc3_mean0.06582466182447963
sim_compute_robot_state-npc3_median0.06387626699038915
sim_compute_robot_state-npc3_min0.06109000232121716
sim_compute_sim_state_max0.04040811210870743
sim_compute_sim_state_mean0.03676698798676375
sim_compute_sim_state_median0.03599854665143149
sim_compute_sim_state_min0.03321682440268027
sim_physics_max0.1820920216185706
sim_physics_mean0.1739374497715533
sim_physics_median0.17349733533086004
sim_physics_min0.1640774321882692
sim_render-ego_max0.06472700834274292
sim_render-ego_mean0.06103505343112081
sim_render-ego_median0.05986731999540982
sim_render-ego_min0.057742342352867126
simulation-passed1
survival_time_max5.599999999999988
survival_time_mean3.6599999999999944
survival_time_min1.6000000000000008
230052406vguerraBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:15:05Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07491694695314322
survival_time_median1.2000000000000004
deviation-center-line_median0.05640650632522012
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18514677194448617
agent_compute-ego_mean0.15781646682479547
agent_compute-ego_median0.15999878020513625
agent_compute-ego_min0.118154915896329
deviation-center-line_max0.08992127954448668
deviation-center-line_mean0.06199087358005375
deviation-center-line_min0.029898656059950363
deviation-heading_max0.7793216720398054
deviation-heading_mean0.6351662554476409
deviation-heading_median0.627212219486254
deviation-heading_min0.44897143643374027
driven_any_max0.24030167248186943
driven_any_mean0.1637581090455199
driven_any_median0.15335033954569677
driven_any_min0.10719505692270384
driven_lanedir_consec_max0.1105641789865821
driven_lanedir_consec_mean0.0816277105454037
driven_lanedir_consec_min0.04884938601700406
driven_lanedir_max0.1105641789865821
driven_lanedir_mean0.0816277105454037
driven_lanedir_median0.07491694695314322
driven_lanedir_min0.04884938601700406
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21834837244228128, "sim_physics": 0.1967623450539329, "survival_time": 1.6500000000000008, "driven_lanedir": 0.08907174895440817, "sim_render-ego": 0.06126224633419153, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.16764759294914475, "deviation-heading": 0.627212219486254, "set_robot_commands": 0.09312995997342197, "deviation-center-line": 0.05640650632522012, "driven_lanedir_consec": 0.08907174895440817, "sim_compute_sim_state": 0.03755643873503714, "sim_compute_performance-ego": 0.0652910362590443, "sim_compute_robot_state-ego": 0.06922458879875415, "sim_compute_robot_state-npc0": 0.06928756742766409, "sim_compute_robot_state-npc1": 0.06901670224738843, "sim_compute_robot_state-npc2": 0.06910524946270567, "sim_compute_robot_state-npc3": 0.06384660258437648}, "udem1-1-0": {"driven_any": 0.2045346177376563, "sim_physics": 0.21124045848846432, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06362435804351518, "sim_render-ego": 0.05997539361317952, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15187825361887614, "deviation-heading": 0.7701213375122605, "set_robot_commands": 0.08562199274698894, "deviation-center-line": 0.052454023176684954, "driven_lanedir_consec": 0.06362435804351518, "sim_compute_sim_state": 0.03502531051635742, "sim_compute_performance-ego": 0.06684813499450684, "sim_compute_robot_state-ego": 0.07066365083058675, "sim_compute_robot_state-npc0": 0.06501454512278239, "sim_compute_robot_state-npc1": 0.06799400647481282, "sim_compute_robot_state-npc2": 0.0674485445022583, "sim_compute_robot_state-npc3": 0.0671061118443807}, "udem1-2-0": {"driven_any": 0.13473286612834703, "sim_physics": 0.21655885378519693, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10476909761056152, "sim_render-ego": 0.05189629963466099, "in-drivable-lane": 0, "agent_compute-ego": 0.15094499360947383, "deviation-heading": 0.44897143643374027, "set_robot_commands": 0.0914754413423084, "deviation-center-line": 0.08931524869683488, "driven_lanedir_consec": 0.10476909761056152, "sim_compute_sim_state": 0.0371892565772647, "sim_compute_performance-ego": 0.05950264703659784, "sim_compute_robot_state-ego": 0.06116531008765811, "sim_compute_robot_state-npc0": 0.06933429127647764, "sim_compute_robot_state-npc1": 0.06236848377046131, "sim_compute_robot_state-npc2": 0.06178171294076102, "sim_compute_robot_state-npc3": 0.06307389622642881}, "udem1-3-0": {"driven_any": 0.14291483300418928, "sim_physics": 0.20723029700192536, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10912498173282748, "sim_render-ego": 0.06438488310033624, "in-drivable-lane": 0, "agent_compute-ego": 0.15604416890577835, "deviation-heading": 0.4972118822697814, "set_robot_commands": 0.07843211564150723, "deviation-center-line": 0.08992127954448668, "driven_lanedir_consec": 0.10912498173282748, "sim_compute_sim_state": 0.03280678662386807, "sim_compute_performance-ego": 0.061022400856018066, "sim_compute_robot_state-ego": 0.06718773191625421, "sim_compute_robot_state-npc0": 0.058065143498507416, "sim_compute_robot_state-npc1": 0.06463762846860019, "sim_compute_robot_state-npc2": 0.05942730470137163, "sim_compute_robot_state-npc3": 0.06262124668468129}, "udem1-4-0": {"driven_any": 0.14178276315110397, "sim_physics": 0.14299599329630533, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0693188667294804, "sim_render-ego": 0.04609111944834391, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.1261963744958242, "deviation-heading": 0.680313885491405, "set_robot_commands": 0.0747896134853363, "deviation-center-line": 0.03890204995911767, "driven_lanedir_consec": 0.0693188667294804, "sim_compute_sim_state": 0.029874682426452637, "sim_compute_performance-ego": 0.04906908671061198, "sim_compute_robot_state-ego": 0.04971322417259216, "sim_compute_robot_state-npc0": 0.04903501272201538, "sim_compute_robot_state-npc1": 0.04909228285153707, "sim_compute_robot_state-npc2": 0.04815538724263509, "sim_compute_robot_state-npc3": 0.04800178607304891}, "udem1-5-0": {"driven_any": 0.24030167248186943, "sim_physics": 0.19300576713350084, "survival_time": 1.800000000000001, "driven_lanedir": 0.1105641789865821, "sim_render-ego": 0.062014374468061656, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17956925100750393, "deviation-heading": 0.711522804791074, "set_robot_commands": 0.10417728953891332, "deviation-center-line": 0.05306794922646514, "driven_lanedir_consec": 0.1105641789865821, "sim_compute_sim_state": 0.03960512081782023, "sim_compute_performance-ego": 0.06972606976826985, "sim_compute_robot_state-ego": 0.07638699478573269, "sim_compute_robot_state-npc0": 0.07075058751636082, "sim_compute_robot_state-npc1": 0.07029742002487183, "sim_compute_robot_state-npc2": 0.07434869474834865, "sim_compute_robot_state-npc3": 0.06719831625620525}, "udem1-6-0": {"driven_any": 0.11270150939795494, "sim_physics": 0.19045411348342897, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06620947043494141, "sim_render-ego": 0.058862042427062986, "in-drivable-lane": 0, "agent_compute-ego": 0.15037866830825805, "deviation-heading": 0.574895069984359, "set_robot_commands": 0.08213498592376708, "deviation-center-line": 0.07065463836309144, "driven_lanedir_consec": 0.06620947043494141, "sim_compute_sim_state": 0.03247301578521729, "sim_compute_performance-ego": 0.06199867725372314, "sim_compute_robot_state-ego": 0.06565209627151489, "sim_compute_robot_state-npc0": 0.060965991020202635, "sim_compute_robot_state-npc1": 0.06060079336166382, "sim_compute_robot_state-npc2": 0.05721924304962158, "sim_compute_robot_state-npc3": 0.05729689598083496}, "udem1-7-0": {"driven_any": 0.1336149242666562, "sim_physics": 0.21235532561937967, "survival_time": 1.2000000000000004, "driven_lanedir": 0.0899961456494276, "sim_render-ego": 0.05789129932721456, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16155225038528442, "deviation-heading": 0.60752994107739, "set_robot_commands": 0.09001559019088745, "deviation-center-line": 0.0882865571900123, "driven_lanedir_consec": 0.0899961456494276, "sim_compute_sim_state": 0.04108725984891256, "sim_compute_performance-ego": 0.06840490301450093, "sim_compute_robot_state-ego": 0.06754019856452942, "sim_compute_robot_state-npc0": 0.06690749526023865, "sim_compute_robot_state-npc1": 0.06699289878209432, "sim_compute_robot_state-npc2": 0.06943117578824361, "sim_compute_robot_state-npc3": 0.06530254085858662}, "udem1-8-0": {"driven_any": 0.20575347714638212, "sim_physics": 0.18548818677663803, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09245911790688988, "sim_render-ego": 0.05860523134469986, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.15143319219350815, "deviation-heading": 0.6593124368300722, "set_robot_commands": 0.0878848284482956, "deviation-center-line": 0.033001617047254836, "driven_lanedir_consec": 0.09245911790688988, "sim_compute_sim_state": 0.03576713055372238, "sim_compute_performance-ego": 0.06470448523759842, "sim_compute_robot_state-ego": 0.06826051324605942, "sim_compute_robot_state-npc0": 0.06687108427286148, "sim_compute_robot_state-npc1": 0.06426393985748291, "sim_compute_robot_state-npc2": 0.06699295341968536, "sim_compute_robot_state-npc3": 0.07018020749092102}, "udem1-9-0": {"driven_any": 0.17686662190033278, "sim_physics": 0.2169735176222665, "survival_time": 1.4000000000000006, "driven_lanedir": 0.04884938601700406, "sim_render-ego": 0.0617398875100272, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.1668195469038827, "deviation-heading": 0.6923571091860621, "set_robot_commands": 0.09687695332935878, "deviation-center-line": 0.029898656059950363, "driven_lanedir_consec": 0.04884938601700406, "sim_compute_sim_state": 0.04075289624077933, "sim_compute_performance-ego": 0.06619696957724434, "sim_compute_robot_state-ego": 0.07085728645324707, "sim_compute_robot_state-npc0": 0.06189301184245518, "sim_compute_robot_state-npc1": 0.06631543806621007, "sim_compute_robot_state-npc2": 0.06424848522458758, "sim_compute_robot_state-npc3": 0.06439448254449028}, "udem1-10-0": {"driven_any": 0.15335033954569677, "sim_physics": 0.2030539313952128, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07491694695314322, "sim_render-ego": 0.057423253854115806, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17715569337209067, "deviation-heading": 0.7793216720398054, "set_robot_commands": 0.10232097903887433, "deviation-center-line": 0.04275711231950694, "driven_lanedir_consec": 0.07491694695314322, "sim_compute_sim_state": 0.033921251694361367, "sim_compute_performance-ego": 0.060446312030156456, "sim_compute_robot_state-ego": 0.07092122236887614, "sim_compute_robot_state-npc0": 0.06298848986625671, "sim_compute_robot_state-npc1": 0.061445653438568115, "sim_compute_robot_state-npc2": 0.06188386678695679, "sim_compute_robot_state-npc3": 0.05842725435892741}, "udem1-11-0": {"driven_any": 0.10719505692270384, "sim_physics": 0.21713595163254512, "survival_time": 1.0500000000000005, "driven_lanedir": 0.0674366373970412, "sim_render-ego": 0.05815075692676362, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15999878020513625, "deviation-heading": 0.5780098992841516, "set_robot_commands": 0.09121677989051456, "deviation-center-line": 0.08622719415032296, "driven_lanedir_consec": 0.0674366373970412, "sim_compute_sim_state": 0.04015445709228515, "sim_compute_performance-ego": 0.06592631340026855, "sim_compute_robot_state-ego": 0.07653329485938662, "sim_compute_robot_state-npc0": 0.06967479842049736, "sim_compute_robot_state-npc1": 0.06270709491911389, "sim_compute_robot_state-npc2": 0.0628298010144915, "sim_compute_robot_state-npc3": 0.06476589611598424}, "udem1-12-0": {"driven_any": 0.20919584393940505, "sim_physics": 0.2149935469907873, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07322233861989269, "sim_render-ego": 0.06237471804899328, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16432654857635498, "deviation-heading": 0.6127680654042019, "set_robot_commands": 0.09123527302461512, "deviation-center-line": 0.05481453918108437, "driven_lanedir_consec": 0.07322233861989269, "sim_compute_sim_state": 0.037078331498538744, "sim_compute_performance-ego": 0.06237503360299503, "sim_compute_robot_state-ego": 0.066009521484375, "sim_compute_robot_state-npc0": 0.06444218579460592, "sim_compute_robot_state-npc1": 0.07045869266285616, "sim_compute_robot_state-npc2": 0.063881516456604, "sim_compute_robot_state-npc3": 0.06285198295817655}, "udem1-13-0": {"driven_any": 0.11094558254280916, "sim_physics": 0.1505636410279707, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05763463362986565, "sim_render-ego": 0.04346928813240745, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.118154915896329, "deviation-heading": 0.591563002444139, "set_robot_commands": 0.0661415620283647, "deviation-center-line": 0.0738916195200361, "driven_lanedir_consec": 0.05763463362986565, "sim_compute_sim_state": 0.025178356604142624, "sim_compute_performance-ego": 0.044275337999517266, "sim_compute_robot_state-ego": 0.04792765053835782, "sim_compute_robot_state-npc0": 0.04482061212713069, "sim_compute_robot_state-npc1": 0.04463608698411421, "sim_compute_robot_state-npc2": 0.04669378020546653, "sim_compute_robot_state-npc3": 0.04427168586037376}, "udem1-14-0": {"driven_any": 0.16413315507541087, "sim_physics": 0.1957005262374878, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10721774951547491, "sim_render-ego": 0.058618820630587064, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18514677194448617, "deviation-heading": 0.6963830694799161, "set_robot_commands": 0.0939657504741962, "deviation-center-line": 0.07026411294073753, "driven_lanedir_consec": 0.10721774951547491, "sim_compute_sim_state": 0.03878279832693247, "sim_compute_performance-ego": 0.06641199038578914, "sim_compute_robot_state-ego": 0.0687640355183528, "sim_compute_robot_state-npc0": 0.06968150689051701, "sim_compute_robot_state-npc1": 0.06584469171670768, "sim_compute_robot_state-npc2": 0.06341825998746432, "sim_compute_robot_state-npc3": 0.06728531764103816}}
set_robot_commands_max0.10417728953891332
set_robot_commands_mean0.08862794100515665
set_robot_commands_median0.09121677989051456
set_robot_commands_min0.0661415620283647
sim_compute_performance-ego_max0.06972606976826985
sim_compute_performance-ego_mean0.06214662654178948
sim_compute_performance-ego_median0.06470448523759842
sim_compute_performance-ego_min0.044275337999517266
sim_compute_robot_state-ego_max0.07653329485938662
sim_compute_robot_state-ego_mean0.06645382132641849
sim_compute_robot_state-ego_median0.06826051324605942
sim_compute_robot_state-ego_min0.04792765053835782
sim_compute_robot_state-npc0_max0.07075058751636082
sim_compute_robot_state-npc0_mean0.0633154882039049
sim_compute_robot_state-npc0_median0.06501454512278239
sim_compute_robot_state-npc0_min0.04482061212713069
sim_compute_robot_state-npc1_max0.07045869266285616
sim_compute_robot_state-npc1_mean0.06311145424176552
sim_compute_robot_state-npc1_median0.06463762846860019
sim_compute_robot_state-npc1_min0.04463608698411421
sim_compute_robot_state-npc2_max0.07434869474834865
sim_compute_robot_state-npc2_mean0.06245773170208012
sim_compute_robot_state-npc2_median0.06341825998746432
sim_compute_robot_state-npc2_min0.04669378020546653
sim_compute_robot_state-npc3_max0.07018020749092102
sim_compute_robot_state-npc3_mean0.06177494823189696
sim_compute_robot_state-npc3_median0.06384660258437648
sim_compute_robot_state-npc3_min0.04427168586037376
sim_compute_sim_state_max0.04108725984891256
sim_compute_sim_state_mean0.03581687288944614
sim_compute_sim_state_median0.037078331498538744
sim_compute_sim_state_min0.025178356604142624
sim_physics_max0.21713595163254512
sim_physics_mean0.19696749703633615
sim_physics_median0.2030539313952128
sim_physics_min0.14299599329630533
sim_render-ego_max0.06438488310033624
sim_render-ego_mean0.05751730765337639
sim_render-ego_median0.058618820630587064
sim_render-ego_min0.04346928813240745
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.323333333333334
survival_time_min1.0000000000000002
229912412jp18813100494Baseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes11690:13:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229882417Andrea Censirandom_agentaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:45Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.14468092254445522
agent_compute-ego_mean0.1308318340220193
agent_compute-ego_median0.1295960302706118
agent_compute-ego_min0.12213953803567323
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1076204600157561, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05772285991244846, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1295960302706118, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09321753184000652, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037863987463491934, "sim_compute_performance-ego": 0.06376502690491853, "sim_compute_robot_state-ego": 0.07028130690256755}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10682015325508866, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05676682790120443, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12731181873994715, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08656997306674134, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.035748107760560276, "sim_compute_performance-ego": 0.06023240556903914, "sim_compute_robot_state-ego": 0.06740412525102205}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10718690647798426, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.053937336977790386, "in-drivable-lane": 0, "agent_compute-ego": 0.12213953803567323, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08536829667932846, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03676623456618365, "sim_compute_performance-ego": 0.06134493210736443, "sim_compute_robot_state-ego": 0.07186105672050924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11015021324157714, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05966569900512695, "in-drivable-lane": 0, "agent_compute-ego": 0.1304308605194092, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08796448707580566, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03649927139282227, "sim_compute_performance-ego": 0.06304806709289551, "sim_compute_robot_state-ego": 0.06287601470947266}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10528943206690534, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06073552143724659, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14468092254445522, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09367075751099406, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03727357598799694, "sim_compute_performance-ego": 0.06319448917726928, "sim_compute_robot_state-ego": 0.0722095272209071}}
set_robot_commands_max0.09367075751099406
set_robot_commands_mean0.08935820923457521
set_robot_commands_median0.08796448707580566
set_robot_commands_min0.08536829667932846
sim_compute_performance-ego_max0.06376502690491853
sim_compute_performance-ego_mean0.06231698417029737
sim_compute_performance-ego_median0.06304806709289551
sim_compute_performance-ego_min0.06023240556903914
sim_compute_robot_state-ego_max0.0722095272209071
sim_compute_robot_state-ego_mean0.06892640616089571
sim_compute_robot_state-ego_median0.07028130690256755
sim_compute_robot_state-ego_min0.06287601470947266
sim_compute_sim_state_max0.037863987463491934
sim_compute_sim_state_mean0.03683023543421101
sim_compute_sim_state_median0.03676623456618365
sim_compute_sim_state_min0.035748107760560276
sim_physics_max0.11015021324157714
sim_physics_mean0.1074134330114623
sim_physics_median0.10718690647798426
sim_physics_min0.10528943206690534
sim_render-ego_max0.06073552143724659
sim_render-ego_mean0.05776564904676336
sim_render-ego_median0.05772285991244846
sim_render-ego_min0.053937336977790386
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
229692447enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11690:22:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.339366254383536
survival_time_median14.950000000000076
deviation-center-line_median1.4012763877174623
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.16230473359425862
agent_compute-ego_mean0.15666086371739704
agent_compute-ego_median0.1584425481160482
agent_compute-ego_min0.14875588655471805
deviation-center-line_max1.5195321274570266
deviation-center-line_mean1.174486624766163
deviation-center-line_min0.26894128230124625
deviation-heading_max8.502617994731201
deviation-heading_mean7.58692926837743
deviation-heading_median8.166880118443489
deviation-heading_min5.592005976497815
driven_any_max4.378506444052819
driven_any_mean4.37850644405281
driven_any_median4.37850644405281
driven_any_min4.378506444052802
driven_lanedir_consec_max-1.3108775667725403
driven_lanedir_consec_mean-1.3430087925060197
driven_lanedir_consec_min-1.375791811242363
driven_lanedir_max-1.339366254383536
driven_lanedir_mean-2.3543334685387003
driven_lanedir_median-2.5973993077066466
driven_lanedir_min-2.7107548643537447
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.5700000000000194
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052806, "sim_physics": 0.10768850644429524, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643537447, "sim_render-ego": 0.060281148751576745, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.15947402318318685, "deviation-heading": 8.372894374860635, "set_robot_commands": 0.09014412641525268, "deviation-center-line": 1.5195321274570266, "driven_lanedir_consec": -1.3108775667725403, "sim_compute_sim_state": 0.037864320278167725, "sim_compute_performance-ego": 0.06637497266133627, "sim_compute_robot_state-ego": 0.07115665753682454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052802, "sim_physics": 0.11003500620524088, "survival_time": 14.950000000000076, "driven_lanedir": -2.44752976847699, "sim_render-ego": 0.05879507621129354, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.1584425481160482, "deviation-heading": 7.300247877354016, "set_robot_commands": 0.08890501578648885, "deviation-center-line": 1.1660826179431367, "driven_lanedir_consec": -1.375791811242363, "sim_compute_sim_state": 0.03743621031443278, "sim_compute_performance-ego": 0.0655603035291036, "sim_compute_robot_state-ego": 0.07081924597422282}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.09606300354003906, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.06144879897435506, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.14875588655471805, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.08191430568695068, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.03447505394617716, "sim_compute_performance-ego": 0.05969450871149699, "sim_compute_robot_state-ego": 0.0660016663869222}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052819, "sim_physics": 0.1097927474975586, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725837, "sim_render-ego": 0.0574702262878418, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.1543271271387736, "deviation-heading": 8.502617994731201, "set_robot_commands": 0.08922839403152466, "deviation-center-line": 1.516600708411943, "driven_lanedir_consec": -1.3215500552073602, "sim_compute_sim_state": 0.03897859255472819, "sim_compute_performance-ego": 0.06676249265670776, "sim_compute_robot_state-ego": 0.07030021508534749}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052814, "sim_physics": 0.10564478079477946, "survival_time": 14.950000000000076, "driven_lanedir": -2.5973993077066466, "sim_render-ego": 0.05999253829320272, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.16230473359425862, "deviation-heading": 8.166880118443489, "set_robot_commands": 0.09055798371632894, "deviation-center-line": 1.4012763877174623, "driven_lanedir_consec": -1.3674582749242976, "sim_compute_sim_state": 0.03919533252716065, "sim_compute_performance-ego": 0.06788738489151001, "sim_compute_robot_state-ego": 0.07092122157414754}}
set_robot_commands_max0.09055798371632894
set_robot_commands_mean0.08814996512730916
set_robot_commands_median0.08922839403152466
set_robot_commands_min0.08191430568695068
sim_compute_performance-ego_max0.06788738489151001
sim_compute_performance-ego_mean0.06525593249003094
sim_compute_performance-ego_median0.06637497266133627
sim_compute_performance-ego_min0.05969450871149699
sim_compute_robot_state-ego_max0.07115665753682454
sim_compute_robot_state-ego_mean0.06983980131149292
sim_compute_robot_state-ego_median0.07081924597422282
sim_compute_robot_state-ego_min0.0660016663869222
sim_compute_sim_state_max0.03919533252716065
sim_compute_sim_state_mean0.0375899019241333
sim_compute_sim_state_median0.037864320278167725
sim_compute_sim_state_min0.03447505394617716
sim_physics_max0.11003500620524088
sim_physics_mean0.10584480889638263
sim_physics_median0.10768850644429524
sim_physics_min0.09606300354003906
sim_render-ego_max0.06144879897435506
sim_render-ego_mean0.05959755770365397
sim_render-ego_median0.05999253829320272
sim_render-ego_min0.0574702262878418
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
229552472Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.14565808243221706
agent_compute-ego_mean0.13631657833298827
agent_compute-ego_median0.13562668800354005
agent_compute-ego_min0.12634257893813283
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.15821173014464202, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05563365088568793, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14565808243221706, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08642429334146005, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.036166513407671894, "sim_compute_performance-ego": 0.06291518387971101, "sim_compute_robot_state-ego": 0.06601080188044796, "sim_compute_robot_state-npc0": 0.06401440832349989, "sim_compute_robot_state-npc1": 0.06293187318024812, "sim_compute_robot_state-npc2": 0.06268769723397714, "sim_compute_robot_state-npc3": 0.061932259135776095}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1606271457672119, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.054636049270629886, "in-drivable-lane": 0, "agent_compute-ego": 0.13562668800354005, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09244461059570312, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03521843910217285, "sim_compute_performance-ego": 0.05779995918273926, "sim_compute_robot_state-ego": 0.05590242385864258, "sim_compute_robot_state-npc0": 0.06620275497436523, "sim_compute_robot_state-npc1": 0.08011174201965332, "sim_compute_robot_state-npc2": 0.06284611701965331, "sim_compute_robot_state-npc3": 0.0591876220703125}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12700644292329488, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.04688173532485962, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.12634257893813283, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08046422506633558, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.029713737337212817, "sim_compute_performance-ego": 0.052965989238337466, "sim_compute_robot_state-ego": 0.055323748212111626, "sim_compute_robot_state-npc0": 0.05610183979335584, "sim_compute_robot_state-npc1": 0.05460271709843686, "sim_compute_robot_state-npc2": 0.05724144295642251, "sim_compute_robot_state-npc3": 0.0546414946254931}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18573508383352547, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05700436724892145, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13899476316910755, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08832041824920268, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03740670711179323, "sim_compute_performance-ego": 0.06295156177086166, "sim_compute_robot_state-ego": 0.066396752490273, "sim_compute_robot_state-npc0": 0.06496730031846445, "sim_compute_robot_state-npc1": 0.06433687934392615, "sim_compute_robot_state-npc2": 0.06893576247782647, "sim_compute_robot_state-npc3": 0.06463940535919575}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1558683259146554, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05609491041728428, "in-drivable-lane": 0, "agent_compute-ego": 0.13496077912194387, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08738267421722412, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03717180660792759, "sim_compute_performance-ego": 0.06099998950958252, "sim_compute_robot_state-ego": 0.06271012340273176, "sim_compute_robot_state-npc0": 0.06099933385848999, "sim_compute_robot_state-npc1": 0.08293798140117101, "sim_compute_robot_state-npc2": 0.06154865026473999, "sim_compute_robot_state-npc3": 0.06306268487657819}}
set_robot_commands_max0.09244461059570312
set_robot_commands_mean0.08700724429398511
set_robot_commands_median0.08738267421722412
set_robot_commands_min0.08046422506633558
sim_compute_performance-ego_max0.06295156177086166
sim_compute_performance-ego_mean0.05952653671624638
sim_compute_performance-ego_median0.06099998950958252
sim_compute_performance-ego_min0.052965989238337466
sim_compute_robot_state-ego_max0.066396752490273
sim_compute_robot_state-ego_mean0.06126876996884138
sim_compute_robot_state-ego_median0.06271012340273176
sim_compute_robot_state-ego_min0.055323748212111626
sim_compute_robot_state-npc0_max0.06620275497436523
sim_compute_robot_state-npc0_mean0.062457127453635075
sim_compute_robot_state-npc0_median0.06401440832349989
sim_compute_robot_state-npc0_min0.05610183979335584
sim_compute_robot_state-npc1_max0.08293798140117101
sim_compute_robot_state-npc1_mean0.0689842386086871
sim_compute_robot_state-npc1_median0.06433687934392615
sim_compute_robot_state-npc1_min0.05460271709843686
sim_compute_robot_state-npc2_max0.06893576247782647
sim_compute_robot_state-npc2_mean0.06265193399052389
sim_compute_robot_state-npc2_median0.06268769723397714
sim_compute_robot_state-npc2_min0.05724144295642251
sim_compute_robot_state-npc3_max0.06463940535919575
sim_compute_robot_state-npc3_mean0.06069269321347113
sim_compute_robot_state-npc3_median0.061932259135776095
sim_compute_robot_state-npc3_min0.0546414946254931
sim_compute_sim_state_max0.03740670711179323
sim_compute_sim_state_mean0.035135440713355684
sim_compute_sim_state_median0.036166513407671894
sim_compute_sim_state_min0.029713737337212817
sim_physics_max0.18573508383352547
sim_physics_mean0.1574897457166659
sim_physics_median0.15821173014464202
sim_physics_min0.12700644292329488
sim_render-ego_max0.05700436724892145
sim_render-ego_mean0.054050142629476626
sim_render-ego_median0.05563365088568793
sim_render-ego_min0.04688173532485962
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
229502484Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationerroryes11690:01:22
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229352503RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerroryes11690:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229202512RamiNaimchallenge-aido_LF-template-rosaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:55
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229142528Liam Paullbaseline-IL-sim-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11690:03:06
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229002551Andrea Censichallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationerroryes11690:11:37
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228942561AlexKaravaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:32Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07335840100827425
agent_compute-ego_mean0.06896229195626642
agent_compute-ego_median0.07018094261487325
agent_compute-ego_min0.06239583889643351
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11121665256124148, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.060719469903220594, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.068386198769153, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09335710632968956, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0394919623791332, "sim_compute_performance-ego": 0.06682284113386987, "sim_compute_robot_state-ego": 0.07330119777733171}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10624462763468424, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.0564763863881429, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06239583889643351, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.0862854798634847, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.037352542082468666, "sim_compute_performance-ego": 0.061874922116597494, "sim_compute_robot_state-ego": 0.06756792465845744}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.14028200236233798, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06270514835010875, "in-drivable-lane": 0, "agent_compute-ego": 0.0704900784925981, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09526532346552068, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03897812149741433, "sim_compute_performance-ego": 0.07625582001426003, "sim_compute_robot_state-ego": 0.0899157307364724}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.11159890393416089, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05581318338712057, "in-drivable-lane": 0, "agent_compute-ego": 0.07018094261487325, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0944691151380539, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03677787880102793, "sim_compute_performance-ego": 0.06092542906602224, "sim_compute_robot_state-ego": 0.06812359889348348}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.10988779689954677, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.058256284050319504, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07335840100827425, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.0874632337818975, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0365890938302745, "sim_compute_performance-ego": 0.06198041853697404, "sim_compute_robot_state-ego": 0.06775163567584494}}
set_robot_commands_max0.09526532346552068
set_robot_commands_mean0.09136805171572927
set_robot_commands_median0.09335710632968956
set_robot_commands_min0.0862854798634847
sim_compute_performance-ego_max0.07625582001426003
sim_compute_performance-ego_mean0.06557188617354473
sim_compute_performance-ego_median0.06198041853697404
sim_compute_performance-ego_min0.06092542906602224
sim_compute_robot_state-ego_max0.0899157307364724
sim_compute_robot_state-ego_mean0.073332017548318
sim_compute_robot_state-ego_median0.06812359889348348
sim_compute_robot_state-ego_min0.06756792465845744
sim_compute_sim_state_max0.0394919623791332
sim_compute_sim_state_mean0.03783791971806373
sim_compute_sim_state_median0.037352542082468666
sim_compute_sim_state_min0.0365890938302745
sim_physics_max0.14028200236233798
sim_physics_mean0.11584599667839428
sim_physics_median0.11121665256124148
sim_physics_min0.10624462763468424
sim_render-ego_max0.06270514835010875
sim_render-ego_mean0.05879409441578246
sim_render-ego_median0.058256284050319504
sim_render-ego_min0.05581318338712057
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
228642612Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:24:33Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.1182025764502731
agent_compute-ego_mean0.07218527742849506
agent_compute-ego_median0.06858522464067508
agent_compute-ego_min0.055423399981330425
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.17883500133652286, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0584233381662024, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.06463591449231987, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.08577713334416769, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.037531683243900896, "sim_compute_performance-ego": 0.06391948389719768, "sim_compute_robot_state-ego": 0.07123779676046717, "sim_compute_robot_state-npc0": 0.06489387764988175, "sim_compute_robot_state-npc1": 0.06331586550517254, "sim_compute_robot_state-npc2": 0.06257144514336643, "sim_compute_robot_state-npc3": 0.06279304515884583}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23798551382841887, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06869525379604763, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07832737322206851, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.1071468989054362, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04101046809443721, "sim_compute_performance-ego": 0.07112035044917354, "sim_compute_robot_state-ego": 0.07480189535352919, "sim_compute_robot_state-npc0": 0.07268694595054344, "sim_compute_robot_state-npc1": 0.07303886943393284, "sim_compute_robot_state-npc2": 0.07496632470024957, "sim_compute_robot_state-npc3": 0.07361095039932816}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.1974443105550913, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06241538891425499, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.06858522464067508, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.08893310718047313, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.037116472537700944, "sim_compute_performance-ego": 0.06509231604062594, "sim_compute_robot_state-ego": 0.07130264318906344, "sim_compute_robot_state-npc0": 0.06616582931616367, "sim_compute_robot_state-npc1": 0.06552791901123829, "sim_compute_robot_state-npc2": 0.06631394227345784, "sim_compute_robot_state-npc3": 0.065575394874964}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.20377247375354432, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06002271802801835, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.06670985723796644, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.08838319778442383, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.036127918644955286, "sim_compute_performance-ego": 0.06419750263816432, "sim_compute_robot_state-ego": 0.06676478971514785, "sim_compute_robot_state-npc0": 0.06667746159068325, "sim_compute_robot_state-npc1": 0.06615903503016422, "sim_compute_robot_state-npc2": 0.06477302417420504, "sim_compute_robot_state-npc3": 0.06414328541672021}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.1984773718792459, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.05932931278062904, "in-drivable-lane": 0, "agent_compute-ego": 0.07181513827780019, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09556900936624278, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.0350753639055335, "sim_compute_performance-ego": 0.06727783576301906, "sim_compute_robot_state-ego": 0.07390937597855278, "sim_compute_robot_state-npc0": 0.06843996047973633, "sim_compute_robot_state-npc1": 0.06818456235139267, "sim_compute_robot_state-npc2": 0.18459471412326975, "sim_compute_robot_state-npc3": 0.06369316059610118}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.16499077806285783, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.05248020677005544, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.1182025764502731, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.08117310439839083, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.033624880454119516, "sim_compute_performance-ego": 0.05637503839006611, "sim_compute_robot_state-ego": 0.060294730990540744, "sim_compute_robot_state-npc0": 0.060158736565533805, "sim_compute_robot_state-npc1": 0.05897352742213829, "sim_compute_robot_state-npc2": 0.05925734837849935, "sim_compute_robot_state-npc3": 0.060294177017959895}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.16780497006007605, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.05462495258876256, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.06246045657566616, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.0823299561228071, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03312497309276036, "sim_compute_performance-ego": 0.0610404542514256, "sim_compute_robot_state-ego": 0.06297503198896136, "sim_compute_robot_state-npc0": 0.059922095707484656, "sim_compute_robot_state-npc1": 0.06074068716594151, "sim_compute_robot_state-npc2": 0.05891319683619907, "sim_compute_robot_state-npc3": 0.05983597721372332}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20091888675950975, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.05903211358475358, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06831390890356613, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.09137611519800472, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.036463574187396326, "sim_compute_performance-ego": 0.06679608070687072, "sim_compute_robot_state-ego": 0.07907395166893529, "sim_compute_robot_state-npc0": 0.07055724810247552, "sim_compute_robot_state-npc1": 0.06620511943346834, "sim_compute_robot_state-npc2": 0.06762623460325476, "sim_compute_robot_state-npc3": 0.06700992910829309}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.19624717291011368, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06219665948734727, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.0715740530989891, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.0979364555935527, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.039325689160546594, "sim_compute_performance-ego": 0.06728293452151986, "sim_compute_robot_state-ego": 0.07608327754708223, "sim_compute_robot_state-npc0": 0.07211226917976557, "sim_compute_robot_state-npc1": 0.07026178060575973, "sim_compute_robot_state-npc2": 0.06738817414572072, "sim_compute_robot_state-npc3": 0.06714277489240779}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.21634794198549712, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06582980889540452, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07020743993612436, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09335700365213248, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.03265473475823036, "sim_compute_performance-ego": 0.06209869568164532, "sim_compute_robot_state-ego": 0.06267233078296368, "sim_compute_robot_state-npc0": 0.06574597725501427, "sim_compute_robot_state-npc1": 0.06554730121905987, "sim_compute_robot_state-npc2": 0.06354972032400277, "sim_compute_robot_state-npc3": 0.06097202117626484}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.17440004666646322, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.05832966486612956, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06714889526367188, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09157020568847656, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.037905941009521486, "sim_compute_performance-ego": 0.06643189748128255, "sim_compute_robot_state-ego": 0.06670793533325195, "sim_compute_robot_state-npc0": 0.06693431536356607, "sim_compute_robot_state-npc1": 0.06619016647338867, "sim_compute_robot_state-npc2": 0.06830972989400227, "sim_compute_robot_state-npc3": 0.06821299235026042}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.16676324889773414, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.05391951969691685, "in-drivable-lane": 0, "agent_compute-ego": 0.06054502441769555, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.08312990551903135, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.031479869570050924, "sim_compute_performance-ego": 0.05435985610598609, "sim_compute_robot_state-ego": 0.05537143207731701, "sim_compute_robot_state-npc0": 0.05798929078238351, "sim_compute_robot_state-npc1": 0.056662616275605704, "sim_compute_robot_state-npc2": 0.0566919417608352, "sim_compute_robot_state-npc3": 0.058520566849481495}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.19464606462522996, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.05476085529770962, "in-drivable-lane": 1.15, "agent_compute-ego": 0.08149958211322163, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.08734471298927485, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.031736872916997866, "sim_compute_performance-ego": 0.05632791408272677, "sim_compute_robot_state-ego": 0.0803770242735397, "sim_compute_robot_state-npc0": 0.06277882775595021, "sim_compute_robot_state-npc1": 0.07397959398668866, "sim_compute_robot_state-npc2": 0.06278911856717842, "sim_compute_robot_state-npc3": 0.05542041534601256}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.1639129945210048, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.04902153355734689, "in-drivable-lane": 0, "agent_compute-ego": 0.07733031681605748, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.07930760724203927, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04580478157315936, "sim_compute_performance-ego": 0.05222690956933158, "sim_compute_robot_state-ego": 0.05570435523986816, "sim_compute_robot_state-npc0": 0.053854167461395264, "sim_compute_robot_state-npc1": 0.05543012278420584, "sim_compute_robot_state-npc2": 0.0686456561088562, "sim_compute_robot_state-npc3": 0.08756314856665474}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.1665807705299527, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.047918268278533335, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.055423399981330425, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0752409112219717, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.029193798700968426, "sim_compute_performance-ego": 0.05081833577623554, "sim_compute_robot_state-ego": 0.053795333002127854, "sim_compute_robot_state-npc0": 0.05575078608942967, "sim_compute_robot_state-npc1": 0.05264792722814223, "sim_compute_robot_state-npc2": 0.05182823012856876, "sim_compute_robot_state-npc3": 0.05162605117349064}}
set_robot_commands_max0.1071468989054362
set_robot_commands_mean0.08857168828042836
set_robot_commands_median0.08838319778442383
set_robot_commands_min0.0752409112219717
sim_compute_performance-ego_max0.07112035044917354
sim_compute_performance-ego_mean0.06169104035701805
sim_compute_performance-ego_median0.06391948389719768
sim_compute_performance-ego_min0.05081833577623554
sim_compute_robot_state-ego_max0.0803770242735397
sim_compute_robot_state-ego_mean0.06740479359342322
sim_compute_robot_state-ego_median0.06676478971514785
sim_compute_robot_state-ego_min0.053795333002127854
sim_compute_robot_state-npc0_max0.07268694595054344
sim_compute_robot_state-npc0_mean0.06431118595000046
sim_compute_robot_state-npc0_median0.06574597725501427
sim_compute_robot_state-npc0_min0.053854167461395264
sim_compute_robot_state-npc1_max0.07397959398668866
sim_compute_robot_state-npc1_mean0.0641910062617533
sim_compute_robot_state-npc1_median0.06554730121905987
sim_compute_robot_state-npc1_min0.05264792722814223
sim_compute_robot_state-npc2_max0.18459471412326975
sim_compute_robot_state-npc2_mean0.07188125341077775
sim_compute_robot_state-npc2_median0.06477302417420504
sim_compute_robot_state-npc2_min0.05182823012856876
sim_compute_robot_state-npc3_max0.08756314856665474
sim_compute_robot_state-npc3_mean0.06442759267603389
sim_compute_robot_state-npc3_median0.06369316059610118
sim_compute_robot_state-npc3_min0.05162605117349064
sim_compute_sim_state_max0.04580478157315936
sim_compute_sim_state_mean0.03587846812335193
sim_compute_sim_state_median0.036127918644955286
sim_compute_sim_state_min0.029193798700968426
sim_physics_max0.23798551382841887
sim_physics_mean0.1886085030914175
sim_physics_median0.19464606462522996
sim_physics_min0.1639129945210048
sim_render-ego_max0.06869525379604763
sim_render-ego_mean0.0577999729805408
sim_render-ego_median0.0584233381662024
sim_render-ego_min0.047918268278533335
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
228592621Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1534561061859131
agent_compute-ego_mean0.1414709274175197
agent_compute-ego_median0.14478258396449842
agent_compute-ego_min0.11568454333714076
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16723294169814498, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06265779336293538, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14904036786821154, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09616708755493164, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.039799902174207896, "sim_compute_performance-ego": 0.06770446123900237, "sim_compute_robot_state-ego": 0.07606213181107133, "sim_compute_robot_state-npc0": 0.06834197044372559, "sim_compute_robot_state-npc1": 0.06981298217067013, "sim_compute_robot_state-npc2": 0.06802170806460911, "sim_compute_robot_state-npc3": 0.06818524554923729}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1938871192932129, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06411319732666015, "in-drivable-lane": 0, "agent_compute-ego": 0.1534561061859131, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0921469497680664, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.0388402271270752, "sim_compute_performance-ego": 0.06790167808532716, "sim_compute_robot_state-ego": 0.07621310234069824, "sim_compute_robot_state-npc0": 0.06792044639587402, "sim_compute_robot_state-npc1": 0.06836292266845703, "sim_compute_robot_state-npc2": 0.06869984626770019, "sim_compute_robot_state-npc3": 0.06871854782104492}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17380189895629883, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05855465562720048, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14478258396449842, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08797462676700793, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03692041572771574, "sim_compute_performance-ego": 0.06629693194439537, "sim_compute_robot_state-ego": 0.06878463531795301, "sim_compute_robot_state-npc0": 0.06442823221808985, "sim_compute_robot_state-npc1": 0.06438963350496794, "sim_compute_robot_state-npc2": 0.06297585525010761, "sim_compute_robot_state-npc3": 0.0636587425282127}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17755194253559353, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05686872518515285, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1443910357318347, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09232374988024748, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03674666791022578, "sim_compute_performance-ego": 0.06376471096956277, "sim_compute_robot_state-ego": 0.06789554523516304, "sim_compute_robot_state-npc0": 0.06666616548465777, "sim_compute_robot_state-npc1": 0.06476785563215424, "sim_compute_robot_state-npc2": 0.0658590944507454, "sim_compute_robot_state-npc3": 0.06617600404763524}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12418924910681588, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04441388164247785, "in-drivable-lane": 0, "agent_compute-ego": 0.11568454333714076, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.07291548592703682, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.02986724036080497, "sim_compute_performance-ego": 0.049084254673549106, "sim_compute_robot_state-ego": 0.09195435898644584, "sim_compute_robot_state-npc0": 0.050221996647971015, "sim_compute_robot_state-npc1": 0.05239453486033848, "sim_compute_robot_state-npc2": 0.05204435757228306, "sim_compute_robot_state-npc3": 0.05192406688417707}}
set_robot_commands_max0.09616708755493164
set_robot_commands_mean0.08830557997945807
set_robot_commands_median0.0921469497680664
set_robot_commands_min0.07291548592703682
sim_compute_performance-ego_max0.06790167808532716
sim_compute_performance-ego_mean0.06295040738236736
sim_compute_performance-ego_median0.06629693194439537
sim_compute_performance-ego_min0.049084254673549106
sim_compute_robot_state-ego_max0.09195435898644584
sim_compute_robot_state-ego_mean0.07618195473826629
sim_compute_robot_state-ego_median0.07606213181107133
sim_compute_robot_state-ego_min0.06789554523516304
sim_compute_robot_state-npc0_max0.06834197044372559
sim_compute_robot_state-npc0_mean0.06351576223806364
sim_compute_robot_state-npc0_median0.06666616548465777
sim_compute_robot_state-npc0_min0.050221996647971015
sim_compute_robot_state-npc1_max0.06981298217067013
sim_compute_robot_state-npc1_mean0.06394558576731757
sim_compute_robot_state-npc1_median0.06476785563215424
sim_compute_robot_state-npc1_min0.05239453486033848
sim_compute_robot_state-npc2_max0.06869984626770019
sim_compute_robot_state-npc2_mean0.06352017232108907
sim_compute_robot_state-npc2_median0.0658590944507454
sim_compute_robot_state-npc2_min0.05204435757228306
sim_compute_robot_state-npc3_max0.06871854782104492
sim_compute_robot_state-npc3_mean0.06373252136606143
sim_compute_robot_state-npc3_median0.06617600404763524
sim_compute_robot_state-npc3_min0.05192406688417707
sim_compute_sim_state_max0.039799902174207896
sim_compute_sim_state_mean0.03643489066000592
sim_compute_sim_state_median0.03692041572771574
sim_compute_sim_state_min0.02986724036080497
sim_physics_max0.1938871192932129
sim_physics_mean0.1673326303180132
sim_physics_median0.17380189895629883
sim_physics_min0.12418924910681588
sim_render-ego_max0.06411319732666015
sim_render-ego_mean0.057321650628885334
sim_render-ego_median0.05855465562720048
sim_render-ego_min0.04441388164247785
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
228462633Andrea Censichallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.17755488838468278
agent_compute-ego_mean0.15240288644407302
agent_compute-ego_median0.14812106132507324
agent_compute-ego_min0.1389357198642779
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1474917906301993, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05718990166982015, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14799557350299977, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08671904934777154, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037823504871792264, "sim_compute_performance-ego": 0.06051652078275328, "sim_compute_robot_state-ego": 0.06581000487009685, "sim_compute_robot_state-npc0": 0.06700247746926767, "sim_compute_robot_state-npc1": 0.06862560466483787, "sim_compute_robot_state-npc2": 0.06452735265096028, "sim_compute_robot_state-npc3": 0.06447519637920239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1798582363128662, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0553582763671875, "in-drivable-lane": 0, "agent_compute-ego": 0.14812106132507324, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09095892906188964, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.041527013778686526, "sim_compute_performance-ego": 0.05951970100402832, "sim_compute_robot_state-ego": 0.06276653289794921, "sim_compute_robot_state-npc0": 0.06634442329406738, "sim_compute_robot_state-npc1": 0.0697330379486084, "sim_compute_robot_state-npc2": 0.07164067268371582, "sim_compute_robot_state-npc3": 0.06951704025268554}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.1732350368248789, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.061908085095255, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14940718914333145, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08969562618356001, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.0374992991748609, "sim_compute_performance-ego": 0.07082227970424451, "sim_compute_robot_state-ego": 0.07192142699894152, "sim_compute_robot_state-npc0": 0.0634148120880127, "sim_compute_robot_state-npc1": 0.0668225696212367, "sim_compute_robot_state-npc2": 0.06538675019615575, "sim_compute_robot_state-npc3": 0.06416409894039757}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.17432209208041807, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05549545227726803, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1389357198642779, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0860226848457433, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.0353407980520514, "sim_compute_performance-ego": 0.06215010111844992, "sim_compute_robot_state-ego": 0.06773116316976427, "sim_compute_robot_state-npc0": 0.06430658811255346, "sim_compute_robot_state-npc1": 0.06344874901107594, "sim_compute_robot_state-npc2": 0.063851552673533, "sim_compute_robot_state-npc3": 0.06429938726787325}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1675068395478385, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05958873885018485, "in-drivable-lane": 0, "agent_compute-ego": 0.17755488838468278, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0904221705027989, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.039251361574445455, "sim_compute_performance-ego": 0.06594703027180263, "sim_compute_robot_state-ego": 0.07235567910330636, "sim_compute_robot_state-npc0": 0.06686457565852574, "sim_compute_robot_state-npc1": 0.06242257356643677, "sim_compute_robot_state-npc2": 0.06847038439341954, "sim_compute_robot_state-npc3": 0.07189409221921648}}
set_robot_commands_max0.09095892906188964
set_robot_commands_mean0.08876369198835268
set_robot_commands_median0.08969562618356001
set_robot_commands_min0.0860226848457433
sim_compute_performance-ego_max0.07082227970424451
sim_compute_performance-ego_mean0.06379112657625574
sim_compute_performance-ego_median0.06215010111844992
sim_compute_performance-ego_min0.05951970100402832
sim_compute_robot_state-ego_max0.07235567910330636
sim_compute_robot_state-ego_mean0.06811696140801164
sim_compute_robot_state-ego_median0.06773116316976427
sim_compute_robot_state-ego_min0.06276653289794921
sim_compute_robot_state-npc0_max0.06700247746926767
sim_compute_robot_state-npc0_mean0.06558657532448539
sim_compute_robot_state-npc0_median0.06634442329406738
sim_compute_robot_state-npc0_min0.0634148120880127
sim_compute_robot_state-npc1_max0.0697330379486084
sim_compute_robot_state-npc1_mean0.06621050696243913
sim_compute_robot_state-npc1_median0.0668225696212367
sim_compute_robot_state-npc1_min0.06242257356643677
sim_compute_robot_state-npc2_max0.07164067268371582
sim_compute_robot_state-npc2_mean0.06677534251955689
sim_compute_robot_state-npc2_median0.06538675019615575
sim_compute_robot_state-npc2_min0.063851552673533
sim_compute_robot_state-npc3_max0.07189409221921648
sim_compute_robot_state-npc3_mean0.06686996301187505
sim_compute_robot_state-npc3_median0.06447519637920239
sim_compute_robot_state-npc3_min0.06416409894039757
sim_compute_sim_state_max0.041527013778686526
sim_compute_sim_state_mean0.038288395490367305
sim_compute_sim_state_median0.037823504871792264
sim_compute_sim_state_min0.0353407980520514
sim_physics_max0.1798582363128662
sim_physics_mean0.1684827990792402
sim_physics_median0.1732350368248789
sim_physics_min0.1474917906301993
sim_render-ego_max0.061908085095255
sim_render-ego_mean0.05790809085194311
sim_render-ego_median0.05718990166982015
sim_render-ego_min0.0553582763671875
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
228402656zamatorychallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:15:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228382664RamiNaimModidfied configaido2-LF-sim-testingstep1-simulationerroryes11690:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228362668RamiNaimModidfied configaido2-LFV-sim-testingstep1-simulationerroryes11690:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228342669RamiNaimModidfied configaido2-LFV-sim-validationstep1-simulationerroryes11690:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228332672RamiNaimModidfied configaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228322673RamiNaimModidfied configaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228142708RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-validationstep1-simulationsuccessyes11690:31:13Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9602362195441052
survival_time_median14.950000000000076
deviation-center-line_median1.021174797456825
in-drivable-lane_median2.000000000000014


other stats
agent_compute-ego_max0.0938571432362432
agent_compute-ego_mean0.09003650160916912
agent_compute-ego_median0.09168352444966632
agent_compute-ego_min0.08523769060770671
deviation-center-line_max1.1865681824346217
deviation-center-line_mean0.8422476215084849
deviation-center-line_min0.22683483670237156
deviation-heading_max7.407076536464438
deviation-heading_mean5.131962918230649
deviation-heading_median6.918808897111082
deviation-heading_min1.7999697601183915
driven_any_max2.3486040874619123
driven_any_mean1.8037203711095755
driven_any_median2.34853514961698
driven_any_min0.870297727821699
driven_lanedir_consec_max1.1675097080656451
driven_lanedir_consec_mean0.8914021715212262
driven_lanedir_consec_min0.4567130552402529
driven_lanedir_max1.6272722403920228
driven_lanedir_mean1.2062607784220605
driven_lanedir_median1.3949694402438109
driven_lanedir_min0.4567130552402529
in-drivable-lane_max2.9000000000000163
in-drivable-lane_mean1.790000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.102609716283609, "sim_physics": 0.19969594478607175, "survival_time": 7.299999999999982, "driven_lanedir": 0.9926581727749428, "sim_render-ego": 0.06827630245522277, "in-drivable-lane": 0, "agent_compute-ego": 0.08733000983930614, "deviation-heading": 2.356275461590165, "set_robot_commands": 0.1067028911146399, "deviation-center-line": 0.6919579175542566, "driven_lanedir_consec": 0.9926581727749428, "sim_compute_sim_state": 0.04228615760803223, "sim_compute_performance-ego": 0.07619614143894143, "sim_compute_robot_state-ego": 0.0840391165589633, "sim_compute_robot_state-npc0": 0.07720329826825285, "sim_compute_robot_state-npc1": 0.07738273437709024, "sim_compute_robot_state-npc2": 0.07755920495072456, "sim_compute_robot_state-npc3": 0.07746556033826854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3486040874619123, "sim_physics": 0.18007017135620118, "survival_time": 14.950000000000076, "driven_lanedir": 1.6272722403920228, "sim_render-ego": 0.06299665768941244, "in-drivable-lane": 2.000000000000014, "agent_compute-ego": 0.08523769060770671, "deviation-heading": 6.918808897111082, "set_robot_commands": 0.1002035148938497, "deviation-center-line": 1.021174797456825, "driven_lanedir_consec": 1.1675097080656451, "sim_compute_sim_state": 0.039476267496744794, "sim_compute_performance-ego": 0.07073665301005046, "sim_compute_robot_state-ego": 0.07598819335301717, "sim_compute_robot_state-npc0": 0.07347880125045776, "sim_compute_robot_state-npc1": 0.06996205965677897, "sim_compute_robot_state-npc2": 0.0703823455174764, "sim_compute_robot_state-npc3": 0.0801578942934672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.34853514961698, "sim_physics": 0.21263033787409463, "survival_time": 14.950000000000076, "driven_lanedir": 1.559690983459272, "sim_render-ego": 0.0698622989654541, "in-drivable-lane": 2.100000000000011, "agent_compute-ego": 0.09207413991292318, "deviation-heading": 7.177683935869171, "set_robot_commands": 0.116681067943573, "deviation-center-line": 1.1865681824346217, "driven_lanedir_consec": 0.9602362195441052, "sim_compute_sim_state": 0.04474099079767863, "sim_compute_performance-ego": 0.07698423067728678, "sim_compute_robot_state-ego": 0.08749618291854859, "sim_compute_robot_state-npc0": 0.07919610897699991, "sim_compute_robot_state-npc1": 0.08090429147084555, "sim_compute_robot_state-npc2": 0.07916534662246705, "sim_compute_robot_state-npc3": 0.08194517612457275}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3485551743636783, "sim_physics": 0.215033225218455, "survival_time": 14.950000000000076, "driven_lanedir": 1.3949694402438109, "sim_render-ego": 0.06965188423792522, "in-drivable-lane": 2.9000000000000163, "agent_compute-ego": 0.09168352444966632, "deviation-heading": 7.407076536464438, "set_robot_commands": 0.110607004960378, "deviation-center-line": 1.0847023733943495, "driven_lanedir_consec": 0.8798937019811857, "sim_compute_sim_state": 0.04389683961868286, "sim_compute_performance-ego": 0.0781196101506551, "sim_compute_robot_state-ego": 0.08688937584559123, "sim_compute_robot_state-npc0": 0.07749598105748494, "sim_compute_robot_state-npc1": 0.07634430329004924, "sim_compute_robot_state-npc2": 0.07618060191472371, "sim_compute_robot_state-npc3": 0.07653478066126505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.870297727821699, "sim_physics": 0.2109789869059687, "survival_time": 5.749999999999988, "driven_lanedir": 0.4567130552402529, "sim_render-ego": 0.07200115452642027, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0938571432362432, "deviation-heading": 1.7999697601183915, "set_robot_commands": 0.11676840574845024, "deviation-center-line": 0.22683483670237156, "driven_lanedir_consec": 0.4567130552402529, "sim_compute_sim_state": 0.045192871923032014, "sim_compute_performance-ego": 0.07922624090443486, "sim_compute_robot_state-ego": 0.08332344967385998, "sim_compute_robot_state-npc0": 0.07942629067794137, "sim_compute_robot_state-npc1": 0.0771606673365054, "sim_compute_robot_state-npc2": 0.07840663661127505, "sim_compute_robot_state-npc3": 0.0770810894344164}}
set_robot_commands_max0.11676840574845024
set_robot_commands_mean0.11019257693217815
set_robot_commands_median0.110607004960378
set_robot_commands_min0.1002035148938497
sim_compute_performance-ego_max0.07922624090443486
sim_compute_performance-ego_mean0.07625257523627373
sim_compute_performance-ego_median0.07698423067728678
sim_compute_performance-ego_min0.07073665301005046
sim_compute_robot_state-ego_max0.08749618291854859
sim_compute_robot_state-ego_mean0.08354726366999606
sim_compute_robot_state-ego_median0.0840391165589633
sim_compute_robot_state-ego_min0.07598819335301717
sim_compute_robot_state-npc0_max0.07942629067794137
sim_compute_robot_state-npc0_mean0.07736009604622737
sim_compute_robot_state-npc0_median0.07749598105748494
sim_compute_robot_state-npc0_min0.07347880125045776
sim_compute_robot_state-npc1_max0.08090429147084555
sim_compute_robot_state-npc1_mean0.07635081122625388
sim_compute_robot_state-npc1_median0.0771606673365054
sim_compute_robot_state-npc1_min0.06996205965677897
sim_compute_robot_state-npc2_max0.07916534662246705
sim_compute_robot_state-npc2_mean0.07633882712333336
sim_compute_robot_state-npc2_median0.07755920495072456
sim_compute_robot_state-npc2_min0.0703823455174764
sim_compute_robot_state-npc3_max0.08194517612457275
sim_compute_robot_state-npc3_mean0.07863690017039798
sim_compute_robot_state-npc3_median0.07746556033826854
sim_compute_robot_state-npc3_min0.07653478066126505
sim_compute_sim_state_max0.045192871923032014
sim_compute_sim_state_mean0.043118625488834106
sim_compute_sim_state_median0.04389683961868286
sim_compute_sim_state_min0.039476267496744794
sim_physics_max0.215033225218455
sim_physics_mean0.20368173322815825
sim_physics_median0.2109789869059687
sim_physics_min0.18007017135620118
sim_render-ego_max0.07200115452642027
sim_render-ego_mean0.06855765957488695
sim_render-ego_median0.06965188423792522
sim_render-ego_min0.06299665768941244
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.58000000000004
survival_time_min5.749999999999988
228042727jp18813100494test for ppoaido2-LFV-sim-testingstep1-simulationerroryes11690:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227972742RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailedyes11690:01:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227832770Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:07:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227792778RamiNaimchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerroryes11690:00:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227692792RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationfailedyes11690:01:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227632809Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:38Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1559074350765773
agent_compute-ego_mean0.1499730514809082
agent_compute-ego_median0.1486142309088456
agent_compute-ego_min0.14205538749694824
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14510134414390283, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05809372442739981, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14748904440138075, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09429979765856708, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03778462498276322, "sim_compute_performance-ego": 0.061406736020688656, "sim_compute_robot_state-ego": 0.06499405701955159, "sim_compute_robot_state-npc0": 0.07010740704006618, "sim_compute_robot_state-npc1": 0.06767352863594338, "sim_compute_robot_state-npc2": 0.06557511841809308, "sim_compute_robot_state-npc3": 0.06733031184585006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.16853354454040528, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.059233083724975585, "in-drivable-lane": 0, "agent_compute-ego": 0.14205538749694824, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08395487785339356, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.03897865295410157, "sim_compute_performance-ego": 0.06436549186706543, "sim_compute_robot_state-ego": 0.07243961334228516, "sim_compute_robot_state-npc0": 0.06808126449584961, "sim_compute_robot_state-npc1": 0.06930939674377441, "sim_compute_robot_state-npc2": 0.06777627944946289, "sim_compute_robot_state-npc3": 0.07024139404296875}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17166478696622348, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06126999541332847, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1486142309088456, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09309128083680804, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03787882077066522, "sim_compute_performance-ego": 0.06754340309845774, "sim_compute_robot_state-ego": 0.07014299066443193, "sim_compute_robot_state-npc0": 0.06648039817810059, "sim_compute_robot_state-npc1": 0.06371013428035535, "sim_compute_robot_state-npc2": 0.06884633239946868, "sim_compute_robot_state-npc3": 0.06831363941493787}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18433020990106125, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06066191950930825, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15579915952078904, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09552024587800231, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03861528408678272, "sim_compute_performance-ego": 0.06733104247081129, "sim_compute_robot_state-ego": 0.07582670223863819, "sim_compute_robot_state-npc0": 0.07070825069765502, "sim_compute_robot_state-npc1": 0.06713490848299823, "sim_compute_robot_state-npc2": 0.06675769105742249, "sim_compute_robot_state-npc3": 0.0690347242958938}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.14658770390919276, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05775103398731777, "in-drivable-lane": 0, "agent_compute-ego": 0.1559074350765773, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08932435512542725, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.035695944513593404, "sim_compute_performance-ego": 0.06526746068681989, "sim_compute_robot_state-ego": 0.07160726615360805, "sim_compute_robot_state-npc0": 0.07116939340318952, "sim_compute_robot_state-npc1": 0.06779411009379796, "sim_compute_robot_state-npc2": 0.06299062286104475, "sim_compute_robot_state-npc3": 0.06655628340584892}}
set_robot_commands_max0.09552024587800231
set_robot_commands_mean0.09123811147043966
set_robot_commands_median0.09309128083680804
set_robot_commands_min0.08395487785339356
sim_compute_performance-ego_max0.06754340309845774
sim_compute_performance-ego_mean0.0651828268287686
sim_compute_performance-ego_median0.06526746068681989
sim_compute_performance-ego_min0.061406736020688656
sim_compute_robot_state-ego_max0.07582670223863819
sim_compute_robot_state-ego_mean0.07100212588370299
sim_compute_robot_state-ego_median0.07160726615360805
sim_compute_robot_state-ego_min0.06499405701955159
sim_compute_robot_state-npc0_max0.07116939340318952
sim_compute_robot_state-npc0_mean0.06930934276297218
sim_compute_robot_state-npc0_median0.07010740704006618
sim_compute_robot_state-npc0_min0.06648039817810059
sim_compute_robot_state-npc1_max0.06930939674377441
sim_compute_robot_state-npc1_mean0.06712441564737386
sim_compute_robot_state-npc1_median0.06767352863594338
sim_compute_robot_state-npc1_min0.06371013428035535
sim_compute_robot_state-npc2_max0.06884633239946868
sim_compute_robot_state-npc2_mean0.06638920883709838
sim_compute_robot_state-npc2_median0.06675769105742249
sim_compute_robot_state-npc2_min0.06299062286104475
sim_compute_robot_state-npc3_max0.07024139404296875
sim_compute_robot_state-npc3_mean0.06829527060109988
sim_compute_robot_state-npc3_median0.06831363941493787
sim_compute_robot_state-npc3_min0.06655628340584892
sim_compute_sim_state_max0.03897865295410157
sim_compute_sim_state_mean0.037790665461581226
sim_compute_sim_state_median0.03787882077066522
sim_compute_sim_state_min0.035695944513593404
sim_physics_max0.18433020990106125
sim_physics_mean0.1632435178921571
sim_physics_median0.16853354454040528
sim_physics_min0.14510134414390283
sim_render-ego_max0.06126999541332847
sim_render-ego_mean0.05940195141246598
sim_render-ego_median0.059233083724975585
sim_render-ego_min0.05775103398731777
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
227602819Liam Paullchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:27Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.15226617513918408
agent_compute-ego_mean0.14444131860046333
agent_compute-ego_median0.14464850425720216
agent_compute-ego_min0.13723482805139878
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10430833145424172, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05900004616490117, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1487106791249028, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09096628648263436, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03971023912783022, "sim_compute_performance-ego": 0.06606966919369167, "sim_compute_robot_state-ego": 0.07431791888342963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10403157215492398, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060144840502271465, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15226617513918408, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08579170002656825, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03728515494103525, "sim_compute_performance-ego": 0.06455132540534525, "sim_compute_robot_state-ego": 0.06786246860728544}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10839073798235724, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05524265064912684, "in-drivable-lane": 0, "agent_compute-ego": 0.13723482805139878, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0963271084953757, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0372778247384464, "sim_compute_performance-ego": 0.05286411678089815, "sim_compute_robot_state-ego": 0.06323925186606015}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.11692477226257324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.055064363479614256, "in-drivable-lane": 0, "agent_compute-ego": 0.14464850425720216, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08280410766601562, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03682717323303222, "sim_compute_performance-ego": 0.06430780410766601, "sim_compute_robot_state-ego": 0.06965743064880371}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.09983240199994438, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05774584902992731, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13934640642962878, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08488985858386076, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03511207314986217, "sim_compute_performance-ego": 0.06217827978013437, "sim_compute_robot_state-ego": 0.06558218786988078}}
set_robot_commands_max0.0963271084953757
set_robot_commands_mean0.08815581225089093
set_robot_commands_median0.08579170002656825
set_robot_commands_min0.08280410766601562
sim_compute_performance-ego_max0.06606966919369167
sim_compute_performance-ego_mean0.06199423905354708
sim_compute_performance-ego_median0.06430780410766601
sim_compute_performance-ego_min0.05286411678089815
sim_compute_robot_state-ego_max0.07431791888342963
sim_compute_robot_state-ego_mean0.06813185157509194
sim_compute_robot_state-ego_median0.06786246860728544
sim_compute_robot_state-ego_min0.06323925186606015
sim_compute_sim_state_max0.03971023912783022
sim_compute_sim_state_mean0.03724249303804125
sim_compute_sim_state_median0.0372778247384464
sim_compute_sim_state_min0.03511207314986217
sim_physics_max0.11692477226257324
sim_physics_mean0.10669756317080813
sim_physics_median0.10430833145424172
sim_physics_min0.09983240199994438
sim_render-ego_max0.060144840502271465
sim_render-ego_mean0.0574395499651682
sim_render-ego_median0.05774584902992731
sim_render-ego_min0.055064363479614256
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
227542823Liam Paullchallenge-aido_LF-template-randomaido2-LFV-sim-validationstep1-simulationsuccessyes11690:08:06Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.15595546855202205
agent_compute-ego_mean0.14596976042591217
agent_compute-ego_median0.14207749707358225
agent_compute-ego_min0.13884836656075936
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1458232800165812, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05868619018130832, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.13884836656075936, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09211504017865216, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037284268273247614, "sim_compute_performance-ego": 0.06601948649794967, "sim_compute_robot_state-ego": 0.0673741411279749, "sim_compute_robot_state-npc0": 0.06222545659100568, "sim_compute_robot_state-npc1": 0.06492252703066226, "sim_compute_robot_state-npc2": 0.0637532737520006, "sim_compute_robot_state-npc3": 0.06451940978014911}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.18890170097351075, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.060622606277465824, "in-drivable-lane": 0, "agent_compute-ego": 0.15157960891723632, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08953378677368164, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035479459762573246, "sim_compute_performance-ego": 0.0655416202545166, "sim_compute_robot_state-ego": 0.0664102840423584, "sim_compute_robot_state-npc0": 0.06467576026916504, "sim_compute_robot_state-npc1": 0.06622018814086914, "sim_compute_robot_state-npc2": 0.06514637947082519, "sim_compute_robot_state-npc3": 0.06683792114257812}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.15931676563463712, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.05520483067161158, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14138786102596082, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08366188250089947, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03713033701244153, "sim_compute_performance-ego": 0.061776895272104365, "sim_compute_robot_state-ego": 0.0678449178996839, "sim_compute_robot_state-npc0": 0.06307367588344373, "sim_compute_robot_state-npc1": 0.06254569166585018, "sim_compute_robot_state-npc2": 0.06476194921292756, "sim_compute_robot_state-npc3": 0.06156619912699649}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18522678749470772, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.061763896217829066, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15595546855202205, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09329423723341544, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03887544704388968, "sim_compute_performance-ego": 0.06996500642993782, "sim_compute_robot_state-ego": 0.07591260234011879, "sim_compute_robot_state-npc0": 0.0686301792724223, "sim_compute_robot_state-npc1": 0.06718306601802006, "sim_compute_robot_state-npc2": 0.07018521465832674, "sim_compute_robot_state-npc3": 0.06788197650185114}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.16896741730826242, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06107671771730695, "in-drivable-lane": 0, "agent_compute-ego": 0.14207749707358225, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.08752220017569405, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.050330093928745816, "sim_compute_performance-ego": 0.06659397057124547, "sim_compute_robot_state-ego": 0.07504447868892125, "sim_compute_robot_state-npc0": 0.06805997235434395, "sim_compute_robot_state-npc1": 0.07056593894958496, "sim_compute_robot_state-npc2": 0.07016749041421073, "sim_compute_robot_state-npc3": 0.07104979242597308}}
set_robot_commands_max0.09329423723341544
set_robot_commands_mean0.08922542937246855
set_robot_commands_median0.08953378677368164
set_robot_commands_min0.08366188250089947
sim_compute_performance-ego_max0.06996500642993782
sim_compute_performance-ego_mean0.06597939580515078
sim_compute_performance-ego_median0.06601948649794967
sim_compute_performance-ego_min0.061776895272104365
sim_compute_robot_state-ego_max0.07591260234011879
sim_compute_robot_state-ego_mean0.07051728481981145
sim_compute_robot_state-ego_median0.0678449178996839
sim_compute_robot_state-ego_min0.0664102840423584
sim_compute_robot_state-npc0_max0.0686301792724223
sim_compute_robot_state-npc0_mean0.06533300887407614
sim_compute_robot_state-npc0_median0.06467576026916504
sim_compute_robot_state-npc0_min0.06222545659100568
sim_compute_robot_state-npc1_max0.07056593894958496
sim_compute_robot_state-npc1_mean0.06628748236099732
sim_compute_robot_state-npc1_median0.06622018814086914
sim_compute_robot_state-npc1_min0.06254569166585018
sim_compute_robot_state-npc2_max0.07018521465832674
sim_compute_robot_state-npc2_mean0.06680286150165816
sim_compute_robot_state-npc2_median0.06514637947082519
sim_compute_robot_state-npc2_min0.0637532737520006
sim_compute_robot_state-npc3_max0.07104979242597308
sim_compute_robot_state-npc3_mean0.06637105979550958
sim_compute_robot_state-npc3_median0.06683792114257812
sim_compute_robot_state-npc3_min0.06156619912699649
sim_compute_sim_state_max0.050330093928745816
sim_compute_sim_state_mean0.039819921204179584
sim_compute_sim_state_median0.037284268273247614
sim_compute_sim_state_min0.035479459762573246
sim_physics_max0.18890170097351075
sim_physics_mean0.16964719028553987
sim_physics_median0.16896741730826242
sim_physics_min0.1458232800165812
sim_render-ego_max0.061763896217829066
sim_render-ego_mean0.05947084821310435
sim_render-ego_median0.060622606277465824
sim_render-ego_min0.05520483067161158
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
227492832AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes11690:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227452835AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11690:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227432844AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationerroryes11690:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227412851AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227392851AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227382852AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227252881Andrea Danieleminimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessyes11690:17:39Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.1482979797181629
agent_compute-ego_mean0.14588299976676952
agent_compute-ego_median0.14574089797411097
agent_compute-ego_min0.14342349038707267
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.15695819237249362, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.05963070101017574, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14342349038707267, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.08734116794394074, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.03668187333525513, "sim_compute_performance-ego": 0.0650164789433102, "sim_compute_robot_state-ego": 0.07090188616471325, "sim_compute_robot_state-npc0": 0.06577892783734439, "sim_compute_robot_state-npc1": 0.06411214698132851, "sim_compute_robot_state-npc2": 0.06558819468930471, "sim_compute_robot_state-npc3": 0.06437573330007869}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.1766417102208213, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.05932898748488653, "in-drivable-lane": 0, "agent_compute-ego": 0.1482979797181629, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.08988079570588611, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.037908160497271824, "sim_compute_performance-ego": 0.07130238744947645, "sim_compute_robot_state-ego": 0.07214847443595765, "sim_compute_robot_state-npc0": 0.0702479188404386, "sim_compute_robot_state-npc1": 0.0703021004086449, "sim_compute_robot_state-npc2": 0.06627434775942848, "sim_compute_robot_state-npc3": 0.06407720323592897}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.1603261555565728, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.05931348058912489, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.14522811147901746, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.0909968736436632, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.0376341003841824, "sim_compute_performance-ego": 0.06510992262098525, "sim_compute_robot_state-ego": 0.06911187065972223, "sim_compute_robot_state-npc0": 0.06749868922763401, "sim_compute_robot_state-npc1": 0.06374116155836318, "sim_compute_robot_state-npc2": 0.06320112970140246, "sim_compute_robot_state-npc3": 0.06395583682590061}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.16556838031188684, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.05902793550271592, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.14574089797411097, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.08951417751575945, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.03741940704908239, "sim_compute_performance-ego": 0.06456921507136613, "sim_compute_robot_state-ego": 0.07045380640689129, "sim_compute_robot_state-npc0": 0.06675630121187132, "sim_compute_robot_state-npc1": 0.06694721406505953, "sim_compute_robot_state-npc2": 0.0642062244327387, "sim_compute_robot_state-npc3": 0.06531034636607368}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.1529825528462728, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.05588086446126302, "in-drivable-lane": 0, "agent_compute-ego": 0.14672451927548363, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.08554129751901778, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.034632868236965604, "sim_compute_performance-ego": 0.06459725849212163, "sim_compute_robot_state-ego": 0.06810735899304586, "sim_compute_robot_state-npc0": 0.06509120880611359, "sim_compute_robot_state-npc1": 0.06304209194486103, "sim_compute_robot_state-npc2": 0.06112901369730631, "sim_compute_robot_state-npc3": 0.0610498171004038}}
set_robot_commands_max0.0909968736436632
set_robot_commands_mean0.08865486246565346
set_robot_commands_median0.08951417751575945
set_robot_commands_min0.08554129751901778
sim_compute_performance-ego_max0.07130238744947645
sim_compute_performance-ego_mean0.06611905251545193
sim_compute_performance-ego_median0.0650164789433102
sim_compute_performance-ego_min0.06456921507136613
sim_compute_robot_state-ego_max0.07214847443595765
sim_compute_robot_state-ego_mean0.07014467933206606
sim_compute_robot_state-ego_median0.07045380640689129
sim_compute_robot_state-ego_min0.06810735899304586
sim_compute_robot_state-npc0_max0.0702479188404386
sim_compute_robot_state-npc0_mean0.06707460918468038
sim_compute_robot_state-npc0_median0.06675630121187132
sim_compute_robot_state-npc0_min0.06509120880611359
sim_compute_robot_state-npc1_max0.0703021004086449
sim_compute_robot_state-npc1_mean0.06562894299165144
sim_compute_robot_state-npc1_median0.06411214698132851
sim_compute_robot_state-npc1_min0.06304209194486103
sim_compute_robot_state-npc2_max0.06627434775942848
sim_compute_robot_state-npc2_mean0.06407978205603614
sim_compute_robot_state-npc2_median0.0642062244327387
sim_compute_robot_state-npc2_min0.06112901369730631
sim_compute_robot_state-npc3_max0.06531034636607368
sim_compute_robot_state-npc3_mean0.06375378736567715
sim_compute_robot_state-npc3_median0.06407720323592897
sim_compute_robot_state-npc3_min0.0610498171004038
sim_compute_sim_state_max0.037908160497271824
sim_compute_sim_state_mean0.03685528190055147
sim_compute_sim_state_median0.03741940704908239
sim_compute_sim_state_min0.034632868236965604
sim_physics_max0.1766417102208213
sim_physics_mean0.16249539826160947
sim_physics_median0.1603261555565728
sim_physics_min0.1529825528462728
sim_render-ego_max0.05963070101017574
sim_render-ego_mean0.058636393809633224
sim_render-ego_median0.05931348058912489
sim_render-ego_min0.05588086446126302
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
226842977Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes11690:46:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226772989Bnaichchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11690:06:08
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226733002Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11690:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226663003Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes11690:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226583019Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes11690:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226473031Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes11690:01:30
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226323051Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-validationstep1-simulationerroryes11690:03:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226263078Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11690:08:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226053114almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11690:27:03Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.185353061495548
survival_time_median14.950000000000076
deviation-center-line_median0.9435008220616988
in-drivable-lane_median0


other stats
agent_compute-ego_max0.28572375535964967
agent_compute-ego_mean0.2666672357657017
agent_compute-ego_median0.256938803990682
agent_compute-ego_min0.25221720774968465
deviation-center-line_max0.9822461139602914
deviation-center-line_mean0.8606329948319832
deviation-center-line_min0.5558214411706502
deviation-heading_max3.2600620014175123
deviation-heading_mean2.7476538296717954
deviation-heading_median2.654186664499502
deviation-heading_min2.334890485276209
driven_any_max2.3249545528410955
driven_any_mean2.168326033245046
driven_any_median2.226723976325144
driven_any_min1.9668256472301673
driven_lanedir_consec_max2.27781394553347
driven_lanedir_consec_mean2.0950503876198985
driven_lanedir_consec_min1.8348894432223557
driven_lanedir_max2.27781394553347
driven_lanedir_mean2.0950503876198985
driven_lanedir_median2.185353061495548
driven_lanedir_min1.8348894432223557
in-drivable-lane_max1.0000000000000142
in-drivable-lane_mean0.20000000000000284
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9668256472301673, "sim_physics": 0.12550162919711716, "survival_time": 13.65000000000006, "driven_lanedir": 1.899485956723519, "sim_render-ego": 0.06567252075279152, "in-drivable-lane": 0, "agent_compute-ego": 0.28487812555753267, "deviation-heading": 2.93529075502866, "set_robot_commands": 0.09840394376398442, "deviation-center-line": 0.5558214411706502, "driven_lanedir_consec": 1.899485956723519, "sim_compute_sim_state": 0.04072246184715858, "sim_compute_performance-ego": 0.0730905864701603, "sim_compute_robot_state-ego": 0.07988009610018887}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.321044713767219, "sim_physics": 0.11436676184336345, "survival_time": 14.950000000000076, "driven_lanedir": 2.2777095311245996, "sim_render-ego": 0.0660379449526469, "in-drivable-lane": 0, "agent_compute-ego": 0.28572375535964967, "deviation-heading": 2.5538392421370943, "set_robot_commands": 0.1003089435895284, "deviation-center-line": 0.9709933754294416, "driven_lanedir_consec": 2.2777095311245996, "sim_compute_sim_state": 0.04115877389907837, "sim_compute_performance-ego": 0.07202286799748739, "sim_compute_robot_state-ego": 0.08049248774846395}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3249545528410955, "sim_physics": 0.10777249972025552, "survival_time": 14.950000000000076, "driven_lanedir": 2.27781394553347, "sim_render-ego": 0.057764697869618735, "in-drivable-lane": 0, "agent_compute-ego": 0.256938803990682, "deviation-heading": 2.654186664499502, "set_robot_commands": 0.09034234126408897, "deviation-center-line": 0.9435008220616988, "driven_lanedir_consec": 2.27781394553347, "sim_compute_sim_state": 0.03809483289718628, "sim_compute_performance-ego": 0.06409759998321533, "sim_compute_robot_state-ego": 0.06853599468866985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0020812760616047, "sim_physics": 0.10309399843215944, "survival_time": 14.950000000000076, "driven_lanedir": 1.8348894432223557, "sim_render-ego": 0.05772845347722371, "in-drivable-lane": 1.0000000000000142, "agent_compute-ego": 0.25221720774968465, "deviation-heading": 3.2600620014175123, "set_robot_commands": 0.08923460880915324, "deviation-center-line": 0.8506032215378343, "driven_lanedir_consec": 1.8348894432223557, "sim_compute_sim_state": 0.03678608973821004, "sim_compute_performance-ego": 0.0691389004389445, "sim_compute_robot_state-ego": 0.07210917949676514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.226723976325144, "sim_physics": 0.10789947907129924, "survival_time": 14.950000000000076, "driven_lanedir": 2.185353061495548, "sim_render-ego": 0.06056863069534302, "in-drivable-lane": 0, "agent_compute-ego": 0.25357828617095945, "deviation-heading": 2.334890485276209, "set_robot_commands": 0.09022313435872396, "deviation-center-line": 0.9822461139602914, "driven_lanedir_consec": 2.185353061495548, "sim_compute_sim_state": 0.037215991020202635, "sim_compute_performance-ego": 0.0681192684173584, "sim_compute_robot_state-ego": 0.07108312129974365}}
set_robot_commands_max0.1003089435895284
set_robot_commands_mean0.0937025943570958
set_robot_commands_median0.09034234126408897
set_robot_commands_min0.08923460880915324
sim_compute_performance-ego_max0.0730905864701603
sim_compute_performance-ego_mean0.06929384466143318
sim_compute_performance-ego_median0.0691389004389445
sim_compute_performance-ego_min0.06409759998321533
sim_compute_robot_state-ego_max0.08049248774846395
sim_compute_robot_state-ego_mean0.07442017586676629
sim_compute_robot_state-ego_median0.07210917949676514
sim_compute_robot_state-ego_min0.06853599468866985
sim_compute_sim_state_max0.04115877389907837
sim_compute_sim_state_mean0.03879562988036718
sim_compute_sim_state_median0.03809483289718628
sim_compute_sim_state_min0.03678608973821004
sim_physics_max0.12550162919711716
sim_physics_mean0.11172687365283895
sim_physics_median0.10789947907129924
sim_physics_min0.10309399843215944
sim_render-ego_max0.0660379449526469
sim_render-ego_mean0.061554449549524784
sim_render-ego_median0.06056863069534302
sim_render-ego_min0.05772845347722371
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.690000000000072
survival_time_min13.65000000000006
225913129almasipBaseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationsuccessyes11690:21:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.16856000774427
survival_time_median6.349999999999985
deviation-center-line_median0.261454195067992
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.317485676037045
agent_compute-ego_mean0.2834679131972922
agent_compute-ego_median0.27834692892137464
agent_compute-ego_min0.26769306109501767
deviation-center-line_max0.9937739318733424
deviation-center-line_mean0.3858564961356631
deviation-center-line_min0.1812231171505083
deviation-heading_max3.8466902743659857
deviation-heading_mean1.4336950455195177
deviation-heading_median0.9695337732365992
deviation-heading_min0.6082458187507025
driven_any_max3.676583339028152
driven_any_mean1.7037200613580763
driven_any_median1.6279652113260263
driven_any_min0.4131691185990866
driven_lanedir_consec_max3.343597617415085
driven_lanedir_consec_mean1.3788437844171837
driven_lanedir_consec_min0.3826134589156941
driven_lanedir_max3.343597617415085
driven_lanedir_mean1.3845739374030934
driven_lanedir_median1.181930880706367
driven_lanedir_min0.3826134589156941
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean1.049999999999999
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1318692695106831, "sim_physics": 0.17917161721449631, "survival_time": 4.549999999999992, "driven_lanedir": 0.7628928668010202, "sim_render-ego": 0.06362644394675454, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.27834692892137464, "deviation-heading": 0.6082458187507025, "set_robot_commands": 0.09718789897122226, "deviation-center-line": 0.18672340840732257, "driven_lanedir_consec": 0.7628928668010202, "sim_compute_sim_state": 0.04096486542251084, "sim_compute_performance-ego": 0.06959338502569513, "sim_compute_robot_state-ego": 0.07444040329901727, "sim_compute_robot_state-npc0": 0.07453418302012015, "sim_compute_robot_state-npc1": 0.07145873530880435, "sim_compute_robot_state-npc2": 0.06739550894433326, "sim_compute_robot_state-npc3": 0.07110863203530783}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.676583339028152, "sim_physics": 0.19607020457585653, "survival_time": 14.950000000000076, "driven_lanedir": 3.343597617415085, "sim_render-ego": 0.06474701960881551, "in-drivable-lane": 0.7500000000000107, "agent_compute-ego": 0.2859421396255493, "deviation-heading": 3.8466902743659857, "set_robot_commands": 0.09752729574839274, "deviation-center-line": 0.9937739318733424, "driven_lanedir_consec": 3.343597617415085, "sim_compute_sim_state": 0.039962621529897054, "sim_compute_performance-ego": 0.07278361638387044, "sim_compute_robot_state-ego": 0.07829826593399047, "sim_compute_robot_state-npc0": 0.0723578929901123, "sim_compute_robot_state-npc1": 0.07154470761617025, "sim_compute_robot_state-npc2": 0.07185405254364013, "sim_compute_robot_state-npc3": 0.07172663370768229}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6690133683264354, "sim_physics": 0.170373876278217, "survival_time": 6.499999999999985, "driven_lanedir": 1.181930880706367, "sim_render-ego": 0.06336484872377836, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.26769306109501767, "deviation-heading": 0.9695337732365992, "set_robot_commands": 0.09318355596982517, "deviation-center-line": 0.261454195067992, "driven_lanedir_consec": 1.16856000774427, "sim_compute_sim_state": 0.038661749546344465, "sim_compute_performance-ego": 0.07028356882242057, "sim_compute_robot_state-ego": 0.0740081475331233, "sim_compute_robot_state-npc0": 0.06866020606114315, "sim_compute_robot_state-npc1": 0.06780773126162015, "sim_compute_robot_state-npc2": 0.06831292189084566, "sim_compute_robot_state-npc3": 0.06916013864370493}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6279652113260263, "sim_physics": 0.19669378273130403, "survival_time": 6.349999999999985, "driven_lanedir": 1.2518348631773013, "sim_render-ego": 0.0663460915482889, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.317485676037045, "deviation-heading": 1.076518730305054, "set_robot_commands": 0.0970139954033799, "deviation-center-line": 0.30610782817915033, "driven_lanedir_consec": 1.236554971209848, "sim_compute_sim_state": 0.04111687217171737, "sim_compute_performance-ego": 0.07763962858305203, "sim_compute_robot_state-ego": 0.08117839858287901, "sim_compute_robot_state-npc0": 0.07106538644925815, "sim_compute_robot_state-npc1": 0.07153979061156746, "sim_compute_robot_state-npc2": 0.07328325556957815, "sim_compute_robot_state-npc3": 0.07432144270168514}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4131691185990866, "sim_physics": 0.1824802946537099, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3826134589156941, "sim_render-ego": 0.06134634829582052, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.26787176030747434, "deviation-heading": 0.6674866309392474, "set_robot_commands": 0.0917362152261937, "deviation-center-line": 0.1812231171505083, "driven_lanedir_consec": 0.3826134589156941, "sim_compute_sim_state": 0.03951794035891269, "sim_compute_performance-ego": 0.07144335482982879, "sim_compute_robot_state-ego": 0.07529659981423235, "sim_compute_robot_state-npc0": 0.07196412187941531, "sim_compute_robot_state-npc1": 0.0716857707246821, "sim_compute_robot_state-npc2": 0.06979329535301695, "sim_compute_robot_state-npc3": 0.06791410547621707}}
set_robot_commands_max0.09752729574839274
set_robot_commands_mean0.09532979226380275
set_robot_commands_median0.0970139954033799
set_robot_commands_min0.0917362152261937
sim_compute_performance-ego_max0.07763962858305203
sim_compute_performance-ego_mean0.07234871072897339
sim_compute_performance-ego_median0.07144335482982879
sim_compute_performance-ego_min0.06959338502569513
sim_compute_robot_state-ego_max0.08117839858287901
sim_compute_robot_state-ego_mean0.07664436303264849
sim_compute_robot_state-ego_median0.07529659981423235
sim_compute_robot_state-ego_min0.0740081475331233
sim_compute_robot_state-npc0_max0.07453418302012015
sim_compute_robot_state-npc0_mean0.07171635808000981
sim_compute_robot_state-npc0_median0.07196412187941531
sim_compute_robot_state-npc0_min0.06866020606114315
sim_compute_robot_state-npc1_max0.0716857707246821
sim_compute_robot_state-npc1_mean0.07080734710456886
sim_compute_robot_state-npc1_median0.07153979061156746
sim_compute_robot_state-npc1_min0.06780773126162015
sim_compute_robot_state-npc2_max0.07328325556957815
sim_compute_robot_state-npc2_mean0.07012780686028283
sim_compute_robot_state-npc2_median0.06979329535301695
sim_compute_robot_state-npc2_min0.06739550894433326
sim_compute_robot_state-npc3_max0.07432144270168514
sim_compute_robot_state-npc3_mean0.07084619051291945
sim_compute_robot_state-npc3_median0.07110863203530783
sim_compute_robot_state-npc3_min0.06791410547621707
sim_compute_sim_state_max0.04111687217171737
sim_compute_sim_state_mean0.04004480980587648
sim_compute_sim_state_median0.039962621529897054
sim_compute_sim_state_min0.038661749546344465
sim_physics_max0.19669378273130403
sim_physics_mean0.18495795509071672
sim_physics_median0.1824802946537099
sim_physics_min0.170373876278217
sim_render-ego_max0.0663460915482889
sim_render-ego_mean0.06388615042469156
sim_render-ego_median0.06362644394675454
sim_render-ego_min0.06134634829582052
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.940000000000009
survival_time_min2.3499999999999996
225523185jp18813100494First test - THaido2-LF-sim-testingstep1-simulationerroryes11690:29:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225413195JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes11690:08:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6920724731953904
survival_time_median3.999999999999994
deviation-center-line_median0.2344202649171729
in-drivable-lane_median0.6999999999999975


other stats
agent_compute-ego_max0.11095846110376818
agent_compute-ego_mean0.10805905903605165
agent_compute-ego_median0.10989526682679758
agent_compute-ego_min0.10198181867599489
deviation-center-line_max0.6179791521957764
deviation-center-line_mean0.28226346712945316
deviation-center-line_min0.12321310762075308
deviation-heading_max1.3808930492427236
deviation-heading_mean0.7404860802660196
deviation-heading_median0.585094901543844
deviation-heading_min0.2909049870120278
driven_any_max2.128820712372678
driven_any_mean0.9941443397815296
driven_any_median1.0247402910688082
driven_any_min0.312040871215342
driven_lanedir_consec_max1.6140708931485974
driven_lanedir_consec_mean0.7506079719491037
driven_lanedir_consec_min0.3063101498086782
driven_lanedir_max1.6140708931485974
driven_lanedir_mean0.7506079719491037
driven_lanedir_median0.6920724731953904
driven_lanedir_min0.3063101498086782
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.7299999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0953025972027035, "sim_physics": 0.12091727866682896, "survival_time": 4.299999999999993, "driven_lanedir": 0.6920724731953904, "sim_render-ego": 0.06806608133537825, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.10995813580446465, "deviation-heading": 0.3443619430804727, "set_robot_commands": 0.10368213819902997, "deviation-center-line": 0.2344202649171729, "driven_lanedir_consec": 0.6920724731953904, "sim_compute_sim_state": 0.04178746633751448, "sim_compute_performance-ego": 0.07154757754747258, "sim_compute_robot_state-ego": 0.07671415528585744}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0247402910688082, "sim_physics": 0.11499017775058748, "survival_time": 3.999999999999994, "driven_lanedir": 0.7527271628855262, "sim_render-ego": 0.06318644285202027, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.10198181867599489, "deviation-heading": 1.1011755204510298, "set_robot_commands": 0.11489853858947754, "deviation-center-line": 0.2881328674723111, "driven_lanedir_consec": 0.7527271628855262, "sim_compute_sim_state": 0.04066879153251648, "sim_compute_performance-ego": 0.07649149596691132, "sim_compute_robot_state-ego": 0.0788007915019989}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.312040871215342, "sim_physics": 0.13957401801799907, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3063101498086782, "sim_render-ego": 0.06597886414363466, "in-drivable-lane": 0, "agent_compute-ego": 0.11095846110376818, "deviation-heading": 0.2909049870120278, "set_robot_commands": 0.10233324971692316, "deviation-center-line": 0.14757194344125227, "driven_lanedir_consec": 0.3063101498086782, "sim_compute_sim_state": 0.04384497938484981, "sim_compute_performance-ego": 0.0752502885358087, "sim_compute_robot_state-ego": 0.08258096925143538}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4098172270481152, "sim_physics": 0.13124869267145792, "survival_time": 1.800000000000001, "driven_lanedir": 0.3878591807073266, "sim_render-ego": 0.06691813468933105, "in-drivable-lane": 0, "agent_compute-ego": 0.10750161276923284, "deviation-heading": 0.585094901543844, "set_robot_commands": 0.11168216996722752, "deviation-center-line": 0.12321310762075308, "driven_lanedir_consec": 0.3878591807073266, "sim_compute_sim_state": 0.04315455092324151, "sim_compute_performance-ego": 0.07439152399698894, "sim_compute_robot_state-ego": 0.08240810367796156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.128820712372678, "sim_physics": 0.12075197321813812, "survival_time": 7.94999999999998, "driven_lanedir": 1.6140708931485974, "sim_render-ego": 0.06879470633260859, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10989526682679758, "deviation-heading": 1.3808930492427236, "set_robot_commands": 0.10756664006215222, "deviation-center-line": 0.6179791521957764, "driven_lanedir_consec": 1.6140708931485974, "sim_compute_sim_state": 0.04432784236452115, "sim_compute_performance-ego": 0.07552501840411492, "sim_compute_robot_state-ego": 0.08393438507176046}}
set_robot_commands_max0.11489853858947754
set_robot_commands_mean0.10803254730696207
set_robot_commands_median0.10756664006215222
set_robot_commands_min0.10233324971692316
sim_compute_performance-ego_max0.07649149596691132
sim_compute_performance-ego_mean0.07464118089025928
sim_compute_performance-ego_median0.0752502885358087
sim_compute_performance-ego_min0.07154757754747258
sim_compute_robot_state-ego_max0.08393438507176046
sim_compute_robot_state-ego_mean0.08088768095780274
sim_compute_robot_state-ego_median0.08240810367796156
sim_compute_robot_state-ego_min0.07671415528585744
sim_compute_sim_state_max0.04432784236452115
sim_compute_sim_state_mean0.04275672610852869
sim_compute_sim_state_median0.04315455092324151
sim_compute_sim_state_min0.04066879153251648
sim_physics_max0.13957401801799907
sim_physics_mean0.1254964280650023
sim_physics_median0.12091727866682896
sim_physics_min0.11499017775058748
sim_render-ego_max0.06879470633260859
sim_render-ego_mean0.06658884587059456
sim_render-ego_median0.06691813468933105
sim_render-ego_min0.06318644285202027
simulation-passed1
survival_time_max7.94999999999998
survival_time_mean3.8999999999999937
survival_time_min1.4500000000000006
225323206Masachallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11690:16:46Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.1786513749290915
agent_compute-ego_mean0.15511499553906033
agent_compute-ego_median0.15421850802534717
agent_compute-ego_min0.11623128822871616
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.13090297469386347, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06537042282245777, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1634766569843999, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10200279730337636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04054001525596336, "sim_compute_performance-ego": 0.07363123363918728, "sim_compute_robot_state-ego": 0.08463266160753039}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12238131317437864, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06139179304534314, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15154617907954196, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.097060666364782, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04071442753660912, "sim_compute_performance-ego": 0.0688319112740311, "sim_compute_robot_state-ego": 0.07585417523103602}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14113751579733455, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07002411169164321, "in-drivable-lane": 0, "agent_compute-ego": 0.1786513749290915, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10744397780474496, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04417044976178337, "sim_compute_performance-ego": 0.07728802456575282, "sim_compute_robot_state-ego": 0.0939787836635814}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13242959022521972, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05832149505615234, "in-drivable-lane": 0, "agent_compute-ego": 0.15406731605529786, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09924959182739258, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03535835266113281, "sim_compute_performance-ego": 0.06810334205627441, "sim_compute_robot_state-ego": 0.07241825103759765}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12005576604529272, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06051766721508171, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1570009249675123, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10113134565232676, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03917969631243356, "sim_compute_performance-ego": 0.07023061076297035, "sim_compute_robot_state-ego": 0.0783809136740769}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1183214284935776, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06255046688780493, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15386468050431232, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09103096747884944, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038152159476766784, "sim_compute_performance-ego": 0.06904157327145946, "sim_compute_robot_state-ego": 0.07460363057194924}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.11440151504107884, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06487809334482465, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1778689750603267, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10350126028060912, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.04193691270692008, "sim_compute_performance-ego": 0.07234878199441093, "sim_compute_robot_state-ego": 0.08581473997661046}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.13488984107971191, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06528980391366142, "in-drivable-lane": 0, "agent_compute-ego": 0.16036438941955566, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10076136816115606, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.043496892565772646, "sim_compute_performance-ego": 0.07254217919849214, "sim_compute_robot_state-ego": 0.08162582488287062}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11515435525926492, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0646961907208976, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15421850802534717, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.1007219169099452, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.039628259206222274, "sim_compute_performance-ego": 0.06549430701692226, "sim_compute_robot_state-ego": 0.06895461324918067}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11664018630981446, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06300766251303933, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1502367539839311, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.09209509329362348, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.0407971902327104, "sim_compute_performance-ego": 0.0679886211048473, "sim_compute_robot_state-ego": 0.07497472763061523}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.11014222479485848, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05945420574832272, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15672748119800123, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10148693679215072, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.039686298989630366, "sim_compute_performance-ego": 0.06494466979782303, "sim_compute_robot_state-ego": 0.06995265205185135}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.12621081726891653, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.043009979384286065, "in-drivable-lane": 0, "agent_compute-ego": 0.11623128822871616, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.07045072317123413, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.02983286551066807, "sim_compute_performance-ego": 0.05280645404543195, "sim_compute_robot_state-ego": 0.05368912220001221}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.10853787964465572, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05786459586199592, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1476902073504878, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.1026014206456203, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04034359314862419, "sim_compute_performance-ego": 0.06512239867565679, "sim_compute_robot_state-ego": 0.07003468158198338}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.09216491381327312, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05247796906365289, "in-drivable-lane": 0, "agent_compute-ego": 0.1407825681898329, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.07400597466362847, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03179698520236545, "sim_compute_performance-ego": 0.05449600572939272, "sim_compute_robot_state-ego": 0.06576668774640118}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.1217414187450035, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06764821678984399, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16399762910955093, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10235999612247244, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04244034196816239, "sim_compute_performance-ego": 0.07420291152654909, "sim_compute_robot_state-ego": 0.08231404949637021}}
set_robot_commands_max0.10744397780474496
set_robot_commands_mean0.09639360243146082
set_robot_commands_median0.10076136816115606
set_robot_commands_min0.07045072317123413
sim_compute_performance-ego_max0.07728802456575282
sim_compute_performance-ego_mean0.06780486831061344
sim_compute_performance-ego_median0.0688319112740311
sim_compute_performance-ego_min0.05280645404543195
sim_compute_robot_state-ego_max0.0939787836635814
sim_compute_robot_state-ego_mean0.07553303430677778
sim_compute_robot_state-ego_median0.07497472763061523
sim_compute_robot_state-ego_min0.05368912220001221
sim_compute_sim_state_max0.04417044976178337
sim_compute_sim_state_mean0.03920496270238432
sim_compute_sim_state_median0.04034359314862419
sim_compute_sim_state_min0.02983286551066807
sim_physics_max0.14113751579733455
sim_physics_mean0.12034078269241628
sim_physics_median0.12005576604529272
sim_physics_min0.09216491381327312
sim_render-ego_max0.07002411169164321
sim_render-ego_mean0.06110017827060051
sim_render-ego_median0.06255046688780493
sim_render-ego_min0.043009979384286065
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
225243213AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1523418192769967
agent_compute-ego_mean0.1255693496385237
agent_compute-ego_median0.11704172134399414
agent_compute-ego_min0.10625041232389562
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0715391856652719, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.045529060893588595, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.10837856045475712, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08159289095136854, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03139298492007785, "sim_compute_performance-ego": 0.053111632664998375, "sim_compute_robot_state-ego": 0.04936827553643121}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10686406434751024, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.060640970865885414, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1523418192769967, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09730026768703089, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0385898001053754, "sim_compute_performance-ego": 0.06931004337235994, "sim_compute_robot_state-ego": 0.06845976324642405}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0823670275071088, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04233037724214442, "in-drivable-lane": 0, "agent_compute-ego": 0.10625041232389562, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07123013103709501, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.029606931349810434, "sim_compute_performance-ego": 0.04578675943262437, "sim_compute_robot_state-ego": 0.04991796437431784}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07517236709594727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.044176855087280274, "in-drivable-lane": 0, "agent_compute-ego": 0.11704172134399414, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08052803993225098, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.028458967208862304, "sim_compute_performance-ego": 0.047406549453735354, "sim_compute_robot_state-ego": 0.05383511543273926}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10986017275460158, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0643488334704049, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14383423479297494, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09211137626744524, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03770142567308643, "sim_compute_performance-ego": 0.06857167316388481, "sim_compute_robot_state-ego": 0.07225940800920318}}
set_robot_commands_max0.09730026768703089
set_robot_commands_mean0.08455254117503813
set_robot_commands_median0.08159289095136854
set_robot_commands_min0.07123013103709501
sim_compute_performance-ego_max0.06931004337235994
sim_compute_performance-ego_mean0.05683733161752057
sim_compute_performance-ego_median0.053111632664998375
sim_compute_performance-ego_min0.04578675943262437
sim_compute_robot_state-ego_max0.07225940800920318
sim_compute_robot_state-ego_mean0.05876810531982311
sim_compute_robot_state-ego_median0.05383511543273926
sim_compute_robot_state-ego_min0.04936827553643121
sim_compute_sim_state_max0.0385898001053754
sim_compute_sim_state_mean0.03315002185144249
sim_compute_sim_state_median0.03139298492007785
sim_compute_sim_state_min0.028458967208862304
sim_physics_max0.10986017275460158
sim_physics_mean0.08916056347408795
sim_physics_median0.0823670275071088
sim_physics_min0.0715391856652719
sim_render-ego_max0.0643488334704049
sim_render-ego_mean0.05140521951186072
sim_render-ego_median0.045529060893588595
sim_render-ego_min0.04233037724214442
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
225223220AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationerroryes11690:06:13
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225133226JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:09:44Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6482690555669561
survival_time_median4.799999999999991
deviation-center-line_median0.33137449973274535
in-drivable-lane_median0.6000000000000001


other stats
agent_compute-ego_max0.10008593227552331
agent_compute-ego_mean0.08257744671541331
agent_compute-ego_median0.08585424201433049
agent_compute-ego_min0.06445349817690642
deviation-center-line_max0.8629816460472337
deviation-center-line_mean0.4052350147373122
deviation-center-line_min0.1232226529796871
deviation-heading_max2.5270421322989316
deviation-heading_mean1.6944073723452333
deviation-heading_median1.3114128255977453
deviation-heading_min1.2772414530099196
driven_any_max2.547563587267358
driven_any_mean1.2489296114351005
driven_any_median1.0806560931556195
driven_any_min0.48079344307760785
driven_lanedir_consec_max2.030429428861149
driven_lanedir_consec_mean0.8410103149601313
driven_lanedir_consec_min0.14330318763051497
driven_lanedir_max2.030429428861149
driven_lanedir_mean0.8968134692823696
driven_lanedir_median0.7507516272566102
driven_lanedir_min0.19840401404062505
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean0.829999999999998
in-drivable-lane_min0.29999999999999893
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0806560931556195, "sim_physics": 0.1112196445465088, "survival_time": 4.799999999999991, "driven_lanedir": 0.7507516272566102, "sim_render-ego": 0.0632547711332639, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.09027464936176936, "deviation-heading": 2.5270421322989316, "set_robot_commands": 0.1148828516403834, "deviation-center-line": 0.33137449973274535, "driven_lanedir_consec": 0.6482690555669561, "sim_compute_sim_state": 0.04267106205224991, "sim_compute_performance-ego": 0.06957327822844188, "sim_compute_robot_state-ego": 0.07245216518640518}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.48080622790521776, "sim_physics": 0.1674722899561343, "survival_time": 2.3, "driven_lanedir": 0.19840401404062505, "sim_render-ego": 0.06491121520166812, "in-drivable-lane": 0.6000000000000001, "agent_compute-ego": 0.10008593227552331, "deviation-heading": 1.2800259505804874, "set_robot_commands": 0.11440334112747856, "deviation-center-line": 0.1232226529796871, "driven_lanedir_consec": 0.14330318763051497, "sim_compute_sim_state": 0.04254971379819124, "sim_compute_performance-ego": 0.0759600660075312, "sim_compute_robot_state-ego": 0.08566067529761273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.547563587267358, "sim_physics": 0.12529881277749705, "survival_time": 10.750000000000018, "driven_lanedir": 2.030429428861149, "sim_render-ego": 0.0645471173663472, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.08585424201433049, "deviation-heading": 1.2772414530099196, "set_robot_commands": 0.11549674743829771, "deviation-center-line": 0.8629816460472337, "driven_lanedir_consec": 2.030429428861149, "sim_compute_sim_state": 0.04396556920783464, "sim_compute_performance-ego": 0.07288735079210858, "sim_compute_robot_state-ego": 0.08039799512818802}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6548287057696982, "sim_physics": 0.094287912610551, "survival_time": 7.099999999999983, "driven_lanedir": 1.2596261670471434, "sim_render-ego": 0.05527513799533038, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.07221891174853688, "deviation-heading": 2.0763145002390835, "set_robot_commands": 0.09694066685690007, "deviation-center-line": 0.558399371643866, "driven_lanedir_consec": 1.228205201818661, "sim_compute_sim_state": 0.03685598642053738, "sim_compute_performance-ego": 0.06083144604320258, "sim_compute_robot_state-ego": 0.0652010591936783}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.48079344307760785, "sim_physics": 0.09346389770507812, "survival_time": 2.3, "driven_lanedir": 0.24485610920632128, "sim_render-ego": 0.04644012451171875, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.06445349817690642, "deviation-heading": 1.3114128255977453, "set_robot_commands": 0.08780003630596658, "deviation-center-line": 0.1501969032830292, "driven_lanedir_consec": 0.154844700923376, "sim_compute_sim_state": 0.03197144943734874, "sim_compute_performance-ego": 0.05303421227828316, "sim_compute_robot_state-ego": 0.05722616548123567}}
set_robot_commands_max0.11549674743829771
set_robot_commands_mean0.10590472867380528
set_robot_commands_median0.11440334112747856
set_robot_commands_min0.08780003630596658
sim_compute_performance-ego_max0.0759600660075312
sim_compute_performance-ego_mean0.06645727066991347
sim_compute_performance-ego_median0.06957327822844188
sim_compute_performance-ego_min0.05303421227828316
sim_compute_robot_state-ego_max0.08566067529761273
sim_compute_robot_state-ego_mean0.07218761205742398
sim_compute_robot_state-ego_median0.07245216518640518
sim_compute_robot_state-ego_min0.05722616548123567
sim_compute_sim_state_max0.04396556920783464
sim_compute_sim_state_mean0.03960275618323238
sim_compute_sim_state_median0.04254971379819124
sim_compute_sim_state_min0.03197144943734874
sim_physics_max0.1674722899561343
sim_physics_mean0.11834851151915383
sim_physics_median0.1112196445465088
sim_physics_min0.09346389770507812
sim_render-ego_max0.06491121520166812
sim_render-ego_mean0.05888567324166567
sim_render-ego_median0.0632547711332639
sim_render-ego_min0.04644012451171875
simulation-passed1
survival_time_max10.750000000000018
survival_time_mean5.449999999999998
survival_time_min2.3
225013236JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:16:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8585602455264372
survival_time_median8.14999999999998
deviation-center-line_median0.7394696972120545
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09078086619396286
agent_compute-ego_mean0.08750102503842552
agent_compute-ego_median0.08810589479845624
agent_compute-ego_min0.08190862386504565
deviation-center-line_max1.330102370170228
deviation-center-line_mean0.7757390305529259
deviation-center-line_min0.156616058950106
deviation-heading_max2.931919980092094
deviation-heading_mean1.6699672337849407
deviation-heading_median1.651951162872906
deviation-heading_min0.33411079807072414
driven_any_max3.574678085296573
driven_any_mean1.9851000130474856
driven_any_median1.9116486550772611
driven_any_min0.4441832066089127
driven_lanedir_consec_max2.9865400109974503
driven_lanedir_consec_mean1.743345148237858
driven_lanedir_consec_min0.42357196576766665
driven_lanedir_max2.9865400109974503
driven_lanedir_mean1.743345148237858
driven_lanedir_median1.8585602455264372
driven_lanedir_min0.42357196576766665
in-drivable-lane_max1.8500000000000263
in-drivable-lane_mean0.6800000000000088
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9515731520694257, "sim_physics": 0.13011445482093167, "survival_time": 12.450000000000042, "driven_lanedir": 2.4083866619267673, "sim_render-ego": 0.0655557764581887, "in-drivable-lane": 1.5500000000000176, "agent_compute-ego": 0.09078086619396286, "deviation-heading": 2.931919980092094, "set_robot_commands": 0.11337530660820772, "deviation-center-line": 1.1071364179412364, "driven_lanedir_consec": 2.4083866619267673, "sim_compute_sim_state": 0.043550624426110206, "sim_compute_performance-ego": 0.07248600994247988, "sim_compute_robot_state-ego": 0.08021995724444408}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9116486550772611, "sim_physics": 0.11311910196316025, "survival_time": 8.14999999999998, "driven_lanedir": 1.8585602455264372, "sim_render-ego": 0.06138913470543235, "in-drivable-lane": 0, "agent_compute-ego": 0.08190862386504565, "deviation-heading": 1.651951162872906, "set_robot_commands": 0.11235505817857988, "deviation-center-line": 0.7394696972120545, "driven_lanedir_consec": 1.8585602455264372, "sim_compute_sim_state": 0.043208561060618766, "sim_compute_performance-ego": 0.06687280005472569, "sim_compute_robot_state-ego": 0.07257761984515043}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0434169661852573, "sim_physics": 0.12795669617860214, "survival_time": 4.599999999999992, "driven_lanedir": 1.039666856970968, "sim_render-ego": 0.06676072400549184, "in-drivable-lane": 0, "agent_compute-ego": 0.08970581707747086, "deviation-heading": 0.33411079807072414, "set_robot_commands": 0.1253545750742373, "deviation-center-line": 0.5453706084910053, "driven_lanedir_consec": 1.039666856970968, "sim_compute_sim_state": 0.044272422790527344, "sim_compute_performance-ego": 0.0744995785796124, "sim_compute_robot_state-ego": 0.08745465330455614}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4441832066089127, "sim_physics": 0.1279981857122377, "survival_time": 2.1500000000000004, "driven_lanedir": 0.42357196576766665, "sim_render-ego": 0.06724884898163551, "in-drivable-lane": 0, "agent_compute-ego": 0.08810589479845624, "deviation-heading": 0.6350053948141431, "set_robot_commands": 0.1116138779839804, "deviation-center-line": 0.156616058950106, "driven_lanedir_consec": 0.42357196576766665, "sim_compute_sim_state": 0.04400884827902151, "sim_compute_performance-ego": 0.07449071906333746, "sim_compute_robot_state-ego": 0.07890796661376953}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.574678085296573, "sim_physics": 0.108406978448232, "survival_time": 14.950000000000076, "driven_lanedir": 2.9865400109974503, "sim_render-ego": 0.061812231540679934, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.08700392325719197, "deviation-heading": 2.796848833074837, "set_robot_commands": 0.11447627941767374, "deviation-center-line": 1.330102370170228, "driven_lanedir_consec": 2.9865400109974503, "sim_compute_sim_state": 0.04303218841552734, "sim_compute_performance-ego": 0.07070357958475748, "sim_compute_robot_state-ego": 0.07434128046035766}}
set_robot_commands_max0.1253545750742373
set_robot_commands_mean0.1154350194525358
set_robot_commands_median0.11337530660820772
set_robot_commands_min0.1116138779839804
sim_compute_performance-ego_max0.0744995785796124
sim_compute_performance-ego_mean0.07181053744498259
sim_compute_performance-ego_median0.07248600994247988
sim_compute_performance-ego_min0.06687280005472569
sim_compute_robot_state-ego_max0.08745465330455614
sim_compute_robot_state-ego_mean0.07870029549365556
sim_compute_robot_state-ego_median0.07890796661376953
sim_compute_robot_state-ego_min0.07257761984515043
sim_compute_sim_state_max0.044272422790527344
sim_compute_sim_state_mean0.04361452899436104
sim_compute_sim_state_median0.043550624426110206
sim_compute_sim_state_min0.04303218841552734
sim_physics_max0.13011445482093167
sim_physics_mean0.12151908342463276
sim_physics_median0.12795669617860214
sim_physics_min0.108406978448232
sim_render-ego_max0.06724884898163551
sim_render-ego_mean0.06455334313828567
sim_render-ego_median0.0655557764581887
sim_render-ego_min0.06138913470543235
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.460000000000019
survival_time_min2.1500000000000004
224993238jp18813100494Second test - THaido2-LF-sim-validationstep1-simulationerroryes11690:00:31
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224923248Brian Chuang challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11690:05:08Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.14806357552023494
agent_compute-ego_mean0.13165739632433948
agent_compute-ego_median0.1288252274195353
agent_compute-ego_min0.11186427116394045
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0875094422587642, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05218831698099772, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1288252274195353, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08165085315704346, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03477229895415129, "sim_compute_performance-ego": 0.05629045874984176, "sim_compute_robot_state-ego": 0.05844326372499819}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.08829712400249407, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04918077412773581, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.12705770193361768, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0726468048843683, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.033991121778301166, "sim_compute_performance-ego": 0.05434441566467285, "sim_compute_robot_state-ego": 0.05536261726828182}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11748273232403925, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05948803004096536, "in-drivable-lane": 0, "agent_compute-ego": 0.14806357552023494, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.09703836721532486, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04054150861852309, "sim_compute_performance-ego": 0.063217653947718, "sim_compute_robot_state-ego": 0.07143064106211942}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.08561182022094727, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04756854057312012, "in-drivable-lane": 0, "agent_compute-ego": 0.11186427116394045, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.07453076362609863, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02890833854675293, "sim_compute_performance-ego": 0.05135771751403809, "sim_compute_robot_state-ego": 0.05411564826965332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11329761939712718, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05827133866805065, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14247620558436913, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08844134777407103, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03665709193748764, "sim_compute_performance-ego": 0.06503508362589003, "sim_compute_robot_state-ego": 0.0723754484442216}}
set_robot_commands_max0.09703836721532486
set_robot_commands_mean0.08286162733138125
set_robot_commands_median0.08165085315704346
set_robot_commands_min0.0726468048843683
sim_compute_performance-ego_max0.06503508362589003
sim_compute_performance-ego_mean0.05804906590043215
sim_compute_performance-ego_median0.05629045874984176
sim_compute_performance-ego_min0.05135771751403809
sim_compute_robot_state-ego_max0.0723754484442216
sim_compute_robot_state-ego_mean0.06234552375385487
sim_compute_robot_state-ego_median0.05844326372499819
sim_compute_robot_state-ego_min0.05411564826965332
sim_compute_sim_state_max0.04054150861852309
sim_compute_sim_state_mean0.034974071967043226
sim_compute_sim_state_median0.03477229895415129
sim_compute_sim_state_min0.02890833854675293
sim_physics_max0.11748273232403925
sim_physics_mean0.0984397476406744
sim_physics_median0.08829712400249407
sim_physics_min0.08561182022094727
sim_render-ego_max0.05948803004096536
sim_render-ego_mean0.05333940007817393
sim_render-ego_median0.05218831698099772
sim_render-ego_min0.04756854057312012
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
224793268ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:17:02Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2305190031201856
survival_time_median8.899999999999991
deviation-center-line_median0.5771458850482323
in-drivable-lane_median1.6999999999999955


other stats
agent_compute-ego_max0.10172563172428986
agent_compute-ego_mean0.0989053062811897
agent_compute-ego_median0.09892491330491736
agent_compute-ego_min0.09690403247225111
deviation-center-line_max1.1488111156355547
deviation-center-line_mean0.6488031212511529
deviation-center-line_min0.34884787027557723
deviation-heading_max3.61599883232021
deviation-heading_mean1.7260666402917764
deviation-heading_median1.4218969858349213
deviation-heading_min0.3112599289821271
driven_any_max3.4035761096508277
driven_any_mean1.8946471986219724
driven_any_median2.0834330562964634
driven_any_min0.7621458305230319
driven_lanedir_consec_max2.786543911691145
driven_lanedir_consec_mean1.4692902725397083
driven_lanedir_consec_min0.758467835111603
driven_lanedir_max2.786543911691145
driven_lanedir_mean1.4692902725397083
driven_lanedir_median1.2305190031201856
driven_lanedir_min0.758467835111603
in-drivable-lane_max2.800000000000005
in-drivable-lane_mean1.34
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.0834330562964634, "sim_physics": 0.11412759577290396, "survival_time": 8.899999999999991, "driven_lanedir": 1.2305190031201856, "sim_render-ego": 0.061742475863253134, "in-drivable-lane": 2.800000000000005, "agent_compute-ego": 0.09720663140329082, "deviation-heading": 2.1694395159240227, "set_robot_commands": 0.09528927320844673, "deviation-center-line": 0.5771458850482323, "driven_lanedir_consec": 1.2305190031201856, "sim_compute_sim_state": 0.03827882348821404, "sim_compute_performance-ego": 0.06992528947551599, "sim_compute_robot_state-ego": 0.07240149814091372}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0678561329190914, "sim_physics": 0.11921270857466028, "survival_time": 4.699999999999991, "driven_lanedir": 0.8981067716987119, "sim_render-ego": 0.06484188932053586, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.09892491330491736, "deviation-heading": 1.1117379383976007, "set_robot_commands": 0.10449194400868515, "deviation-center-line": 0.34884787027557723, "driven_lanedir_consec": 0.8981067716987119, "sim_compute_sim_state": 0.040589669917492154, "sim_compute_performance-ego": 0.07760083675384521, "sim_compute_robot_state-ego": 0.08545771304597245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7621458305230319, "sim_physics": 0.11311588080033012, "survival_time": 3.4499999999999957, "driven_lanedir": 0.758467835111603, "sim_render-ego": 0.061401014742643936, "in-drivable-lane": 0, "agent_compute-ego": 0.09690403247225111, "deviation-heading": 0.3112599289821271, "set_robot_commands": 0.09756624871406004, "deviation-center-line": 0.41225298137550304, "driven_lanedir_consec": 0.758467835111603, "sim_compute_sim_state": 0.03884257095447485, "sim_compute_performance-ego": 0.06795479249263155, "sim_compute_robot_state-ego": 0.07825438181559245}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4035761096508277, "sim_physics": 0.11565114908051072, "survival_time": 14.250000000000068, "driven_lanedir": 2.786543911691145, "sim_render-ego": 0.06242092366804156, "in-drivable-lane": 1.7000000000000002, "agent_compute-ego": 0.0997653225011993, "deviation-heading": 3.61599883232021, "set_robot_commands": 0.09614342053731284, "deviation-center-line": 1.1488111156355547, "driven_lanedir_consec": 2.786543911691145, "sim_compute_sim_state": 0.03905590626231411, "sim_compute_performance-ego": 0.07031122676113195, "sim_compute_robot_state-ego": 0.07502928114773934}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1562248637204484, "sim_physics": 0.1180384341484862, "survival_time": 9.149999999999997, "driven_lanedir": 1.672813841076897, "sim_render-ego": 0.06259278912361854, "in-drivable-lane": 1.6999999999999955, "agent_compute-ego": 0.10172563172428986, "deviation-heading": 1.4218969858349213, "set_robot_commands": 0.09687611314116933, "deviation-center-line": 0.7569577539208971, "driven_lanedir_consec": 1.672813841076897, "sim_compute_sim_state": 0.04012774118308812, "sim_compute_performance-ego": 0.06982239608556196, "sim_compute_robot_state-ego": 0.07419703436679527}}
set_robot_commands_max0.10449194400868515
set_robot_commands_mean0.0980733999219348
set_robot_commands_median0.09687611314116933
set_robot_commands_min0.09528927320844673
sim_compute_performance-ego_max0.07760083675384521
sim_compute_performance-ego_mean0.07112290831373733
sim_compute_performance-ego_median0.06992528947551599
sim_compute_performance-ego_min0.06795479249263155
sim_compute_robot_state-ego_max0.08545771304597245
sim_compute_robot_state-ego_mean0.07706798170340265
sim_compute_robot_state-ego_median0.07502928114773934
sim_compute_robot_state-ego_min0.07240149814091372
sim_compute_sim_state_max0.040589669917492154
sim_compute_sim_state_mean0.03937894236111666
sim_compute_sim_state_median0.03905590626231411
sim_compute_sim_state_min0.03827882348821404
sim_physics_max0.11921270857466028
sim_physics_mean0.11602915367537828
sim_physics_median0.11565114908051072
sim_physics_min0.11311588080033012
sim_render-ego_max0.06484188932053586
sim_render-ego_mean0.06259981854361861
sim_render-ego_median0.06242092366804156
sim_render-ego_min0.061401014742643936
simulation-passed1
survival_time_max14.250000000000068
survival_time_mean8.090000000000009
survival_time_min3.4499999999999957
224543335MYFtestaido2-LFVI-sim-validationstep1-simulationerroryes11690:21:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224463295ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:09:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6665613794166414
survival_time_median4.449999999999992
deviation-center-line_median0.27506318261736495
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.13133786827005367
agent_compute-ego_mean0.10958869698914982
agent_compute-ego_median0.10602452641441708
agent_compute-ego_min0.09961463896076332
deviation-center-line_max0.5405466971129735
deviation-center-line_mean0.29571370825500976
deviation-center-line_min0.14577080707330664
deviation-heading_max1.1772769095730584
deviation-heading_mean0.6219946012733388
deviation-heading_median0.5979885370116356
deviation-heading_min0.3130597775476315
driven_any_max1.6793181334201532
driven_any_mean0.909008083111998
driven_any_median1.0067176412812215
driven_any_min0.3830463924283936
driven_lanedir_consec_max1.2866980510543735
driven_lanedir_consec_mean0.7030867622842658
driven_lanedir_consec_min0.3783827855885713
driven_lanedir_max1.2866980510543735
driven_lanedir_mean0.7030867622842658
driven_lanedir_median0.6665613794166414
driven_lanedir_min0.3783827855885713
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.7399999999999973
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0439998689644476, "sim_physics": 0.13015370471503146, "survival_time": 4.6499999999999915, "driven_lanedir": 0.6665613794166414, "sim_render-ego": 0.07065531258941979, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.13133786827005367, "deviation-heading": 0.37092426295100417, "set_robot_commands": 0.11001646646889308, "deviation-center-line": 0.27506318261736495, "driven_lanedir_consec": 0.6665613794166414, "sim_compute_sim_state": 0.04295575746925928, "sim_compute_performance-ego": 0.07345034999232139, "sim_compute_robot_state-ego": 0.08779208890853389}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0067176412812215, "sim_physics": 0.13158570514636092, "survival_time": 4.449999999999992, "driven_lanedir": 0.7726470000832769, "sim_render-ego": 0.06766855046990213, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.09961463896076332, "deviation-heading": 1.1772769095730584, "set_robot_commands": 0.10496531443649464, "deviation-center-line": 0.3156839638895037, "driven_lanedir_consec": 0.7726470000832769, "sim_compute_sim_state": 0.04170803273661753, "sim_compute_performance-ego": 0.07615993531902185, "sim_compute_robot_state-ego": 0.08146597026439195}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3830463924283936, "sim_physics": 0.13339745370965256, "survival_time": 1.900000000000001, "driven_lanedir": 0.3783827855885713, "sim_render-ego": 0.06137202915392424, "in-drivable-lane": 0, "agent_compute-ego": 0.1026848554611206, "deviation-heading": 0.3130597775476315, "set_robot_commands": 0.10008700270401805, "deviation-center-line": 0.20150389058190016, "driven_lanedir_consec": 0.3783827855885713, "sim_compute_sim_state": 0.041579522584614, "sim_compute_performance-ego": 0.07098876175127532, "sim_compute_robot_state-ego": 0.07685181969090511}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4319583794657741, "sim_physics": 0.124965162504287, "survival_time": 2.1000000000000005, "driven_lanedir": 0.4111445952784658, "sim_render-ego": 0.06486619654155913, "in-drivable-lane": 0, "agent_compute-ego": 0.10602452641441708, "deviation-heading": 0.6507235192833651, "set_robot_commands": 0.10434051354726157, "deviation-center-line": 0.14577080707330664, "driven_lanedir_consec": 0.4111445952784658, "sim_compute_sim_state": 0.040420061066037134, "sim_compute_performance-ego": 0.06979412691933769, "sim_compute_robot_state-ego": 0.07560365540640694}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6793181334201532, "sim_physics": 0.12437489794360268, "survival_time": 7.199999999999982, "driven_lanedir": 1.2866980510543735, "sim_render-ego": 0.06501300467385186, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10828159583939446, "deviation-heading": 0.5979885370116356, "set_robot_commands": 0.10258388353718652, "deviation-center-line": 0.5405466971129735, "driven_lanedir_consec": 1.2866980510543735, "sim_compute_sim_state": 0.04086485008398691, "sim_compute_performance-ego": 0.07392720381418864, "sim_compute_robot_state-ego": 0.08219448394245571}}
set_robot_commands_max0.11001646646889308
set_robot_commands_mean0.10439863613877076
set_robot_commands_median0.10434051354726157
set_robot_commands_min0.10008700270401805
sim_compute_performance-ego_max0.07615993531902185
sim_compute_performance-ego_mean0.07286407555922898
sim_compute_performance-ego_median0.07345034999232139
sim_compute_performance-ego_min0.06979412691933769
sim_compute_robot_state-ego_max0.08779208890853389
sim_compute_robot_state-ego_mean0.08078160364253872
sim_compute_robot_state-ego_median0.08146597026439195
sim_compute_robot_state-ego_min0.07560365540640694
sim_compute_sim_state_max0.04295575746925928
sim_compute_sim_state_mean0.041505644788102966
sim_compute_sim_state_median0.041579522584614
sim_compute_sim_state_min0.040420061066037134
sim_physics_max0.13339745370965256
sim_physics_mean0.12889538480378693
sim_physics_median0.13015370471503146
sim_physics_min0.12437489794360268
sim_render-ego_max0.07065531258941979
sim_render-ego_mean0.06591501868573144
sim_render-ego_median0.06501300467385186
sim_render-ego_min0.06137202915392424
simulation-passed1
survival_time_max7.199999999999982
survival_time_mean4.059999999999993
survival_time_min1.900000000000001
224403300ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11690:08:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4108623025159917
survival_time_median2.2
deviation-center-line_median0.17608683739206069
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1161846626888622
agent_compute-ego_mean0.1065970033854839
agent_compute-ego_median0.10513032807244196
agent_compute-ego_min0.09789851132561178
deviation-center-line_max0.553006586721707
deviation-center-line_mean0.25167707733840106
deviation-center-line_min0.1230563934255246
deviation-heading_max1.353610693525513
deviation-heading_mean0.8401519300419471
deviation-heading_median0.7074316092927606
deviation-heading_min0.3145163536332646
driven_any_max1.1657013383876025
driven_any_mean0.63752855441504
driven_any_median0.4447815158042768
driven_any_min0.3341398229437414
driven_lanedir_consec_max1.0434182104988623
driven_lanedir_consec_mean0.5573910485118122
driven_lanedir_consec_min0.3284215252184426
driven_lanedir_max1.0434182104988623
driven_lanedir_mean0.5573910485118122
driven_lanedir_median0.4108623025159917
driven_lanedir_min0.3284215252184426
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.1399999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4447815158042768, "sim_physics": 0.14357539740475742, "survival_time": 2.2, "driven_lanedir": 0.4108623025159917, "sim_render-ego": 0.06835265593095259, "in-drivable-lane": 0, "agent_compute-ego": 0.1161846626888622, "deviation-heading": 0.7063746991018894, "set_robot_commands": 0.1107547554102811, "deviation-center-line": 0.15953890453813732, "driven_lanedir_consec": 0.4108623025159917, "sim_compute_sim_state": 0.042578009041872894, "sim_compute_performance-ego": 0.0821873437274586, "sim_compute_robot_state-ego": 0.08426532962105492}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8844282098528133, "sim_physics": 0.12575247016134142, "survival_time": 3.949999999999994, "driven_lanedir": 0.6753190495150517, "sim_render-ego": 0.06606724896008455, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.1007549702366696, "deviation-heading": 1.1188262946563077, "set_robot_commands": 0.1018355949015557, "deviation-center-line": 0.24669666461457568, "driven_lanedir_consec": 0.6753190495150517, "sim_compute_sim_state": 0.040934843353078336, "sim_compute_performance-ego": 0.0750313076791884, "sim_compute_robot_state-ego": 0.07969949215273314}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3341398229437414, "sim_physics": 0.121652554063236, "survival_time": 1.7000000000000008, "driven_lanedir": 0.328934154810713, "sim_render-ego": 0.06535426308127011, "in-drivable-lane": 0, "agent_compute-ego": 0.09789851132561178, "deviation-heading": 0.3145163536332646, "set_robot_commands": 0.09681362965527704, "deviation-center-line": 0.17608683739206069, "driven_lanedir_consec": 0.328934154810713, "sim_compute_sim_state": 0.04149777749005486, "sim_compute_performance-ego": 0.0757823341033038, "sim_compute_robot_state-ego": 0.07920744839836569}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3585918850867666, "sim_physics": 0.1465895242161221, "survival_time": 1.800000000000001, "driven_lanedir": 0.3284215252184426, "sim_render-ego": 0.07163292169570923, "in-drivable-lane": 0, "agent_compute-ego": 0.10513032807244196, "deviation-heading": 0.7074316092927606, "set_robot_commands": 0.1057207120789422, "deviation-center-line": 0.1230563934255246, "driven_lanedir_consec": 0.3284215252184426, "sim_compute_sim_state": 0.04634696907467312, "sim_compute_performance-ego": 0.07658784919314915, "sim_compute_robot_state-ego": 0.08306401305728489}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1657013383876025, "sim_physics": 0.1416974792293474, "survival_time": 5.09999999999999, "driven_lanedir": 1.0434182104988623, "sim_render-ego": 0.06556390079797483, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.11301654460383397, "deviation-heading": 1.353610693525513, "set_robot_commands": 0.1080380491181916, "deviation-center-line": 0.553006586721707, "driven_lanedir_consec": 1.0434182104988623, "sim_compute_sim_state": 0.04353268240012374, "sim_compute_performance-ego": 0.07612160140392828, "sim_compute_robot_state-ego": 0.0833505345325844}}
set_robot_commands_max0.1107547554102811
set_robot_commands_mean0.10463254823284954
set_robot_commands_median0.1057207120789422
set_robot_commands_min0.09681362965527704
sim_compute_performance-ego_max0.0821873437274586
sim_compute_performance-ego_mean0.07714208722140564
sim_compute_performance-ego_median0.07612160140392828
sim_compute_performance-ego_min0.0750313076791884
sim_compute_robot_state-ego_max0.08426532962105492
sim_compute_robot_state-ego_mean0.08191736355240462
sim_compute_robot_state-ego_median0.08306401305728489
sim_compute_robot_state-ego_min0.07920744839836569
sim_compute_sim_state_max0.04634696907467312
sim_compute_sim_state_mean0.042978056271960594
sim_compute_sim_state_median0.042578009041872894
sim_compute_sim_state_min0.040934843353078336
sim_physics_max0.1465895242161221
sim_physics_mean0.13585348501496086
sim_physics_median0.1416974792293474
sim_physics_min0.121652554063236
sim_render-ego_max0.07163292169570923
sim_render-ego_mean0.06739419809319827
sim_render-ego_median0.06606724896008455
sim_render-ego_min0.06535426308127011
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.949999999999997
survival_time_min1.7000000000000008
224253312awoo424Roasted duckaido2-LF-sim-validationstep1-simulationsuccessyes11690:16:34Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3496541027899869
survival_time_median5.299999999999989
deviation-center-line_median0.29817832962587804
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.2677252552726052
agent_compute-ego_mean0.22035048683258687
agent_compute-ego_median0.2103179175898714
agent_compute-ego_min0.18094515582742213
deviation-center-line_max0.8910330182524215
deviation-center-line_mean0.4264780459482808
deviation-center-line_min0.28077402334016544
deviation-heading_max2.0821930316740573
deviation-heading_mean1.7659753763307156
deviation-heading_median1.8813395939057316
deviation-heading_min1.0820895466826623
driven_any_max1.1012533152257715
driven_any_mean0.5689374927274462
driven_any_median0.39804664955665897
driven_any_min0.1893884857933168
driven_lanedir_consec_max1.0649032250946142
driven_lanedir_consec_mean0.5019902993930894
driven_lanedir_consec_min0.1722477218334686
driven_lanedir_max1.0649032250946142
driven_lanedir_mean0.5019902993930894
driven_lanedir_median0.3496541027899869
driven_lanedir_min0.1722477218334686
in-drivable-lane_max1.7500000000000249
in-drivable-lane_mean0.4700000000000054
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1012533152257715, "sim_physics": 0.09658172845840454, "survival_time": 14.950000000000076, "driven_lanedir": 1.0649032250946142, "sim_render-ego": 0.05737500429153442, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.18985747098922728, "deviation-heading": 2.0821930316740573, "set_robot_commands": 0.0832806921005249, "deviation-center-line": 0.8910330182524215, "driven_lanedir_consec": 1.0649032250946142, "sim_compute_sim_state": 0.03434476534525553, "sim_compute_performance-ego": 0.060694024562835694, "sim_compute_robot_state-ego": 0.0643535057703654}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8532875463606754, "sim_physics": 0.08834603496882469, "survival_time": 10.95000000000002, "driven_lanedir": 0.6785838987704491, "sim_render-ego": 0.05195739280143285, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.18094515582742213, "deviation-heading": 1.8813395939057316, "set_robot_commands": 0.08122290541592254, "deviation-center-line": 0.3717255384421089, "driven_lanedir_consec": 0.6785838987704491, "sim_compute_sim_state": 0.034273477449809034, "sim_compute_performance-ego": 0.0581164784627418, "sim_compute_robot_state-ego": 0.06008780492495184}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1893884857933168, "sim_physics": 0.1053327343680642, "survival_time": 2.7499999999999982, "driven_lanedir": 0.1722477218334686, "sim_render-ego": 0.057742977142333986, "in-drivable-lane": 0, "agent_compute-ego": 0.2677252552726052, "deviation-heading": 1.0820895466826623, "set_robot_commands": 0.0925160451368852, "deviation-center-line": 0.29817832962587804, "driven_lanedir_consec": 0.1722477218334686, "sim_compute_sim_state": 0.03598507967862216, "sim_compute_performance-ego": 0.06122544462030584, "sim_compute_robot_state-ego": 0.06192522482438521}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.302711466700808, "sim_physics": 0.08022321006398142, "survival_time": 4.049999999999994, "driven_lanedir": 0.2445625484769285, "sim_render-ego": 0.06316284191461256, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.25290663448380835, "deviation-heading": 1.9969904799270992, "set_robot_commands": 0.06967232551103757, "deviation-center-line": 0.28077402334016544, "driven_lanedir_consec": 0.2445625484769285, "sim_compute_sim_state": 0.04143663394598313, "sim_compute_performance-ego": 0.065232147405177, "sim_compute_robot_state-ego": 0.05850335992412803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39804664955665897, "sim_physics": 0.11368137710499314, "survival_time": 5.299999999999989, "driven_lanedir": 0.3496541027899869, "sim_render-ego": 0.05758777429472725, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.2103179175898714, "deviation-heading": 1.7872642294640269, "set_robot_commands": 0.09248955519694202, "deviation-center-line": 0.29067932008082964, "driven_lanedir_consec": 0.3496541027899869, "sim_compute_sim_state": 0.03839026082236812, "sim_compute_performance-ego": 0.06169818707232205, "sim_compute_robot_state-ego": 0.06745851264809663}}
set_robot_commands_max0.0925160451368852
set_robot_commands_mean0.08383630467226245
set_robot_commands_median0.0832806921005249
set_robot_commands_min0.06967232551103757
sim_compute_performance-ego_max0.065232147405177
sim_compute_performance-ego_mean0.06139325642467648
sim_compute_performance-ego_median0.06122544462030584
sim_compute_performance-ego_min0.0581164784627418
sim_compute_robot_state-ego_max0.06745851264809663
sim_compute_robot_state-ego_mean0.062465681618385414
sim_compute_robot_state-ego_median0.06192522482438521
sim_compute_robot_state-ego_min0.05850335992412803
sim_compute_sim_state_max0.04143663394598313
sim_compute_sim_state_mean0.0368860434484076
sim_compute_sim_state_median0.03598507967862216
sim_compute_sim_state_min0.034273477449809034
sim_physics_max0.11368137710499314
sim_physics_mean0.0968330169928536
sim_physics_median0.09658172845840454
sim_physics_min0.08022321006398142
sim_render-ego_max0.06316284191461256
sim_render-ego_mean0.05756519808892822
sim_render-ego_median0.05758777429472725
sim_render-ego_min0.05195739280143285
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.600000000000016
survival_time_min2.7499999999999982
224193319jp18813100494RL - TH - shiaido2-LF-sim-validationstep1-simulationerroryes11690:01:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224053330JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11690:20:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223903342JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyes11690:35:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6061195165241595
survival_time_median14.950000000000076
deviation-center-line_median0.9158554167971322
in-drivable-lane_median0.6499999999999977


other stats
agent_compute-ego_max0.3332826638221741
agent_compute-ego_mean0.3065102955500285
agent_compute-ego_median0.3126683608690898
agent_compute-ego_min0.2709287230173747
deviation-center-line_max1.3900540864280544
deviation-center-line_mean1.0478876261231291
deviation-center-line_min0.8170491003396274
deviation-heading_max3.2814669740520683
deviation-heading_mean2.280953131159643
deviation-heading_median2.235364113960447
deviation-heading_min1.2850574087601645
driven_any_max2.878026120260703
driven_any_mean2.713939627368959
driven_any_median2.667858048351088
driven_any_min2.5107444223692195
driven_lanedir_consec_max2.7234767923157013
driven_lanedir_consec_mean2.5578402399429794
driven_lanedir_consec_min2.26727702033328
driven_lanedir_max2.7234767923157013
driven_lanedir_mean2.5578402399429794
driven_lanedir_median2.6061195165241595
driven_lanedir_min2.26727702033328
in-drivable-lane_max2.150000000000002
in-drivable-lane_mean0.8000000000000034
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5107444223692195, "sim_physics": 0.15085184176762895, "survival_time": 14.950000000000076, "driven_lanedir": 2.26727702033328, "sim_render-ego": 0.07198540846506754, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.2709287230173747, "deviation-heading": 3.2814669740520683, "set_robot_commands": 0.12256356239318848, "deviation-center-line": 0.8170491003396274, "driven_lanedir_consec": 2.26727702033328, "sim_compute_sim_state": 0.046000825564066566, "sim_compute_performance-ego": 0.07941846927007039, "sim_compute_robot_state-ego": 0.09270612637201946}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.8519477342001416, "sim_physics": 0.15287224610646566, "survival_time": 14.950000000000076, "driven_lanedir": 2.7234767923157013, "sim_render-ego": 0.07266729990641276, "in-drivable-lane": 0.6499999999999977, "agent_compute-ego": 0.3332826638221741, "deviation-heading": 2.139728816373815, "set_robot_commands": 0.12005263408025106, "deviation-center-line": 1.3900540864280544, "driven_lanedir_consec": 2.7234767923157013, "sim_compute_sim_state": 0.0458188247680664, "sim_compute_performance-ego": 0.08290475447972616, "sim_compute_robot_state-ego": 0.0951720635096232}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.878026120260703, "sim_physics": 0.13622482776641845, "survival_time": 14.950000000000076, "driven_lanedir": 2.5775981565066965, "sim_render-ego": 0.07277334849039714, "in-drivable-lane": 2.150000000000002, "agent_compute-ego": 0.3126683608690898, "deviation-heading": 1.2850574087601645, "set_robot_commands": 0.11943259477615356, "deviation-center-line": 1.2397826767779554, "driven_lanedir_consec": 2.5775981565066965, "sim_compute_sim_state": 0.04607876062393188, "sim_compute_performance-ego": 0.08166768789291382, "sim_compute_robot_state-ego": 0.0933917530377706}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.667858048351088, "sim_physics": 0.1460714817047119, "survival_time": 14.950000000000076, "driven_lanedir": 2.61472971403506, "sim_render-ego": 0.07214704672495524, "in-drivable-lane": 0, "agent_compute-ego": 0.2984927678108215, "deviation-heading": 2.4631483426517207, "set_robot_commands": 0.11639736175537108, "deviation-center-line": 0.876696850272876, "driven_lanedir_consec": 2.61472971403506, "sim_compute_sim_state": 0.045822412967681886, "sim_compute_performance-ego": 0.08229336659113566, "sim_compute_robot_state-ego": 0.0901212708155314}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6611218116636426, "sim_physics": 0.14282263278961185, "survival_time": 14.950000000000076, "driven_lanedir": 2.6061195165241595, "sim_render-ego": 0.07049689054489136, "in-drivable-lane": 0, "agent_compute-ego": 0.31717896223068237, "deviation-heading": 2.235364113960447, "set_robot_commands": 0.1152267034848531, "deviation-center-line": 0.9158554167971322, "driven_lanedir_consec": 2.6061195165241595, "sim_compute_sim_state": 0.046239012082417805, "sim_compute_performance-ego": 0.08189732869466146, "sim_compute_robot_state-ego": 0.08969166278839111}}
set_robot_commands_max0.12256356239318848
set_robot_commands_mean0.11873457129796346
set_robot_commands_median0.11943259477615356
set_robot_commands_min0.1152267034848531
sim_compute_performance-ego_max0.08290475447972616
sim_compute_performance-ego_mean0.0816363213857015
sim_compute_performance-ego_median0.08189732869466146
sim_compute_performance-ego_min0.07941846927007039
sim_compute_robot_state-ego_max0.0951720635096232
sim_compute_robot_state-ego_mean0.09221657530466716
sim_compute_robot_state-ego_median0.09270612637201946
sim_compute_robot_state-ego_min0.08969166278839111
sim_compute_sim_state_max0.046239012082417805
sim_compute_sim_state_mean0.04599196720123291
sim_compute_sim_state_median0.046000825564066566
sim_compute_sim_state_min0.0458188247680664
sim_physics_max0.15287224610646566
sim_physics_mean0.14576860602696734
sim_physics_median0.1460714817047119
sim_physics_min0.13622482776641845
sim_render-ego_max0.07277334849039714
sim_render-ego_mean0.07201399882634481
sim_render-ego_median0.07214704672495524
sim_render-ego_min0.07049689054489136
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
223863344JBRRussiaJetBrains Researchaido2-LFV-sim-validationstep1-simulationerroryes11690:01:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223823347JBRRussiaJetBrains Researchaido2-LFV-sim-testingstep1-simulationerroryes11690:05:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223743363AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11690:16:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17625309983078313
agent_compute-ego_mean0.15459522755965524
agent_compute-ego_median0.15913964252845914
agent_compute-ego_min0.11782347679138185
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10983236630757648, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059388447690893104, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14248813081670691, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08965456485748291, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.037076989809672035, "sim_compute_performance-ego": 0.06754017759252477, "sim_compute_robot_state-ego": 0.07998771137661403}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10508386761534448, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.059158442067165, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1466529416102989, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09053615027782964, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03900088048448749, "sim_compute_performance-ego": 0.06624575222239774, "sim_compute_robot_state-ego": 0.07221005944644704}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.08880361388711368, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0493316650390625, "in-drivable-lane": 0, "agent_compute-ego": 0.1291334208320169, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.07567940038793228, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03082150571486529, "sim_compute_performance-ego": 0.06274975047392004, "sim_compute_robot_state-ego": 0.06573097846087288}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07724232673645019, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.048953218460083006, "in-drivable-lane": 0, "agent_compute-ego": 0.11782347679138185, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.08277896881103515, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.029877471923828124, "sim_compute_performance-ego": 0.05374107360839843, "sim_compute_robot_state-ego": 0.05405324935913086}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10078196284137196, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0524642799474016, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13160768038109888, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08093705961975871, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.033087911485116694, "sim_compute_performance-ego": 0.05503167985360834, "sim_compute_robot_state-ego": 0.06110450587695158}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1323069747613401, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.08080041651823083, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.17625309983078313, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.10486830497274592, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.04270637278654137, "sim_compute_performance-ego": 0.07426549950424506, "sim_compute_robot_state-ego": 0.0872695591984963}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12183875271252224, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0678783016545432, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1536087989807129, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08759051987103053, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.09751888683864048, "sim_compute_performance-ego": 0.08345099432127816, "sim_compute_robot_state-ego": 0.07750268919127327}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.14024296261015393, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06504759334382557, "in-drivable-lane": 0, "agent_compute-ego": 0.15718892642429896, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10432834852309454, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.04183324178059896, "sim_compute_performance-ego": 0.07316789172944568, "sim_compute_robot_state-ego": 0.08615052132379442}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.13296533439118982, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.0676324286703336, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16495981458890235, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.10585327875816215, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04138175107664981, "sim_compute_performance-ego": 0.0708601111072605, "sim_compute_robot_state-ego": 0.07635310948905298}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.12120715921575372, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06971504471518776, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1628161083568226, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10491611740805884, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04113696705211293, "sim_compute_performance-ego": 0.07315218665383079, "sim_compute_robot_state-ego": 0.0805058089169589}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.1356029293753884, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06802021683036506, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17218447660470937, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.112020443012188, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04333586197394829, "sim_compute_performance-ego": 0.08476135637853052, "sim_compute_robot_state-ego": 0.08814864344411082}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.15191222088677542, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.07176744086401803, "in-drivable-lane": 0, "agent_compute-ego": 0.17163033144814627, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10452603442328316, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.0447989957673209, "sim_compute_performance-ego": 0.08191582134791783, "sim_compute_robot_state-ego": 0.09024468490055627}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11540967810387703, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.06473155115164962, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15913964252845914, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.0994402333801868, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.04328115313660865, "sim_compute_performance-ego": 0.06938658508599974, "sim_compute_robot_state-ego": 0.07348286404329188}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12501410201743798, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.0639389091067844, "in-drivable-lane": 0, "agent_compute-ego": 0.16648387025903771, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10176829938535337, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04093382093641493, "sim_compute_performance-ego": 0.06913186885692456, "sim_compute_robot_state-ego": 0.07721867384733977}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12180633872163062, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06943307203405044, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16695769394145293, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.104967851264804, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.04252606513453465, "sim_compute_performance-ego": 0.07723571973688462, "sim_compute_robot_state-ego": 0.08720116054310519}}
set_robot_commands_max0.112020443012188
set_robot_commands_mean0.09665770499686306
set_robot_commands_median0.10176829938535337
set_robot_commands_min0.07567940038793228
sim_compute_performance-ego_max0.08476135637853052
sim_compute_performance-ego_mean0.07084243123154448
sim_compute_performance-ego_median0.0708601111072605
sim_compute_performance-ego_min0.05374107360839843
sim_compute_robot_state-ego_max0.09024468490055627
sim_compute_robot_state-ego_mean0.07714428129453307
sim_compute_robot_state-ego_median0.07750268919127327
sim_compute_robot_state-ego_min0.05405324935913086
sim_compute_sim_state_max0.09751888683864048
sim_compute_sim_state_mean0.04328785839342271
sim_compute_sim_state_median0.04138175107664981
sim_compute_sim_state_min0.029877471923828124
sim_physics_max0.15191222088677542
sim_physics_mean0.11867003934559509
sim_physics_median0.12180633872163062
sim_physics_min0.07724232673645019
sim_render-ego_max0.08080041651823083
sim_render-ego_mean0.06388406853957292
sim_render-ego_median0.06504759334382557
sim_render-ego_min0.048953218460083006
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
223573386jp18813100494RL-TH-shiaido2-LFVI-sim-validationstep1-simulationsuccessyes11690:36:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0961941803608934
survival_time_median14.950000000000076
deviation-center-line_median0.9555568126403592
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17341103792190551
agent_compute-ego_mean0.16679463847478232
agent_compute-ego_median0.16866087039311728
agent_compute-ego_min0.15788953145345053
deviation-center-line_max1.2876072210642098
deviation-center-line_mean0.8275123667626163
deviation-center-line_min0.4165220148816433
deviation-heading_max16.99759519832536
deviation-heading_mean6.125951093256273
deviation-heading_median3.163097478713258
deviation-heading_min1.8789318174933505
driven_any_max3.9707506625282454
driven_any_mean2.750455990614764
driven_any_median3.166379558689082
driven_any_min0.1357204919218267
driven_lanedir_consec_max3.9062146074302166
driven_lanedir_consec_mean2.556285663248601
driven_lanedir_consec_min0.12068109296077888
driven_lanedir_max3.9062146074302166
driven_lanedir_mean2.6884372731658495
driven_lanedir_median3.0963689487710204
driven_lanedir_min0.12068109296077888
in-drivable-lane_max4.25000000000006
in-drivable-lane_mean0.8900000000000127
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.630389718202428, "sim_physics": 0.17873452186584474, "survival_time": 14.950000000000076, "driven_lanedir": 2.5423281923934073, "sim_render-ego": 0.055167959531148274, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.15788953145345053, "deviation-heading": 5.632204681719905, "set_robot_commands": 0.08382343133290608, "deviation-center-line": 0.9555568126403592, "driven_lanedir_consec": 2.3094997466357805, "sim_compute_sim_state": 0.035568127632141115, "sim_compute_performance-ego": 0.06035219351450602, "sim_compute_robot_state-ego": 0.0652646787961324, "sim_compute_robot_state-npc0": 0.06238325675328573, "sim_compute_robot_state-npc1": 0.062117741107940674, "sim_compute_robot_state-npc2": 0.06113009611765544, "sim_compute_robot_state-npc3": 0.06056814750035604}, "udem1-1-0": {"driven_any": 0.1357204919218267, "sim_physics": 0.2028897205988566, "survival_time": 14.950000000000076, "driven_lanedir": 0.12068109296077888, "sim_render-ego": 0.061084957122802735, "in-drivable-lane": 0, "agent_compute-ego": 0.1722736994425456, "deviation-heading": 16.99759519832536, "set_robot_commands": 0.08945998986562093, "deviation-center-line": 0.4165220148816433, "driven_lanedir_consec": 0.12068109296077888, "sim_compute_sim_state": 0.036806494394938154, "sim_compute_performance-ego": 0.06343329826990764, "sim_compute_robot_state-ego": 0.06873017152150472, "sim_compute_robot_state-npc0": 0.06524298906326294, "sim_compute_robot_state-npc1": 0.06480679035186768, "sim_compute_robot_state-npc2": 0.06442842245101929, "sim_compute_robot_state-npc3": 0.06496115287144978}, "udem1-2-0": {"driven_any": 3.849039521732238, "sim_physics": 0.1942102289199829, "survival_time": 14.950000000000076, "driven_lanedir": 3.776593524273823, "sim_render-ego": 0.06043704350789388, "in-drivable-lane": 0, "agent_compute-ego": 0.17341103792190551, "deviation-heading": 3.163097478713258, "set_robot_commands": 0.09244399070739746, "deviation-center-line": 1.2876072210642098, "driven_lanedir_consec": 3.348838688855335, "sim_compute_sim_state": 0.036699516773223875, "sim_compute_performance-ego": 0.06569170951843262, "sim_compute_robot_state-ego": 0.07259090026219686, "sim_compute_robot_state-npc0": 0.06773422718048096, "sim_compute_robot_state-npc1": 0.06733093659083049, "sim_compute_robot_state-npc2": 0.06589390595753987, "sim_compute_robot_state-npc3": 0.06584122737248739}, "udem1-3-0": {"driven_any": 3.9707506625282454, "sim_physics": 0.1954219388961792, "survival_time": 14.950000000000076, "driven_lanedir": 3.9062146074302166, "sim_render-ego": 0.0598202363650004, "in-drivable-lane": 0, "agent_compute-ego": 0.16866087039311728, "deviation-heading": 2.95792629002949, "set_robot_commands": 0.09247800906499228, "deviation-center-line": 1.0349443222002073, "driven_lanedir_consec": 3.9062146074302166, "sim_compute_sim_state": 0.03599563121795654, "sim_compute_performance-ego": 0.06641101757685343, "sim_compute_robot_state-ego": 0.07093421300252278, "sim_compute_robot_state-npc0": 0.06557390213012695, "sim_compute_robot_state-npc1": 0.06434804677963257, "sim_compute_robot_state-npc2": 0.06417282660802205, "sim_compute_robot_state-npc3": 0.06414253870646158}, "udem1-4-0": {"driven_any": 3.166379558689082, "sim_physics": 0.17110615412394206, "survival_time": 14.950000000000076, "driven_lanedir": 3.0963689487710204, "sim_render-ego": 0.05771746953328451, "in-drivable-lane": 4.25000000000006, "agent_compute-ego": 0.16173805316289266, "deviation-heading": 1.8789318174933505, "set_robot_commands": 0.09154293696085612, "deviation-center-line": 0.4429314630266619, "driven_lanedir_consec": 3.0961941803608934, "sim_compute_sim_state": 0.035366469224294025, "sim_compute_performance-ego": 0.06258252302805582, "sim_compute_robot_state-ego": 0.06580291191736858, "sim_compute_robot_state-npc0": 0.06336495796839396, "sim_compute_robot_state-npc1": 0.06352715333302816, "sim_compute_robot_state-npc2": 0.061151315371195475, "sim_compute_robot_state-npc3": 0.06241880178451538}}
set_robot_commands_max0.09247800906499228
set_robot_commands_mean0.08994967158635457
set_robot_commands_median0.09154293696085612
set_robot_commands_min0.08382343133290608
sim_compute_performance-ego_max0.06641101757685343
sim_compute_performance-ego_mean0.0636941483815511
sim_compute_performance-ego_median0.06343329826990764
sim_compute_performance-ego_min0.06035219351450602
sim_compute_robot_state-ego_max0.07259090026219686
sim_compute_robot_state-ego_mean0.06866457509994507
sim_compute_robot_state-ego_median0.06873017152150472
sim_compute_robot_state-ego_min0.0652646787961324
sim_compute_robot_state-npc0_max0.06773422718048096
sim_compute_robot_state-npc0_mean0.06485986661911011
sim_compute_robot_state-npc0_median0.06524298906326294
sim_compute_robot_state-npc0_min0.06238325675328573
sim_compute_robot_state-npc1_max0.06733093659083049
sim_compute_robot_state-npc1_mean0.06442613363265992
sim_compute_robot_state-npc1_median0.06434804677963257
sim_compute_robot_state-npc1_min0.062117741107940674
sim_compute_robot_state-npc2_max0.06589390595753987
sim_compute_robot_state-npc2_mean0.06335531330108642
sim_compute_robot_state-npc2_median0.06417282660802205
sim_compute_robot_state-npc2_min0.06113009611765544
sim_compute_robot_state-npc3_max0.06584122737248739
sim_compute_robot_state-npc3_mean0.06358637364705402
sim_compute_robot_state-npc3_median0.06414253870646158
sim_compute_robot_state-npc3_min0.06056814750035604
sim_compute_sim_state_max0.036806494394938154
sim_compute_sim_state_mean0.03608724784851074
sim_compute_sim_state_median0.03599563121795654
sim_compute_sim_state_min0.035366469224294025
sim_physics_max0.2028897205988566
sim_physics_mean0.1884725128809611
sim_physics_median0.1942102289199829
sim_physics_min0.17110615412394206
sim_render-ego_max0.061084957122802735
sim_render-ego_mean0.05884553321202596
sim_render-ego_median0.0598202363650004
sim_render-ego_min0.055167959531148274
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
223423397jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11690:56:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223393399jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11690:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223293409jp18813100494RL - TH -hhkaido2-LFV-sim-testingstep1-simulationerroryes11690:17:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223273411jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223203417jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationsuccessyes11690:12:01Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1990896621369949
survival_time_median8.549999999999986
deviation-center-line_median0.27984287863563906
in-drivable-lane_median1.1999999999999955


other stats
agent_compute-ego_max0.1624285991375263
agent_compute-ego_mean0.15493356553984156
agent_compute-ego_median0.15610548885919714
agent_compute-ego_min0.14761669454518814
deviation-center-line_max0.5867373025751078
deviation-center-line_mean0.329920399140803
deviation-center-line_min0.18228241241353563
deviation-heading_max1.4726043676634242
deviation-heading_mean1.1330413833210462
deviation-heading_median1.0470324603828471
deviation-heading_min0.8392455185368155
driven_any_max1.9784423091100856
driven_any_mean1.4691073891236293
driven_any_median1.611422185622498
driven_any_min0.5427627763159826
driven_lanedir_consec_max1.4342644357938217
driven_lanedir_consec_mean1.0156611891593452
driven_lanedir_consec_min0.5028995304197132
driven_lanedir_max1.4342644357938217
driven_lanedir_mean1.0156611891593452
driven_lanedir_median1.1990896621369949
driven_lanedir_min0.5028995304197132
in-drivable-lane_max4.949999999999991
in-drivable-lane_mean1.880000000000002
in-drivable-lane_min0.09999999999999964
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.9784423091100856, "sim_physics": 0.09543951213011267, "survival_time": 8.549999999999986, "driven_lanedir": 0.731133519841413, "sim_render-ego": 0.05136656621743363, "in-drivable-lane": 4.949999999999991, "agent_compute-ego": 0.14761669454518814, "deviation-heading": 1.3078445591894818, "set_robot_commands": 0.08489760320786147, "deviation-center-line": 0.20443047512808832, "driven_lanedir_consec": 0.731133519841413, "sim_compute_sim_state": 0.03352126043442397, "sim_compute_performance-ego": 0.05846241761369315, "sim_compute_robot_state-ego": 0.062159041912235015}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5427627763159826, "sim_physics": 0.10609556344839242, "survival_time": 3.2499999999999964, "driven_lanedir": 0.5028995304197132, "sim_render-ego": 0.064739440037654, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.1624285991375263, "deviation-heading": 0.8392455185368155, "set_robot_commands": 0.08852981053865873, "deviation-center-line": 0.18228241241353563, "driven_lanedir_consec": 0.5028995304197132, "sim_compute_sim_state": 0.03605962900015024, "sim_compute_performance-ego": 0.0631716801570012, "sim_compute_robot_state-ego": 0.0710330266218919}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6004115710229994, "sim_physics": 0.095704436983381, "survival_time": 8.74999999999999, "driven_lanedir": 1.4342644357938217, "sim_render-ego": 0.05364257676260812, "in-drivable-lane": 0.9500000000000092, "agent_compute-ego": 0.14961215700422015, "deviation-heading": 1.0470324603828471, "set_robot_commands": 0.08118879863194058, "deviation-center-line": 0.5867373025751078, "driven_lanedir_consec": 1.4342644357938217, "sim_compute_sim_state": 0.03518272399902344, "sim_compute_performance-ego": 0.0597028078351702, "sim_compute_robot_state-ego": 0.062009216036115374}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.611422185622498, "sim_physics": 0.09981834247548094, "survival_time": 9.299999999999995, "driven_lanedir": 1.210918797604784, "sim_render-ego": 0.05737256234691989, "in-drivable-lane": 2.2000000000000144, "agent_compute-ego": 0.15610548885919714, "deviation-heading": 1.4726043676634242, "set_robot_commands": 0.08433630389551963, "deviation-center-line": 0.3963089269516444, "driven_lanedir_consec": 1.210918797604784, "sim_compute_sim_state": 0.0362281709588984, "sim_compute_performance-ego": 0.062062096852128226, "sim_compute_robot_state-ego": 0.06656066961185907}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6124981035465813, "sim_physics": 0.10289881706237793, "survival_time": 6.249999999999986, "driven_lanedir": 1.1990896621369949, "sim_render-ego": 0.05704084396362305, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.15890488815307618, "deviation-heading": 0.9984800108326628, "set_robot_commands": 0.08485345077514649, "deviation-center-line": 0.27984287863563906, "driven_lanedir_consec": 1.1990896621369949, "sim_compute_sim_state": 0.03516554641723633, "sim_compute_performance-ego": 0.06255588150024415, "sim_compute_robot_state-ego": 0.06437260437011719}}
set_robot_commands_max0.08852981053865873
set_robot_commands_mean0.08476119340982538
set_robot_commands_median0.08485345077514649
set_robot_commands_min0.08118879863194058
sim_compute_performance-ego_max0.0631716801570012
sim_compute_performance-ego_mean0.06119097679164739
sim_compute_performance-ego_median0.062062096852128226
sim_compute_performance-ego_min0.05846241761369315
sim_compute_robot_state-ego_max0.0710330266218919
sim_compute_robot_state-ego_mean0.0652269117104437
sim_compute_robot_state-ego_median0.06437260437011719
sim_compute_robot_state-ego_min0.062009216036115374
sim_compute_sim_state_max0.0362281709588984
sim_compute_sim_state_mean0.03523146616194648
sim_compute_sim_state_median0.03518272399902344
sim_compute_sim_state_min0.03352126043442397
sim_physics_max0.10609556344839242
sim_physics_mean0.09999133441994898
sim_physics_median0.09981834247548094
sim_physics_min0.09543951213011267
sim_render-ego_max0.064739440037654
sim_render-ego_mean0.056832397865647734
sim_render-ego_median0.05704084396362305
sim_render-ego_min0.05136656621743363
simulation-passed1
survival_time_max9.299999999999995
survival_time_mean7.21999999999999
survival_time_min3.2499999999999964
223113425jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11690:29:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4789233115106395
survival_time_median14.950000000000076
deviation-center-line_median0.8146285309217326
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1705783176422119
agent_compute-ego_mean0.16478800010681152
agent_compute-ego_median0.16434234937032063
agent_compute-ego_min0.15866530338923138
deviation-center-line_max1.2012396017870604
deviation-center-line_mean0.7501260074558616
deviation-center-line_min0.09089593761882547
deviation-heading_max6.751529529551556
deviation-heading_mean3.400992125160336
deviation-heading_median3.427825313648924
deviation-heading_min0.5354470537706654
driven_any_max3.0602502735561883
driven_any_mean2.3595528287629848
driven_any_median2.747648771459853
driven_any_min0.3817472176788552
driven_lanedir_consec_max3.0094047492365696
driven_lanedir_consec_mean2.1861404317235182
driven_lanedir_consec_min0.3169746578615049
driven_lanedir_max3.0094047492365696
driven_lanedir_mean2.1861404317235182
driven_lanedir_median2.4789233115106395
driven_lanedir_min0.3169746578615049
in-drivable-lane_max1.1999999999999955
in-drivable-lane_mean0.24999999999999917
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.5549718370774266, "sim_physics": 0.1532482536633809, "survival_time": 14.950000000000076, "driven_lanedir": 2.4789233115106395, "sim_render-ego": 0.057849442958831786, "in-drivable-lane": 0, "agent_compute-ego": 0.15866530338923138, "deviation-heading": 3.764395459495874, "set_robot_commands": 0.09113444010416669, "deviation-center-line": 0.915717854733624, "driven_lanedir_consec": 2.4789233115106395, "sim_compute_sim_state": 0.035156273047129316, "sim_compute_performance-ego": 0.0603924838701884, "sim_compute_robot_state-ego": 0.06471064408620199, "sim_compute_robot_state-npc0": 0.06319768269856771, "sim_compute_robot_state-npc1": 0.06814368565877278, "sim_compute_robot_state-npc2": 0.06147315343221029, "sim_compute_robot_state-npc3": 0.06128411134084066}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3817472176788552, "sim_physics": 0.1742067813873291, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3169746578615049, "sim_render-ego": 0.05756244659423828, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1705783176422119, "deviation-heading": 0.5354470537706654, "set_robot_commands": 0.09034584999084472, "deviation-center-line": 0.09089593761882547, "driven_lanedir_consec": 0.3169746578615049, "sim_compute_sim_state": 0.041628999710083006, "sim_compute_performance-ego": 0.06301189422607421, "sim_compute_robot_state-ego": 0.06833938598632812, "sim_compute_robot_state-npc0": 0.0647934627532959, "sim_compute_robot_state-npc1": 0.06505700111389161, "sim_compute_robot_state-npc2": 0.06329429626464844, "sim_compute_robot_state-npc3": 0.06462483406066895}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.053146044042598, "sim_physics": 0.1655573852856954, "survival_time": 14.950000000000076, "driven_lanedir": 2.9731439422185693, "sim_render-ego": 0.05644808689753215, "in-drivable-lane": 0, "agent_compute-ego": 0.16434234937032063, "deviation-heading": 3.427825313648924, "set_robot_commands": 0.09247412919998169, "deviation-center-line": 0.8146285309217326, "driven_lanedir_consec": 2.9731439422185693, "sim_compute_sim_state": 0.036865094502766926, "sim_compute_performance-ego": 0.06655084292093913, "sim_compute_robot_state-ego": 0.06864944775899251, "sim_compute_robot_state-npc0": 0.06681225220362345, "sim_compute_robot_state-npc1": 0.06554112911224365, "sim_compute_robot_state-npc2": 0.06293324947357178, "sim_compute_robot_state-npc3": 0.06550121068954468}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0602502735561883, "sim_physics": 0.1594786524772644, "survival_time": 14.950000000000076, "driven_lanedir": 3.0094047492365696, "sim_render-ego": 0.058335607846577965, "in-drivable-lane": 0, "agent_compute-ego": 0.16205903132756552, "deviation-heading": 2.5257632693346603, "set_robot_commands": 0.09020399808883668, "deviation-center-line": 0.7281481122180655, "driven_lanedir_consec": 3.0094047492365696, "sim_compute_sim_state": 0.037278894583384195, "sim_compute_performance-ego": 0.06412381649017335, "sim_compute_robot_state-ego": 0.06947394847869873, "sim_compute_robot_state-npc0": 0.06753857533137003, "sim_compute_robot_state-npc1": 0.06515476226806641, "sim_compute_robot_state-npc2": 0.06511690457661946, "sim_compute_robot_state-npc3": 0.06483456214269002}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.747648771459853, "sim_physics": 0.15322364966074625, "survival_time": 14.950000000000076, "driven_lanedir": 2.1522554977903083, "sim_render-ego": 0.058053767681121825, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.1682949988047282, "deviation-heading": 6.751529529551556, "set_robot_commands": 0.08714262088139851, "deviation-center-line": 1.2012396017870604, "driven_lanedir_consec": 2.1522554977903083, "sim_compute_sim_state": 0.03667447566986084, "sim_compute_performance-ego": 0.06472389777501424, "sim_compute_robot_state-ego": 0.06963449875513712, "sim_compute_robot_state-npc0": 0.06588028748830159, "sim_compute_robot_state-npc1": 0.06497968196868896, "sim_compute_robot_state-npc2": 0.06372095425923666, "sim_compute_robot_state-npc3": 0.06542930761973063}}
set_robot_commands_max0.09247412919998169
set_robot_commands_mean0.09026020765304564
set_robot_commands_median0.09034584999084472
set_robot_commands_min0.08714262088139851
sim_compute_performance-ego_max0.06655084292093913
sim_compute_performance-ego_mean0.06376058705647787
sim_compute_performance-ego_median0.06412381649017335
sim_compute_performance-ego_min0.0603924838701884
sim_compute_robot_state-ego_max0.06963449875513712
sim_compute_robot_state-ego_mean0.0681615850130717
sim_compute_robot_state-ego_median0.06864944775899251
sim_compute_robot_state-ego_min0.06471064408620199
sim_compute_robot_state-npc0_max0.06753857533137003
sim_compute_robot_state-npc0_mean0.06564445209503174
sim_compute_robot_state-npc0_median0.06588028748830159
sim_compute_robot_state-npc0_min0.06319768269856771
sim_compute_robot_state-npc1_max0.06814368565877278
sim_compute_robot_state-npc1_mean0.06577525202433268
sim_compute_robot_state-npc1_median0.06515476226806641
sim_compute_robot_state-npc1_min0.06497968196868896
sim_compute_robot_state-npc2_max0.06511690457661946
sim_compute_robot_state-npc2_mean0.06330771160125732
sim_compute_robot_state-npc2_median0.06329429626464844
sim_compute_robot_state-npc2_min0.06147315343221029
sim_compute_robot_state-npc3_max0.06550121068954468
sim_compute_robot_state-npc3_mean0.06433480517069498
sim_compute_robot_state-npc3_median0.06483456214269002
sim_compute_robot_state-npc3_min0.06128411134084066
sim_compute_sim_state_max0.041628999710083006
sim_compute_sim_state_mean0.037520747502644856
sim_compute_sim_state_median0.036865094502766926
sim_compute_sim_state_min0.035156273047129316
sim_physics_max0.1742067813873291
sim_physics_mean0.16114294449488323
sim_physics_median0.1594786524772644
sim_physics_min0.15322364966074625
sim_render-ego_max0.058335607846577965
sim_render-ego_mean0.0576498703956604
sim_render-ego_median0.057849442958831786
sim_render-ego_min0.05644808689753215
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.21000000000006
survival_time_min1.2500000000000004
222903441jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11690:36:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222783486Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationsuccessyes11691 day, 3:25:00Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0005547867508171045
survival_time_median14.950000000000076
deviation-center-line_median0.08595713175886957
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.13974887609481812
agent_compute-ego_mean0.13582511425018312
agent_compute-ego_median0.13518306334813435
agent_compute-ego_min0.13214000940322876
deviation-center-line_max0.7597786156362132
deviation-center-line_mean0.137541590585692
deviation-center-line_min0.020107537896167912
deviation-heading_max6.008014579834853
deviation-heading_mean1.6389251291896465
deviation-heading_median0.6889255803568087
deviation-heading_min0.5598167528005288
driven_any_max1.7412714014715316
driven_any_mean0.41538596054319776
driven_any_median0.1383959973831592
driven_any_min0.0805342731040154
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.00046586963337973407
driven_lanedir_consec_min-0.003361806018059577
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.00046586963337973407
driven_lanedir_median-0.0005547867508171045
driven_lanedir_min-0.003361806018059577
in-drivable-lane_max7.350000000000034
in-drivable-lane_mean1.5900000000000036
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5038800776994324, "sim_physics": 0.08392632820389488, "survival_time": 4.399999999999992, "driven_lanedir": 0.13592142442974575, "sim_render-ego": 0.048557099970904266, "in-drivable-lane": 2.049999999999997, "agent_compute-ego": 0.1312993900342421, "deviation-heading": 1.7051910529504986, "set_robot_commands": 0.07270857420834628, "deviation-center-line": 0.09279921224004846, "driven_lanedir_consec": 0.13592142442974575, "sim_compute_sim_state": 0.029801807620308617, "sim_compute_performance-ego": 0.05540900880640203, "sim_compute_robot_state-ego": 0.0584821186282418}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.16791318770452632, "sim_physics": 0.07447624206542969, "survival_time": 1.7500000000000009, "driven_lanedir": 0.05941689814203566, "sim_render-ego": 0.040719522748674665, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.10583064215523856, "deviation-heading": 0.5598167528005288, "set_robot_commands": 0.05759268488202776, "deviation-center-line": 0.020781659785830305, "driven_lanedir_consec": 0.05941689814203566, "sim_compute_sim_state": 0.02500808579581125, "sim_compute_performance-ego": 0.043497140066964285, "sim_compute_robot_state-ego": 0.046521786281040735}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08765276996396464, "sim_physics": 0.13313346817379906, "survival_time": 1.0500000000000005, "driven_lanedir": 0.04260023322783857, "sim_render-ego": 0.06388014838809059, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.21252366474696568, "deviation-heading": 0.7095420485643351, "set_robot_commands": 0.09975165412539529, "deviation-center-line": 0.08614051989203497, "driven_lanedir_consec": 0.04260023322783857, "sim_compute_sim_state": 0.044624896276564824, "sim_compute_performance-ego": 0.07173551831926618, "sim_compute_robot_state-ego": 0.07800077256702241}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7881445431910101, "sim_physics": 0.07496494869534061, "survival_time": 6.949999999999983, "driven_lanedir": 0.22066563163820965, "sim_render-ego": 0.04709026453306349, "in-drivable-lane": 3.3999999999999924, "agent_compute-ego": 0.13460954316228413, "deviation-heading": 2.753064961008922, "set_robot_commands": 0.0794995277048015, "deviation-center-line": 0.17055937617903916, "driven_lanedir_consec": 0.22066563163820965, "sim_compute_sim_state": 0.029550715316113807, "sim_compute_performance-ego": 0.048857086854015325, "sim_compute_robot_state-ego": 0.052302171858094576}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7412714014715316, "sim_physics": 0.1062314518292745, "survival_time": 14.950000000000076, "driven_lanedir": 0.51331558806727, "sim_render-ego": 0.06049908399581909, "in-drivable-lane": 7.300000000000031, "agent_compute-ego": 0.17329620997111003, "deviation-heading": 5.74023226638551, "set_robot_commands": 0.09741279045740764, "deviation-center-line": 0.27492654119400867, "driven_lanedir_consec": 0.51331558806727, "sim_compute_sim_state": 0.03927523930867513, "sim_compute_performance-ego": 0.0669243876139323, "sim_compute_robot_state-ego": 0.07474176486333212}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.557911234276148, "sim_physics": 0.11294092098871866, "survival_time": 14.950000000000076, "driven_lanedir": 0.42581248291793594, "sim_render-ego": 0.062470107078552245, "in-drivable-lane": 7.350000000000034, "agent_compute-ego": 0.17377737840016683, "deviation-heading": 6.008014579834853, "set_robot_commands": 0.09801504055658976, "deviation-center-line": 0.7597786156362132, "driven_lanedir_consec": 0.42581248291793594, "sim_compute_sim_state": 0.03958724101384481, "sim_compute_performance-ego": 0.06886623064676921, "sim_compute_robot_state-ego": 0.0752490242322286}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.10922150382791856, "sim_physics": 0.09719058183523324, "survival_time": 1.3000000000000005, "driven_lanedir": 0.055059273435346334, "sim_render-ego": 0.051204828115609974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13746167146242583, "deviation-heading": 0.6889255803568087, "set_robot_commands": 0.0832131184064425, "deviation-center-line": 0.08034492463725701, "driven_lanedir_consec": 0.055059273435346334, "sim_compute_sim_state": 0.03494805556077223, "sim_compute_performance-ego": 0.05807793140411377, "sim_compute_robot_state-ego": 0.06146007317763109}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.09061793871792163, "sim_physics": 0.09232519973408092, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04439818477793844, "sim_render-ego": 0.05031388456171209, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.13847096399827438, "deviation-heading": 0.6839085651163759, "set_robot_commands": 0.07593378153714267, "deviation-center-line": 0.08020827764323984, "driven_lanedir_consec": 0.04439818477793844, "sim_compute_sim_state": 0.032801823182539505, "sim_compute_performance-ego": 0.05191075801849365, "sim_compute_robot_state-ego": 0.05699934742667458}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.1383959973831592, "sim_physics": 0.1368484405370859, "survival_time": 1.3000000000000005, "driven_lanedir": 0.06898920083905447, "sim_render-ego": 0.07078351424290584, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.20302185645470253, "deviation-heading": 0.7464558385619143, "set_robot_commands": 0.09680418784801775, "deviation-center-line": 0.041222223349834386, "driven_lanedir_consec": 0.06898920083905447, "sim_compute_sim_state": 0.040751007887033314, "sim_compute_performance-ego": 0.08164682755103478, "sim_compute_robot_state-ego": 0.08620279568892258}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.12899113256320577, "sim_physics": 0.12640927314758302, "survival_time": 1.2500000000000004, "driven_lanedir": 0.08327415222066659, "sim_render-ego": 0.0670548439025879, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18000207901000975, "deviation-heading": 0.6886070008504351, "set_robot_commands": 0.09794439315795898, "deviation-center-line": 0.08595713175886957, "driven_lanedir_consec": 0.08327415222066659, "sim_compute_sim_state": 0.03864916801452637, "sim_compute_performance-ego": 0.06932332038879395, "sim_compute_robot_state-ego": 0.0752395248413086}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.10517680898684446, "sim_physics": 0.11911591239597488, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06490158909721544, "sim_render-ego": 0.06402565085369608, "in-drivable-lane": 0, "agent_compute-ego": 0.16096617864525836, "deviation-heading": 0.6304787133211814, "set_robot_commands": 0.09883214079815408, "deviation-center-line": 0.09916630870260223, "driven_lanedir_consec": 0.06490158909721544, "sim_compute_sim_state": 0.04160481950511103, "sim_compute_performance-ego": 0.06906277200450069, "sim_compute_robot_state-ego": 0.07222379808840544}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.13570423172329227, "sim_physics": 0.126186591607553, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06953231503639734, "sim_render-ego": 0.06494779940004702, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17610977314136647, "deviation-heading": 0.6754887089324252, "set_robot_commands": 0.09450968106587727, "deviation-center-line": 0.06044908742203052, "driven_lanedir_consec": 0.06953231503639734, "sim_compute_sim_state": 0.03871098271122685, "sim_compute_performance-ego": 0.06765250806455259, "sim_compute_robot_state-ego": 0.07666304376390246}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.4501557007619454, "sim_physics": 0.1288058785505073, "survival_time": 4.299999999999993, "driven_lanedir": 0.1611389032344389, "sim_render-ego": 0.06735319037770116, "in-drivable-lane": 1.849999999999997, "agent_compute-ego": 0.2007856812588004, "deviation-heading": 1.7083408854773945, "set_robot_commands": 0.10963306593340497, "deviation-center-line": 0.0844184477464415, "driven_lanedir_consec": 0.1611389032344389, "sim_compute_sim_state": 0.04259567759757818, "sim_compute_performance-ego": 0.07755910795788433, "sim_compute_robot_state-ego": 0.08666661728260129}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1452186067730508, "sim_physics": 0.1332230644841348, "survival_time": 1.5500000000000007, "driven_lanedir": 0.03458168885303836, "sim_render-ego": 0.06850897881292528, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.2051946347759616, "deviation-heading": 0.6879993118879137, "set_robot_commands": 0.1064949881645941, "deviation-center-line": 0.020107537896167912, "driven_lanedir_consec": 0.03458168885303836, "sim_compute_sim_state": 0.04576783795510569, "sim_compute_performance-ego": 0.07885657587359028, "sim_compute_robot_state-ego": 0.08697739724190004}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.0805342731040154, "sim_physics": 0.11965610764243384, "survival_time": 1.1000000000000003, "driven_lanedir": 0.04653848407813177, "sim_render-ego": 0.0595804669640281, "in-drivable-lane": 0, "agent_compute-ego": 0.1547629182988947, "deviation-heading": 0.5978106717955998, "set_robot_commands": 0.09718504819003018, "deviation-center-line": 0.1062639947017614, "driven_lanedir_consec": 0.04653848407813177, "sim_compute_sim_state": 0.040003635666587135, "sim_compute_performance-ego": 0.0669183839451183, "sim_compute_robot_state-ego": 0.07104962522333319}}
set_robot_commands_max0.07707885185877482
set_robot_commands_mean0.07548526016871135
set_robot_commands_median0.07563153425852458
set_robot_commands_min0.07328295866648356
sim_compute_performance-ego_max0.06136019468307495
sim_compute_performance-ego_mean0.06035742839177449
sim_compute_performance-ego_median0.05994773387908935
sim_compute_performance-ego_min0.05958258549372355
sim_compute_robot_state-ego_max0.06217957894007365
sim_compute_robot_state-ego_mean0.06082349761327107
sim_compute_robot_state-ego_median0.06056402047475179
sim_compute_robot_state-ego_min0.06000970760981242
sim_compute_sim_state_max0.038775881131490074
sim_compute_sim_state_mean0.03804562266667684
sim_compute_sim_state_median0.03842011133829753
sim_compute_sim_state_min0.037121593952178955
sim_physics_max0.05798179785410563
sim_physics_mean0.05681725295384725
sim_physics_median0.05732198238372803
sim_physics_min0.05505349636077881
sim_render-ego_max0.05726299206415812
sim_render-ego_mean0.0559770671526591
sim_render-ego_median0.05569203456242879
sim_render-ego_min0.055478870073954266
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
222703491Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11691 day, 4:15:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222623516jp18813100494Second test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessyes11690:21:15Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0328325337918964
survival_time_median14.950000000000076
deviation-center-line_median0.8392144281375854
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16511745850245158
agent_compute-ego_mean0.15846323702253767
agent_compute-ego_median0.15900044712593886
agent_compute-ego_min0.14799310440240904
deviation-center-line_max1.57377995654447
deviation-center-line_mean0.865559805771654
deviation-center-line_min0.18496563734886728
deviation-heading_max4.004765313771469
deviation-heading_mean2.0308289158991455
deviation-heading_median1.7642265469798744
deviation-heading_min0.948149445292733
driven_any_max1.9219346725617432
driven_any_mean1.4991572119331416
driven_any_median1.7528162542818746
driven_any_min0.9524352508948164
driven_lanedir_consec_max1.6401451217007263
driven_lanedir_consec_mean1.0398631418425317
driven_lanedir_consec_min0.5423023023607837
driven_lanedir_max1.6401451217007263
driven_lanedir_mean1.0601325192632054
driven_lanedir_median1.0328325337918964
driven_lanedir_min0.5423023023607837
in-drivable-lane_max6.049999999999988
in-drivable-lane_mean1.5899999999999963
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.792479434189623, "sim_physics": 0.09462983802307484, "survival_time": 8.599999999999987, "driven_lanedir": 0.7364170368464507, "sim_render-ego": 0.054211482059123905, "in-drivable-lane": 6.049999999999988, "agent_compute-ego": 0.14799310440240904, "deviation-heading": 0.948149445292733, "set_robot_commands": 0.08400636218314947, "deviation-center-line": 0.18496563734886728, "driven_lanedir_consec": 0.7364170368464507, "sim_compute_sim_state": 0.0360064756038577, "sim_compute_performance-ego": 0.06024790503257929, "sim_compute_robot_state-ego": 0.0637306903683862}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9524352508948164, "sim_physics": 0.11037824710210165, "survival_time": 14.950000000000076, "driven_lanedir": 0.5423023023607837, "sim_render-ego": 0.060856415430704754, "in-drivable-lane": 0, "agent_compute-ego": 0.16135262250900267, "deviation-heading": 1.7642265469798744, "set_robot_commands": 0.0910523557662964, "deviation-center-line": 0.8392144281375854, "driven_lanedir_consec": 0.5423023023607837, "sim_compute_sim_state": 0.03752377986907959, "sim_compute_performance-ego": 0.0661162288983663, "sim_compute_robot_state-ego": 0.07178863445917766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.9219346725617432, "sim_physics": 0.09823384046554566, "survival_time": 14.950000000000076, "driven_lanedir": 1.6401451217007263, "sim_render-ego": 0.0595707114537557, "in-drivable-lane": 0, "agent_compute-ego": 0.15885255257288614, "deviation-heading": 2.255800088849635, "set_robot_commands": 0.09126749833424888, "deviation-center-line": 1.2687407568495153, "driven_lanedir_consec": 1.6401451217007263, "sim_compute_sim_state": 0.037908584276835126, "sim_compute_performance-ego": 0.06760000467300414, "sim_compute_robot_state-ego": 0.07124161720275879}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0761204477376498, "sim_physics": 0.10611399014790852, "survival_time": 6.149999999999986, "driven_lanedir": 1.0328325337918964, "sim_render-ego": 0.0591616921308564, "in-drivable-lane": 0, "agent_compute-ego": 0.15900044712593886, "deviation-heading": 1.1812031846020177, "set_robot_commands": 0.08911367354354238, "deviation-center-line": 0.461098249977832, "driven_lanedir_consec": 1.0328325337918964, "sim_compute_sim_state": 0.03668747103311182, "sim_compute_performance-ego": 0.06675238919451953, "sim_compute_robot_state-ego": 0.07439405355996233}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.7528162542818746, "sim_physics": 0.10247782150904336, "survival_time": 14.950000000000076, "driven_lanedir": 1.348965601616169, "sim_render-ego": 0.05954940319061279, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.16511745850245158, "deviation-heading": 4.004765313771469, "set_robot_commands": 0.09373553117116291, "deviation-center-line": 1.57377995654447, "driven_lanedir_consec": 1.2476187145128013, "sim_compute_sim_state": 0.038272020816802976, "sim_compute_performance-ego": 0.06743561347325643, "sim_compute_robot_state-ego": 0.07263184626897176}}
set_robot_commands_max0.09373553117116291
set_robot_commands_mean0.08983508419968
set_robot_commands_median0.0910523557662964
set_robot_commands_min0.08400636218314947
sim_compute_performance-ego_max0.06760000467300414
sim_compute_performance-ego_mean0.06563042825434515
sim_compute_performance-ego_median0.06675238919451953
sim_compute_performance-ego_min0.06024790503257929
sim_compute_robot_state-ego_max0.07439405355996233
sim_compute_robot_state-ego_mean0.07075736837185134
sim_compute_robot_state-ego_median0.07178863445917766
sim_compute_robot_state-ego_min0.0637306903683862
sim_compute_sim_state_max0.038272020816802976
sim_compute_sim_state_mean0.03727966631993744
sim_compute_sim_state_median0.03752377986907959
sim_compute_sim_state_min0.0360064756038577
sim_physics_max0.11037824710210165
sim_physics_mean0.1023667474495348
sim_physics_median0.10247782150904336
sim_physics_min0.09462983802307484
sim_render-ego_max0.060856415430704754
sim_render-ego_mean0.05866994085301071
sim_render-ego_median0.05954940319061279
sim_render-ego_min0.054211482059123905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.92000000000004
survival_time_min6.149999999999986
222583517Bea BaselinesStraight maxaido2-LF-sim-validationstep1-simulationsuccessyes11690:04:55Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6618324868125249
survival_time_median2.1000000000000005
deviation-center-line_median0.09250602665006584
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.15481834642348752
agent_compute-ego_mean0.14717569689565008
agent_compute-ego_median0.14553618431091309
agent_compute-ego_min0.13904554503304617
deviation-center-line_max0.21439068356235536
deviation-center-line_mean0.12258369343422797
deviation-center-line_min0.0744010530149505
deviation-heading_max0.5686442582449269
deviation-heading_mean0.3103675930817716
deviation-heading_median0.25395078679676
deviation-heading_min0.17582209342949345
driven_any_max1.575892401948956
driven_any_mean0.8642098067399473
driven_any_median1.0038564958116647
driven_any_min0.26972689326339405
driven_lanedir_consec_max1.1723086623342591
driven_lanedir_consec_mean0.6830346826605466
driven_lanedir_consec_min0.2605911739016977
driven_lanedir_max1.1723086623342591
driven_lanedir_mean0.6830346826605466
driven_lanedir_median0.6618324868125249
driven_lanedir_min0.2605911739016977
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.10020028409503756, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.0599254880632673, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.15136638141813732, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.08784676733471099, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.03492116928100586, "sim_compute_performance-ego": 0.060641669091724214, "sim_compute_robot_state-ego": 0.06804553667704265}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.10005232833680652, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.05957605725242978, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13904554503304617, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.08526499498458136, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.03659413542066302, "sim_compute_performance-ego": 0.06708971659342448, "sim_compute_robot_state-ego": 0.06778626214890253}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.10705603659152985, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.05854539573192597, "in-drivable-lane": 0, "agent_compute-ego": 0.14553618431091309, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.09283143281936646, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.03548361361026764, "sim_compute_performance-ego": 0.06418916583061218, "sim_compute_robot_state-ego": 0.06696945428848267}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.10759379552758258, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.06204308634218962, "in-drivable-lane": 0, "agent_compute-ego": 0.14511202729266623, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.08788836520651112, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.03489448713219684, "sim_compute_performance-ego": 0.06701747230861498, "sim_compute_robot_state-ego": 0.07161693987639053}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.10876998593730312, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.0625239456853559, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15481834642348752, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.09637498471044724, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.04016650492145169, "sim_compute_performance-ego": 0.07596082072104177, "sim_compute_robot_state-ego": 0.07402391587534259}}
set_robot_commands_max0.09637498471044724
set_robot_commands_mean0.09004130901112344
set_robot_commands_median0.08788836520651112
set_robot_commands_min0.08526499498458136
sim_compute_performance-ego_max0.07596082072104177
sim_compute_performance-ego_mean0.06697976890908353
sim_compute_performance-ego_median0.06701747230861498
sim_compute_performance-ego_min0.060641669091724214
sim_compute_robot_state-ego_max0.07402391587534259
sim_compute_robot_state-ego_mean0.06968842177323219
sim_compute_robot_state-ego_median0.06804553667704265
sim_compute_robot_state-ego_min0.06696945428848267
sim_compute_sim_state_max0.04016650492145169
sim_compute_sim_state_mean0.03641198207311701
sim_compute_sim_state_median0.03548361361026764
sim_compute_sim_state_min0.03489448713219684
sim_physics_max0.10876998593730312
sim_physics_mean0.10473448609765192
sim_physics_median0.10705603659152985
sim_physics_min0.10005232833680652
sim_render-ego_max0.0625239456853559
sim_render-ego_mean0.06052279461503371
sim_render-ego_median0.0599254880632673
sim_render-ego_min0.05854539573192597
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean1.8499999999999996
survival_time_min0.8000000000000002
222523512Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessyes11690:15:36Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12739082416299574
survival_time_median1.3000000000000005
deviation-center-line_median0.08166444632038598
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18476768462888657
agent_compute-ego_mean0.16376106652265052
agent_compute-ego_median0.15784091949462892
agent_compute-ego_min0.1470374365647634
deviation-center-line_max0.10535131406181696
deviation-center-line_mean0.07920742144300794
deviation-center-line_min0.04917145582597334
deviation-heading_max0.8944037859209665
deviation-heading_mean0.6835739505179455
deviation-heading_median0.7143094752986094
deviation-heading_min0.43743511397729734
driven_any_max0.27551261256002413
driven_any_mean0.18207307865933367
driven_any_median0.1694214624294807
driven_any_min0.1291760435692988
driven_lanedir_consec_max0.16044635668179685
driven_lanedir_consec_mean0.11784383872015912
driven_lanedir_consec_min0.04857885231725145
driven_lanedir_max0.16044635668179685
driven_lanedir_mean0.11784383872015912
driven_lanedir_median0.12739082416299574
driven_lanedir_min0.04857885231725145
in-drivable-lane_max0.6500000000000005
in-drivable-lane_mean0.09333333333333342
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22820709281725776, "sim_physics": 0.1834951639175415, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13280530497373566, "sim_render-ego": 0.0544139305750529, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15784091949462892, "deviation-heading": 0.8433953108880111, "set_robot_commands": 0.09036743640899658, "deviation-center-line": 0.08166444632038598, "driven_lanedir_consec": 0.13280530497373566, "sim_compute_sim_state": 0.036406358083089195, "sim_compute_performance-ego": 0.060034624735514325, "sim_compute_robot_state-ego": 0.06399655342102051, "sim_compute_robot_state-npc0": 0.06115816434224446, "sim_compute_robot_state-npc1": 0.06027337710062663, "sim_compute_robot_state-npc2": 0.056591184933980306, "sim_compute_robot_state-npc3": 0.057327795028686526}, "udem1-1-0": {"driven_any": 0.20266776554092908, "sim_physics": 0.2099245861172676, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04857885231725145, "sim_render-ego": 0.058185845613479614, "in-drivable-lane": 0.6500000000000005, "agent_compute-ego": 0.15606805682182312, "deviation-heading": 0.7143094752986094, "set_robot_commands": 0.08968508243560791, "deviation-center-line": 0.04917145582597334, "driven_lanedir_consec": 0.04857885231725145, "sim_compute_sim_state": 0.03775376081466675, "sim_compute_performance-ego": 0.06416727602481842, "sim_compute_robot_state-ego": 0.06575394421815872, "sim_compute_robot_state-npc0": 0.062373265624046326, "sim_compute_robot_state-npc1": 0.06619405746459961, "sim_compute_robot_state-npc2": 0.06731273233890533, "sim_compute_robot_state-npc3": 0.06713659316301346}, "udem1-2-0": {"driven_any": 0.16108849671358594, "sim_physics": 0.2465995450814565, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13188257778266976, "sim_render-ego": 0.05705118179321289, "in-drivable-lane": 0, "agent_compute-ego": 0.15444488326708475, "deviation-heading": 0.45036973196732893, "set_robot_commands": 0.0851011872291565, "deviation-center-line": 0.10535131406181696, "driven_lanedir_consec": 0.13188257778266976, "sim_compute_sim_state": 0.036276797453562416, "sim_compute_performance-ego": 0.06125849485397339, "sim_compute_robot_state-ego": 0.07144211729367574, "sim_compute_robot_state-npc0": 0.06509377559026082, "sim_compute_robot_state-npc1": 0.06627131501833598, "sim_compute_robot_state-npc2": 0.06189813216527303, "sim_compute_robot_state-npc3": 0.0652672251065572}, "udem1-3-0": {"driven_any": 0.153655082107214, "sim_physics": 0.2216716508070628, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1255962524250125, "sim_render-ego": 0.06339550018310547, "in-drivable-lane": 0, "agent_compute-ego": 0.17390645543734232, "deviation-heading": 0.46834646323296336, "set_robot_commands": 0.09079898397127788, "deviation-center-line": 0.1030498142655799, "driven_lanedir_consec": 0.1255962524250125, "sim_compute_sim_state": 0.03971850872039795, "sim_compute_performance-ego": 0.06715959310531616, "sim_compute_robot_state-ego": 0.07341389854749043, "sim_compute_robot_state-npc0": 0.0682414174079895, "sim_compute_robot_state-npc1": 0.06819952527681987, "sim_compute_robot_state-npc2": 0.06979599595069885, "sim_compute_robot_state-npc3": 0.07064475615819295}, "udem1-4-0": {"driven_any": 0.13981664554712356, "sim_physics": 0.1873867304428764, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07507866194597557, "sim_render-ego": 0.05360462354577106, "in-drivable-lane": 0, "agent_compute-ego": 0.1537732041400412, "deviation-heading": 0.8402456780060235, "set_robot_commands": 0.0822650556978972, "deviation-center-line": 0.05739454977041497, "driven_lanedir_consec": 0.07507866194597557, "sim_compute_sim_state": 0.03527833067852518, "sim_compute_performance-ego": 0.05989587825277577, "sim_compute_robot_state-ego": 0.06680842067884363, "sim_compute_robot_state-npc0": 0.060166545536207115, "sim_compute_robot_state-npc1": 0.062391923821490745, "sim_compute_robot_state-npc2": 0.0617777679277503, "sim_compute_robot_state-npc3": 0.062472809915957245}, "udem1-5-0": {"driven_any": 0.23020312238328677, "sim_physics": 0.1799452006816864, "survival_time": 1.6000000000000008, "driven_lanedir": 0.14795033168175253, "sim_render-ego": 0.05333881825208664, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16148369014263153, "deviation-heading": 0.8944037859209665, "set_robot_commands": 0.08640874177217484, "deviation-center-line": 0.07849734496098351, "driven_lanedir_consec": 0.14795033168175253, "sim_compute_sim_state": 0.034599244594573975, "sim_compute_performance-ego": 0.06113458424806595, "sim_compute_robot_state-ego": 0.0637613832950592, "sim_compute_robot_state-npc0": 0.06151715666055679, "sim_compute_robot_state-npc1": 0.06007233262062073, "sim_compute_robot_state-npc2": 0.05678988993167877, "sim_compute_robot_state-npc3": 0.059908583760261536}, "udem1-6-0": {"driven_any": 0.13739141656015158, "sim_physics": 0.2450716599174168, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09810265379317862, "sim_render-ego": 0.06367431516232698, "in-drivable-lane": 0, "agent_compute-ego": 0.17728295533553415, "deviation-heading": 0.6108547854404713, "set_robot_commands": 0.0936152105746062, "deviation-center-line": 0.08590157493301563, "driven_lanedir_consec": 0.09810265379317862, "sim_compute_sim_state": 0.04091674348582392, "sim_compute_performance-ego": 0.07417300473088803, "sim_compute_robot_state-ego": 0.07740012459132982, "sim_compute_robot_state-npc0": 0.07035036708997644, "sim_compute_robot_state-npc1": 0.07043027877807617, "sim_compute_robot_state-npc2": 0.07130860245746115, "sim_compute_robot_state-npc3": 0.07309508323669434}, "udem1-7-0": {"driven_any": 0.1694214624294807, "sim_physics": 0.21872691007760856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1354027287524724, "sim_render-ego": 0.06375100979438195, "in-drivable-lane": 0, "agent_compute-ego": 0.1842745267427885, "deviation-heading": 0.5525010321613538, "set_robot_commands": 0.09460028318258432, "deviation-center-line": 0.0949205639516543, "driven_lanedir_consec": 0.1354027287524724, "sim_compute_sim_state": 0.04129774753863995, "sim_compute_performance-ego": 0.06762821857745831, "sim_compute_robot_state-ego": 0.07003931815807636, "sim_compute_robot_state-npc0": 0.06882540996258076, "sim_compute_robot_state-npc1": 0.0661164980668288, "sim_compute_robot_state-npc2": 0.06576743492713341, "sim_compute_robot_state-npc3": 0.0720811073596661}, "udem1-8-0": {"driven_any": 0.2256162089827095, "sim_physics": 0.20383083435796925, "survival_time": 1.5500000000000007, "driven_lanedir": 0.16044635668179685, "sim_render-ego": 0.08630955603814894, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.18476768462888657, "deviation-heading": 0.8103928587691155, "set_robot_commands": 0.10080790519714355, "deviation-center-line": 0.06310404878870934, "driven_lanedir_consec": 0.16044635668179685, "sim_compute_sim_state": 0.041854712270921274, "sim_compute_performance-ego": 0.07348091371597783, "sim_compute_robot_state-ego": 0.07741732751169512, "sim_compute_robot_state-npc0": 0.07033335008928852, "sim_compute_robot_state-npc1": 0.06813362336927845, "sim_compute_robot_state-npc2": 0.07089711004687894, "sim_compute_robot_state-npc3": 0.0700593763782132}, "udem1-9-0": {"driven_any": 0.20596055415287937, "sim_physics": 0.21258903466738188, "survival_time": 1.3000000000000005, "driven_lanedir": 0.147810754938138, "sim_render-ego": 0.06223408992473896, "in-drivable-lane": 0, "agent_compute-ego": 0.16989333813007065, "deviation-heading": 0.7948395610973749, "set_robot_commands": 0.09164064664107102, "deviation-center-line": 0.07148292926011672, "driven_lanedir_consec": 0.147810754938138, "sim_compute_sim_state": 0.03518346639779898, "sim_compute_performance-ego": 0.05952900189619798, "sim_compute_robot_state-ego": 0.0678318922336285, "sim_compute_robot_state-npc0": 0.06877581889812763, "sim_compute_robot_state-npc1": 0.06732782033773568, "sim_compute_robot_state-npc2": 0.06256372195023757, "sim_compute_robot_state-npc3": 0.06251335144042969}, "udem1-10-0": {"driven_any": 0.1578030648975387, "sim_physics": 0.1920095185438792, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09526607341585414, "sim_render-ego": 0.056928286949793495, "in-drivable-lane": 0, "agent_compute-ego": 0.1470374365647634, "deviation-heading": 0.8862955888299321, "set_robot_commands": 0.08811499675114949, "deviation-center-line": 0.061250469156920714, "driven_lanedir_consec": 0.09526607341585414, "sim_compute_sim_state": 0.03323671221733093, "sim_compute_performance-ego": 0.06305602192878723, "sim_compute_robot_state-ego": 0.06821711858113606, "sim_compute_robot_state-npc0": 0.063358207543691, "sim_compute_robot_state-npc1": 0.06131940086682638, "sim_compute_robot_state-npc2": 0.06275618076324463, "sim_compute_robot_state-npc3": 0.06009323398272196}, "udem1-11-0": {"driven_any": 0.13793227142857434, "sim_physics": 0.19893321990966795, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11048060583341623, "sim_render-ego": 0.05994168519973755, "in-drivable-lane": 0, "agent_compute-ego": 0.15378785133361816, "deviation-heading": 0.43743511397729734, "set_robot_commands": 0.08749377727508545, "deviation-center-line": 0.08821708648511872, "driven_lanedir_consec": 0.11048060583341623, "sim_compute_sim_state": 0.03764940500259399, "sim_compute_performance-ego": 0.06956921815872193, "sim_compute_robot_state-ego": 0.06914379596710205, "sim_compute_robot_state-npc0": 0.06340347528457642, "sim_compute_robot_state-npc1": 0.06586630344390869, "sim_compute_robot_state-npc2": 0.06317163705825805, "sim_compute_robot_state-npc3": 0.06167234182357788}, "udem1-12-0": {"driven_any": 0.27551261256002413, "sim_physics": 0.20536517485594136, "survival_time": 1.950000000000001, "driven_lanedir": 0.12739082416299574, "sim_render-ego": 0.0622259286733774, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15656353265811235, "deviation-heading": 0.74269506660919, "set_robot_commands": 0.09189469997699444, "deviation-center-line": 0.07470024164204528, "driven_lanedir_consec": 0.12739082416299574, "sim_compute_sim_state": 0.03925157815982134, "sim_compute_performance-ego": 0.06508259284190643, "sim_compute_robot_state-ego": 0.06824753834651066, "sim_compute_robot_state-npc0": 0.06805254862858699, "sim_compute_robot_state-npc1": 0.06465753530844665, "sim_compute_robot_state-npc2": 0.06743106475243202, "sim_compute_robot_state-npc3": 0.06574153288816795}, "udem1-13-0": {"driven_any": 0.1291760435692988, "sim_physics": 0.23081208311993143, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0942065850756637, "sim_render-ego": 0.06618307984393576, "in-drivable-lane": 0, "agent_compute-ego": 0.1679232535154923, "deviation-heading": 0.5577150912322762, "set_robot_commands": 0.09401935079823368, "deviation-center-line": 0.09018753673738882, "driven_lanedir_consec": 0.0942065850756637, "sim_compute_sim_state": 0.04008720232092816, "sim_compute_performance-ego": 0.07644500939742378, "sim_compute_robot_state-ego": 0.08027637523153554, "sim_compute_robot_state-npc0": 0.0705157466556715, "sim_compute_robot_state-npc1": 0.07382007267164148, "sim_compute_robot_state-npc2": 0.07391806270765222, "sim_compute_robot_state-npc3": 0.0680133467135222}, "udem1-14-0": {"driven_any": 0.1766443401999513, "sim_physics": 0.17793035507202148, "survival_time": 1.3500000000000003, "driven_lanedir": 0.13665901702247374, "sim_render-ego": 0.052847614994755494, "in-drivable-lane": 0, "agent_compute-ego": 0.15736820962693956, "deviation-heading": 0.6498097143382661, "set_robot_commands": 0.08727086031878437, "deviation-center-line": 0.08321794548499498, "driven_lanedir_consec": 0.13665901702247374, "sim_compute_sim_state": 0.03515297395211679, "sim_compute_performance-ego": 0.05821320745680067, "sim_compute_robot_state-ego": 0.06405391516508879, "sim_compute_robot_state-npc0": 0.06519661126313386, "sim_compute_robot_state-npc1": 0.06736838376080548, "sim_compute_robot_state-npc2": 0.06322754753960504, "sim_compute_robot_state-npc3": 0.06369072419625742}}
set_robot_commands_max0.10080790519714355
set_robot_commands_mean0.09027228121538423
set_robot_commands_median0.09036743640899658
set_robot_commands_min0.0822650556978972
sim_compute_performance-ego_max0.07644500939742378
sim_compute_performance-ego_mean0.06538850932830843
sim_compute_performance-ego_median0.06416727602481842
sim_compute_performance-ego_min0.05821320745680067
sim_compute_robot_state-ego_max0.08027637523153554
sim_compute_robot_state-ego_mean0.06985358154935675
sim_compute_robot_state-ego_median0.06824753834651066
sim_compute_robot_state-ego_min0.0637613832950592
sim_compute_robot_state-npc0_max0.0705157466556715
sim_compute_robot_state-npc0_mean0.06582412403846255
sim_compute_robot_state-npc0_median0.06519661126313386
sim_compute_robot_state-npc0_min0.060166545536207115
sim_compute_robot_state-npc1_max0.07382007267164148
sim_compute_robot_state-npc1_mean0.06589616319373609
sim_compute_robot_state-npc1_median0.06619405746459961
sim_compute_robot_state-npc1_min0.06007233262062073
sim_compute_robot_state-npc2_max0.07391806270765222
sim_compute_robot_state-npc2_mean0.06501380436341264
sim_compute_robot_state-npc2_median0.06322754753960504
sim_compute_robot_state-npc2_min0.056591184933980306
sim_compute_robot_state-npc3_max0.07309508323669434
sim_compute_robot_state-npc3_mean0.06531452407679465
sim_compute_robot_state-npc3_median0.0652672251065572
sim_compute_robot_state-npc3_min0.057327795028686526
sim_compute_sim_state_max0.041854712270921274
sim_compute_sim_state_mean0.03764423611271939
sim_compute_sim_state_median0.03764940500259399
sim_compute_sim_state_min0.03323671221733093
sim_physics_max0.2465995450814565
sim_physics_mean0.20761944450464723
sim_physics_median0.20536517485594136
sim_physics_min0.17793035507202148
sim_render-ego_max0.08630955603814894
sim_render-ego_mean0.06093903110292701
sim_render-ego_median0.05994168519973755
sim_render-ego_min0.052847614994755494
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3466666666666671
survival_time_min1.0000000000000002
222462751RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationfailedyes11690:01:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222422516Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11690:00:33
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222272894almasipBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes11690:11:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.