AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1291

evaluator1291
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7227
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success39
# timeout
# failed12
# error33
# aborted
# host-error2
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.2 GB
Disk (MB)96.9 GB
Disk available (MB)45.3 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242514025dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:03:53(hidden)
driven_lanedir_consec_median0.2390767607415909
survival_time_median1.7000000000000008
deviation-center-line_median0.08731774378025493
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16627474088926572
agent_compute-ego_mean0.1313293596330848
agent_compute-ego_median0.12806763819285802
agent_compute-ego_min0.09928670796481046
deviation-center-line_max0.12054118396669132
deviation-center-line_mean0.0943806886453727
deviation-center-line_min0.07236157409992623
deviation-heading_max0.8395823312464852
deviation-heading_mean0.6952558053777387
deviation-heading_median0.7189552202610832
deviation-heading_min0.45739388058973846
driven_any_max0.3749492126045942
driven_any_mean0.2776285226328782
driven_any_median0.3017614212335563
driven_any_min0.17025356377144965
driven_lanedir_consec_max0.3270190082975084
driven_lanedir_consec_mean0.22965679021530988
driven_lanedir_consec_min0.14686490694733578
driven_lanedir_max0.3270190082975084
driven_lanedir_mean0.22965679021530988
driven_lanedir_median0.2390767607415909
driven_lanedir_min0.14686490694733578
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3749492126045942, "sim_physics": 0.12693515339413206, "survival_time": 1.850000000000001, "driven_lanedir": 0.3270190082975084, "sim_render-ego": 0.06605729541263065, "in-drivable-lane": 0, "agent_compute-ego": 0.16627474088926572, "deviation-heading": 0.7189552202610832, "set_robot_commands": 0.09236621212314916, "deviation-center-line": 0.12054118396669132, "driven_lanedir_consec": 0.3270190082975084, "sim_compute_sim_state": 0.04001455049257021, "sim_compute_performance-ego": 0.07290745425868679, "sim_compute_robot_state-ego": 0.07285991874901024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3017614212335563, "sim_physics": 0.08956792074091294, "survival_time": 1.7000000000000008, "driven_lanedir": 0.2564287352724717, "sim_render-ego": 0.052202484186957866, "in-drivable-lane": 0, "agent_compute-ego": 0.13587720955119414, "deviation-heading": 0.6733187045960338, "set_robot_commands": 0.07599426718319163, "deviation-center-line": 0.07236157409992623, "driven_lanedir_consec": 0.2564287352724717, "sim_compute_sim_state": 0.0335771686890546, "sim_compute_performance-ego": 0.061313993790570426, "sim_compute_robot_state-ego": 0.06306799019084257}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17025356377144965, "sim_physics": 0.07938455451618541, "survival_time": 1.1000000000000003, "driven_lanedir": 0.14686490694733578, "sim_render-ego": 0.042021328752691094, "in-drivable-lane": 0, "agent_compute-ego": 0.09928670796481046, "deviation-heading": 0.45739388058973846, "set_robot_commands": 0.056093421849337494, "deviation-center-line": 0.10546361989156476, "driven_lanedir_consec": 0.14686490694733578, "sim_compute_sim_state": 0.027623111551458187, "sim_compute_performance-ego": 0.04570894891565496, "sim_compute_robot_state-ego": 0.04802670262076638}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23782365344564824, "sim_physics": 0.08705323083060128, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1788945398176427, "sim_render-ego": 0.047928035259246826, "in-drivable-lane": 0, "agent_compute-ego": 0.12806763819285802, "deviation-heading": 0.8395823312464852, "set_robot_commands": 0.07527873345783778, "deviation-center-line": 0.08621932148842626, "driven_lanedir_consec": 0.1788945398176427, "sim_compute_sim_state": 0.03158831596374512, "sim_compute_performance-ego": 0.05270154135567801, "sim_compute_robot_state-ego": 0.05596248592649187}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3033547621091426, "sim_physics": 0.07809444155011858, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2390767607415909, "sim_render-ego": 0.0470867361341204, "in-drivable-lane": 0, "agent_compute-ego": 0.12714050156729562, "deviation-heading": 0.7870288901953529, "set_robot_commands": 0.07119325229099818, "deviation-center-line": 0.08731774378025493, "driven_lanedir_consec": 0.2390767607415909, "sim_compute_sim_state": 0.02933272634233747, "sim_compute_performance-ego": 0.05213925497872489, "sim_compute_robot_state-ego": 0.06471589633396693}}
set_robot_commands_max0.09236621212314916
set_robot_commands_mean0.07418517738090284
set_robot_commands_median0.07527873345783778
set_robot_commands_min0.056093421849337494
sim_compute_performance-ego_max0.07290745425868679
sim_compute_performance-ego_mean0.05695423865986302
sim_compute_performance-ego_median0.05270154135567801
sim_compute_performance-ego_min0.04570894891565496
sim_compute_robot_state-ego_max0.07285991874901024
sim_compute_robot_state-ego_mean0.0609265987642156
sim_compute_robot_state-ego_median0.06306799019084257
sim_compute_robot_state-ego_min0.04802670262076638
sim_compute_sim_state_max0.04001455049257021
sim_compute_sim_state_mean0.03242717460783312
sim_compute_sim_state_median0.03158831596374512
sim_compute_sim_state_min0.027623111551458187
sim_physics_max0.12693515339413206
sim_physics_mean0.09220706020639004
sim_physics_median0.08705323083060128
sim_physics_min0.07809444155011858
sim_render-ego_max0.06605729541263065
sim_render-ego_mean0.05105917594912936
sim_render-ego_median0.047928035259246826
sim_render-ego_min0.042021328752691094
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5600000000000007
survival_time_min1.1000000000000003
242424033frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12910:14:22(hidden)
driven_lanedir_consec_median0.4126113388371666
survival_time_median2.6999999999999984
deviation-center-line_median0.11871775985231396
in-drivable-lane_median0.9499999999999976


other stats
agent_compute-ego_max0.08625599054189828
agent_compute-ego_mean0.06545590483320625
agent_compute-ego_median0.06711106300354004
agent_compute-ego_min0.05170397247586932
deviation-center-line_max0.2616199012603187
deviation-center-line_mean0.12663752615997417
deviation-center-line_min0.07143676193760398
deviation-heading_max1.4563581054905994
deviation-heading_mean0.5551840294909584
deviation-heading_median0.55940705176748
deviation-heading_min0.2596285487829774
driven_any_max1.6839250134630197
driven_any_mean0.7327294413370017
driven_any_median0.7309130538792373
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.9416535020294268
driven_lanedir_consec_mean0.4469104002974222
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.9416535020294268
driven_lanedir_mean0.4469104002974222
driven_lanedir_median0.4126113388371666
driven_lanedir_min0.2221238695940002
in-drivable-lane_max2.1499999999999924
in-drivable-lane_mean0.8233333333333307
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.1152582974501059, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06141374144755619, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07228640435447156, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.08963692020362532, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03723813446474747, "sim_compute_performance-ego": 0.06911584692941584, "sim_compute_robot_state-ego": 0.0728284305250141}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.10965328613917032, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05989002386728923, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06711106300354004, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09171077410380044, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.03891295989354451, "sim_compute_performance-ego": 0.06470248699188233, "sim_compute_robot_state-ego": 0.07342348098754883}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11428345333446156, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06141300634904341, "in-drivable-lane": 0, "agent_compute-ego": 0.0644609819759022, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.09197779135270552, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.039153792641379616, "sim_compute_performance-ego": 0.06963430751453746, "sim_compute_robot_state-ego": 0.07346431775526567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.12053691347440083, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06152849396069845, "in-drivable-lane": 0, "agent_compute-ego": 0.06888946890830994, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.0911272217830022, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03807920217514038, "sim_compute_performance-ego": 0.06891987224419911, "sim_compute_robot_state-ego": 0.06644616027673085}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12105796129807182, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06257574454597804, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07804710968681004, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09984223220659338, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.0419939082601796, "sim_compute_performance-ego": 0.06749126703842827, "sim_compute_robot_state-ego": 0.07498586177825928}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.32177231722795413, "sim_physics": 0.10813112060228984, "survival_time": 1.2000000000000004, "driven_lanedir": 0.259671941523266, "sim_render-ego": 0.0538142720858256, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.06173714995384216, "deviation-heading": 0.55940705176748, "set_robot_commands": 0.08492747942606609, "deviation-center-line": 0.07983398841276981, "driven_lanedir_consec": 0.259671941523266, "sim_compute_sim_state": 0.035684674978256226, "sim_compute_performance-ego": 0.057745675245920815, "sim_compute_robot_state-ego": 0.06469250718752544}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.9218874635466072, "sim_physics": 0.11351568882281964, "survival_time": 3.899999999999994, "driven_lanedir": 0.5450627289344152, "sim_render-ego": 0.06516244472601475, "in-drivable-lane": 1.2999999999999954, "agent_compute-ego": 0.06772094812148656, "deviation-heading": 0.6586708623908946, "set_robot_commands": 0.088167178325164, "deviation-center-line": 0.13114121213460145, "driven_lanedir_consec": 0.5450627289344152, "sim_compute_sim_state": 0.038558366971138194, "sim_compute_performance-ego": 0.075775574415158, "sim_compute_robot_state-ego": 0.06782164023472713}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.8035998912048764, "sim_physics": 0.0795491806098393, "survival_time": 2.799999999999998, "driven_lanedir": 0.4126113388371666, "sim_render-ego": 0.04486587217875889, "in-drivable-lane": 0.9999999999999972, "agent_compute-ego": 0.05170397247586932, "deviation-heading": 0.6465417997696941, "set_robot_commands": 0.07026986139161247, "deviation-center-line": 0.119844131874105, "driven_lanedir_consec": 0.4126113388371666, "sim_compute_sim_state": 0.02878409624099731, "sim_compute_performance-ego": 0.04810681939125061, "sim_compute_robot_state-ego": 0.05069054450307574}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.082025040886041, "sim_physics": 0.08206461489885702, "survival_time": 4.3499999999999925, "driven_lanedir": 0.4507633352947824, "sim_render-ego": 0.045274304247450554, "in-drivable-lane": 2.1499999999999924, "agent_compute-ego": 0.05246536485080061, "deviation-heading": 0.6137519362826567, "set_robot_commands": 0.07070483284435053, "deviation-center-line": 0.11871775985231396, "driven_lanedir_consec": 0.4507633352947824, "sim_compute_sim_state": 0.029729881505856568, "sim_compute_performance-ego": 0.0508778067840927, "sim_compute_robot_state-ego": 0.05319372264818213}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.6839250134630197, "sim_physics": 0.08666576688939875, "survival_time": 5.4999999999999885, "driven_lanedir": 0.9416535020294268, "sim_render-ego": 0.04753606536171653, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.05828435204245828, "deviation-heading": 1.4563581054905994, "set_robot_commands": 0.07354183413765647, "deviation-center-line": 0.2616199012603187, "driven_lanedir_consec": 0.9416535020294268, "sim_compute_sim_state": 0.03192270018837669, "sim_compute_performance-ego": 0.0510006080974232, "sim_compute_robot_state-ego": 0.05258553678339178}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.2667775284624888, "sim_physics": 0.08706937233606975, "survival_time": 1.2000000000000004, "driven_lanedir": 0.25235480657068055, "sim_render-ego": 0.04745560884475708, "in-drivable-lane": 0, "agent_compute-ego": 0.05345945556958517, "deviation-heading": 0.2735028974766809, "set_robot_commands": 0.07471247514088948, "deviation-center-line": 0.10630271043038582, "driven_lanedir_consec": 0.25235480657068055, "sim_compute_sim_state": 0.03272449970245361, "sim_compute_performance-ego": 0.05435901880264282, "sim_compute_robot_state-ego": 0.0534152090549469}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 1.0389325864387626, "sim_physics": 0.09923049072166544, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4755729783153157, "sim_render-ego": 0.05137330525881284, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.062483385011747286, "deviation-heading": 0.521699236138543, "set_robot_commands": 0.07960305585489645, "deviation-center-line": 0.10517150645857888, "driven_lanedir_consec": 0.4755729783153157, "sim_compute_sim_state": 0.03313115045621798, "sim_compute_performance-ego": 0.056381002649084314, "sim_compute_robot_state-ego": 0.059746373783458366}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6835794874956865, "sim_physics": 0.10831332206726074, "survival_time": 2.499999999999999, "driven_lanedir": 0.6100305079584653, "sim_render-ego": 0.05624489784240723, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.06821502685546875, "deviation-heading": 0.4739455376152246, "set_robot_commands": 0.08412778854370118, "deviation-center-line": 0.12143860235134882, "driven_lanedir_consec": 0.6100305079584653, "sim_compute_sim_state": 0.03808627605438233, "sim_compute_performance-ego": 0.06167109966278076, "sim_compute_robot_state-ego": 0.06277284145355225}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.29517411990766207, "sim_physics": 0.12679200906019944, "survival_time": 1.3000000000000005, "driven_lanedir": 0.25251967754950355, "sim_render-ego": 0.06066429615020752, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.08625599054189828, "deviation-heading": 0.466101326638835, "set_robot_commands": 0.09967133632073036, "deviation-center-line": 0.07143676193760398, "driven_lanedir_consec": 0.25251967754950355, "sim_compute_sim_state": 0.049069918118990384, "sim_compute_performance-ego": 0.06791069874396691, "sim_compute_robot_state-ego": 0.07237301422999455}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7309130538792373, "sim_physics": 0.1129042042626275, "survival_time": 2.6999999999999984, "driven_lanedir": 0.38087957155028906, "sim_render-ego": 0.058872624679848, "in-drivable-lane": 0.9499999999999976, "agent_compute-ego": 0.06871789914590341, "deviation-heading": 0.5607794956477159, "set_robot_commands": 0.0855096490294845, "deviation-center-line": 0.12406277512673576, "driven_lanedir_consec": 0.38087957155028906, "sim_compute_sim_state": 0.03541923893822564, "sim_compute_performance-ego": 0.06428851463176587, "sim_compute_robot_state-ego": 0.07162940943682636}}
set_robot_commands_max0.09984223220659338
set_robot_commands_mean0.08503536204428523
set_robot_commands_median0.0855096490294845
set_robot_commands_min0.07026986139161247
sim_compute_performance-ego_max0.075775574415158
sim_compute_performance-ego_mean0.061865373276169935
sim_compute_performance-ego_median0.06428851463176587
sim_compute_performance-ego_min0.04810681939125061
sim_compute_robot_state-ego_max0.07498586177825928
sim_compute_robot_state-ego_mean0.06467127004256662
sim_compute_robot_state-ego_median0.06644616027673085
sim_compute_robot_state-ego_min0.05069054450307574
sim_compute_sim_state_max0.049069918118990384
sim_compute_sim_state_mean0.03656592003932577
sim_compute_sim_state_median0.03723813446474747
sim_compute_sim_state_min0.02878409624099731
sim_physics_max0.12679200906019944
sim_physics_mean0.10566837879781588
sim_physics_median0.10965328613917032
sim_physics_min0.0795491806098393
sim_render-ego_max0.06516244472601475
sim_render-ego_mean0.055872313436424285
sim_render-ego_median0.058872624679848
sim_render-ego_min0.04486587217875889
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean2.7766666666666637
survival_time_min1.1000000000000003
242394040frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:07:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242384043riza.veliogluPredictorLastaido2-PREDstep1-simulationsuccessyes12910:01:37(hidden)
error_L10.11146035845548724
error_L20.019208026578897232


242304024meanstreetsPredictorLastaido2-PREDstep1-simulationsuccessyes12910:00:27(hidden)
error_L10.11549356909288
error_L20.021365875461778584


242244014dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242224019dgmds17avchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:01:24
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242164010kene4192CNN-48by96-less-one-50-augaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.NotFoundError: Op type not registered 'ImageProjectiveTransformV2' in binary running on ef0495743c75. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
242154009kene4192CNN-8logs-60by80-latestaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:16:37(hidden)
driven_lanedir_consec_median1.1952234028445328
survival_time_median13.00000000000005
deviation-center-line_median0.3256618704452082
in-drivable-lane_median2.3999999999999915


other stats
agent_compute-ego_max0.11907339737965512
agent_compute-ego_mean0.11830892618638418
agent_compute-ego_median0.11829149421257308
agent_compute-ego_min0.11766454068625844
deviation-center-line_max0.5344984645986883
deviation-center-line_mean0.33373860704654085
deviation-center-line_min0.14378333683408742
deviation-heading_max1.562809565076711
deviation-heading_mean1.229904356455272
deviation-heading_median1.1186705479884342
deviation-heading_min0.9454037442742542
driven_any_max1.7446467209804262
driven_any_mean1.255517800327618
driven_any_median1.611251704928607
driven_any_min0.22880056343648816
driven_lanedir_consec_max1.7367392886938515
driven_lanedir_consec_mean0.9961459420709204
driven_lanedir_consec_min0.1995007661685579
driven_lanedir_max1.7367392886938515
driven_lanedir_mean0.9961885494729422
driven_lanedir_median1.195436439854642
driven_lanedir_min0.1995007661685579
in-drivable-lane_max3.100000000000044
in-drivable-lane_mean1.6900000000000155
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9923053585059056, "sim_physics": 0.09173779698866832, "survival_time": 7.89999999999998, "driven_lanedir": 0.647504007011475, "sim_render-ego": 0.0354262273522872, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.11829149421257308, "deviation-heading": 0.999382388975032, "set_robot_commands": 0.054936648924139485, "deviation-center-line": 0.34252413548837746, "driven_lanedir_consec": 0.647504007011475, "sim_compute_sim_state": 0.02239957489544832, "sim_compute_performance-ego": 0.03832693190514287, "sim_compute_robot_state-ego": 0.04036252558985843, "sim_compute_robot_state-npc0": 0.03986259502700613, "sim_compute_robot_state-npc1": 0.03904065452044523, "sim_compute_robot_state-npc2": 0.038914840432662, "sim_compute_robot_state-npc3": 0.03902263279202618}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.7446467209804262, "sim_physics": 0.09826469580332438, "survival_time": 14.950000000000076, "driven_lanedir": 1.7367392886938515, "sim_render-ego": 0.035647926330566404, "in-drivable-lane": 0, "agent_compute-ego": 0.11859069267908733, "deviation-heading": 1.1186705479884342, "set_robot_commands": 0.054910106658935545, "deviation-center-line": 0.5344984645986883, "driven_lanedir_consec": 1.7367392886938515, "sim_compute_sim_state": 0.022767698764801024, "sim_compute_performance-ego": 0.03853987455368042, "sim_compute_robot_state-ego": 0.04069352626800537, "sim_compute_robot_state-npc0": 0.041070401668548584, "sim_compute_robot_state-npc1": 0.03950678110122681, "sim_compute_robot_state-npc2": 0.039288843472798665, "sim_compute_robot_state-npc3": 0.039430228074391685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.611251704928607, "sim_physics": 0.0900276746505346, "survival_time": 13.65000000000006, "driven_lanedir": 1.2017622456361838, "sim_render-ego": 0.03520317916031722, "in-drivable-lane": 3.100000000000044, "agent_compute-ego": 0.11792450597434692, "deviation-heading": 1.562809565076711, "set_robot_commands": 0.05486709032303248, "deviation-center-line": 0.32222522786634267, "driven_lanedir_consec": 1.2017622456361838, "sim_compute_sim_state": 0.022816099090017243, "sim_compute_performance-ego": 0.03990311413020878, "sim_compute_robot_state-ego": 0.04070883530836839, "sim_compute_robot_state-npc0": 0.042579586252624736, "sim_compute_robot_state-npc1": 0.039325075708466134, "sim_compute_robot_state-npc2": 0.0391649964091542, "sim_compute_robot_state-npc3": 0.03942370589399512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.700584653786663, "sim_physics": 0.08992650967377883, "survival_time": 13.00000000000005, "driven_lanedir": 1.195436439854642, "sim_render-ego": 0.035550045967102054, "in-drivable-lane": 2.950000000000042, "agent_compute-ego": 0.11907339737965512, "deviation-heading": 1.5232555359619275, "set_robot_commands": 0.054250281590681806, "deviation-center-line": 0.3256618704452082, "driven_lanedir_consec": 1.1952234028445328, "sim_compute_sim_state": 0.02248762112397414, "sim_compute_performance-ego": 0.038557898998260495, "sim_compute_robot_state-ego": 0.040445626699007475, "sim_compute_robot_state-npc0": 0.04002711314421434, "sim_compute_robot_state-npc1": 0.039264647777263934, "sim_compute_robot_state-npc2": 0.03924060051257794, "sim_compute_robot_state-npc3": 0.04049841073843149}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22880056343648816, "sim_physics": 0.09023163958293635, "survival_time": 2.0500000000000007, "driven_lanedir": 0.1995007661685579, "sim_render-ego": 0.03497586017701684, "in-drivable-lane": 0, "agent_compute-ego": 0.11766454068625844, "deviation-heading": 0.9454037442742542, "set_robot_commands": 0.053757958295868664, "deviation-center-line": 0.14378333683408742, "driven_lanedir_consec": 0.1995007661685579, "sim_compute_sim_state": 0.022427209993688073, "sim_compute_performance-ego": 0.037980957729060474, "sim_compute_robot_state-ego": 0.040193778712575026, "sim_compute_robot_state-npc0": 0.03968077171139601, "sim_compute_robot_state-npc1": 0.03895214127331245, "sim_compute_robot_state-npc2": 0.03878805695510492, "sim_compute_robot_state-npc3": 0.03891725074954149}}
set_robot_commands_max0.054936648924139485
set_robot_commands_mean0.05454441715853159
set_robot_commands_median0.05486709032303248
set_robot_commands_min0.053757958295868664
sim_compute_performance-ego_max0.03990311413020878
sim_compute_performance-ego_mean0.03866175546327061
sim_compute_performance-ego_median0.03853987455368042
sim_compute_performance-ego_min0.037980957729060474
sim_compute_robot_state-ego_max0.04070883530836839
sim_compute_robot_state-ego_mean0.040480858515562934
sim_compute_robot_state-ego_median0.040445626699007475
sim_compute_robot_state-ego_min0.040193778712575026
sim_compute_robot_state-npc0_max0.042579586252624736
sim_compute_robot_state-npc0_mean0.04064409356075795
sim_compute_robot_state-npc0_median0.04002711314421434
sim_compute_robot_state-npc0_min0.03968077171139601
sim_compute_robot_state-npc1_max0.03950678110122681
sim_compute_robot_state-npc1_mean0.03921786007614291
sim_compute_robot_state-npc1_median0.039264647777263934
sim_compute_robot_state-npc1_min0.03895214127331245
sim_compute_robot_state-npc2_max0.039288843472798665
sim_compute_robot_state-npc2_mean0.039079467556459545
sim_compute_robot_state-npc2_median0.0391649964091542
sim_compute_robot_state-npc2_min0.03878805695510492
sim_compute_robot_state-npc3_max0.04049841073843149
sim_compute_robot_state-npc3_mean0.0394584456496772
sim_compute_robot_state-npc3_median0.03942370589399512
sim_compute_robot_state-npc3_min0.03891725074954149
sim_compute_sim_state_max0.022816099090017243
sim_compute_sim_state_mean0.022579640773585756
sim_compute_sim_state_median0.02248762112397414
sim_compute_sim_state_min0.02239957489544832
sim_physics_max0.09826469580332438
sim_physics_mean0.09203766333984847
sim_physics_median0.09023163958293635
sim_physics_min0.08992650967377883
sim_render-ego_max0.035647926330566404
sim_render-ego_mean0.03536064779745794
sim_render-ego_median0.0354262273522872
sim_render-ego_min0.03497586017701684
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.310000000000034
survival_time_min2.0500000000000007
242144008jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:08:36(hidden)
driven_lanedir_consec_median0.15983003669304985
survival_time_median4.149999999999993
deviation-center-line_median0.0703502703414475
in-drivable-lane_median1.7999999999999974


other stats
agent_compute-ego_max0.09613393624623616
agent_compute-ego_mean0.0952625260891794
agent_compute-ego_median0.0955228460840432
agent_compute-ego_min0.09408488980046024
deviation-center-line_max0.6960955385806167
deviation-center-line_mean0.28487389184774126
deviation-center-line_min0.021871844335814388
deviation-heading_max5.983722633208984
deviation-heading_mean2.918648007643378
deviation-heading_median1.5654975982633557
deviation-heading_min0.5967098075182897
driven_any_max1.889158590404872
driven_any_mean0.869731362762467
driven_any_median0.4651432691953716
driven_any_min0.0980990159131188
driven_lanedir_consec_max0.6425970163950665
driven_lanedir_consec_mean0.2774269639310317
driven_lanedir_consec_min0.034697835002273525
driven_lanedir_max0.6425970163950665
driven_lanedir_mean0.2774269639310317
driven_lanedir_median0.15983003669304985
driven_lanedir_min0.034697835002273525
in-drivable-lane_max7.600000000000042
in-drivable-lane_mean3.510000000000015
in-drivable-lane_min0.4500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.889158590404872, "sim_physics": 0.055369951725006104, "survival_time": 14.950000000000076, "driven_lanedir": 0.6425970163950665, "sim_render-ego": 0.035343929926554364, "in-drivable-lane": 7.100000000000034, "agent_compute-ego": 0.0960918672879537, "deviation-heading": 5.983722633208984, "set_robot_commands": 0.05422401905059814, "deviation-center-line": 0.6960955385806167, "driven_lanedir_consec": 0.6425970163950665, "sim_compute_sim_state": 0.02259062925974528, "sim_compute_performance-ego": 0.038076802889506024, "sim_compute_robot_state-ego": 0.04011547088623047}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1541454437653466, "sim_physics": 0.0586084057303036, "survival_time": 1.7000000000000008, "driven_lanedir": 0.04181350773923831, "sim_render-ego": 0.034477198825163, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09447909102720373, "deviation-heading": 0.6183887112259263, "set_robot_commands": 0.053534255308263445, "deviation-center-line": 0.021871844335814388, "driven_lanedir_consec": 0.04181350773923831, "sim_compute_sim_state": 0.022742636063519645, "sim_compute_performance-ego": 0.038333920871510226, "sim_compute_robot_state-ego": 0.040275952395270855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.0980990159131188, "sim_physics": 0.05540929900275336, "survival_time": 1.3500000000000003, "driven_lanedir": 0.034697835002273525, "sim_render-ego": 0.03404392136467828, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.09408488980046024, "deviation-heading": 0.5967098075182897, "set_robot_commands": 0.0537840172096535, "deviation-center-line": 0.07026661260266032, "driven_lanedir_consec": 0.034697835002273525, "sim_compute_sim_state": 0.022600747920848704, "sim_compute_performance-ego": 0.0380075595996998, "sim_compute_robot_state-ego": 0.040156134852656615}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7421104945336263, "sim_physics": 0.05637174208958944, "survival_time": 14.950000000000076, "driven_lanedir": 0.5081964238255305, "sim_render-ego": 0.03531768639882406, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.09613393624623616, "deviation-heading": 5.828921288000335, "set_robot_commands": 0.05439356486002604, "deviation-center-line": 0.5657851933781672, "driven_lanedir_consec": 0.5081964238255305, "sim_compute_sim_state": 0.022633309364318847, "sim_compute_performance-ego": 0.03806220849355062, "sim_compute_robot_state-ego": 0.04006751139958699}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4651432691953716, "sim_physics": 0.05886568218828684, "survival_time": 4.149999999999993, "driven_lanedir": 0.15983003669304985, "sim_render-ego": 0.03531084290469985, "in-drivable-lane": 1.7999999999999974, "agent_compute-ego": 0.0955228460840432, "deviation-heading": 1.5654975982633557, "set_robot_commands": 0.054625232535672474, "deviation-center-line": 0.0703502703414475, "driven_lanedir_consec": 0.15983003669304985, "sim_compute_sim_state": 0.02272988514727857, "sim_compute_performance-ego": 0.038458209439932584, "sim_compute_robot_state-ego": 0.039753181388579216}}
set_robot_commands_max0.054625232535672474
set_robot_commands_mean0.05411221779284272
set_robot_commands_median0.05422401905059814
set_robot_commands_min0.053534255308263445
sim_compute_performance-ego_max0.038458209439932584
sim_compute_performance-ego_mean0.03818774025883985
sim_compute_performance-ego_median0.038076802889506024
sim_compute_performance-ego_min0.0380075595996998
sim_compute_robot_state-ego_max0.040275952395270855
sim_compute_robot_state-ego_mean0.040073650184464835
sim_compute_robot_state-ego_median0.04011547088623047
sim_compute_robot_state-ego_min0.039753181388579216
sim_compute_sim_state_max0.022742636063519645
sim_compute_sim_state_mean0.02265944155114221
sim_compute_sim_state_median0.022633309364318847
sim_compute_sim_state_min0.02259062925974528
sim_physics_max0.05886568218828684
sim_physics_mean0.05692501614718788
sim_physics_median0.05637174208958944
sim_physics_min0.055369951725006104
sim_render-ego_max0.035343929926554364
sim_render-ego_mean0.03489871588398391
sim_render-ego_median0.03531084290469985
sim_render-ego_min0.03404392136467828
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.42000000000003
survival_time_min1.3500000000000003
242134007InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242124006jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:38(hidden)
driven_lanedir_consec_median0.07579582448250355
survival_time_median1.6000000000000008
deviation-center-line_median0.08009172848177352
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09601959871209186
agent_compute-ego_mean0.0949256401643521
agent_compute-ego_median0.09500908106565475
agent_compute-ego_min0.093785938463713
deviation-center-line_max0.2405417869685169
deviation-center-line_mean0.09169309380908088
deviation-center-line_min0.024549257963551625
deviation-heading_max4.617564995557
deviation-heading_mean1.5644167646288392
deviation-heading_median0.5550325578631559
deviation-heading_min0.5438538878239981
driven_any_max1.4816910427797223
driven_any_mean0.495176833085527
driven_any_median0.18694509205844767
driven_any_min0.09880002889701386
driven_lanedir_consec_max0.49519261333171904
driven_lanedir_consec_mean0.17250946715992693
driven_lanedir_consec_min0.06472982378274272
driven_lanedir_max0.49519261333171904
driven_lanedir_mean0.17250946715992693
driven_lanedir_median0.07579582448250355
driven_lanedir_min0.06472982378274272
in-drivable-lane_max5.400000000000016
in-drivable-lane_mean1.660000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.4816910427797223, "sim_physics": 0.056865911898405654, "survival_time": 11.500000000000028, "driven_lanedir": 0.49519261333171904, "sim_render-ego": 0.035276695956354555, "in-drivable-lane": 5.400000000000016, "agent_compute-ego": 0.09601959871209186, "deviation-heading": 4.617564995557, "set_robot_commands": 0.054113337268000064, "deviation-center-line": 0.2405417869685169, "driven_lanedir_consec": 0.49519261333171904, "sim_compute_sim_state": 0.02241007970727008, "sim_compute_performance-ego": 0.037818044164906375, "sim_compute_robot_state-ego": 0.03979926212974216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18694509205844767, "sim_physics": 0.05601000785827637, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07579582448250355, "sim_render-ego": 0.034890249371528625, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.09500908106565475, "deviation-heading": 0.5513759756100111, "set_robot_commands": 0.054661400616168976, "deviation-center-line": 0.024549257963551625, "driven_lanedir_consec": 0.07579582448250355, "sim_compute_sim_state": 0.02267883718013763, "sim_compute_performance-ego": 0.0376165583729744, "sim_compute_robot_state-ego": 0.04014083743095398}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09880002889701386, "sim_physics": 0.05664123986896716, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06756661795490837, "sim_render-ego": 0.0344741846385755, "in-drivable-lane": 0, "agent_compute-ego": 0.093785938463713, "deviation-heading": 0.5550325578631559, "set_robot_commands": 0.05422968613473993, "deviation-center-line": 0.08312789178633377, "driven_lanedir_consec": 0.06756661795490837, "sim_compute_sim_state": 0.022804473575792815, "sim_compute_performance-ego": 0.03830104125173468, "sim_compute_robot_state-ego": 0.03982152436908923}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5263936149096982, "sim_physics": 0.05797784841513332, "survival_time": 3.949999999999994, "driven_lanedir": 0.15926245624776092, "sim_render-ego": 0.03561568561988541, "in-drivable-lane": 1.8499999999999983, "agent_compute-ego": 0.09532391874096062, "deviation-heading": 1.554256406290032, "set_robot_commands": 0.05461578127704089, "deviation-center-line": 0.08009172848177352, "driven_lanedir_consec": 0.15926245624776092, "sim_compute_sim_state": 0.02261855028852632, "sim_compute_performance-ego": 0.03783848617650286, "sim_compute_robot_state-ego": 0.04013185259662097}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1820543867827529, "sim_physics": 0.05938730388879776, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06472982378274272, "sim_render-ego": 0.03480908274650574, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.0944896638393402, "deviation-heading": 0.5438538878239981, "set_robot_commands": 0.054827980697155, "deviation-center-line": 0.0301548038452286, "driven_lanedir_consec": 0.06472982378274272, "sim_compute_sim_state": 0.023577839136123657, "sim_compute_performance-ego": 0.037807755172252655, "sim_compute_robot_state-ego": 0.043960362672805786}}
set_robot_commands_max0.054827980697155
set_robot_commands_mean0.05448963719862097
set_robot_commands_median0.05461578127704089
set_robot_commands_min0.054113337268000064
sim_compute_performance-ego_max0.03830104125173468
sim_compute_performance-ego_mean0.03787637702767419
sim_compute_performance-ego_median0.037818044164906375
sim_compute_performance-ego_min0.0376165583729744
sim_compute_robot_state-ego_max0.043960362672805786
sim_compute_robot_state-ego_mean0.040770767839842424
sim_compute_robot_state-ego_median0.04013185259662097
sim_compute_robot_state-ego_min0.03979926212974216
sim_compute_sim_state_max0.023577839136123657
sim_compute_sim_state_mean0.022817955977570106
sim_compute_sim_state_median0.02267883718013763
sim_compute_sim_state_min0.02241007970727008
sim_physics_max0.05938730388879776
sim_physics_mean0.05737646238591605
sim_physics_median0.056865911898405654
sim_physics_min0.05601000785827637
sim_render-ego_max0.03561568561988541
sim_render-ego_mean0.035013179666569964
sim_render-ego_median0.034890249371528625
sim_render-ego_min0.0344741846385755
simulation-passed1
survival_time_max11.500000000000028
survival_time_mean3.9200000000000057
survival_time_min0.9500000000000004
242114005jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:02:53(hidden)
driven_lanedir_consec_median0.0772679506413414
survival_time_median1.6000000000000008
deviation-center-line_median0.0613513324699074
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.09663986414670944
agent_compute-ego_mean0.0958702497830367
agent_compute-ego_median0.09591157812821238
agent_compute-ego_min0.09439153671264648
deviation-center-line_max0.08345382407618472
deviation-center-line_mean0.058419638662448946
deviation-center-line_min0.026443558539094345
deviation-heading_max0.9218048369594884
deviation-heading_mean0.719622609823016
deviation-heading_median0.6997052138594824
deviation-heading_min0.6227713704254445
driven_any_max0.20250596105814983
driven_any_mean0.17867700914822263
driven_any_median0.19996483831105633
driven_any_min0.09531884518035684
driven_lanedir_consec_max0.11241693563678412
driven_lanedir_consec_mean0.08370788016267627
driven_lanedir_consec_min0.05478240813622692
driven_lanedir_max0.11241693563678412
driven_lanedir_mean0.08370788016267627
driven_lanedir_median0.0772679506413414
driven_lanedir_min0.05478240813622692
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.3200000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20250596105814983, "sim_physics": 0.05838939121791294, "survival_time": 1.7500000000000009, "driven_lanedir": 0.06884443029429255, "sim_render-ego": 0.035469654628208704, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.0966219765799386, "deviation-heading": 0.6997052138594824, "set_robot_commands": 0.053894846779959545, "deviation-center-line": 0.0613513324699074, "driven_lanedir_consec": 0.06884443029429255, "sim_compute_sim_state": 0.022397940499441965, "sim_compute_performance-ego": 0.03811454772949219, "sim_compute_robot_state-ego": 0.040408781596592495}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19996483831105633, "sim_physics": 0.05308730942862375, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0772679506413414, "sim_render-ego": 0.03483869688851493, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09439153671264648, "deviation-heading": 0.6227713704254445, "set_robot_commands": 0.05404246875217983, "deviation-center-line": 0.026443558539094345, "driven_lanedir_consec": 0.0772679506413414, "sim_compute_sim_state": 0.022618559428623744, "sim_compute_performance-ego": 0.03792435782296317, "sim_compute_robot_state-ego": 0.04007571084158761}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09531884518035684, "sim_physics": 0.057345264836361536, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05478240813622692, "sim_render-ego": 0.0344429518047132, "in-drivable-lane": 0, "agent_compute-ego": 0.09591157812821238, "deviation-heading": 0.6228573861704099, "set_robot_commands": 0.05313186896474738, "deviation-center-line": 0.08345382407618472, "driven_lanedir_consec": 0.05478240813622692, "sim_compute_sim_state": 0.02287936210632324, "sim_compute_performance-ego": 0.03819581081992701, "sim_compute_robot_state-ego": 0.04053026751468056}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20016427696693792, "sim_physics": 0.061871004104614255, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11241693563678412, "sim_render-ego": 0.03550979296366374, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.0957862933476766, "deviation-heading": 0.9218048369594884, "set_robot_commands": 0.05368614196777344, "deviation-center-line": 0.06879476900788264, "driven_lanedir_consec": 0.11241693563678412, "sim_compute_sim_state": 0.02270797888437907, "sim_compute_performance-ego": 0.03782270749409993, "sim_compute_robot_state-ego": 0.04026153087615967}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19543112422461217, "sim_physics": 0.06400367617607117, "survival_time": 1.6000000000000008, "driven_lanedir": 0.10522767610473638, "sim_render-ego": 0.036433689296245575, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09663986414670944, "deviation-heading": 0.7309742417002549, "set_robot_commands": 0.05451656132936478, "deviation-center-line": 0.052054709219175606, "driven_lanedir_consec": 0.10522767610473638, "sim_compute_sim_state": 0.023417800664901733, "sim_compute_performance-ego": 0.0393063947558403, "sim_compute_robot_state-ego": 0.04083704948425293}}
set_robot_commands_max0.05451656132936478
set_robot_commands_mean0.05385437755880499
set_robot_commands_median0.053894846779959545
set_robot_commands_min0.05313186896474738
sim_compute_performance-ego_max0.0393063947558403
sim_compute_performance-ego_mean0.03827276372446452
sim_compute_performance-ego_median0.03811454772949219
sim_compute_performance-ego_min0.03782270749409993
sim_compute_robot_state-ego_max0.04083704948425293
sim_compute_robot_state-ego_mean0.040422668062654654
sim_compute_robot_state-ego_median0.040408781596592495
sim_compute_robot_state-ego_min0.04007571084158761
sim_compute_sim_state_max0.023417800664901733
sim_compute_sim_state_mean0.02280432831673395
sim_compute_sim_state_median0.02270797888437907
sim_compute_sim_state_min0.022397940499441965
sim_physics_max0.06400367617607117
sim_physics_mean0.058939329152716734
sim_physics_median0.05838939121791294
sim_physics_min0.05308730942862375
sim_render-ego_max0.036433689296245575
sim_render-ego_mean0.03533895711626923
sim_render-ego_median0.035469654628208704
sim_render-ego_min0.0344429518047132
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.510000000000001
survival_time_min0.9500000000000004
242064000InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242053999InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242033998InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationhost-erroryes12910:01:35
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 759, in run_one
    run_docker(wd, project, cmd)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1100, in run_docker
    subprocess.check_call(cmd0, cwd=cwd, stdout=tee_stdout, stderr=tee_stderr)
  File "/usr/lib/python3.6/subprocess.py", line 286, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/lib/python3.6/subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/lib/python3.6/subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1344, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203': '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation-offseason/submission3998/step1-simulation-ip-172-31-42-167-7227-job24203'
(hidden)
241933989jagwarBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:12:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241903984jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:48(hidden)
driven_lanedir_consec_median0.11925280990562026
survival_time_median1.4500000000000006
deviation-center-line_median0.07598570357684653
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18854566278128787
agent_compute-ego_mean0.16184220244334488
agent_compute-ego_median0.15700873874482654
agent_compute-ego_min0.14333097751323992
deviation-center-line_max0.10027282357584272
deviation-center-line_mean0.07734860649591588
deviation-center-line_min0.06045013765355835
deviation-heading_max0.9068035029186574
deviation-heading_mean0.7515052271859106
deviation-heading_median0.7204652740850678
deviation-heading_min0.5367230331073389
driven_any_max0.21468146773583277
driven_any_mean0.1922058536396188
driven_any_median0.2072449185087261
driven_any_min0.13932120481015925
driven_lanedir_consec_max0.1559987034744572
driven_lanedir_consec_mean0.1287179576015225
driven_lanedir_consec_min0.10830944814629584
driven_lanedir_max0.1559987034744572
driven_lanedir_mean0.1287179576015225
driven_lanedir_median0.11925280990562026
driven_lanedir_min0.10830944814629584
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20878554467107727, "sim_physics": 0.10555112746454054, "survival_time": 1.5500000000000007, "driven_lanedir": 0.11018191257811603, "sim_render-ego": 0.05691415263760474, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15350837092245778, "deviation-heading": 0.8784138376717667, "set_robot_commands": 0.08129599017481651, "deviation-center-line": 0.08186327107034987, "driven_lanedir_consec": 0.11018191257811603, "sim_compute_sim_state": 0.03465456347311697, "sim_compute_performance-ego": 0.06270694732666016, "sim_compute_robot_state-ego": 0.06790360327689879}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2072449185087261, "sim_physics": 0.11194923828388084, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1498469139031231, "sim_render-ego": 0.05767253349567282, "in-drivable-lane": 0, "agent_compute-ego": 0.16681726225491228, "deviation-heading": 0.7204652740850678, "set_robot_commands": 0.08830396060285897, "deviation-center-line": 0.06045013765355835, "driven_lanedir_consec": 0.1498469139031231, "sim_compute_sim_state": 0.03733583976482523, "sim_compute_performance-ego": 0.06955302994826744, "sim_compute_robot_state-ego": 0.07014833647629311}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13932120481015925, "sim_physics": 0.10933848789760044, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10830944814629584, "sim_render-ego": 0.06103466805957612, "in-drivable-lane": 0, "agent_compute-ego": 0.15700873874482654, "deviation-heading": 0.5367230331073389, "set_robot_commands": 0.08222117878141857, "deviation-center-line": 0.10027282357584272, "driven_lanedir_consec": 0.10830944814629584, "sim_compute_sim_state": 0.03948378562927246, "sim_compute_performance-ego": 0.06559086981273833, "sim_compute_robot_state-ego": 0.06546919686453682}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19099613247229863, "sim_physics": 0.10698398259969856, "survival_time": 1.3000000000000005, "driven_lanedir": 0.11925280990562026, "sim_render-ego": 0.0559467077255249, "in-drivable-lane": 0, "agent_compute-ego": 0.14333097751323992, "deviation-heading": 0.9068035029186574, "set_robot_commands": 0.08338176287137546, "deviation-center-line": 0.07598570357684653, "driven_lanedir_consec": 0.11925280990562026, "sim_compute_sim_state": 0.03615858921637902, "sim_compute_performance-ego": 0.0623777096088116, "sim_compute_robot_state-ego": 0.06540194841531607}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21468146773583277, "sim_physics": 0.11789335875675595, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1559987034744572, "sim_render-ego": 0.06605066924259581, "in-drivable-lane": 0, "agent_compute-ego": 0.18854566278128787, "deviation-heading": 0.7151204881467224, "set_robot_commands": 0.09931351398599558, "deviation-center-line": 0.06817109660298196, "driven_lanedir_consec": 0.1559987034744572, "sim_compute_sim_state": 0.03906979231998838, "sim_compute_performance-ego": 0.07097945542171083, "sim_compute_robot_state-ego": 0.07861217959173794}}
set_robot_commands_max0.09931351398599558
set_robot_commands_mean0.08690328128329303
set_robot_commands_median0.08338176287137546
set_robot_commands_min0.08129599017481651
sim_compute_performance-ego_max0.07097945542171083
sim_compute_performance-ego_mean0.06624160242363768
sim_compute_performance-ego_median0.06559086981273833
sim_compute_performance-ego_min0.0623777096088116
sim_compute_robot_state-ego_max0.07861217959173794
sim_compute_robot_state-ego_mean0.06950705292495656
sim_compute_robot_state-ego_median0.06790360327689879
sim_compute_robot_state-ego_min0.06540194841531607
sim_compute_sim_state_max0.03948378562927246
sim_compute_sim_state_mean0.03734051408071641
sim_compute_sim_state_median0.03733583976482523
sim_compute_sim_state_min0.03465456347311697
sim_physics_max0.11789335875675595
sim_physics_mean0.11034323900049528
sim_physics_median0.10933848789760044
sim_physics_min0.10555112746454054
sim_render-ego_max0.06605066924259581
sim_render-ego_mean0.05952374623219488
sim_render-ego_median0.05767253349567282
sim_render-ego_min0.0559467077255249
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3600000000000003
survival_time_min1.0500000000000005
241873979kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:09:06(hidden)
driven_lanedir_consec_median0.5023434565289406
survival_time_median4.199999999999993
deviation-center-line_median0.17507015629058817
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11996814182826453
agent_compute-ego_mean0.11802581095016124
agent_compute-ego_median0.11788666248321532
agent_compute-ego_min0.11695061789618598
deviation-center-line_max0.6460659939847264
deviation-center-line_mean0.25618809798806963
deviation-center-line_min0.07931830581813651
deviation-heading_max1.932506820469996
deviation-heading_mean1.3814352340891929
deviation-heading_median1.4178669878324306
deviation-heading_min0.8737860689832767
driven_any_max1.046072237588788
driven_any_mean0.5354377268924694
driven_any_median0.5434824197914987
driven_any_min0.1653078317781185
driven_lanedir_consec_max0.970354015928126
driven_lanedir_consec_mean0.4777915741225094
driven_lanedir_consec_min0.117287795145798
driven_lanedir_max0.970354015928126
driven_lanedir_mean0.4777915741225094
driven_lanedir_median0.5023434565289406
driven_lanedir_min0.117287795145798
in-drivable-lane_max0.10000000000000142
in-drivable-lane_mean0.020000000000000285
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.046072237588788, "sim_physics": 0.09292284695498916, "survival_time": 8.299999999999983, "driven_lanedir": 0.970354015928126, "sim_render-ego": 0.03603935816201819, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.11824099414319876, "deviation-heading": 1.932506820469996, "set_robot_commands": 0.054944651672639046, "deviation-center-line": 0.6460659939847264, "driven_lanedir_consec": 0.970354015928126, "sim_compute_sim_state": 0.022699883185237288, "sim_compute_performance-ego": 0.038999831820108806, "sim_compute_robot_state-ego": 0.04149222230336752, "sim_compute_robot_state-npc0": 0.04031713899359646, "sim_compute_robot_state-npc1": 0.03980569523501109, "sim_compute_robot_state-npc2": 0.03966030586196716, "sim_compute_robot_state-npc3": 0.0396460854863546}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.26011787173774675, "sim_physics": 0.09008729722764756, "survival_time": 2.25, "driven_lanedir": 0.19512641186752824, "sim_render-ego": 0.03647498024834527, "in-drivable-lane": 0, "agent_compute-ego": 0.11695061789618598, "deviation-heading": 1.4178669878324306, "set_robot_commands": 0.054578505622016056, "deviation-center-line": 0.1565201674570823, "driven_lanedir_consec": 0.19512641186752824, "sim_compute_sim_state": 0.022826284832424583, "sim_compute_performance-ego": 0.03861703872680664, "sim_compute_robot_state-ego": 0.04081703291998969, "sim_compute_robot_state-npc0": 0.04034141434563531, "sim_compute_robot_state-npc1": 0.03964693811204698, "sim_compute_robot_state-npc2": 0.0395911799536811, "sim_compute_robot_state-npc3": 0.03957157135009766}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6622082735661947, "sim_physics": 0.09127032106572933, "survival_time": 5.4999999999999885, "driven_lanedir": 0.6038461911421544, "sim_render-ego": 0.03614023598757657, "in-drivable-lane": 0, "agent_compute-ego": 0.11788666248321532, "deviation-heading": 1.610511938167705, "set_robot_commands": 0.055853204293684525, "deviation-center-line": 0.2239658663898147, "driven_lanedir_consec": 0.6038461911421544, "sim_compute_sim_state": 0.022744063897566363, "sim_compute_performance-ego": 0.038734514063054865, "sim_compute_robot_state-ego": 0.041424166072498665, "sim_compute_robot_state-npc0": 0.040476020899685945, "sim_compute_robot_state-npc1": 0.03985693237998269, "sim_compute_robot_state-npc2": 0.03962564034895463, "sim_compute_robot_state-npc3": 0.03992493369362571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5434824197914987, "sim_physics": 0.09146126679011754, "survival_time": 4.199999999999993, "driven_lanedir": 0.5023434565289406, "sim_render-ego": 0.03600750934510004, "in-drivable-lane": 0, "agent_compute-ego": 0.11996814182826453, "deviation-heading": 1.0725043549925544, "set_robot_commands": 0.054271590142023, "deviation-center-line": 0.17507015629058817, "driven_lanedir_consec": 0.5023434565289406, "sim_compute_sim_state": 0.02256264573051816, "sim_compute_performance-ego": 0.03905048540660313, "sim_compute_robot_state-ego": 0.040814073312850224, "sim_compute_robot_state-npc0": 0.04030875932602655, "sim_compute_robot_state-npc1": 0.03937436285473052, "sim_compute_robot_state-npc2": 0.03935809930165609, "sim_compute_robot_state-npc3": 0.03950704279400054}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1653078317781185, "sim_physics": 0.08979256664003644, "survival_time": 1.4000000000000006, "driven_lanedir": 0.117287795145798, "sim_render-ego": 0.035984422479357035, "in-drivable-lane": 0, "agent_compute-ego": 0.11708263839994158, "deviation-heading": 0.8737860689832767, "set_robot_commands": 0.05464962550571987, "deviation-center-line": 0.07931830581813651, "driven_lanedir_consec": 0.117287795145798, "sim_compute_sim_state": 0.022635800497872487, "sim_compute_performance-ego": 0.03843822649547032, "sim_compute_robot_state-ego": 0.0411829948425293, "sim_compute_robot_state-npc0": 0.04060364621026175, "sim_compute_robot_state-npc1": 0.040178963116237094, "sim_compute_robot_state-npc2": 0.03979051113128662, "sim_compute_robot_state-npc3": 0.03995045593806675}}
set_robot_commands_max0.055853204293684525
set_robot_commands_mean0.0548595154472165
set_robot_commands_median0.05464962550571987
set_robot_commands_min0.054271590142023
sim_compute_performance-ego_max0.03905048540660313
sim_compute_performance-ego_mean0.03876801930240875
sim_compute_performance-ego_median0.038734514063054865
sim_compute_performance-ego_min0.03843822649547032
sim_compute_robot_state-ego_max0.04149222230336752
sim_compute_robot_state-ego_mean0.04114609789024708
sim_compute_robot_state-ego_median0.0411829948425293
sim_compute_robot_state-ego_min0.040814073312850224
sim_compute_robot_state-npc0_max0.04060364621026175
sim_compute_robot_state-npc0_mean0.04040939595504121
sim_compute_robot_state-npc0_median0.04034141434563531
sim_compute_robot_state-npc0_min0.04030875932602655
sim_compute_robot_state-npc1_max0.040178963116237094
sim_compute_robot_state-npc1_mean0.03977257833960167
sim_compute_robot_state-npc1_median0.03980569523501109
sim_compute_robot_state-npc1_min0.03937436285473052
sim_compute_robot_state-npc2_max0.03979051113128662
sim_compute_robot_state-npc2_mean0.03960514731950912
sim_compute_robot_state-npc2_median0.03962564034895463
sim_compute_robot_state-npc2_min0.03935809930165609
sim_compute_robot_state-npc3_max0.03995045593806675
sim_compute_robot_state-npc3_mean0.039720017852429054
sim_compute_robot_state-npc3_median0.0396460854863546
sim_compute_robot_state-npc3_min0.03950704279400054
sim_compute_sim_state_max0.022826284832424583
sim_compute_sim_state_mean0.02269373562872378
sim_compute_sim_state_median0.022699883185237288
sim_compute_sim_state_min0.02256264573051816
sim_physics_max0.09292284695498916
sim_physics_mean0.091106859735704
sim_physics_median0.09127032106572933
sim_physics_min0.08979256664003644
sim_render-ego_max0.03647498024834527
sim_render-ego_mean0.036129301244479425
sim_render-ego_median0.03603935816201819
sim_render-ego_min0.035984422479357035
simulation-passed1
survival_time_max8.299999999999983
survival_time_mean4.329999999999993
survival_time_min1.4000000000000006
241823974ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:43(hidden)
driven_lanedir_consec_median0.06454460099062675
survival_time_median1.6000000000000008
deviation-center-line_median0.04275896688221893
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.10264609271082384
agent_compute-ego_mean0.09701086434879004
agent_compute-ego_median0.09594948830143098
agent_compute-ego_min0.09362062285928165
deviation-center-line_max0.13718448071669845
deviation-center-line_mean0.0684921545577323
deviation-center-line_min0.03871162596530647
deviation-heading_max2.735299351096212
deviation-heading_mean1.1074335531278754
deviation-heading_median0.7042447910838436
deviation-heading_min0.6427699281071828
driven_any_max0.8942512637639648
driven_any_mean0.31095777816370673
driven_any_median0.18824557338854264
driven_any_min0.08996491052944253
driven_lanedir_consec_max0.2292061820947371
driven_lanedir_consec_mean0.09472789098805764
driven_lanedir_consec_min0.04478126069436117
driven_lanedir_max0.2292061820947371
driven_lanedir_mean0.09472789098805764
driven_lanedir_median0.06454460099062675
driven_lanedir_min0.04478126069436117
in-drivable-lane_max3.5999999999999917
in-drivable-lane_mean1.0099999999999985
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8942512637639648, "sim_physics": 0.06372406071630017, "survival_time": 7.249999999999982, "driven_lanedir": 0.2292061820947371, "sim_render-ego": 0.03942658490148084, "in-drivable-lane": 3.5999999999999917, "agent_compute-ego": 0.10264609271082384, "deviation-heading": 2.735299351096212, "set_robot_commands": 0.057690580959977776, "deviation-center-line": 0.13718448071669845, "driven_lanedir_consec": 0.2292061820947371, "sim_compute_sim_state": 0.025390330676374764, "sim_compute_performance-ego": 0.04287418990299619, "sim_compute_robot_state-ego": 0.044683568230990706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19438136117780877, "sim_physics": 0.05683975359972786, "survival_time": 1.7000000000000008, "driven_lanedir": 0.08715643071703483, "sim_render-ego": 0.0353010191636927, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09362062285928165, "deviation-heading": 0.6989631533120237, "set_robot_commands": 0.05336518147412468, "deviation-center-line": 0.03871162596530647, "driven_lanedir_consec": 0.08715643071703483, "sim_compute_sim_state": 0.024535312372095445, "sim_compute_performance-ego": 0.038845034206614774, "sim_compute_robot_state-ego": 0.04095963870777803}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08996491052944253, "sim_physics": 0.05967116355895996, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0479509804435283, "sim_render-ego": 0.03548543076766165, "in-drivable-lane": 0, "agent_compute-ego": 0.095776357148823, "deviation-heading": 0.6427699281071828, "set_robot_commands": 0.05353345369037829, "deviation-center-line": 0.08216877498149172, "driven_lanedir_consec": 0.0479509804435283, "sim_compute_sim_state": 0.023606363095735248, "sim_compute_performance-ego": 0.03907295277244166, "sim_compute_robot_state-ego": 0.0411552253522371}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.187945781958775, "sim_physics": 0.06090966612100601, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04478126069436117, "sim_render-ego": 0.03618890792131424, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09706176072359084, "deviation-heading": 0.7558905420401153, "set_robot_commands": 0.057833969593048096, "deviation-center-line": 0.04275896688221893, "driven_lanedir_consec": 0.04478126069436117, "sim_compute_sim_state": 0.02339804172515869, "sim_compute_performance-ego": 0.03862155228853226, "sim_compute_robot_state-ego": 0.04078549146652222}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18824557338854264, "sim_physics": 0.06394163254768617, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06454460099062675, "sim_render-ego": 0.03665424162341702, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09594948830143098, "deviation-heading": 0.7042447910838436, "set_robot_commands": 0.05346919644263483, "deviation-center-line": 0.041636924242946, "driven_lanedir_consec": 0.06454460099062675, "sim_compute_sim_state": 0.023623074254681988, "sim_compute_performance-ego": 0.03946469676110052, "sim_compute_robot_state-ego": 0.04122935571978169}}
set_robot_commands_max0.057833969593048096
set_robot_commands_mean0.05517847643203273
set_robot_commands_median0.05353345369037829
set_robot_commands_min0.05336518147412468
sim_compute_performance-ego_max0.04287418990299619
sim_compute_performance-ego_mean0.03977568518633708
sim_compute_performance-ego_median0.03907295277244166
sim_compute_performance-ego_min0.03862155228853226
sim_compute_robot_state-ego_max0.044683568230990706
sim_compute_robot_state-ego_mean0.04176265589546194
sim_compute_robot_state-ego_median0.0411552253522371
sim_compute_robot_state-ego_min0.04078549146652222
sim_compute_sim_state_max0.025390330676374764
sim_compute_sim_state_mean0.024110624424809227
sim_compute_sim_state_median0.023623074254681988
sim_compute_sim_state_min0.02339804172515869
sim_physics_max0.06394163254768617
sim_physics_mean0.06101725530873603
sim_physics_median0.06090966612100601
sim_physics_min0.05683975359972786
sim_render-ego_max0.03942658490148084
sim_render-ego_mean0.036611236875513285
sim_render-ego_median0.03618890792131424
sim_render-ego_min0.0353010191636927
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean2.609999999999997
survival_time_min0.9500000000000004
241793971kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:00:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4608) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
241773969kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:31
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4800) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
241723961jagwarBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12910:17:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241713966ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:35
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241693962jagwarBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:03(hidden)
driven_lanedir_consec_median0.07551485562861782
survival_time_median1.4500000000000006
deviation-center-line_median0.09362617382590456
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.21044018350798507
agent_compute-ego_mean0.16529575799844107
agent_compute-ego_median0.15773930420746674
agent_compute-ego_min0.14487847915062538
deviation-center-line_max0.10260554899178596
deviation-center-line_mean0.07679947183624983
deviation-center-line_min0.03603645325283269
deviation-heading_max1.854935730405859
deviation-heading_mean0.883917892491068
deviation-heading_median0.6356811413845974
deviation-heading_min0.5751540795888518
driven_any_max0.5182735884865612
driven_any_mean0.2271955674033622
driven_any_median0.15661494768192794
driven_any_min0.11434936553255484
driven_lanedir_consec_max0.16492648525961995
driven_lanedir_consec_mean0.08926978947100114
driven_lanedir_consec_min0.05751065867736016
driven_lanedir_max0.16492648525961995
driven_lanedir_mean0.08926978947100114
driven_lanedir_median0.07551485562861782
driven_lanedir_min0.05751065867736016
in-drivable-lane_max1.9999999999999971
in-drivable-lane_mean0.6599999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2162076641094172, "sim_physics": 0.17249367043778702, "survival_time": 1.850000000000001, "driven_lanedir": 0.060893961810018826, "sim_render-ego": 0.06005472750277133, "in-drivable-lane": 0.8000000000000007, "agent_compute-ego": 0.15773930420746674, "deviation-heading": 0.6183161015648596, "set_robot_commands": 0.09144973754882812, "deviation-center-line": 0.05549402521811258, "driven_lanedir_consec": 0.060893961810018826, "sim_compute_sim_state": 0.036435024158374685, "sim_compute_performance-ego": 0.06896498396589949, "sim_compute_robot_state-ego": 0.06950143865636878, "sim_compute_robot_state-npc0": 0.06540289440670528, "sim_compute_robot_state-npc1": 0.06594462652464171, "sim_compute_robot_state-npc2": 0.06822528065861883, "sim_compute_robot_state-npc3": 0.06705717138341956}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5182735884865612, "sim_physics": 0.16015451333739542, "survival_time": 4.399999999999992, "driven_lanedir": 0.16492648525961995, "sim_render-ego": 0.06261696056886153, "in-drivable-lane": 1.9999999999999971, "agent_compute-ego": 0.15538633953441272, "deviation-heading": 1.854935730405859, "set_robot_commands": 0.09187248078259556, "deviation-center-line": 0.0962351578926134, "driven_lanedir_consec": 0.16492648525961995, "sim_compute_sim_state": 0.03823161937973716, "sim_compute_performance-ego": 0.06774818626317111, "sim_compute_robot_state-ego": 0.07197147878733548, "sim_compute_robot_state-npc0": 0.06710418516939337, "sim_compute_robot_state-npc1": 0.06846741925586354, "sim_compute_robot_state-npc2": 0.06601326844908974, "sim_compute_robot_state-npc3": 0.0649129558693279}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11434936553255484, "sim_physics": 0.16921517252922058, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07551485562861782, "sim_render-ego": 0.0635385513305664, "in-drivable-lane": 0, "agent_compute-ego": 0.15803448359171549, "deviation-heading": 0.6356811413845974, "set_robot_commands": 0.09147721529006958, "deviation-center-line": 0.10260554899178596, "driven_lanedir_consec": 0.07551485562861782, "sim_compute_sim_state": 0.038631935914357506, "sim_compute_performance-ego": 0.06741986672083537, "sim_compute_robot_state-ego": 0.07049128413200378, "sim_compute_robot_state-npc0": 0.06994844476381938, "sim_compute_robot_state-npc1": 0.060924917459487915, "sim_compute_robot_state-npc2": 0.06348322828610738, "sim_compute_robot_state-npc3": 0.06721251209576924}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13053227120634986, "sim_physics": 0.17430565907404974, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08750298597938899, "sim_render-ego": 0.054193927691533014, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14487847915062538, "deviation-heading": 0.5751540795888518, "set_robot_commands": 0.08117404350867638, "deviation-center-line": 0.09362617382590456, "driven_lanedir_consec": 0.08750298597938899, "sim_compute_sim_state": 0.03716414708357591, "sim_compute_performance-ego": 0.06306320887345535, "sim_compute_robot_state-ego": 0.06506070723900428, "sim_compute_robot_state-npc0": 0.06549240992619441, "sim_compute_robot_state-npc1": 0.06359499234419602, "sim_compute_robot_state-npc2": 0.060685579593365006, "sim_compute_robot_state-npc3": 0.06601856305049016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.15661494768192794, "sim_physics": 0.18751576851154195, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05751065867736016, "sim_render-ego": 0.06519345579476192, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.21044018350798507, "deviation-heading": 0.7355024095111723, "set_robot_commands": 0.10136878901514514, "deviation-center-line": 0.03603645325283269, "driven_lanedir_consec": 0.05751065867736016, "sim_compute_sim_state": 0.04110631449469205, "sim_compute_performance-ego": 0.07505028001193342, "sim_compute_robot_state-ego": 0.07901070035737136, "sim_compute_robot_state-npc0": 0.06968087163464777, "sim_compute_robot_state-npc1": 0.0711324379361909, "sim_compute_robot_state-npc2": 0.07002425193786621, "sim_compute_robot_state-npc3": 0.07170964109486547}}
set_robot_commands_max0.10136878901514514
set_robot_commands_mean0.09146845322906295
set_robot_commands_median0.09147721529006958
set_robot_commands_min0.08117404350867638
sim_compute_performance-ego_max0.07505028001193342
sim_compute_performance-ego_mean0.06844930516705895
sim_compute_performance-ego_median0.06774818626317111
sim_compute_performance-ego_min0.06306320887345535
sim_compute_robot_state-ego_max0.07901070035737136
sim_compute_robot_state-ego_mean0.07120712183441673
sim_compute_robot_state-ego_median0.07049128413200378
sim_compute_robot_state-ego_min0.06506070723900428
sim_compute_robot_state-npc0_max0.06994844476381938
sim_compute_robot_state-npc0_mean0.06752576118015205
sim_compute_robot_state-npc0_median0.06710418516939337
sim_compute_robot_state-npc0_min0.06540289440670528
sim_compute_robot_state-npc1_max0.0711324379361909
sim_compute_robot_state-npc1_mean0.06601287870407602
sim_compute_robot_state-npc1_median0.06594462652464171
sim_compute_robot_state-npc1_min0.060924917459487915
sim_compute_robot_state-npc2_max0.07002425193786621
sim_compute_robot_state-npc2_mean0.06568632178500942
sim_compute_robot_state-npc2_median0.06601326844908974
sim_compute_robot_state-npc2_min0.060685579593365006
sim_compute_robot_state-npc3_max0.07170964109486547
sim_compute_robot_state-npc3_mean0.06738216869877448
sim_compute_robot_state-npc3_median0.06705717138341956
sim_compute_robot_state-npc3_min0.0649129558693279
sim_compute_sim_state_max0.04110631449469205
sim_compute_sim_state_mean0.03831380820614746
sim_compute_sim_state_median0.03823161937973716
sim_compute_sim_state_min0.036435024158374685
sim_physics_max0.18751576851154195
sim_physics_mean0.17273695677799894
sim_physics_median0.17249367043778702
sim_physics_min0.16015451333739542
sim_render-ego_max0.06519345579476192
sim_render-ego_mean0.06111952457769885
sim_render-ego_median0.06261696056886153
sim_render-ego_min0.054193927691533014
simulation-passed1
survival_time_max4.399999999999992
survival_time_mean2.0399999999999987
survival_time_min1.2000000000000004
241543944InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:05:29(hidden)
driven_lanedir_consec_median0.08313679214764313
survival_time_median1.1500000000000004
deviation-center-line_median0.05876755694249432
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1322025838105575
agent_compute-ego_mean0.11348315787557256
agent_compute-ego_median0.11086433584039862
agent_compute-ego_min0.09711940629141672
deviation-center-line_max0.0954786649471541
deviation-center-line_mean0.0712095432582611
deviation-center-line_min0.05147641233064459
deviation-heading_max0.822270867916417
deviation-heading_mean0.627217952569668
deviation-heading_median0.6947115697194624
deviation-heading_min0.4579813273097649
driven_any_max0.2192646210647059
driven_any_mean0.1668771647442949
driven_any_median0.1505766847907309
driven_any_min0.13394597652044343
driven_lanedir_consec_max0.12025014518972688
driven_lanedir_consec_mean0.08779264078422662
driven_lanedir_consec_min0.050553337459390946
driven_lanedir_max0.12025014518972688
driven_lanedir_mean0.08779264078422662
driven_lanedir_median0.08313679214764313
driven_lanedir_min0.050553337459390946
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2400000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2192646210647059, "sim_physics": 0.09794654846191406, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08313679214764313, "sim_render-ego": 0.0365788459777832, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09711940629141672, "deviation-heading": 0.6947115697194624, "set_robot_commands": 0.0547999586377825, "deviation-center-line": 0.05876755694249432, "driven_lanedir_consec": 0.08313679214764313, "sim_compute_sim_state": 0.022591045924595425, "sim_compute_performance-ego": 0.0385108402797154, "sim_compute_robot_state-ego": 0.040706239427839006, "sim_compute_robot_state-npc0": 0.03998299326215472, "sim_compute_robot_state-npc1": 0.039105074746268134, "sim_compute_robot_state-npc2": 0.03918213163103376, "sim_compute_robot_state-npc3": 0.039157928739275254}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1915377963714012, "sim_physics": 0.11220358264061712, "survival_time": 1.5500000000000007, "driven_lanedir": 0.050553337459390946, "sim_render-ego": 0.03869945772232548, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.10825558631650864, "deviation-heading": 0.6972776593519882, "set_robot_commands": 0.05981957527898973, "deviation-center-line": 0.05147641233064459, "driven_lanedir_consec": 0.050553337459390946, "sim_compute_sim_state": 0.024571134198096492, "sim_compute_performance-ego": 0.04232408154395319, "sim_compute_robot_state-ego": 0.04705765170435752, "sim_compute_robot_state-npc0": 0.04559149280671151, "sim_compute_robot_state-npc1": 0.04363249963329685, "sim_compute_robot_state-npc2": 0.04406344506048387, "sim_compute_robot_state-npc3": 0.04362785431646531}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1390607449741929, "sim_physics": 0.12688942389054733, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10659137206139936, "sim_render-ego": 0.04551098563454368, "in-drivable-lane": 0, "agent_compute-ego": 0.11086433584039862, "deviation-heading": 0.4579813273097649, "set_robot_commands": 0.06134886091405695, "deviation-center-line": 0.0954786649471541, "driven_lanedir_consec": 0.10659137206139936, "sim_compute_sim_state": 0.025090412660078568, "sim_compute_performance-ego": 0.04613850333473899, "sim_compute_robot_state-ego": 0.04889296401630749, "sim_compute_robot_state-npc0": 0.04711407964879816, "sim_compute_robot_state-npc1": 0.04357458244670521, "sim_compute_robot_state-npc2": 0.04197911782698198, "sim_compute_robot_state-npc3": 0.04244598475369541}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1505766847907309, "sim_physics": 0.141264241674672, "survival_time": 1.1500000000000004, "driven_lanedir": 0.12025014518972688, "sim_render-ego": 0.04531386624211851, "in-drivable-lane": 0, "agent_compute-ego": 0.1189738771189814, "deviation-heading": 0.4638483385507074, "set_robot_commands": 0.0656194894210152, "deviation-center-line": 0.09311933836637463, "driven_lanedir_consec": 0.12025014518972688, "sim_compute_sim_state": 0.0289258334947669, "sim_compute_performance-ego": 0.05029367363971213, "sim_compute_robot_state-ego": 0.053218654964281166, "sim_compute_robot_state-npc0": 0.0503316651219907, "sim_compute_robot_state-npc1": 0.05206584930419922, "sim_compute_robot_state-npc2": 0.04978123955104662, "sim_compute_robot_state-npc3": 0.04938323601432469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13394597652044343, "sim_physics": 0.11948242394820505, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07843155706297278, "sim_render-ego": 0.04875115726305091, "in-drivable-lane": 0, "agent_compute-ego": 0.1322025838105575, "deviation-heading": 0.822270867916417, "set_robot_commands": 0.07180532165195631, "deviation-center-line": 0.057205743704637824, "driven_lanedir_consec": 0.07843155706297278, "sim_compute_sim_state": 0.029245127802309784, "sim_compute_performance-ego": 0.05332376645958942, "sim_compute_robot_state-ego": 0.05393238689588464, "sim_compute_robot_state-npc0": 0.05342482483905295, "sim_compute_robot_state-npc1": 0.05180203396341075, "sim_compute_robot_state-npc2": 0.05104405983634617, "sim_compute_robot_state-npc3": 0.05008102499920389}}
set_robot_commands_max0.07180532165195631
set_robot_commands_mean0.06267864118076014
set_robot_commands_median0.06134886091405695
set_robot_commands_min0.0547999586377825
sim_compute_performance-ego_max0.05332376645958942
sim_compute_performance-ego_mean0.046118173051541825
sim_compute_performance-ego_median0.04613850333473899
sim_compute_performance-ego_min0.0385108402797154
sim_compute_robot_state-ego_max0.05393238689588464
sim_compute_robot_state-ego_mean0.048761579401733965
sim_compute_robot_state-ego_median0.04889296401630749
sim_compute_robot_state-ego_min0.040706239427839006
sim_compute_robot_state-npc0_max0.05342482483905295
sim_compute_robot_state-npc0_mean0.0472890111357416
sim_compute_robot_state-npc0_median0.04711407964879816
sim_compute_robot_state-npc0_min0.03998299326215472
sim_compute_robot_state-npc1_max0.05206584930419922
sim_compute_robot_state-npc1_mean0.04603600801877603
sim_compute_robot_state-npc1_median0.04363249963329685
sim_compute_robot_state-npc1_min0.039105074746268134
sim_compute_robot_state-npc2_max0.05104405983634617
sim_compute_robot_state-npc2_mean0.04520999878117848
sim_compute_robot_state-npc2_median0.04406344506048387
sim_compute_robot_state-npc2_min0.03918213163103376
sim_compute_robot_state-npc3_max0.05008102499920389
sim_compute_robot_state-npc3_mean0.044939205764592906
sim_compute_robot_state-npc3_median0.04362785431646531
sim_compute_robot_state-npc3_min0.039157928739275254
sim_compute_sim_state_max0.029245127802309784
sim_compute_sim_state_mean0.026084710815969435
sim_compute_sim_state_median0.025090412660078568
sim_compute_sim_state_min0.022591045924595425
sim_physics_max0.141264241674672
sim_physics_mean0.1195572441231911
sim_physics_median0.11948242394820505
sim_physics_min0.09794654846191406
sim_render-ego_max0.04875115726305091
sim_render-ego_mean0.042970862567964355
sim_render-ego_median0.04531386624211851
sim_render-ego_min0.0365788459777832
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.3400000000000003
survival_time_min1.1000000000000003
241503940kene4192CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:04:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241433936kene4192CNN-Adam-More-Data-Less-One-300aido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12910:37:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241413928gadeseaido_LF-tensorflow_modifaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:14:04(hidden)
driven_lanedir_consec_median0
survival_time_median14.950000000000076
deviation-center-line_median0.8791250519425075
in-drivable-lane_median0


other stats
agent_compute-ego_max0.07758502960205078
agent_compute-ego_mean0.07594386688868204
agent_compute-ego_median0.07615749994913737
agent_compute-ego_min0.07480955441792805
deviation-center-line_max1.1518259299248657
deviation-center-line_mean0.7501216125180884
deviation-center-line_min0.25213161298160436
deviation-heading_max4.612311799738734
deviation-heading_mean2.597716698919712
deviation-heading_median2.4213367613149206
deviation-heading_min1.055344347110816
driven_any_max1.328474932138796e-13
driven_any_mean2.656949864277592e-14
driven_any_median0
driven_any_min0
driven_lanedir_consec_max0
driven_lanedir_consec_mean0
driven_lanedir_consec_min0
driven_lanedir_max0
driven_lanedir_mean0
driven_lanedir_median0
driven_lanedir_min0
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.328474932138796e-13, "sim_physics": 0.054884865283966064, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.036498675346374514, "in-drivable-lane": 0, "agent_compute-ego": 0.07492612361907959, "deviation-heading": 1.3094334271540409, "set_robot_commands": 0.054569859504699704, "deviation-center-line": 1.1518259299248657, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02300134261449178, "sim_compute_performance-ego": 0.03879517237345378, "sim_compute_robot_state-ego": 0.04059458573659261}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0, "sim_physics": 0.05530176957448323, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035991378625233966, "in-drivable-lane": 0, "agent_compute-ego": 0.07615749994913737, "deviation-heading": 2.4213367613149206, "set_robot_commands": 0.053935476144154865, "deviation-center-line": 0.25213161298160436, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02387633005777995, "sim_compute_performance-ego": 0.03908871094385783, "sim_compute_robot_state-ego": 0.04032535711924235}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0, "sim_physics": 0.054826050599416094, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.035448341369628905, "in-drivable-lane": 0, "agent_compute-ego": 0.07480955441792805, "deviation-heading": 3.590157159280048, "set_robot_commands": 0.0554386830329895, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02298421541849772, "sim_compute_performance-ego": 0.03877959648768107, "sim_compute_robot_state-ego": 0.04022638479868571}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0, "sim_physics": 0.057835851510365806, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03584970633188884, "in-drivable-lane": 0, "agent_compute-ego": 0.07624112685521443, "deviation-heading": 4.612311799738734, "set_robot_commands": 0.054311936696370446, "deviation-center-line": 0.9357839616685772, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.022914016246795656, "sim_compute_performance-ego": 0.03859936396280925, "sim_compute_robot_state-ego": 0.04024292627970378}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0, "sim_physics": 0.05806056976318359, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03616939465204875, "in-drivable-lane": 0, "agent_compute-ego": 0.07758502960205078, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.055087499618530274, "deviation-center-line": 0.5317415060728867, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02302017688751221, "sim_compute_performance-ego": 0.03873713175455729, "sim_compute_robot_state-ego": 0.04032743295033773}}
set_robot_commands_max0.0554386830329895
set_robot_commands_mean0.05466869099934896
set_robot_commands_median0.054569859504699704
set_robot_commands_min0.053935476144154865
sim_compute_performance-ego_max0.03908871094385783
sim_compute_performance-ego_mean0.03879999510447184
sim_compute_performance-ego_median0.03877959648768107
sim_compute_performance-ego_min0.03859936396280925
sim_compute_robot_state-ego_max0.04059458573659261
sim_compute_robot_state-ego_mean0.04034333737691243
sim_compute_robot_state-ego_median0.04032535711924235
sim_compute_robot_state-ego_min0.04022638479868571
sim_compute_sim_state_max0.02387633005777995
sim_compute_sim_state_mean0.023159216245015463
sim_compute_sim_state_median0.02300134261449178
sim_compute_sim_state_min0.022914016246795656
sim_physics_max0.05806056976318359
sim_physics_mean0.056181821346282954
sim_physics_median0.05530176957448323
sim_physics_min0.054826050599416094
sim_render-ego_max0.036498675346374514
sim_render-ego_mean0.03599149926503499
sim_render-ego_median0.035991378625233966
sim_render-ego_min0.035448341369628905
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
241363919ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:00:47
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241353925ekunniiBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:02:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241313916gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:00:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241303915gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:00:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241273912gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12910:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241063901gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:01:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241023904gadesechallenge-aido_LF-template-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12910:03:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
240963894chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12910:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240913889kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:10:20(hidden)
driven_lanedir_consec_median0.45666589362836785
survival_time_median5.449999999999989
deviation-center-line_median0.25332645511657703
in-drivable-lane_median1.7499999999999938


other stats
agent_compute-ego_max0.10970165068844714
agent_compute-ego_mean0.10797798669116215
agent_compute-ego_median0.10751995252906728
agent_compute-ego_min0.10630135938345668
deviation-center-line_max0.4425928614168368
deviation-center-line_mean0.2608568329442013
deviation-center-line_min0.13996123501341126
deviation-heading_max2.4759093115044557
deviation-heading_mean1.3592444529938548
deviation-heading_median1.0383502495387735
deviation-heading_min0.8804169749426534
driven_any_max1.0912724466754036
driven_any_mean0.8134022489246592
driven_any_median0.7715990675788054
driven_any_min0.5869546514040958
driven_lanedir_consec_max0.686747113215187
driven_lanedir_consec_mean0.4646650979244666
driven_lanedir_consec_min0.27134103181085756
driven_lanedir_max0.6897013567087782
driven_lanedir_mean0.46584152187477573
driven_lanedir_median0.45666589362836785
driven_lanedir_min0.27134103181085756
in-drivable-lane_max2.3499999999999917
in-drivable-lane_mean1.8299999999999936
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0912724466754036, "sim_physics": 0.08685293855338261, "survival_time": 7.249999999999982, "driven_lanedir": 0.6370399227084125, "sim_render-ego": 0.03625481046479324, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.1068322494112212, "deviation-heading": 1.3970386661756726, "set_robot_commands": 0.05478235935342723, "deviation-center-line": 0.3227088214526142, "driven_lanedir_consec": 0.6341120464504577, "sim_compute_sim_state": 0.023101074942227063, "sim_compute_performance-ego": 0.038954968288027005, "sim_compute_robot_state-ego": 0.041509669402550006, "sim_compute_robot_state-npc0": 0.040779094038338494, "sim_compute_robot_state-npc1": 0.040366661137547985, "sim_compute_robot_state-npc2": 0.04013377222521552, "sim_compute_robot_state-npc3": 0.04015175885167615}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7715990675788054, "sim_physics": 0.09906378142330624, "survival_time": 5.449999999999989, "driven_lanedir": 0.45666589362836785, "sim_render-ego": 0.036337299084444656, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.10751995252906728, "deviation-heading": 0.8804169749426534, "set_robot_commands": 0.056602659575436094, "deviation-center-line": 0.25332645511657703, "driven_lanedir_consec": 0.45666589362836785, "sim_compute_sim_state": 0.023046224489124544, "sim_compute_performance-ego": 0.03904854923213294, "sim_compute_robot_state-ego": 0.04160633218397788, "sim_compute_robot_state-npc0": 0.041497832044548946, "sim_compute_robot_state-npc1": 0.04037978452280027, "sim_compute_robot_state-npc2": 0.04032363804108506, "sim_compute_robot_state-npc3": 0.04037997700752468}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5870196211677848, "sim_physics": 0.084742609276829, "survival_time": 4.149999999999993, "driven_lanedir": 0.27134103181085756, "sim_render-ego": 0.03555839320263231, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10630135938345668, "deviation-heading": 1.0383502495387735, "set_robot_commands": 0.053939555064741386, "deviation-center-line": 0.14569479172156735, "driven_lanedir_consec": 0.27134103181085756, "sim_compute_sim_state": 0.023113948753081173, "sim_compute_performance-ego": 0.03875514685389507, "sim_compute_robot_state-ego": 0.04140622931790639, "sim_compute_robot_state-npc0": 0.040646981043987965, "sim_compute_robot_state-npc1": 0.040715415793729115, "sim_compute_robot_state-npc2": 0.03999407607388784, "sim_compute_robot_state-npc3": 0.04013380372380636}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5869546514040958, "sim_physics": 0.08696071498365288, "survival_time": 4.149999999999993, "driven_lanedir": 0.2744594045174624, "sim_render-ego": 0.03662548294986587, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.10970165068844714, "deviation-heading": 1.0045070628077175, "set_robot_commands": 0.05427464232387313, "deviation-center-line": 0.13996123501341126, "driven_lanedir_consec": 0.2744594045174624, "sim_compute_sim_state": 0.02354213128606957, "sim_compute_performance-ego": 0.03947412249553634, "sim_compute_robot_state-ego": 0.04214339371187141, "sim_compute_robot_state-npc0": 0.0413097559687603, "sim_compute_robot_state-npc1": 0.041119397404682206, "sim_compute_robot_state-npc2": 0.04079440990126276, "sim_compute_robot_state-npc3": 0.04087833324110651}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0301654577972064, "sim_physics": 0.08793604719466057, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6897013567087782, "sim_render-ego": 0.03670671884564386, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10953472144361856, "deviation-heading": 2.4759093115044557, "set_robot_commands": 0.05552416953487672, "deviation-center-line": 0.4425928614168368, "driven_lanedir_consec": 0.686747113215187, "sim_compute_sim_state": 0.02330841707146686, "sim_compute_performance-ego": 0.039201212965923805, "sim_compute_robot_state-ego": 0.041675386221512505, "sim_compute_robot_state-npc0": 0.041089653968811035, "sim_compute_robot_state-npc1": 0.04058444327202397, "sim_compute_robot_state-npc2": 0.04051257389179175, "sim_compute_robot_state-npc3": 0.040469242178875466}}
set_robot_commands_max0.056602659575436094
set_robot_commands_mean0.05502467717047091
set_robot_commands_median0.05478235935342723
set_robot_commands_min0.053939555064741386
sim_compute_performance-ego_max0.03947412249553634
sim_compute_performance-ego_mean0.03908679996710303
sim_compute_performance-ego_median0.03904854923213294
sim_compute_performance-ego_min0.03875514685389507
sim_compute_robot_state-ego_max0.04214339371187141
sim_compute_robot_state-ego_mean0.04166820216756364
sim_compute_robot_state-ego_median0.04160633218397788
sim_compute_robot_state-ego_min0.04140622931790639
sim_compute_robot_state-npc0_max0.041497832044548946
sim_compute_robot_state-npc0_mean0.04106466341288935
sim_compute_robot_state-npc0_median0.041089653968811035
sim_compute_robot_state-npc0_min0.040646981043987965
sim_compute_robot_state-npc1_max0.041119397404682206
sim_compute_robot_state-npc1_mean0.040633140426156705
sim_compute_robot_state-npc1_median0.04058444327202397
sim_compute_robot_state-npc1_min0.040366661137547985
sim_compute_robot_state-npc2_max0.04079440990126276
sim_compute_robot_state-npc2_mean0.04035169402664858
sim_compute_robot_state-npc2_median0.04032363804108506
sim_compute_robot_state-npc2_min0.03999407607388784
sim_compute_robot_state-npc3_max0.04087833324110651
sim_compute_robot_state-npc3_mean0.04040262300059783
sim_compute_robot_state-npc3_median0.04037997700752468
sim_compute_robot_state-npc3_min0.04013380372380636
sim_compute_sim_state_max0.02354213128606957
sim_compute_sim_state_mean0.023222359308393843
sim_compute_sim_state_median0.023113948753081173
sim_compute_sim_state_min0.023046224489124544
sim_physics_max0.09906378142330624
sim_physics_mean0.08911121828636627
sim_physics_median0.08696071498365288
sim_physics_min0.084742609276829
sim_render-ego_max0.03670671884564386
sim_render-ego_mean0.03629654090947598
sim_render-ego_median0.036337299084444656
sim_render-ego_min0.03555839320263231
simulation-passed1
survival_time_max7.249999999999982
survival_time_mean5.5799999999999885
survival_time_min4.149999999999993
240903881chuyjBaseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12910:08:28(hidden)
driven_lanedir_consec_median0.09300630371175034
survival_time_median1.3500000000000003
deviation-center-line_median0.07026189516599242
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14801534016927084
agent_compute-ego_mean0.1253962636023895
agent_compute-ego_median0.12913731166294642
agent_compute-ego_min0.10698240995407104
deviation-center-line_max0.10994671013441548
deviation-center-line_mean0.07308725720183315
deviation-center-line_min0.036299447868137776
deviation-heading_max0.8879303311639637
deviation-heading_mean0.7031357916312373
deviation-heading_median0.7370462562658814
deviation-heading_min0.44449776512206174
driven_any_max0.2469379752413027
driven_any_mean0.16418076521060082
driven_any_median0.16197115773273257
driven_any_min0.10289015653777456
driven_lanedir_consec_max0.13014387086739854
driven_lanedir_consec_mean0.09023606361011167
driven_lanedir_consec_min0.06403097401086644
driven_lanedir_max0.13014387086739854
driven_lanedir_mean0.09023606361011167
driven_lanedir_median0.09300630371175034
driven_lanedir_min0.06403097401086644
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.2033333333333335
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2469379752413027, "sim_physics": 0.086747828282808, "survival_time": 1.900000000000001, "driven_lanedir": 0.11354785188431515, "sim_render-ego": 0.046632547127573115, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13183859774940893, "deviation-heading": 0.7856156369263251, "set_robot_commands": 0.07214874970285516, "deviation-center-line": 0.07026189516599242, "driven_lanedir_consec": 0.11354785188431515, "sim_compute_sim_state": 0.029638911548413728, "sim_compute_performance-ego": 0.04857612283606278, "sim_compute_robot_state-ego": 0.05137309902592709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19572712360742137, "sim_physics": 0.07790074926434142, "survival_time": 1.6500000000000008, "driven_lanedir": 0.10740086241935388, "sim_render-ego": 0.0467098770719586, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12172386863014915, "deviation-heading": 0.7370462562658814, "set_robot_commands": 0.07589691335504706, "deviation-center-line": 0.045483793290576384, "driven_lanedir_consec": 0.10740086241935388, "sim_compute_sim_state": 0.029599348704020183, "sim_compute_performance-ego": 0.05294145959796327, "sim_compute_robot_state-ego": 0.05197790174773245}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10584939081680976, "sim_physics": 0.07113023996353149, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06829141196592747, "sim_render-ego": 0.03653477430343628, "in-drivable-lane": 0, "agent_compute-ego": 0.10811865329742432, "deviation-heading": 0.6178428375857117, "set_robot_commands": 0.06227314472198486, "deviation-center-line": 0.09007528077482532, "driven_lanedir_consec": 0.06829141196592747, "sim_compute_sim_state": 0.02512909173965454, "sim_compute_performance-ego": 0.04211246967315674, "sim_compute_robot_state-ego": 0.04441527128219605}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19981989687228763, "sim_physics": 0.08635971695184708, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07162783241331594, "sim_render-ego": 0.039785005152225494, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.10698240995407104, "deviation-heading": 0.8879303311639637, "set_robot_commands": 0.059373125433921814, "deviation-center-line": 0.056089002240840825, "driven_lanedir_consec": 0.07162783241331594, "sim_compute_sim_state": 0.02523992210626602, "sim_compute_performance-ego": 0.04368913173675537, "sim_compute_robot_state-ego": 0.0512683242559433}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1882671163422387, "sim_physics": 0.09761250681347317, "survival_time": 1.800000000000001, "driven_lanedir": 0.0710868958526154, "sim_render-ego": 0.05024376180436877, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13688632514741686, "deviation-heading": 0.6237244123429082, "set_robot_commands": 0.0745668543709649, "deviation-center-line": 0.036299447868137776, "driven_lanedir_consec": 0.0710868958526154, "sim_compute_sim_state": 0.04544980658425225, "sim_compute_performance-ego": 0.05491766002443102, "sim_compute_robot_state-ego": 0.056443783971998424}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.20666279677098, "sim_physics": 0.07772032419840495, "survival_time": 1.6500000000000008, "driven_lanedir": 0.06403097401086644, "sim_render-ego": 0.04247909603696881, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.1133374734358354, "deviation-heading": 0.8799366941227552, "set_robot_commands": 0.06122269774928237, "deviation-center-line": 0.05992367774039761, "driven_lanedir_consec": 0.06403097401086644, "sim_compute_sim_state": 0.026656663779056435, "sim_compute_performance-ego": 0.044763312195286606, "sim_compute_robot_state-ego": 0.04626092766270493}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14433723356179745, "sim_physics": 0.08459572281156268, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1040498411435844, "sim_render-ego": 0.043480822018214633, "in-drivable-lane": 0, "agent_compute-ego": 0.12913731166294642, "deviation-heading": 0.7314277977076952, "set_robot_commands": 0.06925622054508754, "deviation-center-line": 0.10599987205296645, "driven_lanedir_consec": 0.1040498411435844, "sim_compute_sim_state": 0.02863689831324986, "sim_compute_performance-ego": 0.04932528734207153, "sim_compute_robot_state-ego": 0.05071265356881278}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10289015653777456, "sim_physics": 0.07960901762309827, "survival_time": 0.9500000000000004, "driven_lanedir": 0.0678830990979673, "sim_render-ego": 0.05772904345863744, "in-drivable-lane": 0, "agent_compute-ego": 0.13322172666850843, "deviation-heading": 0.5648891662813488, "set_robot_commands": 0.06689288741663883, "deviation-center-line": 0.0795382497762156, "driven_lanedir_consec": 0.0678830990979673, "sim_compute_sim_state": 0.0344229120957224, "sim_compute_performance-ego": 0.06015332121598093, "sim_compute_robot_state-ego": 0.05611028169330798}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14464565765338278, "sim_physics": 0.08210282855563694, "survival_time": 1.3500000000000003, "driven_lanedir": 0.0758055641320925, "sim_render-ego": 0.05060914710715965, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.13717630174424914, "deviation-heading": 0.7936379391592215, "set_robot_commands": 0.07092245419820149, "deviation-center-line": 0.0488344749801295, "driven_lanedir_consec": 0.0758055641320925, "sim_compute_sim_state": 0.032085816065470375, "sim_compute_performance-ego": 0.05226207662511755, "sim_compute_robot_state-ego": 0.05526671586213289}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1328319597501586, "sim_physics": 0.09062718351682028, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09366638770493108, "sim_render-ego": 0.0475704570611318, "in-drivable-lane": 0, "agent_compute-ego": 0.14801534016927084, "deviation-heading": 0.626366363066711, "set_robot_commands": 0.07677748799324036, "deviation-center-line": 0.08333870695408575, "driven_lanedir_consec": 0.09366638770493108, "sim_compute_sim_state": 0.030582964420318604, "sim_compute_performance-ego": 0.048565427462259926, "sim_compute_robot_state-ego": 0.05036798119544983}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16197115773273257, "sim_physics": 0.0935445785522461, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13014387086739854, "sim_render-ego": 0.048301477432250974, "in-drivable-lane": 0, "agent_compute-ego": 0.1326344108581543, "deviation-heading": 0.5084743744419903, "set_robot_commands": 0.07192572593688965, "deviation-center-line": 0.10994671013441548, "driven_lanedir_consec": 0.13014387086739854, "sim_compute_sim_state": 0.03314057350158692, "sim_compute_performance-ego": 0.05167938232421875, "sim_compute_robot_state-ego": 0.0529127025604248}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.12374095271042829, "sim_physics": 0.08472345272699992, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06771510962277494, "sim_render-ego": 0.0476699968179067, "in-drivable-lane": 0, "agent_compute-ego": 0.11551529169082642, "deviation-heading": 0.8089737931429815, "set_robot_commands": 0.06218854586283366, "deviation-center-line": 0.07620363543986901, "driven_lanedir_consec": 0.06771510962277494, "sim_compute_sim_state": 0.02895253896713257, "sim_compute_performance-ego": 0.05052704612414042, "sim_compute_robot_state-ego": 0.054268101851145424}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.2262700823731645, "sim_physics": 0.07529842853546143, "survival_time": 1.800000000000001, "driven_lanedir": 0.10983855690349932, "sim_render-ego": 0.043977591726515025, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11579836739434136, "deviation-heading": 0.7654963773468593, "set_robot_commands": 0.060591565238104925, "deviation-center-line": 0.061983761828166874, "driven_lanedir_consec": 0.10983855690349932, "sim_compute_sim_state": 0.028356975979275174, "sim_compute_performance-ego": 0.049280908372667104, "sim_compute_robot_state-ego": 0.05036523607042101}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16596450105613075, "sim_physics": 0.08287342071533203, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11544639242128252, "sim_render-ego": 0.04659250259399414, "in-drivable-lane": 0, "agent_compute-ego": 0.1295858383178711, "deviation-heading": 0.7711771297921475, "set_robot_commands": 0.07684094429016114, "deviation-center-line": 0.06353009651971579, "driven_lanedir_consec": 0.11544639242128252, "sim_compute_sim_state": 0.03306610107421875, "sim_compute_performance-ego": 0.0525583553314209, "sim_compute_robot_state-ego": 0.05170239448547363}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.11679547713240308, "sim_physics": 0.08638334274291992, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09300630371175034, "sim_render-ego": 0.04657817970622669, "in-drivable-lane": 0, "agent_compute-ego": 0.12097203731536864, "deviation-heading": 0.44449776512206174, "set_robot_commands": 0.06690068678422408, "deviation-center-line": 0.10880025326116258, "driven_lanedir_consec": 0.09300630371175034, "sim_compute_sim_state": 0.03095875003121116, "sim_compute_performance-ego": 0.05211740190332586, "sim_compute_robot_state-ego": 0.05258902636441318}}
set_robot_commands_max0.07684094429016114
set_robot_commands_mean0.06851853357329586
set_robot_commands_median0.06925622054508754
set_robot_commands_min0.059373125433921814
sim_compute_performance-ego_max0.06015332121598093
sim_compute_performance-ego_mean0.05023129085099058
sim_compute_performance-ego_median0.05052704612414042
sim_compute_performance-ego_min0.04211246967315674
sim_compute_robot_state-ego_max0.056443783971998424
sim_compute_robot_state-ego_mean0.051735626773205576
sim_compute_robot_state-ego_median0.05170239448547363
sim_compute_robot_state-ego_min0.04441527128219605
sim_compute_sim_state_max0.04544980658425225
sim_compute_sim_state_mean0.030794484993989936
sim_compute_sim_state_median0.029638911548413728
sim_compute_sim_state_min0.02512909173965454
sim_physics_max0.09761250681347317
sim_physics_mean0.08381528941696557
sim_physics_median0.08459572281156268
sim_physics_min0.07113023996353149
sim_render-ego_max0.05772904345863744
sim_render-ego_mean0.04632628529457121
sim_render-ego_median0.046632547127573115
sim_render-ego_min0.03653477430343628
simulation-passed1
survival_time_max1.900000000000001
survival_time_mean1.4066666666666672
survival_time_min0.9500000000000004
240853888chuyjBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12910:05:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240843879chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationerroryes12910:01:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240743869kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:15:23(hidden)
driven_lanedir_consec_median0.45636437422784915
survival_time_median8.649999999999988
deviation-center-line_median0.4311785162839246
in-drivable-lane_median2.299999999999992


other stats
agent_compute-ego_max0.12268276634456228
agent_compute-ego_mean0.12208369441902012
agent_compute-ego_median0.1225238087576187
agent_compute-ego_min0.12077296675974232
deviation-center-line_max0.9088854268142452
deviation-center-line_mean0.5986365356813155
deviation-center-line_min0.37564804861275336
deviation-heading_max4.201945109163213
deviation-heading_mean2.4228734465614012
deviation-heading_median2.2302979057944925
deviation-heading_min1.1336786145374231
driven_any_max0.8955257816530534
driven_any_mean0.5880326060855007
driven_any_median0.5278877561210948
driven_any_min0.4705143843374088
driven_lanedir_consec_max0.5152090074378766
driven_lanedir_consec_mean0.3627920394806733
driven_lanedir_consec_min0.17480460052515134
driven_lanedir_max0.5152090074378766
driven_lanedir_mean0.36608941005895024
driven_lanedir_median0.45636437422784915
driven_lanedir_min0.17480460052515134
in-drivable-lane_max5.5500000000000655
in-drivable-lane_mean2.4000000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5024128743307011, "sim_physics": 0.08547406290706835, "survival_time": 7.599999999999981, "driven_lanedir": 0.17480460052515134, "sim_render-ego": 0.03583336660736486, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.12258098627391614, "deviation-heading": 1.1336786145374231, "set_robot_commands": 0.055266813228004856, "deviation-center-line": 0.37564804861275336, "driven_lanedir_consec": 0.17480460052515134, "sim_compute_sim_state": 0.022465840766304417, "sim_compute_performance-ego": 0.038641499845605144, "sim_compute_robot_state-ego": 0.04036120678249158, "sim_compute_robot_state-npc0": 0.04006241183531912, "sim_compute_robot_state-npc1": 0.03942519269491497, "sim_compute_robot_state-npc2": 0.039244541996403745, "sim_compute_robot_state-npc3": 0.03939867333361977}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5438222339852451, "sim_physics": 0.08745535755656776, "survival_time": 9.55, "driven_lanedir": 0.5152090074378766, "sim_render-ego": 0.03503860104146428, "in-drivable-lane": 0, "agent_compute-ego": 0.12185794395926113, "deviation-heading": 2.735425563790408, "set_robot_commands": 0.055516565033278543, "deviation-center-line": 0.9088854268142452, "driven_lanedir_consec": 0.5152090074378766, "sim_compute_sim_state": 0.02241874739761752, "sim_compute_performance-ego": 0.0384227493046466, "sim_compute_robot_state-ego": 0.040321315146241515, "sim_compute_robot_state-npc0": 0.04046992481691051, "sim_compute_robot_state-npc1": 0.0393408767840001, "sim_compute_robot_state-npc2": 0.039136850397000135, "sim_compute_robot_state-npc3": 0.039288167554046474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8955257816530534, "sim_physics": 0.08792518456158471, "survival_time": 12.850000000000048, "driven_lanedir": 0.4592920284641715, "sim_render-ego": 0.03523501904558115, "in-drivable-lane": 5.5500000000000655, "agent_compute-ego": 0.1225238087576187, "deviation-heading": 2.2302979057944925, "set_robot_commands": 0.054407366518844424, "deviation-center-line": 0.4311785162839246, "driven_lanedir_consec": 0.4592920284641715, "sim_compute_sim_state": 0.022443917938707404, "sim_compute_performance-ego": 0.03845612733744462, "sim_compute_robot_state-ego": 0.04053906522372353, "sim_compute_robot_state-npc0": 0.040240739570053634, "sim_compute_robot_state-npc1": 0.03952933007177212, "sim_compute_robot_state-npc2": 0.03916288164339177, "sim_compute_robot_state-npc3": 0.03936556526659064}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5278877561210948, "sim_physics": 0.08301354654180179, "survival_time": 7.94999999999998, "driven_lanedir": 0.22477703963970264, "sim_render-ego": 0.03539052999244546, "in-drivable-lane": 2.299999999999992, "agent_compute-ego": 0.12268276634456228, "deviation-heading": 4.201945109163213, "set_robot_commands": 0.05447112389330594, "deviation-center-line": 0.38406107755178015, "driven_lanedir_consec": 0.208290186748318, "sim_compute_sim_state": 0.022604126600349474, "sim_compute_performance-ego": 0.03846659150513463, "sim_compute_robot_state-ego": 0.04017748622774328, "sim_compute_robot_state-npc0": 0.04011150276136098, "sim_compute_robot_state-npc1": 0.03938994167735742, "sim_compute_robot_state-npc2": 0.03919571150773726, "sim_compute_robot_state-npc3": 0.03969250085218897}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4705143843374088, "sim_physics": 0.0838875577628957, "survival_time": 8.649999999999988, "driven_lanedir": 0.45636437422784915, "sim_render-ego": 0.03565651695163264, "in-drivable-lane": 0, "agent_compute-ego": 0.12077296675974232, "deviation-heading": 1.8130200395214708, "set_robot_commands": 0.05521230752757519, "deviation-center-line": 0.8934096091438738, "driven_lanedir_consec": 0.45636437422784915, "sim_compute_sim_state": 0.022390546137197855, "sim_compute_performance-ego": 0.03819861853053804, "sim_compute_robot_state-ego": 0.04011638316115892, "sim_compute_robot_state-npc0": 0.03984622872633741, "sim_compute_robot_state-npc1": 0.03920341916166978, "sim_compute_robot_state-npc2": 0.03895784251262687, "sim_compute_robot_state-npc3": 0.03974945558977954}}
set_robot_commands_max0.055516565033278543
set_robot_commands_mean0.05497483524020179
set_robot_commands_median0.05521230752757519
set_robot_commands_min0.054407366518844424
sim_compute_performance-ego_max0.038641499845605144
sim_compute_performance-ego_mean0.03843711730467381
sim_compute_performance-ego_median0.03845612733744462
sim_compute_performance-ego_min0.03819861853053804
sim_compute_robot_state-ego_max0.04053906522372353
sim_compute_robot_state-ego_mean0.04030309130827177
sim_compute_robot_state-ego_median0.040321315146241515
sim_compute_robot_state-ego_min0.04011638316115892
sim_compute_robot_state-npc0_max0.04046992481691051
sim_compute_robot_state-npc0_mean0.04014616154199633
sim_compute_robot_state-npc0_median0.04011150276136098
sim_compute_robot_state-npc0_min0.03984622872633741
sim_compute_robot_state-npc1_max0.03952933007177212
sim_compute_robot_state-npc1_mean0.03937775207794288
sim_compute_robot_state-npc1_median0.03938994167735742
sim_compute_robot_state-npc1_min0.03920341916166978
sim_compute_robot_state-npc2_max0.039244541996403745
sim_compute_robot_state-npc2_mean0.03913956561143196
sim_compute_robot_state-npc2_median0.03916288164339177
sim_compute_robot_state-npc2_min0.03895784251262687
sim_compute_robot_state-npc3_max0.03974945558977954
sim_compute_robot_state-npc3_mean0.03949887251924508
sim_compute_robot_state-npc3_median0.03939867333361977
sim_compute_robot_state-npc3_min0.039288167554046474
sim_compute_sim_state_max0.022604126600349474
sim_compute_sim_state_mean0.022464635768035333
sim_compute_sim_state_median0.022443917938707404
sim_compute_sim_state_min0.022390546137197855
sim_physics_max0.08792518456158471
sim_physics_mean0.08555114186598367
sim_physics_median0.08547406290706835
sim_physics_min0.08301354654180179
sim_render-ego_max0.03583336660736486
sim_render-ego_mean0.035430806727697675
sim_render-ego_median0.03539052999244546
sim_render-ego_min0.03503860104146428
simulation-passed1
survival_time_max12.850000000000048
survival_time_mean9.32
survival_time_min7.599999999999981
240733868kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240713866kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240693861kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-testing-offseasonstep1-simulationfailedyes12910:01:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240653865kene4192Baseline-IL-logs-tensorflow-keneaido2-LFVI-sim-validation-offseasonstep1-simulationfailedyes12910:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240643856kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12910:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240573848jagwarchallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationhost-erroryes12910:08:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 544, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1123, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1361, in upload
    sha256hex = compute_sha256hex(realfile)
  File "/project/src/duckietown_challenges_runner/runner.py", line 1408, in compute_sha256hex
    res: bytes = subprocess.check_output(cmd)
  File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 418, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing-offseason/submission3848/step1-simulation-ip-172-31-42-167-7227-job24057/tmp/tmpl1qgv5wi/episodes/ETHZ_autolab_technical_track-6-0/camera.mp4']' returned non-zero exit status 1.
(hidden)
240563849jagwarchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:04:26(hidden)
driven_lanedir_consec_median0.11625373188552056
survival_time_median1.4500000000000006
deviation-center-line_median0.07024506747576006
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.16975932285703463
agent_compute-ego_mean0.16086828715734824
agent_compute-ego_median0.16106406334907775
agent_compute-ego_min0.15250553908171477
deviation-center-line_max0.09965909160382908
deviation-center-line_mean0.07785012798678762
deviation-center-line_min0.06382064595539545
deviation-heading_max0.968269231110289
deviation-heading_mean0.8318545652290827
deviation-heading_median0.885486168547169
deviation-heading_min0.5016197567471753
driven_any_max0.2094901948184788
driven_any_mean0.1845683090371713
driven_any_median0.19574639516462844
driven_any_min0.14206951858565578
driven_lanedir_consec_max0.14082402440929165
driven_lanedir_consec_mean0.11325795992373412
driven_lanedir_consec_min0.06858394686549474
driven_lanedir_max0.14082402440929165
driven_lanedir_mean0.11325795992373412
driven_lanedir_median0.11625373188552056
driven_lanedir_min0.06858394686549474
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.05000000000000005
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19574639516462844, "sim_physics": 0.11965363601158405, "survival_time": 1.4500000000000006, "driven_lanedir": 0.10427155634647356, "sim_render-ego": 0.06520772802418676, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16975932285703463, "deviation-heading": 0.9630529380006068, "set_robot_commands": 0.0872659601014236, "deviation-center-line": 0.08810099620917924, "driven_lanedir_consec": 0.10427155634647356, "sim_compute_sim_state": 0.04211558144668053, "sim_compute_performance-ego": 0.07047092503514783, "sim_compute_robot_state-ego": 0.0753754500685067}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2093992838752257, "sim_physics": 0.11730228700945454, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14082402440929165, "sim_render-ego": 0.060718513304187406, "in-drivable-lane": 0, "agent_compute-ego": 0.16106406334907775, "deviation-heading": 0.885486168547169, "set_robot_commands": 0.09277856734491163, "deviation-center-line": 0.0674248386897742, "driven_lanedir_consec": 0.14082402440929165, "sim_compute_sim_state": 0.037933741846392234, "sim_compute_performance-ego": 0.06854627978417181, "sim_compute_robot_state-ego": 0.07176111590477728}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14206951858565578, "sim_physics": 0.11170458793640135, "survival_time": 1.0500000000000005, "driven_lanedir": 0.11625373188552056, "sim_render-ego": 0.05927668298993792, "in-drivable-lane": 0, "agent_compute-ego": 0.1664267721630278, "deviation-heading": 0.5016197567471753, "set_robot_commands": 0.0913049266451881, "deviation-center-line": 0.09965909160382908, "driven_lanedir_consec": 0.11625373188552056, "sim_compute_sim_state": 0.03948166256859189, "sim_compute_performance-ego": 0.06645964440845308, "sim_compute_robot_state-ego": 0.07321344103131976}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16613615274186797, "sim_physics": 0.1152166525522868, "survival_time": 1.3500000000000003, "driven_lanedir": 0.06858394686549474, "sim_render-ego": 0.055583450529310435, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15250553908171477, "deviation-heading": 0.968269231110289, "set_robot_commands": 0.08067478073967828, "deviation-center-line": 0.06382064595539545, "driven_lanedir_consec": 0.06858394686549474, "sim_compute_sim_state": 0.038197075879132306, "sim_compute_performance-ego": 0.06488500701056586, "sim_compute_robot_state-ego": 0.06500245023656774}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2094901948184788, "sim_physics": 0.11443663412524809, "survival_time": 1.5500000000000007, "driven_lanedir": 0.13635654011189002, "sim_render-ego": 0.05997775446984076, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15458573833588632, "deviation-heading": 0.8408447317401738, "set_robot_commands": 0.08502098052732406, "deviation-center-line": 0.07024506747576006, "driven_lanedir_consec": 0.13635654011189002, "sim_compute_sim_state": 0.03761930619516681, "sim_compute_performance-ego": 0.06656668263096963, "sim_compute_robot_state-ego": 0.07040172238503734}}
set_robot_commands_max0.09277856734491163
set_robot_commands_mean0.08740904307170513
set_robot_commands_median0.0872659601014236
set_robot_commands_min0.08067478073967828
sim_compute_performance-ego_max0.07047092503514783
sim_compute_performance-ego_mean0.06738570777386163
sim_compute_performance-ego_median0.06656668263096963
sim_compute_performance-ego_min0.06488500701056586
sim_compute_robot_state-ego_max0.0753754500685067
sim_compute_robot_state-ego_mean0.07115083592524177
sim_compute_robot_state-ego_median0.07176111590477728
sim_compute_robot_state-ego_min0.06500245023656774
sim_compute_sim_state_max0.04211558144668053
sim_compute_sim_state_mean0.039069473587192746
sim_compute_sim_state_median0.038197075879132306
sim_compute_sim_state_min0.03761930619516681
sim_physics_max0.11965363601158405
sim_physics_mean0.11566275952699497
sim_physics_median0.1152166525522868
sim_physics_min0.11170458793640135
sim_render-ego_max0.06520772802418676
sim_render-ego_mean0.06015282586349265
sim_render-ego_median0.05997775446984076
sim_render-ego_min0.055583450529310435
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min1.0500000000000005
240543852jagwarchallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:14(hidden)
driven_lanedir_consec_median0.0819383221144574
survival_time_median1.3000000000000005
deviation-center-line_median0.07077390798309896
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.17414705506686506
agent_compute-ego_mean0.15810703215069807
agent_compute-ego_median0.15347544046548697
agent_compute-ego_min0.14671557396650314
deviation-center-line_max0.09800504654144594
deviation-center-line_mean0.07045069903959204
deviation-center-line_min0.030135435176982937
deviation-heading_max0.8551283501446498
deviation-heading_mean0.6719909238299641
deviation-heading_median0.6870076329772088
deviation-heading_min0.4521897011097954
driven_any_max0.20041782579608844
driven_any_mean0.16516350978113747
driven_any_median0.14502263548424654
driven_any_min0.1423779403214888
driven_lanedir_consec_max0.11509937785817526
driven_lanedir_consec_mean0.08240530779959436
driven_lanedir_consec_min0.05282981528380293
driven_lanedir_max0.11509937785817526
driven_lanedir_mean0.08240530779959436
driven_lanedir_median0.0819383221144574
driven_lanedir_min0.05282981528380293
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.2100000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19560426654016289, "sim_physics": 0.20608437472376331, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0819383221144574, "sim_render-ego": 0.06778819807644548, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17414705506686506, "deviation-heading": 0.8551283501446498, "set_robot_commands": 0.09356327714591192, "deviation-center-line": 0.07077390798309896, "driven_lanedir_consec": 0.0819383221144574, "sim_compute_sim_state": 0.0385485681994208, "sim_compute_performance-ego": 0.07141706039165628, "sim_compute_robot_state-ego": 0.0771245709780989, "sim_compute_robot_state-npc0": 0.07363201831949168, "sim_compute_robot_state-npc1": 0.07464429427837503, "sim_compute_robot_state-npc2": 0.068607733167451, "sim_compute_robot_state-npc3": 0.07009597482352421}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20041782579608844, "sim_physics": 0.19276969134807587, "survival_time": 1.6000000000000008, "driven_lanedir": 0.053388466723951034, "sim_render-ego": 0.054685547947883606, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.14671557396650314, "deviation-heading": 0.8324616964471786, "set_robot_commands": 0.07870610803365707, "deviation-center-line": 0.05641878674318129, "driven_lanedir_consec": 0.053388466723951034, "sim_compute_sim_state": 0.03493325412273407, "sim_compute_performance-ego": 0.05989177525043487, "sim_compute_robot_state-ego": 0.06696608662605286, "sim_compute_robot_state-npc0": 0.06143356114625931, "sim_compute_robot_state-npc1": 0.06332977861166, "sim_compute_robot_state-npc2": 0.06112276017665863, "sim_compute_robot_state-npc3": 0.06364889442920685}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14502263548424654, "sim_physics": 0.16786829284999685, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11509937785817526, "sim_render-ego": 0.05559926447661027, "in-drivable-lane": 0, "agent_compute-ego": 0.14872488768204398, "deviation-heading": 0.4521897011097954, "set_robot_commands": 0.09000758502794348, "deviation-center-line": 0.09800504654144594, "driven_lanedir_consec": 0.11509937785817526, "sim_compute_sim_state": 0.03772831999737283, "sim_compute_performance-ego": 0.05576241534689198, "sim_compute_robot_state-ego": 0.05968075213224992, "sim_compute_robot_state-npc0": 0.0684490618498429, "sim_compute_robot_state-npc1": 0.06388718148936397, "sim_compute_robot_state-npc2": 0.06374618281488834, "sim_compute_robot_state-npc3": 0.061319952425749405}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1423948807637008, "sim_physics": 0.17129621903101602, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1087705570175852, "sim_render-ego": 0.054846485455830894, "in-drivable-lane": 0, "agent_compute-ego": 0.16747220357259116, "deviation-heading": 0.5331672384709879, "set_robot_commands": 0.08396690090497334, "deviation-center-line": 0.09692031875325116, "driven_lanedir_consec": 0.1087705570175852, "sim_compute_sim_state": 0.035669416189193726, "sim_compute_performance-ego": 0.057942996422449745, "sim_compute_robot_state-ego": 0.062318642934163414, "sim_compute_robot_state-npc0": 0.06539532542228699, "sim_compute_robot_state-npc1": 0.0644575556119283, "sim_compute_robot_state-npc2": 0.06464587648709615, "sim_compute_robot_state-npc3": 0.06303100784619649}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1423779403214888, "sim_physics": 0.1671090951332679, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05282981528380293, "sim_render-ego": 0.06030139556297889, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.15347544046548697, "deviation-heading": 0.6870076329772088, "set_robot_commands": 0.08243260016808143, "deviation-center-line": 0.030135435176982937, "driven_lanedir_consec": 0.05282981528380293, "sim_compute_sim_state": 0.03926129524524395, "sim_compute_performance-ego": 0.06409441507779635, "sim_compute_robot_state-ego": 0.06766114785121037, "sim_compute_robot_state-npc0": 0.06311380863189697, "sim_compute_robot_state-npc1": 0.05971040175511287, "sim_compute_robot_state-npc2": 0.05896378480471098, "sim_compute_robot_state-npc3": 0.06268228017366849}}
set_robot_commands_max0.09356327714591192
set_robot_commands_mean0.08573529425611344
set_robot_commands_median0.08396690090497334
set_robot_commands_min0.07870610803365707
sim_compute_performance-ego_max0.07141706039165628
sim_compute_performance-ego_mean0.06182173249784585
sim_compute_performance-ego_median0.05989177525043487
sim_compute_performance-ego_min0.05576241534689198
sim_compute_robot_state-ego_max0.0771245709780989
sim_compute_robot_state-ego_mean0.06675024010435508
sim_compute_robot_state-ego_median0.06696608662605286
sim_compute_robot_state-ego_min0.05968075213224992
sim_compute_robot_state-npc0_max0.07363201831949168
sim_compute_robot_state-npc0_mean0.06640475507395557
sim_compute_robot_state-npc0_median0.06539532542228699
sim_compute_robot_state-npc0_min0.06143356114625931
sim_compute_robot_state-npc1_max0.07464429427837503
sim_compute_robot_state-npc1_mean0.06520584234928803
sim_compute_robot_state-npc1_median0.06388718148936397
sim_compute_robot_state-npc1_min0.05971040175511287
sim_compute_robot_state-npc2_max0.068607733167451
sim_compute_robot_state-npc2_mean0.06341726749016102
sim_compute_robot_state-npc2_median0.06374618281488834
sim_compute_robot_state-npc2_min0.05896378480471098
sim_compute_robot_state-npc3_max0.07009597482352421
sim_compute_robot_state-npc3_mean0.06415562193966909
sim_compute_robot_state-npc3_median0.06303100784619649
sim_compute_robot_state-npc3_min0.061319952425749405
sim_compute_sim_state_max0.03926129524524395
sim_compute_sim_state_mean0.03722817075079308
sim_compute_sim_state_median0.03772831999737283
sim_compute_sim_state_min0.03493325412273407
sim_physics_max0.20608437472376331
sim_physics_mean0.181025534617224
sim_physics_median0.17129621903101602
sim_physics_min0.1671090951332679
sim_render-ego_max0.06778819807644548
sim_render-ego_mean0.05864417830394984
sim_render-ego_median0.05559926447661027
sim_render-ego_min0.054685547947883606
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1500000000000004
240493842kene4192kene-template-randomaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12910:02:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240473843kene4192kene-template-randomaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:08:21(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.16231069564819336
agent_compute-ego_mean0.15128819758289083
agent_compute-ego_median0.15210639547418664
agent_compute-ego_min0.13974570286901375
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1633225988458704, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.059476772944132485, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15210639547418664, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09054977805526168, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03930593419958044, "sim_compute_performance-ego": 0.06233612696329752, "sim_compute_robot_state-ego": 0.06939459288561786, "sim_compute_robot_state-npc0": 0.06632724956229881, "sim_compute_robot_state-npc1": 0.06937612427605523, "sim_compute_robot_state-npc2": 0.06878949094701696, "sim_compute_robot_state-npc3": 0.06956363607335973}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.20505611419677736, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06617661476135255, "in-drivable-lane": 0, "agent_compute-ego": 0.16231069564819336, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10179373741149902, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.043011751174926754, "sim_compute_performance-ego": 0.0762082290649414, "sim_compute_robot_state-ego": 0.08063323974609375, "sim_compute_robot_state-npc0": 0.0743963623046875, "sim_compute_robot_state-npc1": 0.07485847473144532, "sim_compute_robot_state-npc2": 0.07597770690917968, "sim_compute_robot_state-npc3": 0.07454434394836426}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.17613514473563746, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.060132625855897605, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.13974570286901375, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.08798848014128835, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.037200209341551126, "sim_compute_performance-ego": 0.07145665821276213, "sim_compute_robot_state-ego": 0.06995841390208195, "sim_compute_robot_state-npc0": 0.06377959251403809, "sim_compute_robot_state-npc1": 0.06602493085359272, "sim_compute_robot_state-npc2": 0.06932620939455535, "sim_compute_robot_state-npc3": 0.06616252974459999}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.18737847291970555, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06109425387805021, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.15262396727936178, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.09570898285394984, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03940281083312216, "sim_compute_performance-ego": 0.06668576409545125, "sim_compute_robot_state-ego": 0.07513675508619863, "sim_compute_robot_state-npc0": 0.07176095322717595, "sim_compute_robot_state-npc1": 0.06829976130135451, "sim_compute_robot_state-npc2": 0.06925340543819379, "sim_compute_robot_state-npc3": 0.0657697055913225}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.1711898786681039, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.05929947750908988, "in-drivable-lane": 0, "agent_compute-ego": 0.14965422664369857, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.0934708033289228, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03752040011542184, "sim_compute_performance-ego": 0.06353692497525897, "sim_compute_robot_state-ego": 0.08188389028821673, "sim_compute_robot_state-npc0": 0.07103140865053449, "sim_compute_robot_state-npc1": 0.07125016621180943, "sim_compute_robot_state-npc2": 0.07379370076315743, "sim_compute_robot_state-npc3": 0.06655193226678031}}
set_robot_commands_max0.10179373741149902
set_robot_commands_mean0.09390235635818436
set_robot_commands_median0.0934708033289228
set_robot_commands_min0.08798848014128835
sim_compute_performance-ego_max0.0762082290649414
sim_compute_performance-ego_mean0.06804474066234226
sim_compute_performance-ego_median0.06668576409545125
sim_compute_performance-ego_min0.06233612696329752
sim_compute_robot_state-ego_max0.08188389028821673
sim_compute_robot_state-ego_mean0.07540137838164178
sim_compute_robot_state-ego_median0.07513675508619863
sim_compute_robot_state-ego_min0.06939459288561786
sim_compute_robot_state-npc0_max0.0743963623046875
sim_compute_robot_state-npc0_mean0.06945911325174696
sim_compute_robot_state-npc0_median0.07103140865053449
sim_compute_robot_state-npc0_min0.06377959251403809
sim_compute_robot_state-npc1_max0.07485847473144532
sim_compute_robot_state-npc1_mean0.06996189147485143
sim_compute_robot_state-npc1_median0.06937612427605523
sim_compute_robot_state-npc1_min0.06602493085359272
sim_compute_robot_state-npc2_max0.07597770690917968
sim_compute_robot_state-npc2_mean0.07142810269042064
sim_compute_robot_state-npc2_median0.06932620939455535
sim_compute_robot_state-npc2_min0.06878949094701696
sim_compute_robot_state-npc3_max0.07454434394836426
sim_compute_robot_state-npc3_mean0.06851842952488535
sim_compute_robot_state-npc3_median0.06655193226678031
sim_compute_robot_state-npc3_min0.0657697055913225
sim_compute_sim_state_max0.043011751174926754
sim_compute_sim_state_mean0.03928822113292047
sim_compute_sim_state_median0.03930593419958044
sim_compute_sim_state_min0.037200209341551126
sim_physics_max0.20505611419677736
sim_physics_mean0.18061644187321896
sim_physics_median0.17613514473563746
sim_physics_min0.1633225988458704
sim_render-ego_max0.06617661476135255
sim_render-ego_mean0.061235948989704546
sim_render-ego_median0.060132625855897605
sim_render-ego_min0.05929947750908988
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
240403830movehoonchallenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12910:37:46(hidden)
driven_lanedir_consec_median0.05619252710304179
survival_time_median1.5500000000000007
deviation-center-line_median0.07150011916070365
in-drivable-lane_median0.6000000000000004


other stats
agent_compute-ego_max0.16363341410954793
agent_compute-ego_mean0.11574671522941628
agent_compute-ego_median0.11757416560732084
agent_compute-ego_min0.09233924058767463
deviation-center-line_max0.67455409294423
deviation-center-line_mean0.2062292765429776
deviation-center-line_min0.0252460442318012
deviation-heading_max5.951946366406269
deviation-heading_mean2.992326580684763
deviation-heading_median0.660032058750875
deviation-heading_min0.475064368099676
driven_any_max1.549300856112976
driven_any_mean0.756381258447249
driven_any_median0.13902285579015622
driven_any_min0.09785778688038418
driven_lanedir_consec_max0.5128275283186512
driven_lanedir_consec_mean0.2448402237322826
driven_lanedir_consec_min0.03539412568615141
driven_lanedir_max0.5128275283186512
driven_lanedir_mean0.2448402237322826
driven_lanedir_median0.05619252710304179
driven_lanedir_min0.03539412568615141
in-drivable-lane_max7.400000000000042
in-drivable-lane_mean3.650000000000019
in-drivable-lane_min0.40000000000000024
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.520449431210659, "sim_physics": 0.15357592344284057, "survival_time": 14.950000000000076, "driven_lanedir": 0.4761497610365853, "sim_render-ego": 0.05812755823135376, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.15606792052586874, "deviation-heading": 5.703725350250262, "set_robot_commands": 0.08969576597213745, "deviation-center-line": 0.67455409294423, "driven_lanedir_consec": 0.4761497610365853, "sim_compute_sim_state": 0.03624515453974406, "sim_compute_performance-ego": 0.06333513975143433, "sim_compute_robot_state-ego": 0.0677087124188741, "sim_compute_robot_state-npc0": 0.06804217179616293, "sim_compute_robot_state-npc1": 0.06287844101587932, "sim_compute_robot_state-npc2": 0.06436240275700887, "sim_compute_robot_state-npc3": 0.06611492077509562}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5007181505792806, "sim_physics": 0.15405097166697185, "survival_time": 14.950000000000076, "driven_lanedir": 0.5128275283186512, "sim_render-ego": 0.056550753911336266, "in-drivable-lane": 7.250000000000039, "agent_compute-ego": 0.16363341410954793, "deviation-heading": 5.951946366406269, "set_robot_commands": 0.08858625888824463, "deviation-center-line": 0.6486559452884139, "driven_lanedir_consec": 0.5128275283186512, "sim_compute_sim_state": 0.03634945392608643, "sim_compute_performance-ego": 0.06272190332412719, "sim_compute_robot_state-ego": 0.06941298802693685, "sim_compute_robot_state-npc0": 0.06595839897791544, "sim_compute_robot_state-npc1": 0.0645911447207133, "sim_compute_robot_state-npc2": 0.06565740585327148, "sim_compute_robot_state-npc3": 0.06607284625371297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11253832201412475, "sim_physics": 0.1473619054864954, "survival_time": 1.3500000000000003, "driven_lanedir": 0.03932019861766678, "sim_render-ego": 0.06759012186968769, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.13401043856585468, "deviation-heading": 0.4791709020455639, "set_robot_commands": 0.0827018243295175, "deviation-center-line": 0.07150011916070365, "driven_lanedir_consec": 0.03932019861766678, "sim_compute_sim_state": 0.02831494366681134, "sim_compute_performance-ego": 0.05273879015887225, "sim_compute_robot_state-ego": 0.054263282705236365, "sim_compute_robot_state-npc0": 0.050477036723384154, "sim_compute_robot_state-npc1": 0.04830805460611979, "sim_compute_robot_state-npc2": 0.051373702508431894, "sim_compute_robot_state-npc3": 0.04924785649334943}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.09785778688038418, "sim_physics": 0.12603880677904403, "survival_time": 1.4000000000000006, "driven_lanedir": 0.03658928646741266, "sim_render-ego": 0.03883779048919678, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.12104438883917672, "deviation-heading": 0.475064368099676, "set_robot_commands": 0.06639944655554635, "deviation-center-line": 0.06487951268102517, "driven_lanedir_consec": 0.03658928646741266, "sim_compute_sim_state": 0.02553622211728777, "sim_compute_performance-ego": 0.040439026696341376, "sim_compute_robot_state-ego": 0.04547431639262608, "sim_compute_robot_state-npc0": 0.046820376600537984, "sim_compute_robot_state-npc1": 0.04576652390616281, "sim_compute_robot_state-npc2": 0.04686811140605381, "sim_compute_robot_state-npc3": 0.045682319572993686}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.13902285579015622, "sim_physics": 0.11336714990677373, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04511625552223309, "sim_render-ego": 0.04513412906277564, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.130077761988486, "deviation-heading": 0.660032058750875, "set_robot_commands": 0.07208092751041535, "deviation-center-line": 0.0252460442318012, "driven_lanedir_consec": 0.04511625552223309, "sim_compute_sim_state": 0.030574229455763293, "sim_compute_performance-ego": 0.047448519737489765, "sim_compute_robot_state-ego": 0.052729491264589375, "sim_compute_robot_state-npc0": 0.05188827360829999, "sim_compute_robot_state-npc1": 0.05176391140107186, "sim_compute_robot_state-npc2": 0.053771018981933594, "sim_compute_robot_state-npc3": 0.053046787938764016}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.5231332255954098, "sim_physics": 0.11337181488672891, "survival_time": 14.950000000000076, "driven_lanedir": 0.46154987075899934, "sim_render-ego": 0.04284192403157552, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.1198224933942159, "deviation-heading": 5.846279732457238, "set_robot_commands": 0.06863049030303955, "deviation-center-line": 0.19487592557061875, "driven_lanedir_consec": 0.46154987075899934, "sim_compute_sim_state": 0.027536209424336752, "sim_compute_performance-ego": 0.04710146347681681, "sim_compute_robot_state-ego": 0.04930564324061076, "sim_compute_robot_state-npc0": 0.05037042856216431, "sim_compute_robot_state-npc1": 0.04956636110941569, "sim_compute_robot_state-npc2": 0.04895167509714762, "sim_compute_robot_state-npc3": 0.04918215433756511}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.12250839159386852, "sim_physics": 0.12772474617793642, "survival_time": 1.4500000000000006, "driven_lanedir": 0.05619252710304179, "sim_render-ego": 0.04367977175219306, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.13004909712692786, "deviation-heading": 0.5552112406757185, "set_robot_commands": 0.0724709938312399, "deviation-center-line": 0.06029425998802036, "driven_lanedir_consec": 0.05619252710304179, "sim_compute_sim_state": 0.029237969168301285, "sim_compute_performance-ego": 0.048412692957911, "sim_compute_robot_state-ego": 0.05017775502698175, "sim_compute_robot_state-npc0": 0.05222282738521181, "sim_compute_robot_state-npc1": 0.04961733160347774, "sim_compute_robot_state-npc2": 0.048100372840618265, "sim_compute_robot_state-npc3": 0.04701910347774111}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.11630928031024144, "sim_physics": 0.11538097776215651, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0474967363266976, "sim_render-ego": 0.03910641834653657, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.11757416560732084, "deviation-heading": 0.5030055899666701, "set_robot_commands": 0.06500858273999445, "deviation-center-line": 0.06487076640014555, "driven_lanedir_consec": 0.0474967363266976, "sim_compute_sim_state": 0.025905395376271213, "sim_compute_performance-ego": 0.04349142107470282, "sim_compute_robot_state-ego": 0.04523434310123838, "sim_compute_robot_state-npc0": 0.04470735582812079, "sim_compute_robot_state-npc1": 0.04745567256006701, "sim_compute_robot_state-npc2": 0.04347459201155038, "sim_compute_robot_state-npc3": 0.04311674216697956}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.4173505343595274, "sim_physics": 0.08691491921742757, "survival_time": 14.950000000000076, "driven_lanedir": 0.4648112553924002, "sim_render-ego": 0.03542586167653402, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09706971089045206, "deviation-heading": 5.70587525882846, "set_robot_commands": 0.05512343883514404, "deviation-center-line": 0.17941614396429134, "driven_lanedir_consec": 0.4648112553924002, "sim_compute_sim_state": 0.02249463478724162, "sim_compute_performance-ego": 0.0382056721051534, "sim_compute_robot_state-ego": 0.04035648028055827, "sim_compute_robot_state-npc0": 0.040192278226216634, "sim_compute_robot_state-npc1": 0.04291801611582438, "sim_compute_robot_state-npc2": 0.039559539953867594, "sim_compute_robot_state-npc3": 0.03960151354471842}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.549300856112976, "sim_physics": 0.08637301524480184, "survival_time": 14.950000000000076, "driven_lanedir": 0.5021161672433161, "sim_render-ego": 0.03440210501352946, "in-drivable-lane": 7.250000000000042, "agent_compute-ego": 0.09415711164474488, "deviation-heading": 5.914564142579523, "set_robot_commands": 0.05417873064676921, "deviation-center-line": 0.2599067842059366, "driven_lanedir_consec": 0.5021161672433161, "sim_compute_sim_state": 0.021880664825439457, "sim_compute_performance-ego": 0.03747548818588257, "sim_compute_robot_state-ego": 0.0396323815981547, "sim_compute_robot_state-npc0": 0.03898825883865356, "sim_compute_robot_state-npc1": 0.03846743901570638, "sim_compute_robot_state-npc2": 0.03816656986872355, "sim_compute_robot_state-npc3": 0.03838402430216471}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.4753623571873176, "sim_physics": 0.08769421946721447, "survival_time": 14.850000000000076, "driven_lanedir": 0.43921059175913646, "sim_render-ego": 0.03594921494172478, "in-drivable-lane": 7.400000000000042, "agent_compute-ego": 0.09418090104254008, "deviation-heading": 5.785997466850599, "set_robot_commands": 0.05346408355918396, "deviation-center-line": 0.16129015706442756, "driven_lanedir_consec": 0.43921059175913646, "sim_compute_sim_state": 0.02190391222635905, "sim_compute_performance-ego": 0.037550302466960866, "sim_compute_robot_state-ego": 0.04084114675168638, "sim_compute_robot_state-npc0": 0.03899870496807677, "sim_compute_robot_state-npc1": 0.038403901186856354, "sim_compute_robot_state-npc2": 0.03838756670454135, "sim_compute_robot_state-npc3": 0.03856651068536521}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1062414247922028, "sim_physics": 0.08574439929081844, "survival_time": 1.3000000000000005, "driven_lanedir": 0.03539412568615141, "sim_render-ego": 0.03405158336345966, "in-drivable-lane": 0.40000000000000024, "agent_compute-ego": 0.09233924058767463, "deviation-heading": 0.5469586710936079, "set_robot_commands": 0.05391481289496789, "deviation-center-line": 0.06768869117415303, "driven_lanedir_consec": 0.03539412568615141, "sim_compute_sim_state": 0.02190543138063871, "sim_compute_performance-ego": 0.03741241418398344, "sim_compute_robot_state-ego": 0.0394969811806312, "sim_compute_robot_state-npc0": 0.038795021864084095, "sim_compute_robot_state-npc1": 0.038312636888944186, "sim_compute_robot_state-npc2": 0.03814960443056547, "sim_compute_robot_state-npc3": 0.03826470558459942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.4144272744009805, "sim_physics": 0.0870790688196818, "survival_time": 14.950000000000076, "driven_lanedir": 0.4637785754440843, "sim_render-ego": 0.0348508087793986, "in-drivable-lane": 7.35000000000004, "agent_compute-ego": 0.09484684546788534, "deviation-heading": 5.626897126940251, "set_robot_commands": 0.05315001885096232, "deviation-center-line": 0.4964700492703755, "driven_lanedir_consec": 0.4637785754440843, "sim_compute_sim_state": 0.021866169770558674, "sim_compute_performance-ego": 0.03748757123947143, "sim_compute_robot_state-ego": 0.03958635171254476, "sim_compute_robot_state-npc0": 0.0388403590520223, "sim_compute_robot_state-npc1": 0.038857120672861734, "sim_compute_robot_state-npc2": 0.03832295020421346, "sim_compute_robot_state-npc3": 0.03830404837926229}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.12083257660815765, "sim_physics": 0.08946015153612409, "survival_time": 1.4000000000000006, "driven_lanedir": 0.042197402673734175, "sim_render-ego": 0.03497825350080218, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.0966081704412188, "deviation-heading": 0.5229829866540693, "set_robot_commands": 0.053070204598563056, "deviation-center-line": 0.061918832249083615, "driven_lanedir_consec": 0.042197402673734175, "sim_compute_sim_state": 0.02204619986670358, "sim_compute_performance-ego": 0.03740223816462925, "sim_compute_robot_state-ego": 0.03991428443363735, "sim_compute_robot_state-npc0": 0.03886995996747698, "sim_compute_robot_state-npc1": 0.03862914868763515, "sim_compute_robot_state-npc2": 0.0382178681237357, "sim_compute_robot_state-npc3": 0.03828510216304234}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12966640927345294, "sim_physics": 0.0859628438949585, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04985307363412872, "sim_render-ego": 0.03415618737538655, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09471906820933024, "deviation-heading": 0.6071874486726682, "set_robot_commands": 0.052899408340454104, "deviation-center-line": 0.06187182395143777, "driven_lanedir_consec": 0.04985307363412872, "sim_compute_sim_state": 0.02197280724843343, "sim_compute_performance-ego": 0.03885881900787354, "sim_compute_robot_state-ego": 0.039401976267496745, "sim_compute_robot_state-npc0": 0.03872841993967692, "sim_compute_robot_state-npc1": 0.038318204879760745, "sim_compute_robot_state-npc2": 0.038157113393147785, "sim_compute_robot_state-npc3": 0.038229330380757647}}
set_robot_commands_max0.08969576597213745
set_robot_commands_mean0.06542499919041199
set_robot_commands_median0.06500858273999445
set_robot_commands_min0.052899408340454104
sim_compute_performance-ego_max0.06333513975143433
sim_compute_performance-ego_mean0.044672097502110014
sim_compute_performance-ego_median0.040439026696341376
sim_compute_performance-ego_min0.03740223816462925
sim_compute_robot_state-ego_max0.06941298802693685
sim_compute_robot_state-ego_mean0.047569075626786875
sim_compute_robot_state-ego_median0.04523434310123838
sim_compute_robot_state-ego_min0.039401976267496745
sim_compute_robot_state-npc0_max0.06804217179616293
sim_compute_robot_state-npc0_mean0.04692665815586698
sim_compute_robot_state-npc0_median0.04470735582812079
sim_compute_robot_state-npc0_min0.03872841993967692
sim_compute_robot_state-npc1_max0.0645911447207133
sim_compute_robot_state-npc1_mean0.046256927224699755
sim_compute_robot_state-npc1_median0.04576652390616281
sim_compute_robot_state-npc1_min0.038312636888944186
sim_compute_robot_state-npc2_max0.06565740585327148
sim_compute_robot_state-npc2_mean0.04610136627565406
sim_compute_robot_state-npc2_median0.04347459201155038
sim_compute_robot_state-npc2_min0.03814960443056547
sim_compute_robot_state-npc3_max0.06611492077509562
sim_compute_robot_state-npc3_mean0.04594119773707409
sim_compute_robot_state-npc3_median0.04311674216697956
sim_compute_robot_state-npc3_min0.038229330380757647
sim_compute_sim_state_max0.03634945392608643
sim_compute_sim_state_mean0.026251293185331776
sim_compute_sim_state_median0.02553622211728777
sim_compute_sim_state_min0.021866169770558674
sim_physics_max0.15405097166697185
sim_physics_mean0.11067339423866496
sim_physics_median0.11336714990677373
sim_physics_min0.08574439929081844
sim_render-ego_max0.06759012186968769
sim_render-ego_mean0.04237883215636603
sim_render-ego_median0.03883779048919678
sim_render-ego_min0.03405158336345966
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000036
survival_time_min1.3000000000000005
240373834movehoonchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12910:05:52(hidden)
driven_lanedir_consec_median0.07383424331709154
survival_time_median1.3500000000000003
deviation-center-line_median0.05705265581440869
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.17874737467084612
agent_compute-ego_mean0.1606283118232848
agent_compute-ego_median0.1673769746507917
agent_compute-ego_min0.12412693765428331
deviation-center-line_max0.09818380750852644
deviation-center-line_mean0.0677207387718659
deviation-center-line_min0.03656547923061833
deviation-heading_max0.7771855002132214
deviation-heading_mean0.6583715316956857
deviation-heading_median0.6682300029207968
deviation-heading_min0.5403861725297875
driven_any_max0.20784381121866372
driven_any_mean0.15914885559001862
driven_any_median0.1417168846318984
driven_any_min0.12319961026820576
driven_lanedir_consec_max0.0953976952757818
driven_lanedir_consec_mean0.07130341266563955
driven_lanedir_consec_min0.0436590552126539
driven_lanedir_max0.0953976952757818
driven_lanedir_mean0.07130341266563955
driven_lanedir_median0.07383424331709154
driven_lanedir_min0.0436590552126539
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.3400000000000003
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.20784381121866372, "sim_physics": 0.16911689213344028, "survival_time": 1.7500000000000009, "driven_lanedir": 0.07383424331709154, "sim_render-ego": 0.05449119976588658, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17874737467084612, "deviation-heading": 0.6682300029207968, "set_robot_commands": 0.09517807279314314, "deviation-center-line": 0.05705265581440869, "driven_lanedir_consec": 0.07383424331709154, "sim_compute_sim_state": 0.03626397677830288, "sim_compute_performance-ego": 0.06300899641854422, "sim_compute_robot_state-ego": 0.06642934254237584, "sim_compute_robot_state-npc0": 0.06494290488106864, "sim_compute_robot_state-npc1": 0.06091593333653041, "sim_compute_robot_state-npc2": 0.06288292067391532, "sim_compute_robot_state-npc3": 0.07792319570268903}, "udem1-1-0": {"driven_any": 0.19357951605083903, "sim_physics": 0.199284873689924, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0436590552126539, "sim_render-ego": 0.05764995983668736, "in-drivable-lane": 0.7500000000000007, "agent_compute-ego": 0.1673769746507917, "deviation-heading": 0.7771855002132214, "set_robot_commands": 0.0989567416054862, "deviation-center-line": 0.05316634304862935, "driven_lanedir_consec": 0.0436590552126539, "sim_compute_sim_state": 0.03772200856889997, "sim_compute_performance-ego": 0.06320146151951381, "sim_compute_robot_state-ego": 0.07055085727146694, "sim_compute_robot_state-npc0": 0.06637706075395856, "sim_compute_robot_state-npc1": 0.06363024711608886, "sim_compute_robot_state-npc2": 0.06438001905168805, "sim_compute_robot_state-npc3": 0.06601973942347936}, "udem1-2-0": {"driven_any": 0.12319961026820576, "sim_physics": 0.2378211228743843, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0909348778873702, "sim_render-ego": 0.05719819276229195, "in-drivable-lane": 0, "agent_compute-ego": 0.16761250081269638, "deviation-heading": 0.5500801984102511, "set_robot_commands": 0.0926177916319474, "deviation-center-line": 0.09818380750852644, "driven_lanedir_consec": 0.0909348778873702, "sim_compute_sim_state": 0.037220571352087936, "sim_compute_performance-ego": 0.06499089365420134, "sim_compute_robot_state-ego": 0.07251958225084387, "sim_compute_robot_state-npc0": 0.0686053296794062, "sim_compute_robot_state-npc1": 0.06713612183280614, "sim_compute_robot_state-npc2": 0.06670742449553116, "sim_compute_robot_state-npc3": 0.06639506505883258}, "udem1-3-0": {"driven_any": 0.1294044557804862, "sim_physics": 0.1794763129690419, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0953976952757818, "sim_render-ego": 0.05026697075885275, "in-drivable-lane": 0, "agent_compute-ego": 0.16527777132780655, "deviation-heading": 0.5403861725297875, "set_robot_commands": 0.08696698105853537, "deviation-center-line": 0.09363540825714668, "driven_lanedir_consec": 0.0953976952757818, "sim_compute_sim_state": 0.03274481192879055, "sim_compute_performance-ego": 0.05597413104513417, "sim_compute_robot_state-ego": 0.06083795298700747, "sim_compute_robot_state-npc0": 0.06421364908633025, "sim_compute_robot_state-npc1": 0.06535506248474121, "sim_compute_robot_state-npc2": 0.06313301169353983, "sim_compute_robot_state-npc3": 0.07008324498715608}, "udem1-4-0": {"driven_any": 0.1417168846318984, "sim_physics": 0.13775081987734197, "survival_time": 1.3500000000000003, "driven_lanedir": 0.05269119163530034, "sim_render-ego": 0.04435784728438766, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12412693765428331, "deviation-heading": 0.7559757844043717, "set_robot_commands": 0.0783363801461679, "deviation-center-line": 0.03656547923061833, "driven_lanedir_consec": 0.05269119163530034, "sim_compute_sim_state": 0.030198229683770075, "sim_compute_performance-ego": 0.04664537641737196, "sim_compute_robot_state-ego": 0.05089267094930013, "sim_compute_robot_state-npc0": 0.05352564211244936, "sim_compute_robot_state-npc1": 0.04939112839875398, "sim_compute_robot_state-npc2": 0.050411109571103695, "sim_compute_robot_state-npc3": 0.050608414190786856}}
set_robot_commands_max0.0989567416054862
set_robot_commands_mean0.090411193447056
set_robot_commands_median0.0926177916319474
set_robot_commands_min0.0783363801461679
sim_compute_performance-ego_max0.06499089365420134
sim_compute_performance-ego_mean0.0587641718109531
sim_compute_performance-ego_median0.06300899641854422
sim_compute_performance-ego_min0.04664537641737196
sim_compute_robot_state-ego_max0.07251958225084387
sim_compute_robot_state-ego_mean0.06424608120019884
sim_compute_robot_state-ego_median0.06642934254237584
sim_compute_robot_state-ego_min0.05089267094930013
sim_compute_robot_state-npc0_max0.0686053296794062
sim_compute_robot_state-npc0_mean0.06353291730264261
sim_compute_robot_state-npc0_median0.06494290488106864
sim_compute_robot_state-npc0_min0.05352564211244936
sim_compute_robot_state-npc1_max0.06713612183280614
sim_compute_robot_state-npc1_mean0.06128569863378412
sim_compute_robot_state-npc1_median0.06363024711608886
sim_compute_robot_state-npc1_min0.04939112839875398
sim_compute_robot_state-npc2_max0.06670742449553116
sim_compute_robot_state-npc2_mean0.0615028970971556
sim_compute_robot_state-npc2_median0.06313301169353983
sim_compute_robot_state-npc2_min0.050411109571103695
sim_compute_robot_state-npc3_max0.07792319570268903
sim_compute_robot_state-npc3_mean0.06620593187258879
sim_compute_robot_state-npc3_median0.06639506505883258
sim_compute_robot_state-npc3_min0.050608414190786856
sim_compute_sim_state_max0.03772200856889997
sim_compute_sim_state_mean0.03482991966237028
sim_compute_sim_state_median0.03626397677830288
sim_compute_sim_state_min0.030198229683770075
sim_physics_max0.2378211228743843
sim_physics_mean0.18469000430882648
sim_physics_median0.1794763129690419
sim_physics_min0.13775081987734197
sim_render-ego_max0.05764995983668736
sim_render-ego_mean0.052792834081621255
sim_render-ego_median0.05449119976588658
sim_render-ego_min0.04435784728438766
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4300000000000006
survival_time_min1.1500000000000004
240353825dcharrezPredictorLastaido2-PREDstep1-simulationsuccessyes12910:00:30(hidden)
error_L10.1263750130726308
error_L20.023816452751950105


240303824movehoonPredictorLastaido2-PREDstep1-simulationsuccessyes12910:00:28(hidden)
error_L10.11856790268534818
error_L20.02192530636895919


240253819Philippe LaferrièrePredictorLastaido2-PREDstep1-simulationsuccessyes12910:00:30(hidden)
error_L10.11536419350005156
error_L20.021206786063720628


240213811AmaurXLet's do this one todayaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12910:20:09(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.15490049362182615
agent_compute-ego_mean0.1456960371013701
agent_compute-ego_median0.14437071323394776
agent_compute-ego_min0.13737282947618135
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14457240811100713, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.054441346062554255, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1380183387685705, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08253905949769197, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03582359684838189, "sim_compute_performance-ego": 0.06477907410374394, "sim_compute_robot_state-ego": 0.06567731610050907, "sim_compute_robot_state-npc0": 0.062410694581490976, "sim_compute_robot_state-npc1": 0.05984913419794153, "sim_compute_robot_state-npc2": 0.059104857621369536, "sim_compute_robot_state-npc3": 0.0693692719494855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1896437549591065, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.0549664306640625, "in-drivable-lane": 0, "agent_compute-ego": 0.1511079978942871, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.09153096199035644, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.035165834426879886, "sim_compute_performance-ego": 0.0656983184814453, "sim_compute_robot_state-ego": 0.07345609664916992, "sim_compute_robot_state-npc0": 0.06581464767456055, "sim_compute_robot_state-npc1": 0.0680873966217041, "sim_compute_robot_state-npc2": 0.0686650276184082, "sim_compute_robot_state-npc3": 0.06469029426574707}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.18416582283220792, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06020417338923404, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1547418707295468, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09182849369551006, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03796993431292082, "sim_compute_performance-ego": 0.06892933343586169, "sim_compute_robot_state-ego": 0.07456099045904059, "sim_compute_robot_state-npc0": 0.06911055978975798, "sim_compute_robot_state-npc1": 0.06830665312315289, "sim_compute_robot_state-npc2": 0.06938967892998144, "sim_compute_robot_state-npc3": 0.06763688200398495}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1758499930176554, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05715300463422944, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14191963401021837, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.0884618065025233, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.03715092320985432, "sim_compute_performance-ego": 0.06487847581694398, "sim_compute_robot_state-ego": 0.0688384062127222, "sim_compute_robot_state-npc0": 0.06655381601068038, "sim_compute_robot_state-npc1": 0.0637691292581679, "sim_compute_robot_state-npc2": 0.06270368793342687, "sim_compute_robot_state-npc3": 0.06492069099522844}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18644426550183976, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06348412377493722, "in-drivable-lane": 0, "agent_compute-ego": 0.14642901931490218, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09115604843412128, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.03799478496823992, "sim_compute_performance-ego": 0.07842214618410383, "sim_compute_robot_state-ego": 0.08461907080241612, "sim_compute_robot_state-npc0": 0.06538815157754081, "sim_compute_robot_state-npc1": 0.06816862310682024, "sim_compute_robot_state-npc2": 0.0801080550466265, "sim_compute_robot_state-npc3": 0.0691582305090768}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.17198358641730416, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05898628411469636, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.1540774769253201, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.09305791060129802, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.037748230828179255, "sim_compute_performance-ego": 0.06823840847721806, "sim_compute_robot_state-ego": 0.07831386283591941, "sim_compute_robot_state-npc0": 0.06665530469682482, "sim_compute_robot_state-npc1": 0.06747843159569634, "sim_compute_robot_state-npc2": 0.06419946529247143, "sim_compute_robot_state-npc3": 0.0622190413651643}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.1580219754466304, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.05955469166790998, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.14819739041505037, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.09131286320862948, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.038524349530537925, "sim_compute_performance-ego": 0.06429988366586191, "sim_compute_robot_state-ego": 0.07411954579529939, "sim_compute_robot_state-npc0": 0.07103748674745913, "sim_compute_robot_state-npc1": 0.06879680686526829, "sim_compute_robot_state-npc2": 0.06804309950934516, "sim_compute_robot_state-npc3": 0.0676783941410206}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.18525716463724773, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.055891826417711045, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.14014821582370335, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.08578039275275337, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.03633508152431912, "sim_compute_performance-ego": 0.06373834080166287, "sim_compute_robot_state-ego": 0.06935877799987793, "sim_compute_robot_state-npc0": 0.06444903479682075, "sim_compute_robot_state-npc1": 0.06377460161844889, "sim_compute_robot_state-npc2": 0.06452424791124133, "sim_compute_robot_state-npc3": 0.06049550374348958}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.15554473711096722, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.0547945032949033, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.14252261493517004, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.08384197691212529, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.03499943277110224, "sim_compute_performance-ego": 0.063835885213769, "sim_compute_robot_state-ego": 0.06966765548871912, "sim_compute_robot_state-npc0": 0.060037846150605576, "sim_compute_robot_state-npc1": 0.06194913905599843, "sim_compute_robot_state-npc2": 0.061233359834422234, "sim_compute_robot_state-npc3": 0.06351341890252155}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.17428080558776857, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.05718729972839356, "in-drivable-lane": 0, "agent_compute-ego": 0.14437071323394776, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.09319132328033448, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.03674973487854004, "sim_compute_performance-ego": 0.06508312702178955, "sim_compute_robot_state-ego": 0.0697386360168457, "sim_compute_robot_state-npc0": 0.06593659400939941, "sim_compute_robot_state-npc1": 0.06584096908569335, "sim_compute_robot_state-npc2": 0.06328247547149658, "sim_compute_robot_state-npc3": 0.06283201694488526}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.19032766819000244, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.054708456993103026, "in-drivable-lane": 0, "agent_compute-ego": 0.1379152297973633, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.08132275342941284, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.03937950134277344, "sim_compute_performance-ego": 0.056161558628082274, "sim_compute_robot_state-ego": 0.06101411581039429, "sim_compute_robot_state-npc0": 0.06086570024490357, "sim_compute_robot_state-npc1": 0.060111498832702635, "sim_compute_robot_state-npc2": 0.060692989826202394, "sim_compute_robot_state-npc3": 0.06275250911712646}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1837275404679148, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.057871529930516294, "in-drivable-lane": 0, "agent_compute-ego": 0.14319327003077456, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.09725716239527651, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.038558156866776314, "sim_compute_performance-ego": 0.06474228909141139, "sim_compute_robot_state-ego": 0.06653420548689992, "sim_compute_robot_state-npc0": 0.06477884242409154, "sim_compute_robot_state-npc1": 0.06340068265011436, "sim_compute_robot_state-npc2": 0.06229994171544125, "sim_compute_robot_state-npc3": 0.06110197619387978}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1596747589111328, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06129908084869385, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15490049362182615, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.09682887077331542, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.03829436302185059, "sim_compute_performance-ego": 0.06720079898834229, "sim_compute_robot_state-ego": 0.07471795082092285, "sim_compute_robot_state-npc0": 0.07501360416412353, "sim_compute_robot_state-npc1": 0.06613888263702393, "sim_compute_robot_state-npc2": 0.06960060119628907, "sim_compute_robot_state-npc3": 0.0668506669998169}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1979970173402266, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.06210316311229359, "in-drivable-lane": 0, "agent_compute-ego": 0.15052546154369006, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.09406846219843085, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.03684248707511208, "sim_compute_performance-ego": 0.0688642913644964, "sim_compute_robot_state-ego": 0.06672258810563521, "sim_compute_robot_state-npc0": 0.06770364804701372, "sim_compute_robot_state-npc1": 0.06814177469773726, "sim_compute_robot_state-npc2": 0.0650750615380027, "sim_compute_robot_state-npc3": 0.0683983564376831}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.19275997122939753, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.054923115944375794, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.13737282947618135, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.08814426830836705, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.03414844006908183, "sim_compute_performance-ego": 0.06097612089040328, "sim_compute_robot_state-ego": 0.06554427438852739, "sim_compute_robot_state-npc0": 0.06166401687933474, "sim_compute_robot_state-npc1": 0.06144505131001375, "sim_compute_robot_state-npc2": 0.06232723411248655, "sim_compute_robot_state-npc3": 0.06330297917735819}}
set_robot_commands_max0.09725716239527651
set_robot_commands_mean0.0900214902653431
set_robot_commands_median0.09131286320862948
set_robot_commands_min0.08132275342941284
sim_compute_performance-ego_max0.07842214618410383
sim_compute_performance-ego_mean0.06572320347767571
sim_compute_performance-ego_median0.06487847581694398
sim_compute_performance-ego_min0.056161558628082274
sim_compute_robot_state-ego_max0.08461907080241612
sim_compute_robot_state-ego_mean0.07085889953152662
sim_compute_robot_state-ego_median0.06966765548871912
sim_compute_robot_state-ego_min0.06101411581039429
sim_compute_robot_state-npc0_max0.07501360416412353
sim_compute_robot_state-npc0_mean0.0658279965196405
sim_compute_robot_state-npc0_median0.06581464767456055
sim_compute_robot_state-npc0_min0.060037846150605576
sim_compute_robot_state-npc1_max0.06879680686526829
sim_compute_robot_state-npc1_mean0.0650172516437656
sim_compute_robot_state-npc1_median0.06584096908569335
sim_compute_robot_state-npc1_min0.05984913419794153
sim_compute_robot_state-npc2_max0.0801080550466265
sim_compute_robot_state-npc2_mean0.06541665223714742
sim_compute_robot_state-npc2_median0.06419946529247143
sim_compute_robot_state-npc2_min0.059104857621369536
sim_compute_robot_state-npc3_max0.0693692719494855
sim_compute_robot_state-npc3_mean0.0649946821830979
sim_compute_robot_state-npc3_median0.06469029426574707
sim_compute_robot_state-npc3_min0.06049550374348958
sim_compute_sim_state_max0.03937950134277344
sim_compute_sim_state_mean0.03704565677830331
sim_compute_sim_state_median0.03715092320985432
sim_compute_sim_state_min0.03414844006908183
sim_physics_max0.1979970173402266
sim_physics_mean0.17668343131736058
sim_physics_median0.1837275404679148
sim_physics_min0.14457240811100713
sim_render-ego_max0.06348412377493722
sim_render-ego_mean0.05783793537184094
sim_render-ego_median0.05718729972839356
sim_render-ego_min0.054441346062554255
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
240183812AmaurXLet's do this one todayaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12910:07:58(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.1589952196393694
agent_compute-ego_mean0.1443899867802169
agent_compute-ego_median0.14387595176696777
agent_compute-ego_min0.1272968053817749
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1386045394120393, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05365012310169361, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1272968053817749, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08360874211346661, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.030434882199322735, "sim_compute_performance-ego": 0.05939118950455277, "sim_compute_robot_state-ego": 0.06362844396520544, "sim_compute_robot_state-npc0": 0.05890295240614149, "sim_compute_robot_state-npc1": 0.06061981342456959, "sim_compute_robot_state-npc2": 0.05585845752998635, "sim_compute_robot_state-npc3": 0.05371559107745135}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.17676926612854005, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.05732707977294922, "in-drivable-lane": 0, "agent_compute-ego": 0.14387595176696777, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.08809575080871582, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.038383712768554686, "sim_compute_performance-ego": 0.0675126838684082, "sim_compute_robot_state-ego": 0.07254491806030273, "sim_compute_robot_state-npc0": 0.06259063720703124, "sim_compute_robot_state-npc1": 0.05928920745849609, "sim_compute_robot_state-npc2": 0.06364901542663574, "sim_compute_robot_state-npc3": 0.06614619255065918}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.16564353202518664, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06097643626363654, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.15265919032849765, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09170702256654438, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03777066657417699, "sim_compute_performance-ego": 0.06716087931080868, "sim_compute_robot_state-ego": 0.07071869310579802, "sim_compute_robot_state-npc0": 0.06850385979602211, "sim_compute_robot_state-npc1": 0.06672239303588867, "sim_compute_robot_state-npc2": 0.06498376946700246, "sim_compute_robot_state-npc3": 0.06363452421991449}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1672186911860599, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.05605304090282585, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.13912276678447483, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.08500884756257263, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.036784003052530406, "sim_compute_performance-ego": 0.06535746176031572, "sim_compute_robot_state-ego": 0.06858903245080876, "sim_compute_robot_state-npc0": 0.06409105469908895, "sim_compute_robot_state-npc1": 0.06202624417558501, "sim_compute_robot_state-npc2": 0.06290957293932951, "sim_compute_robot_state-npc3": 0.06163346616527702}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19311797618865967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.0674223814691816, "in-drivable-lane": 0, "agent_compute-ego": 0.1589952196393694, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09666510139192852, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.038140339510781426, "sim_compute_performance-ego": 0.07641136646270752, "sim_compute_robot_state-ego": 0.08577047075544085, "sim_compute_robot_state-npc0": 0.07334305558885847, "sim_compute_robot_state-npc1": 0.06730685915265765, "sim_compute_robot_state-npc2": 0.06725857087544032, "sim_compute_robot_state-npc3": 0.06931218930653163}}
set_robot_commands_max0.09666510139192852
set_robot_commands_mean0.0890170928886456
set_robot_commands_median0.08809575080871582
set_robot_commands_min0.08360874211346661
sim_compute_performance-ego_max0.07641136646270752
sim_compute_performance-ego_mean0.06716671618135858
sim_compute_performance-ego_median0.06716087931080868
sim_compute_performance-ego_min0.05939118950455277
sim_compute_robot_state-ego_max0.08577047075544085
sim_compute_robot_state-ego_mean0.07225031166751117
sim_compute_robot_state-ego_median0.07071869310579802
sim_compute_robot_state-ego_min0.06362844396520544
sim_compute_robot_state-npc0_max0.07334305558885847
sim_compute_robot_state-npc0_mean0.06548631193942844
sim_compute_robot_state-npc0_median0.06409105469908895
sim_compute_robot_state-npc0_min0.05890295240614149
sim_compute_robot_state-npc1_max0.06730685915265765
sim_compute_robot_state-npc1_mean0.06319290344943941
sim_compute_robot_state-npc1_median0.06202624417558501
sim_compute_robot_state-npc1_min0.05928920745849609
sim_compute_robot_state-npc2_max0.06725857087544032
sim_compute_robot_state-npc2_mean0.06293187724767887
sim_compute_robot_state-npc2_median0.06364901542663574
sim_compute_robot_state-npc2_min0.05585845752998635
sim_compute_robot_state-npc3_max0.06931218930653163
sim_compute_robot_state-npc3_mean0.06288839266396673
sim_compute_robot_state-npc3_median0.06363452421991449
sim_compute_robot_state-npc3_min0.05371559107745135
sim_compute_sim_state_max0.038383712768554686
sim_compute_sim_state_mean0.036302720821073255
sim_compute_sim_state_median0.03777066657417699
sim_compute_sim_state_min0.030434882199322735
sim_physics_max0.19311797618865967
sim_physics_mean0.16827080098809713
sim_physics_median0.1672186911860599
sim_physics_min0.1386045394120393
sim_render-ego_max0.0674223814691816
sim_render-ego_mean0.05908581230205736
sim_render-ego_median0.05732707977294922
sim_render-ego_min0.05365012310169361
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
240173808chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12910:02:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240163807chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:05:26(hidden)
driven_lanedir_consec_median1.2970674355257206
survival_time_median3.949999999999994
deviation-center-line_median0.24025421116283985
in-drivable-lane_median1.1


other stats
agent_compute-ego_max0.10040280486963972
agent_compute-ego_mean0.09702737088559864
agent_compute-ego_median0.0965848930420414
agent_compute-ego_min0.09535973167419434
deviation-center-line_max0.4061793754210388
deviation-center-line_mean0.25189118162533297
deviation-center-line_min0.15515493126262506
deviation-heading_max2.647670858343001
deviation-heading_mean1.1252774021173737
deviation-heading_median0.6747565568469233
deviation-heading_min0.5052265076591098
driven_any_max3.2880508883115636
driven_any_mean1.8578266103841456
driven_any_median1.6706165070497003
driven_any_min1.1319608299029815
driven_lanedir_consec_max2.3342334664816917
driven_lanedir_consec_mean1.2690510285465983
driven_lanedir_consec_min0.6051744314078786
driven_lanedir_max2.3342334664816917
driven_lanedir_mean1.2899546004169025
driven_lanedir_median1.2970674355257206
driven_lanedir_min0.7096922907593997
in-drivable-lane_max2.3499999999999934
in-drivable-lane_mean1.389999999999996
in-drivable-lane_min0.6999999999999975
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1319608299029815, "sim_physics": 0.05300341033935547, "survival_time": 6.249999999999986, "driven_lanedir": 0.7096922907593997, "sim_render-ego": 0.03633154296875, "in-drivable-lane": 2.3499999999999934, "agent_compute-ego": 0.09535973167419434, "deviation-heading": 2.647670858343001, "set_robot_commands": 0.054799161911010745, "deviation-center-line": 0.29980146209532654, "driven_lanedir_consec": 0.6051744314078786, "sim_compute_sim_state": 0.02317292022705078, "sim_compute_performance-ego": 0.03870099067687988, "sim_compute_robot_state-ego": 0.04071904563903809}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4527301541173807, "sim_physics": 0.05605689556367936, "survival_time": 3.099999999999997, "driven_lanedir": 0.7944486342774126, "sim_render-ego": 0.03648869452937957, "in-drivable-lane": 1.1, "agent_compute-ego": 0.0965848930420414, "deviation-heading": 0.6747565568469233, "set_robot_commands": 0.054535369719228434, "deviation-center-line": 0.15806592818483473, "driven_lanedir_consec": 0.7944486342774126, "sim_compute_sim_state": 0.02423794807926301, "sim_compute_performance-ego": 0.0385343567017586, "sim_compute_robot_state-ego": 0.04058572553819226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2880508883115636, "sim_physics": 0.05646739267323115, "survival_time": 7.299999999999982, "driven_lanedir": 2.3342334664816917, "sim_render-ego": 0.036066349238565526, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0971947189879744, "deviation-heading": 1.2629759937588492, "set_robot_commands": 0.055597088108324026, "deviation-center-line": 0.4061793754210388, "driven_lanedir_consec": 2.3342334664816917, "sim_compute_sim_state": 0.023705583729156075, "sim_compute_performance-ego": 0.03895185744925721, "sim_compute_robot_state-ego": 0.040644637525898135}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6706165070497003, "sim_physics": 0.05653592906420744, "survival_time": 3.949999999999994, "driven_lanedir": 1.2970674355257206, "sim_render-ego": 0.03599302678168574, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.10040280486963972, "deviation-heading": 0.535757093978986, "set_robot_commands": 0.05501183980627905, "deviation-center-line": 0.24025421116283985, "driven_lanedir_consec": 1.2970674355257206, "sim_compute_sim_state": 0.023166505596305752, "sim_compute_performance-ego": 0.039199469964715496, "sim_compute_robot_state-ego": 0.04064590417886082}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.745774672539102, "sim_physics": 0.05590164661407471, "survival_time": 3.4999999999999956, "driven_lanedir": 1.3143311750402882, "sim_render-ego": 0.03624299253736223, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.0955947058541434, "deviation-heading": 0.5052265076591098, "set_robot_commands": 0.05462308951786586, "deviation-center-line": 0.15515493126262506, "driven_lanedir_consec": 1.3143311750402882, "sim_compute_sim_state": 0.023116132191249306, "sim_compute_performance-ego": 0.03843733583177839, "sim_compute_robot_state-ego": 0.040599523271833145}}
set_robot_commands_max0.055597088108324026
set_robot_commands_mean0.054913309812541625
set_robot_commands_median0.054799161911010745
set_robot_commands_min0.054535369719228434
sim_compute_performance-ego_max0.039199469964715496
sim_compute_performance-ego_mean0.038764802124877915
sim_compute_performance-ego_median0.03870099067687988
sim_compute_performance-ego_min0.03843733583177839
sim_compute_robot_state-ego_max0.04071904563903809
sim_compute_robot_state-ego_mean0.04063896723076449
sim_compute_robot_state-ego_median0.040644637525898135
sim_compute_robot_state-ego_min0.04058572553819226
sim_compute_sim_state_max0.02423794807926301
sim_compute_sim_state_mean0.023479817964604983
sim_compute_sim_state_median0.02317292022705078
sim_compute_sim_state_min0.023116132191249306
sim_physics_max0.05653592906420744
sim_physics_mean0.055593054850909616
sim_physics_median0.05605689556367936
sim_physics_min0.05300341033935547
sim_render-ego_max0.03648869452937957
sim_render-ego_mean0.03622452121114862
sim_render-ego_median0.03624299253736223
sim_render-ego_min0.03599302678168574
simulation-passed1
survival_time_max7.299999999999982
survival_time_mean4.819999999999991
survival_time_min3.099999999999997
240153806chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12910:03:46(hidden)
driven_lanedir_consec_median0.6855098869645495
survival_time_median2.5999999999999988
deviation-center-line_median0.12793042492891543
in-drivable-lane_median1.0000000000000009


other stats
agent_compute-ego_max0.0984562219575394
agent_compute-ego_mean0.096470371236175
agent_compute-ego_median0.09590721130371094
agent_compute-ego_min0.09588342242770724
deviation-center-line_max0.16679643269696504
deviation-center-line_mean0.13737866514037766
deviation-center-line_min0.12414245792704968
deviation-heading_max0.6791831831911687
deviation-heading_mean0.33884697450451134
deviation-heading_median0.21409351211459093
deviation-heading_min0.18215304654123532
driven_any_max1.604140759595854
driven_any_mean1.2096054895409938
driven_any_median1.2668379264292713
driven_any_min0.5682626539104457
driven_lanedir_consec_max1.1193879233836466
driven_lanedir_consec_mean0.7576280848276593
driven_lanedir_consec_min0.5641809645311522
driven_lanedir_max1.1193879233836466
driven_lanedir_mean0.7576280848276593
driven_lanedir_median0.6855098869645495
driven_lanedir_min0.5641809645311522
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.859999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0137664315009025, "sim_physics": 0.05875971705414528, "survival_time": 2.1500000000000004, "driven_lanedir": 0.6855098869645495, "sim_render-ego": 0.0364763293155404, "in-drivable-lane": 0.5499999999999996, "agent_compute-ego": 0.0984562219575394, "deviation-heading": 0.2039272936686647, "set_robot_commands": 0.05511888237886651, "deviation-center-line": 0.12591626222493102, "driven_lanedir_consec": 0.6855098869645495, "sim_compute_sim_state": 0.02294494384943053, "sim_compute_performance-ego": 0.03841918568278468, "sim_compute_robot_state-ego": 0.040881467420001365}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2668379264292713, "sim_physics": 0.055738549966078535, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6094197005359626, "sim_render-ego": 0.0383343008848337, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.09590721130371094, "deviation-heading": 0.6791831831911687, "set_robot_commands": 0.05498377176431509, "deviation-center-line": 0.12414245792704968, "driven_lanedir_consec": 0.6094197005359626, "sim_compute_sim_state": 0.02285874806917631, "sim_compute_performance-ego": 0.03857610317376944, "sim_compute_robot_state-ego": 0.04049638142952552}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5682626539104457, "sim_physics": 0.06095984246995714, "survival_time": 1.3500000000000003, "driven_lanedir": 0.5641809645311522, "sim_render-ego": 0.03600402231569643, "in-drivable-lane": 0, "agent_compute-ego": 0.09588342242770724, "deviation-heading": 0.18215304654123532, "set_robot_commands": 0.05470576992741338, "deviation-center-line": 0.14210774792402706, "driven_lanedir_consec": 0.5641809645311522, "sim_compute_sim_state": 0.023037071581240052, "sim_compute_performance-ego": 0.038295993098506224, "sim_compute_robot_state-ego": 0.04055567140932436}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.604140759595854, "sim_physics": 0.05493602237185916, "survival_time": 3.699999999999995, "driven_lanedir": 0.809641948722986, "sim_render-ego": 0.03844661648209031, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09588521235697978, "deviation-heading": 0.414877837006897, "set_robot_commands": 0.05556973573323842, "deviation-center-line": 0.12793042492891543, "driven_lanedir_consec": 0.809641948722986, "sim_compute_sim_state": 0.023032265740471916, "sim_compute_performance-ego": 0.0385152681453808, "sim_compute_robot_state-ego": 0.04064293165464659}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5950196762684965, "sim_physics": 0.05641588023011113, "survival_time": 3.5499999999999954, "driven_lanedir": 1.1193879233836466, "sim_render-ego": 0.0362303592789341, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.09621978813493756, "deviation-heading": 0.21409351211459093, "set_robot_commands": 0.05563468664464816, "deviation-center-line": 0.16679643269696504, "driven_lanedir_consec": 1.1193879233836466, "sim_compute_sim_state": 0.023199262753338883, "sim_compute_performance-ego": 0.038837902982470016, "sim_compute_robot_state-ego": 0.0443235350326753}}
set_robot_commands_max0.05563468664464816
set_robot_commands_mean0.05520256928969631
set_robot_commands_median0.05511888237886651
set_robot_commands_min0.05470576992741338
sim_compute_performance-ego_max0.038837902982470016
sim_compute_performance-ego_mean0.03852889061658223
sim_compute_performance-ego_median0.0385152681453808
sim_compute_performance-ego_min0.038295993098506224
sim_compute_robot_state-ego_max0.0443235350326753
sim_compute_robot_state-ego_mean0.04137999738923463
sim_compute_robot_state-ego_median0.04064293165464659
sim_compute_robot_state-ego_min0.04049638142952552
sim_compute_sim_state_max0.023199262753338883
sim_compute_sim_state_mean0.023014458398731535
sim_compute_sim_state_median0.023032265740471916
sim_compute_sim_state_min0.02285874806917631
sim_physics_max0.06095984246995714
sim_physics_mean0.05736200241843024
sim_physics_median0.05641588023011113
sim_physics_min0.05493602237185916
sim_render-ego_max0.03844661648209031
sim_render-ego_mean0.037098325655418984
sim_render-ego_median0.0364763293155404
sim_render-ego_min0.03600402231569643
simulation-passed1
survival_time_max3.699999999999995
survival_time_mean2.6699999999999977
survival_time_min1.3500000000000003
239893788felipecer13challenge-aido_LF-template-randomaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12910:07:57(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.14947347981589182
agent_compute-ego_mean0.1363077549816327
agent_compute-ego_median0.14229384209345847
agent_compute-ego_min0.11264621714750926
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19407301914842823, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.060520986967448946, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1482754115816913, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09916533095927178, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03712070440944237, "sim_compute_performance-ego": 0.06775676449642906, "sim_compute_robot_state-ego": 0.07034035272236112, "sim_compute_robot_state-npc0": 0.06628528124169458, "sim_compute_robot_state-npc1": 0.06680799737761292, "sim_compute_robot_state-npc2": 0.06554390207121644, "sim_compute_robot_state-npc3": 0.06759585006327569}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2124412911278861, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06811869995934623, "in-drivable-lane": 0, "agent_compute-ego": 0.14947347981589182, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09324975524629864, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03833797999790737, "sim_compute_performance-ego": 0.07171557630811419, "sim_compute_robot_state-ego": 0.07972225121089391, "sim_compute_robot_state-npc0": 0.06490887914385114, "sim_compute_robot_state-npc1": 0.06500063623700823, "sim_compute_robot_state-npc2": 0.06676739454269409, "sim_compute_robot_state-npc3": 0.06743172236851283}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.1817907939836817, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06045508847653287, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14229384209345847, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08312763519657468, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.035817465735870656, "sim_compute_performance-ego": 0.06313097129747705, "sim_compute_robot_state-ego": 0.06926587947363992, "sim_compute_robot_state-npc0": 0.06430929146924065, "sim_compute_robot_state-npc1": 0.06562385281312813, "sim_compute_robot_state-npc2": 0.06527653018247734, "sim_compute_robot_state-npc3": 0.06307925529850339}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.14384466409683228, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.046836654345194496, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.11264621714750926, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.07099344333012898, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.028764143586158752, "sim_compute_performance-ego": 0.05199195941289266, "sim_compute_robot_state-ego": 0.05249966184298197, "sim_compute_robot_state-npc0": 0.05060990651448568, "sim_compute_robot_state-npc1": 0.052147080500920616, "sim_compute_robot_state-npc2": 0.05272684494654337, "sim_compute_robot_state-npc3": 0.05006362497806549}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1341072264171782, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04733263878595261, "in-drivable-lane": 0, "agent_compute-ego": 0.12884982426961264, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0733969665708996, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.02747821807861328, "sim_compute_performance-ego": 0.054478656677972706, "sim_compute_robot_state-ego": 0.0495168822152274, "sim_compute_robot_state-npc0": 0.05257193247477213, "sim_compute_robot_state-npc1": 0.05250067937941778, "sim_compute_robot_state-npc2": 0.05608508700416202, "sim_compute_robot_state-npc3": 0.04951449802943638}}
set_robot_commands_max0.09916533095927178
set_robot_commands_mean0.08398662626063473
set_robot_commands_median0.08312763519657468
set_robot_commands_min0.07099344333012898
sim_compute_performance-ego_max0.07171557630811419
sim_compute_performance-ego_mean0.06181478563857713
sim_compute_performance-ego_median0.06313097129747705
sim_compute_performance-ego_min0.05199195941289266
sim_compute_robot_state-ego_max0.07972225121089391
sim_compute_robot_state-ego_mean0.06426900549302086
sim_compute_robot_state-ego_median0.06926587947363992
sim_compute_robot_state-ego_min0.0495168822152274
sim_compute_robot_state-npc0_max0.06628528124169458
sim_compute_robot_state-npc0_mean0.05973705816880883
sim_compute_robot_state-npc0_median0.06430929146924065
sim_compute_robot_state-npc0_min0.05060990651448568
sim_compute_robot_state-npc1_max0.06680799737761292
sim_compute_robot_state-npc1_mean0.06041604926161753
sim_compute_robot_state-npc1_median0.06500063623700823
sim_compute_robot_state-npc1_min0.052147080500920616
sim_compute_robot_state-npc2_max0.06676739454269409
sim_compute_robot_state-npc2_mean0.06127995174941866
sim_compute_robot_state-npc2_median0.06527653018247734
sim_compute_robot_state-npc2_min0.05272684494654337
sim_compute_robot_state-npc3_max0.06759585006327569
sim_compute_robot_state-npc3_mean0.059536990147558755
sim_compute_robot_state-npc3_median0.06307925529850339
sim_compute_robot_state-npc3_min0.04951449802943638
sim_compute_sim_state_max0.03833797999790737
sim_compute_sim_state_mean0.033503702361598484
sim_compute_sim_state_median0.035817465735870656
sim_compute_sim_state_min0.02747821807861328
sim_physics_max0.2124412911278861
sim_physics_mean0.1732513989548013
sim_physics_median0.1817907939836817
sim_physics_min0.1341072264171782
sim_render-ego_max0.06811869995934623
sim_render-ego_mean0.056652813706895025
sim_render-ego_median0.06045508847653287
sim_render-ego_min0.046836654345194496
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
237493762Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes12910:39:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
237363747sebaido2-LF-sim-validationstep1-simulationsuccessyes12910:04:15(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.12199536491842831
agent_compute-ego_mean0.11335889166846198
agent_compute-ego_median0.11389463036148637
agent_compute-ego_min0.10476522352181228
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05849235146133988, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04956727999228018, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11389463036148637, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05561636553870307, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.023923617822152597, "sim_compute_performance-ego": 0.0403083430396186, "sim_compute_robot_state-ego": 0.04170925970430727}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.07938395294488645, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.04314203823313994, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.10476522352181228, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.06453849755081476, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.028622996573354684, "sim_compute_performance-ego": 0.047435671675438974, "sim_compute_robot_state-ego": 0.05377449241338992}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.0802910888896269, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.04947386068456313, "in-drivable-lane": 0, "agent_compute-ego": 0.12199536491842831, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0760809954474954, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.028622991898480585, "sim_compute_performance-ego": 0.05031184589161592, "sim_compute_robot_state-ego": 0.05045732329873478}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.07461433410644532, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.04038871765136719, "in-drivable-lane": 0, "agent_compute-ego": 0.10781005859375, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.06237324714660644, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.02543781280517578, "sim_compute_performance-ego": 0.04478235244750976, "sim_compute_robot_state-ego": 0.04548724174499512}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.07276426387738578, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.04550890681109851, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.11832918094683297, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0712078311775304, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02830149553999116, "sim_compute_performance-ego": 0.04868088492864295, "sim_compute_robot_state-ego": 0.05106089990350265}}
set_robot_commands_max0.0760809954474954
set_robot_commands_mean0.06596338737223002
set_robot_commands_median0.06453849755081476
set_robot_commands_min0.05561636553870307
sim_compute_performance-ego_max0.05031184589161592
sim_compute_performance-ego_mean0.04630381959656524
sim_compute_performance-ego_median0.047435671675438974
sim_compute_performance-ego_min0.0403083430396186
sim_compute_robot_state-ego_max0.05377449241338992
sim_compute_robot_state-ego_mean0.04849784341298595
sim_compute_robot_state-ego_median0.05045732329873478
sim_compute_robot_state-ego_min0.04170925970430727
sim_compute_sim_state_max0.028622996573354684
sim_compute_sim_state_mean0.02698178292783096
sim_compute_sim_state_median0.02830149553999116
sim_compute_sim_state_min0.023923617822152597
sim_physics_max0.0802910888896269
sim_physics_mean0.07310919825593686
sim_physics_median0.07461433410644532
sim_physics_min0.05849235146133988
sim_render-ego_max0.04956727999228018
sim_render-ego_mean0.045616160674489786
sim_render-ego_median0.04550890681109851
sim_render-ego_min0.04038871765136719
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
237203744JBRRussiacolcnt fixaido2-LF-sim-validationstep1-simulationsuccessyes12910:12:35(hidden)
driven_lanedir_consec_median1.9705669376900432
survival_time_median14.950000000000076
deviation-center-line_median0.7422340304530037
in-drivable-lane_median0


other stats
agent_compute-ego_max0.052840578556060794
agent_compute-ego_mean0.05209226701167692
agent_compute-ego_median0.05201107347515267
agent_compute-ego_min0.05160330040286286
deviation-center-line_max1.2082307329342523
deviation-center-line_mean0.7139712903877511
deviation-center-line_min0.2976033703881105
deviation-heading_max2.9019980388351496
deviation-heading_mean2.055183686097723
deviation-heading_median2.5826051961665573
deviation-heading_min0.4783500635159773
driven_any_max2.081962678438535
driven_any_mean1.4615878586790547
driven_any_median2.046539141116722
driven_any_min0.4601374492136299
driven_lanedir_consec_max2.0148048229342077
driven_lanedir_consec_mean1.4072865603571754
driven_lanedir_consec_min0.4546187992944528
driven_lanedir_max2.0148048229342077
driven_lanedir_mean1.4072865603571754
driven_lanedir_median1.9705669376900432
driven_lanedir_min0.4546187992944528
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.019999999999999928
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.046539141116722, "sim_physics": 0.07620734691619874, "survival_time": 14.950000000000076, "driven_lanedir": 1.9705669376900432, "sim_render-ego": 0.03715049187342326, "in-drivable-lane": 0, "agent_compute-ego": 0.05169507503509521, "deviation-heading": 2.5826051961665573, "set_robot_commands": 0.06983069737752279, "deviation-center-line": 1.2082307329342523, "driven_lanedir_consec": 1.9705669376900432, "sim_compute_sim_state": 0.028919689655303955, "sim_compute_performance-ego": 0.04263082106908162, "sim_compute_robot_state-ego": 0.04909709771474202}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6517876053649976, "sim_physics": 0.06956413779595885, "survival_time": 4.94999999999999, "driven_lanedir": 0.5863186782911962, "sim_render-ego": 0.036590648419929275, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.05160330040286286, "deviation-heading": 1.5432802419840048, "set_robot_commands": 0.06694418974597045, "deviation-center-line": 0.2976033703881105, "driven_lanedir_consec": 0.5863186782911962, "sim_compute_sim_state": 0.02893591890431414, "sim_compute_performance-ego": 0.04280408945950595, "sim_compute_robot_state-ego": 0.04876386035572399}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4601374492136299, "sim_physics": 0.07476299917194205, "survival_time": 3.5499999999999954, "driven_lanedir": 0.4546187992944528, "sim_render-ego": 0.03668399595878494, "in-drivable-lane": 0, "agent_compute-ego": 0.05201107347515267, "deviation-heading": 0.4783500635159773, "set_robot_commands": 0.0682686684836804, "deviation-center-line": 0.3215696732608136, "driven_lanedir_consec": 0.4546187992944528, "sim_compute_sim_state": 0.027644476420442824, "sim_compute_performance-ego": 0.04014250594125667, "sim_compute_robot_state-ego": 0.04766347710515412}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.0675124192613885, "sim_physics": 0.0773093072573344, "survival_time": 14.950000000000076, "driven_lanedir": 2.010123563575976, "sim_render-ego": 0.0363422171274821, "in-drivable-lane": 0, "agent_compute-ego": 0.052311307589213055, "deviation-heading": 2.769684889986926, "set_robot_commands": 0.0689547069867452, "deviation-center-line": 1.0002186449025752, "driven_lanedir_consec": 2.010123563575976, "sim_compute_sim_state": 0.0297066330909729, "sim_compute_performance-ego": 0.042552579243977866, "sim_compute_robot_state-ego": 0.05000249306360881}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.081962678438535, "sim_physics": 0.07434181213378906, "survival_time": 14.950000000000076, "driven_lanedir": 2.0148048229342077, "sim_render-ego": 0.036698753833770754, "in-drivable-lane": 0, "agent_compute-ego": 0.052840578556060794, "deviation-heading": 2.9019980388351496, "set_robot_commands": 0.06718560616175334, "deviation-center-line": 0.7422340304530037, "driven_lanedir_consec": 2.0148048229342077, "sim_compute_sim_state": 0.02859974861145019, "sim_compute_performance-ego": 0.0429000186920166, "sim_compute_robot_state-ego": 0.04926316102345785}}
set_robot_commands_max0.06983069737752279
set_robot_commands_mean0.06823677375113443
set_robot_commands_median0.0682686684836804
set_robot_commands_min0.06694418974597045
sim_compute_performance-ego_max0.0429000186920166
sim_compute_performance-ego_mean0.04220600288116774
sim_compute_performance-ego_median0.04263082106908162
sim_compute_performance-ego_min0.04014250594125667
sim_compute_robot_state-ego_max0.05000249306360881
sim_compute_robot_state-ego_mean0.04895801785253736
sim_compute_robot_state-ego_median0.04909709771474202
sim_compute_robot_state-ego_min0.04766347710515412
sim_compute_sim_state_max0.0297066330909729
sim_compute_sim_state_mean0.028761293336496803
sim_compute_sim_state_median0.028919689655303955
sim_compute_sim_state_min0.027644476420442824
sim_physics_max0.0773093072573344
sim_physics_mean0.07443712065504461
sim_physics_median0.07476299917194205
sim_physics_min0.06956413779595885
sim_render-ego_max0.03715049187342326
sim_render-ego_mean0.036693221442678066
sim_render-ego_median0.03668399595878494
sim_render-ego_min0.0363422171274821
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.670000000000044
survival_time_min3.5499999999999954
237133738jp18813100494LF sim test - whaido2-LF-sim-testingstep1-simulationerroryes12910:17:39
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
237083733jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationerroryes12910:02:11
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
236853724jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationsuccessyes12910:31:42(hidden)
driven_lanedir_consec_median0.709012048590294
survival_time_median14.950000000000076
deviation-center-line_median0.38447320334523055
in-drivable-lane_median0


other stats
agent_compute-ego_max0.0996611918846186
agent_compute-ego_mean0.09810469418239014
agent_compute-ego_median0.0980234138170878
agent_compute-ego_min0.09696349541346232
deviation-center-line_max1.438868052751231
deviation-center-line_mean0.48208775053432856
deviation-center-line_min0.0617584420153499
deviation-heading_max5.564545696826533
deviation-heading_mean2.359945341123894
deviation-heading_median1.5742087652078072
deviation-heading_min0.2871123077880753
driven_any_max2.136133509270581
driven_any_mean0.7241300030505512
driven_any_median0.754356812754684
driven_any_min0.01207028324337977
driven_lanedir_consec_max2.0900359741350343
driven_lanedir_consec_mean0.6788604458460102
driven_lanedir_consec_min0.011972988324831402
driven_lanedir_max2.0900359741350343
driven_lanedir_mean0.6788604458460102
driven_lanedir_median0.709012048590294
driven_lanedir_min0.011972988324831402
in-drivable-lane_max3.7000000000000526
in-drivable-lane_mean0.3833333333333363
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0126610440005843, "sim_physics": 0.05420453638970098, "survival_time": 3.949999999999994, "driven_lanedir": 0.6609181258806545, "sim_render-ego": 0.03471648240391212, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0976023100599458, "deviation-heading": 0.858940841687016, "set_robot_commands": 0.05373997929729993, "deviation-center-line": 0.13529134746320506, "driven_lanedir_consec": 0.6609181258806545, "sim_compute_sim_state": 0.022649535649939427, "sim_compute_performance-ego": 0.03844546064545837, "sim_compute_robot_state-ego": 0.040026024927066854}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7595522424314712, "sim_physics": 0.05649709065755208, "survival_time": 14.950000000000076, "driven_lanedir": 0.7352279124260795, "sim_render-ego": 0.035350757439931234, "in-drivable-lane": 0, "agent_compute-ego": 0.0980234138170878, "deviation-heading": 4.795891064811469, "set_robot_commands": 0.05499387820561727, "deviation-center-line": 0.360545942209073, "driven_lanedir_consec": 0.7352279124260795, "sim_compute_sim_state": 0.023203980922698975, "sim_compute_performance-ego": 0.038593909740448, "sim_compute_robot_state-ego": 0.03988143603006999}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9535561139978752, "sim_physics": 0.05531730810801188, "survival_time": 14.950000000000076, "driven_lanedir": 0.9462743954342976, "sim_render-ego": 0.03514857848485311, "in-drivable-lane": 0, "agent_compute-ego": 0.09724403381347656, "deviation-heading": 1.812369823698207, "set_robot_commands": 0.05373850822448731, "deviation-center-line": 0.27508255291473815, "driven_lanedir_consec": 0.9462743954342976, "sim_compute_sim_state": 0.022386131286621095, "sim_compute_performance-ego": 0.0378109057744344, "sim_compute_robot_state-ego": 0.040115397771199546}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9792418325527504, "sim_physics": 0.05794432878494263, "survival_time": 14.950000000000076, "driven_lanedir": 0.9743230583614304, "sim_render-ego": 0.03464421351750692, "in-drivable-lane": 0, "agent_compute-ego": 0.09696349541346232, "deviation-heading": 5.564545696826533, "set_robot_commands": 0.05381812175114949, "deviation-center-line": 0.5179984751883532, "driven_lanedir_consec": 0.9743230583614304, "sim_compute_sim_state": 0.022425337632497152, "sim_compute_performance-ego": 0.03873747825622559, "sim_compute_robot_state-ego": 0.03999961455663045}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.754356812754684, "sim_physics": 0.05876517375310262, "survival_time": 14.950000000000076, "driven_lanedir": 0.7468731885941198, "sim_render-ego": 0.03517238696416219, "in-drivable-lane": 0, "agent_compute-ego": 0.09744280894597372, "deviation-heading": 5.256343632028708, "set_robot_commands": 0.05396216948827108, "deviation-center-line": 0.38447320334523055, "driven_lanedir_consec": 0.7468731885941198, "sim_compute_sim_state": 0.022570263544718423, "sim_compute_performance-ego": 0.03904949982961019, "sim_compute_robot_state-ego": 0.03985714276631673}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0129391163110788, "sim_physics": 0.055006386131368656, "survival_time": 4.6499999999999915, "driven_lanedir": 0.8692143577854579, "sim_render-ego": 0.03456300048417942, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.09755104331560031, "deviation-heading": 1.002728981635512, "set_robot_commands": 0.053575708020117976, "deviation-center-line": 0.24064776928315793, "driven_lanedir_consec": 0.8692143577854579, "sim_compute_sim_state": 0.02249879990854571, "sim_compute_performance-ego": 0.0401685494248585, "sim_compute_robot_state-ego": 0.03994862751294208}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.06203930329353196, "sim_physics": 0.05754446268081665, "survival_time": 14.950000000000076, "driven_lanedir": 0.061569482784165075, "sim_render-ego": 0.03534478743871053, "in-drivable-lane": 0, "agent_compute-ego": 0.09858973026275634, "deviation-heading": 1.645525881043571, "set_robot_commands": 0.054133090972900394, "deviation-center-line": 0.7779901747567166, "driven_lanedir_consec": 0.061569482784165075, "sim_compute_sim_state": 0.02257569392522176, "sim_compute_performance-ego": 0.039389306704203285, "sim_compute_robot_state-ego": 0.040039972464243574}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.15136862047452393, "sim_physics": 0.05534584023231684, "survival_time": 2.1500000000000004, "driven_lanedir": 0.09773519546862808, "sim_render-ego": 0.0343180867128594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.09841010736864668, "deviation-heading": 0.8050995867641144, "set_robot_commands": 0.05409701480421909, "deviation-center-line": 0.13271573895151803, "driven_lanedir_consec": 0.09773519546862808, "sim_compute_sim_state": 0.02252128512360329, "sim_compute_performance-ego": 0.03775852225547613, "sim_compute_robot_state-ego": 0.039420116779416106}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.39366644863819766, "sim_physics": 0.057451059420903526, "survival_time": 1.2000000000000004, "driven_lanedir": 0.3769299980029403, "sim_render-ego": 0.034979045391082764, "in-drivable-lane": 0, "agent_compute-ego": 0.09956639011700948, "deviation-heading": 0.2871123077880753, "set_robot_commands": 0.05402557055155436, "deviation-center-line": 0.0617584420153499, "driven_lanedir_consec": 0.3769299980029403, "sim_compute_sim_state": 0.022832214832305908, "sim_compute_performance-ego": 0.03849690159161886, "sim_compute_robot_state-ego": 0.03986928860346476}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.01207028324337977, "sim_physics": 0.056538570721944174, "survival_time": 14.950000000000076, "driven_lanedir": 0.011972988324831402, "sim_render-ego": 0.035556633472442624, "in-drivable-lane": 0, "agent_compute-ego": 0.09887064536412556, "deviation-heading": 1.5742087652078072, "set_robot_commands": 0.054431983629862464, "deviation-center-line": 0.5186473247667536, "driven_lanedir_consec": 0.011972988324831402, "sim_compute_sim_state": 0.022678641478220626, "sim_compute_performance-ego": 0.03810760656992594, "sim_compute_robot_state-ego": 0.04011669635772705}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.7184318050350545, "sim_physics": 0.054263792037963866, "survival_time": 14.950000000000076, "driven_lanedir": 0.709012048590294, "sim_render-ego": 0.035081058343251544, "in-drivable-lane": 0, "agent_compute-ego": 0.09806182702382406, "deviation-heading": 1.349317653307769, "set_robot_commands": 0.05443323055903117, "deviation-center-line": 1.438868052751231, "driven_lanedir_consec": 0.709012048590294, "sim_compute_sim_state": 0.02238067626953125, "sim_compute_performance-ego": 0.03780695676803589, "sim_compute_robot_state-ego": 0.03987501303354899}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.18588476350540203, "sim_physics": 0.05472529967625936, "survival_time": 14.950000000000076, "driven_lanedir": 0.17552793266900713, "sim_render-ego": 0.03484431743621826, "in-drivable-lane": 3.7000000000000526, "agent_compute-ego": 0.09733277161916096, "deviation-heading": 4.3552318393211715, "set_robot_commands": 0.053373096783955895, "deviation-center-line": 0.34688256652617033, "driven_lanedir_consec": 0.17552793266900713, "sim_compute_sim_state": 0.02230413834253947, "sim_compute_performance-ego": 0.03769482692082723, "sim_compute_robot_state-ego": 0.03941885550816854}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.0626005991626111, "sim_physics": 0.05314427693684896, "survival_time": 14.950000000000076, "driven_lanedir": 0.06235658463734717, "sim_render-ego": 0.035106648604075114, "in-drivable-lane": 0, "agent_compute-ego": 0.09825180530548096, "deviation-heading": 1.4015827358155828, "set_robot_commands": 0.05376312096913655, "deviation-center-line": 0.7257497630175758, "driven_lanedir_consec": 0.06235658463734717, "sim_compute_sim_state": 0.022611144383748373, "sim_compute_performance-ego": 0.038234810034434, "sim_compute_robot_state-ego": 0.03958297888437907}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.136133509270581, "sim_physics": 0.052472587919583286, "survival_time": 6.849999999999984, "driven_lanedir": 2.0900359741350343, "sim_render-ego": 0.034677773496530354, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.0996611918846186, "deviation-heading": 1.1788561841133236, "set_robot_commands": 0.053573258601836045, "deviation-center-line": 0.38841158383151136, "driven_lanedir_consec": 2.0900359741350343, "sim_compute_sim_state": 0.022490000202708, "sim_compute_performance-ego": 0.0378209657042566, "sim_compute_robot_state-ego": 0.039261551669044215}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.6674475510865443, "sim_physics": 0.054576791922251386, "survival_time": 14.950000000000076, "driven_lanedir": 1.6649354445958648, "sim_render-ego": 0.035544300079345705, "in-drivable-lane": 0, "agent_compute-ego": 0.0979988384246826, "deviation-heading": 3.5114251228095523, "set_robot_commands": 0.05351172129313151, "deviation-center-line": 0.9262533209943434, "driven_lanedir_consec": 1.6649354445958648, "sim_compute_sim_state": 0.022145510514577228, "sim_compute_performance-ego": 0.03733561833699544, "sim_compute_robot_state-ego": 0.039485049247741696}}
set_robot_commands_max0.05499387820561727
set_robot_commands_mean0.05394469687683804
set_robot_commands_median0.05381812175114949
set_robot_commands_min0.053373096783955895
sim_compute_performance-ego_max0.0401685494248585
sim_compute_performance-ego_mean0.03836342123712056
sim_compute_performance-ego_median0.038234810034434
sim_compute_performance-ego_min0.03733561833699544
sim_compute_robot_state-ego_max0.04011669635772705
sim_compute_robot_state-ego_mean0.039793184407463975
sim_compute_robot_state-ego_median0.03987501303354899
sim_compute_robot_state-ego_min0.039261551669044215
sim_compute_sim_state_max0.023203980922698975
sim_compute_sim_state_mean0.022551556934498448
sim_compute_sim_state_median0.02252128512360329
sim_compute_sim_state_min0.022145510514577228
sim_physics_max0.05876517375310262
sim_physics_mean0.05558650035823779
sim_physics_median0.05531730810801188
sim_physics_min0.052472587919583286
sim_render-ego_max0.035556633472442624
sim_render-ego_mean0.035003204684604085
sim_render-ego_median0.035081058343251544
sim_render-ego_min0.0343180867128594
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.22000000000005
survival_time_min1.2000000000000004
236823720jp18813100494final test2 - whaido2-LF-sim-testingstep1-simulationfailedyes12910:02:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 60, in on_received_get_commands
               ||     action = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     if action[0]<1e-2:
               || UnboundLocalError: local variable 'action' referenced before assignment
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
236723717jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationfailedyes12910:03:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
236203710ierosodinBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes12910:41:41
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
236173705ierosodinBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationerroryes12910:51:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
235903692Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes12910:11:58(hidden)
driven_lanedir_consec_median0.6514023258687487
survival_time_median4.449999999999992
deviation-center-line_median0.23739122357818904
in-drivable-lane_median0.849999999999997


other stats
agent_compute-ego_max0.14946525361802843
agent_compute-ego_mean0.14370166347578034
agent_compute-ego_median0.14363891463125905
agent_compute-ego_min0.13956740379333496
deviation-center-line_max0.5170746666829398
deviation-center-line_mean0.286490123346237
deviation-center-line_min0.11858883250573632
deviation-heading_max2.8602914150984016
deviation-heading_mean1.7467146270959322
deviation-heading_median1.883489448082707
deviation-heading_min0.7774267019988155
driven_any_max1.806170835824281
driven_any_mean1.0870136375050108
driven_any_median1.098380589429692
driven_any_min0.5292009749888434
driven_lanedir_consec_max1.342369046619216
driven_lanedir_consec_mean0.7701808073457285
driven_lanedir_consec_min0.42382714508842456
driven_lanedir_max1.342369046619216
driven_lanedir_mean0.7701808073457285
driven_lanedir_median0.6514023258687487
driven_lanedir_min0.42382714508842456
in-drivable-lane_max1.099999999999996
in-drivable-lane_mean0.6399999999999977
in-drivable-lane_min0.09999999999999964
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5292009749888434, "sim_physics": 0.1206768936581082, "survival_time": 2.25, "driven_lanedir": 0.42382714508842456, "sim_render-ego": 0.06719823413425022, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.14946525361802843, "deviation-heading": 0.7774267019988155, "set_robot_commands": 0.09415511025322808, "deviation-center-line": 0.14559773692031788, "driven_lanedir_consec": 0.42382714508842456, "sim_compute_sim_state": 0.038673920101589626, "sim_compute_performance-ego": 0.06957403288947211, "sim_compute_robot_state-ego": 0.0786970615386963}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.098380589429692, "sim_physics": 0.10529749580983364, "survival_time": 4.449999999999992, "driven_lanedir": 0.6514023258687487, "sim_render-ego": 0.05653299374526806, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.14373021715142753, "deviation-heading": 1.883489448082707, "set_robot_commands": 0.09079486868354712, "deviation-center-line": 0.23739122357818904, "driven_lanedir_consec": 0.6514023258687487, "sim_compute_sim_state": 0.03746234165148789, "sim_compute_performance-ego": 0.06657439671205671, "sim_compute_robot_state-ego": 0.0706902246796683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.806170835824281, "sim_physics": 0.1079913126368101, "survival_time": 7.349999999999982, "driven_lanedir": 1.342369046619216, "sim_render-ego": 0.060333362241991526, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.1421065281848518, "deviation-heading": 2.8602914150984016, "set_robot_commands": 0.1044308701340033, "deviation-center-line": 0.5170746666829398, "driven_lanedir_consec": 1.342369046619216, "sim_compute_sim_state": 0.03852646042700528, "sim_compute_performance-ego": 0.06795510629407403, "sim_compute_robot_state-ego": 0.07096199437874515}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1615700603052233, "sim_physics": 0.1115765380859375, "survival_time": 4.99999999999999, "driven_lanedir": 0.9798601952252768, "sim_render-ego": 0.06322489500045776, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.13956740379333496, "deviation-heading": 2.2145663289769866, "set_robot_commands": 0.08822371244430542, "deviation-center-line": 0.4137981570440021, "driven_lanedir_consec": 0.9798601952252768, "sim_compute_sim_state": 0.03742807388305664, "sim_compute_performance-ego": 0.06537937641143798, "sim_compute_robot_state-ego": 0.06835029125213624}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8397457269770152, "sim_physics": 0.1080409942134734, "survival_time": 3.099999999999997, "driven_lanedir": 0.45344532392697623, "sim_render-ego": 0.05873402472465269, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.14363891463125905, "deviation-heading": 0.9977992413227512, "set_robot_commands": 0.09034750538487588, "deviation-center-line": 0.11858883250573632, "driven_lanedir_consec": 0.45344532392697623, "sim_compute_sim_state": 0.03952567038997527, "sim_compute_performance-ego": 0.06798774965347783, "sim_compute_robot_state-ego": 0.0664678196753225}}
set_robot_commands_max0.1044308701340033
set_robot_commands_mean0.09359041337999197
set_robot_commands_median0.09079486868354712
set_robot_commands_min0.08822371244430542
sim_compute_performance-ego_max0.06957403288947211
sim_compute_performance-ego_mean0.06749413239210374
sim_compute_performance-ego_median0.06795510629407403
sim_compute_performance-ego_min0.06537937641143798
sim_compute_robot_state-ego_max0.0786970615386963
sim_compute_robot_state-ego_mean0.0710334783049137
sim_compute_robot_state-ego_median0.0706902246796683
sim_compute_robot_state-ego_min0.0664678196753225
sim_compute_sim_state_max0.03952567038997527
sim_compute_sim_state_mean0.03832329329062294
sim_compute_sim_state_median0.03852646042700528
sim_compute_sim_state_min0.03742807388305664
sim_physics_max0.1206768936581082
sim_physics_mean0.11071664688083258
sim_physics_median0.1080409942134734
sim_physics_min0.10529749580983364
sim_render-ego_max0.06719823413425022
sim_render-ego_mean0.06120470196932405
sim_render-ego_median0.060333362241991526
sim_render-ego_min0.05653299374526806
simulation-passed1
survival_time_max7.349999999999982
survival_time_mean4.429999999999993
survival_time_min2.25
234623652MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:39:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
234553649ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes12910:05:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
234083638awoo424HKDUCKaido2-LF-sim-validationstep1-simulationsuccessyes12910:12:14(hidden)
driven_lanedir_consec_median0.3985434806544852
survival_time_median8.999999999999993
deviation-center-line_median0.4195350258812748
in-drivable-lane_median3.3999999999999906


other stats
agent_compute-ego_max0.19601535229455855
agent_compute-ego_mean0.18925902155089003
agent_compute-ego_median0.18951765537261964
agent_compute-ego_min0.18307086096869576
deviation-center-line_max0.7391797512240016
deviation-center-line_mean0.4218625236504649
deviation-center-line_min0.2125450582078782
deviation-heading_max4.112199519161604
deviation-heading_mean1.5034026457446608
deviation-heading_median0.8501527311300738
deviation-heading_min0.548078208681167
driven_any_max1.5491560058468408
driven_any_mean0.8296669819222954
driven_any_median1.00574171915957
driven_any_min0.22605035291042525
driven_lanedir_consec_max0.6196900440864868
driven_lanedir_consec_mean0.3797273266028719
driven_lanedir_consec_min0.217880906877971
driven_lanedir_max0.6196900440864868
driven_lanedir_mean0.3797273266028719
driven_lanedir_median0.3985434806544852
driven_lanedir_min0.217880906877971
in-drivable-lane_max10.950000000000085
in-drivable-lane_mean3.830000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.00574171915957, "sim_physics": 0.05352273252275255, "survival_time": 8.999999999999993, "driven_lanedir": 0.4085994677356664, "sim_render-ego": 0.036618582407633465, "in-drivable-lane": 4.8, "agent_compute-ego": 0.18307086096869576, "deviation-heading": 0.6410804492719147, "set_robot_commands": 0.054311830467647974, "deviation-center-line": 0.5196983327237378, "driven_lanedir_consec": 0.4085994677356664, "sim_compute_sim_state": 0.023450280560387504, "sim_compute_performance-ego": 0.03950999975204468, "sim_compute_robot_state-ego": 0.04130300283432007}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0751999436658484, "sim_physics": 0.05734101563942533, "survival_time": 11.900000000000034, "driven_lanedir": 0.6196900440864868, "sim_render-ego": 0.03815067114950228, "in-drivable-lane": 3.3999999999999906, "agent_compute-ego": 0.1844912256513323, "deviation-heading": 4.112199519161604, "set_robot_commands": 0.05450275966099331, "deviation-center-line": 0.7391797512240016, "driven_lanedir_consec": 0.6196900440864868, "sim_compute_sim_state": 0.023438489737630897, "sim_compute_performance-ego": 0.03898641241698706, "sim_compute_robot_state-ego": 0.04115447176604712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22605035291042525, "sim_physics": 0.056062868663242886, "survival_time": 2.1000000000000005, "driven_lanedir": 0.217880906877971, "sim_render-ego": 0.03547638370877221, "in-drivable-lane": 0, "agent_compute-ego": 0.19601535229455855, "deviation-heading": 0.548078208681167, "set_robot_commands": 0.05333755697522845, "deviation-center-line": 0.21835445021543207, "driven_lanedir_consec": 0.217880906877971, "sim_compute_sim_state": 0.023101710137866792, "sim_compute_performance-ego": 0.03867136864435105, "sim_compute_robot_state-ego": 0.0407523995354062}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.29218688802879217, "sim_physics": 0.05828401020595005, "survival_time": 2.799999999999998, "driven_lanedir": 0.2539227336597505, "sim_render-ego": 0.036623703581946235, "in-drivable-lane": 0, "agent_compute-ego": 0.19320001346724375, "deviation-heading": 1.3655023204785444, "set_robot_commands": 0.054644682577678134, "deviation-center-line": 0.2125450582078782, "driven_lanedir_consec": 0.2539227336597505, "sim_compute_sim_state": 0.02348941990307399, "sim_compute_performance-ego": 0.03930684072630746, "sim_compute_robot_state-ego": 0.04065151725496565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5491560058468408, "sim_physics": 0.057543240388234454, "survival_time": 14.950000000000076, "driven_lanedir": 0.3985434806544852, "sim_render-ego": 0.03616609970728557, "in-drivable-lane": 10.950000000000085, "agent_compute-ego": 0.18951765537261964, "deviation-heading": 0.8501527311300738, "set_robot_commands": 0.05370533227920532, "deviation-center-line": 0.4195350258812748, "driven_lanedir_consec": 0.3985434806544852, "sim_compute_sim_state": 0.023257683118184408, "sim_compute_performance-ego": 0.03863510926564535, "sim_compute_robot_state-ego": 0.04151976744333903}}
set_robot_commands_max0.054644682577678134
set_robot_commands_mean0.054100432392150635
set_robot_commands_median0.054311830467647974
set_robot_commands_min0.05333755697522845
sim_compute_performance-ego_max0.03950999975204468
sim_compute_performance-ego_mean0.03902194616106712
sim_compute_performance-ego_median0.03898641241698706
sim_compute_performance-ego_min0.03863510926564535
sim_compute_robot_state-ego_max0.04151976744333903
sim_compute_robot_state-ego_mean0.04107623176681561
sim_compute_robot_state-ego_median0.04115447176604712
sim_compute_robot_state-ego_min0.04065151725496565
sim_compute_sim_state_max0.02348941990307399
sim_compute_sim_state_mean0.023347516691428715
sim_compute_sim_state_median0.023438489737630897
sim_compute_sim_state_min0.023101710137866792
sim_physics_max0.05828401020595005
sim_physics_mean0.056550773483921055
sim_physics_median0.05734101563942533
sim_physics_min0.05352273252275255
sim_render-ego_max0.03815067114950228
sim_render-ego_mean0.036607088111027954
sim_render-ego_median0.036618582407633465
sim_render-ego_min0.03547638370877221
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.15000000000002
survival_time_min2.1000000000000005
234013634awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes12910:15:11(hidden)
driven_lanedir_consec_median1.2932968863301235
survival_time_median12.000000000000036
deviation-center-line_median0.5428480558509712
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14416495561599732
agent_compute-ego_mean0.14213884926394943
agent_compute-ego_median0.14128753070917605
agent_compute-ego_min0.14045836687088012
deviation-center-line_max1.2545102713230998
deviation-center-line_mean0.622210109555386
deviation-center-line_min0.28009223675992184
deviation-heading_max1.8536757404464157
deviation-heading_mean1.5817646483482783
deviation-heading_median1.7334473101384278
deviation-heading_min1.2491895377385989
driven_any_max1.6803424467176225
driven_any_mean1.3016697591247863
driven_any_median1.356331216069872
driven_any_min1.0019717789023883
driven_lanedir_consec_max1.671543605018729
driven_lanedir_consec_mean1.2020197376945547
driven_lanedir_consec_min0.7166359896439909
driven_lanedir_max1.671543605018729
driven_lanedir_mean1.2020197376945547
driven_lanedir_median1.2932968863301235
driven_lanedir_min0.7166359896439909
in-drivable-lane_max2.8500000000000405
in-drivable-lane_mean0.6200000000000088
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.103080333151624, "sim_physics": 0.05468600260186519, "survival_time": 11.050000000000022, "driven_lanedir": 0.7166359896439909, "sim_render-ego": 0.03667079161734602, "in-drivable-lane": 2.8500000000000405, "agent_compute-ego": 0.14128753070917605, "deviation-heading": 1.7600329620639388, "set_robot_commands": 0.05528489065386052, "deviation-center-line": 0.387653382470645, "driven_lanedir_consec": 0.7166359896439909, "sim_compute_sim_state": 0.022879539032327645, "sim_compute_performance-ego": 0.038152635367207935, "sim_compute_robot_state-ego": 0.04012442282422096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.356331216069872, "sim_physics": 0.054363184173901874, "survival_time": 12.000000000000036, "driven_lanedir": 1.343815051014507, "sim_render-ego": 0.034600035349528, "in-drivable-lane": 0, "agent_compute-ego": 0.14416495561599732, "deviation-heading": 1.3124776913540108, "set_robot_commands": 0.05461906393369039, "deviation-center-line": 0.5428480558509712, "driven_lanedir_consec": 1.343815051014507, "sim_compute_sim_state": 0.02261511584122976, "sim_compute_performance-ego": 0.03852868676185608, "sim_compute_robot_state-ego": 0.04001905620098114}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6803424467176225, "sim_physics": 0.05571472326914469, "survival_time": 14.950000000000076, "driven_lanedir": 1.671543605018729, "sim_render-ego": 0.03503158728281657, "in-drivable-lane": 0, "agent_compute-ego": 0.14045836687088012, "deviation-heading": 1.2491895377385989, "set_robot_commands": 0.05436585982640584, "deviation-center-line": 1.2545102713230998, "driven_lanedir_consec": 1.671543605018729, "sim_compute_sim_state": 0.02255563497543335, "sim_compute_performance-ego": 0.03810618082682292, "sim_compute_robot_state-ego": 0.03945291916529337}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0019717789023883, "sim_physics": 0.053666700396621435, "survival_time": 11.400000000000029, "driven_lanedir": 0.9848071564654224, "sim_render-ego": 0.0350069612787481, "in-drivable-lane": 0, "agent_compute-ego": 0.14411154546235738, "deviation-heading": 1.7334473101384278, "set_robot_commands": 0.05475003572932461, "deviation-center-line": 0.6459466013722925, "driven_lanedir_consec": 0.9848071564654224, "sim_compute_sim_state": 0.02248706629401759, "sim_compute_performance-ego": 0.0381512349111992, "sim_compute_robot_state-ego": 0.03922048890799807}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.366623020782425, "sim_physics": 0.053456055323282875, "survival_time": 14.950000000000076, "driven_lanedir": 1.2932968863301235, "sim_render-ego": 0.03487984418869019, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.14067184766133625, "deviation-heading": 1.8536757404464157, "set_robot_commands": 0.05490405162175496, "deviation-center-line": 0.28009223675992184, "driven_lanedir_consec": 1.2932968863301235, "sim_compute_sim_state": 0.0224370543162028, "sim_compute_performance-ego": 0.03797109603881836, "sim_compute_robot_state-ego": 0.03966047128041585}}
set_robot_commands_max0.05528489065386052
set_robot_commands_mean0.05478478035300727
set_robot_commands_median0.05475003572932461
set_robot_commands_min0.05436585982640584
sim_compute_performance-ego_max0.03852868676185608
sim_compute_performance-ego_mean0.038181966781180895
sim_compute_performance-ego_median0.0381512349111992
sim_compute_performance-ego_min0.03797109603881836
sim_compute_robot_state-ego_max0.04012442282422096
sim_compute_robot_state-ego_mean0.03969547167578188
sim_compute_robot_state-ego_median0.03966047128041585
sim_compute_robot_state-ego_min0.03922048890799807
sim_compute_sim_state_max0.022879539032327645
sim_compute_sim_state_mean0.02259488209184223
sim_compute_sim_state_median0.02255563497543335
sim_compute_sim_state_min0.0224370543162028
sim_physics_max0.05571472326914469
sim_physics_mean0.05437733315296321
sim_physics_median0.054363184173901874
sim_physics_min0.053456055323282875
sim_render-ego_max0.03667079161734602
sim_render-ego_mean0.03523784394342578
sim_render-ego_median0.0350069612787481
sim_render-ego_min0.034600035349528
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.870000000000047
survival_time_min11.050000000000022
233903632enickyaido2-LFVI-sim-testingstep1-simulationsuccessyes12910:24:15(hidden)
driven_lanedir_consec_median0.4443672320455454
survival_time_median2.499999999999999
deviation-center-line_median0.15455097642444732
in-drivable-lane_median0.7000000000000006


other stats
agent_compute-ego_max0.12579487787710653
agent_compute-ego_mean0.10108475088377546
agent_compute-ego_median0.09728738239833289
agent_compute-ego_min0.09507711483882024
deviation-center-line_max1.068229629093837
deviation-center-line_mean0.25274867543065366
deviation-center-line_min0.054904029848945685
deviation-heading_max3.507487670047857
deviation-heading_mean0.9951171151839956
deviation-heading_median0.4411806188695786
deviation-heading_min0.13989224355569133
driven_any_max3.207709657944666
driven_any_mean1.2513357364761413
driven_any_median1.008977359835069
driven_any_min0.37149985167138017
driven_lanedir_consec_max2.3108240053208213
driven_lanedir_consec_mean0.8535592430911254
driven_lanedir_consec_min0.17855427696068582
driven_lanedir_max2.3527222534487895
driven_lanedir_mean0.927270844605768
driven_lanedir_median0.4443672320455454
driven_lanedir_min0.17855427696068582
in-drivable-lane_max7.450000000000026
in-drivable-lane_mean1.6266666666666665
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.50162892780929, "sim_physics": 0.1303127762433645, "survival_time": 7.399999999999982, "driven_lanedir": 2.1208268912576216, "sim_render-ego": 0.04695734140035268, "in-drivable-lane": 3.4499999999999877, "agent_compute-ego": 0.12579487787710653, "deviation-heading": 0.36159719377172606, "set_robot_commands": 0.06898449562691353, "deviation-center-line": 0.28905228033842156, "driven_lanedir_consec": 2.120743097074997, "sim_compute_sim_state": 0.028648276586790342, "sim_compute_performance-ego": 0.05047347900029775, "sim_compute_robot_state-ego": 0.05037268271317353, "sim_compute_robot_state-npc0": 0.05097346853565525, "sim_compute_robot_state-npc1": 0.0496539602408538, "sim_compute_robot_state-npc2": 0.050061113125569115, "sim_compute_robot_state-npc3": 0.04985267084998053}, "udem1-1-0": {"driven_any": 0.46051146883057115, "sim_physics": 0.13298135454004462, "survival_time": 1.1000000000000003, "driven_lanedir": 0.43495908029179065, "sim_render-ego": 0.04310985044999556, "in-drivable-lane": 0, "agent_compute-ego": 0.10952236435630104, "deviation-heading": 0.3681646786246837, "set_robot_commands": 0.06221373514695601, "deviation-center-line": 0.07726482156623102, "driven_lanedir_consec": 0.43495908029179065, "sim_compute_sim_state": 0.025588566606695003, "sim_compute_performance-ego": 0.04710344834761186, "sim_compute_robot_state-ego": 0.04837015542117032, "sim_compute_robot_state-npc0": 0.04974007606506348, "sim_compute_robot_state-npc1": 0.0468057935888117, "sim_compute_robot_state-npc2": 0.04548823833465576, "sim_compute_robot_state-npc3": 0.04403805732727051}, "udem1-2-0": {"driven_any": 2.4755270458423686, "sim_physics": 0.1217907802113947, "survival_time": 10.600000000000016, "driven_lanedir": 2.1506205729307473, "sim_render-ego": 0.043521931711232885, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.12083262542508684, "deviation-heading": 3.451647136461856, "set_robot_commands": 0.0674754594856838, "deviation-center-line": 1.068229629093837, "driven_lanedir_consec": 1.7413838620089876, "sim_compute_sim_state": 0.02754419817114776, "sim_compute_performance-ego": 0.04666406928368334, "sim_compute_robot_state-ego": 0.04895027965869544, "sim_compute_robot_state-npc0": 0.04968261381365218, "sim_compute_robot_state-npc1": 0.04972328779832373, "sim_compute_robot_state-npc2": 0.05014199130939988, "sim_compute_robot_state-npc3": 0.04844863347287448}, "udem1-3-0": {"driven_any": 3.207709657944666, "sim_physics": 0.10023000280735855, "survival_time": 11.800000000000033, "driven_lanedir": 2.3527222534487895, "sim_render-ego": 0.0356690782611653, "in-drivable-lane": 7.450000000000026, "agent_compute-ego": 0.09610077385175024, "deviation-heading": 0.4411806188695786, "set_robot_commands": 0.05528494766203024, "deviation-center-line": 0.3742483665016732, "driven_lanedir_consec": 2.3108240053208213, "sim_compute_sim_state": 0.022265896958819892, "sim_compute_performance-ego": 0.038034861370668575, "sim_compute_robot_state-ego": 0.04034038721504858, "sim_compute_robot_state-npc0": 0.03982664467924732, "sim_compute_robot_state-npc1": 0.03922452259871919, "sim_compute_robot_state-npc2": 0.03899813708612474, "sim_compute_robot_state-npc3": 0.039018103631876286}, "udem1-4-0": {"driven_any": 0.400811386017319, "sim_physics": 0.10934990644454956, "survival_time": 1.0000000000000002, "driven_lanedir": 0.38693847040587825, "sim_render-ego": 0.035493326187133786, "in-drivable-lane": 0, "agent_compute-ego": 0.0954519271850586, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.054077553749084475, "deviation-center-line": 0.060733287044270105, "driven_lanedir_consec": 0.38693847040587825, "sim_compute_sim_state": 0.022308659553527833, "sim_compute_performance-ego": 0.038115501403808594, "sim_compute_robot_state-ego": 0.040381121635437014, "sim_compute_robot_state-npc0": 0.03984323740005493, "sim_compute_robot_state-npc1": 0.03899335861206055, "sim_compute_robot_state-npc2": 0.03885066509246826, "sim_compute_robot_state-npc3": 0.03912315368652344}, "udem1-5-0": {"driven_any": 1.1301285156014205, "sim_physics": 0.10505011081695556, "survival_time": 2.499999999999999, "driven_lanedir": 0.3805698593940634, "sim_render-ego": 0.03573078632354736, "in-drivable-lane": 1.0500000000000005, "agent_compute-ego": 0.09628181457519532, "deviation-heading": 0.924976817672808, "set_robot_commands": 0.0547673749923706, "deviation-center-line": 0.1205488749427968, "driven_lanedir_consec": 0.3805698593940634, "sim_compute_sim_state": 0.02251267433166504, "sim_compute_performance-ego": 0.03866978645324707, "sim_compute_robot_state-ego": 0.04052900791168213, "sim_compute_robot_state-npc0": 0.04008974075317383, "sim_compute_robot_state-npc1": 0.039516873359680176, "sim_compute_robot_state-npc2": 0.03927776336669922, "sim_compute_robot_state-npc3": 0.03932257175445557}, "udem1-6-0": {"driven_any": 0.8796785144013353, "sim_physics": 0.12079187896516588, "survival_time": 1.800000000000001, "driven_lanedir": 0.8770246919234508, "sim_render-ego": 0.0354907578892178, "in-drivable-lane": 0, "agent_compute-ego": 0.0972089370091756, "deviation-heading": 0.13989224355569133, "set_robot_commands": 0.053935719860924616, "deviation-center-line": 0.15455097642444732, "driven_lanedir_consec": 0.8770246919234508, "sim_compute_sim_state": 0.022196325990888808, "sim_compute_performance-ego": 0.03794503211975098, "sim_compute_robot_state-ego": 0.04126464658313327, "sim_compute_robot_state-npc0": 0.03960323996014065, "sim_compute_robot_state-npc1": 0.03883483674791125, "sim_compute_robot_state-npc2": 0.03868100378248426, "sim_compute_robot_state-npc3": 0.03876482778125339}, "udem1-7-0": {"driven_any": 1.008977359835069, "sim_physics": 0.11556951896004054, "survival_time": 2.3, "driven_lanedir": 0.8934759392227924, "sim_render-ego": 0.03565124843431556, "in-drivable-lane": 0, "agent_compute-ego": 0.09798097610473631, "deviation-heading": 1.0583693635822085, "set_robot_commands": 0.05415734000827955, "deviation-center-line": 0.15983372236288246, "driven_lanedir_consec": 0.8770842728627053, "sim_compute_sim_state": 0.02212951494299847, "sim_compute_performance-ego": 0.03800359497899595, "sim_compute_robot_state-ego": 0.04024951354317043, "sim_compute_robot_state-npc0": 0.03961937842161759, "sim_compute_robot_state-npc1": 0.03878322373265806, "sim_compute_robot_state-npc2": 0.03870572214541228, "sim_compute_robot_state-npc3": 0.03885953322700832}, "udem1-8-0": {"driven_any": 1.7854758389187866, "sim_physics": 0.10307882485851164, "survival_time": 6.199999999999986, "driven_lanedir": 1.2770502106053638, "sim_render-ego": 0.03547324865095077, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.09789155375572944, "deviation-heading": 1.9536260214987975, "set_robot_commands": 0.054199653287087715, "deviation-center-line": 0.5971886468995992, "driven_lanedir_consec": 1.2770502106053638, "sim_compute_sim_state": 0.022464085009790236, "sim_compute_performance-ego": 0.03824980797306184, "sim_compute_robot_state-ego": 0.04056805372238159, "sim_compute_robot_state-npc0": 0.040431601385916435, "sim_compute_robot_state-npc1": 0.039307578917472594, "sim_compute_robot_state-npc2": 0.03910266199419575, "sim_compute_robot_state-npc3": 0.039195724071994904}, "udem1-9-0": {"driven_any": 0.4605114688305781, "sim_physics": 0.12386540933088824, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4443672320455454, "sim_render-ego": 0.03590524196624756, "in-drivable-lane": 0, "agent_compute-ego": 0.09735300324179907, "deviation-heading": 0.2921306476839709, "set_robot_commands": 0.05389658971266313, "deviation-center-line": 0.06393804025783281, "driven_lanedir_consec": 0.4443672320455454, "sim_compute_sim_state": 0.022110364653847435, "sim_compute_performance-ego": 0.038040778853676536, "sim_compute_robot_state-ego": 0.04074032740159468, "sim_compute_robot_state-npc0": 0.03951588543978604, "sim_compute_robot_state-npc1": 0.03916941989551891, "sim_compute_robot_state-npc2": 0.03889300606467507, "sim_compute_robot_state-npc3": 0.03867713971571489}, "udem1-10-0": {"driven_any": 0.37149985167138017, "sim_physics": 0.1119976796601948, "survival_time": 0.9500000000000004, "driven_lanedir": 0.3517991142132264, "sim_render-ego": 0.03666752263119346, "in-drivable-lane": 0, "agent_compute-ego": 0.098503966080515, "deviation-heading": 0.31076793256366336, "set_robot_commands": 0.05368198846515856, "deviation-center-line": 0.054904029848945685, "driven_lanedir_consec": 0.3517991142132264, "sim_compute_sim_state": 0.022528824053312604, "sim_compute_performance-ego": 0.03859118411415502, "sim_compute_robot_state-ego": 0.04058632097746197, "sim_compute_robot_state-npc0": 0.03987253339667069, "sim_compute_robot_state-npc1": 0.03933215141296387, "sim_compute_robot_state-npc2": 0.03958532684727719, "sim_compute_robot_state-npc3": 0.03924484001962762}, "udem1-11-0": {"driven_any": 0.4307612897755775, "sim_physics": 0.10577259744916644, "survival_time": 1.0500000000000005, "driven_lanedir": 0.4261291824030562, "sim_render-ego": 0.03615953808739072, "in-drivable-lane": 0, "agent_compute-ego": 0.09728738239833289, "deviation-heading": 0.1541202345559414, "set_robot_commands": 0.05390955152965728, "deviation-center-line": 0.09941469755038562, "driven_lanedir_consec": 0.4261291824030562, "sim_compute_sim_state": 0.02273197401137579, "sim_compute_performance-ego": 0.03836211704072498, "sim_compute_robot_state-ego": 0.040588185900733584, "sim_compute_robot_state-npc0": 0.05611964634486607, "sim_compute_robot_state-npc1": 0.03938428560892741, "sim_compute_robot_state-npc2": 0.039196196056547616, "sim_compute_robot_state-npc3": 0.03936022803896949}, "udem1-12-0": {"driven_any": 1.3824591937553763, "sim_physics": 0.10541878400310394, "survival_time": 6.199999999999986, "driven_lanedir": 0.3402246555815205, "sim_render-ego": 0.03534124166734757, "in-drivable-lane": 4.799999999999987, "agent_compute-ego": 0.09544034158029864, "deviation-heading": 0.9247813938323732, "set_robot_commands": 0.05343397202030305, "deviation-center-line": 0.16225221199578418, "driven_lanedir_consec": 0.3402246555815205, "sim_compute_sim_state": 0.022105830331002514, "sim_compute_performance-ego": 0.03774715623547954, "sim_compute_robot_state-ego": 0.04032877952821793, "sim_compute_robot_state-npc0": 0.039503928153745586, "sim_compute_robot_state-npc1": 0.038867089056199594, "sim_compute_robot_state-npc2": 0.038661237685911114, "sim_compute_robot_state-npc3": 0.038693595317102245}, "udem1-13-0": {"driven_any": 1.628837292636662, "sim_physics": 0.09903453557919233, "survival_time": 9.750000000000004, "driven_lanedir": 1.2938002384019889, "sim_render-ego": 0.03524814874697954, "in-drivable-lane": 4.050000000000004, "agent_compute-ego": 0.09507711483882024, "deviation-heading": 3.507487670047857, "set_robot_commands": 0.053537992330697864, "deviation-center-line": 0.43117857132256254, "driven_lanedir_consec": 0.6557366352747889, "sim_compute_sim_state": 0.02230414121578901, "sim_compute_performance-ego": 0.038157142736972904, "sim_compute_robot_state-ego": 0.04021897927308694, "sim_compute_robot_state-npc0": 0.03988419679495005, "sim_compute_robot_state-npc1": 0.039271280093070786, "sim_compute_robot_state-npc2": 0.03896530591524564, "sim_compute_robot_state-npc3": 0.0393251590239696}, "udem1-14-0": {"driven_any": 0.6455182352717241, "sim_physics": 0.11480471323121268, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17855427696068582, "sim_render-ego": 0.035964025641387364, "in-drivable-lane": 1.099999999999998, "agent_compute-ego": 0.09554360497672602, "deviation-heading": 0.7741476850944534, "set_robot_commands": 0.05371708689995531, "deviation-center-line": 0.077891975310135, "driven_lanedir_consec": 0.17855427696068582, "sim_compute_sim_state": 0.02211646313937205, "sim_compute_performance-ego": 0.037973520890721736, "sim_compute_robot_state-ego": 0.040326248924687225, "sim_compute_robot_state-npc0": 0.03950341692510641, "sim_compute_robot_state-npc1": 0.038845548089945094, "sim_compute_robot_state-npc2": 0.03881252486750765, "sim_compute_robot_state-npc3": 0.03934516097014805}}
set_robot_commands_max0.06898449562691353
set_robot_commands_mean0.05648489738518439
set_robot_commands_median0.054077553749084475
set_robot_commands_min0.05343397202030305
sim_compute_performance-ego_max0.05047347900029775
sim_compute_performance-ego_mean0.04014209872019044
sim_compute_performance-ego_median0.038157142736972904
sim_compute_performance-ego_min0.03774715623547954
sim_compute_robot_state-ego_max0.05037268271317353
sim_compute_robot_state-ego_mean0.04225431269397831
sim_compute_robot_state-ego_median0.04056805372238159
sim_compute_robot_state-ego_min0.04021897927308694
sim_compute_robot_state-npc0_max0.05611964634486607
sim_compute_robot_state-npc0_mean0.0429473072046431
sim_compute_robot_state-npc0_median0.03987253339667069
sim_compute_robot_state-npc0_min0.03950341692510641
sim_compute_robot_state-npc1_max0.04972328779832373
sim_compute_robot_state-npc1_mean0.04104754731687445
sim_compute_robot_state-npc1_median0.039271280093070786
sim_compute_robot_state-npc1_min0.03878322373265806
sim_compute_robot_state-npc2_max0.05014199130939988
sim_compute_robot_state-npc2_mean0.040894726244944904
sim_compute_robot_state-npc2_median0.03899813708612474
sim_compute_robot_state-npc2_min0.038661237685911114
sim_compute_robot_state-npc3_max0.04985267084998053
sim_compute_robot_state-npc3_mean0.04075129325925129
sim_compute_robot_state-npc3_median0.03924484001962762
sim_compute_robot_state-npc3_min0.03867713971571489
sim_compute_sim_state_max0.028648276586790342
sim_compute_sim_state_mean0.02330371970380152
sim_compute_sim_state_median0.022308659553527833
sim_compute_sim_state_min0.022105830331002514
sim_physics_max0.13298135454004462
sim_physics_mean0.11333659154007628
sim_physics_median0.1119976796601948
sim_physics_min0.09903453557919233
sim_render-ego_max0.04695734140035268
sim_render-ego_mean0.03749221920323052
sim_render-ego_median0.03573078632354736
sim_render-ego_min0.03524814874697954
simulation-passed1
survival_time_max11.800000000000033
survival_time_mean4.426666666666667
survival_time_min0.9500000000000004
233793620MYFtestaido2-LFVI-sim-testingstep1-simulationerroryes12910:23:36
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233563609riza.veliogluaido2-LFV-sim-testingstep1-simulationerroryes12910:05:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233553604MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:29:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233533602MYFtestaido2-LFV-sim-testingstep1-simulationerroryes12910:10:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233323597Victor Adolfo Romero Canoaido2-LFV-sim-testingstep1-simulationsuccessyes12910:13:27(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.12117403966409188
agent_compute-ego_mean0.0943884288169612
agent_compute-ego_median0.08579270044962566
agent_compute-ego_min0.0847318172454834
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11150115066104466, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04608925625129982, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.12117403966409188, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.06987743024472837, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02789100452705666, "sim_compute_performance-ego": 0.04859203762478299, "sim_compute_robot_state-ego": 0.05176416591361717, "sim_compute_robot_state-npc0": 0.05264091933215106, "sim_compute_robot_state-npc1": 0.051717678705851235, "sim_compute_robot_state-npc2": 0.05222060503783049, "sim_compute_robot_state-npc3": 0.05050568668930619}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.1309053611755371, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.04664741516113281, "in-drivable-lane": 0, "agent_compute-ego": 0.11681883811950684, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.07168488502502442, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.030660943984985353, "sim_compute_performance-ego": 0.052088136672973635, "sim_compute_robot_state-ego": 0.05363428115844727, "sim_compute_robot_state-npc0": 0.051275386810302734, "sim_compute_robot_state-npc1": 0.04797172546386719, "sim_compute_robot_state-npc2": 0.05204931259155274, "sim_compute_robot_state-npc3": 0.05395244598388672}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12064300712786225, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.043275378252330576, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10630479298139874, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06280541106274254, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02797605175721018, "sim_compute_performance-ego": 0.04827641185961271, "sim_compute_robot_state-ego": 0.04914965127643786, "sim_compute_robot_state-npc0": 0.04643561965540836, "sim_compute_robot_state-npc1": 0.04619423652950086, "sim_compute_robot_state-npc2": 0.046722440343154106, "sim_compute_robot_state-npc3": 0.047222987601631565}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.12712318685990345, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.043375664119479025, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11014933525761472, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.06800885441937024, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.027159917203685904, "sim_compute_performance-ego": 0.04722817638252355, "sim_compute_robot_state-ego": 0.05012507378300534, "sim_compute_robot_state-npc0": 0.05246663998953904, "sim_compute_robot_state-npc1": 0.051373901246469234, "sim_compute_robot_state-npc2": 0.04975870892971377, "sim_compute_robot_state-npc3": 0.049436035035531734}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.10010761874062676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04044470616749355, "in-drivable-lane": 0, "agent_compute-ego": 0.10578417778015135, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.060710276876177104, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.023120462894439697, "sim_compute_performance-ego": 0.04603620086397443, "sim_compute_robot_state-ego": 0.04451092651912144, "sim_compute_robot_state-npc0": 0.04329056399209159, "sim_compute_robot_state-npc1": 0.04232628004891532, "sim_compute_robot_state-npc2": 0.04309627839497158, "sim_compute_robot_state-npc3": 0.04184817416327341}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08194327354431152, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.03521350578025535, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08624926761344627, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.0536988134737368, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022231746602941443, "sim_compute_performance-ego": 0.0406493654957524, "sim_compute_robot_state-ego": 0.04001951217651367, "sim_compute_robot_state-npc0": 0.039231057520265934, "sim_compute_robot_state-npc1": 0.03960601930265074, "sim_compute_robot_state-npc2": 0.03868971047578035, "sim_compute_robot_state-npc3": 0.03861169903366654}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0844954737910518, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.03490696571491383, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08579270044962566, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0532834044209233, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022049034083331073, "sim_compute_performance-ego": 0.037778125868903265, "sim_compute_robot_state-ego": 0.03988954755995008, "sim_compute_robot_state-npc0": 0.039292494455973305, "sim_compute_robot_state-npc1": 0.03864149252573649, "sim_compute_robot_state-npc2": 0.03863577489499693, "sim_compute_robot_state-npc3": 0.0385353167851766}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.11228564580281576, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.03631012704637315, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08685203658209907, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05411349402533637, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022988091574774848, "sim_compute_performance-ego": 0.03919310569763183, "sim_compute_robot_state-ego": 0.04229167302449544, "sim_compute_robot_state-npc0": 0.04039191669887966, "sim_compute_robot_state-npc1": 0.040125799179077146, "sim_compute_robot_state-npc2": 0.03963661193847656, "sim_compute_robot_state-npc3": 0.04009330007765028}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08624698804772418, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03493636587391729, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08536121119623599, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05324211327925972, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.02224360859912375, "sim_compute_performance-ego": 0.037977228993954865, "sim_compute_robot_state-ego": 0.04002940654754639, "sim_compute_robot_state-npc0": 0.039358786914659584, "sim_compute_robot_state-npc1": 0.03873440493708071, "sim_compute_robot_state-npc2": 0.038615936818330185, "sim_compute_robot_state-npc3": 0.03882363568181577}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.10017043590545656, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034849538803100585, "in-drivable-lane": 0, "agent_compute-ego": 0.08571155071258545, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.053426289558410646, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02205103874206543, "sim_compute_performance-ego": 0.03853568077087402, "sim_compute_robot_state-ego": 0.0427286434173584, "sim_compute_robot_state-npc0": 0.03912705421447754, "sim_compute_robot_state-npc1": 0.03872065067291259, "sim_compute_robot_state-npc2": 0.0386264181137085, "sim_compute_robot_state-npc3": 0.0386556339263916}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.1122372031211853, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.0351258397102356, "in-drivable-lane": 0, "agent_compute-ego": 0.0855568528175354, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05282052755355835, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.0220969557762146, "sim_compute_performance-ego": 0.037859654426574706, "sim_compute_robot_state-ego": 0.03998314142227173, "sim_compute_robot_state-npc0": 0.039096271991729735, "sim_compute_robot_state-npc1": 0.038419461250305174, "sim_compute_robot_state-npc2": 0.03839997053146362, "sim_compute_robot_state-npc3": 0.0385094404220581}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08870715844003778, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.03434359399895919, "in-drivable-lane": 0, "agent_compute-ego": 0.0847318172454834, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05273724857129549, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02198984748438785, "sim_compute_performance-ego": 0.037758864854511465, "sim_compute_robot_state-ego": 0.03959963196202328, "sim_compute_robot_state-npc0": 0.03901698714808414, "sim_compute_robot_state-npc1": 0.03854633632459139, "sim_compute_robot_state-npc2": 0.03842009996113024, "sim_compute_robot_state-npc3": 0.038662734784578025}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.082181396484375, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.03448686599731445, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.0849280023574829, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.05235579967498779, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02206511974334717, "sim_compute_performance-ego": 0.037347850799560545, "sim_compute_robot_state-ego": 0.03948755264282226, "sim_compute_robot_state-npc0": 0.03905360221862793, "sim_compute_robot_state-npc1": 0.03832610607147217, "sim_compute_robot_state-npc2": 0.03896951675415039, "sim_compute_robot_state-npc3": 0.03840787410736084}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1042057600888339, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035158601674166595, "in-drivable-lane": 0, "agent_compute-ego": 0.0850601087916981, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.05273234844207764, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.022030754522843796, "sim_compute_performance-ego": 0.03761691396886653, "sim_compute_robot_state-ego": 0.03987704623829235, "sim_compute_robot_state-npc0": 0.03899142958901145, "sim_compute_robot_state-npc1": 0.03853940963745117, "sim_compute_robot_state-npc2": 0.03844360871748491, "sim_compute_robot_state-npc3": 0.03821939771825617}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10011285178515376, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.034939201510682395, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08535170068546218, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.052632229668753486, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02192103619478187, "sim_compute_performance-ego": 0.03753426610207071, "sim_compute_robot_state-ego": 0.03961390378523846, "sim_compute_robot_state-npc0": 0.046734848800970584, "sim_compute_robot_state-npc1": 0.03838518687656948, "sim_compute_robot_state-npc2": 0.03809822822103695, "sim_compute_robot_state-npc3": 0.03828405847354811}}
set_robot_commands_max0.07168488502502442
set_robot_commands_mean0.05760860841975882
set_robot_commands_median0.053426289558410646
set_robot_commands_min0.05235579967498779
sim_compute_performance-ego_max0.052088136672973635
sim_compute_performance-ego_mean0.041631468025504506
sim_compute_performance-ego_median0.03853568077087402
sim_compute_performance-ego_min0.037347850799560545
sim_compute_robot_state-ego_max0.05363428115844727
sim_compute_robot_state-ego_mean0.043513610495142734
sim_compute_robot_state-ego_median0.04002940654754639
sim_compute_robot_state-ego_min0.03948755264282226
sim_compute_robot_state-npc0_max0.05264091933215106
sim_compute_robot_state-npc0_mean0.04309357195547817
sim_compute_robot_state-npc0_median0.039358786914659584
sim_compute_robot_state-npc0_min0.03899142958901145
sim_compute_robot_state-npc1_max0.051717678705851235
sim_compute_robot_state-npc1_mean0.041841912584830054
sim_compute_robot_state-npc1_median0.03873440493708071
sim_compute_robot_state-npc1_min0.03832610607147217
sim_compute_robot_state-npc2_max0.05222060503783049
sim_compute_robot_state-npc2_mean0.04202554811491875
sim_compute_robot_state-npc2_median0.03868971047578035
sim_compute_robot_state-npc2_min0.03809822822103695
sim_compute_robot_state-npc3_max0.05395244598388672
sim_compute_robot_state-npc3_mean0.041984561365608776
sim_compute_robot_state-npc3_median0.038662734784578025
sim_compute_robot_state-npc3_min0.03821939771825617
sim_compute_sim_state_max0.030660943984985353
sim_compute_sim_state_mean0.02389837424607931
sim_compute_sim_state_median0.022231746602941443
sim_compute_sim_state_min0.02192103619478187
sim_physics_max0.1309053611755371
sim_physics_mean0.10285776743839464
sim_physics_median0.10017043590545656
sim_physics_min0.08194327354431152
sim_render-ego_max0.04664741516113281
sim_render-ego_mean0.038006868404110286
sim_render-ego_median0.035158601674166595
sim_render-ego_min0.03434359399895919
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
232923513Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessyes12910:08:12(hidden)
driven_lanedir_consec_median0.126519619846877
survival_time_median1.2500000000000004
deviation-center-line_median0.09099610507857396
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17437504952953709
agent_compute-ego_mean0.15807920630602
agent_compute-ego_median0.15490864753723144
agent_compute-ego_min0.1480963627497355
deviation-center-line_max0.1133884355221843
deviation-center-line_mean0.08992195278247239
deviation-center-line_min0.06389265570941403
deviation-heading_max0.9918498881185052
deviation-heading_mean0.6989804307508887
deviation-heading_median0.7489263178993967
deviation-heading_min0.4286232289812193
driven_any_max0.2071389909002107
driven_any_mean0.18601213728065524
driven_any_median0.1843375442846786
driven_any_min0.16473283374657466
driven_lanedir_consec_max0.15677666245360866
driven_lanedir_consec_mean0.1267139230659188
driven_lanedir_consec_min0.09642465400829003
driven_lanedir_max0.15677666245360866
driven_lanedir_mean0.1267139230659188
driven_lanedir_median0.126519619846877
driven_lanedir_min0.09642465400829003
in-drivable-lane_max0.20000000000000015
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2041346079356744, "sim_physics": 0.20655958114131803, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09642465400829003, "sim_render-ego": 0.06199335282848727, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.17437504952953709, "deviation-heading": 0.8654299790414866, "set_robot_commands": 0.08897796753914125, "deviation-center-line": 0.07535448141486417, "driven_lanedir_consec": 0.09642465400829003, "sim_compute_sim_state": 0.03978893064683483, "sim_compute_performance-ego": 0.0695214117726972, "sim_compute_robot_state-ego": 0.07844278120225476, "sim_compute_robot_state-npc0": 0.06974702496682444, "sim_compute_robot_state-npc1": 0.06656402926291188, "sim_compute_robot_state-npc2": 0.06976249141077842, "sim_compute_robot_state-npc3": 0.06549476808117281}, "udem1-1-0": {"driven_any": 0.2071389909002107, "sim_physics": 0.19499941225405093, "survival_time": 1.3500000000000003, "driven_lanedir": 0.126519619846877, "sim_render-ego": 0.061435558177806715, "in-drivable-lane": 0, "agent_compute-ego": 0.1538143687778049, "deviation-heading": 0.9918498881185052, "set_robot_commands": 0.07576971583896214, "deviation-center-line": 0.09099610507857396, "driven_lanedir_consec": 0.126519619846877, "sim_compute_sim_state": 0.03699239978083858, "sim_compute_performance-ego": 0.06923903359307183, "sim_compute_robot_state-ego": 0.0686461572293882, "sim_compute_robot_state-npc0": 0.06295571503815828, "sim_compute_robot_state-npc1": 0.05931214933042173, "sim_compute_robot_state-npc2": 0.05754051385102449, "sim_compute_robot_state-npc3": 0.06738716584664804}, "udem1-2-0": {"driven_any": 0.1843375442846786, "sim_physics": 0.21084897994995117, "survival_time": 1.2500000000000004, "driven_lanedir": 0.15677666245360866, "sim_render-ego": 0.057331695556640624, "in-drivable-lane": 0, "agent_compute-ego": 0.15490864753723144, "deviation-heading": 0.4286232289812193, "set_robot_commands": 0.08966363906860352, "deviation-center-line": 0.1133884355221843, "driven_lanedir_consec": 0.15677666245360866, "sim_compute_sim_state": 0.036446666717529295, "sim_compute_performance-ego": 0.059206151962280275, "sim_compute_robot_state-ego": 0.06776450157165527, "sim_compute_robot_state-npc0": 0.06362541198730469, "sim_compute_robot_state-npc1": 0.0653553295135498, "sim_compute_robot_state-npc2": 0.06928662300109863, "sim_compute_robot_state-npc3": 0.06553478240966797}, "udem1-3-0": {"driven_any": 0.1697167095361378, "sim_physics": 0.19585787773132324, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1403138163611315, "sim_render-ego": 0.06261606216430664, "in-drivable-lane": 0, "agent_compute-ego": 0.15920160293579105, "deviation-heading": 0.4600727397138359, "set_robot_commands": 0.09010379791259764, "deviation-center-line": 0.10597808618732547, "driven_lanedir_consec": 0.1403138163611315, "sim_compute_sim_state": 0.032850522994995114, "sim_compute_performance-ego": 0.06647941589355469, "sim_compute_robot_state-ego": 0.07230002403259278, "sim_compute_robot_state-npc0": 0.06809094429016113, "sim_compute_robot_state-npc1": 0.06808688163757325, "sim_compute_robot_state-npc2": 0.06462312698364257, "sim_compute_robot_state-npc3": 0.06273202896118164}, "udem1-4-0": {"driven_any": 0.16473283374657466, "sim_physics": 0.1806030571460724, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11353486265968682, "sim_render-ego": 0.055715968211491905, "in-drivable-lane": 0, "agent_compute-ego": 0.1480963627497355, "deviation-heading": 0.7489263178993967, "set_robot_commands": 0.08113818367322286, "deviation-center-line": 0.06389265570941403, "driven_lanedir_consec": 0.11353486265968682, "sim_compute_sim_state": 0.03428687651952108, "sim_compute_performance-ego": 0.06407466530799866, "sim_compute_robot_state-ego": 0.06794539093971252, "sim_compute_robot_state-npc0": 0.05488091707229614, "sim_compute_robot_state-npc1": 0.0593599279721578, "sim_compute_robot_state-npc2": 0.05697957674662272, "sim_compute_robot_state-npc3": 0.0595604677995046}}
set_robot_commands_max0.09010379791259764
set_robot_commands_mean0.08513066080650547
set_robot_commands_median0.08897796753914125
set_robot_commands_min0.07576971583896214
sim_compute_performance-ego_max0.0695214117726972
sim_compute_performance-ego_mean0.06570413570592053
sim_compute_performance-ego_median0.06647941589355469
sim_compute_performance-ego_min0.059206151962280275
sim_compute_robot_state-ego_max0.07844278120225476
sim_compute_robot_state-ego_mean0.0710197709951207
sim_compute_robot_state-ego_median0.0686461572293882
sim_compute_robot_state-ego_min0.06776450157165527
sim_compute_robot_state-npc0_max0.06974702496682444
sim_compute_robot_state-npc0_mean0.06386000267094893
sim_compute_robot_state-npc0_median0.06362541198730469
sim_compute_robot_state-npc0_min0.05488091707229614
sim_compute_robot_state-npc1_max0.06808688163757325
sim_compute_robot_state-npc1_mean0.06373566354332288
sim_compute_robot_state-npc1_median0.0653553295135498
sim_compute_robot_state-npc1_min0.05931214933042173
sim_compute_robot_state-npc2_max0.06976249141077842
sim_compute_robot_state-npc2_mean0.06363846639863338
sim_compute_robot_state-npc2_median0.06462312698364257
sim_compute_robot_state-npc2_min0.05697957674662272
sim_compute_robot_state-npc3_max0.06738716584664804
sim_compute_robot_state-npc3_mean0.064141842619635
sim_compute_robot_state-npc3_median0.06549476808117281
sim_compute_robot_state-npc3_min0.0595604677995046
sim_compute_sim_state_max0.03978893064683483
sim_compute_sim_state_mean0.03607307933194378
sim_compute_sim_state_median0.036446666717529295
sim_compute_sim_state_min0.032850522994995114
sim_physics_max0.21084897994995117
sim_physics_mean0.19777378164454312
sim_physics_median0.19585787773132324
sim_physics_min0.1806030571460724
sim_render-ego_max0.06261606216430664
sim_render-ego_mean0.05981852738774664
sim_render-ego_median0.061435558177806715
sim_render-ego_min0.055715968211491905
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3200000000000005
survival_time_min1.2000000000000004
231693575Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationerroryes12910:01:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)