AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1290

evaluator1290
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success42
# timeout
# failed7
# error48
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.2 GB
Disk (MB)96.9 GB
Disk available (MB)45.3 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242434036frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12900:20:43(hidden)
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.1106478486742292
agent_compute-ego_mean0.06199001561805024
agent_compute-ego_median0.06017080200052707
agent_compute-ego_min0.03964016514439737
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.17259249552874498, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05853160334305024, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06643809399134676, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.090115208021352, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03779360274193992, "sim_compute_performance-ego": 0.06516533502390687, "sim_compute_robot_state-ego": 0.0729933456635811, "sim_compute_robot_state-npc0": 0.0653411502569494, "sim_compute_robot_state-npc1": 0.06344999729747504, "sim_compute_robot_state-npc2": 0.06516528801179268, "sim_compute_robot_state-npc3": 0.06726868051878164}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.16017258167266846, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06066032499074936, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07328619807958603, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.095040962100029, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.034773558378219604, "sim_compute_performance-ego": 0.06297294795513153, "sim_compute_robot_state-ego": 0.06697991490364075, "sim_compute_robot_state-npc0": 0.06976090371608734, "sim_compute_robot_state-npc1": 0.0657234862446785, "sim_compute_robot_state-npc2": 0.06480155140161514, "sim_compute_robot_state-npc3": 0.06649348884820938}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1835190745500418, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.0609819430571336, "in-drivable-lane": 0, "agent_compute-ego": 0.07172694114538339, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10429075589546792, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04021320893214299, "sim_compute_performance-ego": 0.06898973079828116, "sim_compute_robot_state-ego": 0.07547166255804208, "sim_compute_robot_state-npc0": 0.06829018317736112, "sim_compute_robot_state-npc1": 0.06816641183999869, "sim_compute_robot_state-npc2": 0.06779144360468937, "sim_compute_robot_state-npc3": 0.0693958172431359}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.16135254726615003, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06178282409585932, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06508874636824413, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.08715818005223427, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03633315076110184, "sim_compute_performance-ego": 0.06808676258210213, "sim_compute_robot_state-ego": 0.06455425549578923, "sim_compute_robot_state-npc0": 0.06318834520155384, "sim_compute_robot_state-npc1": 0.06722157744951146, "sim_compute_robot_state-npc2": 0.06373339570978637, "sim_compute_robot_state-npc3": 0.07009006315662016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.12163784390404112, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.044799906866891046, "in-drivable-lane": 0, "agent_compute-ego": 0.1106478486742292, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.07247058550516765, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.02805928956894647, "sim_compute_performance-ego": 0.04885026386805943, "sim_compute_robot_state-ego": 0.051695766903105234, "sim_compute_robot_state-npc0": 0.054832106544857935, "sim_compute_robot_state-npc1": 0.05168124607631138, "sim_compute_robot_state-npc2": 0.05025059836251395, "sim_compute_robot_state-npc3": 0.053249200185139976}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.138987288987341, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.04967998670152396, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.05564061669278736, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.07486273434536517, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.03124259326083601, "sim_compute_performance-ego": 0.053905591491825326, "sim_compute_robot_state-ego": 0.05819470035143135, "sim_compute_robot_state-npc0": 0.05927641529682254, "sim_compute_robot_state-npc1": 0.05499991503628818, "sim_compute_robot_state-npc2": 0.0561694015156139, "sim_compute_robot_state-npc3": 0.05508633881561027}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.12302984793980916, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.05268455119360061, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05568920430682954, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.0704221214566912, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.029528771127973284, "sim_compute_performance-ego": 0.05352189143498739, "sim_compute_robot_state-ego": 0.0563102506455921, "sim_compute_robot_state-npc0": 0.05383979138873872, "sim_compute_robot_state-npc1": 0.05385443142482212, "sim_compute_robot_state-npc2": 0.053318386986142115, "sim_compute_robot_state-npc3": 0.05320980151494344}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.17808949947357178, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06132100079510663, "in-drivable-lane": 0, "agent_compute-ego": 0.0677021226367435, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.0907102597726358, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.039492806872806034, "sim_compute_performance-ego": 0.06738372428997143, "sim_compute_robot_state-ego": 0.06778038192439724, "sim_compute_robot_state-npc0": 0.0661642583640846, "sim_compute_robot_state-npc1": 0.06533390444678229, "sim_compute_robot_state-npc2": 0.06561498706405228, "sim_compute_robot_state-npc3": 0.0675166941977836}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.16842023531595865, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06163349085383945, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.0686925748984019, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.09149235486984252, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.038496805561913386, "sim_compute_performance-ego": 0.06668981909751892, "sim_compute_robot_state-ego": 0.07370191481378344, "sim_compute_robot_state-npc0": 0.0669769545396169, "sim_compute_robot_state-npc1": 0.06594098938835992, "sim_compute_robot_state-npc2": 0.06648754080136617, "sim_compute_robot_state-npc3": 0.07044398453500536}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.1828345383439109, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.05317024872681805, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.06017080200052707, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.08293080775537223, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.033067166248214576, "sim_compute_performance-ego": 0.059099304341824255, "sim_compute_robot_state-ego": 0.06760430558819637, "sim_compute_robot_state-npc0": 0.05991510810139023, "sim_compute_robot_state-npc1": 0.060810525840687975, "sim_compute_robot_state-npc2": 0.07329327592225833, "sim_compute_robot_state-npc3": 0.05997806397553916}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.14316580913684987, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.04231531531722457, "in-drivable-lane": 0, "agent_compute-ego": 0.049337563691315825, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.06619523189685962, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.027584914807920104, "sim_compute_performance-ego": 0.04832983899999548, "sim_compute_robot_state-ego": 0.04793233341640896, "sim_compute_robot_state-npc0": 0.049181620279947914, "sim_compute_robot_state-npc1": 0.04689764976501465, "sim_compute_robot_state-npc2": 0.04940525690714518, "sim_compute_robot_state-npc3": 0.04844313197665744}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.11713428497314451, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.04314267158508301, "in-drivable-lane": 0, "agent_compute-ego": 0.04855221748352051, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.06409713745117188, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.02761631965637207, "sim_compute_performance-ego": 0.04609543800354004, "sim_compute_robot_state-ego": 0.05039950370788574, "sim_compute_robot_state-npc0": 0.05013354301452637, "sim_compute_robot_state-npc1": 0.04754280090332031, "sim_compute_robot_state-npc2": 0.04496476173400879, "sim_compute_robot_state-npc3": 0.04637848854064942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.11244752721966438, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.0437417930027224, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.057499264771083615, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.0683422493484785, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.02675222450832151, "sim_compute_performance-ego": 0.04806764620654988, "sim_compute_robot_state-ego": 0.05090806169329949, "sim_compute_robot_state-npc0": 0.04873331987632895, "sim_compute_robot_state-npc1": 0.04766923076701614, "sim_compute_robot_state-npc2": 0.048681421099968675, "sim_compute_robot_state-npc3": 0.04728538585159014}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.0996757092014436, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.034979135759415164, "in-drivable-lane": 0, "agent_compute-ego": 0.03964016514439737, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.05395432441465317, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.021746681582543156, "sim_compute_performance-ego": 0.03787852102710355, "sim_compute_robot_state-ego": 0.039934719762494485, "sim_compute_robot_state-npc0": 0.038819297667472594, "sim_compute_robot_state-npc1": 0.03837187828556184, "sim_compute_robot_state-npc2": 0.03855499144523374, "sim_compute_robot_state-npc3": 0.03834801335488596}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.09857805102479224, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.035628804973527495, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.03973787438635733, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.0539704163869222, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.0217433863995122, "sim_compute_performance-ego": 0.03755849482966405, "sim_compute_robot_state-ego": 0.039978284461825504, "sim_compute_robot_state-npc0": 0.03894965788897346, "sim_compute_robot_state-npc1": 0.03825010972864488, "sim_compute_robot_state-npc2": 0.03840976602890912, "sim_compute_robot_state-npc3": 0.03838051534166523}}
set_robot_commands_max0.10429075589546792
set_robot_commands_mean0.07773688861814954
set_robot_commands_median0.07486273434536517
set_robot_commands_min0.05395432441465317
sim_compute_performance-ego_max0.06898973079828116
sim_compute_performance-ego_mean0.05550635399669743
sim_compute_performance-ego_median0.053905591491825326
sim_compute_performance-ego_min0.03755849482966405
sim_compute_robot_state-ego_max0.07547166255804208
sim_compute_robot_state-ego_mean0.05896262679263155
sim_compute_robot_state-ego_median0.05819470035143135
sim_compute_robot_state-ego_min0.039934719762494485
sim_compute_robot_state-npc0_max0.06976090371608734
sim_compute_robot_state-npc0_mean0.05689351035431412
sim_compute_robot_state-npc0_median0.05927641529682254
sim_compute_robot_state-npc0_min0.038819297667472594
sim_compute_robot_state-npc1_max0.06816641183999869
sim_compute_robot_state-npc1_mean0.05572761029963156
sim_compute_robot_state-npc1_median0.05499991503628818
sim_compute_robot_state-npc1_min0.03825010972864488
sim_compute_robot_state-npc2_max0.07329327592225833
sim_compute_robot_state-npc2_mean0.05644280443967305
sim_compute_robot_state-npc2_median0.0561694015156139
sim_compute_robot_state-npc2_min0.03840976602890912
sim_compute_robot_state-npc3_max0.07044398453500536
sim_compute_robot_state-npc3_mean0.05677117787041446
sim_compute_robot_state-npc3_median0.05508633881561027
sim_compute_robot_state-npc3_min0.03834801335488596
sim_compute_sim_state_max0.04021320893214299
sim_compute_sim_state_mean0.03162963202725087
sim_compute_sim_state_median0.03124259326083601
sim_compute_sim_state_min0.0217433863995122
sim_physics_max0.1835190745500418
sim_physics_mean0.1441091556358755
sim_physics_median0.14316580913684987
sim_physics_min0.09857805102479224
sim_render-ego_max0.06178282409585932
sim_render-ego_mean0.05100357341750299
sim_render-ego_median0.05268455119360061
sim_render-ego_min0.034979135759415164
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
242414037frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:05:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242364041frank_qcd_qkchallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12900:03:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
242234016dgmds17avchallenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12900:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242214020dgmds17avchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12900:01:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242174011kene4192CNN-48by96-less-one-50-augaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12900:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.NotFoundError: Op type not registered 'ImageProjectiveTransformV2' in binary running on 8c10866f3f0e. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
242074001InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242043998InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242013996kene4192CNN-8logs-48by96-400aido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:08:32(hidden)
driven_lanedir_consec_median0.6399481427290574
survival_time_median9.349999999999998
deviation-center-line_median0.35402262759182024
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.13019435478610242
agent_compute-ego_mean0.1192579602224066
agent_compute-ego_median0.11674047311147054
agent_compute-ego_min0.11470392808557194
deviation-center-line_max1.0345160885300402
deviation-center-line_mean0.4640106368739538
deviation-center-line_min0.1586636763764999
deviation-heading_max1.505810398336881
deviation-heading_mean1.190955735008876
deviation-heading_median1.2142354694852135
deviation-heading_min0.8538877677179595
driven_any_max1.6401669850924
driven_any_mean0.9126841721349968
driven_any_median1.0155776578082527
driven_any_min0.1417057211723953
driven_lanedir_consec_max1.6321719566678614
driven_lanedir_consec_mean0.7472589113977561
driven_lanedir_consec_min0.09901218243235954
driven_lanedir_max1.6321719566678614
driven_lanedir_mean0.7472589113977561
driven_lanedir_median0.6399481427290574
driven_lanedir_min0.09901218243235954
in-drivable-lane_max2.850000000000013
in-drivable-lane_mean1.0900000000000092
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0155776578082527, "sim_physics": 0.05191111819629363, "survival_time": 9.349999999999998, "driven_lanedir": 0.6399481427290574, "sim_render-ego": 0.03433668294692422, "in-drivable-lane": 2.850000000000013, "agent_compute-ego": 0.11470392808557194, "deviation-heading": 1.505810398336881, "set_robot_commands": 0.054493832715692365, "deviation-center-line": 0.35402262759182024, "driven_lanedir_consec": 0.6399481427290574, "sim_compute_sim_state": 0.02234924413303641, "sim_compute_performance-ego": 0.038493616695710046, "sim_compute_robot_state-ego": 0.03964407558747154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6401669850924, "sim_physics": 0.053314332167307535, "survival_time": 14.950000000000076, "driven_lanedir": 1.6321719566678614, "sim_render-ego": 0.03448267857233683, "in-drivable-lane": 0, "agent_compute-ego": 0.11674047311147054, "deviation-heading": 1.2142354694852135, "set_robot_commands": 0.05491943756739299, "deviation-center-line": 1.0345160885300402, "driven_lanedir_consec": 1.6321719566678614, "sim_compute_sim_state": 0.02235020399093628, "sim_compute_performance-ego": 0.03794295072555542, "sim_compute_robot_state-ego": 0.039644447962443034}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1417057211723953, "sim_physics": 0.050949992555560486, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09901218243235954, "sim_render-ego": 0.03391898762096058, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.11667562253547437, "deviation-heading": 0.8538877677179595, "set_robot_commands": 0.05474204005617084, "deviation-center-line": 0.1586636763764999, "driven_lanedir_consec": 0.09901218243235954, "sim_compute_sim_state": 0.022547057180693657, "sim_compute_performance-ego": 0.038310246034102005, "sim_compute_robot_state-ego": 0.03951882593559496}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3417315338089263, "sim_physics": 0.05687798437525014, "survival_time": 3.049999999999997, "driven_lanedir": 0.29712734602503543, "sim_render-ego": 0.03556013498149934, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1179754225934138, "deviation-heading": 1.3257028668709698, "set_robot_commands": 0.05594498212220239, "deviation-center-line": 0.19771137140353784, "driven_lanedir_consec": 0.29712734602503543, "sim_compute_sim_state": 0.02241982397485952, "sim_compute_performance-ego": 0.03788292994264696, "sim_compute_robot_state-ego": 0.03981387419778792}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.42423896279301, "sim_physics": 0.0658003086606488, "survival_time": 11.450000000000028, "driven_lanedir": 1.0680349291344666, "sim_render-ego": 0.03847995491527574, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.13019435478610242, "deviation-heading": 1.0551421726333554, "set_robot_commands": 0.06044431024243217, "deviation-center-line": 0.5751394204678707, "driven_lanedir_consec": 1.0680349291344666, "sim_compute_sim_state": 0.02486358147000642, "sim_compute_performance-ego": 0.04491177604708609, "sim_compute_robot_state-ego": 0.04569223666295214}}
set_robot_commands_max0.06044431024243217
set_robot_commands_mean0.05610892054077815
set_robot_commands_median0.05491943756739299
set_robot_commands_min0.054493832715692365
sim_compute_performance-ego_max0.04491177604708609
sim_compute_performance-ego_mean0.03950830388902011
sim_compute_performance-ego_median0.038310246034102005
sim_compute_performance-ego_min0.03788292994264696
sim_compute_robot_state-ego_max0.04569223666295214
sim_compute_robot_state-ego_mean0.04086269206924992
sim_compute_robot_state-ego_median0.039644447962443034
sim_compute_robot_state-ego_min0.03951882593559496
sim_compute_sim_state_max0.02486358147000642
sim_compute_sim_state_mean0.022905982149906457
sim_compute_sim_state_median0.02241982397485952
sim_compute_sim_state_min0.02234924413303641
sim_physics_max0.0658003086606488
sim_physics_mean0.05577074719101212
sim_physics_median0.053314332167307535
sim_physics_min0.050949992555560486
sim_render-ego_max0.03847995491527574
sim_render-ego_mean0.03535568780739934
sim_render-ego_median0.03448267857233683
sim_render-ego_min0.03391898762096058
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.090000000000021
survival_time_min1.6500000000000008
241993994kene4192CNN-8logs-48by96-300-sameaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:14:01(hidden)
driven_lanedir_consec_median0.4701624614616744
survival_time_median6.549999999999985
deviation-center-line_median0.20357126010532092
in-drivable-lane_median1.8499999999999936


other stats
agent_compute-ego_max0.1533180957532111
agent_compute-ego_mean0.1331428120032716
agent_compute-ego_median0.12891998132069907
agent_compute-ego_min0.12626710183480205
deviation-center-line_max0.7158520700937782
deviation-center-line_mean0.2943592652884442
deviation-center-line_min0.14649014039179292
deviation-heading_max1.005528783558309
deviation-heading_mean0.9452385170150384
deviation-heading_median0.9761454575220188
deviation-heading_min0.8133180839381376
driven_any_max2.3261859693197353
driven_any_mean1.059807406848004
driven_any_median0.996771593068209
driven_any_min0.2741742324478404
driven_lanedir_consec_max2.3187173768123417
driven_lanedir_consec_mean0.8072361439573192
driven_lanedir_consec_min0.24906235508417415
driven_lanedir_max2.3187173768123417
driven_lanedir_mean0.8072361439573192
driven_lanedir_median0.4701624614616744
driven_lanedir_min0.24906235508417415
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean1.409999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.996771593068209, "sim_physics": 0.11640120644605796, "survival_time": 6.549999999999985, "driven_lanedir": 0.6576195637172955, "sim_render-ego": 0.04527475269696184, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.1533180957532111, "deviation-heading": 1.005528783558309, "set_robot_commands": 0.0679908180964812, "deviation-center-line": 0.24755239189157496, "driven_lanedir_consec": 0.6576195637172955, "sim_compute_sim_state": 0.02779751515570488, "sim_compute_performance-ego": 0.04843374063040464, "sim_compute_robot_state-ego": 0.0531322137090086, "sim_compute_robot_state-npc0": 0.05129479633942815, "sim_compute_robot_state-npc1": 0.04803240572223227, "sim_compute_robot_state-npc2": 0.04815091249596982, "sim_compute_robot_state-npc3": 0.049142593645867504}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3261859693197353, "sim_physics": 0.09325819412867228, "survival_time": 14.950000000000076, "driven_lanedir": 2.3187173768123417, "sim_render-ego": 0.036114441553751625, "in-drivable-lane": 0, "agent_compute-ego": 0.12891998132069907, "deviation-heading": 0.9897356038564686, "set_robot_commands": 0.05661748727162679, "deviation-center-line": 0.7158520700937782, "driven_lanedir_consec": 2.3187173768123417, "sim_compute_sim_state": 0.023498060703277587, "sim_compute_performance-ego": 0.03920413970947265, "sim_compute_robot_state-ego": 0.04119286378224691, "sim_compute_robot_state-npc0": 0.04215293804804484, "sim_compute_robot_state-npc1": 0.04030112504959107, "sim_compute_robot_state-npc2": 0.046082996527353925, "sim_compute_robot_state-npc3": 0.04050636768341064}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0254190021537897, "sim_physics": 0.08780226111412048, "survival_time": 6.799999999999984, "driven_lanedir": 0.4701624614616744, "sim_render-ego": 0.034740731996648455, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.12626710183480205, "deviation-heading": 0.9761454575220188, "set_robot_commands": 0.05357179045677185, "deviation-center-line": 0.20357126010532092, "driven_lanedir_consec": 0.4701624614616744, "sim_compute_sim_state": 0.022089213132858276, "sim_compute_performance-ego": 0.03804435274180244, "sim_compute_robot_state-ego": 0.03993514706106747, "sim_compute_robot_state-npc0": 0.042008817195892334, "sim_compute_robot_state-npc1": 0.03871281182064729, "sim_compute_robot_state-npc2": 0.03849005173234379, "sim_compute_robot_state-npc3": 0.038565178127849806}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6764862372504455, "sim_physics": 0.08429893721704898, "survival_time": 4.599999999999992, "driven_lanedir": 0.3406189627111105, "sim_render-ego": 0.03774454541828321, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.1264181473980779, "deviation-heading": 0.941464656200257, "set_robot_commands": 0.054076150707576584, "deviation-center-line": 0.15833046395975406, "driven_lanedir_consec": 0.3406189627111105, "sim_compute_sim_state": 0.022150664225868557, "sim_compute_performance-ego": 0.03814432413681694, "sim_compute_robot_state-ego": 0.04000568649043208, "sim_compute_robot_state-npc0": 0.0393728432448014, "sim_compute_robot_state-npc1": 0.038594248502150826, "sim_compute_robot_state-npc2": 0.03837904204492983, "sim_compute_robot_state-npc3": 0.038507350113080895}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2741742324478404, "sim_physics": 0.08702605526621748, "survival_time": 2.0500000000000007, "driven_lanedir": 0.24906235508417415, "sim_render-ego": 0.035018420800930115, "in-drivable-lane": 0, "agent_compute-ego": 0.13079073370956792, "deviation-heading": 0.8133180839381376, "set_robot_commands": 0.05398525842806188, "deviation-center-line": 0.14649014039179292, "driven_lanedir_consec": 0.24906235508417415, "sim_compute_sim_state": 0.02209872734255907, "sim_compute_performance-ego": 0.03768099226602694, "sim_compute_robot_state-ego": 0.04002182658125714, "sim_compute_robot_state-npc0": 0.03972292527919862, "sim_compute_robot_state-npc1": 0.039494113224308666, "sim_compute_robot_state-npc2": 0.0385708576295434, "sim_compute_robot_state-npc3": 0.038702394904159915}}
set_robot_commands_max0.0679908180964812
set_robot_commands_mean0.057248300992103665
set_robot_commands_median0.054076150707576584
set_robot_commands_min0.05357179045677185
sim_compute_performance-ego_max0.04843374063040464
sim_compute_performance-ego_mean0.04030150989690473
sim_compute_performance-ego_median0.03814432413681694
sim_compute_performance-ego_min0.03768099226602694
sim_compute_robot_state-ego_max0.0531322137090086
sim_compute_robot_state-ego_mean0.04285754752480243
sim_compute_robot_state-ego_median0.04002182658125714
sim_compute_robot_state-ego_min0.03993514706106747
sim_compute_robot_state-npc0_max0.05129479633942815
sim_compute_robot_state-npc0_mean0.04291046402147307
sim_compute_robot_state-npc0_median0.042008817195892334
sim_compute_robot_state-npc0_min0.0393728432448014
sim_compute_robot_state-npc1_max0.04803240572223227
sim_compute_robot_state-npc1_mean0.04102694086378602
sim_compute_robot_state-npc1_median0.039494113224308666
sim_compute_robot_state-npc1_min0.038594248502150826
sim_compute_robot_state-npc2_max0.04815091249596982
sim_compute_robot_state-npc2_mean0.04193477208602815
sim_compute_robot_state-npc2_median0.0385708576295434
sim_compute_robot_state-npc2_min0.03837904204492983
sim_compute_robot_state-npc3_max0.049142593645867504
sim_compute_robot_state-npc3_mean0.041084776894873755
sim_compute_robot_state-npc3_median0.038702394904159915
sim_compute_robot_state-npc3_min0.038507350113080895
sim_compute_sim_state_max0.02779751515570488
sim_compute_sim_state_mean0.02352683611205367
sim_compute_sim_state_median0.022150664225868557
sim_compute_sim_state_min0.022089213132858276
sim_physics_max0.11640120644605796
sim_physics_mean0.09375733083442345
sim_physics_median0.08780226111412048
sim_physics_min0.08429893721704898
sim_render-ego_max0.04527475269696184
sim_render-ego_mean0.03777857849331505
sim_render-ego_median0.036114441553751625
sim_render-ego_min0.034740731996648455
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.990000000000009
survival_time_min2.0500000000000007
241983993kene4192CNN-8logs-48by96-400aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:16:19(hidden)
driven_lanedir_consec_median1.0797778945248968
survival_time_median12.900000000000048
deviation-center-line_median0.3842570954855193
in-drivable-lane_median2.4499999999999913


other stats
agent_compute-ego_max0.11988204239058668
agent_compute-ego_mean0.1169678370790958
agent_compute-ego_median0.11633583068847655
agent_compute-ego_min0.11541304200194603
deviation-center-line_max0.6787029710182483
deviation-center-line_mean0.40729548959144096
deviation-center-line_min0.15271113176222087
deviation-heading_max2.4264832769330997
deviation-heading_mean1.3490665976523997
deviation-heading_median1.089159192135702
deviation-heading_min0.7820033819865391
driven_any_max1.6891244416240918
driven_any_mean1.1435936564495726
driven_any_median1.4476487951116503
driven_any_min0.23234149711205265
driven_lanedir_consec_max1.5821753039095463
driven_lanedir_consec_mean0.8948399674891288
driven_lanedir_consec_min0.19408431083084657
driven_lanedir_max1.5821753039095463
driven_lanedir_mean0.8962768003736306
driven_lanedir_median1.0797778945248968
driven_lanedir_min0.19408431083084657
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean1.6100000000000143
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7597586061465279, "sim_physics": 0.09296599617839728, "survival_time": 6.849999999999984, "driven_lanedir": 0.43388314807549033, "sim_render-ego": 0.03524607985559171, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.11988204239058668, "deviation-heading": 0.7820033819865391, "set_robot_commands": 0.05403345692766844, "deviation-center-line": 0.3629902651355248, "driven_lanedir_consec": 0.43388314807549033, "sim_compute_sim_state": 0.022077426423121545, "sim_compute_performance-ego": 0.03806084437961996, "sim_compute_robot_state-ego": 0.040666298274576226, "sim_compute_robot_state-npc0": 0.03957366595303055, "sim_compute_robot_state-npc1": 0.03878218936224053, "sim_compute_robot_state-npc2": 0.03861076640386651, "sim_compute_robot_state-npc3": 0.03871018173050706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5890949422535396, "sim_physics": 0.09566062768300376, "survival_time": 14.950000000000076, "driven_lanedir": 1.5821753039095463, "sim_render-ego": 0.0351123038927714, "in-drivable-lane": 0, "agent_compute-ego": 0.11633583068847655, "deviation-heading": 1.089159192135702, "set_robot_commands": 0.05478250741958618, "deviation-center-line": 0.6787029710182483, "driven_lanedir_consec": 1.5821753039095463, "sim_compute_sim_state": 0.02217648983001709, "sim_compute_performance-ego": 0.038088670571645104, "sim_compute_robot_state-ego": 0.04032665014266968, "sim_compute_robot_state-npc0": 0.03961253643035888, "sim_compute_robot_state-npc1": 0.03894674936930338, "sim_compute_robot_state-npc2": 0.03867206255594889, "sim_compute_robot_state-npc3": 0.03895911773045858}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.4476487951116503, "sim_physics": 0.08533164142638214, "survival_time": 12.900000000000048, "driven_lanedir": 1.0797778945248968, "sim_render-ego": 0.03500465921653333, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.11541304200194603, "deviation-heading": 1.4359495558842914, "set_robot_commands": 0.05455670707909636, "deviation-center-line": 0.4578159845556917, "driven_lanedir_consec": 1.0797778945248968, "sim_compute_sim_state": 0.022193748821583828, "sim_compute_performance-ego": 0.03814644961394081, "sim_compute_robot_state-ego": 0.04019292472868927, "sim_compute_robot_state-npc0": 0.039929747581481934, "sim_compute_robot_state-npc1": 0.03905893388644669, "sim_compute_robot_state-npc2": 0.03885878056518791, "sim_compute_robot_state-npc3": 0.03912343350491782}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6891244416240918, "sim_physics": 0.08436912624803308, "survival_time": 14.600000000000072, "driven_lanedir": 1.191463344527373, "sim_render-ego": 0.03522006779500883, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.117329721581446, "deviation-heading": 2.4264832769330997, "set_robot_commands": 0.05458133432963123, "deviation-center-line": 0.3842570954855193, "driven_lanedir_consec": 1.184279180104864, "sim_compute_sim_state": 0.022130034557760577, "sim_compute_performance-ego": 0.03898329849112524, "sim_compute_robot_state-ego": 0.03996230314855706, "sim_compute_robot_state-npc0": 0.03956834502416114, "sim_compute_robot_state-npc1": 0.03899232573705177, "sim_compute_robot_state-npc2": 0.03861694384927619, "sim_compute_robot_state-npc3": 0.038715384594381674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23234149711205265, "sim_physics": 0.08520120243693508, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19408431083084657, "sim_render-ego": 0.03487350774365802, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11587854873302372, "deviation-heading": 1.011737581322366, "set_robot_commands": 0.05397318684777548, "deviation-center-line": 0.15271113176222087, "driven_lanedir_consec": 0.19408431083084657, "sim_compute_sim_state": 0.022111099819804348, "sim_compute_performance-ego": 0.0389484915622445, "sim_compute_robot_state-ego": 0.03994293545567712, "sim_compute_robot_state-npc0": 0.03925288555233977, "sim_compute_robot_state-npc1": 0.038765868475270825, "sim_compute_robot_state-npc2": 0.03848664150681606, "sim_compute_robot_state-npc3": 0.038453839546026186}}
set_robot_commands_max0.05478250741958618
set_robot_commands_mean0.05438543852075154
set_robot_commands_median0.05455670707909636
set_robot_commands_min0.05397318684777548
sim_compute_performance-ego_max0.03898329849112524
sim_compute_performance-ego_mean0.03844555092371512
sim_compute_performance-ego_median0.03814644961394081
sim_compute_performance-ego_min0.03806084437961996
sim_compute_robot_state-ego_max0.040666298274576226
sim_compute_robot_state-ego_mean0.040218222350033875
sim_compute_robot_state-ego_median0.04019292472868927
sim_compute_robot_state-ego_min0.03994293545567712
sim_compute_robot_state-npc0_max0.039929747581481934
sim_compute_robot_state-npc0_mean0.03958743610827446
sim_compute_robot_state-npc0_median0.03957366595303055
sim_compute_robot_state-npc0_min0.03925288555233977
sim_compute_robot_state-npc1_max0.03905893388644669
sim_compute_robot_state-npc1_mean0.03890921336606264
sim_compute_robot_state-npc1_median0.03894674936930338
sim_compute_robot_state-npc1_min0.038765868475270825
sim_compute_robot_state-npc2_max0.03885878056518791
sim_compute_robot_state-npc2_mean0.03864903897621911
sim_compute_robot_state-npc2_median0.03861694384927619
sim_compute_robot_state-npc2_min0.03848664150681606
sim_compute_robot_state-npc3_max0.03912343350491782
sim_compute_robot_state-npc3_mean0.03879239142125827
sim_compute_robot_state-npc3_median0.038715384594381674
sim_compute_robot_state-npc3_min0.038453839546026186
sim_compute_sim_state_max0.022193748821583828
sim_compute_sim_state_mean0.02213775989045748
sim_compute_sim_state_median0.022130034557760577
sim_compute_sim_state_min0.022077426423121545
sim_physics_max0.09566062768300376
sim_physics_mean0.08870571879455028
sim_physics_median0.08533164142638214
sim_physics_min0.08436912624803308
sim_render-ego_max0.03524607985559171
sim_render-ego_mean0.03509132370071266
sim_render-ego_median0.0351123038927714
sim_render-ego_min0.03487350774365802
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.290000000000036
survival_time_min2.1500000000000004
241973992InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:01:22
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241943986jagwarBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12900:11:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241923990jagwarBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12900:06:11(hidden)
driven_lanedir_consec_median0.15449255994260236
survival_time_median1.3000000000000005
deviation-center-line_median0.10561981513298954
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16796274807142175
agent_compute-ego_mean0.15997935885296544
agent_compute-ego_median0.1616802657092059
agent_compute-ego_min0.14310016998877892
deviation-center-line_max0.11675665902112815
deviation-center-line_mean0.09549558679718972
deviation-center-line_min0.058425774273412064
deviation-heading_max1.0420469745545748
deviation-heading_mean0.7240817127967657
deviation-heading_median0.693622343480995
deviation-heading_min0.4339030287688481
driven_any_max0.2431421302142493
driven_any_mean0.19339253096026215
driven_any_median0.1862760845307865
driven_any_min0.15991837678076093
driven_lanedir_consec_max0.16574266421346984
driven_lanedir_consec_mean0.14124416145190258
driven_lanedir_consec_min0.11203926886053096
driven_lanedir_max0.16574266421346984
driven_lanedir_mean0.14124416145190258
driven_lanedir_median0.15449255994260236
driven_lanedir_min0.11203926886053096
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2431421302142493, "sim_physics": 0.18689925968647003, "survival_time": 1.6000000000000008, "driven_lanedir": 0.16574266421346984, "sim_render-ego": 0.055416181683540344, "in-drivable-lane": 0, "agent_compute-ego": 0.16559477150440216, "deviation-heading": 0.990785945291892, "set_robot_commands": 0.09229914844036102, "deviation-center-line": 0.10561981513298954, "driven_lanedir_consec": 0.16574266421346984, "sim_compute_sim_state": 0.03606649488210678, "sim_compute_performance-ego": 0.0658918097615242, "sim_compute_robot_state-ego": 0.07124215364456177, "sim_compute_robot_state-npc0": 0.06540650874376297, "sim_compute_robot_state-npc1": 0.06788076460361481, "sim_compute_robot_state-npc2": 0.06604916602373123, "sim_compute_robot_state-npc3": 0.06324329227209091}, "udem1-1-0": {"driven_any": 0.19500115966948645, "sim_physics": 0.2081667670497188, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11203926886053096, "sim_render-ego": 0.05891380486664949, "in-drivable-lane": 0, "agent_compute-ego": 0.1616802657092059, "deviation-heading": 1.0420469745545748, "set_robot_commands": 0.09207014684323912, "deviation-center-line": 0.08990435575280982, "driven_lanedir_consec": 0.11203926886053096, "sim_compute_sim_state": 0.034187378706755464, "sim_compute_performance-ego": 0.06576130125257704, "sim_compute_robot_state-ego": 0.06878305364538122, "sim_compute_robot_state-npc0": 0.06387280534814906, "sim_compute_robot_state-npc1": 0.06198257870144314, "sim_compute_robot_state-npc2": 0.0635301183771204, "sim_compute_robot_state-npc3": 0.06468378172980414}, "udem1-2-0": {"driven_any": 0.1862760845307865, "sim_physics": 0.24117029630220857, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1611671915561601, "sim_render-ego": 0.059647899407606855, "in-drivable-lane": 0, "agent_compute-ego": 0.16155883899101844, "deviation-heading": 0.4339030287688481, "set_robot_commands": 0.08756216672750619, "deviation-center-line": 0.11675665902112815, "driven_lanedir_consec": 0.1611671915561601, "sim_compute_sim_state": 0.03463587394127479, "sim_compute_performance-ego": 0.06339727915250339, "sim_compute_robot_state-ego": 0.07032238520108737, "sim_compute_robot_state-npc0": 0.06334228699023907, "sim_compute_robot_state-npc1": 0.0638739145719088, "sim_compute_robot_state-npc2": 0.06508825375483586, "sim_compute_robot_state-npc3": 0.062004731251643255}, "udem1-3-0": {"driven_any": 0.18262490360602776, "sim_physics": 0.1840254435172448, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15449255994260236, "sim_render-ego": 0.05012242610637958, "in-drivable-lane": 0, "agent_compute-ego": 0.14310016998877892, "deviation-heading": 0.4600502718875181, "set_robot_commands": 0.0854655045729417, "deviation-center-line": 0.10677132980560904, "driven_lanedir_consec": 0.15449255994260236, "sim_compute_sim_state": 0.03145893720480112, "sim_compute_performance-ego": 0.05810995285327618, "sim_compute_robot_state-ego": 0.05822887787452111, "sim_compute_robot_state-npc0": 0.05447201545421894, "sim_compute_robot_state-npc1": 0.05696555284353403, "sim_compute_robot_state-npc2": 0.05426465548001803, "sim_compute_robot_state-npc3": 0.054171277926518366}, "udem1-4-0": {"driven_any": 0.15991837678076093, "sim_physics": 0.20421785893647568, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1127791226867496, "sim_render-ego": 0.06144187761389691, "in-drivable-lane": 0, "agent_compute-ego": 0.16796274807142175, "deviation-heading": 0.693622343480995, "set_robot_commands": 0.10543142194333284, "deviation-center-line": 0.058425774273412064, "driven_lanedir_consec": 0.1127791226867496, "sim_compute_sim_state": 0.042878949123880135, "sim_compute_performance-ego": 0.07077886747277301, "sim_compute_robot_state-ego": 0.06742256620655888, "sim_compute_robot_state-npc0": 0.07146659104720406, "sim_compute_robot_state-npc1": 0.07199581809665846, "sim_compute_robot_state-npc2": 0.07033544001371964, "sim_compute_robot_state-npc3": 0.06716587232506793}}
set_robot_commands_max0.10543142194333284
set_robot_commands_mean0.09256567770547616
set_robot_commands_median0.09207014684323912
set_robot_commands_min0.0854655045729417
sim_compute_performance-ego_max0.07077886747277301
sim_compute_performance-ego_mean0.06478784209853077
sim_compute_performance-ego_median0.06576130125257704
sim_compute_performance-ego_min0.05810995285327618
sim_compute_robot_state-ego_max0.07124215364456177
sim_compute_robot_state-ego_mean0.06719980731442207
sim_compute_robot_state-ego_median0.06878305364538122
sim_compute_robot_state-ego_min0.05822887787452111
sim_compute_robot_state-npc0_max0.07146659104720406
sim_compute_robot_state-npc0_mean0.0637120415167148
sim_compute_robot_state-npc0_median0.06387280534814906
sim_compute_robot_state-npc0_min0.05447201545421894
sim_compute_robot_state-npc1_max0.07199581809665846
sim_compute_robot_state-npc1_mean0.06453972576343184
sim_compute_robot_state-npc1_median0.0638739145719088
sim_compute_robot_state-npc1_min0.05696555284353403
sim_compute_robot_state-npc2_max0.07033544001371964
sim_compute_robot_state-npc2_mean0.06385352672988502
sim_compute_robot_state-npc2_median0.06508825375483586
sim_compute_robot_state-npc2_min0.05426465548001803
sim_compute_robot_state-npc3_max0.06716587232506793
sim_compute_robot_state-npc3_mean0.06225379110102493
sim_compute_robot_state-npc3_median0.06324329227209091
sim_compute_robot_state-npc3_min0.054171277926518366
sim_compute_sim_state_max0.042878949123880135
sim_compute_sim_state_mean0.035845526771763656
sim_compute_sim_state_median0.03463587394127479
sim_compute_sim_state_min0.03145893720480112
sim_physics_max0.24117029630220857
sim_physics_mean0.20489592509842355
sim_physics_median0.20421785893647568
sim_physics_min0.1840254435172448
sim_render-ego_max0.06144187761389691
sim_render-ego_mean0.05710843793561463
sim_render-ego_median0.05891380486664949
sim_render-ego_min0.05012242610637958
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1500000000000004
241893981InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:04:14(hidden)
driven_lanedir_consec_median0.12325038673543531
survival_time_median1.4500000000000006
deviation-center-line_median0.10809078580236922
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09848608641788878
agent_compute-ego_mean0.09644055996434824
agent_compute-ego_median0.09672806813166691
agent_compute-ego_min0.0934866790113778
deviation-center-line_max0.12119265669743222
deviation-center-line_mean0.10107917441905533
deviation-center-line_min0.06851222384495047
deviation-heading_max1.1055973475738787
deviation-heading_mean0.817609683247893
deviation-heading_median0.8179735961129668
deviation-heading_min0.504423240086942
driven_any_max0.2137042049458888
driven_any_mean0.18215728568881756
driven_any_median0.18600783001739896
driven_any_min0.1541362349533087
driven_lanedir_consec_max0.15459340479632822
driven_lanedir_consec_mean0.12592670687079016
driven_lanedir_consec_min0.10885535221418796
driven_lanedir_max0.15459340479632822
driven_lanedir_mean0.12592670687079016
driven_lanedir_median0.12325038673543531
driven_lanedir_min0.10885535221418796
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2137042049458888, "sim_physics": 0.16573666803764575, "survival_time": 1.6500000000000008, "driven_lanedir": 0.12325038673543531, "sim_render-ego": 0.036561070066509826, "in-drivable-lane": 0, "agent_compute-ego": 0.09782335252472849, "deviation-heading": 1.1055973475738787, "set_robot_commands": 0.056170015624075226, "deviation-center-line": 0.10809078580236922, "driven_lanedir_consec": 0.12325038673543531, "sim_compute_sim_state": 0.02275556506532611, "sim_compute_performance-ego": 0.03917457840659402, "sim_compute_robot_state-ego": 0.04199004895759351, "sim_compute_robot_state-npc0": 0.04031693574154016, "sim_compute_robot_state-npc1": 0.03965806238579027, "sim_compute_robot_state-npc2": 0.03975893511916652, "sim_compute_robot_state-npc3": 0.03981246370257753}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19809544474430765, "sim_physics": 0.0926276239855536, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1159500549344763, "sim_render-ego": 0.03476736463349441, "in-drivable-lane": 0, "agent_compute-ego": 0.0934866790113778, "deviation-heading": 1.0938175900130944, "set_robot_commands": 0.05368356047005489, "deviation-center-line": 0.09337801924718142, "driven_lanedir_consec": 0.1159500549344763, "sim_compute_sim_state": 0.022265894659634293, "sim_compute_performance-ego": 0.038370929915329505, "sim_compute_robot_state-ego": 0.04015577250513537, "sim_compute_robot_state-npc0": 0.039713374499616955, "sim_compute_robot_state-npc1": 0.03906851801378974, "sim_compute_robot_state-npc2": 0.03876119646532782, "sim_compute_robot_state-npc3": 0.03895900167267898}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1541362349533087, "sim_physics": 0.1016466709283682, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12698433567352296, "sim_render-ego": 0.035851579446059004, "in-drivable-lane": 0, "agent_compute-ego": 0.09567861373607928, "deviation-heading": 0.504423240086942, "set_robot_commands": 0.054684969095083386, "deviation-center-line": 0.11422218650334327, "driven_lanedir_consec": 0.12698433567352296, "sim_compute_sim_state": 0.022407366679264948, "sim_compute_performance-ego": 0.039636694467984714, "sim_compute_robot_state-ego": 0.040525308022132285, "sim_compute_robot_state-npc0": 0.03993544211754432, "sim_compute_robot_state-npc1": 0.03879069364987887, "sim_compute_robot_state-npc2": 0.03898476637326754, "sim_compute_robot_state-npc3": 0.03891069155472975}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18600783001739896, "sim_physics": 0.10373439459965147, "survival_time": 1.4500000000000006, "driven_lanedir": 0.15459340479632822, "sim_render-ego": 0.0362396815727497, "in-drivable-lane": 0, "agent_compute-ego": 0.09848608641788878, "deviation-heading": 0.5662366424525823, "set_robot_commands": 0.05961529139814706, "deviation-center-line": 0.12119265669743222, "driven_lanedir_consec": 0.15459340479632822, "sim_compute_sim_state": 0.02277911120447619, "sim_compute_performance-ego": 0.03889318170218632, "sim_compute_robot_state-ego": 0.04077461670184958, "sim_compute_robot_state-npc0": 0.040218090188914334, "sim_compute_robot_state-npc1": 0.03948293883225013, "sim_compute_robot_state-npc2": 0.03935973397616682, "sim_compute_robot_state-npc3": 0.03930284237039501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1588427137831836, "sim_physics": 0.0955605598596426, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10885535221418796, "sim_render-ego": 0.0409390926361084, "in-drivable-lane": 0, "agent_compute-ego": 0.09672806813166691, "deviation-heading": 0.8179735961129668, "set_robot_commands": 0.05413778928609995, "deviation-center-line": 0.06851222384495047, "driven_lanedir_consec": 0.10885535221418796, "sim_compute_sim_state": 0.022675844339224007, "sim_compute_performance-ego": 0.038711052674513594, "sim_compute_robot_state-ego": 0.0404438513975877, "sim_compute_robot_state-npc0": 0.04023455656491793, "sim_compute_robot_state-npc1": 0.0395963742182805, "sim_compute_robot_state-npc2": 0.039476477182828464, "sim_compute_robot_state-npc3": 0.03966071972480187}}
set_robot_commands_max0.05961529139814706
set_robot_commands_mean0.0556583251746921
set_robot_commands_median0.054684969095083386
set_robot_commands_min0.05368356047005489
sim_compute_performance-ego_max0.039636694467984714
sim_compute_performance-ego_mean0.03895728743332163
sim_compute_performance-ego_median0.03889318170218632
sim_compute_performance-ego_min0.038370929915329505
sim_compute_robot_state-ego_max0.04199004895759351
sim_compute_robot_state-ego_mean0.0407779195168597
sim_compute_robot_state-ego_median0.040525308022132285
sim_compute_robot_state-ego_min0.04015577250513537
sim_compute_robot_state-npc0_max0.04031693574154016
sim_compute_robot_state-npc0_mean0.04008367982250674
sim_compute_robot_state-npc0_median0.040218090188914334
sim_compute_robot_state-npc0_min0.039713374499616955
sim_compute_robot_state-npc1_max0.03965806238579027
sim_compute_robot_state-npc1_mean0.039319317419997904
sim_compute_robot_state-npc1_median0.03948293883225013
sim_compute_robot_state-npc1_min0.03879069364987887
sim_compute_robot_state-npc2_max0.03975893511916652
sim_compute_robot_state-npc2_mean0.03926822182335143
sim_compute_robot_state-npc2_median0.03935973397616682
sim_compute_robot_state-npc2_min0.03876119646532782
sim_compute_robot_state-npc3_max0.03981246370257753
sim_compute_robot_state-npc3_mean0.039329143805036625
sim_compute_robot_state-npc3_median0.03930284237039501
sim_compute_robot_state-npc3_min0.03891069155472975
sim_compute_sim_state_max0.02277911120447619
sim_compute_sim_state_mean0.02257675638958511
sim_compute_sim_state_median0.022675844339224007
sim_compute_sim_state_min0.022265894659634293
sim_physics_max0.16573666803764575
sim_physics_mean0.11186118348217232
sim_physics_median0.1016466709283682
sim_physics_min0.0926276239855536
sim_render-ego_max0.0409390926361084
sim_render-ego_mean0.036871757670984266
sim_render-ego_median0.0362396815727497
sim_render-ego_min0.03476736463349441
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.4300000000000008
survival_time_min1.3000000000000005
241883980ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:02:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241863978ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241853977kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12900:02:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
241843976ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241833975ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241813973kene4192CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12900:02:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4608) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
241803972InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:03:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241783970ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241763968ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241743967jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:08:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241683965jagwarBaseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12900:16:52(hidden)
driven_lanedir_consec_median0.05319053470519375
survival_time_median1.5000000000000009
deviation-center-line_median0.08872565100894553
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.16517682870229086
agent_compute-ego_mean0.1534850875426983
agent_compute-ego_median0.1578334935506185
agent_compute-ego_min0.14089012145996094
deviation-center-line_max0.6767356052525613
deviation-center-line_mean0.2256396102592435
deviation-center-line_min0.02671726496495251
deviation-heading_max6.132459275055254
deviation-heading_mean2.803276609404043
deviation-heading_median0.7318868542222161
deviation-heading_min0.5568814768626287
driven_any_max1.761531755729803
driven_any_mean0.7539832808561595
driven_any_median0.1397644289602451
driven_any_min0.1030488965565943
driven_lanedir_consec_max0.5771916037737432
driven_lanedir_consec_mean0.2437017811590759
driven_lanedir_consec_min0.037661052742133494
driven_lanedir_max0.5771916037737432
driven_lanedir_mean0.2437017811590759
driven_lanedir_median0.05319053470519375
driven_lanedir_min0.037661052742133494
in-drivable-lane_max7.250000000000033
in-drivable-lane_mean3.0400000000000125
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 1.761531755729803, "sim_physics": 0.19118844509124755, "survival_time": 14.950000000000076, "driven_lanedir": 0.5771916037737432, "sim_render-ego": 0.05989348967870076, "in-drivable-lane": 6.950000000000031, "agent_compute-ego": 0.16247899611790975, "deviation-heading": 6.132459275055254, "set_robot_commands": 0.0916451334953308, "deviation-center-line": 0.2591638512627785, "driven_lanedir_consec": 0.5771916037737432, "sim_compute_sim_state": 0.03826332410176595, "sim_compute_performance-ego": 0.06595141490300496, "sim_compute_robot_state-ego": 0.07078574339548747, "sim_compute_robot_state-npc0": 0.06708263397216797, "sim_compute_robot_state-npc1": 0.06563827117284139, "sim_compute_robot_state-npc2": 0.06480464617411295, "sim_compute_robot_state-npc3": 0.06650219440460205}, "udem1-1-0": {"driven_any": 1.6464161123203065, "sim_physics": 0.18140601634979248, "survival_time": 14.950000000000076, "driven_lanedir": 0.5074466051259168, "sim_render-ego": 0.05641024112701416, "in-drivable-lane": 7.250000000000033, "agent_compute-ego": 0.1578334935506185, "deviation-heading": 6.001645290705572, "set_robot_commands": 0.09003806273142496, "deviation-center-line": 0.6767356052525613, "driven_lanedir_consec": 0.5074466051259168, "sim_compute_sim_state": 0.036508407592773434, "sim_compute_performance-ego": 0.0622144349416097, "sim_compute_robot_state-ego": 0.06654099702835083, "sim_compute_robot_state-npc0": 0.0631827203432719, "sim_compute_robot_state-npc1": 0.0640666643778483, "sim_compute_robot_state-npc2": 0.06248686790466309, "sim_compute_robot_state-npc3": 0.06284919261932373}, "udem1-2-0": {"driven_any": 0.1030488965565943, "sim_physics": 0.24685121575991312, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05319053470519375, "sim_render-ego": 0.06282935539881389, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16517682870229086, "deviation-heading": 0.5935101501745453, "set_robot_commands": 0.09339635570844014, "deviation-center-line": 0.08872565100894553, "driven_lanedir_consec": 0.05319053470519375, "sim_compute_sim_state": 0.03528385361035665, "sim_compute_performance-ego": 0.0668407678604126, "sim_compute_robot_state-ego": 0.06973543763160706, "sim_compute_robot_state-npc0": 0.06757597128550212, "sim_compute_robot_state-npc1": 0.06693775455156963, "sim_compute_robot_state-npc2": 0.06379615267117818, "sim_compute_robot_state-npc3": 0.06575765212376912}, "udem1-3-0": {"driven_any": 0.11915521071384916, "sim_physics": 0.1875779464327056, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04301910944839227, "sim_render-ego": 0.055227608516298494, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1410459978827115, "deviation-heading": 0.5568814768626287, "set_robot_commands": 0.07856731579221528, "deviation-center-line": 0.07685567880697966, "driven_lanedir_consec": 0.04301910944839227, "sim_compute_sim_state": 0.034313456765536605, "sim_compute_performance-ego": 0.05926909939996127, "sim_compute_robot_state-ego": 0.06208648352787413, "sim_compute_robot_state-npc0": 0.058755858191128434, "sim_compute_robot_state-npc1": 0.06014707170683762, "sim_compute_robot_state-npc2": 0.06355708220909381, "sim_compute_robot_state-npc3": 0.06335687637329102}, "udem1-4-0": {"driven_any": 0.1397644289602451, "sim_physics": 0.17609313329060872, "survival_time": 1.5000000000000009, "driven_lanedir": 0.037661052742133494, "sim_render-ego": 0.06062184969584147, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.14089012145996094, "deviation-heading": 0.7318868542222161, "set_robot_commands": 0.07962566216786703, "deviation-center-line": 0.02671726496495251, "driven_lanedir_consec": 0.037661052742133494, "sim_compute_sim_state": 0.032918485005696614, "sim_compute_performance-ego": 0.06371587912241618, "sim_compute_robot_state-ego": 0.06512213548024495, "sim_compute_robot_state-npc0": 0.05817345778147379, "sim_compute_robot_state-npc1": 0.05945538679758708, "sim_compute_robot_state-npc2": 0.05779317220052083, "sim_compute_robot_state-npc3": 0.05534669558207194}}
set_robot_commands_max0.09339635570844014
set_robot_commands_mean0.08665450597905563
set_robot_commands_median0.09003806273142496
set_robot_commands_min0.07856731579221528
sim_compute_performance-ego_max0.0668407678604126
sim_compute_performance-ego_mean0.06359831924548094
sim_compute_performance-ego_median0.06371587912241618
sim_compute_performance-ego_min0.05926909939996127
sim_compute_robot_state-ego_max0.07078574339548747
sim_compute_robot_state-ego_mean0.06685415941271289
sim_compute_robot_state-ego_median0.06654099702835083
sim_compute_robot_state-ego_min0.06208648352787413
sim_compute_robot_state-npc0_max0.06757597128550212
sim_compute_robot_state-npc0_mean0.06295412831470884
sim_compute_robot_state-npc0_median0.0631827203432719
sim_compute_robot_state-npc0_min0.05817345778147379
sim_compute_robot_state-npc1_max0.06693775455156963
sim_compute_robot_state-npc1_mean0.06324902972133681
sim_compute_robot_state-npc1_median0.0640666643778483
sim_compute_robot_state-npc1_min0.05945538679758708
sim_compute_robot_state-npc2_max0.06480464617411295
sim_compute_robot_state-npc2_mean0.062487584231913765
sim_compute_robot_state-npc2_median0.06355708220909381
sim_compute_robot_state-npc2_min0.05779317220052083
sim_compute_robot_state-npc3_max0.06650219440460205
sim_compute_robot_state-npc3_mean0.06276252222061157
sim_compute_robot_state-npc3_median0.06335687637329102
sim_compute_robot_state-npc3_min0.05534669558207194
sim_compute_sim_state_max0.03826332410176595
sim_compute_sim_state_mean0.03545750541522585
sim_compute_sim_state_median0.03528385361035665
sim_compute_sim_state_min0.032918485005696614
sim_physics_max0.24685121575991312
sim_physics_mean0.19662335138485348
sim_physics_median0.1875779464327056
sim_physics_min0.17609313329060872
sim_render-ego_max0.06282935539881389
sim_render-ego_mean0.05899650888333376
sim_render-ego_median0.05989348967870076
sim_render-ego_min0.055227608516298494
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.810000000000031
survival_time_min1.2000000000000004
241673956ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:02:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241653954InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:07:30(hidden)
driven_lanedir_consec_median0.07861043890431585
survival_time_median1.5000000000000009
deviation-center-line_median0.0925292907717837
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.14184424151544986
agent_compute-ego_mean0.1210292406046666
agent_compute-ego_median0.12969269355138144
agent_compute-ego_min0.09885097194362331
deviation-center-line_max0.3293219766992911
deviation-center-line_mean0.12363359349477844
deviation-center-line_min0.02984642261976296
deviation-heading_max3.1082803521983315
deviation-heading_mean1.1297640045456148
deviation-heading_median0.6935838691470626
deviation-heading_min0.5649381579388664
driven_any_max1.9931312639701548
driven_any_mean0.5236946648765095
driven_any_median0.16023958228601415
driven_any_min0.1147808773372466
driven_lanedir_consec_max0.14056068678419775
driven_lanedir_consec_mean0.08770698417009141
driven_lanedir_consec_min0.04956030453101212
driven_lanedir_max0.14056068678419775
driven_lanedir_mean0.08770698417009141
driven_lanedir_median0.07861043890431585
driven_lanedir_min0.04956030453101212
in-drivable-lane_max12.050000000000075
in-drivable-lane_mean2.6400000000000152
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22079577919878723, "sim_physics": 0.0992474298219423, "survival_time": 1.850000000000001, "driven_lanedir": 0.07861043890431585, "sim_render-ego": 0.03602337837219238, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09885097194362331, "deviation-heading": 0.7079984024804801, "set_robot_commands": 0.05471963495821566, "deviation-center-line": 0.06241721008209275, "driven_lanedir_consec": 0.07861043890431585, "sim_compute_sim_state": 0.022427649111361116, "sim_compute_performance-ego": 0.03833668296401565, "sim_compute_robot_state-ego": 0.04071192483644228, "sim_compute_robot_state-npc0": 0.039733074806831976, "sim_compute_robot_state-npc1": 0.03907843538232752, "sim_compute_robot_state-npc2": 0.03911367622581688, "sim_compute_robot_state-npc3": 0.03896522521972656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9931312639701548, "sim_physics": 0.09522852420806883, "survival_time": 14.950000000000076, "driven_lanedir": 0.14056068678419775, "sim_render-ego": 0.03862582524617513, "in-drivable-lane": 12.050000000000075, "agent_compute-ego": 0.10473135153452556, "deviation-heading": 3.1082803521983315, "set_robot_commands": 0.05815245548884074, "deviation-center-line": 0.3293219766992911, "driven_lanedir_consec": 0.14056068678419775, "sim_compute_sim_state": 0.024359974066416424, "sim_compute_performance-ego": 0.041845239003499346, "sim_compute_robot_state-ego": 0.04393174727757772, "sim_compute_robot_state-npc0": 0.04330559730529785, "sim_compute_robot_state-npc1": 0.042901959419250485, "sim_compute_robot_state-npc2": 0.04236151615778605, "sim_compute_robot_state-npc3": 0.042786657015482586}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12952582159034473, "sim_physics": 0.1315408448378245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09187287381280916, "sim_render-ego": 0.04477124412854513, "in-drivable-lane": 0, "agent_compute-ego": 0.12969269355138144, "deviation-heading": 0.5649381579388664, "set_robot_commands": 0.07245855530103047, "deviation-center-line": 0.10405306730096156, "driven_lanedir_consec": 0.09187287381280916, "sim_compute_sim_state": 0.029050131638844807, "sim_compute_performance-ego": 0.04835054278373718, "sim_compute_robot_state-ego": 0.05092929800351461, "sim_compute_robot_state-npc0": 0.05772672096888224, "sim_compute_robot_state-npc1": 0.057859718799591064, "sim_compute_robot_state-npc2": 0.058460732301076256, "sim_compute_robot_state-npc3": 0.0542600949605306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1147808773372466, "sim_physics": 0.14166123970695163, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07793061681812219, "sim_render-ego": 0.04383025998654573, "in-drivable-lane": 0, "agent_compute-ego": 0.14184424151544986, "deviation-heading": 0.5740192409633336, "set_robot_commands": 0.07727030049199643, "deviation-center-line": 0.0925292907717837, "driven_lanedir_consec": 0.07793061681812219, "sim_compute_sim_state": 0.029622865759808083, "sim_compute_performance-ego": 0.04922910358594811, "sim_compute_robot_state-ego": 0.053419455238010574, "sim_compute_robot_state-npc0": 0.05969141877215842, "sim_compute_robot_state-npc1": 0.05396742406098739, "sim_compute_robot_state-npc2": 0.0513574973396633, "sim_compute_robot_state-npc3": 0.051432495531828507}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16023958228601415, "sim_physics": 0.1231859048207601, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04956030453101212, "sim_render-ego": 0.04751433531443278, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.13002694447835286, "deviation-heading": 0.6935838691470626, "set_robot_commands": 0.07568442821502686, "deviation-center-line": 0.02984642261976296, "driven_lanedir_consec": 0.04956030453101212, "sim_compute_sim_state": 0.03212429682413737, "sim_compute_performance-ego": 0.05176841417948405, "sim_compute_robot_state-ego": 0.054657944043477374, "sim_compute_robot_state-npc0": 0.05627603530883789, "sim_compute_robot_state-npc1": 0.05406216780344645, "sim_compute_robot_state-npc2": 0.05621006488800049, "sim_compute_robot_state-npc3": 0.05656065940856934}}
set_robot_commands_max0.07727030049199643
set_robot_commands_mean0.06765707489102205
set_robot_commands_median0.07245855530103047
set_robot_commands_min0.05471963495821566
sim_compute_performance-ego_max0.05176841417948405
sim_compute_performance-ego_mean0.04590599650333687
sim_compute_performance-ego_median0.04835054278373718
sim_compute_performance-ego_min0.03833668296401565
sim_compute_robot_state-ego_max0.054657944043477374
sim_compute_robot_state-ego_mean0.048730073879804506
sim_compute_robot_state-ego_median0.05092929800351461
sim_compute_robot_state-ego_min0.04071192483644228
sim_compute_robot_state-npc0_max0.05969141877215842
sim_compute_robot_state-npc0_mean0.05134656943240168
sim_compute_robot_state-npc0_median0.05627603530883789
sim_compute_robot_state-npc0_min0.039733074806831976
sim_compute_robot_state-npc1_max0.057859718799591064
sim_compute_robot_state-npc1_mean0.049573941093120584
sim_compute_robot_state-npc1_median0.05396742406098739
sim_compute_robot_state-npc1_min0.03907843538232752
sim_compute_robot_state-npc2_max0.058460732301076256
sim_compute_robot_state-npc2_mean0.049500697382468595
sim_compute_robot_state-npc2_median0.0513574973396633
sim_compute_robot_state-npc2_min0.03911367622581688
sim_compute_robot_state-npc3_max0.05656065940856934
sim_compute_robot_state-npc3_mean0.048801026427227515
sim_compute_robot_state-npc3_median0.051432495531828507
sim_compute_robot_state-npc3_min0.03896522521972656
sim_compute_sim_state_max0.03212429682413737
sim_compute_sim_state_mean0.02751698348011356
sim_compute_sim_state_median0.029050131638844807
sim_compute_sim_state_min0.022427649111361116
sim_physics_max0.14166123970695163
sim_physics_mean0.11817278867910948
sim_physics_median0.1231859048207601
sim_physics_min0.09522852420806883
sim_render-ego_max0.04751433531443278
sim_render-ego_mean0.042153008609578234
sim_render-ego_median0.04383025998654573
sim_render-ego_min0.03602337837219238
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.130000000000015
survival_time_min1.1500000000000004
241643953InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:12:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241633952kene4192ResNet-Combined-500aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:08:50(hidden)
driven_lanedir_consec_median0.4589478924646482
survival_time_median5.549999999999988
deviation-center-line_median0.2732370478243992
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.14823703157821758
agent_compute-ego_mean0.14413362705384553
agent_compute-ego_median0.14294548630714415
agent_compute-ego_min0.14255314338498
deviation-center-line_max0.34410229979389356
deviation-center-line_mean0.25188165950331576
deviation-center-line_min0.15636545654094347
deviation-heading_max1.56768180905471
deviation-heading_mean1.2419051427710806
deviation-heading_median1.2737719576940765
deviation-heading_min0.9227739414581312
driven_any_max1.09838571170569
driven_any_mean0.7838372691157963
driven_any_median0.8057429573770406
driven_any_min0.5609253507783094
driven_lanedir_consec_max0.7750688968866272
driven_lanedir_consec_mean0.447568640354591
driven_lanedir_consec_min0.24750251651826585
driven_lanedir_max0.7750688968866272
driven_lanedir_mean0.4486313519956516
driven_lanedir_median0.4589478924646482
driven_lanedir_min0.24833493117162275
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean1.8099999999999936
in-drivable-lane_min1.399999999999995
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8057429573770406, "sim_physics": 0.09423070555334692, "survival_time": 5.549999999999988, "driven_lanedir": 0.5027220691343182, "sim_render-ego": 0.03626152201815768, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.14410545589687587, "deviation-heading": 1.4204368369060838, "set_robot_commands": 0.05474168975074012, "deviation-center-line": 0.3120199445982953, "driven_lanedir_consec": 0.4982409255823717, "sim_compute_sim_state": 0.02274229505040624, "sim_compute_performance-ego": 0.03866694424603436, "sim_compute_robot_state-ego": 0.04059764501210805, "sim_compute_robot_state-npc0": 0.04011738837302268, "sim_compute_robot_state-npc1": 0.03941205600360492, "sim_compute_robot_state-npc2": 0.03933852642506092, "sim_compute_robot_state-npc3": 0.03944009703558844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8725044774766706, "sim_physics": 0.09978856643040974, "survival_time": 5.999999999999987, "driven_lanedir": 0.4589478924646482, "sim_render-ego": 0.035581036408742266, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.1428270181020101, "deviation-heading": 0.9227739414581312, "set_robot_commands": 0.05576436320940654, "deviation-center-line": 0.2732370478243992, "driven_lanedir_consec": 0.4589478924646482, "sim_compute_sim_state": 0.02229543129603068, "sim_compute_performance-ego": 0.03814337849617004, "sim_compute_robot_state-ego": 0.04043074250221253, "sim_compute_robot_state-npc0": 0.040201954046885174, "sim_compute_robot_state-npc1": 0.03914828896522522, "sim_compute_robot_state-npc2": 0.03900692860285441, "sim_compute_robot_state-npc3": 0.03917133212089539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5609253507783094, "sim_physics": 0.08666641116142274, "survival_time": 3.999999999999994, "driven_lanedir": 0.24833493117162275, "sim_render-ego": 0.034605520963668826, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.14294548630714415, "deviation-heading": 1.2737719576940765, "set_robot_commands": 0.05412046015262604, "deviation-center-line": 0.17368354875904737, "driven_lanedir_consec": 0.24750251651826585, "sim_compute_sim_state": 0.030200654268264772, "sim_compute_performance-ego": 0.03790692687034607, "sim_compute_robot_state-ego": 0.04004885256290436, "sim_compute_robot_state-npc0": 0.03980890810489655, "sim_compute_robot_state-npc1": 0.038994011282920835, "sim_compute_robot_state-npc2": 0.038772988319396975, "sim_compute_robot_state-npc3": 0.03890398442745209}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5816278482412709, "sim_physics": 0.08993402923025735, "survival_time": 4.099999999999993, "driven_lanedir": 0.25808297032104166, "sim_render-ego": 0.034812819666978786, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14255314338498, "deviation-heading": 1.024861168742401, "set_robot_commands": 0.05434452615133146, "deviation-center-line": 0.15636545654094347, "driven_lanedir_consec": 0.25808297032104166, "sim_compute_sim_state": 0.022277715729504096, "sim_compute_performance-ego": 0.038084768667453674, "sim_compute_robot_state-ego": 0.04278869745207996, "sim_compute_robot_state-npc0": 0.04042588792196134, "sim_compute_robot_state-npc1": 0.039004378202484875, "sim_compute_robot_state-npc2": 0.03912252623860429, "sim_compute_robot_state-npc3": 0.03890767039322272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.09838571170569, "sim_physics": 0.08566444032144227, "survival_time": 7.449999999999981, "driven_lanedir": 0.7750688968866272, "sim_render-ego": 0.03582686545864848, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14823703157821758, "deviation-heading": 1.56768180905471, "set_robot_commands": 0.05454113179405264, "deviation-center-line": 0.34410229979389356, "driven_lanedir_consec": 0.7750688968866272, "sim_compute_sim_state": 0.02372955155852657, "sim_compute_performance-ego": 0.038512735558836254, "sim_compute_robot_state-ego": 0.040792220390883066, "sim_compute_robot_state-npc0": 0.040215717866116725, "sim_compute_robot_state-npc1": 0.03955236857369442, "sim_compute_robot_state-npc2": 0.03937416428687589, "sim_compute_robot_state-npc3": 0.03942624354522501}}
set_robot_commands_max0.05576436320940654
set_robot_commands_mean0.05470243421163136
set_robot_commands_median0.05454113179405264
set_robot_commands_min0.05412046015262604
sim_compute_performance-ego_max0.03866694424603436
sim_compute_performance-ego_mean0.038262950767768075
sim_compute_performance-ego_median0.03814337849617004
sim_compute_performance-ego_min0.03790692687034607
sim_compute_robot_state-ego_max0.04278869745207996
sim_compute_robot_state-ego_mean0.04093163158403759
sim_compute_robot_state-ego_median0.04059764501210805
sim_compute_robot_state-ego_min0.04004885256290436
sim_compute_robot_state-npc0_max0.04042588792196134
sim_compute_robot_state-npc0_mean0.040153971262576485
sim_compute_robot_state-npc0_median0.040201954046885174
sim_compute_robot_state-npc0_min0.03980890810489655
sim_compute_robot_state-npc1_max0.03955236857369442
sim_compute_robot_state-npc1_mean0.039222220605586056
sim_compute_robot_state-npc1_median0.03914828896522522
sim_compute_robot_state-npc1_min0.038994011282920835
sim_compute_robot_state-npc2_max0.03937416428687589
sim_compute_robot_state-npc2_mean0.0391230267745585
sim_compute_robot_state-npc2_median0.03912252623860429
sim_compute_robot_state-npc2_min0.038772988319396975
sim_compute_robot_state-npc3_max0.03944009703558844
sim_compute_robot_state-npc3_mean0.03916986550447673
sim_compute_robot_state-npc3_median0.03917133212089539
sim_compute_robot_state-npc3_min0.03890398442745209
sim_compute_sim_state_max0.030200654268264772
sim_compute_sim_state_mean0.024249129580546473
sim_compute_sim_state_median0.02274229505040624
sim_compute_sim_state_min0.022277715729504096
sim_physics_max0.09978856643040974
sim_physics_mean0.0912568305393758
sim_physics_median0.08993402923025735
sim_physics_min0.08566444032144227
sim_render-ego_max0.03626152201815768
sim_render-ego_mean0.03541755290323921
sim_render-ego_median0.035581036408742266
sim_render-ego_min0.034605520963668826
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean5.419999999999989
survival_time_min3.999999999999994
241623951kene4192ResNet-Combined-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:12:51(hidden)
driven_lanedir_consec_median0.29508753702959556
survival_time_median5.749999999999988
deviation-center-line_median0.2059687425493089
in-drivable-lane_median2.5999999999999908


other stats
agent_compute-ego_max0.1925699517533586
agent_compute-ego_mean0.1817838355169224
agent_compute-ego_median0.18084408584253747
agent_compute-ego_min0.172406538327535
deviation-center-line_max0.43296025976298386
deviation-center-line_mean0.23348413724631295
deviation-center-line_min0.11419995840473224
deviation-heading_max1.391041140942218
deviation-heading_mean1.113795520692506
deviation-heading_median1.2022172017580914
deviation-heading_min0.6980494855980874
driven_any_max1.1010553022789005
driven_any_mean0.6832727007486209
driven_any_median0.6691345653210314
driven_any_min0.21149230325216872
driven_lanedir_consec_max0.5757554391847877
driven_lanedir_consec_mean0.330507412007999
driven_lanedir_consec_min0.1715530912881481
driven_lanedir_max0.5757554391847877
driven_lanedir_mean0.330507412007999
driven_lanedir_median0.29508753702959556
driven_lanedir_min0.1715530912881481
in-drivable-lane_max5.849999999999995
in-drivable-lane_mean2.519999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1010553022789005, "sim_physics": 0.11541490798646752, "survival_time": 8.79999999999999, "driven_lanedir": 0.5757554391847877, "sim_render-ego": 0.04397284984588623, "in-drivable-lane": 4.099999999999999, "agent_compute-ego": 0.17808677527037534, "deviation-heading": 0.6980494855980874, "set_robot_commands": 0.06855979426340623, "deviation-center-line": 0.43296025976298386, "driven_lanedir_consec": 0.5757554391847877, "sim_compute_sim_state": 0.028655501929196445, "sim_compute_performance-ego": 0.049017346718094566, "sim_compute_robot_state-ego": 0.05063325302167372, "sim_compute_robot_state-npc0": 0.05236324126070196, "sim_compute_robot_state-npc1": 0.05470769242806868, "sim_compute_robot_state-npc2": 0.05064139853824269, "sim_compute_robot_state-npc3": 0.05017097836191004}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3475890288176715, "sim_physics": 0.12257886330286662, "survival_time": 2.9999999999999973, "driven_lanedir": 0.29356588765843483, "sim_render-ego": 0.043844350179036456, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.172406538327535, "deviation-heading": 1.391041140942218, "set_robot_commands": 0.06911156177520753, "deviation-center-line": 0.19142854425691477, "driven_lanedir_consec": 0.29356588765843483, "sim_compute_sim_state": 0.028947106997172036, "sim_compute_performance-ego": 0.0502185583114624, "sim_compute_robot_state-ego": 0.05318384567896525, "sim_compute_robot_state-npc0": 0.050666956106821696, "sim_compute_robot_state-npc1": 0.0501931627591451, "sim_compute_robot_state-npc2": 0.04945802688598633, "sim_compute_robot_state-npc3": 0.04940900007883708}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6691345653210314, "sim_physics": 0.11006838757058848, "survival_time": 5.749999999999988, "driven_lanedir": 0.29508753702959556, "sim_render-ego": 0.04629520333331564, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.18501182639080543, "deviation-heading": 1.3184311569069338, "set_robot_commands": 0.07620573043823242, "deviation-center-line": 0.2059687425493089, "driven_lanedir_consec": 0.29508753702959556, "sim_compute_sim_state": 0.029212522506713863, "sim_compute_performance-ego": 0.050793542032656465, "sim_compute_robot_state-ego": 0.05084130660347316, "sim_compute_robot_state-npc0": 0.05448712266009787, "sim_compute_robot_state-npc1": 0.05373456167138141, "sim_compute_robot_state-npc2": 0.052798430815986966, "sim_compute_robot_state-npc3": 0.05328532923822817}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0870923040733325, "sim_physics": 0.11514250393020374, "survival_time": 8.949999999999992, "driven_lanedir": 0.31657510487902885, "sim_render-ego": 0.045191956631964146, "in-drivable-lane": 5.849999999999995, "agent_compute-ego": 0.18084408584253747, "deviation-heading": 1.2022172017580914, "set_robot_commands": 0.0699584817087184, "deviation-center-line": 0.22286318125762528, "driven_lanedir_consec": 0.31657510487902885, "sim_compute_sim_state": 0.02851244191217689, "sim_compute_performance-ego": 0.049315408621420406, "sim_compute_robot_state-ego": 0.05012057746588851, "sim_compute_robot_state-npc0": 0.05339875700753494, "sim_compute_robot_state-npc1": 0.053196811143246446, "sim_compute_robot_state-npc2": 0.05175493282978761, "sim_compute_robot_state-npc3": 0.05149606619467283}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21149230325216872, "sim_physics": 0.12058456523998363, "survival_time": 1.850000000000001, "driven_lanedir": 0.1715530912881481, "sim_render-ego": 0.06660775236181311, "in-drivable-lane": 0, "agent_compute-ego": 0.1925699517533586, "deviation-heading": 0.9592386182571984, "set_robot_commands": 0.0797213670369741, "deviation-center-line": 0.11419995840473224, "driven_lanedir_consec": 0.1715530912881481, "sim_compute_sim_state": 0.029643677376412055, "sim_compute_performance-ego": 0.051481395154385955, "sim_compute_robot_state-ego": 0.05509873338647791, "sim_compute_robot_state-npc0": 0.05386203044169658, "sim_compute_robot_state-npc1": 0.05380888242979307, "sim_compute_robot_state-npc2": 0.053404421419710725, "sim_compute_robot_state-npc3": 0.05516947282327188}}
set_robot_commands_max0.0797213670369741
set_robot_commands_mean0.07271138704450772
set_robot_commands_median0.0699584817087184
set_robot_commands_min0.06855979426340623
sim_compute_performance-ego_max0.051481395154385955
sim_compute_performance-ego_mean0.05016525016760396
sim_compute_performance-ego_median0.0502185583114624
sim_compute_performance-ego_min0.049017346718094566
sim_compute_robot_state-ego_max0.05509873338647791
sim_compute_robot_state-ego_mean0.051975543231295704
sim_compute_robot_state-ego_median0.05084130660347316
sim_compute_robot_state-ego_min0.05012057746588851
sim_compute_robot_state-npc0_max0.05448712266009787
sim_compute_robot_state-npc0_mean0.05295562149537061
sim_compute_robot_state-npc0_median0.05339875700753494
sim_compute_robot_state-npc0_min0.050666956106821696
sim_compute_robot_state-npc1_max0.05470769242806868
sim_compute_robot_state-npc1_mean0.05312822208632695
sim_compute_robot_state-npc1_median0.05373456167138141
sim_compute_robot_state-npc1_min0.0501931627591451
sim_compute_robot_state-npc2_max0.053404421419710725
sim_compute_robot_state-npc2_mean0.05161144209794286
sim_compute_robot_state-npc2_median0.05175493282978761
sim_compute_robot_state-npc2_min0.04945802688598633
sim_compute_robot_state-npc3_max0.05516947282327188
sim_compute_robot_state-npc3_mean0.051906169339384
sim_compute_robot_state-npc3_median0.05149606619467283
sim_compute_robot_state-npc3_min0.04940900007883708
sim_compute_sim_state_max0.029643677376412055
sim_compute_sim_state_mean0.02899425014433426
sim_compute_sim_state_median0.028947106997172036
sim_compute_sim_state_min0.02851244191217689
sim_physics_max0.12257886330286662
sim_physics_mean0.116757845606022
sim_physics_median0.11541490798646752
sim_physics_min0.11006838757058848
sim_render-ego_max0.06660775236181311
sim_render-ego_mean0.04918242247040312
sim_render-ego_median0.045191956631964146
sim_render-ego_min0.043844350179036456
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean5.669999999999994
survival_time_min1.850000000000001
241603950kene4192ResNet-First-500aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:08:09(hidden)
driven_lanedir_consec_median0.2746668393238183
survival_time_median3.349999999999996
deviation-center-line_median0.2493966621579762
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13243227005004882
agent_compute-ego_mean0.1307094551550347
agent_compute-ego_median0.13034532286904074
agent_compute-ego_min0.12977418303489685
deviation-center-line_max0.35261397432018726
deviation-center-line_mean0.2725011981027062
deviation-center-line_min0.2143901225150106
deviation-heading_max1.9550795655786484
deviation-heading_mean1.1657117778599588
deviation-heading_median0.8827120309855782
deviation-heading_min0.5627400348400277
driven_any_max0.4549362764475247
driven_any_mean0.33260881004308895
driven_any_median0.3118273862187141
driven_any_min0.24451066059497653
driven_lanedir_consec_max0.4064316650562807
driven_lanedir_consec_mean0.3043818705630216
driven_lanedir_consec_min0.23488859602179657
driven_lanedir_max0.4064316650562807
driven_lanedir_mean0.3043818705630216
driven_lanedir_median0.2746668393238183
driven_lanedir_min0.23488859602179657
in-drivable-lane_max0.1999999999999993
in-drivable-lane_mean0.04999999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4549362764475247, "sim_physics": 0.09344662102785978, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4064316650562807, "sim_render-ego": 0.0362589337609031, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.13243227005004882, "deviation-heading": 1.9550795655786484, "set_robot_commands": 0.05524171482432972, "deviation-center-line": 0.35261397432018726, "driven_lanedir_consec": 0.4064316650562807, "sim_compute_sim_state": 0.022411179542541505, "sim_compute_performance-ego": 0.03837053342299028, "sim_compute_robot_state-ego": 0.04040866981853138, "sim_compute_robot_state-npc0": 0.03968778090043502, "sim_compute_robot_state-npc1": 0.0391209754076871, "sim_compute_robot_state-npc2": 0.038938533176075325, "sim_compute_robot_state-npc3": 0.03975115472620184}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3118273862187141, "sim_physics": 0.08962391151322259, "survival_time": 3.599999999999995, "driven_lanedir": 0.25675940500194505, "sim_render-ego": 0.03465605444378323, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12977418303489685, "deviation-heading": 1.811494882196615, "set_robot_commands": 0.054713586966196694, "deviation-center-line": 0.24495706221834396, "driven_lanedir_consec": 0.25675940500194505, "sim_compute_sim_state": 0.022301418913735285, "sim_compute_performance-ego": 0.03834600249926249, "sim_compute_robot_state-ego": 0.039982640080981784, "sim_compute_robot_state-npc0": 0.03969201445579529, "sim_compute_robot_state-npc1": 0.04213465915785895, "sim_compute_robot_state-npc2": 0.03878019253412882, "sim_compute_robot_state-npc3": 0.03899160027503967}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24451066059497653, "sim_physics": 0.09639231074940074, "survival_time": 2.7499999999999982, "driven_lanedir": 0.23488859602179657, "sim_render-ego": 0.03518643379211426, "in-drivable-lane": 0, "agent_compute-ego": 0.13034532286904074, "deviation-heading": 0.616532375698925, "set_robot_commands": 0.05426044030623003, "deviation-center-line": 0.2493966621579762, "driven_lanedir_consec": 0.23488859602179657, "sim_compute_sim_state": 0.02207747372713956, "sim_compute_performance-ego": 0.03803690130060369, "sim_compute_robot_state-ego": 0.039972691102461384, "sim_compute_robot_state-npc0": 0.039342004602605646, "sim_compute_robot_state-npc1": 0.03866985494440252, "sim_compute_robot_state-npc2": 0.039189720153808595, "sim_compute_robot_state-npc3": 0.03864495970986106}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2855132245954165, "sim_physics": 0.09671634098268904, "survival_time": 2.6499999999999986, "driven_lanedir": 0.2746668393238183, "sim_render-ego": 0.03546766515048045, "in-drivable-lane": 0, "agent_compute-ego": 0.1303028790455944, "deviation-heading": 0.5627400348400277, "set_robot_commands": 0.05432827967517781, "deviation-center-line": 0.2143901225150106, "driven_lanedir_consec": 0.2746668393238183, "sim_compute_sim_state": 0.022295731418537645, "sim_compute_performance-ego": 0.03876945657550164, "sim_compute_robot_state-ego": 0.03998785198859449, "sim_compute_robot_state-npc0": 0.039528662303708634, "sim_compute_robot_state-npc1": 0.03909557720400252, "sim_compute_robot_state-npc2": 0.03867507880588747, "sim_compute_robot_state-npc3": 0.038966021447811486}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36625650235881296, "sim_physics": 0.08555191310484019, "survival_time": 3.349999999999996, "driven_lanedir": 0.34916284741126713, "sim_render-ego": 0.03536779844938819, "in-drivable-lane": 0, "agent_compute-ego": 0.13069262077559285, "deviation-heading": 0.8827120309855782, "set_robot_commands": 0.05497287280523955, "deviation-center-line": 0.3011481693020129, "driven_lanedir_consec": 0.34916284741126713, "sim_compute_sim_state": 0.022237674513859537, "sim_compute_performance-ego": 0.038058551389779614, "sim_compute_robot_state-ego": 0.03996752269232451, "sim_compute_robot_state-npc0": 0.039549098086001266, "sim_compute_robot_state-npc1": 0.03889600554508949, "sim_compute_robot_state-npc2": 0.03869755588360687, "sim_compute_robot_state-npc3": 0.03891397234219224}}
set_robot_commands_max0.05524171482432972
set_robot_commands_mean0.05470337891543475
set_robot_commands_median0.054713586966196694
set_robot_commands_min0.05426044030623003
sim_compute_performance-ego_max0.03876945657550164
sim_compute_performance-ego_mean0.03831628903762754
sim_compute_performance-ego_median0.03834600249926249
sim_compute_performance-ego_min0.03803690130060369
sim_compute_robot_state-ego_max0.04040866981853138
sim_compute_robot_state-ego_mean0.040063875136578705
sim_compute_robot_state-ego_median0.039982640080981784
sim_compute_robot_state-ego_min0.03996752269232451
sim_compute_robot_state-npc0_max0.03969201445579529
sim_compute_robot_state-npc0_mean0.03955991206970917
sim_compute_robot_state-npc0_median0.039549098086001266
sim_compute_robot_state-npc0_min0.039342004602605646
sim_compute_robot_state-npc1_max0.04213465915785895
sim_compute_robot_state-npc1_mean0.03958341445180811
sim_compute_robot_state-npc1_median0.03909557720400252
sim_compute_robot_state-npc1_min0.03866985494440252
sim_compute_robot_state-npc2_max0.039189720153808595
sim_compute_robot_state-npc2_mean0.03885621611070142
sim_compute_robot_state-npc2_median0.03878019253412882
sim_compute_robot_state-npc2_min0.03867507880588747
sim_compute_robot_state-npc3_max0.03975115472620184
sim_compute_robot_state-npc3_mean0.03905354170022126
sim_compute_robot_state-npc3_median0.038966021447811486
sim_compute_robot_state-npc3_min0.03864495970986106
sim_compute_sim_state_max0.022411179542541505
sim_compute_sim_state_mean0.022264695623162703
sim_compute_sim_state_median0.022295731418537645
sim_compute_sim_state_min0.02207747372713956
sim_physics_max0.09671634098268904
sim_physics_mean0.09234621947560248
sim_physics_median0.09344662102785978
sim_physics_min0.08555191310484019
sim_render-ego_max0.0362589337609031
sim_render-ego_mean0.035387377119333846
sim_render-ego_median0.03536779844938819
sim_render-ego_min0.03465605444378323
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean3.5699999999999954
survival_time_min2.6499999999999986
241593949kene4192ResNet-First-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:08:27(hidden)
driven_lanedir_consec_median0.3146426904693782
survival_time_median3.399999999999996
deviation-center-line_median0.2905707012218368
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13560217145889525
agent_compute-ego_mean0.13111274918293556
agent_compute-ego_median0.13053399403889973
agent_compute-ego_min0.1269652274117541
deviation-center-line_max0.32605608765525007
deviation-center-line_mean0.2829819167900262
deviation-center-line_min0.23839925792125427
deviation-heading_max1.9886792073753896
deviation-heading_mean1.1551162037221194
deviation-heading_median0.9354687362217136
deviation-heading_min0.586796931705462
driven_any_max0.42459458520693305
driven_any_mean0.3377772576865833
driven_any_median0.3252687014325032
driven_any_min0.2780384066147995
driven_lanedir_consec_max0.39360276940393835
driven_lanedir_consec_mean0.3136197833498578
driven_lanedir_consec_min0.25219949810362996
driven_lanedir_max0.39360276940393835
driven_lanedir_mean0.3136197833498578
driven_lanedir_median0.3146426904693782
driven_lanedir_min0.25219949810362996
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.42459458520693305, "sim_physics": 0.0921651452452272, "survival_time": 4.549999999999992, "driven_lanedir": 0.39360276940393835, "sim_render-ego": 0.03692013876778739, "in-drivable-lane": 0, "agent_compute-ego": 0.13297581672668457, "deviation-heading": 1.5936349349510563, "set_robot_commands": 0.05438794146527301, "deviation-center-line": 0.32605608765525007, "driven_lanedir_consec": 0.39360276940393835, "sim_compute_sim_state": 0.02293273904821375, "sim_compute_performance-ego": 0.04127369870196332, "sim_compute_robot_state-ego": 0.04061549050467355, "sim_compute_robot_state-npc0": 0.04040292069152161, "sim_compute_robot_state-npc1": 0.03988532705621405, "sim_compute_robot_state-npc2": 0.039748553391341326, "sim_compute_robot_state-npc3": 0.03973352516090477}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3041950863577518, "sim_physics": 0.09033322016398113, "survival_time": 3.7499999999999942, "driven_lanedir": 0.25219949810362996, "sim_render-ego": 0.0348824151357015, "in-drivable-lane": 0, "agent_compute-ego": 0.13053399403889973, "deviation-heading": 1.9886792073753896, "set_robot_commands": 0.05372927347819011, "deviation-center-line": 0.265640937890693, "driven_lanedir_consec": 0.25219949810362996, "sim_compute_sim_state": 0.02250668525695801, "sim_compute_performance-ego": 0.03830652872721354, "sim_compute_robot_state-ego": 0.040291032791137694, "sim_compute_robot_state-npc0": 0.03994073232014974, "sim_compute_robot_state-npc1": 0.039135281244913736, "sim_compute_robot_state-npc2": 0.04177555084228515, "sim_compute_robot_state-npc3": 0.0392715326944987}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2780384066147995, "sim_physics": 0.09395834581175846, "survival_time": 3.349999999999996, "driven_lanedir": 0.2684238379205497, "sim_render-ego": 0.035576745645323794, "in-drivable-lane": 0, "agent_compute-ego": 0.1269652274117541, "deviation-heading": 0.6710012083569757, "set_robot_commands": 0.05367310723262047, "deviation-center-line": 0.294242599261097, "driven_lanedir_consec": 0.2684238379205497, "sim_compute_sim_state": 0.02231698249703023, "sim_compute_performance-ego": 0.038131528825902226, "sim_compute_robot_state-ego": 0.04030258975811859, "sim_compute_robot_state-npc0": 0.040559064096479275, "sim_compute_robot_state-npc1": 0.03906322948968233, "sim_compute_robot_state-npc2": 0.038827465541327176, "sim_compute_robot_state-npc3": 0.03902516080372369}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3252687014325032, "sim_physics": 0.097874054833064, "survival_time": 3.149999999999997, "driven_lanedir": 0.3146426904693782, "sim_render-ego": 0.03607183411007836, "in-drivable-lane": 0, "agent_compute-ego": 0.13560217145889525, "deviation-heading": 0.586796931705462, "set_robot_commands": 0.05373563463725741, "deviation-center-line": 0.23839925792125427, "driven_lanedir_consec": 0.3146426904693782, "sim_compute_sim_state": 0.022659483410063245, "sim_compute_performance-ego": 0.038436760978093225, "sim_compute_robot_state-ego": 0.04065094296894376, "sim_compute_robot_state-npc0": 0.040080660865420385, "sim_compute_robot_state-npc1": 0.03930825278872535, "sim_compute_robot_state-npc2": 0.039288006131611174, "sim_compute_robot_state-npc3": 0.03997681254432315}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.35678950882092886, "sim_physics": 0.0880545412792879, "survival_time": 3.399999999999996, "driven_lanedir": 0.3392301208517927, "sim_render-ego": 0.0361782663008746, "in-drivable-lane": 0, "agent_compute-ego": 0.12948653627844417, "deviation-heading": 0.9354687362217136, "set_robot_commands": 0.05392141201916863, "deviation-center-line": 0.2905707012218368, "driven_lanedir_consec": 0.3392301208517927, "sim_compute_sim_state": 0.02288971227758071, "sim_compute_performance-ego": 0.038588443223167866, "sim_compute_robot_state-ego": 0.04055072279537425, "sim_compute_robot_state-npc0": 0.04041621965520522, "sim_compute_robot_state-npc1": 0.03956943399765912, "sim_compute_robot_state-npc2": 0.03940596650628483, "sim_compute_robot_state-npc3": 0.0395401821416967}}
set_robot_commands_max0.05438794146527301
set_robot_commands_mean0.053889473766501925
set_robot_commands_median0.05373563463725741
set_robot_commands_min0.05367310723262047
sim_compute_performance-ego_max0.04127369870196332
sim_compute_performance-ego_mean0.03894739209126804
sim_compute_performance-ego_median0.038436760978093225
sim_compute_performance-ego_min0.038131528825902226
sim_compute_robot_state-ego_max0.04065094296894376
sim_compute_robot_state-ego_mean0.040482155763649566
sim_compute_robot_state-ego_median0.04055072279537425
sim_compute_robot_state-ego_min0.040291032791137694
sim_compute_robot_state-npc0_max0.040559064096479275
sim_compute_robot_state-npc0_mean0.04027991952575525
sim_compute_robot_state-npc0_median0.04040292069152161
sim_compute_robot_state-npc0_min0.03994073232014974
sim_compute_robot_state-npc1_max0.03988532705621405
sim_compute_robot_state-npc1_mean0.039392304915438915
sim_compute_robot_state-npc1_median0.03930825278872535
sim_compute_robot_state-npc1_min0.03906322948968233
sim_compute_robot_state-npc2_max0.04177555084228515
sim_compute_robot_state-npc2_mean0.03980910848256993
sim_compute_robot_state-npc2_median0.03940596650628483
sim_compute_robot_state-npc2_min0.038827465541327176
sim_compute_robot_state-npc3_max0.03997681254432315
sim_compute_robot_state-npc3_mean0.03950944266902941
sim_compute_robot_state-npc3_median0.0395401821416967
sim_compute_robot_state-npc3_min0.03902516080372369
sim_compute_sim_state_max0.02293273904821375
sim_compute_sim_state_mean0.02266112049796919
sim_compute_sim_state_median0.022659483410063245
sim_compute_sim_state_min0.02231698249703023
sim_physics_max0.097874054833064
sim_physics_mean0.09247706146666376
sim_physics_median0.0921651452452272
sim_physics_min0.0880545412792879
sim_render-ego_max0.03692013876778739
sim_render-ego_mean0.035925879991953125
sim_render-ego_median0.03607183411007836
sim_render-ego_min0.0348824151357015
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean3.639999999999995
survival_time_min3.149999999999997
241583948ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241573947ekunniichallenge-aido_LF-template-randomaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:03:17(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.08836619159843348
agent_compute-ego_mean0.08722168107092083
agent_compute-ego_median0.08707602351319556
agent_compute-ego_min0.08629052779253792
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05746628178490533, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03515225428122061, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0874064012810036, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05456455107088442, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.022593171508223923, "sim_compute_performance-ego": 0.03941203929759838, "sim_compute_robot_state-ego": 0.040259869010360154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05531026802810968, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03519624354792576, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08707602351319556, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.054511706034342446, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.022791619394339768, "sim_compute_performance-ego": 0.038183226304895734, "sim_compute_robot_state-ego": 0.04014192375482297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06063055992126465, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03492830781375661, "in-drivable-lane": 0, "agent_compute-ego": 0.08629052779253792, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.05398886344012093, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.022525576984181124, "sim_compute_performance-ego": 0.03784700000987334, "sim_compute_robot_state-ego": 0.040166013381060434}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06363832473754882, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03518622398376465, "in-drivable-lane": 0, "agent_compute-ego": 0.0869692611694336, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.06007771492004395, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.022593259811401367, "sim_compute_performance-ego": 0.03827417373657226, "sim_compute_robot_state-ego": 0.040163002014160155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05356701114509679, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03589986245843429, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08836619159843348, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05501582954503313, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.022442802598204793, "sim_compute_performance-ego": 0.03773496724382232, "sim_compute_robot_state-ego": 0.03991325595710851}}
set_robot_commands_max0.06007771492004395
set_robot_commands_mean0.055631733002084974
set_robot_commands_median0.05456455107088442
set_robot_commands_min0.05398886344012093
sim_compute_performance-ego_max0.03941203929759838
sim_compute_performance-ego_mean0.03829028131855241
sim_compute_performance-ego_median0.038183226304895734
sim_compute_performance-ego_min0.03773496724382232
sim_compute_robot_state-ego_max0.040259869010360154
sim_compute_robot_state-ego_mean0.04012881282350245
sim_compute_robot_state-ego_median0.040163002014160155
sim_compute_robot_state-ego_min0.03991325595710851
sim_compute_sim_state_max0.022791619394339768
sim_compute_sim_state_mean0.022589286059270193
sim_compute_sim_state_median0.022593171508223923
sim_compute_sim_state_min0.022442802598204793
sim_physics_max0.06363832473754882
sim_physics_mean0.05812248912338506
sim_physics_median0.05746628178490533
sim_physics_min0.05356701114509679
sim_render-ego_max0.03589986245843429
sim_render-ego_mean0.03527257841702038
sim_render-ego_median0.03518622398376465
sim_render-ego_min0.03492830781375661
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
241553945InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:03:53(hidden)
driven_lanedir_consec_median0.1294404405248777
survival_time_median1.3000000000000005
deviation-center-line_median0.09338622725274218
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12728214263916016
agent_compute-ego_mean0.11524603397790403
agent_compute-ego_median0.1191264115847074
agent_compute-ego_min0.09654423464899478
deviation-center-line_max0.10892192753213874
deviation-center-line_mean0.09194580968447356
deviation-center-line_min0.06140937149608804
deviation-heading_max0.9592597135890456
deviation-heading_mean0.7017331914578778
deviation-heading_median0.754312185079301
deviation-heading_min0.4011457954992934
driven_any_max0.2122875299110134
driven_any_mean0.1926594805075889
driven_any_median0.19860515510732793
driven_any_min0.1606683916839803
driven_lanedir_consec_max0.1687086810735563
driven_lanedir_consec_mean0.136364879497661
driven_lanedir_consec_min0.10803961476731394
driven_lanedir_max0.1687086810735563
driven_lanedir_mean0.136364879497661
driven_lanedir_median0.1294404405248777
driven_lanedir_min0.10803961476731394
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2023424889894566, "sim_physics": 0.12413289717265538, "survival_time": 1.4000000000000006, "driven_lanedir": 0.11018226125799836, "sim_render-ego": 0.04092953034809658, "in-drivable-lane": 0, "agent_compute-ego": 0.12728214263916016, "deviation-heading": 0.9592597135890456, "set_robot_commands": 0.06524669272559029, "deviation-center-line": 0.09338622725274218, "driven_lanedir_consec": 0.11018226125799836, "sim_compute_sim_state": 0.0253203170640128, "sim_compute_performance-ego": 0.04458613906587873, "sim_compute_robot_state-ego": 0.048019307000296454, "sim_compute_robot_state-npc0": 0.04615435429981777, "sim_compute_robot_state-npc1": 0.046870597771235874, "sim_compute_robot_state-npc2": 0.04735968794141497, "sim_compute_robot_state-npc3": 0.046011899198804586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2122875299110134, "sim_physics": 0.12508840744311994, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1294404405248777, "sim_render-ego": 0.04274342610285832, "in-drivable-lane": 0, "agent_compute-ego": 0.11254613216106708, "deviation-heading": 0.9473784691800065, "set_robot_commands": 0.05962546055133526, "deviation-center-line": 0.08797329943426593, "driven_lanedir_consec": 0.1294404405248777, "sim_compute_sim_state": 0.025864555285527155, "sim_compute_performance-ego": 0.04762036983783429, "sim_compute_robot_state-ego": 0.049658546080956094, "sim_compute_robot_state-npc0": 0.04507593925182636, "sim_compute_robot_state-npc1": 0.04573812851539025, "sim_compute_robot_state-npc2": 0.0452342125085684, "sim_compute_robot_state-npc3": 0.04473062661977915}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18939383684616645, "sim_physics": 0.1222874927520752, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16545339986455865, "sim_render-ego": 0.04242095947265625, "in-drivable-lane": 0, "agent_compute-ego": 0.12073124885559082, "deviation-heading": 0.4011457954992934, "set_robot_commands": 0.06597446441650391, "deviation-center-line": 0.10803822270713292, "driven_lanedir_consec": 0.16545339986455865, "sim_compute_sim_state": 0.02776669502258301, "sim_compute_performance-ego": 0.04461875915527344, "sim_compute_robot_state-ego": 0.04377845764160156, "sim_compute_robot_state-npc0": 0.05293529510498047, "sim_compute_robot_state-npc1": 0.05110466003417969, "sim_compute_robot_state-npc2": 0.04878972053527832, "sim_compute_robot_state-npc3": 0.04946917533874512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19860515510732793, "sim_physics": 0.137157339316148, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1687086810735563, "sim_render-ego": 0.043482652077308066, "in-drivable-lane": 0, "agent_compute-ego": 0.1191264115847074, "deviation-heading": 0.4465697939417433, "set_robot_commands": 0.06366384029388428, "deviation-center-line": 0.10892192753213874, "driven_lanedir_consec": 0.1687086810735563, "sim_compute_sim_state": 0.028508433928856484, "sim_compute_performance-ego": 0.04742388541881855, "sim_compute_robot_state-ego": 0.05076782520000751, "sim_compute_robot_state-npc0": 0.05132241432483379, "sim_compute_robot_state-npc1": 0.05246884089249831, "sim_compute_robot_state-npc2": 0.05062570938697228, "sim_compute_robot_state-npc3": 0.04979557257432204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1606683916839803, "sim_physics": 0.090712018634962, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10803961476731394, "sim_render-ego": 0.03545068657916525, "in-drivable-lane": 0, "agent_compute-ego": 0.09654423464899478, "deviation-heading": 0.754312185079301, "set_robot_commands": 0.061320097550101905, "deviation-center-line": 0.06140937149608804, "driven_lanedir_consec": 0.10803961476731394, "sim_compute_sim_state": 0.02248483118803605, "sim_compute_performance-ego": 0.03805222718612007, "sim_compute_robot_state-ego": 0.04034085895704186, "sim_compute_robot_state-npc0": 0.039841745210730514, "sim_compute_robot_state-npc1": 0.03929100865903108, "sim_compute_robot_state-npc2": 0.039350945016612175, "sim_compute_robot_state-npc3": 0.03918680937393852}}
set_robot_commands_max0.06597446441650391
set_robot_commands_mean0.06316611110748313
set_robot_commands_median0.06366384029388428
set_robot_commands_min0.05962546055133526
sim_compute_performance-ego_max0.04762036983783429
sim_compute_performance-ego_mean0.04446027613278501
sim_compute_performance-ego_median0.04461875915527344
sim_compute_performance-ego_min0.03805222718612007
sim_compute_robot_state-ego_max0.05076782520000751
sim_compute_robot_state-ego_mean0.0465129989759807
sim_compute_robot_state-ego_median0.048019307000296454
sim_compute_robot_state-ego_min0.04034085895704186
sim_compute_robot_state-npc0_max0.05293529510498047
sim_compute_robot_state-npc0_mean0.047065949638437785
sim_compute_robot_state-npc0_median0.04615435429981777
sim_compute_robot_state-npc0_min0.039841745210730514
sim_compute_robot_state-npc1_max0.05246884089249831
sim_compute_robot_state-npc1_mean0.04709464717446704
sim_compute_robot_state-npc1_median0.046870597771235874
sim_compute_robot_state-npc1_min0.03929100865903108
sim_compute_robot_state-npc2_max0.05062570938697228
sim_compute_robot_state-npc2_mean0.04627205507776923
sim_compute_robot_state-npc2_median0.04735968794141497
sim_compute_robot_state-npc2_min0.039350945016612175
sim_compute_robot_state-npc3_max0.04979557257432204
sim_compute_robot_state-npc3_mean0.04583881662111789
sim_compute_robot_state-npc3_median0.046011899198804586
sim_compute_robot_state-npc3_min0.03918680937393852
sim_compute_sim_state_max0.028508433928856484
sim_compute_sim_state_mean0.0259889664978031
sim_compute_sim_state_median0.025864555285527155
sim_compute_sim_state_min0.02248483118803605
sim_physics_max0.137157339316148
sim_physics_mean0.1198756310637921
sim_physics_median0.12413289717265538
sim_physics_min0.090712018634962
sim_render-ego_max0.043482652077308066
sim_render-ego_mean0.04100545091601689
sim_render-ego_median0.04242095947265625
sim_render-ego_min0.03545068657916525
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2800000000000005
survival_time_min1.1500000000000004
241533943kene4192ResNet-Adam-More-Data-Less-One-200aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:06:22(hidden)
driven_lanedir_consec_median0.33984019106939245
survival_time_median3.4499999999999957
deviation-center-line_median0.20091872933256769
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14455853058741644
agent_compute-ego_mean0.14351070097802832
agent_compute-ego_median0.14327181594959204
agent_compute-ego_min0.14258367439796185
deviation-center-line_max0.24649560031253304
deviation-center-line_mean0.17093315491253477
deviation-center-line_min0.0686933620052518
deviation-heading_max1.4050632838700603
deviation-heading_mean1.072935327142821
deviation-heading_median1.0627273086158018
deviation-heading_min0.6783427176799068
driven_any_max0.6245873955281743
driven_any_mean0.38789938153347
driven_any_median0.3897167487538862
driven_any_min0.14941949188402762
driven_lanedir_consec_max0.5814710947060013
driven_lanedir_consec_mean0.33199450974066796
driven_lanedir_consec_min0.09642255853610215
driven_lanedir_max0.5814710947060013
driven_lanedir_mean0.33199450974066796
driven_lanedir_median0.33984019106939245
driven_lanedir_min0.09642255853610215
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.1099999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3859428783046955, "sim_physics": 0.10050491491953532, "survival_time": 3.599999999999995, "driven_lanedir": 0.2822607979802827, "sim_render-ego": 0.03609509600533379, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14395981695916918, "deviation-heading": 1.0627273086158018, "set_robot_commands": 0.054005334774653115, "deviation-center-line": 0.13424637584629232, "driven_lanedir_consec": 0.2822607979802827, "sim_compute_sim_state": 0.022652318080266316, "sim_compute_performance-ego": 0.03917070229848226, "sim_compute_robot_state-ego": 0.04078402121861776, "sim_compute_robot_state-npc0": 0.040157695611317955, "sim_compute_robot_state-npc1": 0.03966520561112298, "sim_compute_robot_state-npc2": 0.03955557280116611, "sim_compute_robot_state-npc3": 0.03944059544139438}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3898303931965665, "sim_physics": 0.09352204074030336, "survival_time": 3.4499999999999957, "driven_lanedir": 0.33984019106939245, "sim_render-ego": 0.038258054982060974, "in-drivable-lane": 0, "agent_compute-ego": 0.14327181594959204, "deviation-heading": 1.4050632838700603, "set_robot_commands": 0.054211170777030616, "deviation-center-line": 0.20091872933256769, "driven_lanedir_consec": 0.33984019106939245, "sim_compute_sim_state": 0.02282244226206904, "sim_compute_performance-ego": 0.03919551337974659, "sim_compute_robot_state-ego": 0.040607210518657295, "sim_compute_robot_state-npc0": 0.040147283802861755, "sim_compute_robot_state-npc1": 0.03951212979745174, "sim_compute_robot_state-npc2": 0.0393949107847352, "sim_compute_robot_state-npc3": 0.03931530316670736}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6245873955281743, "sim_physics": 0.09542781320111506, "survival_time": 5.799999999999987, "driven_lanedir": 0.5814710947060013, "sim_render-ego": 0.038461204232840704, "in-drivable-lane": 0, "agent_compute-ego": 0.14258367439796185, "deviation-heading": 1.3413303256811508, "set_robot_commands": 0.054756209768097974, "deviation-center-line": 0.24649560031253304, "driven_lanedir_consec": 0.5814710947060013, "sim_compute_sim_state": 0.022674096041712267, "sim_compute_performance-ego": 0.03853375541752782, "sim_compute_robot_state-ego": 0.040551181497245, "sim_compute_robot_state-npc0": 0.04024701488429103, "sim_compute_robot_state-npc1": 0.041397394805118955, "sim_compute_robot_state-npc2": 0.03993703784613774, "sim_compute_robot_state-npc3": 0.039679301196131216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3897167487538862, "sim_physics": 0.10057848691940308, "survival_time": 2.9999999999999973, "driven_lanedir": 0.35997790641156113, "sim_render-ego": 0.03566553592681885, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1431796669960022, "deviation-heading": 0.6783427176799068, "set_robot_commands": 0.05436696211496989, "deviation-center-line": 0.20431170706602905, "driven_lanedir_consec": 0.35997790641156113, "sim_compute_sim_state": 0.022521682580312095, "sim_compute_performance-ego": 0.03835423787434896, "sim_compute_robot_state-ego": 0.0404343843460083, "sim_compute_robot_state-npc0": 0.040161621570587155, "sim_compute_robot_state-npc1": 0.03948256572087606, "sim_compute_robot_state-npc2": 0.04021254777908325, "sim_compute_robot_state-npc3": 0.03951239983240763}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14941949188402762, "sim_physics": 0.09170385507436898, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09642255853610215, "sim_render-ego": 0.04297491220327524, "in-drivable-lane": 0, "agent_compute-ego": 0.14455853058741644, "deviation-heading": 0.8772129998671855, "set_robot_commands": 0.05439115487612211, "deviation-center-line": 0.0686933620052518, "driven_lanedir_consec": 0.09642255853610215, "sim_compute_sim_state": 0.0225447599704449, "sim_compute_performance-ego": 0.03827989101409912, "sim_compute_robot_state-ego": 0.04038053292494554, "sim_compute_robot_state-npc0": 0.04019640959226168, "sim_compute_robot_state-npc1": 0.039846374438359186, "sim_compute_robot_state-npc2": 0.03957521915435791, "sim_compute_robot_state-npc3": 0.039452314376831055}}
set_robot_commands_max0.054756209768097974
set_robot_commands_mean0.05434616646217474
set_robot_commands_median0.05436696211496989
set_robot_commands_min0.054005334774653115
sim_compute_performance-ego_max0.03919551337974659
sim_compute_performance-ego_mean0.038706819996840953
sim_compute_performance-ego_median0.03853375541752782
sim_compute_performance-ego_min0.03827989101409912
sim_compute_robot_state-ego_max0.04078402121861776
sim_compute_robot_state-ego_mean0.04055146610109478
sim_compute_robot_state-ego_median0.040551181497245
sim_compute_robot_state-ego_min0.04038053292494554
sim_compute_robot_state-npc0_max0.04024701488429103
sim_compute_robot_state-npc0_mean0.04018200509226392
sim_compute_robot_state-npc0_median0.040161621570587155
sim_compute_robot_state-npc0_min0.040147283802861755
sim_compute_robot_state-npc1_max0.041397394805118955
sim_compute_robot_state-npc1_mean0.03998073407458578
sim_compute_robot_state-npc1_median0.03966520561112298
sim_compute_robot_state-npc1_min0.03948256572087606
sim_compute_robot_state-npc2_max0.04021254777908325
sim_compute_robot_state-npc2_mean0.03973505767309604
sim_compute_robot_state-npc2_median0.03957521915435791
sim_compute_robot_state-npc2_min0.0393949107847352
sim_compute_robot_state-npc3_max0.039679301196131216
sim_compute_robot_state-npc3_mean0.03947998280269432
sim_compute_robot_state-npc3_median0.039452314376831055
sim_compute_robot_state-npc3_min0.03931530316670736
sim_compute_sim_state_max0.02282244226206904
sim_compute_sim_state_mean0.022643059786960924
sim_compute_sim_state_median0.022652318080266316
sim_compute_sim_state_min0.022521682580312095
sim_physics_max0.10057848691940308
sim_physics_mean0.09634742217094516
sim_physics_median0.09542781320111506
sim_physics_min0.09170385507436898
sim_render-ego_max0.04297491220327524
sim_render-ego_mean0.03829096067006591
sim_render-ego_median0.038258054982060974
sim_render-ego_min0.03566553592681885
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean3.4299999999999953
survival_time_min1.3000000000000005
241523942kene4192ResNet-Adam-More-Data-Less-One-200aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:10:27(hidden)
driven_lanedir_consec_median0.8916754334336016
survival_time_median6.349999999999985
deviation-center-line_median0.22601831842281095
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13219511124395555
agent_compute-ego_mean0.12989220540648333
agent_compute-ego_median0.13024107261940285
agent_compute-ego_min0.12668553807518698
deviation-center-line_max0.4075189835322025
deviation-center-line_mean0.22154303544849316
deviation-center-line_min0.0890829941225665
deviation-heading_max2.6265166887447964
deviation-heading_mean1.4518079821159378
deviation-heading_median1.2671669825698508
deviation-heading_min0.8204846906895403
driven_any_max1.376085903433618
driven_any_mean0.7698282850492163
driven_any_median0.9596449810534988
driven_any_min0.1980574571263778
driven_lanedir_consec_max0.975589132041604
driven_lanedir_consec_mean0.6349293385700381
driven_lanedir_consec_min0.14970234342329958
driven_lanedir_max0.975589132041604
driven_lanedir_mean0.6349293385700381
driven_lanedir_median0.8916754334336016
driven_lanedir_min0.14970234342329958
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean0.40999999999999853
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.376085903433618, "sim_physics": 0.09950037508703476, "survival_time": 8.949999999999992, "driven_lanedir": 0.8916754334336016, "sim_render-ego": 0.03628572272188837, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.13089610078481323, "deviation-heading": 2.6265166887447964, "set_robot_commands": 0.055289317775705005, "deviation-center-line": 0.4075189835322025, "driven_lanedir_consec": 0.8916754334336016, "sim_compute_sim_state": 0.022847058386776035, "sim_compute_performance-ego": 0.03918303724107795, "sim_compute_robot_state-ego": 0.04076762572347119, "sim_compute_robot_state-npc0": 0.040377583583639985, "sim_compute_robot_state-npc1": 0.03974395224501967, "sim_compute_robot_state-npc2": 0.03968776937303596, "sim_compute_robot_state-npc3": 0.03974785751470641}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.29990361874675686, "sim_physics": 0.09916965527967972, "survival_time": 2.2, "driven_lanedir": 0.2441696698653173, "sim_render-ego": 0.03527446768500588, "in-drivable-lane": 0, "agent_compute-ego": 0.12668553807518698, "deviation-heading": 1.1564233016705368, "set_robot_commands": 0.054774750362743034, "deviation-center-line": 0.13658501833997166, "driven_lanedir_consec": 0.2441696698653173, "sim_compute_sim_state": 0.02285524931820956, "sim_compute_performance-ego": 0.038361110470511696, "sim_compute_robot_state-ego": 0.04074073921550403, "sim_compute_robot_state-npc0": 0.04042625427246094, "sim_compute_robot_state-npc1": 0.03995401209050959, "sim_compute_robot_state-npc2": 0.04095875133167614, "sim_compute_robot_state-npc3": 0.039650153030048714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.01544946488583, "sim_physics": 0.09669081723248515, "survival_time": 6.749999999999984, "driven_lanedir": 0.975589132041604, "sim_render-ego": 0.036044786594532155, "in-drivable-lane": 0, "agent_compute-ego": 0.13024107261940285, "deviation-heading": 1.2671669825698508, "set_robot_commands": 0.05493155232182256, "deviation-center-line": 0.24850986282491416, "driven_lanedir_consec": 0.975589132041604, "sim_compute_sim_state": 0.022839669828061702, "sim_compute_performance-ego": 0.039226819850780345, "sim_compute_robot_state-ego": 0.04080705642700195, "sim_compute_robot_state-npc0": 0.040558883878919816, "sim_compute_robot_state-npc1": 0.039847004855120625, "sim_compute_robot_state-npc2": 0.03954573384037724, "sim_compute_robot_state-npc3": 0.039714954517505785}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9596449810534988, "sim_physics": 0.09947671852712556, "survival_time": 6.349999999999985, "driven_lanedir": 0.913510114086368, "sim_render-ego": 0.035862703022994394, "in-drivable-lane": 0, "agent_compute-ego": 0.129443204309058, "deviation-heading": 1.3884482469049648, "set_robot_commands": 0.05419477139870951, "deviation-center-line": 0.22601831842281095, "driven_lanedir_consec": 0.913510114086368, "sim_compute_sim_state": 0.022631983118733084, "sim_compute_performance-ego": 0.0388443319816289, "sim_compute_robot_state-ego": 0.04054345859317329, "sim_compute_robot_state-npc0": 0.04033908130615715, "sim_compute_robot_state-npc1": 0.0397106531098133, "sim_compute_robot_state-npc2": 0.039348001555195, "sim_compute_robot_state-npc3": 0.039514243133424776}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1980574571263778, "sim_physics": 0.0925838178203952, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14970234342329958, "sim_render-ego": 0.035812324093234156, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.13219511124395555, "deviation-heading": 0.8204846906895403, "set_robot_commands": 0.05432899536625031, "deviation-center-line": 0.0890829941225665, "driven_lanedir_consec": 0.14970234342329958, "sim_compute_sim_state": 0.022618747526599516, "sim_compute_performance-ego": 0.038261767356626446, "sim_compute_robot_state-ego": 0.04036865695830314, "sim_compute_robot_state-npc0": 0.04174796227485903, "sim_compute_robot_state-npc1": 0.03975186040324549, "sim_compute_robot_state-npc2": 0.039464896725070094, "sim_compute_robot_state-npc3": 0.039475264087800055}}
set_robot_commands_max0.055289317775705005
set_robot_commands_mean0.05470387744504609
set_robot_commands_median0.054774750362743034
set_robot_commands_min0.05419477139870951
sim_compute_performance-ego_max0.039226819850780345
sim_compute_performance-ego_mean0.038775413380125065
sim_compute_performance-ego_median0.0388443319816289
sim_compute_performance-ego_min0.038261767356626446
sim_compute_robot_state-ego_max0.04080705642700195
sim_compute_robot_state-ego_mean0.04064550738349072
sim_compute_robot_state-ego_median0.04074073921550403
sim_compute_robot_state-ego_min0.04036865695830314
sim_compute_robot_state-npc0_max0.04174796227485903
sim_compute_robot_state-npc0_mean0.040689953063207385
sim_compute_robot_state-npc0_median0.04042625427246094
sim_compute_robot_state-npc0_min0.04033908130615715
sim_compute_robot_state-npc1_max0.03995401209050959
sim_compute_robot_state-npc1_mean0.039801496540741735
sim_compute_robot_state-npc1_median0.03975186040324549
sim_compute_robot_state-npc1_min0.0397106531098133
sim_compute_robot_state-npc2_max0.04095875133167614
sim_compute_robot_state-npc2_mean0.03980103056507088
sim_compute_robot_state-npc2_median0.03954573384037724
sim_compute_robot_state-npc2_min0.039348001555195
sim_compute_robot_state-npc3_max0.03974785751470641
sim_compute_robot_state-npc3_mean0.039620494456697145
sim_compute_robot_state-npc3_median0.039650153030048714
sim_compute_robot_state-npc3_min0.039475264087800055
sim_compute_sim_state_max0.02285524931820956
sim_compute_sim_state_mean0.022758541635675984
sim_compute_sim_state_median0.022839669828061702
sim_compute_sim_state_min0.022618747526599516
sim_physics_max0.09950037508703476
sim_physics_mean0.0974842767893441
sim_physics_median0.09916965527967972
sim_physics_min0.0925838178203952
sim_render-ego_max0.03628572272188837
sim_render-ego_mean0.035856000823530985
sim_render-ego_median0.035862703022994394
sim_render-ego_min0.03527446768500588
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean5.159999999999993
survival_time_min1.5500000000000007
241483938kene4192CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:16:55(hidden)
driven_lanedir_consec_median0.9283651264960432
survival_time_median14.950000000000076
deviation-center-line_median0.6754232041223853
in-drivable-lane_median6.850000000000031


other stats
agent_compute-ego_max0.12779506106874836
agent_compute-ego_mean0.1192649700216858
agent_compute-ego_median0.11801851987838743
agent_compute-ego_min0.11570240418116252
deviation-center-line_max0.7898221522863711
deviation-center-line_mean0.5732872071586015
deviation-center-line_min0.11813053478971323
deviation-heading_max2.3316182564563026
deviation-heading_mean1.5566861653133068
deviation-heading_median1.695694963472156
deviation-heading_min0.8066302781451287
driven_any_max2.3902864324830984
driven_any_mean1.907142614310964
driven_any_median2.37297177263376
driven_any_min0.2454760801580007
driven_lanedir_consec_max1.2240373867707417
driven_lanedir_consec_mean0.8352459830606127
driven_lanedir_consec_min0.19921548771784947
driven_lanedir_max1.2240373867707417
driven_lanedir_mean0.8352459830606127
driven_lanedir_median0.9283651264960432
driven_lanedir_min0.19921548771784947
in-drivable-lane_max9.250000000000068
in-drivable-lane_mean6.2400000000000375
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.137656429178905, "sim_physics": 0.1045457000163064, "survival_time": 13.400000000000055, "driven_lanedir": 0.9283651264960432, "sim_render-ego": 0.0399918235949616, "in-drivable-lane": 6.700000000000037, "agent_compute-ego": 0.12779506106874836, "deviation-heading": 2.3316182564563026, "set_robot_commands": 0.05892605479083844, "deviation-center-line": 0.7013931773232394, "driven_lanedir_consec": 0.9283651264960432, "sim_compute_sim_state": 0.02450909543393263, "sim_compute_performance-ego": 0.04188422124777267, "sim_compute_robot_state-ego": 0.04326641915449456, "sim_compute_robot_state-npc0": 0.04397973818565482, "sim_compute_robot_state-npc1": 0.04268130971424615, "sim_compute_robot_state-npc2": 0.04306854151967746, "sim_compute_robot_state-npc3": 0.04305526658670226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.37297177263376, "sim_physics": 0.09724696477254231, "survival_time": 14.950000000000076, "driven_lanedir": 0.8391342061577314, "sim_render-ego": 0.03553317864735921, "in-drivable-lane": 9.250000000000068, "agent_compute-ego": 0.11596015453338623, "deviation-heading": 1.1616048429085866, "set_robot_commands": 0.053972707589467366, "deviation-center-line": 0.5816669672712985, "driven_lanedir_consec": 0.8391342061577314, "sim_compute_sim_state": 0.022339287598927816, "sim_compute_performance-ego": 0.03821731646855672, "sim_compute_robot_state-ego": 0.03999705632527669, "sim_compute_robot_state-npc0": 0.03961199283599853, "sim_compute_robot_state-npc1": 0.038889443079630534, "sim_compute_robot_state-npc2": 0.03865925629933675, "sim_compute_robot_state-npc3": 0.03994410514831543}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.389322357101056, "sim_physics": 0.08966590801874796, "survival_time": 14.950000000000076, "driven_lanedir": 1.2240373867707417, "sim_render-ego": 0.035050046443939206, "in-drivable-lane": 6.850000000000031, "agent_compute-ego": 0.11570240418116252, "deviation-heading": 1.7878824855843611, "set_robot_commands": 0.0537849227587382, "deviation-center-line": 0.7898221522863711, "driven_lanedir_consec": 1.2240373867707417, "sim_compute_sim_state": 0.02217422564824422, "sim_compute_performance-ego": 0.03769195795059204, "sim_compute_robot_state-ego": 0.039635848999023435, "sim_compute_robot_state-npc0": 0.03930387179056803, "sim_compute_robot_state-npc1": 0.03865574598312378, "sim_compute_robot_state-npc2": 0.038552323977152504, "sim_compute_robot_state-npc3": 0.03878864526748657}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3902864324830984, "sim_physics": 0.09185556650161744, "survival_time": 14.950000000000076, "driven_lanedir": 0.985477708160698, "sim_render-ego": 0.03501791556676229, "in-drivable-lane": 8.30000000000005, "agent_compute-ego": 0.11801851987838743, "deviation-heading": 1.695694963472156, "set_robot_commands": 0.05405122836430867, "deviation-center-line": 0.6754232041223853, "driven_lanedir_consec": 0.985477708160698, "sim_compute_sim_state": 0.02217038154602051, "sim_compute_performance-ego": 0.039381376107533776, "sim_compute_robot_state-ego": 0.03951612075169881, "sim_compute_robot_state-npc0": 0.039461337725321455, "sim_compute_robot_state-npc1": 0.03866757074991862, "sim_compute_robot_state-npc2": 0.03836783250172933, "sim_compute_robot_state-npc3": 0.03883686145146688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2454760801580007, "sim_physics": 0.08977457639333364, "survival_time": 1.850000000000001, "driven_lanedir": 0.19921548771784947, "sim_render-ego": 0.034805323626544024, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.11884871044674436, "deviation-heading": 0.8066302781451287, "set_robot_commands": 0.054095036274678, "deviation-center-line": 0.11813053478971323, "driven_lanedir_consec": 0.19921548771784947, "sim_compute_sim_state": 0.022141044204299513, "sim_compute_performance-ego": 0.037741016697239234, "sim_compute_robot_state-ego": 0.03941786611402357, "sim_compute_robot_state-npc0": 0.03952759021037334, "sim_compute_robot_state-npc1": 0.038701933783453865, "sim_compute_robot_state-npc2": 0.03839760213284879, "sim_compute_robot_state-npc3": 0.038527682020857525}}
set_robot_commands_max0.05892605479083844
set_robot_commands_mean0.05496598995560613
set_robot_commands_median0.05405122836430867
set_robot_commands_min0.0537849227587382
sim_compute_performance-ego_max0.04188422124777267
sim_compute_performance-ego_mean0.038983177694338886
sim_compute_performance-ego_median0.03821731646855672
sim_compute_performance-ego_min0.03769195795059204
sim_compute_robot_state-ego_max0.04326641915449456
sim_compute_robot_state-ego_mean0.04036666226890341
sim_compute_robot_state-ego_median0.039635848999023435
sim_compute_robot_state-ego_min0.03941786611402357
sim_compute_robot_state-npc0_max0.04397973818565482
sim_compute_robot_state-npc0_mean0.04037690614958324
sim_compute_robot_state-npc0_median0.03952759021037334
sim_compute_robot_state-npc0_min0.03930387179056803
sim_compute_robot_state-npc1_max0.04268130971424615
sim_compute_robot_state-npc1_mean0.039519200662074594
sim_compute_robot_state-npc1_median0.038701933783453865
sim_compute_robot_state-npc1_min0.03865574598312378
sim_compute_robot_state-npc2_max0.04306854151967746
sim_compute_robot_state-npc2_mean0.03940911128614896
sim_compute_robot_state-npc2_median0.038552323977152504
sim_compute_robot_state-npc2_min0.03836783250172933
sim_compute_robot_state-npc3_max0.04305526658670226
sim_compute_robot_state-npc3_mean0.03983051209496573
sim_compute_robot_state-npc3_median0.03883686145146688
sim_compute_robot_state-npc3_min0.038527682020857525
sim_compute_sim_state_max0.02450909543393263
sim_compute_sim_state_mean0.022666806886284935
sim_compute_sim_state_median0.02217422564824422
sim_compute_sim_state_min0.022141044204299513
sim_physics_max0.1045457000163064
sim_physics_mean0.09461774314050957
sim_physics_median0.09185556650161744
sim_physics_min0.08966590801874796
sim_render-ego_max0.0399918235949616
sim_render-ego_mean0.03607965757591327
sim_render-ego_median0.035050046443939206
sim_render-ego_min0.034805323626544024
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.020000000000056
survival_time_min1.850000000000001
241473930kene4192CNN-Adam-More-Data-Less-One-300aido2-LF-sim-testing-offseasonstep1-simulationerroryes12900:14:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241463931kene4192CNN-Adam-More-Data-Less-One-300aido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241443937kene4192CNN-Adam-More-Data-Less-One-300aido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12900:21:38(hidden)
driven_lanedir_consec_median0.5994227130761502
survival_time_median4.749999999999991
deviation-center-line_median0.30857845902368236
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.19370741605758668
agent_compute-ego_mean0.1810226011745677
agent_compute-ego_median0.17941145759692295
agent_compute-ego_min0.16839055454029755
deviation-center-line_max1.084664527984148
deviation-center-line_mean0.474721554724556
deviation-center-line_min0.11480871786724324
deviation-heading_max2.305586741175672
deviation-heading_mean1.556798893313569
deviation-heading_median1.506905135070767
deviation-heading_min0.8378018914383335
driven_any_max2.363343646474145
driven_any_mean1.1577759430913288
driven_any_median0.7222031080082241
driven_any_min0.22079798489695793
driven_lanedir_consec_max1.7505118536572235
driven_lanedir_consec_mean0.8605819441147059
driven_lanedir_consec_min0.17815303340255562
driven_lanedir_max2.03579634538389
driven_lanedir_mean0.9867831108358234
driven_lanedir_median0.6334388376792676
driven_lanedir_min0.17815303340255562
in-drivable-lane_max2.7999999999999936
in-drivable-lane_mean0.7300000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.188896037342168, "sim_physics": 0.16656424330292846, "survival_time": 13.900000000000064, "driven_lanedir": 2.03579634538389, "sim_render-ego": 0.05829061621384655, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.17941145759692295, "deviation-heading": 2.0096106583285898, "set_robot_commands": 0.08334131378064052, "deviation-center-line": 0.7291535670536762, "driven_lanedir_consec": 1.7505118536572235, "sim_compute_sim_state": 0.03547325923288469, "sim_compute_performance-ego": 0.06378785225984862, "sim_compute_robot_state-ego": 0.06566147667040928, "sim_compute_robot_state-npc0": 0.0624189428288302, "sim_compute_robot_state-npc1": 0.0615068271005754, "sim_compute_robot_state-npc2": 0.06212737234376317, "sim_compute_robot_state-npc3": 0.06392017885935393}, "udem1-1-0": {"driven_any": 0.29363893873514874, "sim_physics": 0.17654757167017737, "survival_time": 2.1500000000000004, "driven_lanedir": 0.24112463585586852, "sim_render-ego": 0.060471046802609466, "in-drivable-lane": 0, "agent_compute-ego": 0.17219848965489587, "deviation-heading": 1.1240900405544838, "set_robot_commands": 0.08570919480434684, "deviation-center-line": 0.1364025016940298, "driven_lanedir_consec": 0.24112463585586852, "sim_compute_sim_state": 0.036176687063172806, "sim_compute_performance-ego": 0.06024157723715139, "sim_compute_robot_state-ego": 0.06439289935799532, "sim_compute_robot_state-npc0": 0.06509076162826183, "sim_compute_robot_state-npc1": 0.0635546418123467, "sim_compute_robot_state-npc2": 0.0651842106220334, "sim_compute_robot_state-npc3": 0.05997634488482808}, "udem1-2-0": {"driven_any": 2.363343646474145, "sim_physics": 0.20096118529637655, "survival_time": 14.950000000000076, "driven_lanedir": 1.8454027018575352, "sim_render-ego": 0.06076358159383138, "in-drivable-lane": 2.7999999999999936, "agent_compute-ego": 0.19370741605758668, "deviation-heading": 2.305586741175672, "set_robot_commands": 0.09056256612141927, "deviation-center-line": 1.084664527984148, "driven_lanedir_consec": 1.5336974845817315, "sim_compute_sim_state": 0.038951040108998615, "sim_compute_performance-ego": 0.06789038976033529, "sim_compute_robot_state-ego": 0.07114229202270508, "sim_compute_robot_state-npc0": 0.06672600746154785, "sim_compute_robot_state-npc1": 0.0662579886118571, "sim_compute_robot_state-npc2": 0.06641668796539307, "sim_compute_robot_state-npc3": 0.06803383111953736}, "udem1-3-0": {"driven_any": 0.7222031080082241, "sim_physics": 0.19728373226366544, "survival_time": 4.749999999999991, "driven_lanedir": 0.6334388376792676, "sim_render-ego": 0.06288451144569798, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.19140508802313555, "deviation-heading": 1.506905135070767, "set_robot_commands": 0.09802196904232628, "deviation-center-line": 0.30857845902368236, "driven_lanedir_consec": 0.5994227130761502, "sim_compute_sim_state": 0.03836264359323602, "sim_compute_performance-ego": 0.06701117063823499, "sim_compute_robot_state-ego": 0.07114693240115517, "sim_compute_robot_state-npc0": 0.06905575049550909, "sim_compute_robot_state-npc1": 0.06863906007064016, "sim_compute_robot_state-npc2": 0.06812775511490671, "sim_compute_robot_state-npc3": 0.0669631230203729}, "udem1-4-0": {"driven_any": 0.22079798489695793, "sim_physics": 0.1814290495479808, "survival_time": 1.7000000000000008, "driven_lanedir": 0.17815303340255562, "sim_render-ego": 0.05906691971947165, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16839055454029755, "deviation-heading": 0.8378018914383335, "set_robot_commands": 0.08313886558308321, "deviation-center-line": 0.11480871786724324, "driven_lanedir_consec": 0.17815303340255562, "sim_compute_sim_state": 0.03850196389590993, "sim_compute_performance-ego": 0.06667623099158793, "sim_compute_robot_state-ego": 0.07059119729434743, "sim_compute_robot_state-npc0": 0.06056003710802864, "sim_compute_robot_state-npc1": 0.060982500805574304, "sim_compute_robot_state-npc2": 0.0641188200782327, "sim_compute_robot_state-npc3": 0.0661020419176887}}
set_robot_commands_max0.09802196904232628
set_robot_commands_mean0.08815478186636322
set_robot_commands_median0.08570919480434684
set_robot_commands_min0.08313886558308321
sim_compute_performance-ego_max0.06789038976033529
sim_compute_performance-ego_mean0.06512144417743164
sim_compute_performance-ego_median0.06667623099158793
sim_compute_performance-ego_min0.06024157723715139
sim_compute_robot_state-ego_max0.07114693240115517
sim_compute_robot_state-ego_mean0.06858695954932245
sim_compute_robot_state-ego_median0.07059119729434743
sim_compute_robot_state-ego_min0.06439289935799532
sim_compute_robot_state-npc0_max0.06905575049550909
sim_compute_robot_state-npc0_mean0.06477029990443553
sim_compute_robot_state-npc0_median0.06509076162826183
sim_compute_robot_state-npc0_min0.06056003710802864
sim_compute_robot_state-npc1_max0.06863906007064016
sim_compute_robot_state-npc1_mean0.06418820368019873
sim_compute_robot_state-npc1_median0.0635546418123467
sim_compute_robot_state-npc1_min0.060982500805574304
sim_compute_robot_state-npc2_max0.06812775511490671
sim_compute_robot_state-npc2_mean0.06519496922486581
sim_compute_robot_state-npc2_median0.0651842106220334
sim_compute_robot_state-npc2_min0.06212737234376317
sim_compute_robot_state-npc3_max0.06803383111953736
sim_compute_robot_state-npc3_mean0.06499910396035619
sim_compute_robot_state-npc3_median0.0661020419176887
sim_compute_robot_state-npc3_min0.05997634488482808
sim_compute_sim_state_max0.038951040108998615
sim_compute_sim_state_mean0.037493118778840415
sim_compute_sim_state_median0.03836264359323602
sim_compute_sim_state_min0.03547325923288469
sim_physics_max0.20096118529637655
sim_physics_mean0.18455715641622572
sim_physics_median0.1814290495479808
sim_physics_min0.16656424330292846
sim_render-ego_max0.06288451144569798
sim_render-ego_mean0.06029533515509141
sim_render-ego_median0.060471046802609466
sim_render-ego_min0.05829061621384655
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.490000000000026
survival_time_min1.7000000000000008
241383921ekunniiBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12900:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241333922ekunniiBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:02:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241293914gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12900:00:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241283913gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12900:00:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241053903gadesechallenge-aido_LF-template-tensorflowaido2-LFV-sim-testing-offseasonstep1-simulationerroryes12900:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241033907gadesechallenge-aido_LF-template-tensorflowaido2-LFVI-sim-validation-offseasonstep1-simulationerroryes12900:02:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
240973895chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240893882chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:04:08(hidden)
driven_lanedir_consec_median0.08571151642369346
survival_time_median1.5500000000000007
deviation-center-line_median0.06409428690010577
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16554415888256496
agent_compute-ego_mean0.15061350798326428
agent_compute-ego_median0.15389921448447488
agent_compute-ego_min0.12643179400213833
deviation-center-line_max0.08214055855485246
deviation-center-line_mean0.06265572674847514
deviation-center-line_min0.04694939818633675
deviation-heading_max0.8309171532564221
deviation-heading_mean0.7509204170765138
deviation-heading_median0.7778672810284888
deviation-heading_min0.6095014518453489
driven_any_max0.21533062460019672
driven_any_mean0.17797577247458798
driven_any_median0.19493286402130255
driven_any_min0.09015220879211878
driven_lanedir_consec_max0.12874424605593937
driven_lanedir_consec_mean0.09043612248019746
driven_lanedir_consec_min0.05458586061136739
driven_lanedir_max0.12874424605593937
driven_lanedir_mean0.09043612248019746
driven_lanedir_median0.08571151642369346
driven_lanedir_min0.05458586061136739
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.26000000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21533062460019672, "sim_physics": 0.11511071523030598, "survival_time": 1.800000000000001, "driven_lanedir": 0.08571151642369346, "sim_render-ego": 0.06294830640157063, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16554415888256496, "deviation-heading": 0.7236405044166995, "set_robot_commands": 0.08861029148101807, "deviation-center-line": 0.06409428690010577, "driven_lanedir_consec": 0.08571151642369346, "sim_compute_sim_state": 0.03725050555335151, "sim_compute_performance-ego": 0.06917726331286961, "sim_compute_robot_state-ego": 0.07640869749916925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19493286402130255, "sim_physics": 0.10961797929579212, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1124813263645692, "sim_render-ego": 0.06280070735562232, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15499218817680113, "deviation-heading": 0.7778672810284888, "set_robot_commands": 0.09064838194078016, "deviation-center-line": 0.04694939818633675, "driven_lanedir_consec": 0.1124813263645692, "sim_compute_sim_state": 0.04161253283100744, "sim_compute_performance-ego": 0.06769731736952259, "sim_compute_robot_state-ego": 0.07074789847097089}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09015220879211878, "sim_physics": 0.10718302977712532, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05458586061136739, "sim_render-ego": 0.05362654987134432, "in-drivable-lane": 0, "agent_compute-ego": 0.15220018437034205, "deviation-heading": 0.6095014518453489, "set_robot_commands": 0.086911352057206, "deviation-center-line": 0.08214055855485246, "driven_lanedir_consec": 0.05458586061136739, "sim_compute_sim_state": 0.03701661762438322, "sim_compute_performance-ego": 0.0680097404279207, "sim_compute_robot_state-ego": 0.07058244002492804}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19327564131210817, "sim_physics": 0.11289673140554717, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07065766294541787, "sim_render-ego": 0.056658968780979965, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15389921448447488, "deviation-heading": 0.8126756948356093, "set_robot_commands": 0.08809329524184718, "deviation-center-line": 0.048049267440574986, "driven_lanedir_consec": 0.07065766294541787, "sim_compute_sim_state": 0.03628157124374852, "sim_compute_performance-ego": 0.06702004056988341, "sim_compute_robot_state-ego": 0.06855937206383908}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19618752364721356, "sim_physics": 0.08675767635477, "survival_time": 1.4500000000000006, "driven_lanedir": 0.12874424605593937, "sim_render-ego": 0.04738118730742356, "in-drivable-lane": 0, "agent_compute-ego": 0.12643179400213833, "deviation-heading": 0.8309171532564221, "set_robot_commands": 0.07167983055114746, "deviation-center-line": 0.07204512266050571, "driven_lanedir_consec": 0.12874424605593937, "sim_compute_sim_state": 0.030076084465816104, "sim_compute_performance-ego": 0.0519460809641871, "sim_compute_robot_state-ego": 0.05458315487565665}}
set_robot_commands_max0.09064838194078016
set_robot_commands_mean0.08518863025439977
set_robot_commands_median0.08809329524184718
set_robot_commands_min0.07167983055114746
sim_compute_performance-ego_max0.06917726331286961
sim_compute_performance-ego_mean0.0647700885288767
sim_compute_performance-ego_median0.06769731736952259
sim_compute_performance-ego_min0.0519460809641871
sim_compute_robot_state-ego_max0.07640869749916925
sim_compute_robot_state-ego_mean0.06817631258691279
sim_compute_robot_state-ego_median0.07058244002492804
sim_compute_robot_state-ego_min0.05458315487565665
sim_compute_sim_state_max0.04161253283100744
sim_compute_sim_state_mean0.03644746234366136
sim_compute_sim_state_median0.03701661762438322
sim_compute_sim_state_min0.030076084465816104
sim_physics_max0.11511071523030598
sim_physics_mean0.1063132264127081
sim_physics_median0.10961797929579212
sim_physics_min0.08675767635477
sim_render-ego_max0.06294830640157063
sim_render-ego_mean0.05668314394338816
sim_render-ego_median0.056658968780979965
sim_render-ego_min0.04738118730742356
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.4800000000000009
survival_time_min0.9500000000000004
240863885chuyjBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:02:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240833878kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:09:55(hidden)
driven_lanedir_consec_median0.33279926730365705
survival_time_median5.849999999999987
deviation-center-line_median0.21022023296625092
in-drivable-lane_median2.0999999999999925


other stats
agent_compute-ego_max0.1287631160683102
agent_compute-ego_mean0.12771073839579872
agent_compute-ego_median0.12776276339655335
agent_compute-ego_min0.126483491822785
deviation-center-line_max0.2262868523213402
deviation-center-line_mean0.1965654273718572
deviation-center-line_min0.14645975179579562
deviation-heading_max1.2131711311570286
deviation-heading_mean1.0827998868533266
deviation-heading_median1.1008009336224678
deviation-heading_min0.8478430824265855
driven_any_max1.1055931573373332
driven_any_mean0.6885620593603189
driven_any_median0.7471676798578288
driven_any_min0.25873035421963597
driven_lanedir_consec_max0.6563085287922115
driven_lanedir_consec_mean0.3735421108334759
driven_lanedir_consec_min0.23163114629630965
driven_lanedir_max0.6563085287922115
driven_lanedir_mean0.3735421108334759
driven_lanedir_median0.33279926730365705
driven_lanedir_min0.23163114629630965
in-drivable-lane_max4.949999999999982
in-drivable-lane_mean1.9799999999999929
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9907644976495152, "sim_physics": 0.08968806266784668, "survival_time": 7.199999999999982, "driven_lanedir": 0.6563085287922115, "sim_render-ego": 0.03534017503261566, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.1287631160683102, "deviation-heading": 1.1008009336224678, "set_robot_commands": 0.053878150052494474, "deviation-center-line": 0.2262868523213402, "driven_lanedir_consec": 0.6563085287922115, "sim_compute_sim_state": 0.023695864611201815, "sim_compute_performance-ego": 0.03831834759977129, "sim_compute_robot_state-ego": 0.04331002632776896, "sim_compute_robot_state-npc0": 0.03993704252772861, "sim_compute_robot_state-npc1": 0.03943177064259847, "sim_compute_robot_state-npc2": 0.03910762071609497, "sim_compute_robot_state-npc3": 0.03901538915104336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.34055460773728163, "sim_physics": 0.0923160337934307, "survival_time": 2.549999999999999, "driven_lanedir": 0.2891427668852411, "sim_render-ego": 0.034804339502371995, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.126483491822785, "deviation-heading": 1.2131711311570286, "set_robot_commands": 0.05349427111008588, "deviation-center-line": 0.18578030876369211, "driven_lanedir_consec": 0.2891427668852411, "sim_compute_sim_state": 0.05469674690096986, "sim_compute_performance-ego": 0.03814316730873257, "sim_compute_robot_state-ego": 0.04060883615531173, "sim_compute_robot_state-npc0": 0.03994904312432981, "sim_compute_robot_state-npc1": 0.03975808386709176, "sim_compute_robot_state-npc2": 0.03898057750627106, "sim_compute_robot_state-npc3": 0.03899912273182588}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7471676798578288, "sim_physics": 0.08595298905657907, "survival_time": 5.849999999999987, "driven_lanedir": 0.33279926730365705, "sim_render-ego": 0.03496418243799454, "in-drivable-lane": 2.79999999999999, "agent_compute-ego": 0.12808084284138477, "deviation-heading": 1.1694069693061715, "set_robot_commands": 0.055320888502984986, "deviation-center-line": 0.21022023296625092, "driven_lanedir_consec": 0.33279926730365705, "sim_compute_sim_state": 0.02282600321321406, "sim_compute_performance-ego": 0.03828362725738786, "sim_compute_robot_state-ego": 0.040419829197418995, "sim_compute_robot_state-npc0": 0.04012658453395224, "sim_compute_robot_state-npc1": 0.03913182682461209, "sim_compute_robot_state-npc2": 0.039075038371941984, "sim_compute_robot_state-npc3": 0.03914115775344718}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1055931573373332, "sim_physics": 0.08878081481649268, "survival_time": 8.04999999999998, "driven_lanedir": 0.35782884488996025, "sim_render-ego": 0.03508263493176573, "in-drivable-lane": 4.949999999999982, "agent_compute-ego": 0.12776276339655335, "deviation-heading": 1.0827773177543794, "set_robot_commands": 0.05351628576006208, "deviation-center-line": 0.2140799910122072, "driven_lanedir_consec": 0.35782884488996025, "sim_compute_sim_state": 0.022402918857076893, "sim_compute_performance-ego": 0.038046217853238126, "sim_compute_robot_state-ego": 0.0405316604590564, "sim_compute_robot_state-npc0": 0.0399917104969854, "sim_compute_robot_state-npc1": 0.03922086620923155, "sim_compute_robot_state-npc2": 0.039186402137235087, "sim_compute_robot_state-npc3": 0.03919306008712105}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.25873035421963597, "sim_physics": 0.08760219812393188, "survival_time": 2.000000000000001, "driven_lanedir": 0.23163114629630965, "sim_render-ego": 0.03545739054679871, "in-drivable-lane": 0, "agent_compute-ego": 0.12746347784996032, "deviation-heading": 0.8478430824265855, "set_robot_commands": 0.05996580719947815, "deviation-center-line": 0.14645975179579562, "driven_lanedir_consec": 0.23163114629630965, "sim_compute_sim_state": 0.02250462770462036, "sim_compute_performance-ego": 0.039312970638275144, "sim_compute_robot_state-ego": 0.04055095911026001, "sim_compute_robot_state-npc0": 0.03997097611427307, "sim_compute_robot_state-npc1": 0.03939003348350525, "sim_compute_robot_state-npc2": 0.039150315523147586, "sim_compute_robot_state-npc3": 0.0392932653427124}}
set_robot_commands_max0.05996580719947815
set_robot_commands_mean0.05523508052502111
set_robot_commands_median0.053878150052494474
set_robot_commands_min0.05349427111008588
sim_compute_performance-ego_max0.039312970638275144
sim_compute_performance-ego_mean0.038420866131481005
sim_compute_performance-ego_median0.03828362725738786
sim_compute_performance-ego_min0.038046217853238126
sim_compute_robot_state-ego_max0.04331002632776896
sim_compute_robot_state-ego_mean0.04108426224996322
sim_compute_robot_state-ego_median0.04055095911026001
sim_compute_robot_state-ego_min0.040419829197418995
sim_compute_robot_state-npc0_max0.04012658453395224
sim_compute_robot_state-npc0_mean0.03999507135945383
sim_compute_robot_state-npc0_median0.03997097611427307
sim_compute_robot_state-npc0_min0.03993704252772861
sim_compute_robot_state-npc1_max0.03975808386709176
sim_compute_robot_state-npc1_mean0.039386516205407826
sim_compute_robot_state-npc1_median0.03939003348350525
sim_compute_robot_state-npc1_min0.03913182682461209
sim_compute_robot_state-npc2_max0.039186402137235087
sim_compute_robot_state-npc2_mean0.03909999085093814
sim_compute_robot_state-npc2_median0.03910762071609497
sim_compute_robot_state-npc2_min0.03898057750627106
sim_compute_robot_state-npc3_max0.0392932653427124
sim_compute_robot_state-npc3_mean0.03912839901322998
sim_compute_robot_state-npc3_median0.03914115775344718
sim_compute_robot_state-npc3_min0.03899912273182588
sim_compute_sim_state_max0.05469674690096986
sim_compute_sim_state_mean0.029225232257416595
sim_compute_sim_state_median0.02282600321321406
sim_compute_sim_state_min0.022402918857076893
sim_physics_max0.0923160337934307
sim_physics_mean0.08886801969165621
sim_physics_median0.08878081481649268
sim_physics_min0.08595298905657907
sim_render-ego_max0.03545739054679871
sim_render-ego_mean0.035129744490309325
sim_render-ego_median0.03508263493176573
sim_render-ego_min0.034804339502371995
simulation-passed1
survival_time_max8.04999999999998
survival_time_mean5.12999999999999
survival_time_min2.000000000000001
240823877kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:09:46(hidden)
driven_lanedir_consec_median0.2325888948459751
survival_time_median4.699999999999991
deviation-center-line_median0.20519370129928063
in-drivable-lane_median1.5999999999999943


other stats
agent_compute-ego_max0.1426428607169618
agent_compute-ego_mean0.14207917895822617
agent_compute-ego_median0.14221031553793273
agent_compute-ego_min0.14105623208203363
deviation-center-line_max0.3944978820386541
deviation-center-line_mean0.26074188312324365
deviation-center-line_min0.15040450785110265
deviation-heading_max1.883700490427273
deviation-heading_mean1.3099016593565351
deviation-heading_median1.3569110353714675
deviation-heading_min0.8184218680195565
driven_any_max0.7868129396802005
driven_any_mean0.5169737117137255
driven_any_median0.5135884632677558
driven_any_min0.25270480564285747
driven_lanedir_consec_max0.4747302601189896
driven_lanedir_consec_mean0.2849250544812904
driven_lanedir_consec_min0.1777004155236721
driven_lanedir_max0.4747302601189896
driven_lanedir_mean0.2849250544812904
driven_lanedir_median0.2325888948459751
driven_lanedir_min0.1777004155236721
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.3499999999999952
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7868129396802005, "sim_physics": 0.09413236579639, "survival_time": 7.449999999999981, "driven_lanedir": 0.3576372650310624, "sim_render-ego": 0.03539906732187975, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.14221031553793273, "deviation-heading": 0.8388870976517899, "set_robot_commands": 0.054867746045925474, "deviation-center-line": 0.3794862259084424, "driven_lanedir_consec": 0.3576372650310624, "sim_compute_sim_state": 0.02220655767709617, "sim_compute_performance-ego": 0.03795663622401705, "sim_compute_robot_state-ego": 0.04058574510100704, "sim_compute_robot_state-npc0": 0.0395853183413512, "sim_compute_robot_state-npc1": 0.03883007228774513, "sim_compute_robot_state-npc2": 0.03864145438943133, "sim_compute_robot_state-npc3": 0.038727243474665905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.501415989191816, "sim_physics": 0.09230301481612184, "survival_time": 4.699999999999991, "driven_lanedir": 0.4747302601189896, "sim_render-ego": 0.0353072019333535, "in-drivable-lane": 0, "agent_compute-ego": 0.1426428607169618, "deviation-heading": 1.3569110353714675, "set_robot_commands": 0.054527305542154514, "deviation-center-line": 0.3944978820386541, "driven_lanedir_consec": 0.4747302601189896, "sim_compute_sim_state": 0.022410737707259806, "sim_compute_performance-ego": 0.03779991636884973, "sim_compute_robot_state-ego": 0.040300272880716526, "sim_compute_robot_state-npc0": 0.03949160525139342, "sim_compute_robot_state-npc1": 0.03871567452207525, "sim_compute_robot_state-npc2": 0.038650593859084106, "sim_compute_robot_state-npc3": 0.03870958723920457}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.530346360785998, "sim_physics": 0.08643660499054251, "survival_time": 5.14999999999999, "driven_lanedir": 0.1819684368867529, "sim_render-ego": 0.03459578115963242, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14105623208203363, "deviation-heading": 1.883700490427273, "set_robot_commands": 0.054592546907443446, "deviation-center-line": 0.20519370129928063, "driven_lanedir_consec": 0.1819684368867529, "sim_compute_sim_state": 0.022229365932131276, "sim_compute_performance-ego": 0.0395849815850119, "sim_compute_robot_state-ego": 0.04016252628807883, "sim_compute_robot_state-npc0": 0.039614524656129114, "sim_compute_robot_state-npc1": 0.038838680508067304, "sim_compute_robot_state-npc2": 0.039165885703077594, "sim_compute_robot_state-npc3": 0.03870968448305593}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5135884632677558, "sim_physics": 0.08477173381381564, "survival_time": 4.499999999999992, "driven_lanedir": 0.1777004155236721, "sim_render-ego": 0.034720722834269205, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.1426173316107856, "deviation-heading": 1.651587805312589, "set_robot_commands": 0.054001752535502115, "deviation-center-line": 0.17412709851873853, "driven_lanedir_consec": 0.1777004155236721, "sim_compute_sim_state": 0.02261038621266683, "sim_compute_performance-ego": 0.03788363933563232, "sim_compute_robot_state-ego": 0.03990389506022136, "sim_compute_robot_state-npc0": 0.03977232774098714, "sim_compute_robot_state-npc1": 0.038764055569966635, "sim_compute_robot_state-npc2": 0.03861265447404649, "sim_compute_robot_state-npc3": 0.03874883651733398}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.25270480564285747, "sim_physics": 0.09255985780195757, "survival_time": 2.2, "driven_lanedir": 0.2325888948459751, "sim_render-ego": 0.03512871807271784, "in-drivable-lane": 0, "agent_compute-ego": 0.14186915484341708, "deviation-heading": 0.8184218680195565, "set_robot_commands": 0.05502085252241655, "deviation-center-line": 0.15040450785110265, "driven_lanedir_consec": 0.2325888948459751, "sim_compute_sim_state": 0.02226532589305531, "sim_compute_performance-ego": 0.03784096782857722, "sim_compute_robot_state-ego": 0.040135221047834915, "sim_compute_robot_state-npc0": 0.03969298167662187, "sim_compute_robot_state-npc1": 0.03885148872028698, "sim_compute_robot_state-npc2": 0.03873466903513128, "sim_compute_robot_state-npc3": 0.038951890035109085}}
set_robot_commands_max0.05502085252241655
set_robot_commands_mean0.05460204071068843
set_robot_commands_median0.054592546907443446
set_robot_commands_min0.054001752535502115
sim_compute_performance-ego_max0.0395849815850119
sim_compute_performance-ego_mean0.03821322826841765
sim_compute_performance-ego_median0.03788363933563232
sim_compute_performance-ego_min0.03779991636884973
sim_compute_robot_state-ego_max0.04058574510100704
sim_compute_robot_state-ego_mean0.04021753207557174
sim_compute_robot_state-ego_median0.04016252628807883
sim_compute_robot_state-ego_min0.03990389506022136
sim_compute_robot_state-npc0_max0.03977232774098714
sim_compute_robot_state-npc0_mean0.039631351533296555
sim_compute_robot_state-npc0_median0.039614524656129114
sim_compute_robot_state-npc0_min0.03949160525139342
sim_compute_robot_state-npc1_max0.03885148872028698
sim_compute_robot_state-npc1_mean0.03879999432162826
sim_compute_robot_state-npc1_median0.03883007228774513
sim_compute_robot_state-npc1_min0.03871567452207525
sim_compute_robot_state-npc2_max0.039165885703077594
sim_compute_robot_state-npc2_mean0.03876105149215416
sim_compute_robot_state-npc2_median0.038650593859084106
sim_compute_robot_state-npc2_min0.03861265447404649
sim_compute_robot_state-npc3_max0.038951890035109085
sim_compute_robot_state-npc3_mean0.03876944834987389
sim_compute_robot_state-npc3_median0.038727243474665905
sim_compute_robot_state-npc3_min0.03870958723920457
sim_compute_sim_state_max0.02261038621266683
sim_compute_sim_state_mean0.02234447468444188
sim_compute_sim_state_median0.02226532589305531
sim_compute_sim_state_min0.02220655767709617
sim_physics_max0.09413236579639
sim_physics_mean0.09004071544376552
sim_physics_median0.09230301481612184
sim_physics_min0.08477173381381564
sim_render-ego_max0.03539906732187975
sim_render-ego_mean0.03503029826437054
sim_render-ego_median0.03512871807271784
sim_render-ego_min0.03459578115963242
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean4.799999999999991
survival_time_min2.2
240813876kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:11:13(hidden)
driven_lanedir_consec_median0.3675080545743271
survival_time_median6.249999999999986
deviation-center-line_median0.2965447427870658
in-drivable-lane_median2.199999999999992


other stats
agent_compute-ego_max0.14249171619921658
agent_compute-ego_mean0.14224431368274132
agent_compute-ego_median0.142472505569458
agent_compute-ego_min0.1415359992980957
deviation-center-line_max0.502780561610695
deviation-center-line_mean0.3161493322362382
deviation-center-line_min0.200283345726444
deviation-heading_max1.7101667772152096
deviation-heading_mean1.3163083605250905
deviation-heading_median1.54403723100336
deviation-heading_min0.835925562236027
driven_any_max0.7414594899441834
driven_any_mean0.5997161783290534
driven_any_median0.5746177764942553
driven_any_min0.3828625879524511
driven_lanedir_consec_max0.721858504154008
driven_lanedir_consec_mean0.3973510219779481
driven_lanedir_consec_min0.24995251430571308
driven_lanedir_max0.721858504154008
driven_lanedir_mean0.3973510219779481
driven_lanedir_median0.3675080545743271
driven_lanedir_min0.24995251430571308
in-drivable-lane_max2.6999999999999904
in-drivable-lane_mean1.4899999999999949
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7258903159008789, "sim_physics": 0.09723767593725403, "survival_time": 6.699999999999984, "driven_lanedir": 0.3970209812753591, "sim_render-ego": 0.03536459937024472, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.1424752420453883, "deviation-heading": 0.835925562236027, "set_robot_commands": 0.05409862568129355, "deviation-center-line": 0.365759055809039, "driven_lanedir_consec": 0.3970209812753591, "sim_compute_sim_state": 0.02217911784328631, "sim_compute_performance-ego": 0.03814115986895206, "sim_compute_robot_state-ego": 0.040497317242978226, "sim_compute_robot_state-npc0": 0.03967960912789872, "sim_compute_robot_state-npc1": 0.03886110391189803, "sim_compute_robot_state-npc2": 0.0385749980584899, "sim_compute_robot_state-npc3": 0.038749554264011665}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7414594899441834, "sim_physics": 0.09273102939528909, "survival_time": 7.449999999999981, "driven_lanedir": 0.721858504154008, "sim_render-ego": 0.03486212788012204, "in-drivable-lane": 0, "agent_compute-ego": 0.142472505569458, "deviation-heading": 1.54403723100336, "set_robot_commands": 0.05379382715929275, "deviation-center-line": 0.502780561610695, "driven_lanedir_consec": 0.721858504154008, "sim_compute_sim_state": 0.0221921277526241, "sim_compute_performance-ego": 0.0379980458509202, "sim_compute_robot_state-ego": 0.04017216407212635, "sim_compute_robot_state-npc0": 0.03966037219002743, "sim_compute_robot_state-npc1": 0.039093121586229976, "sim_compute_robot_state-npc2": 0.038702188722239246, "sim_compute_robot_state-npc3": 0.03879737693991437}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5746177764942553, "sim_physics": 0.08303946113586426, "survival_time": 6.249999999999986, "driven_lanedir": 0.24995251430571308, "sim_render-ego": 0.03450054740905762, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.1415359992980957, "deviation-heading": 1.7101667772152096, "set_robot_commands": 0.05394504928588867, "deviation-center-line": 0.21537895524794728, "driven_lanedir_consec": 0.24995251430571308, "sim_compute_sim_state": 0.022240015029907228, "sim_compute_performance-ego": 0.03822783088684082, "sim_compute_robot_state-ego": 0.040259922027587894, "sim_compute_robot_state-npc0": 0.03959039878845215, "sim_compute_robot_state-npc1": 0.03877754783630371, "sim_compute_robot_state-npc2": 0.03862243843078613, "sim_compute_robot_state-npc3": 0.03876107978820801}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5737507213534986, "sim_physics": 0.08939439427536146, "survival_time": 5.649999999999988, "driven_lanedir": 0.25041505558033306, "sim_render-ego": 0.03505208007002299, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.14249171619921658, "deviation-heading": 1.6011030791933836, "set_robot_commands": 0.0562770493262637, "deviation-center-line": 0.200283345726444, "driven_lanedir_consec": 0.25041505558033306, "sim_compute_sim_state": 0.02227118373972125, "sim_compute_performance-ego": 0.03820469105138188, "sim_compute_robot_state-ego": 0.040148445990233296, "sim_compute_robot_state-npc0": 0.03980777115948432, "sim_compute_robot_state-npc1": 0.03888515877512704, "sim_compute_robot_state-npc2": 0.03866351389251979, "sim_compute_robot_state-npc3": 0.03917710127028744}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3828625879524511, "sim_physics": 0.08745633380513795, "survival_time": 3.5499999999999954, "driven_lanedir": 0.3675080545743271, "sim_render-ego": 0.03533963082541882, "in-drivable-lane": 0, "agent_compute-ego": 0.14224610530154805, "deviation-heading": 0.8903091529774714, "set_robot_commands": 0.05418194179803553, "deviation-center-line": 0.2965447427870658, "driven_lanedir_consec": 0.3675080545743271, "sim_compute_sim_state": 0.02230795336441255, "sim_compute_performance-ego": 0.03796863555908203, "sim_compute_robot_state-ego": 0.04018960200564962, "sim_compute_robot_state-npc0": 0.04298190667595662, "sim_compute_robot_state-npc1": 0.03882207333202094, "sim_compute_robot_state-npc2": 0.03931924994562713, "sim_compute_robot_state-npc3": 0.03877376502668354}}
set_robot_commands_max0.0562770493262637
set_robot_commands_mean0.05445929865015484
set_robot_commands_median0.05409862568129355
set_robot_commands_min0.05379382715929275
sim_compute_performance-ego_max0.03822783088684082
sim_compute_performance-ego_mean0.038108072643435395
sim_compute_performance-ego_median0.03814115986895206
sim_compute_performance-ego_min0.03796863555908203
sim_compute_robot_state-ego_max0.040497317242978226
sim_compute_robot_state-ego_mean0.040253490267715075
sim_compute_robot_state-ego_median0.04018960200564962
sim_compute_robot_state-ego_min0.040148445990233296
sim_compute_robot_state-npc0_max0.04298190667595662
sim_compute_robot_state-npc0_mean0.04034401158836384
sim_compute_robot_state-npc0_median0.03967960912789872
sim_compute_robot_state-npc0_min0.03959039878845215
sim_compute_robot_state-npc1_max0.039093121586229976
sim_compute_robot_state-npc1_mean0.038887801088315944
sim_compute_robot_state-npc1_median0.03886110391189803
sim_compute_robot_state-npc1_min0.03877754783630371
sim_compute_robot_state-npc2_max0.03931924994562713
sim_compute_robot_state-npc2_mean0.03877647780993245
sim_compute_robot_state-npc2_median0.03866351389251979
sim_compute_robot_state-npc2_min0.0385749980584899
sim_compute_robot_state-npc3_max0.03917710127028744
sim_compute_robot_state-npc3_mean0.038851775457820995
sim_compute_robot_state-npc3_median0.03877376502668354
sim_compute_robot_state-npc3_min0.038749554264011665
sim_compute_sim_state_max0.02230795336441255
sim_compute_sim_state_mean0.022238079545990285
sim_compute_sim_state_median0.022240015029907228
sim_compute_sim_state_min0.02217911784328631
sim_physics_max0.09723767593725403
sim_physics_mean0.08997177890978135
sim_physics_median0.08939439427536146
sim_physics_min0.08303946113586426
sim_render-ego_max0.03536459937024472
sim_render-ego_mean0.03502379711097324
sim_render-ego_median0.03505208007002299
sim_render-ego_min0.03450054740905762
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean5.9199999999999875
survival_time_min3.5499999999999954
240793874kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:07:25
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240783873kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:16:10(hidden)
driven_lanedir_consec_median1.225963669352753
survival_time_median14.700000000000074
deviation-center-line_median0.32499624241951536
in-drivable-lane_median1.9500000000000275


other stats
agent_compute-ego_max0.12095973457115285
agent_compute-ego_mean0.11885629021748056
agent_compute-ego_median0.11859255205860454
agent_compute-ego_min0.11753423611323038
deviation-center-line_max0.5197457509417088
deviation-center-line_mean0.3545294018982278
deviation-center-line_min0.27188759915307575
deviation-heading_max2.821300237394604
deviation-heading_mean1.525743687194269
deviation-heading_median1.154542704336736
deviation-heading_min0.9169501529164946
driven_any_max1.6123967099239709
driven_any_mean1.2086815900426546
driven_any_median1.412550742658916
driven_any_min0.39715175640098854
driven_lanedir_consec_max1.4073403927561352
driven_lanedir_consec_mean0.9760534268685678
driven_lanedir_consec_min0.3775597171788704
driven_lanedir_max1.4073403927561352
driven_lanedir_mean0.9767608362686996
driven_lanedir_median1.225963669352753
driven_lanedir_min0.3775597171788704
in-drivable-lane_max3.600000000000051
in-drivable-lane_mean1.760000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029522663409033, "sim_physics": 0.08818714658199753, "survival_time": 9.049999999999994, "driven_lanedir": 0.6347961055068527, "sim_render-ego": 0.03647119564246078, "in-drivable-lane": 3.250000000000006, "agent_compute-ego": 0.11859255205860454, "deviation-heading": 1.154542704336736, "set_robot_commands": 0.054130670115434, "deviation-center-line": 0.30726351636942645, "driven_lanedir_consec": 0.6347961055068527, "sim_compute_sim_state": 0.02279914281644874, "sim_compute_performance-ego": 0.0388902867037947, "sim_compute_robot_state-ego": 0.04077567975165436, "sim_compute_robot_state-npc0": 0.04054103898738629, "sim_compute_robot_state-npc1": 0.04026242646064548, "sim_compute_robot_state-npc2": 0.039531373187323304, "sim_compute_robot_state-npc3": 0.0395660400390625}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.412550742658916, "sim_physics": 0.09398037830988566, "survival_time": 14.950000000000076, "driven_lanedir": 1.4073403927561352, "sim_render-ego": 0.03592634757359823, "in-drivable-lane": 0, "agent_compute-ego": 0.11753423611323038, "deviation-heading": 0.9723549014458814, "set_robot_commands": 0.05386878331502279, "deviation-center-line": 0.5197457509417088, "driven_lanedir_consec": 1.4073403927561352, "sim_compute_sim_state": 0.022815579573313396, "sim_compute_performance-ego": 0.03879493395487467, "sim_compute_robot_state-ego": 0.04076599915822347, "sim_compute_robot_state-npc0": 0.040391914049784344, "sim_compute_robot_state-npc1": 0.041047099431355795, "sim_compute_robot_state-npc2": 0.039551221529642744, "sim_compute_robot_state-npc3": 0.03993306636810303}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6123967099239709, "sim_physics": 0.08588542620340983, "survival_time": 14.950000000000076, "driven_lanedir": 1.2381442965488854, "sim_render-ego": 0.0360284686088562, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.11834374268849691, "deviation-heading": 2.821300237394604, "set_robot_commands": 0.05421180804570516, "deviation-center-line": 0.3487539006074123, "driven_lanedir_consec": 1.2346072495482274, "sim_compute_sim_state": 0.022870856126149496, "sim_compute_performance-ego": 0.03919635852177938, "sim_compute_robot_state-ego": 0.040853374004364014, "sim_compute_robot_state-npc0": 0.04173196077346802, "sim_compute_robot_state-npc1": 0.040239235560099285, "sim_compute_robot_state-npc2": 0.039914185206095375, "sim_compute_robot_state-npc3": 0.039761478106180824}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5917860778203643, "sim_physics": 0.088339461761267, "survival_time": 14.700000000000074, "driven_lanedir": 1.225963669352753, "sim_render-ego": 0.03723057678767613, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.11885118565591823, "deviation-heading": 1.7635704398776282, "set_robot_commands": 0.05473826288365993, "deviation-center-line": 0.27188759915307575, "driven_lanedir_consec": 1.225963669352753, "sim_compute_sim_state": 0.02306052454474832, "sim_compute_performance-ego": 0.03891507379051779, "sim_compute_robot_state-ego": 0.040728917738207346, "sim_compute_robot_state-npc0": 0.04116316474213892, "sim_compute_robot_state-npc1": 0.03984445374028212, "sim_compute_robot_state-npc2": 0.03991079087160072, "sim_compute_robot_state-npc3": 0.03976367363313429}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39715175640098854, "sim_physics": 0.08445552812106367, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3775597171788704, "sim_render-ego": 0.0364157289698504, "in-drivable-lane": 0, "agent_compute-ego": 0.12095973457115285, "deviation-heading": 0.9169501529164946, "set_robot_commands": 0.05389442996702332, "deviation-center-line": 0.32499624241951536, "driven_lanedir_consec": 0.3775597171788704, "sim_compute_sim_state": 0.022905408472254658, "sim_compute_performance-ego": 0.03891054443691088, "sim_compute_robot_state-ego": 0.04058672725290492, "sim_compute_robot_state-npc0": 0.04090702015420665, "sim_compute_robot_state-npc1": 0.039649248123168945, "sim_compute_robot_state-npc2": 0.03951226801112078, "sim_compute_robot_state-npc3": 0.03950456950975501}}
set_robot_commands_max0.05473826288365993
set_robot_commands_mean0.05416879086536904
set_robot_commands_median0.054130670115434
set_robot_commands_min0.05386878331502279
sim_compute_performance-ego_max0.03919635852177938
sim_compute_performance-ego_mean0.03894143948157548
sim_compute_performance-ego_median0.03891054443691088
sim_compute_performance-ego_min0.03879493395487467
sim_compute_robot_state-ego_max0.040853374004364014
sim_compute_robot_state-ego_mean0.04074213958107083
sim_compute_robot_state-ego_median0.04076599915822347
sim_compute_robot_state-ego_min0.04058672725290492
sim_compute_robot_state-npc0_max0.04173196077346802
sim_compute_robot_state-npc0_mean0.04094701974139685
sim_compute_robot_state-npc0_median0.04090702015420665
sim_compute_robot_state-npc0_min0.040391914049784344
sim_compute_robot_state-npc1_max0.041047099431355795
sim_compute_robot_state-npc1_mean0.04020849266311032
sim_compute_robot_state-npc1_median0.040239235560099285
sim_compute_robot_state-npc1_min0.039649248123168945
sim_compute_robot_state-npc2_max0.039914185206095375
sim_compute_robot_state-npc2_mean0.03968396776115658
sim_compute_robot_state-npc2_median0.039551221529642744
sim_compute_robot_state-npc2_min0.03951226801112078
sim_compute_robot_state-npc3_max0.03993306636810303
sim_compute_robot_state-npc3_mean0.039705765531247134
sim_compute_robot_state-npc3_median0.039761478106180824
sim_compute_robot_state-npc3_min0.03950456950975501
sim_compute_sim_state_max0.02306052454474832
sim_compute_sim_state_mean0.02289030230658292
sim_compute_sim_state_median0.022870856126149496
sim_compute_sim_state_min0.02279914281644874
sim_physics_max0.09398037830988566
sim_physics_mean0.08816958819552474
sim_physics_median0.08818714658199753
sim_physics_min0.08445552812106367
sim_render-ego_max0.03723057678767613
sim_render-ego_mean0.036414463516488346
sim_render-ego_median0.0364157289698504
sim_render-ego_min0.03592634757359823
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.420000000000044
survival_time_min3.4499999999999957
240773872kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:15:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240763871kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:10:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
240753870kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12900:03:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
240683858kene4192Baseline-IL-logs-tensorflow-keneaido2-LF-sim-testing-offseasonstep1-simulationfailedyes12900:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240673864kene4192Baseline-IL-logs-tensorflow-keneaido2-LFVI-sim-testing-offseasonstep1-simulationfailedyes12900:03:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240583848jagwarchallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12900:08:17(hidden)
driven_lanedir_consec_median0.1229443581134273
survival_time_median1.3500000000000003
deviation-center-line_median0.07666609549956557
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11029372612635296
agent_compute-ego_mean0.09718670064441325
agent_compute-ego_median0.09571255170381986
agent_compute-ego_min0.09446550499309192
deviation-center-line_max0.13280535346761538
deviation-center-line_mean0.08341721544931532
deviation-center-line_min0.044634091985992545
deviation-heading_max1.0509843201450328
deviation-heading_mean0.7268228368430759
deviation-heading_median0.7571356106125486
deviation-heading_min0.4407891421364369
driven_any_max0.24341132515354225
driven_any_mean0.1782360757850334
driven_any_median0.17394321290463016
driven_any_min0.1231734531965312
driven_lanedir_consec_max0.19202791779080508
driven_lanedir_consec_mean0.11795308596805625
driven_lanedir_consec_min0.058553136577239595
driven_lanedir_max0.19202791779080508
driven_lanedir_mean0.11795308596805625
driven_lanedir_median0.1229443581134273
driven_lanedir_min0.058553136577239595
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21784388970386043, "sim_physics": 0.059850431978702545, "survival_time": 1.6000000000000008, "driven_lanedir": 0.13562462050107582, "sim_render-ego": 0.03619995713233948, "in-drivable-lane": 0, "agent_compute-ego": 0.10377609729766846, "deviation-heading": 1.0509843201450328, "set_robot_commands": 0.055401675403118134, "deviation-center-line": 0.10424047374846002, "driven_lanedir_consec": 0.13562462050107582, "sim_compute_sim_state": 0.023091517388820648, "sim_compute_performance-ego": 0.03881244361400604, "sim_compute_robot_state-ego": 0.040485478937625885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24341132515354225, "sim_physics": 0.059744467054094585, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17236304027848937, "sim_render-ego": 0.03575107710702079, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09633346966334752, "deviation-heading": 0.8881560403107783, "set_robot_commands": 0.05454801150730678, "deviation-center-line": 0.06549435431208495, "driven_lanedir_consec": 0.17236304027848937, "sim_compute_sim_state": 0.02344212532043457, "sim_compute_performance-ego": 0.039439208166939875, "sim_compute_robot_state-ego": 0.04088039398193359}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1231734531965312, "sim_physics": 0.05874059313819522, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09414985618509952, "sim_render-ego": 0.035969745545160206, "in-drivable-lane": 0, "agent_compute-ego": 0.0961693014417376, "deviation-heading": 0.5586926307322083, "set_robot_commands": 0.05385372752235049, "deviation-center-line": 0.09794670099385716, "driven_lanedir_consec": 0.09414985618509952, "sim_compute_sim_state": 0.02333891959417434, "sim_compute_performance-ego": 0.039209116072881786, "sim_compute_robot_state-ego": 0.040715172177269346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17633006573155224, "sim_physics": 0.06504533208649733, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07616191045725307, "sim_render-ego": 0.03674069766340585, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09720968378001246, "deviation-heading": 0.9805094729677124, "set_robot_commands": 0.05557279751218598, "deviation-center-line": 0.06413429802505513, "driven_lanedir_consec": 0.07616191045725307, "sim_compute_sim_state": 0.023410164076706454, "sim_compute_performance-ego": 0.03890867068849761, "sim_compute_robot_state-ego": 0.04067992341929469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22275054588977952, "sim_physics": 0.06380349217039166, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14638465078058038, "sim_render-ego": 0.03652576966719194, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09683557712670528, "deviation-heading": 0.8492114904895192, "set_robot_commands": 0.0578853144790187, "deviation-center-line": 0.0712737219748357, "driven_lanedir_consec": 0.14638465078058038, "sim_compute_sim_state": 0.02341732834324692, "sim_compute_performance-ego": 0.039356202790231415, "sim_compute_robot_state-ego": 0.04107469500917377}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18773213486094453, "sim_physics": 0.06225159764289856, "survival_time": 1.6000000000000008, "driven_lanedir": 0.058553136577239595, "sim_render-ego": 0.03682372719049454, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09568683058023451, "deviation-heading": 0.8976997876744849, "set_robot_commands": 0.05429675430059433, "deviation-center-line": 0.06037512768288391, "driven_lanedir_consec": 0.058553136577239595, "sim_compute_sim_state": 0.023168981075286865, "sim_compute_performance-ego": 0.03872343897819519, "sim_compute_robot_state-ego": 0.04045236110687256}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2251873551058529, "sim_physics": 0.06152981122334798, "survival_time": 1.5000000000000009, "driven_lanedir": 0.19202791779080508, "sim_render-ego": 0.035486761728922525, "in-drivable-lane": 0, "agent_compute-ego": 0.09548126856486004, "deviation-heading": 0.5836644222385844, "set_robot_commands": 0.053549154599507647, "deviation-center-line": 0.10143054101209424, "driven_lanedir_consec": 0.19202791779080508, "sim_compute_sim_state": 0.023042448361714683, "sim_compute_performance-ego": 0.03862470785776774, "sim_compute_robot_state-ego": 0.04034092426300049}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13775473224063794, "sim_physics": 0.05523665384812789, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1051179778500404, "sim_render-ego": 0.035022063688798385, "in-drivable-lane": 0, "agent_compute-ego": 0.09446550499309192, "deviation-heading": 0.5783914395686329, "set_robot_commands": 0.0543942776593295, "deviation-center-line": 0.10137170634845805, "driven_lanedir_consec": 0.1051179778500404, "sim_compute_sim_state": 0.023315711454911667, "sim_compute_performance-ego": 0.03868713162162087, "sim_compute_robot_state-ego": 0.04071886972947554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14382652503473223, "sim_physics": 0.05701860097738413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07639718955321007, "sim_render-ego": 0.03588681037609394, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0946797040792612, "deviation-heading": 0.7775430075810775, "set_robot_commands": 0.05432403087615967, "deviation-center-line": 0.044634091985992545, "driven_lanedir_consec": 0.07639718955321007, "sim_compute_sim_state": 0.023384992892925557, "sim_compute_performance-ego": 0.03883211429302509, "sim_compute_robot_state-ego": 0.04079767373891977}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.16575475257370412, "sim_physics": 0.0612483574793889, "survival_time": 1.3000000000000005, "driven_lanedir": 0.128276307911535, "sim_render-ego": 0.04227846402388353, "in-drivable-lane": 0, "agent_compute-ego": 0.09571255170381986, "deviation-heading": 0.5991811933956286, "set_robot_commands": 0.05450230378371019, "deviation-center-line": 0.09840410208342552, "driven_lanedir_consec": 0.128276307911535, "sim_compute_sim_state": 0.023311449931218073, "sim_compute_performance-ego": 0.039297085541945234, "sim_compute_robot_state-ego": 0.04104258463932918}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1586243662901447, "sim_physics": 0.06124300003051758, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1264633834032557, "sim_render-ego": 0.04200637817382812, "in-drivable-lane": 0, "agent_compute-ego": 0.09501618385314942, "deviation-heading": 0.5191351250629405, "set_robot_commands": 0.05459192276000977, "deviation-center-line": 0.11102855621744924, "driven_lanedir_consec": 0.1264633834032557, "sim_compute_sim_state": 0.023310766220092777, "sim_compute_performance-ego": 0.03858145713806152, "sim_compute_robot_state-ego": 0.0406609058380127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14532602778681517, "sim_physics": 0.06638988852500916, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10552075516404393, "sim_render-ego": 0.036208927631378174, "in-drivable-lane": 0, "agent_compute-ego": 0.11029372612635296, "deviation-heading": 0.6433314660550675, "set_robot_commands": 0.05407660206158956, "deviation-center-line": 0.07666609549956557, "driven_lanedir_consec": 0.10552075516404393, "sim_compute_sim_state": 0.023110419511795044, "sim_compute_performance-ego": 0.03887237111727397, "sim_compute_robot_state-ego": 0.04650078217188517}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18283249884991845, "sim_physics": 0.05930591374635696, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08043569777929549, "sim_render-ego": 0.03660367429256439, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09504076093435287, "deviation-heading": 0.7779174036754858, "set_robot_commands": 0.05382777750492096, "deviation-center-line": 0.053782878450133, "driven_lanedir_consec": 0.08043569777929549, "sim_compute_sim_state": 0.023179173469543457, "sim_compute_performance-ego": 0.03899698704481125, "sim_compute_robot_state-ego": 0.04077526181936264}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16905025145285457, "sim_physics": 0.05866719209230863, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1229443581134273, "sim_render-ego": 0.03519900028522198, "in-drivable-lane": 0, "agent_compute-ego": 0.09491450969989484, "deviation-heading": 0.7571356106125486, "set_robot_commands": 0.05364535405085637, "deviation-center-line": 0.06767022993781907, "driven_lanedir_consec": 0.1229443581134273, "sim_compute_sim_state": 0.023006109090951778, "sim_compute_performance-ego": 0.03866552389585055, "sim_compute_robot_state-ego": 0.04037053768451397}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17394321290463016, "sim_physics": 0.05840714772542318, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14887548717549315, "sim_render-ego": 0.036333931816948786, "in-drivable-lane": 0, "agent_compute-ego": 0.09618533982170951, "deviation-heading": 0.4407891421364369, "set_robot_commands": 0.05514686195938675, "deviation-center-line": 0.13280535346761538, "driven_lanedir_consec": 0.14887548717549315, "sim_compute_sim_state": 0.023279825846354168, "sim_compute_performance-ego": 0.03884870917708785, "sim_compute_robot_state-ego": 0.040822894484908494}}
set_robot_commands_max0.0578853144790187
set_robot_commands_mean0.05464110439866966
set_robot_commands_median0.0543942776593295
set_robot_commands_min0.053549154599507647
sim_compute_performance-ego_max0.039439208166939875
sim_compute_performance-ego_mean0.0389236778665464
sim_compute_performance-ego_median0.03884870917708785
sim_compute_performance-ego_min0.03858145713806152
sim_compute_robot_state-ego_max0.04650078217188517
sim_compute_robot_state-ego_mean0.04108789726677186
sim_compute_robot_state-ego_median0.04071886972947554
sim_compute_robot_state-ego_min0.04034092426300049
sim_compute_sim_state_max0.02344212532043457
sim_compute_sim_state_mean0.0232539955052118
sim_compute_sim_state_median0.023310766220092777
sim_compute_sim_state_min0.023006109090951778
sim_physics_max0.06638988852500916
sim_physics_mean0.060565498647909624
sim_physics_median0.059850431978702545
sim_physics_min0.05523665384812789
sim_render-ego_max0.04227846402388353
sim_render-ego_mean0.036869132421550176
sim_render-ego_median0.036208927631378174
sim_render-ego_min0.035022063688798385
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4000000000000008
survival_time_min1.0500000000000005
240553851jagwarchallenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12900:13:35(hidden)
driven_lanedir_consec_median0.06947524826232065
survival_time_median1.3000000000000005
deviation-center-line_median0.06512377432009957
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16704841454823813
agent_compute-ego_mean0.1450840945902538
agent_compute-ego_median0.1480418806490691
agent_compute-ego_min0.12042725086212158
deviation-center-line_max0.09912182735535308
deviation-center-line_mean0.06956223729060027
deviation-center-line_min0.034221115106860704
deviation-heading_max0.9568908317311412
deviation-heading_mean0.7331424734268113
deviation-heading_median0.6918688301065948
deviation-heading_min0.6093679154268812
driven_any_max0.2664548389627696
driven_any_mean0.16158241740697565
driven_any_median0.16635266971035748
driven_any_min0.09830786333507666
driven_lanedir_consec_max0.14117875567636862
driven_lanedir_consec_mean0.07727458275898706
driven_lanedir_consec_min0.05206771627714435
driven_lanedir_max0.14117875567636862
driven_lanedir_mean0.07727458275898706
driven_lanedir_median0.06947524826232065
driven_lanedir_min0.05206771627714435
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.2600000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2216939397145425, "sim_physics": 0.18235335085127088, "survival_time": 1.800000000000001, "driven_lanedir": 0.07943468613563676, "sim_render-ego": 0.056959728399912514, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16704841454823813, "deviation-heading": 0.6918688301065948, "set_robot_commands": 0.09787617127100628, "deviation-center-line": 0.05811903637043487, "driven_lanedir_consec": 0.07943468613563676, "sim_compute_sim_state": 0.03633320331573486, "sim_compute_performance-ego": 0.06499005688561334, "sim_compute_robot_state-ego": 0.07335406541824341, "sim_compute_robot_state-npc0": 0.06719151470396253, "sim_compute_robot_state-npc1": 0.07012327512105306, "sim_compute_robot_state-npc2": 0.07034833563698663, "sim_compute_robot_state-npc3": 0.0688115225897895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20615819948533312, "sim_physics": 0.1589486522059287, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09157991248925246, "sim_render-ego": 0.05703136228745984, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16113135122483777, "deviation-heading": 0.9568908317311412, "set_robot_commands": 0.09058475494384766, "deviation-center-line": 0.07001847109510527, "driven_lanedir_consec": 0.09157991248925246, "sim_compute_sim_state": 0.039651801509241906, "sim_compute_performance-ego": 0.061763078935684695, "sim_compute_robot_state-ego": 0.06340051466418851, "sim_compute_robot_state-npc0": 0.06369275431479177, "sim_compute_robot_state-npc1": 0.06507884302446919, "sim_compute_robot_state-npc2": 0.0643343617839198, "sim_compute_robot_state-npc3": 0.06955517491986675}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09830786333507666, "sim_physics": 0.20347898939381476, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06330370880935465, "sim_render-ego": 0.06764827603879182, "in-drivable-lane": 0, "agent_compute-ego": 0.1480418806490691, "deviation-heading": 0.6093679154268812, "set_robot_commands": 0.09097525347834048, "deviation-center-line": 0.09912182735535308, "driven_lanedir_consec": 0.06330370880935465, "sim_compute_sim_state": 0.04063751386559528, "sim_compute_performance-ego": 0.0745113932568094, "sim_compute_robot_state-ego": 0.07761051343834918, "sim_compute_robot_state-npc0": 0.06494205930958623, "sim_compute_robot_state-npc1": 0.06941005458002505, "sim_compute_robot_state-npc2": 0.06838686569877293, "sim_compute_robot_state-npc3": 0.07157523735709813}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1133320044931791, "sim_physics": 0.1933247184753418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06814144662571531, "sim_render-ego": 0.05544223785400391, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15899683952331542, "deviation-heading": 0.638366169946637, "set_robot_commands": 0.08558884620666504, "deviation-center-line": 0.09466029891830084, "driven_lanedir_consec": 0.06814144662571531, "sim_compute_sim_state": 0.03705830574035644, "sim_compute_performance-ego": 0.05993223190307617, "sim_compute_robot_state-ego": 0.06578329086303711, "sim_compute_robot_state-npc0": 0.060085411071777346, "sim_compute_robot_state-npc1": 0.060624094009399415, "sim_compute_robot_state-npc2": 0.06081487655639648, "sim_compute_robot_state-npc3": 0.05813167572021485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1360913024836359, "sim_physics": 0.1206211126767672, "survival_time": 1.3000000000000005, "driven_lanedir": 0.062190920984986575, "sim_render-ego": 0.041885201747600846, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1210268002289992, "deviation-heading": 0.8365001779512337, "set_robot_commands": 0.06595696852757381, "deviation-center-line": 0.04654452675863551, "driven_lanedir_consec": 0.062190920984986575, "sim_compute_sim_state": 0.027146293566777155, "sim_compute_performance-ego": 0.04698711175184984, "sim_compute_robot_state-ego": 0.04767457338479849, "sim_compute_robot_state-npc0": 0.04708421230316162, "sim_compute_robot_state-npc1": 0.045769498898432806, "sim_compute_robot_state-npc2": 0.04547284199641301, "sim_compute_robot_state-npc3": 0.0462725804402278}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2156692827764211, "sim_physics": 0.1782274674146603, "survival_time": 1.950000000000001, "driven_lanedir": 0.06947524826232065, "sim_render-ego": 0.06243216685759716, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16631625860165328, "deviation-heading": 0.6906570612038296, "set_robot_commands": 0.09298043373303536, "deviation-center-line": 0.04774932989614036, "driven_lanedir_consec": 0.06947524826232065, "sim_compute_sim_state": 0.04152528444925944, "sim_compute_performance-ego": 0.07140862024747409, "sim_compute_robot_state-ego": 0.0779262016981076, "sim_compute_robot_state-npc0": 0.06909989699339256, "sim_compute_robot_state-npc1": 0.0684819649427365, "sim_compute_robot_state-npc2": 0.06957450891152406, "sim_compute_robot_state-npc3": 0.06881208908863556}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11992072199147588, "sim_physics": 0.1927576706959651, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05373239123963269, "sim_render-ego": 0.058785502727215104, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15995104496295637, "deviation-heading": 0.6137971284761422, "set_robot_commands": 0.09189346203437218, "deviation-center-line": 0.06512377432009957, "driven_lanedir_consec": 0.05373239123963269, "sim_compute_sim_state": 0.03601824320279635, "sim_compute_performance-ego": 0.06257947591634896, "sim_compute_robot_state-ego": 0.06917618788205661, "sim_compute_robot_state-npc0": 0.06844513232891376, "sim_compute_robot_state-npc1": 0.05966759645021879, "sim_compute_robot_state-npc2": 0.06216304118816669, "sim_compute_robot_state-npc3": 0.0634528581912701}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10322377002716536, "sim_physics": 0.16976577043533325, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05775063107126677, "sim_render-ego": 0.058421184619267784, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16690322756767273, "deviation-heading": 0.635272022705146, "set_robot_commands": 0.08777597546577454, "deviation-center-line": 0.08173861480172218, "driven_lanedir_consec": 0.05775063107126677, "sim_compute_sim_state": 0.03720415631930033, "sim_compute_performance-ego": 0.06373035907745361, "sim_compute_robot_state-ego": 0.06808560093243916, "sim_compute_robot_state-npc0": 0.06465348601341248, "sim_compute_robot_state-npc1": 0.06982527176539104, "sim_compute_robot_state-npc2": 0.0665293534596761, "sim_compute_robot_state-npc3": 0.06590592861175537}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2664548389627696, "sim_physics": 0.1790088176727295, "survival_time": 2.000000000000001, "driven_lanedir": 0.14117875567636862, "sim_render-ego": 0.06046784520149231, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.16685298681259156, "deviation-heading": 0.7666971028646175, "set_robot_commands": 0.08462631702423096, "deviation-center-line": 0.04455787468573659, "driven_lanedir_consec": 0.14117875567636862, "sim_compute_sim_state": 0.03818677663803101, "sim_compute_performance-ego": 0.06707600355148316, "sim_compute_robot_state-ego": 0.07247701287269592, "sim_compute_robot_state-npc0": 0.06787875890731812, "sim_compute_robot_state-npc1": 0.06965561509132386, "sim_compute_robot_state-npc2": 0.06925073266029358, "sim_compute_robot_state-npc3": 0.06856895685195923}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1684502708468383, "sim_physics": 0.1161815936748798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0877210200270544, "sim_render-ego": 0.04508034999553974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12891615354097807, "deviation-heading": 0.8684815001261574, "set_robot_commands": 0.06699111828437218, "deviation-center-line": 0.05669407424921031, "driven_lanedir_consec": 0.0877210200270544, "sim_compute_sim_state": 0.02840133813711313, "sim_compute_performance-ego": 0.04933460859151987, "sim_compute_robot_state-ego": 0.049698206094595104, "sim_compute_robot_state-npc0": 0.04773864379295936, "sim_compute_robot_state-npc1": 0.04714820935175969, "sim_compute_robot_state-npc2": 0.05010886375720684, "sim_compute_robot_state-npc3": 0.048369838641240046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16635266971035748, "sim_physics": 0.13589370250701904, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05206771627714435, "sim_render-ego": 0.04869455844163895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1307450607419014, "deviation-heading": 0.842795983716735, "set_robot_commands": 0.07418506592512131, "deviation-center-line": 0.034221115106860704, "driven_lanedir_consec": 0.05206771627714435, "sim_compute_sim_state": 0.029382482171058655, "sim_compute_performance-ego": 0.0518643856048584, "sim_compute_robot_state-ego": 0.05227695405483246, "sim_compute_robot_state-npc0": 0.05606383830308914, "sim_compute_robot_state-npc1": 0.05469105392694473, "sim_compute_robot_state-npc2": 0.05288615822792053, "sim_compute_robot_state-npc3": 0.05510794371366501}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11152707836209318, "sim_physics": 0.11044746095483954, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07430216811015633, "sim_render-ego": 0.04369520057331432, "in-drivable-lane": 0, "agent_compute-ego": 0.12042725086212158, "deviation-heading": 0.633161668341792, "set_robot_commands": 0.07578564773906361, "deviation-center-line": 0.09856101392100196, "driven_lanedir_consec": 0.07430216811015633, "sim_compute_sim_state": 0.02698223157362505, "sim_compute_performance-ego": 0.049310619180852715, "sim_compute_robot_state-ego": 0.05137376351789995, "sim_compute_robot_state-npc0": 0.0521550178527832, "sim_compute_robot_state-npc1": 0.05090663649819114, "sim_compute_robot_state-npc2": 0.05012174086137251, "sim_compute_robot_state-npc3": 0.051370891657742584}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.213121520801667, "sim_physics": 0.12741071299502724, "survival_time": 1.900000000000001, "driven_lanedir": 0.07342749917038549, "sim_render-ego": 0.0453889809156719, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1218564698570653, "deviation-heading": 0.7208020674825103, "set_robot_commands": 0.06580694098221629, "deviation-center-line": 0.06432396279468568, "driven_lanedir_consec": 0.07342749917038549, "sim_compute_sim_state": 0.028651852356760127, "sim_compute_performance-ego": 0.04859908003556101, "sim_compute_robot_state-ego": 0.049504562428123074, "sim_compute_robot_state-npc0": 0.05017357123525519, "sim_compute_robot_state-npc1": 0.04988887435511539, "sim_compute_robot_state-npc2": 0.050419518822117856, "sim_compute_robot_state-npc3": 0.05154264600653397}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11543104782289168, "sim_physics": 0.12491594190182892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06880245823933606, "sim_render-ego": 0.04531669616699219, "in-drivable-lane": 0, "agent_compute-ego": 0.13515500400377356, "deviation-heading": 0.687341124254223, "set_robot_commands": 0.06442269035007643, "deviation-center-line": 0.09017432794428108, "driven_lanedir_consec": 0.06880245823933606, "sim_compute_sim_state": 0.026953831962917164, "sim_compute_performance-ego": 0.047048641287762184, "sim_compute_robot_state-ego": 0.04680087255394977, "sim_compute_robot_state-npc0": 0.05067781780077064, "sim_compute_robot_state-npc1": 0.04745799562205439, "sim_compute_robot_state-npc2": 0.04632307135540506, "sim_compute_robot_state-npc3": 0.04648586978083071}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1680017502911879, "sim_physics": 0.1303401651053593, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11601017826619486, "sim_render-ego": 0.0469716006311877, "in-drivable-lane": 0, "agent_compute-ego": 0.12289267572863348, "deviation-heading": 0.8051375170685292, "set_robot_commands": 0.07019320849714608, "deviation-center-line": 0.09182531114143604, "driven_lanedir_consec": 0.11601017826619486, "sim_compute_sim_state": 0.029662428231074893, "sim_compute_performance-ego": 0.051585526301943026, "sim_compute_robot_state-ego": 0.05165175733895137, "sim_compute_robot_state-npc0": 0.05113275297756853, "sim_compute_robot_state-npc1": 0.05358579240996262, "sim_compute_robot_state-npc2": 0.05109383319986278, "sim_compute_robot_state-npc3": 0.04864432071817333}}
set_robot_commands_max0.09787617127100628
set_robot_commands_mean0.08037619029752283
set_robot_commands_median0.08462631702423096
set_robot_commands_min0.06442269035007643
sim_compute_performance-ego_max0.0745113932568094
sim_compute_performance-ego_mean0.05804807950188603
sim_compute_performance-ego_median0.05993223190307617
sim_compute_performance-ego_min0.04698711175184984
sim_compute_robot_state-ego_max0.0779262016981076
sim_compute_robot_state-ego_mean0.06111960514281783
sim_compute_robot_state-ego_median0.06340051466418851
sim_compute_robot_state-ego_min0.04680087255394977
sim_compute_robot_state-npc0_max0.06909989699339256
sim_compute_robot_state-npc0_mean0.05873432452724949
sim_compute_robot_state-npc0_median0.060085411071777346
sim_compute_robot_state-npc0_min0.04708421230316162
sim_compute_robot_state-npc1_max0.07012327512105306
sim_compute_robot_state-npc1_mean0.05882098506980518
sim_compute_robot_state-npc1_median0.05966759645021879
sim_compute_robot_state-npc1_min0.045769498898432806
sim_compute_robot_state-npc2_max0.07034833563698663
sim_compute_robot_state-npc2_mean0.058521873607735655
sim_compute_robot_state-npc2_median0.06081487655639648
sim_compute_robot_state-npc2_min0.04547284199641301
sim_compute_robot_state-npc3_max0.07157523735709813
sim_compute_robot_state-npc3_mean0.05884050228593353
sim_compute_robot_state-npc3_median0.05813167572021485
sim_compute_robot_state-npc3_min0.0462725804402278
sim_compute_sim_state_max0.04152528444925944
sim_compute_sim_state_mean0.033586382869309456
sim_compute_sim_state_median0.03601824320279635
sim_compute_sim_state_min0.026953831962917164
sim_physics_max0.20347898939381476
sim_physics_mean0.15491174179738437
sim_physics_median0.1589486522059287
sim_physics_min0.11044746095483954
sim_render-ego_max0.06764827603879182
sim_render-ego_mean0.052948059497179074
sim_render-ego_median0.05544223785400391
sim_render-ego_min0.041885201747600846
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.4666666666666677
survival_time_min1.1000000000000003
240523855jagwarchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12900:07:28(hidden)
driven_lanedir_consec_median0.10841242970988851
survival_time_median1.2000000000000004
deviation-center-line_median0.0785272864481927
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17366300929676404
agent_compute-ego_mean0.16165763564378377
agent_compute-ego_median0.16038896726525348
agent_compute-ego_min0.15099177153214163
deviation-center-line_max0.10137678827910948
deviation-center-line_mean0.08217518204448526
deviation-center-line_min0.06101048778196971
deviation-heading_max0.9811581264325268
deviation-heading_mean0.7196417831175996
deviation-heading_median0.816459206838672
deviation-heading_min0.4765154978536198
driven_any_max0.22408440128729695
driven_any_mean0.1701541383747119
driven_any_median0.14239899680454415
driven_any_min0.13840448083518486
driven_lanedir_consec_max0.12614560964674926
driven_lanedir_consec_mean0.1059152289990144
driven_lanedir_consec_min0.08715686275611012
driven_lanedir_max0.12614560964674926
driven_lanedir_mean0.1059152289990144
driven_lanedir_median0.10841242970988851
driven_lanedir_min0.08715686275611012
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.1100000000000001
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22408440128729695, "sim_physics": 0.20000138427271988, "survival_time": 1.6500000000000008, "driven_lanedir": 0.12614560964674926, "sim_render-ego": 0.057723558310306435, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17366300929676404, "deviation-heading": 0.816459206838672, "set_robot_commands": 0.09098248048262164, "deviation-center-line": 0.0785272864481927, "driven_lanedir_consec": 0.12614560964674926, "sim_compute_sim_state": 0.040144761403401695, "sim_compute_performance-ego": 0.06353425979614258, "sim_compute_robot_state-ego": 0.07103196779886882, "sim_compute_robot_state-npc0": 0.06677364580559009, "sim_compute_robot_state-npc1": 0.06539917714668042, "sim_compute_robot_state-npc2": 0.06717796036691377, "sim_compute_robot_state-npc3": 0.07061535661870783}, "udem1-1-0": {"driven_any": 0.20562433161597565, "sim_physics": 0.21806523948907852, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09918140686845732, "sim_render-ego": 0.06793069839477539, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16751647740602493, "deviation-heading": 0.9811581264325268, "set_robot_commands": 0.08753719180822372, "deviation-center-line": 0.07412798602141865, "driven_lanedir_consec": 0.09918140686845732, "sim_compute_sim_state": 0.03910890966653824, "sim_compute_performance-ego": 0.07015541940927505, "sim_compute_robot_state-ego": 0.1072678044438362, "sim_compute_robot_state-npc0": 0.06583426147699356, "sim_compute_robot_state-npc1": 0.06724468618631363, "sim_compute_robot_state-npc2": 0.07822313904762268, "sim_compute_robot_state-npc3": 0.0713609978556633}, "udem1-2-0": {"driven_any": 0.14025848133055793, "sim_physics": 0.23656636735667352, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10841242970988851, "sim_render-ego": 0.06362561557603919, "in-drivable-lane": 0, "agent_compute-ego": 0.16038896726525348, "deviation-heading": 0.4765154978536198, "set_robot_commands": 0.09031105041503906, "deviation-center-line": 0.10137678827910948, "driven_lanedir_consec": 0.10841242970988851, "sim_compute_sim_state": 0.03902503718500552, "sim_compute_performance-ego": 0.06942088707633641, "sim_compute_robot_state-ego": 0.07832657772561778, "sim_compute_robot_state-npc0": 0.06632314557614534, "sim_compute_robot_state-npc1": 0.06504446527232295, "sim_compute_robot_state-npc2": 0.06802041634269383, "sim_compute_robot_state-npc3": 0.06594068071116573}, "udem1-3-0": {"driven_any": 0.13840448083518486, "sim_physics": 0.21385299641153083, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10867983601386676, "sim_render-ego": 0.05900790380394977, "in-drivable-lane": 0, "agent_compute-ego": 0.15099177153214163, "deviation-heading": 0.48578061144859186, "set_robot_commands": 0.08661710697671642, "deviation-center-line": 0.0958333616917358, "driven_lanedir_consec": 0.10867983601386676, "sim_compute_sim_state": 0.03655789209448773, "sim_compute_performance-ego": 0.06698414553766666, "sim_compute_robot_state-ego": 0.06967255343561587, "sim_compute_robot_state-npc0": 0.06803417205810547, "sim_compute_robot_state-npc1": 0.06968230786530868, "sim_compute_robot_state-npc2": 0.06875857062961745, "sim_compute_robot_state-npc3": 0.06878825892572818}, "udem1-4-0": {"driven_any": 0.14239899680454415, "sim_physics": 0.21248593926429749, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08715686275611012, "sim_render-ego": 0.06263730923334758, "in-drivable-lane": 0, "agent_compute-ego": 0.15572795271873474, "deviation-heading": 0.8382954730145875, "set_robot_commands": 0.08868125081062317, "deviation-center-line": 0.06101048778196971, "driven_lanedir_consec": 0.08715686275611012, "sim_compute_sim_state": 0.03820039828618368, "sim_compute_performance-ego": 0.07082422574361165, "sim_compute_robot_state-ego": 0.07698733607927959, "sim_compute_robot_state-npc0": 0.07029362519582112, "sim_compute_robot_state-npc1": 0.0717146893342336, "sim_compute_robot_state-npc2": 0.07128756244977315, "sim_compute_robot_state-npc3": 0.06453742583592732}}
set_robot_commands_max0.09098248048262164
set_robot_commands_mean0.0888258160986448
set_robot_commands_median0.08868125081062317
set_robot_commands_min0.08661710697671642
sim_compute_performance-ego_max0.07082422574361165
sim_compute_performance-ego_mean0.06818378751260647
sim_compute_performance-ego_median0.06942088707633641
sim_compute_performance-ego_min0.06353425979614258
sim_compute_robot_state-ego_max0.1072678044438362
sim_compute_robot_state-ego_mean0.08065724789664366
sim_compute_robot_state-ego_median0.07698733607927959
sim_compute_robot_state-ego_min0.06967255343561587
sim_compute_robot_state-npc0_max0.07029362519582112
sim_compute_robot_state-npc0_mean0.06745177002253111
sim_compute_robot_state-npc0_median0.06677364580559009
sim_compute_robot_state-npc0_min0.06583426147699356
sim_compute_robot_state-npc1_max0.0717146893342336
sim_compute_robot_state-npc1_mean0.06781706516097184
sim_compute_robot_state-npc1_median0.06724468618631363
sim_compute_robot_state-npc1_min0.06504446527232295
sim_compute_robot_state-npc2_max0.07822313904762268
sim_compute_robot_state-npc2_mean0.07069352976732417
sim_compute_robot_state-npc2_median0.06875857062961745
sim_compute_robot_state-npc2_min0.06717796036691377
sim_compute_robot_state-npc3_max0.0713609978556633
sim_compute_robot_state-npc3_mean0.06824854398943846
sim_compute_robot_state-npc3_median0.06878825892572818
sim_compute_robot_state-npc3_min0.06453742583592732
sim_compute_sim_state_max0.040144761403401695
sim_compute_sim_state_mean0.038607399727123376
sim_compute_sim_state_median0.03902503718500552
sim_compute_sim_state_min0.03655789209448773
sim_physics_max0.23656636735667352
sim_physics_mean0.21619438535886007
sim_physics_median0.21385299641153083
sim_physics_min0.20000138427271988
sim_render-ego_max0.06793069839477539
sim_render-ego_mean0.062185017063683665
sim_render-ego_median0.06263730923334758
sim_render-ego_min0.057723558310306435
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3500000000000003
survival_time_min1.1500000000000004
240513839kene4192kene-template-randomaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12900:09:29(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.10567373340412722
agent_compute-ego_mean0.08828905747662495
agent_compute-ego_median0.08667568284638073
agent_compute-ego_min0.0853923515037254
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05754892031351725, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.035991664286013005, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08758476045396593, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0564713301482024, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02311914496951633, "sim_compute_performance-ego": 0.038981000582377114, "sim_compute_robot_state-ego": 0.04060816323315656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05988408537471995, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03542415768492455, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08681893348693848, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.055281849468455595, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.023221043979420385, "sim_compute_performance-ego": 0.039093728158988206, "sim_compute_robot_state-ego": 0.04029261832143746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06022742215324851, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03663997089161592, "in-drivable-lane": 0, "agent_compute-ego": 0.08745193481445312, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0554507760440602, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02346003756803625, "sim_compute_performance-ego": 0.03938226138844209, "sim_compute_robot_state-ego": 0.04094175731434541}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06408195495605469, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0368233585357666, "in-drivable-lane": 0, "agent_compute-ego": 0.09353622436523436, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05487502098083496, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0234027099609375, "sim_compute_performance-ego": 0.03886502265930176, "sim_compute_robot_state-ego": 0.04064421653747559}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05989903136144711, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0379552237595184, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08655439751057685, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05518694467182401, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02320653577394123, "sim_compute_performance-ego": 0.03860976726193971, "sim_compute_robot_state-ego": 0.04137445401541794}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.05828631167509118, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03635723736821389, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08667568284638073, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.05492612780356894, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02333019704234843, "sim_compute_performance-ego": 0.03892149244035993, "sim_compute_robot_state-ego": 0.040773975605867346}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.05630562560898917, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03629807915006365, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.08677088788577489, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0550339264529092, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.023259260824748447, "sim_compute_performance-ego": 0.038823923894337246, "sim_compute_robot_state-ego": 0.040748540844236104}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.061629352115449454, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.035855304627191456, "in-drivable-lane": 0, "agent_compute-ego": 0.0858741941906157, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05450621105375744, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.023022765205019995, "sim_compute_performance-ego": 0.03853568576631092, "sim_compute_robot_state-ego": 0.040723164876302086}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.06176831358570164, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03637610047550525, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.10567373340412722, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.057692580303903354, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.023932412519293317, "sim_compute_performance-ego": 0.03887203184224791, "sim_compute_robot_state-ego": 0.04041864912388688}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.06055666316639293, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03635511831803755, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.08641171888871627, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05523879744789817, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.023175920139659533, "sim_compute_performance-ego": 0.0387467471036044, "sim_compute_robot_state-ego": 0.04051625078374689}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.05767479500213227, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.0367173653144341, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08637983148748224, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.05692771193269011, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.023354753271325843, "sim_compute_performance-ego": 0.03865686020293793, "sim_compute_robot_state-ego": 0.04058615882675369}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06401261261531285, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03719432864870344, "in-drivable-lane": 0, "agent_compute-ego": 0.08771087442125593, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.05498570203781128, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.023481317928859165, "sim_compute_performance-ego": 0.039391900811876567, "sim_compute_robot_state-ego": 0.04084088121141706}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.06086548636941349, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03564663026847091, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08567020472358255, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.05389673102135752, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.02332750021242628, "sim_compute_performance-ego": 0.03909013785567938, "sim_compute_robot_state-ego": 0.04132581692115933}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.0591787232293023, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.035411993662516274, "in-drivable-lane": 0, "agent_compute-ego": 0.0853923515037254, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.05345922929269296, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.022890550118905527, "sim_compute_performance-ego": 0.03824090074609827, "sim_compute_robot_state-ego": 0.0403399908984149}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05713002821978401, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03612395595101749, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0858301321665446, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.05388251472921932, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02306206086102654, "sim_compute_performance-ego": 0.03844993254717659, "sim_compute_robot_state-ego": 0.04062299401152367}}
set_robot_commands_max0.057692580303903354
set_robot_commands_mean0.05518769689261237
set_robot_commands_median0.0550339264529092
set_robot_commands_min0.05345922929269296
sim_compute_performance-ego_max0.039391900811876567
sim_compute_performance-ego_mean0.038844092884111864
sim_compute_performance-ego_median0.03886502265930176
sim_compute_performance-ego_min0.03824090074609827
sim_compute_robot_state-ego_max0.04137445401541794
sim_compute_robot_state-ego_mean0.04071717550167606
sim_compute_robot_state-ego_median0.04064421653747559
sim_compute_robot_state-ego_min0.04029261832143746
sim_compute_sim_state_max0.023932412519293317
sim_compute_sim_state_mean0.023283080691697648
sim_compute_sim_state_median0.023259260824748447
sim_compute_sim_state_min0.022890550118905527
sim_physics_max0.06408195495605469
sim_physics_mean0.05993662171643711
sim_physics_median0.05989903136144711
sim_physics_min0.05630562560898917
sim_render-ego_max0.0379552237595184
sim_render-ego_mean0.0363446992627995
sim_render-ego_median0.03635511831803755
sim_render-ego_min0.035411993662516274
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
240503840kene4192kene-template-randomaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240463846kene4192kene-template-randomaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12900:09:17(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15225677550593508
agent_compute-ego_mean0.14105627559261852
agent_compute-ego_median0.14303297088259742
agent_compute-ego_min0.1305269173213414
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19762217545811137, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06303895877886422, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15225677550593508, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09310173988342284, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03987477399125884, "sim_compute_performance-ego": 0.06963047800184805, "sim_compute_robot_state-ego": 0.07090689864339708, "sim_compute_robot_state-npc0": 0.06940295424642443, "sim_compute_robot_state-npc1": 0.0692497899260702, "sim_compute_robot_state-npc2": 0.06844821760926066, "sim_compute_robot_state-npc3": 0.06731489942043642}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.18520689010620117, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06220605543681553, "in-drivable-lane": 0, "agent_compute-ego": 0.1305269173213414, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08470879282270159, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03708258696964809, "sim_compute_performance-ego": 0.06477619068963188, "sim_compute_robot_state-ego": 0.07441197974341256, "sim_compute_robot_state-npc0": 0.06683300222669329, "sim_compute_robot_state-npc1": 0.06334818261010307, "sim_compute_robot_state-npc2": 0.06345361471176147, "sim_compute_robot_state-npc3": 0.06284972599574498}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18714643219142285, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05948456282754546, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14676795653926517, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08900121346260738, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03761644270813581, "sim_compute_performance-ego": 0.06518250298731536, "sim_compute_robot_state-ego": 0.07082680822576135, "sim_compute_robot_state-npc0": 0.06427738967451077, "sim_compute_robot_state-npc1": 0.06579373878182716, "sim_compute_robot_state-npc2": 0.0678421293647544, "sim_compute_robot_state-npc3": 0.06611233313106796}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.18824073175589243, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05906169613202413, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.13269675771395364, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08286091685295105, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03575885792573293, "sim_compute_performance-ego": 0.0747957577308019, "sim_compute_robot_state-ego": 0.06763852636019389, "sim_compute_robot_state-npc0": 0.061636035641034446, "sim_compute_robot_state-npc1": 0.060223355889320374, "sim_compute_robot_state-npc2": 0.0649541715780894, "sim_compute_robot_state-npc3": 0.06558084487915039}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.19202797753470283, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05321259725661505, "in-drivable-lane": 0, "agent_compute-ego": 0.14303297088259742, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08845733460925874, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.039272149403889976, "sim_compute_performance-ego": 0.06504238219488234, "sim_compute_robot_state-ego": 0.06291411036536806, "sim_compute_robot_state-npc0": 0.06815162159147717, "sim_compute_robot_state-npc1": 0.06517521540323894, "sim_compute_robot_state-npc2": 0.06764262063162667, "sim_compute_robot_state-npc3": 0.06623448644365583}}
set_robot_commands_max0.09310173988342284
set_robot_commands_mean0.08762599952618833
set_robot_commands_median0.08845733460925874
set_robot_commands_min0.08286091685295105
sim_compute_performance-ego_max0.0747957577308019
sim_compute_performance-ego_mean0.0678854623208959
sim_compute_performance-ego_median0.06518250298731536
sim_compute_performance-ego_min0.06477619068963188
sim_compute_robot_state-ego_max0.07441197974341256
sim_compute_robot_state-ego_mean0.06933966466762657
sim_compute_robot_state-ego_median0.07082680822576135
sim_compute_robot_state-ego_min0.06291411036536806
sim_compute_robot_state-npc0_max0.06940295424642443
sim_compute_robot_state-npc0_mean0.06606020067602802
sim_compute_robot_state-npc0_median0.06683300222669329
sim_compute_robot_state-npc0_min0.061636035641034446
sim_compute_robot_state-npc1_max0.0692497899260702
sim_compute_robot_state-npc1_mean0.06475805652211195
sim_compute_robot_state-npc1_median0.06517521540323894
sim_compute_robot_state-npc1_min0.060223355889320374
sim_compute_robot_state-npc2_max0.06844821760926066
sim_compute_robot_state-npc2_mean0.06646815077909853
sim_compute_robot_state-npc2_median0.06764262063162667
sim_compute_robot_state-npc2_min0.06345361471176147
sim_compute_robot_state-npc3_max0.06731489942043642
sim_compute_robot_state-npc3_mean0.06561845797401111
sim_compute_robot_state-npc3_median0.06611233313106796
sim_compute_robot_state-npc3_min0.06284972599574498
sim_compute_sim_state_max0.03987477399125884
sim_compute_sim_state_mean0.037920962199733135
sim_compute_sim_state_median0.03761644270813581
sim_compute_sim_state_min0.03575885792573293
sim_physics_max0.19762217545811137
sim_physics_mean0.19004884140926612
sim_physics_median0.18824073175589243
sim_physics_min0.18520689010620117
sim_render-ego_max0.06303895877886422
sim_render-ego_mean0.05940077408637288
sim_render-ego_median0.05948456282754546
sim_render-ego_min0.05321259725661505
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
240453837kene4192PredictorLastaido2-PREDstep1-simulationsuccessyes12900:00:29(hidden)
error_L10.09492392580310964
error_L20.014957697957094116


240423835ekunniiPredictorLastaido2-PREDstep1-simulationsuccessyes12900:00:28(hidden)
error_L10.1157008368396059
error_L20.021441392589954644


240383831movehoonchallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12900:19:23(hidden)
driven_lanedir_consec_median0.35786221158093356
survival_time_median10.800000000000018
deviation-center-line_median0.1725980454374791
in-drivable-lane_median5.000000000000013


other stats
agent_compute-ego_max0.1762944459915161
agent_compute-ego_mean0.16135973931241918
agent_compute-ego_median0.1575172185897827
agent_compute-ego_min0.15464136362075806
deviation-center-line_max0.9364938179889484
deviation-center-line_mean0.4118788869612856
deviation-center-line_min0.08744248313548349
deviation-heading_max6.0318917484945525
deviation-heading_mean3.478698603966555
deviation-heading_median4.409906515582579
deviation-heading_min0.5562821893998362
driven_any_max1.3586464211760976
driven_any_mean0.7956568709515786
driven_any_median0.9940565666269422
driven_any_min0.13438802308427183
driven_lanedir_consec_max0.4105306724900455
driven_lanedir_consec_mean0.25919767603623295
driven_lanedir_consec_min0.06519042473766756
driven_lanedir_max0.4105306724900455
driven_lanedir_mean0.25919767603623295
driven_lanedir_median0.35786221158093356
driven_lanedir_min0.06519042473766756
in-drivable-lane_max7.500000000000044
in-drivable-lane_mean4.090000000000019
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3586464211760976, "sim_physics": 0.15150328079859415, "survival_time": 14.950000000000076, "driven_lanedir": 0.4105306724900455, "sim_render-ego": 0.05562659740447998, "in-drivable-lane": 7.15000000000004, "agent_compute-ego": 0.15464136362075806, "deviation-heading": 5.827164872408666, "set_robot_commands": 0.0826386562983195, "deviation-center-line": 0.7729577344796874, "driven_lanedir_consec": 0.4105306724900455, "sim_compute_sim_state": 0.03551085392634074, "sim_compute_performance-ego": 0.05914116621017456, "sim_compute_robot_state-ego": 0.06510607560475667, "sim_compute_robot_state-npc0": 0.06199576775232951, "sim_compute_robot_state-npc1": 0.06248692671457926, "sim_compute_robot_state-npc2": 0.060802846749623614, "sim_compute_robot_state-npc3": 0.06105844497680664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3532358766863517, "sim_physics": 0.15480210860570273, "survival_time": 14.950000000000076, "driven_lanedir": 0.3918087388754099, "sim_render-ego": 0.05807198206583659, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.162668772538503, "deviation-heading": 6.0318917484945525, "set_robot_commands": 0.08707692623138427, "deviation-center-line": 0.9364938179889484, "driven_lanedir_consec": 0.3918087388754099, "sim_compute_sim_state": 0.03782718261082967, "sim_compute_performance-ego": 0.06462070862452189, "sim_compute_robot_state-ego": 0.0691019868850708, "sim_compute_robot_state-npc0": 0.06433158159255982, "sim_compute_robot_state-npc1": 0.06282595078150431, "sim_compute_robot_state-npc2": 0.06156563440958659, "sim_compute_robot_state-npc3": 0.06484601100285849}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13795746718422938, "sim_physics": 0.17842224438985188, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07059633249710817, "sim_render-ego": 0.06287392775217691, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1762944459915161, "deviation-heading": 0.5562821893998362, "set_robot_commands": 0.10201715628306073, "deviation-center-line": 0.08990235376482977, "driven_lanedir_consec": 0.07059633249710817, "sim_compute_sim_state": 0.040337777137756346, "sim_compute_performance-ego": 0.06804992357889811, "sim_compute_robot_state-ego": 0.07090872923533122, "sim_compute_robot_state-npc0": 0.07381138801574708, "sim_compute_robot_state-npc1": 0.06838573614756266, "sim_compute_robot_state-npc2": 0.07056996822357178, "sim_compute_robot_state-npc3": 0.1081571102142334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13438802308427183, "sim_physics": 0.16810941696166992, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06519042473766756, "sim_render-ego": 0.05501742362976074, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1575172185897827, "deviation-heading": 0.5682476939471425, "set_robot_commands": 0.08306884765625, "deviation-center-line": 0.08744248313548349, "driven_lanedir_consec": 0.06519042473766756, "sim_compute_sim_state": 0.037286925315856936, "sim_compute_performance-ego": 0.06218255360921224, "sim_compute_robot_state-ego": 0.06949561436971029, "sim_compute_robot_state-npc0": 0.06381951967875163, "sim_compute_robot_state-npc1": 0.0618907372156779, "sim_compute_robot_state-npc2": 0.06388692061106364, "sim_compute_robot_state-npc3": 0.06357952753702799}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9940565666269422, "sim_physics": 0.15636495528397737, "survival_time": 10.800000000000018, "driven_lanedir": 0.35786221158093356, "sim_render-ego": 0.056787844057436344, "in-drivable-lane": 5.000000000000013, "agent_compute-ego": 0.15567689582153602, "deviation-heading": 4.409906515582579, "set_robot_commands": 0.08597295814090306, "deviation-center-line": 0.1725980454374791, "driven_lanedir_consec": 0.35786221158093356, "sim_compute_sim_state": 0.03517134211681507, "sim_compute_performance-ego": 0.06210300547105295, "sim_compute_robot_state-ego": 0.06803852871612266, "sim_compute_robot_state-npc0": 0.06235945335140935, "sim_compute_robot_state-npc1": 0.06326135220351042, "sim_compute_robot_state-npc2": 0.06266436422312702, "sim_compute_robot_state-npc3": 0.062070761565808895}}
set_robot_commands_max0.10201715628306073
set_robot_commands_mean0.08815490892198351
set_robot_commands_median0.08597295814090306
set_robot_commands_min0.0826386562983195
sim_compute_performance-ego_max0.06804992357889811
sim_compute_performance-ego_mean0.06321947149877195
sim_compute_performance-ego_median0.06218255360921224
sim_compute_performance-ego_min0.05914116621017456
sim_compute_robot_state-ego_max0.07090872923533122
sim_compute_robot_state-ego_mean0.06853018696219833
sim_compute_robot_state-ego_median0.0691019868850708
sim_compute_robot_state-ego_min0.06510607560475667
sim_compute_robot_state-npc0_max0.07381138801574708
sim_compute_robot_state-npc0_mean0.06526354207815947
sim_compute_robot_state-npc0_median0.06381951967875163
sim_compute_robot_state-npc0_min0.06199576775232951
sim_compute_robot_state-npc1_max0.06838573614756266
sim_compute_robot_state-npc1_mean0.06377014061256692
sim_compute_robot_state-npc1_median0.06282595078150431
sim_compute_robot_state-npc1_min0.0618907372156779
sim_compute_robot_state-npc2_max0.07056996822357178
sim_compute_robot_state-npc2_mean0.06389794684339453
sim_compute_robot_state-npc2_median0.06266436422312702
sim_compute_robot_state-npc2_min0.060802846749623614
sim_compute_robot_state-npc3_max0.1081571102142334
sim_compute_robot_state-npc3_mean0.07194237105934707
sim_compute_robot_state-npc3_median0.06357952753702799
sim_compute_robot_state-npc3_min0.06105844497680664
sim_compute_sim_state_max0.040337777137756346
sim_compute_sim_state_mean0.03722681622151976
sim_compute_sim_state_median0.037286925315856936
sim_compute_sim_state_min0.03517134211681507
sim_physics_max0.17842224438985188
sim_physics_mean0.1618404012079592
sim_physics_median0.15636495528397737
sim_physics_min0.15150328079859415
sim_render-ego_max0.06287392775217691
sim_render-ego_mean0.05767555498193812
sim_render-ego_median0.056787844057436344
sim_render-ego_min0.05501742362976074
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.740000000000034
survival_time_min1.5000000000000009
240273821Eric LuStudent 0756813aido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240263820Eric LuStudent A043022aido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240243815Philippe LaferrièrePredictorLastaido2-PREDstep1-simulationsuccessyes12900:00:30(hidden)
error_L10.11237899343548824
error_L20.019981468864290263


240203813AmaurXLet's do this one todayaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyes12900:28:06(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1563138484954834
agent_compute-ego_mean0.14224538226374
agent_compute-ego_median0.14316874458676293
agent_compute-ego_min0.11374047824314662
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19785743121859395, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05972365789775607, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1459732417818866, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09405065488211715, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03700873218005216, "sim_compute_performance-ego": 0.06902700134470494, "sim_compute_robot_state-ego": 0.07283587697186047, "sim_compute_robot_state-npc0": 0.06513374666624432, "sim_compute_robot_state-npc1": 0.06566875493979152, "sim_compute_robot_state-npc2": 0.0660276594041269, "sim_compute_robot_state-npc3": 0.06603033029580418}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2204183510371617, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06369439193180629, "in-drivable-lane": 0, "agent_compute-ego": 0.1533781119755336, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09530054671423777, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03836854015077863, "sim_compute_performance-ego": 0.0641306894166129, "sim_compute_robot_state-ego": 0.07295445033482142, "sim_compute_robot_state-npc0": 0.06915511403764997, "sim_compute_robot_state-npc1": 0.06475349834987096, "sim_compute_robot_state-npc2": 0.0654194610459464, "sim_compute_robot_state-npc3": 0.06729290315083095}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18819466146450595, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05909788029865154, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14728875299101896, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08812848572592133, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.037783027852623205, "sim_compute_performance-ego": 0.06466824568591072, "sim_compute_robot_state-ego": 0.07310150664986916, "sim_compute_robot_state-npc0": 0.06780302640303824, "sim_compute_robot_state-npc1": 0.06758026243413537, "sim_compute_robot_state-npc2": 0.06639687528887998, "sim_compute_robot_state-npc3": 0.06516352209072669}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.17660076916217804, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.054342254996299744, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1417760302623113, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08520347376664479, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.033539911111195884, "sim_compute_performance-ego": 0.05998608469963074, "sim_compute_robot_state-ego": 0.07065149148305257, "sim_compute_robot_state-npc0": 0.06458088755607605, "sim_compute_robot_state-npc1": 0.06328063706556956, "sim_compute_robot_state-npc2": 0.060044233997662864, "sim_compute_robot_state-npc3": 0.0594738374153773}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.16089812914530435, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.045429808752877374, "in-drivable-lane": 0, "agent_compute-ego": 0.11374047824314662, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07363063948495048, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.030543520337059385, "sim_compute_performance-ego": 0.05537318048023042, "sim_compute_robot_state-ego": 0.05572102183387393, "sim_compute_robot_state-npc0": 0.06285956927708217, "sim_compute_robot_state-npc1": 0.05834874652680896, "sim_compute_robot_state-npc2": 0.05909637042454311, "sim_compute_robot_state-npc3": 0.055411032267979214}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.17108180280217153, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05619439250694777, "in-drivable-lane": 2, "agent_compute-ego": 0.13783249455297775, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.08656680227039817, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.0375423445673046, "sim_compute_performance-ego": 0.0601132958235141, "sim_compute_robot_state-ego": 0.06520537273612564, "sim_compute_robot_state-npc0": 0.06268375505230384, "sim_compute_robot_state-npc1": 0.061752339323123774, "sim_compute_robot_state-npc2": 0.05969838039603776, "sim_compute_robot_state-npc3": 0.060014931741588846}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.20403395115750508, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05656913646216531, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14411924649210808, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.08860076746894317, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042737481663528, "sim_compute_performance-ego": 0.06489615532958391, "sim_compute_robot_state-ego": 0.06909627590364623, "sim_compute_robot_state-npc0": 0.06552021943249749, "sim_compute_robot_state-npc1": 0.06519616460337223, "sim_compute_robot_state-npc2": 0.06617130122138458, "sim_compute_robot_state-npc3": 0.06645399621389445}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.21505807399749757, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06473001480102539, "in-drivable-lane": 0, "agent_compute-ego": 0.1563138484954834, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.0938023328781128, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03822293758392334, "sim_compute_performance-ego": 0.07534383296966553, "sim_compute_robot_state-ego": 0.07400619983673096, "sim_compute_robot_state-npc0": 0.06648483753204346, "sim_compute_robot_state-npc1": 0.06820342540740967, "sim_compute_robot_state-npc2": 0.06663676738739013, "sim_compute_robot_state-npc3": 0.073778657913208}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1992738155218271, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05938854584327111, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1416816252928514, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09859112592843863, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03698029426427988, "sim_compute_performance-ego": 0.06592382376010601, "sim_compute_robot_state-ego": 0.07648106721731332, "sim_compute_robot_state-npc0": 0.06614183921080369, "sim_compute_robot_state-npc1": 0.06489477249292228, "sim_compute_robot_state-npc2": 0.062474800990178034, "sim_compute_robot_state-npc3": 0.0632331004509559}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.21978918405679557, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.05933631383455717, "in-drivable-lane": 0, "agent_compute-ego": 0.14464750656714806, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.08546737524179313, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0362558181469257, "sim_compute_performance-ego": 0.06528013486128587, "sim_compute_robot_state-ego": 0.06937809173877423, "sim_compute_robot_state-npc0": 0.06469456966106708, "sim_compute_robot_state-npc1": 0.06407546080075778, "sim_compute_robot_state-npc2": 0.06316908506246713, "sim_compute_robot_state-npc3": 0.06239513250497671}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2014577497135509, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.055626966736533424, "in-drivable-lane": 0, "agent_compute-ego": 0.1413579095493663, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.08418777855959805, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04120331460779363, "sim_compute_performance-ego": 0.06291391632773659, "sim_compute_robot_state-ego": 0.07174154845151035, "sim_compute_robot_state-npc0": 0.0672144889831543, "sim_compute_robot_state-npc1": 0.06528068672526967, "sim_compute_robot_state-npc2": 0.06138299811970104, "sim_compute_robot_state-npc3": 0.06736912510611794}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1753295087814331, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05656915664672851, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13584393978118897, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0844034767150879, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03446864128112793, "sim_compute_performance-ego": 0.06371952056884765, "sim_compute_robot_state-ego": 0.06901931285858154, "sim_compute_robot_state-npc0": 0.05993995189666748, "sim_compute_robot_state-npc1": 0.06075715065002441, "sim_compute_robot_state-npc2": 0.059779939651489256, "sim_compute_robot_state-npc3": 0.06265366077423096}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1977610004709122, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.05860028368361453, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.14432274027073638, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.089206226328586, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.036524853807814575, "sim_compute_performance-ego": 0.06681065102840991, "sim_compute_robot_state-ego": 0.07204739337271833, "sim_compute_robot_state-npc0": 0.06345987319946289, "sim_compute_robot_state-npc1": 0.06392853057130854, "sim_compute_robot_state-npc2": 0.06237771916896739, "sim_compute_robot_state-npc3": 0.06197723682890547}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.18177090699856097, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.05955348106530997, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1422360631135794, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.08723753690719604, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03632171795918392, "sim_compute_performance-ego": 0.0671042249752925, "sim_compute_robot_state-ego": 0.06718605756759644, "sim_compute_robot_state-npc0": 0.06817240898425762, "sim_compute_robot_state-npc1": 0.06518360284658578, "sim_compute_robot_state-npc2": 0.06172108191710252, "sim_compute_robot_state-npc3": 0.06568951331652127}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.17610240436735608, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.057875733148484, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.14316874458676293, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08775440851847331, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03567985580081032, "sim_compute_performance-ego": 0.06254329227265858, "sim_compute_robot_state-ego": 0.06802017575218564, "sim_compute_robot_state-npc0": 0.0659514586130778, "sim_compute_robot_state-npc1": 0.06449282737005324, "sim_compute_robot_state-npc2": 0.06393530255272276, "sim_compute_robot_state-npc3": 0.06280323210216704}}
set_robot_commands_max0.09859112592843863
set_robot_commands_mean0.0881421087593666
set_robot_commands_median0.08775440851847331
set_robot_commands_min0.07363063948495048
sim_compute_performance-ego_max0.07534383296966553
sim_compute_performance-ego_mean0.06452226996961268
sim_compute_performance-ego_median0.06466824568591072
sim_compute_performance-ego_min0.05537318048023042
sim_compute_robot_state-ego_max0.07648106721731332
sim_compute_robot_state-ego_mean0.06982972284724401
sim_compute_robot_state-ego_median0.07065149148305257
sim_compute_robot_state-ego_min0.05572102183387393
sim_compute_robot_state-npc0_max0.06915511403764997
sim_compute_robot_state-npc0_mean0.06531971643369511
sim_compute_robot_state-npc0_median0.06552021943249749
sim_compute_robot_state-npc0_min0.05993995189666748
sim_compute_robot_state-npc1_max0.06820342540740967
sim_compute_robot_state-npc1_mean0.06422645734046692
sim_compute_robot_state-npc1_median0.06475349834987096
sim_compute_robot_state-npc1_min0.05834874652680896
sim_compute_robot_state-npc2_max0.06663676738739013
sim_compute_robot_state-npc2_mean0.06295546510857332
sim_compute_robot_state-npc2_median0.062474800990178034
sim_compute_robot_state-npc2_min0.05909637042454311
sim_compute_robot_state-npc3_max0.073778657913208
sim_compute_robot_state-npc3_mean0.06398268081155231
sim_compute_robot_state-npc3_median0.0632331004509559
sim_compute_robot_state-npc3_min0.055411032267979214
sim_compute_sim_state_max0.042737481663528
sim_compute_sim_state_mean0.03687873275429341
sim_compute_sim_state_median0.03698029426427988
sim_compute_sim_state_min0.030543520337059385
sim_physics_max0.2204183510371617
sim_physics_mean0.19237518265969028
sim_physics_median0.1977610004709122
sim_physics_min0.16089812914530435
sim_render-ego_max0.06473001480102539
sim_render-ego_mean0.057782134573735225
sim_render-ego_median0.05860028368361453
sim_render-ego_min0.045429808752877374
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
240133804chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:06:00(hidden)
driven_lanedir_consec_median1.319488299473331
survival_time_median3.649999999999995
deviation-center-line_median0.22383456082410105
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.0965159833431244
agent_compute-ego_mean0.0960786805132249
agent_compute-ego_median0.09619516542513076
agent_compute-ego_min0.09570563832918803
deviation-center-line_max0.5041244339741484
deviation-center-line_mean0.2952751295937134
deviation-center-line_min0.10352795783771118
deviation-heading_max2.119486240215086
deviation-heading_mean1.0826656537238424
deviation-heading_median0.5336681486530255
deviation-heading_min0.4285776638996418
driven_any_max4.027169245536098
driven_any_mean2.3885020521560607
driven_any_median1.6927430020494696
driven_any_min1.1231152018644142
driven_lanedir_consec_max2.451328684317319
driven_lanedir_consec_mean1.583559278758105
driven_lanedir_consec_min0.7089212038122639
driven_lanedir_max2.466751109446747
driven_lanedir_mean1.5866437637839903
driven_lanedir_median1.319488299473331
driven_lanedir_min0.7089212038122639
in-drivable-lane_max3.700000000000012
in-drivable-lane_mean1.7999999999999996
in-drivable-lane_min0.6499999999999986
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1231152018644142, "sim_physics": 0.05530280371507009, "survival_time": 2.3999999999999995, "driven_lanedir": 0.7089212038122639, "sim_render-ego": 0.035934507846832275, "in-drivable-lane": 0.6499999999999986, "agent_compute-ego": 0.0965159833431244, "deviation-heading": 0.5336681486530255, "set_robot_commands": 0.0539746085802714, "deviation-center-line": 0.10352795783771118, "driven_lanedir_consec": 0.7089212038122639, "sim_compute_sim_state": 0.023049533367156982, "sim_compute_performance-ego": 0.03920093675454458, "sim_compute_robot_state-ego": 0.0405824879805247}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.027169245536098, "sim_physics": 0.055218875744922014, "survival_time": 8.84999999999999, "driven_lanedir": 2.193121651141115, "sim_render-ego": 0.035552269994875804, "in-drivable-lane": 3.0999999999999934, "agent_compute-ego": 0.09627002376621052, "deviation-heading": 1.8864126705741, "set_robot_commands": 0.05364074410691773, "deviation-center-line": 0.500596347890897, "driven_lanedir_consec": 2.193121651141115, "sim_compute_sim_state": 0.02309624219344834, "sim_compute_performance-ego": 0.03897279399936482, "sim_compute_robot_state-ego": 0.04064428469555526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.458879329068231, "sim_physics": 0.057197604516539914, "survival_time": 9.900000000000006, "driven_lanedir": 2.466751109446747, "sim_render-ego": 0.03569887141988735, "in-drivable-lane": 3.700000000000012, "agent_compute-ego": 0.09570659170247088, "deviation-heading": 2.119486240215086, "set_robot_commands": 0.05329026597918886, "deviation-center-line": 0.5041244339741484, "driven_lanedir_consec": 2.451328684317319, "sim_compute_sim_state": 0.022997561127248437, "sim_compute_performance-ego": 0.038549193228134, "sim_compute_robot_state-ego": 0.04082696847241334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6406034822620883, "sim_physics": 0.057579922349485634, "survival_time": 3.649999999999995, "driven_lanedir": 1.2449365550464957, "sim_render-ego": 0.03580527762844138, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09619516542513076, "deviation-heading": 0.44518354527735954, "set_robot_commands": 0.05394793209964282, "deviation-center-line": 0.22383456082410105, "driven_lanedir_consec": 1.2449365550464957, "sim_compute_sim_state": 0.02327697244409013, "sim_compute_performance-ego": 0.0387748071592148, "sim_compute_robot_state-ego": 0.04058976369361355}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6927430020494696, "sim_physics": 0.056349873542785645, "survival_time": 3.599999999999995, "driven_lanedir": 1.319488299473331, "sim_render-ego": 0.036262969175974526, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.09570563832918803, "deviation-heading": 0.4285776638996418, "set_robot_commands": 0.054116517305374146, "deviation-center-line": 0.14429234744170946, "driven_lanedir_consec": 1.319488299473331, "sim_compute_sim_state": 0.02328749166594611, "sim_compute_performance-ego": 0.038879311747021146, "sim_compute_robot_state-ego": 0.0408335824807485}}
set_robot_commands_max0.054116517305374146
set_robot_commands_mean0.05379401361427899
set_robot_commands_median0.05394793209964282
set_robot_commands_min0.05329026597918886
sim_compute_performance-ego_max0.03920093675454458
sim_compute_performance-ego_mean0.03887540857765587
sim_compute_performance-ego_median0.038879311747021146
sim_compute_performance-ego_min0.038549193228134
sim_compute_robot_state-ego_max0.0408335824807485
sim_compute_robot_state-ego_mean0.040695417464571074
sim_compute_robot_state-ego_median0.04064428469555526
sim_compute_robot_state-ego_min0.0405824879805247
sim_compute_sim_state_max0.02328749166594611
sim_compute_sim_state_mean0.023141560159578
sim_compute_sim_state_median0.02309624219344834
sim_compute_sim_state_min0.022997561127248437
sim_physics_max0.057579922349485634
sim_physics_mean0.056329815973760654
sim_physics_median0.056349873542785645
sim_physics_min0.055218875744922014
sim_render-ego_max0.036262969175974526
sim_render-ego_mean0.03585077921320227
sim_render-ego_median0.03580527762844138
sim_render-ego_min0.035552269994875804
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean5.679999999999997
survival_time_min2.3999999999999995
240053796chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:03:21(hidden)
driven_lanedir_consec_median0.7232895676919848
survival_time_median2.000000000000001
deviation-center-line_median0.11123144500941264
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.09825950577145531
agent_compute-ego_mean0.09602803819127136
agent_compute-ego_median0.09645414046752147
agent_compute-ego_min0.09380485117435455
deviation-center-line_max0.2274233462652022
deviation-center-line_mean0.13342380717935837
deviation-center-line_min0.07504719484739283
deviation-heading_max0.5818730682625293
deviation-heading_mean0.3292482562980156
deviation-heading_median0.3145505780820485
deviation-heading_min0.1900354247685071
driven_any_max1.6189646584674098
driven_any_mean0.9338254047929304
driven_any_median0.9996632207705848
driven_any_min0.28362940600638153
driven_lanedir_consec_max1.1250809112117863
driven_lanedir_consec_mean0.7405112329435293
driven_lanedir_consec_min0.275488859799796
driven_lanedir_max1.1250809112117863
driven_lanedir_mean0.7405112329435293
driven_lanedir_median0.7232895676919848
driven_lanedir_min0.275488859799796
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.06014494895935059, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.037070071697235106, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.09666680097579956, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.0544408917427063, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.02317131161689758, "sim_compute_performance-ego": 0.03881134390830994, "sim_compute_robot_state-ego": 0.04207938313484192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0311750388448655, "sim_physics": 0.06021393480755034, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8930167529184583, "sim_render-ego": 0.0359574556350708, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09825950577145531, "deviation-heading": 0.5818730682625293, "set_robot_commands": 0.05472036202748617, "deviation-center-line": 0.1646428974937126, "driven_lanedir_consec": 0.8930167529184583, "sim_compute_sim_state": 0.023456136385599773, "sim_compute_performance-ego": 0.03941571144830613, "sim_compute_robot_state-ego": 0.04027116866338821}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.0593084990978241, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.035214170813560486, "in-drivable-lane": 0, "agent_compute-ego": 0.09380485117435455, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.06809341907501221, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.023242443799972538, "sim_compute_performance-ego": 0.03866367042064667, "sim_compute_robot_state-ego": 0.04001890122890472}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7356946998754108, "sim_physics": 0.06152124404907226, "survival_time": 1.7500000000000009, "driven_lanedir": 0.7232895676919848, "sim_render-ego": 0.03640792710440499, "in-drivable-lane": 0, "agent_compute-ego": 0.09495489256722586, "deviation-heading": 0.3676667771044827, "set_robot_commands": 0.05424473626273019, "deviation-center-line": 0.11123144500941264, "driven_lanedir_consec": 0.7232895676919848, "sim_compute_sim_state": 0.023250797816685268, "sim_compute_performance-ego": 0.03877718108040946, "sim_compute_robot_state-ego": 0.0407120909009661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6189646584674098, "sim_physics": 0.054783925032004334, "survival_time": 3.899999999999994, "driven_lanedir": 1.1250809112117863, "sim_render-ego": 0.036098321278889976, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09645414046752147, "deviation-heading": 0.1900354247685071, "set_robot_commands": 0.053956921284015365, "deviation-center-line": 0.2274233462652022, "driven_lanedir_consec": 1.1250809112117863, "sim_compute_sim_state": 0.023311324608631626, "sim_compute_performance-ego": 0.03979088404239752, "sim_compute_robot_state-ego": 0.04060274515396509}}
set_robot_commands_max0.06809341907501221
set_robot_commands_mean0.057091266078390046
set_robot_commands_median0.0544408917427063
set_robot_commands_min0.053956921284015365
sim_compute_performance-ego_max0.03979088404239752
sim_compute_performance-ego_mean0.03909175818001394
sim_compute_performance-ego_median0.03881134390830994
sim_compute_performance-ego_min0.03866367042064667
sim_compute_robot_state-ego_max0.04207938313484192
sim_compute_robot_state-ego_mean0.04073685781641321
sim_compute_robot_state-ego_median0.04060274515396509
sim_compute_robot_state-ego_min0.04001890122890472
sim_compute_sim_state_max0.023456136385599773
sim_compute_sim_state_mean0.02328640284555735
sim_compute_sim_state_median0.023250797816685268
sim_compute_sim_state_min0.02317131161689758
sim_physics_max0.06152124404907226
sim_physics_mean0.05919451038916033
sim_physics_median0.06014494895935059
sim_physics_min0.054783925032004334
sim_render-ego_max0.037070071697235106
sim_render-ego_mean0.03614958930583227
sim_render-ego_median0.036098321278889976
sim_render-ego_min0.035214170813560486
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean2.109999999999999
survival_time_min0.8000000000000002
240043795chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:01:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240023794chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12900:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 73, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     k_r = self.k
               || AttributeError: 'PytorchRLBaseline' object has no attribute 'k'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240013793chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:04:05(hidden)
driven_lanedir_consec_median0.405216831454843
survival_time_median1.5000000000000009
deviation-center-line_median0.07504719483005236
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.09889365037282308
agent_compute-ego_mean0.0958973729744865
agent_compute-ego_median0.09551022201776505
agent_compute-ego_min0.09448498487472534
deviation-center-line_max0.4814966407152546
deviation-center-line_mean0.1476072749309575
deviation-center-line_min0.03346317817245914
deviation-heading_max4.1524288955983195
deviation-heading_mean1.1483549891839573
deviation-heading_median0.4542830623759403
deviation-heading_min0.19211543327251043
driven_any_max2.121664707940838
driven_any_mean0.7250005014907428
driven_any_median0.5312466152394437
driven_any_min0.14671966767306738
driven_lanedir_consec_max1.0971328152564688
driven_lanedir_consec_mean0.45506643909907113
driven_lanedir_consec_min0.041168469500798555
driven_lanedir_max1.0971328152564688
driven_lanedir_mean0.45506643909907113
driven_lanedir_median0.405216831454843
driven_lanedir_min0.041168469500798555
in-drivable-lane_max3.9
in-drivable-lane_mean0.85
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5417421381665942, "sim_physics": 0.0580013910929362, "survival_time": 1.5000000000000009, "driven_lanedir": 0.4563252463585652, "sim_render-ego": 0.03685693740844727, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09889365037282308, "deviation-heading": 0.4542830623759403, "set_robot_commands": 0.05860037008921305, "deviation-center-line": 0.08706745255629056, "driven_lanedir_consec": 0.4563252463585652, "sim_compute_sim_state": 0.02331703503926595, "sim_compute_performance-ego": 0.039561740557352704, "sim_compute_robot_state-ego": 0.040798338254292806}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.121664707940838, "sim_physics": 0.05735039829027535, "survival_time": 10.100000000000009, "driven_lanedir": 1.0971328152564688, "sim_render-ego": 0.03658982314685784, "in-drivable-lane": 3.9, "agent_compute-ego": 0.09488587568301966, "deviation-heading": 4.1524288955983195, "set_robot_commands": 0.05455787701181846, "deviation-center-line": 0.4814966407152546, "driven_lanedir_consec": 1.0971328152564688, "sim_compute_sim_state": 0.023194517239485637, "sim_compute_performance-ego": 0.038909445894826755, "sim_compute_robot_state-ego": 0.0407944115081636}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2836293784337706, "sim_physics": 0.06326423585414886, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27548883292468007, "sim_render-ego": 0.03541463613510132, "in-drivable-lane": 0, "agent_compute-ego": 0.09448498487472534, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.053917139768600464, "deviation-center-line": 0.07504719483005236, "driven_lanedir_consec": 0.27548883292468007, "sim_compute_sim_state": 0.0229949951171875, "sim_compute_performance-ego": 0.038997918367385864, "sim_compute_robot_state-ego": 0.04104362428188324}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5312466152394437, "sim_physics": 0.060377366840839386, "survival_time": 1.6000000000000008, "driven_lanedir": 0.405216831454843, "sim_render-ego": 0.03639849275350571, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09551022201776505, "deviation-heading": 0.44800362931808274, "set_robot_commands": 0.05467734485864639, "deviation-center-line": 0.06096190838073073, "driven_lanedir_consec": 0.405216831454843, "sim_compute_sim_state": 0.023262523114681244, "sim_compute_performance-ego": 0.04491182416677475, "sim_compute_robot_state-ego": 0.04044823348522186}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14671966767306738, "sim_physics": 0.06436340014139812, "survival_time": 0.9000000000000002, "driven_lanedir": 0.041168469500798555, "sim_render-ego": 0.03606779045528836, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0957121319240994, "deviation-heading": 0.49494392535493303, "set_robot_commands": 0.05413919024997287, "deviation-center-line": 0.03346317817245914, "driven_lanedir_consec": 0.041168469500798555, "sim_compute_sim_state": 0.02321030033959283, "sim_compute_performance-ego": 0.03877451684739855, "sim_compute_robot_state-ego": 0.04069530963897705}}
set_robot_commands_max0.05860037008921305
set_robot_commands_mean0.055178384395650246
set_robot_commands_median0.05455787701181846
set_robot_commands_min0.053917139768600464
sim_compute_performance-ego_max0.04491182416677475
sim_compute_performance-ego_mean0.04023108916674773
sim_compute_performance-ego_median0.038997918367385864
sim_compute_performance-ego_min0.03877451684739855
sim_compute_robot_state-ego_max0.04104362428188324
sim_compute_robot_state-ego_mean0.04075598343370771
sim_compute_robot_state-ego_median0.0407944115081636
sim_compute_robot_state-ego_min0.04044823348522186
sim_compute_sim_state_max0.02331703503926595
sim_compute_sim_state_mean0.02319587417004263
sim_compute_sim_state_median0.02321030033959283
sim_compute_sim_state_min0.0229949951171875
sim_physics_max0.06436340014139812
sim_physics_mean0.06067135844391959
sim_physics_median0.060377366840839386
sim_physics_min0.05735039829027535
sim_render-ego_max0.03685693740844727
sim_render-ego_mean0.0362655359798401
sim_render-ego_median0.03639849275350571
sim_render-ego_min0.03541463613510132
simulation-passed1
survival_time_max10.100000000000009
survival_time_mean2.980000000000002
survival_time_min0.8000000000000002
240003792chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:02:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
239993791chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:02:57(hidden)
driven_lanedir_consec_median0.2679222231321656
survival_time_median1.6500000000000008
deviation-center-line_median0.0943858230924602
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10426025390625
agent_compute-ego_mean0.0987961681941887
agent_compute-ego_median0.09716988332343823
agent_compute-ego_min0.09641059239705405
deviation-center-line_max0.11569874380011312
deviation-center-line_mean0.09587568609314276
deviation-center-line_min0.08371873596982482
deviation-heading_max0.7895755749062322
deviation-heading_mean0.6609422960382333
deviation-heading_median0.68115961650565
deviation-heading_min0.49450636808312326
driven_any_max0.3811011302421271
driven_any_mean0.28196229632139297
driven_any_median0.30980836081601304
driven_any_min0.1403954417726464
driven_lanedir_consec_max0.3405801336410198
driven_lanedir_consec_mean0.23751203909611637
driven_lanedir_consec_min0.11135716229552096
driven_lanedir_max0.3405801336410198
driven_lanedir_mean0.23751203909611637
driven_lanedir_median0.2679222231321656
driven_lanedir_min0.11135716229552096
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3388550212196471, "sim_physics": 0.06181313650948661, "survival_time": 1.7500000000000009, "driven_lanedir": 0.287986893676873, "sim_render-ego": 0.035861662455967495, "in-drivable-lane": 0, "agent_compute-ego": 0.09912324632917131, "deviation-heading": 0.7375204051195551, "set_robot_commands": 0.05416088785443987, "deviation-center-line": 0.11569874380011312, "driven_lanedir_consec": 0.287986893676873, "sim_compute_sim_state": 0.022968237740652903, "sim_compute_performance-ego": 0.03911147117614746, "sim_compute_robot_state-ego": 0.04059091976710728}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3811011302421271, "sim_physics": 0.05918384194374084, "survival_time": 2.000000000000001, "driven_lanedir": 0.3405801336410198, "sim_render-ego": 0.035386127233505246, "in-drivable-lane": 0, "agent_compute-ego": 0.0970168650150299, "deviation-heading": 0.68115961650565, "set_robot_commands": 0.05427998900413513, "deviation-center-line": 0.09621492941191535, "driven_lanedir_consec": 0.3405801336410198, "sim_compute_sim_state": 0.023284685611724858, "sim_compute_performance-ego": 0.03908435106277466, "sim_compute_robot_state-ego": 0.03997340202331543}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1403954417726464, "sim_physics": 0.06004089117050171, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11135716229552096, "sim_render-ego": 0.034908521175384524, "in-drivable-lane": 0, "agent_compute-ego": 0.10426025390625, "deviation-heading": 0.49450636808312326, "set_robot_commands": 0.0536878228187561, "deviation-center-line": 0.0943858230924602, "driven_lanedir_consec": 0.11135716229552096, "sim_compute_sim_state": 0.023104560375213624, "sim_compute_performance-ego": 0.0385317325592041, "sim_compute_robot_state-ego": 0.04028111696243286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23965152755653132, "sim_physics": 0.05761112107170953, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1797137827350026, "sim_render-ego": 0.03636690422340676, "in-drivable-lane": 0, "agent_compute-ego": 0.09641059239705405, "deviation-heading": 0.7895755749062322, "set_robot_commands": 0.05878242739924678, "deviation-center-line": 0.08371873596982482, "driven_lanedir_consec": 0.1797137827350026, "sim_compute_sim_state": 0.02313555611504449, "sim_compute_performance-ego": 0.03846492590727629, "sim_compute_robot_state-ego": 0.04032249803896303}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30980836081601304, "sim_physics": 0.06428457751418605, "survival_time": 1.6500000000000008, "driven_lanedir": 0.2679222231321656, "sim_render-ego": 0.03632278153390595, "in-drivable-lane": 0, "agent_compute-ego": 0.09716988332343823, "deviation-heading": 0.6019495155766061, "set_robot_commands": 0.05404311960393733, "deviation-center-line": 0.08936019819140023, "driven_lanedir_consec": 0.2679222231321656, "sim_compute_sim_state": 0.023126175909331352, "sim_compute_performance-ego": 0.03928240140279134, "sim_compute_robot_state-ego": 0.040688160694006714}}
set_robot_commands_max0.05878242739924678
set_robot_commands_mean0.05499084933610304
set_robot_commands_median0.05416088785443987
set_robot_commands_min0.0536878228187561
sim_compute_performance-ego_max0.03928240140279134
sim_compute_performance-ego_mean0.03889497642163877
sim_compute_performance-ego_median0.03908435106277466
sim_compute_performance-ego_min0.03846492590727629
sim_compute_robot_state-ego_max0.040688160694006714
sim_compute_robot_state-ego_mean0.040371219497165066
sim_compute_robot_state-ego_median0.04032249803896303
sim_compute_robot_state-ego_min0.03997340202331543
sim_compute_sim_state_max0.023284685611724858
sim_compute_sim_state_mean0.02312384315039344
sim_compute_sim_state_median0.023126175909331352
sim_compute_sim_state_min0.022968237740652903
sim_physics_max0.06428457751418605
sim_physics_mean0.06058671364192495
sim_physics_median0.06004089117050171
sim_physics_min0.05761112107170953
sim_render-ego_max0.03636690422340676
sim_render-ego_mean0.035769199324433995
sim_render-ego_median0.035861662455967495
sim_render-ego_min0.034908521175384524
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.5500000000000007
survival_time_min1.0000000000000002
239983790chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12900:03:28(hidden)
driven_lanedir_consec_median0.07033725840374228
survival_time_median1.800000000000001
deviation-center-line_median0.04804875518080813
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09760514232847424
agent_compute-ego_mean0.09662577550807776
agent_compute-ego_median0.09662849295373056
agent_compute-ego_min0.09582858472257048
deviation-center-line_max0.11087661991474489
deviation-center-line_mean0.06607935828637886
deviation-center-line_min0.034702296918071716
deviation-heading_max1.9905815563488944
deviation-heading_mean0.9867628655372414
deviation-heading_median0.7435769161601652
deviation-heading_min0.6427615728979265
driven_any_max0.5904190194854401
driven_any_mean0.2507895103672611
driven_any_median0.18540154227334435
driven_any_min0.1020115535648569
driven_lanedir_consec_max0.19107115625219473
driven_lanedir_consec_mean0.09454604553923932
driven_lanedir_consec_min0.06784162189370324
driven_lanedir_max0.19107115625219473
driven_lanedir_mean0.09454604553923932
driven_lanedir_median0.07033725840374228
driven_lanedir_min0.06784162189370324
in-drivable-lane_max2.2999999999999954
in-drivable-lane_mean0.8099999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5904190194854401, "sim_physics": 0.0583351640140309, "survival_time": 5.09999999999999, "driven_lanedir": 0.19107115625219473, "sim_render-ego": 0.03666300867118087, "in-drivable-lane": 2.2999999999999954, "agent_compute-ego": 0.09662849295373056, "deviation-heading": 1.9905815563488944, "set_robot_commands": 0.05466751257578532, "deviation-center-line": 0.11087661991474489, "driven_lanedir_consec": 0.19107115625219473, "sim_compute_sim_state": 0.02336597442626953, "sim_compute_performance-ego": 0.03948041971992044, "sim_compute_robot_state-ego": 0.0409466215208465}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18305606435585867, "sim_physics": 0.056579886256037534, "survival_time": 1.850000000000001, "driven_lanedir": 0.07381003243865136, "sim_render-ego": 0.03492714263297416, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09582858472257048, "deviation-heading": 0.7181203868548293, "set_robot_commands": 0.0538970457540976, "deviation-center-line": 0.034702296918071716, "driven_lanedir_consec": 0.07381003243865136, "sim_compute_sim_state": 0.023085362202412373, "sim_compute_performance-ego": 0.0386302020098712, "sim_compute_robot_state-ego": 0.04059938482336096}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1020115535648569, "sim_physics": 0.05688755852835519, "survival_time": 1.0500000000000005, "driven_lanedir": 0.06967015870790494, "sim_render-ego": 0.035158236821492515, "in-drivable-lane": 0, "agent_compute-ego": 0.0960034075237456, "deviation-heading": 0.6427615728979265, "set_robot_commands": 0.05411069733755929, "deviation-center-line": 0.09470036841017418, "driven_lanedir_consec": 0.06967015870790494, "sim_compute_sim_state": 0.02303227924165271, "sim_compute_performance-ego": 0.038905189150855654, "sim_compute_robot_state-ego": 0.04068296296255929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19305937215680535, "sim_physics": 0.06106236908170912, "survival_time": 1.800000000000001, "driven_lanedir": 0.07033725840374228, "sim_render-ego": 0.03785369131300184, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09706325001186794, "deviation-heading": 0.838773895424391, "set_robot_commands": 0.05454615089628431, "deviation-center-line": 0.04804875518080813, "driven_lanedir_consec": 0.07033725840374228, "sim_compute_sim_state": 0.02291078699959649, "sim_compute_performance-ego": 0.03846840726004706, "sim_compute_robot_state-ego": 0.04083634747399224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18540154227334435, "sim_physics": 0.06345576047897339, "survival_time": 1.800000000000001, "driven_lanedir": 0.06784162189370324, "sim_render-ego": 0.036018298731909856, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09760514232847424, "deviation-heading": 0.7435769161601652, "set_robot_commands": 0.05408503611882528, "deviation-center-line": 0.04206875100809539, "driven_lanedir_consec": 0.06784162189370324, "sim_compute_sim_state": 0.023146629333496097, "sim_compute_performance-ego": 0.03888440794414944, "sim_compute_robot_state-ego": 0.040535185072157115}}
set_robot_commands_max0.05466751257578532
set_robot_commands_mean0.054261288536510355
set_robot_commands_median0.05411069733755929
set_robot_commands_min0.0538970457540976
sim_compute_performance-ego_max0.03948041971992044
sim_compute_performance-ego_mean0.03887372521696876
sim_compute_performance-ego_median0.03888440794414944
sim_compute_performance-ego_min0.03846840726004706
sim_compute_robot_state-ego_max0.0409466215208465
sim_compute_robot_state-ego_mean0.04072010037058322
sim_compute_robot_state-ego_median0.04068296296255929
sim_compute_robot_state-ego_min0.040535185072157115
sim_compute_sim_state_max0.02336597442626953
sim_compute_sim_state_mean0.02310820644068544
sim_compute_sim_state_median0.023085362202412373
sim_compute_sim_state_min0.02291078699959649
sim_physics_max0.06345576047897339
sim_physics_mean0.05926414767182122
sim_physics_median0.0583351640140309
sim_physics_min0.056579886256037534
sim_render-ego_max0.03785369131300184
sim_render-ego_mean0.03612407563411185
sim_render-ego_median0.036018298731909856
sim_render-ego_min0.03492714263297416
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.3199999999999985
survival_time_min1.0500000000000005
239973789chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:02:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
239963787felipecer13challenge-aido_LF-template-randomaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12900:08:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
239823781chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12900:02:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
237153742jp18813100494LF sim test - whaido2-LFV-sim-validationstep1-simulationsuccessyes12900:14:18(hidden)
driven_lanedir_consec_median1.2713083739772268
survival_time_median5.04999999999999
deviation-center-line_median0.31806683794475604
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.12809320992114498
agent_compute-ego_mean0.12706089946052476
agent_compute-ego_median0.12697452306747437
agent_compute-ego_min0.1261438562514934
deviation-center-line_max0.7211916231786494
deviation-center-line_mean0.40134617476411893
deviation-center-line_min0.24061218009407292
deviation-heading_max1.985444502691372
deviation-heading_mean1.1717402545301725
deviation-heading_median1.1890551848742072
deviation-heading_min0.6122663580637252
driven_any_max2.9584410343291796
driven_any_mean1.7571256515469826
driven_any_median1.6063054545284894
driven_any_min1.017458319867132
driven_lanedir_consec_max2.0982209947890547
driven_lanedir_consec_mean1.3456197615935737
driven_lanedir_consec_min0.580820957536107
driven_lanedir_max2.0982209947890547
driven_lanedir_mean1.3457070443631491
driven_lanedir_median1.2713083739772268
driven_lanedir_min0.5812573713839839
in-drivable-lane_max6.399999999999993
in-drivable-lane_mean1.9999999999999964
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.017458319867132, "sim_physics": 0.1137802547582701, "survival_time": 8.949999999999992, "driven_lanedir": 0.5812573713839839, "sim_render-ego": 0.045858404489868845, "in-drivable-lane": 6.399999999999993, "agent_compute-ego": 0.12755458181796794, "deviation-heading": 1.1890551848742072, "set_robot_commands": 0.0723043114113408, "deviation-center-line": 0.24061218009407292, "driven_lanedir_consec": 0.580820957536107, "sim_compute_sim_state": 0.030705479936226788, "sim_compute_performance-ego": 0.05045981513721317, "sim_compute_robot_state-ego": 0.05341458853396624, "sim_compute_robot_state-npc0": 0.053941803937517734, "sim_compute_robot_state-npc1": 0.05333603161007333, "sim_compute_robot_state-npc2": 0.05251708377006999, "sim_compute_robot_state-npc3": 0.05275397194164425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5904643431334025, "sim_physics": 0.13596063321179683, "survival_time": 5.04999999999999, "driven_lanedir": 1.5184432423416716, "sim_render-ego": 0.04774908264084618, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1265383262445431, "deviation-heading": 1.3345399387232824, "set_robot_commands": 0.06983025947419724, "deviation-center-line": 0.4567767219955693, "driven_lanedir_consec": 1.5184432423416716, "sim_compute_sim_state": 0.02997649070059899, "sim_compute_performance-ego": 0.05102222980839191, "sim_compute_robot_state-ego": 0.051745905734524866, "sim_compute_robot_state-npc0": 0.05372370587717189, "sim_compute_robot_state-npc1": 0.051880281750518495, "sim_compute_robot_state-npc2": 0.05296339138899699, "sim_compute_robot_state-npc3": 0.05187496572437853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6129591058767103, "sim_physics": 0.11541854574325236, "survival_time": 4.699999999999991, "driven_lanedir": 1.2713083739772268, "sim_render-ego": 0.04407357155008519, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.1261438562514934, "deviation-heading": 0.7373952882982748, "set_robot_commands": 0.06810627592370865, "deviation-center-line": 0.31806683794475604, "driven_lanedir_consec": 1.2713083739772268, "sim_compute_sim_state": 0.02811949811083205, "sim_compute_performance-ego": 0.047308346058459995, "sim_compute_robot_state-ego": 0.051389782986742384, "sim_compute_robot_state-npc0": 0.05199335737431303, "sim_compute_robot_state-npc1": 0.04970532528897549, "sim_compute_robot_state-npc2": 0.04895916137289494, "sim_compute_robot_state-npc3": 0.04921962352509194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6063054545284894, "sim_physics": 0.12080603539943696, "survival_time": 3.999999999999994, "driven_lanedir": 1.2593052393238082, "sim_render-ego": 0.04765730202198029, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.12697452306747437, "deviation-heading": 0.6122663580637252, "set_robot_commands": 0.06882000863552093, "deviation-center-line": 0.2700835106075473, "driven_lanedir_consec": 1.2593052393238082, "sim_compute_sim_state": 0.03032896816730499, "sim_compute_performance-ego": 0.05233608782291412, "sim_compute_robot_state-ego": 0.052488818764686584, "sim_compute_robot_state-npc0": 0.05349414348602295, "sim_compute_robot_state-npc1": 0.051941245794296265, "sim_compute_robot_state-npc2": 0.05140843093395233, "sim_compute_robot_state-npc3": 0.05299774706363678}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9584410343291796, "sim_physics": 0.11866556078779932, "survival_time": 10.20000000000001, "driven_lanedir": 2.0982209947890547, "sim_render-ego": 0.04629065709955552, "in-drivable-lane": 1.4999999999999956, "agent_compute-ego": 0.12809320992114498, "deviation-heading": 1.985444502691372, "set_robot_commands": 0.07031136283687517, "deviation-center-line": 0.7211916231786494, "driven_lanedir_consec": 2.0982209947890547, "sim_compute_sim_state": 0.029317083312015907, "sim_compute_performance-ego": 0.0507508773429721, "sim_compute_robot_state-ego": 0.051670755825790705, "sim_compute_robot_state-npc0": 0.05242313941319784, "sim_compute_robot_state-npc1": 0.051698477829203886, "sim_compute_robot_state-npc2": 0.0520554780960083, "sim_compute_robot_state-npc3": 0.05169609831828697}}
set_robot_commands_max0.0723043114113408
set_robot_commands_mean0.06987444365632857
set_robot_commands_median0.06983025947419724
set_robot_commands_min0.06810627592370865
sim_compute_performance-ego_max0.05233608782291412
sim_compute_performance-ego_mean0.05037547123399026
sim_compute_performance-ego_median0.0507508773429721
sim_compute_performance-ego_min0.047308346058459995
sim_compute_robot_state-ego_max0.05341458853396624
sim_compute_robot_state-ego_mean0.05214197036914216
sim_compute_robot_state-ego_median0.051745905734524866
sim_compute_robot_state-ego_min0.051389782986742384
sim_compute_robot_state-npc0_max0.053941803937517734
sim_compute_robot_state-npc0_mean0.05311523001764468
sim_compute_robot_state-npc0_median0.05349414348602295
sim_compute_robot_state-npc0_min0.05199335737431303
sim_compute_robot_state-npc1_max0.05333603161007333
sim_compute_robot_state-npc1_mean0.051712272454613496
sim_compute_robot_state-npc1_median0.051880281750518495
sim_compute_robot_state-npc1_min0.04970532528897549
sim_compute_robot_state-npc2_max0.05296339138899699
sim_compute_robot_state-npc2_mean0.05158070911238451
sim_compute_robot_state-npc2_median0.0520554780960083
sim_compute_robot_state-npc2_min0.04895916137289494
sim_compute_robot_state-npc3_max0.05299774706363678
sim_compute_robot_state-npc3_mean0.05170848131460769
sim_compute_robot_state-npc3_median0.05187496572437853
sim_compute_robot_state-npc3_min0.04921962352509194
sim_compute_sim_state_max0.030705479936226788
sim_compute_sim_state_mean0.02968950404539574
sim_compute_sim_state_median0.02997649070059899
sim_compute_sim_state_min0.02811949811083205
sim_physics_max0.13596063321179683
sim_physics_mean0.12092620598011113
sim_physics_median0.11866556078779932
sim_physics_min0.1137802547582701
sim_render-ego_max0.04774908264084618
sim_render-ego_mean0.046325803560467206
sim_render-ego_median0.04629065709955552
sim_render-ego_min0.04407357155008519
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean6.579999999999996
survival_time_min3.999999999999994
236753717jp18813100494Second test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationfailedyes12900:02:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
235913694Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes12900:16:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
234833659ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes12900:16:31(hidden)
driven_lanedir_consec_median0.6642436660663087
survival_time_median14.950000000000076
deviation-center-line_median0.6127901567591342
in-drivable-lane_median0


other stats
agent_compute-ego_max0.3206735249537571
agent_compute-ego_mean0.31700625580100394
agent_compute-ego_median0.31648379961649575
agent_compute-ego_min0.312611513932546
deviation-center-line_max1.3019541099294043
deviation-center-line_mean0.8511498118650721
deviation-center-line_min0.5066981329943391
deviation-heading_max4.055717681436225
deviation-heading_mean2.2639447928188265
deviation-heading_median2.4218493396621237
deviation-heading_min1.055344347110816
driven_any_max0.8769654767822298
driven_any_mean0.6687654736799274
driven_any_median0.8769654767821278
driven_any_min0.2619654676188363
driven_lanedir_consec_max0.8747874033840302
driven_lanedir_consec_mean0.6098641630266942
driven_lanedir_consec_min0.25444128804097765
driven_lanedir_max0.8747874033840302
driven_lanedir_mean0.6098641630266942
driven_lanedir_median0.6642436660663087
driven_lanedir_min0.25444128804097765
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.5800000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8769654767821669, "sim_physics": 0.05316559235254924, "survival_time": 14.950000000000076, "driven_lanedir": 0.6642436660663087, "sim_render-ego": 0.0351360551516215, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.312611513932546, "deviation-heading": 2.6581344254089676, "set_robot_commands": 0.0546033787727356, "deviation-center-line": 0.6127901567591342, "driven_lanedir_consec": 0.6642436660663087, "sim_compute_sim_state": 0.022707699139912923, "sim_compute_performance-ego": 0.0380490779876709, "sim_compute_robot_state-ego": 0.03976110140482585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8769654767822298, "sim_physics": 0.05472138404846191, "survival_time": 14.950000000000076, "driven_lanedir": 0.8261690326522699, "sim_render-ego": 0.03522776206334432, "in-drivable-lane": 0, "agent_compute-ego": 0.31630295832951866, "deviation-heading": 4.055717681436225, "set_robot_commands": 0.05412618080774943, "deviation-center-line": 1.281715573033011, "driven_lanedir_consec": 0.8261690326522699, "sim_compute_sim_state": 0.022726482550303143, "sim_compute_performance-ego": 0.03933650255203247, "sim_compute_robot_state-ego": 0.03994382381439209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2619654676188363, "sim_physics": 0.0522937444930381, "survival_time": 4.699999999999991, "driven_lanedir": 0.25444128804097765, "sim_render-ego": 0.0349651980907359, "in-drivable-lane": 0, "agent_compute-ego": 0.3189594821727022, "deviation-heading": 1.128678170475998, "set_robot_commands": 0.054122940022894674, "deviation-center-line": 0.5066981329943391, "driven_lanedir_consec": 0.25444128804097765, "sim_compute_sim_state": 0.022730644713056847, "sim_compute_performance-ego": 0.03846039416942191, "sim_compute_robot_state-ego": 0.043848676884427985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4509654704342765, "sim_physics": 0.0549343270101365, "survival_time": 7.84999999999998, "driven_lanedir": 0.4296794249898848, "sim_render-ego": 0.03567575497232425, "in-drivable-lane": 0, "agent_compute-ego": 0.3206735249537571, "deviation-heading": 2.4218493396621237, "set_robot_commands": 0.05472214510486384, "deviation-center-line": 0.5525910866094718, "driven_lanedir_consec": 0.4296794249898848, "sim_compute_sim_state": 0.0228283724207787, "sim_compute_performance-ego": 0.03787975554253645, "sim_compute_robot_state-ego": 0.03983632774110053}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8769654767821278, "sim_physics": 0.05427723884582519, "survival_time": 14.950000000000076, "driven_lanedir": 0.8747874033840302, "sim_render-ego": 0.03501849174499512, "in-drivable-lane": 0, "agent_compute-ego": 0.31648379961649575, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.05342774391174317, "deviation-center-line": 1.3019541099294043, "driven_lanedir_consec": 0.8747874033840302, "sim_compute_sim_state": 0.02257968266805013, "sim_compute_performance-ego": 0.03816560904184977, "sim_compute_robot_state-ego": 0.040784647464752195}}
set_robot_commands_max0.05472214510486384
set_robot_commands_mean0.054200477723997345
set_robot_commands_median0.05412618080774943
set_robot_commands_min0.05342774391174317
sim_compute_performance-ego_max0.03933650255203247
sim_compute_performance-ego_mean0.0383782678587023
sim_compute_performance-ego_median0.03816560904184977
sim_compute_performance-ego_min0.03787975554253645
sim_compute_robot_state-ego_max0.043848676884427985
sim_compute_robot_state-ego_mean0.040834915461899726
sim_compute_robot_state-ego_median0.03994382381439209
sim_compute_robot_state-ego_min0.03976110140482585
sim_compute_sim_state_max0.0228283724207787
sim_compute_sim_state_mean0.02271457629842035
sim_compute_sim_state_median0.022726482550303143
sim_compute_sim_state_min0.02257968266805013
sim_physics_max0.0549343270101365
sim_physics_mean0.053878457350002185
sim_physics_median0.05427723884582519
sim_physics_min0.0522937444930381
sim_render-ego_max0.03567575497232425
sim_render-ego_mean0.03520465240460422
sim_render-ego_median0.0351360551516215
sim_render-ego_min0.0349651980907359
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.48000000000004
survival_time_min4.699999999999991
234573648ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes12900:18:02(hidden)
driven_lanedir_consec_median1.4569501890103642
survival_time_median14.950000000000076
deviation-center-line_median1.301168569795478
in-drivable-lane_median1.8000000000000107


other stats
agent_compute-ego_max0.26276496092478435
agent_compute-ego_mean0.23110902166366576
agent_compute-ego_median0.21996260643005372
agent_compute-ego_min0.21616416136423747
deviation-center-line_max1.3125511488831354
deviation-center-line_mean1.1985086282065969
deviation-center-line_min0.8168503090782064
deviation-heading_max9.114488416750689
deviation-heading_mean8.49621536573682
deviation-heading_median8.958328817197787
deviation-heading_min6.498379844353641
driven_any_max4.817677691380996
driven_any_mean4.817677691380984
driven_any_median4.817677691380987
driven_any_min4.817677691380966
driven_lanedir_consec_max1.4959818706634302
driven_lanedir_consec_mean1.447454660198641
driven_lanedir_consec_min1.3598522055779538
driven_lanedir_max3.002156010752614
driven_lanedir_mean2.841506234756632
driven_lanedir_median2.9457788003480623
driven_lanedir_min2.3634970567089493
in-drivable-lane_max4.650000000000027
in-drivable-lane_mean2.380000000000014
in-drivable-lane_min1.7500000000000098
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.817677691380996, "sim_physics": 0.05548554420471191, "survival_time": 14.950000000000076, "driven_lanedir": 2.918088194757594, "sim_render-ego": 0.03555293798446655, "in-drivable-lane": 1.9000000000000103, "agent_compute-ego": 0.21616416136423747, "deviation-heading": 8.958328817197787, "set_robot_commands": 0.055363659063975015, "deviation-center-line": 1.2532391684123592, "driven_lanedir_consec": 1.3598522055779538, "sim_compute_sim_state": 0.02263363202412923, "sim_compute_performance-ego": 0.03818883101145427, "sim_compute_robot_state-ego": 0.03993381579717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.817677691380987, "sim_physics": 0.05394798437754313, "survival_time": 14.950000000000076, "driven_lanedir": 2.9457788003480623, "sim_render-ego": 0.03519783814748128, "in-drivable-lane": 1.8000000000000105, "agent_compute-ego": 0.2190894079208374, "deviation-heading": 9.114488416750689, "set_robot_commands": 0.05487186829249064, "deviation-center-line": 1.301168569795478, "driven_lanedir_consec": 1.46991933974784, "sim_compute_sim_state": 0.022661914030710856, "sim_compute_performance-ego": 0.03837620496749878, "sim_compute_robot_state-ego": 0.04085246483484904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.817677691380966, "sim_physics": 0.05493957201639811, "survival_time": 14.950000000000076, "driven_lanedir": 2.3634970567089493, "sim_render-ego": 0.03505817810694377, "in-drivable-lane": 4.650000000000027, "agent_compute-ego": 0.21996260643005372, "deviation-heading": 6.498379844353641, "set_robot_commands": 0.05521396239598592, "deviation-center-line": 0.8168503090782064, "driven_lanedir_consec": 1.4959818706634302, "sim_compute_sim_state": 0.022768457730611164, "sim_compute_performance-ego": 0.03861080884933472, "sim_compute_robot_state-ego": 0.03966735521952311}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.817677691380982, "sim_physics": 0.05699605305989584, "survival_time": 14.950000000000076, "driven_lanedir": 3.002156010752614, "sim_render-ego": 0.035965359210968016, "in-drivable-lane": 1.7500000000000098, "agent_compute-ego": 0.23756397167841595, "deviation-heading": 8.944077312138214, "set_robot_commands": 0.05598080317179362, "deviation-center-line": 1.3087339448638062, "driven_lanedir_consec": 1.4569501890103642, "sim_compute_sim_state": 0.023410643736521405, "sim_compute_performance-ego": 0.03998084545135498, "sim_compute_robot_state-ego": 0.041617360115051266}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.817677691380995, "sim_physics": 0.06528013785680135, "survival_time": 14.950000000000076, "driven_lanedir": 2.9780111112159418, "sim_render-ego": 0.04436314582824707, "in-drivable-lane": 1.8000000000000107, "agent_compute-ego": 0.26276496092478435, "deviation-heading": 8.965802438243768, "set_robot_commands": 0.07097762028376262, "deviation-center-line": 1.3125511488831354, "driven_lanedir_consec": 1.4545696959936176, "sim_compute_sim_state": 0.02550589164098104, "sim_compute_performance-ego": 0.04383865038553874, "sim_compute_robot_state-ego": 0.0495304807027181}}
set_robot_commands_max0.07097762028376262
set_robot_commands_mean0.05848158264160157
set_robot_commands_median0.055363659063975015
set_robot_commands_min0.05487186829249064
sim_compute_performance-ego_max0.04383865038553874
sim_compute_performance-ego_mean0.0397990681330363
sim_compute_performance-ego_median0.03861080884933472
sim_compute_performance-ego_min0.03818883101145427
sim_compute_robot_state-ego_max0.0495304807027181
sim_compute_robot_state-ego_mean0.0423202953338623
sim_compute_robot_state-ego_median0.04085246483484904
sim_compute_robot_state-ego_min0.03966735521952311
sim_compute_sim_state_max0.02550589164098104
sim_compute_sim_state_mean0.02339610783259074
sim_compute_sim_state_median0.022768457730611164
sim_compute_sim_state_min0.02263363202412923
sim_physics_max0.06528013785680135
sim_physics_mean0.057329858303070066
sim_physics_median0.05548554420471191
sim_physics_min0.05394798437754313
sim_render-ego_max0.04436314582824707
sim_render-ego_mean0.03722749185562134
sim_render-ego_median0.03555293798446655
sim_render-ego_min0.03505817810694377
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
233613612riza.veliogluaido2-LFVI-sim-testingstep1-simulationerroryes12900:06:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233263598Victor Adolfo Romero Canoaido2-LFV-sim-validationstep1-simulationsuccessyes12900:06:01(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.12759084360940115
agent_compute-ego_mean0.11145593134653108
agent_compute-ego_median0.11172129232672195
agent_compute-ego_min0.09938619754932544
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11284206531665944, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0408646442272045, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.09938619754932544, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07345981068081325, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.025333205858866375, "sim_compute_performance-ego": 0.05217196764769377, "sim_compute_robot_state-ego": 0.05326533317565918, "sim_compute_robot_state-npc0": 0.04864901966518826, "sim_compute_robot_state-npc1": 0.045478352793940795, "sim_compute_robot_state-npc2": 0.04670650870711715, "sim_compute_robot_state-npc3": 0.045170364556489165}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.122734317779541, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.050302648544311525, "in-drivable-lane": 0, "agent_compute-ego": 0.11299166679382323, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0751535415649414, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02798310279846191, "sim_compute_performance-ego": 0.05431384086608887, "sim_compute_robot_state-ego": 0.057003202438354494, "sim_compute_robot_state-npc0": 0.05496631622314453, "sim_compute_robot_state-npc1": 0.05842295646667481, "sim_compute_robot_state-npc2": 0.05555746078491211, "sim_compute_robot_state-npc3": 0.0519480037689209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12007968990426314, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.04323607683181763, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1055896564533836, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.0645371675491333, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02730455524043033, "sim_compute_performance-ego": 0.04650271879999261, "sim_compute_robot_state-ego": 0.048784729681516946, "sim_compute_robot_state-npc0": 0.04910896326366224, "sim_compute_robot_state-npc1": 0.04836492475710417, "sim_compute_robot_state-npc2": 0.04923229468496222, "sim_compute_robot_state-npc3": 0.04881271563078228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1262460509433022, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.04079777077783512, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11172129232672195, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.069595581368555, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.026764990408209306, "sim_compute_performance-ego": 0.04545927651320832, "sim_compute_robot_state-ego": 0.04796127729778048, "sim_compute_robot_state-npc0": 0.05043248285221148, "sim_compute_robot_state-npc1": 0.04919333699383313, "sim_compute_robot_state-npc2": 0.047759291491931, "sim_compute_robot_state-npc3": 0.04577439947973324}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12065327167510986, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04872921534946987, "in-drivable-lane": 0, "agent_compute-ego": 0.12759084360940115, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.06985628604888916, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.028628204550061907, "sim_compute_performance-ego": 0.0503378084727696, "sim_compute_robot_state-ego": 0.047922755990709574, "sim_compute_robot_state-npc0": 0.05508664676121303, "sim_compute_robot_state-npc1": 0.05134316001619611, "sim_compute_robot_state-npc2": 0.0480705840247018, "sim_compute_robot_state-npc3": 0.048564297812325616}}
set_robot_commands_max0.0751535415649414
set_robot_commands_mean0.07052047744246642
set_robot_commands_median0.06985628604888916
set_robot_commands_min0.0645371675491333
sim_compute_performance-ego_max0.05431384086608887
sim_compute_performance-ego_mean0.049757122459950634
sim_compute_performance-ego_median0.0503378084727696
sim_compute_performance-ego_min0.04545927651320832
sim_compute_robot_state-ego_max0.057003202438354494
sim_compute_robot_state-ego_mean0.05098745971680414
sim_compute_robot_state-ego_median0.048784729681516946
sim_compute_robot_state-ego_min0.047922755990709574
sim_compute_robot_state-npc0_max0.05508664676121303
sim_compute_robot_state-npc0_mean0.051648685753083914
sim_compute_robot_state-npc0_median0.05043248285221148
sim_compute_robot_state-npc0_min0.04864901966518826
sim_compute_robot_state-npc1_max0.05842295646667481
sim_compute_robot_state-npc1_mean0.05056054620554981
sim_compute_robot_state-npc1_median0.04919333699383313
sim_compute_robot_state-npc1_min0.045478352793940795
sim_compute_robot_state-npc2_max0.05555746078491211
sim_compute_robot_state-npc2_mean0.049465227938724855
sim_compute_robot_state-npc2_median0.0480705840247018
sim_compute_robot_state-npc2_min0.04670650870711715
sim_compute_robot_state-npc3_max0.0519480037689209
sim_compute_robot_state-npc3_mean0.04805395624965024
sim_compute_robot_state-npc3_median0.048564297812325616
sim_compute_robot_state-npc3_min0.045170364556489165
sim_compute_sim_state_max0.028628204550061907
sim_compute_sim_state_mean0.027202811771205964
sim_compute_sim_state_median0.02730455524043033
sim_compute_sim_state_min0.025333205858866375
sim_physics_max0.1262460509433022
sim_physics_mean0.12051107912377512
sim_physics_median0.12065327167510986
sim_physics_min0.11284206531665944
sim_render-ego_max0.050302648544311525
sim_render-ego_mean0.044786071146127725
sim_render-ego_median0.04323607683181763
sim_render-ego_min0.04079777077783512
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
233063584enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes12900:02:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
233033581almasipMy solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes12900:33:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
232852873almasipchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes12900:10:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
231733573Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerroryes12900:01:18
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
231643566Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes12900:02:13
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)