Duckietown Challenges Home Challenges Submissions

Evaluator 1290

ID1290
evaluatorip-172-31-42-167-7194
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success42 23326
# timeout
# failed7 23675
# error48 23164
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242434036Frank (Chude) Qian 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:20:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.1106478486742292
agent_compute-ego_mean0.06199001561805024
agent_compute-ego_median0.06017080200052707
agent_compute-ego_min0.03964016514439737
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.17259249552874498, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.05853160334305024, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.06643809399134676, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.090115208021352, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.03779360274193992, "sim_compute_performance-ego": 0.06516533502390687, "sim_compute_robot_state-ego": 0.0729933456635811, "sim_compute_robot_state-npc0": 0.0653411502569494, "sim_compute_robot_state-npc1": 0.06344999729747504, "sim_compute_robot_state-npc2": 0.06516528801179268, "sim_compute_robot_state-npc3": 0.06726868051878164}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.16017258167266846, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06066032499074936, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07328619807958603, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.095040962100029, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.034773558378219604, "sim_compute_performance-ego": 0.06297294795513153, "sim_compute_robot_state-ego": 0.06697991490364075, "sim_compute_robot_state-npc0": 0.06976090371608734, "sim_compute_robot_state-npc1": 0.0657234862446785, "sim_compute_robot_state-npc2": 0.06480155140161514, "sim_compute_robot_state-npc3": 0.06649348884820938}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.1835190745500418, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.0609819430571336, "in-drivable-lane": 0, "agent_compute-ego": 0.07172694114538339, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.10429075589546792, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04021320893214299, "sim_compute_performance-ego": 0.06898973079828116, "sim_compute_robot_state-ego": 0.07547166255804208, "sim_compute_robot_state-npc0": 0.06829018317736112, "sim_compute_robot_state-npc1": 0.06816641183999869, "sim_compute_robot_state-npc2": 0.06779144360468937, "sim_compute_robot_state-npc3": 0.0693958172431359}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.16135254726615003, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06178282409585932, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06508874636824413, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.08715818005223427, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.03633315076110184, "sim_compute_performance-ego": 0.06808676258210213, "sim_compute_robot_state-ego": 0.06455425549578923, "sim_compute_robot_state-npc0": 0.06318834520155384, "sim_compute_robot_state-npc1": 0.06722157744951146, "sim_compute_robot_state-npc2": 0.06373339570978637, "sim_compute_robot_state-npc3": 0.07009006315662016}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.12163784390404112, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.044799906866891046, "in-drivable-lane": 0, "agent_compute-ego": 0.1106478486742292, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.07247058550516765, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.02805928956894647, "sim_compute_performance-ego": 0.04885026386805943, "sim_compute_robot_state-ego": 0.051695766903105234, "sim_compute_robot_state-npc0": 0.054832106544857935, "sim_compute_robot_state-npc1": 0.05168124607631138, "sim_compute_robot_state-npc2": 0.05025059836251395, "sim_compute_robot_state-npc3": 0.053249200185139976}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.138987288987341, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.04967998670152396, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.05564061669278736, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.07486273434536517, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.03124259326083601, "sim_compute_performance-ego": 0.053905591491825326, "sim_compute_robot_state-ego": 0.05819470035143135, "sim_compute_robot_state-npc0": 0.05927641529682254, "sim_compute_robot_state-npc1": 0.05499991503628818, "sim_compute_robot_state-npc2": 0.0561694015156139, "sim_compute_robot_state-npc3": 0.05508633881561027}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.12302984793980916, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.05268455119360061, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.05568920430682954, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.0704221214566912, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.029528771127973284, "sim_compute_performance-ego": 0.05352189143498739, "sim_compute_robot_state-ego": 0.0563102506455921, "sim_compute_robot_state-npc0": 0.05383979138873872, "sim_compute_robot_state-npc1": 0.05385443142482212, "sim_compute_robot_state-npc2": 0.053318386986142115, "sim_compute_robot_state-npc3": 0.05320980151494344}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.17808949947357178, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06132100079510663, "in-drivable-lane": 0, "agent_compute-ego": 0.0677021226367435, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.0907102597726358, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.039492806872806034, "sim_compute_performance-ego": 0.06738372428997143, "sim_compute_robot_state-ego": 0.06778038192439724, "sim_compute_robot_state-npc0": 0.0661642583640846, "sim_compute_robot_state-npc1": 0.06533390444678229, "sim_compute_robot_state-npc2": 0.06561498706405228, "sim_compute_robot_state-npc3": 0.0675166941977836}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.16842023531595865, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06163349085383945, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.0686925748984019, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.09149235486984252, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.038496805561913386, "sim_compute_performance-ego": 0.06668981909751892, "sim_compute_robot_state-ego": 0.07370191481378344, "sim_compute_robot_state-npc0": 0.0669769545396169, "sim_compute_robot_state-npc1": 0.06594098938835992, "sim_compute_robot_state-npc2": 0.06648754080136617, "sim_compute_robot_state-npc3": 0.07044398453500536}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.1828345383439109, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.05317024872681805, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.06017080200052707, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.08293080775537223, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.033067166248214576, "sim_compute_performance-ego": 0.059099304341824255, "sim_compute_robot_state-ego": 0.06760430558819637, "sim_compute_robot_state-npc0": 0.05991510810139023, "sim_compute_robot_state-npc1": 0.060810525840687975, "sim_compute_robot_state-npc2": 0.07329327592225833, "sim_compute_robot_state-npc3": 0.05997806397553916}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.14316580913684987, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.04231531531722457, "in-drivable-lane": 0, "agent_compute-ego": 0.049337563691315825, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.06619523189685962, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.027584914807920104, "sim_compute_performance-ego": 0.04832983899999548, "sim_compute_robot_state-ego": 0.04793233341640896, "sim_compute_robot_state-npc0": 0.049181620279947914, "sim_compute_robot_state-npc1": 0.04689764976501465, "sim_compute_robot_state-npc2": 0.04940525690714518, "sim_compute_robot_state-npc3": 0.04844313197665744}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.11713428497314451, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.04314267158508301, "in-drivable-lane": 0, "agent_compute-ego": 0.04855221748352051, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.06409713745117188, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.02761631965637207, "sim_compute_performance-ego": 0.04609543800354004, "sim_compute_robot_state-ego": 0.05039950370788574, "sim_compute_robot_state-npc0": 0.05013354301452637, "sim_compute_robot_state-npc1": 0.04754280090332031, "sim_compute_robot_state-npc2": 0.04496476173400879, "sim_compute_robot_state-npc3": 0.04637848854064942}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.11244752721966438, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.0437417930027224, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.057499264771083615, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.0683422493484785, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.02675222450832151, "sim_compute_performance-ego": 0.04806764620654988, "sim_compute_robot_state-ego": 0.05090806169329949, "sim_compute_robot_state-npc0": 0.04873331987632895, "sim_compute_robot_state-npc1": 0.04766923076701614, "sim_compute_robot_state-npc2": 0.048681421099968675, "sim_compute_robot_state-npc3": 0.04728538585159014}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.0996757092014436, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.034979135759415164, "in-drivable-lane": 0, "agent_compute-ego": 0.03964016514439737, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.05395432441465317, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.021746681582543156, "sim_compute_performance-ego": 0.03787852102710355, "sim_compute_robot_state-ego": 0.039934719762494485, "sim_compute_robot_state-npc0": 0.038819297667472594, "sim_compute_robot_state-npc1": 0.03837187828556184, "sim_compute_robot_state-npc2": 0.03855499144523374, "sim_compute_robot_state-npc3": 0.03834801335488596}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.09857805102479224, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.035628804973527495, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.03973787438635733, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.0539704163869222, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.0217433863995122, "sim_compute_performance-ego": 0.03755849482966405, "sim_compute_robot_state-ego": 0.039978284461825504, "sim_compute_robot_state-npc0": 0.03894965788897346, "sim_compute_robot_state-npc1": 0.03825010972864488, "sim_compute_robot_state-npc2": 0.03840976602890912, "sim_compute_robot_state-npc3": 0.03838051534166523}}
set_robot_commands_max0.10429075589546792
set_robot_commands_mean0.07773688861814954
set_robot_commands_median0.07486273434536517
set_robot_commands_min0.05395432441465317
sim_compute_performance-ego_max0.06898973079828116
sim_compute_performance-ego_mean0.05550635399669743
sim_compute_performance-ego_median0.053905591491825326
sim_compute_performance-ego_min0.03755849482966405
sim_compute_robot_state-ego_max0.07547166255804208
sim_compute_robot_state-ego_mean0.05896262679263155
sim_compute_robot_state-ego_median0.05819470035143135
sim_compute_robot_state-ego_min0.039934719762494485
sim_compute_robot_state-npc0_max0.06976090371608734
sim_compute_robot_state-npc0_mean0.05689351035431412
sim_compute_robot_state-npc0_median0.05927641529682254
sim_compute_robot_state-npc0_min0.038819297667472594
sim_compute_robot_state-npc1_max0.06816641183999869
sim_compute_robot_state-npc1_mean0.05572761029963156
sim_compute_robot_state-npc1_median0.05499991503628818
sim_compute_robot_state-npc1_min0.03825010972864488
sim_compute_robot_state-npc2_max0.07329327592225833
sim_compute_robot_state-npc2_mean0.05644280443967305
sim_compute_robot_state-npc2_median0.0561694015156139
sim_compute_robot_state-npc2_min0.03840976602890912
sim_compute_robot_state-npc3_max0.07044398453500536
sim_compute_robot_state-npc3_mean0.05677117787041446
sim_compute_robot_state-npc3_median0.05508633881561027
sim_compute_robot_state-npc3_min0.03834801335488596
sim_compute_sim_state_max0.04021320893214299
sim_compute_sim_state_mean0.03162963202725087
sim_compute_sim_state_median0.03124259326083601
sim_compute_sim_state_min0.0217433863995122
sim_physics_max0.1835190745500418
sim_physics_mean0.1441091556358755
sim_physics_median0.14316580913684987
sim_physics_min0.09857805102479224
sim_render-ego_max0.06178282409585932
sim_render-ego_mean0.05100357341750299
sim_render-ego_median0.05268455119360061
sim_render-ego_min0.034979135759415164
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
No reset possible
242414037Frank (Chude) Qian 🇨🇦challenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:05:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242364041Frank (Chude) Qian 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:03:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242234016Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:43
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242214020Andrew Vennekotter 🇺🇸challenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242174011Kenechukwu Nnodu 🇨🇦CNN-48by96-less-one-50-augaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.NotFoundError: Op type not registered 'ImageProjectiveTransformV2' in binary running on 8c10866f3f0e. Make sure the Op and Kernel are registered in the binary running in this process. Note that if you are loading a saved graph which used ops from tf.contrib, accessing (e.g.) `tf.contrib.resampler` should be done before importing the graph, as contrib ops are lazily registered when the module is first accessed.
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242074001Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242043998Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
242013996Kenechukwu Nnodu 🇨🇦CNN-8logs-48by96-400aido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6399481427290574
survival_time_median9.349999999999998
deviation-center-line_median0.35402262759182024
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.13019435478610242
agent_compute-ego_mean0.1192579602224066
agent_compute-ego_median0.11674047311147054
agent_compute-ego_min0.11470392808557194
deviation-center-line_max1.0345160885300402
deviation-center-line_mean0.4640106368739538
deviation-center-line_min0.1586636763764999
deviation-heading_max1.505810398336881
deviation-heading_mean1.190955735008876
deviation-heading_median1.2142354694852135
deviation-heading_min0.8538877677179595
driven_any_max1.6401669850924
driven_any_mean0.9126841721349968
driven_any_median1.0155776578082527
driven_any_min0.1417057211723953
driven_lanedir_consec_max1.6321719566678614
driven_lanedir_consec_mean0.7472589113977561
driven_lanedir_consec_min0.09901218243235954
driven_lanedir_max1.6321719566678614
driven_lanedir_mean0.7472589113977561
driven_lanedir_median0.6399481427290574
driven_lanedir_min0.09901218243235954
in-drivable-lane_max2.850000000000013
in-drivable-lane_mean1.0900000000000092
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0155776578082527, "sim_physics": 0.05191111819629363, "survival_time": 9.349999999999998, "driven_lanedir": 0.6399481427290574, "sim_render-ego": 0.03433668294692422, "in-drivable-lane": 2.850000000000013, "agent_compute-ego": 0.11470392808557194, "deviation-heading": 1.505810398336881, "set_robot_commands": 0.054493832715692365, "deviation-center-line": 0.35402262759182024, "driven_lanedir_consec": 0.6399481427290574, "sim_compute_sim_state": 0.02234924413303641, "sim_compute_performance-ego": 0.038493616695710046, "sim_compute_robot_state-ego": 0.03964407558747154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6401669850924, "sim_physics": 0.053314332167307535, "survival_time": 14.950000000000076, "driven_lanedir": 1.6321719566678614, "sim_render-ego": 0.03448267857233683, "in-drivable-lane": 0, "agent_compute-ego": 0.11674047311147054, "deviation-heading": 1.2142354694852135, "set_robot_commands": 0.05491943756739299, "deviation-center-line": 1.0345160885300402, "driven_lanedir_consec": 1.6321719566678614, "sim_compute_sim_state": 0.02235020399093628, "sim_compute_performance-ego": 0.03794295072555542, "sim_compute_robot_state-ego": 0.039644447962443034}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1417057211723953, "sim_physics": 0.050949992555560486, "survival_time": 1.6500000000000008, "driven_lanedir": 0.09901218243235954, "sim_render-ego": 0.03391898762096058, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.11667562253547437, "deviation-heading": 0.8538877677179595, "set_robot_commands": 0.05474204005617084, "deviation-center-line": 0.1586636763764999, "driven_lanedir_consec": 0.09901218243235954, "sim_compute_sim_state": 0.022547057180693657, "sim_compute_performance-ego": 0.038310246034102005, "sim_compute_robot_state-ego": 0.03951882593559496}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3417315338089263, "sim_physics": 0.05687798437525014, "survival_time": 3.049999999999997, "driven_lanedir": 0.29712734602503543, "sim_render-ego": 0.03556013498149934, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1179754225934138, "deviation-heading": 1.3257028668709698, "set_robot_commands": 0.05594498212220239, "deviation-center-line": 0.19771137140353784, "driven_lanedir_consec": 0.29712734602503543, "sim_compute_sim_state": 0.02241982397485952, "sim_compute_performance-ego": 0.03788292994264696, "sim_compute_robot_state-ego": 0.03981387419778792}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.42423896279301, "sim_physics": 0.0658003086606488, "survival_time": 11.450000000000028, "driven_lanedir": 1.0680349291344666, "sim_render-ego": 0.03847995491527574, "in-drivable-lane": 2.3500000000000334, "agent_compute-ego": 0.13019435478610242, "deviation-heading": 1.0551421726333554, "set_robot_commands": 0.06044431024243217, "deviation-center-line": 0.5751394204678707, "driven_lanedir_consec": 1.0680349291344666, "sim_compute_sim_state": 0.02486358147000642, "sim_compute_performance-ego": 0.04491177604708609, "sim_compute_robot_state-ego": 0.04569223666295214}}
set_robot_commands_max0.06044431024243217
set_robot_commands_mean0.05610892054077815
set_robot_commands_median0.05491943756739299
set_robot_commands_min0.054493832715692365
sim_compute_performance-ego_max0.04491177604708609
sim_compute_performance-ego_mean0.03950830388902011
sim_compute_performance-ego_median0.038310246034102005
sim_compute_performance-ego_min0.03788292994264696
sim_compute_robot_state-ego_max0.04569223666295214
sim_compute_robot_state-ego_mean0.04086269206924992
sim_compute_robot_state-ego_median0.039644447962443034
sim_compute_robot_state-ego_min0.03951882593559496
sim_compute_sim_state_max0.02486358147000642
sim_compute_sim_state_mean0.022905982149906457
sim_compute_sim_state_median0.02241982397485952
sim_compute_sim_state_min0.02234924413303641
sim_physics_max0.0658003086606488
sim_physics_mean0.05577074719101212
sim_physics_median0.053314332167307535
sim_physics_min0.050949992555560486
sim_render-ego_max0.03847995491527574
sim_render-ego_mean0.03535568780739934
sim_render-ego_median0.03448267857233683
sim_render-ego_min0.03391898762096058
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.090000000000021
survival_time_min1.6500000000000008
No reset possible
241993994Kenechukwu Nnodu 🇨🇦CNN-8logs-48by96-300-sameaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:14:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4701624614616744
survival_time_median6.549999999999985
deviation-center-line_median0.20357126010532092
in-drivable-lane_median1.8499999999999936


other stats
agent_compute-ego_max0.1533180957532111
agent_compute-ego_mean0.1331428120032716
agent_compute-ego_median0.12891998132069907
agent_compute-ego_min0.12626710183480205
deviation-center-line_max0.7158520700937782
deviation-center-line_mean0.2943592652884442
deviation-center-line_min0.14649014039179292
deviation-heading_max1.005528783558309
deviation-heading_mean0.9452385170150384
deviation-heading_median0.9761454575220188
deviation-heading_min0.8133180839381376
driven_any_max2.3261859693197353
driven_any_mean1.059807406848004
driven_any_median0.996771593068209
driven_any_min0.2741742324478404
driven_lanedir_consec_max2.3187173768123417
driven_lanedir_consec_mean0.8072361439573192
driven_lanedir_consec_min0.24906235508417415
driven_lanedir_max2.3187173768123417
driven_lanedir_mean0.8072361439573192
driven_lanedir_median0.4701624614616744
driven_lanedir_min0.24906235508417415
in-drivable-lane_max3.2999999999999883
in-drivable-lane_mean1.409999999999995
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.996771593068209, "sim_physics": 0.11640120644605796, "survival_time": 6.549999999999985, "driven_lanedir": 0.6576195637172955, "sim_render-ego": 0.04527475269696184, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.1533180957532111, "deviation-heading": 1.005528783558309, "set_robot_commands": 0.0679908180964812, "deviation-center-line": 0.24755239189157496, "driven_lanedir_consec": 0.6576195637172955, "sim_compute_sim_state": 0.02779751515570488, "sim_compute_performance-ego": 0.04843374063040464, "sim_compute_robot_state-ego": 0.0531322137090086, "sim_compute_robot_state-npc0": 0.05129479633942815, "sim_compute_robot_state-npc1": 0.04803240572223227, "sim_compute_robot_state-npc2": 0.04815091249596982, "sim_compute_robot_state-npc3": 0.049142593645867504}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3261859693197353, "sim_physics": 0.09325819412867228, "survival_time": 14.950000000000076, "driven_lanedir": 2.3187173768123417, "sim_render-ego": 0.036114441553751625, "in-drivable-lane": 0, "agent_compute-ego": 0.12891998132069907, "deviation-heading": 0.9897356038564686, "set_robot_commands": 0.05661748727162679, "deviation-center-line": 0.7158520700937782, "driven_lanedir_consec": 2.3187173768123417, "sim_compute_sim_state": 0.023498060703277587, "sim_compute_performance-ego": 0.03920413970947265, "sim_compute_robot_state-ego": 0.04119286378224691, "sim_compute_robot_state-npc0": 0.04215293804804484, "sim_compute_robot_state-npc1": 0.04030112504959107, "sim_compute_robot_state-npc2": 0.046082996527353925, "sim_compute_robot_state-npc3": 0.04050636768341064}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.0254190021537897, "sim_physics": 0.08780226111412048, "survival_time": 6.799999999999984, "driven_lanedir": 0.4701624614616744, "sim_render-ego": 0.034740731996648455, "in-drivable-lane": 3.2999999999999883, "agent_compute-ego": 0.12626710183480205, "deviation-heading": 0.9761454575220188, "set_robot_commands": 0.05357179045677185, "deviation-center-line": 0.20357126010532092, "driven_lanedir_consec": 0.4701624614616744, "sim_compute_sim_state": 0.022089213132858276, "sim_compute_performance-ego": 0.03804435274180244, "sim_compute_robot_state-ego": 0.03993514706106747, "sim_compute_robot_state-npc0": 0.042008817195892334, "sim_compute_robot_state-npc1": 0.03871281182064729, "sim_compute_robot_state-npc2": 0.03849005173234379, "sim_compute_robot_state-npc3": 0.038565178127849806}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6764862372504455, "sim_physics": 0.08429893721704898, "survival_time": 4.599999999999992, "driven_lanedir": 0.3406189627111105, "sim_render-ego": 0.03774454541828321, "in-drivable-lane": 1.8999999999999932, "agent_compute-ego": 0.1264181473980779, "deviation-heading": 0.941464656200257, "set_robot_commands": 0.054076150707576584, "deviation-center-line": 0.15833046395975406, "driven_lanedir_consec": 0.3406189627111105, "sim_compute_sim_state": 0.022150664225868557, "sim_compute_performance-ego": 0.03814432413681694, "sim_compute_robot_state-ego": 0.04000568649043208, "sim_compute_robot_state-npc0": 0.0393728432448014, "sim_compute_robot_state-npc1": 0.038594248502150826, "sim_compute_robot_state-npc2": 0.03837904204492983, "sim_compute_robot_state-npc3": 0.038507350113080895}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2741742324478404, "sim_physics": 0.08702605526621748, "survival_time": 2.0500000000000007, "driven_lanedir": 0.24906235508417415, "sim_render-ego": 0.035018420800930115, "in-drivable-lane": 0, "agent_compute-ego": 0.13079073370956792, "deviation-heading": 0.8133180839381376, "set_robot_commands": 0.05398525842806188, "deviation-center-line": 0.14649014039179292, "driven_lanedir_consec": 0.24906235508417415, "sim_compute_sim_state": 0.02209872734255907, "sim_compute_performance-ego": 0.03768099226602694, "sim_compute_robot_state-ego": 0.04002182658125714, "sim_compute_robot_state-npc0": 0.03972292527919862, "sim_compute_robot_state-npc1": 0.039494113224308666, "sim_compute_robot_state-npc2": 0.0385708576295434, "sim_compute_robot_state-npc3": 0.038702394904159915}}
set_robot_commands_max0.0679908180964812
set_robot_commands_mean0.057248300992103665
set_robot_commands_median0.054076150707576584
set_robot_commands_min0.05357179045677185
sim_compute_performance-ego_max0.04843374063040464
sim_compute_performance-ego_mean0.04030150989690473
sim_compute_performance-ego_median0.03814432413681694
sim_compute_performance-ego_min0.03768099226602694
sim_compute_robot_state-ego_max0.0531322137090086
sim_compute_robot_state-ego_mean0.04285754752480243
sim_compute_robot_state-ego_median0.04002182658125714
sim_compute_robot_state-ego_min0.03993514706106747
sim_compute_robot_state-npc0_max0.05129479633942815
sim_compute_robot_state-npc0_mean0.04291046402147307
sim_compute_robot_state-npc0_median0.042008817195892334
sim_compute_robot_state-npc0_min0.0393728432448014
sim_compute_robot_state-npc1_max0.04803240572223227
sim_compute_robot_state-npc1_mean0.04102694086378602
sim_compute_robot_state-npc1_median0.039494113224308666
sim_compute_robot_state-npc1_min0.038594248502150826
sim_compute_robot_state-npc2_max0.04815091249596982
sim_compute_robot_state-npc2_mean0.04193477208602815
sim_compute_robot_state-npc2_median0.0385708576295434
sim_compute_robot_state-npc2_min0.03837904204492983
sim_compute_robot_state-npc3_max0.049142593645867504
sim_compute_robot_state-npc3_mean0.041084776894873755
sim_compute_robot_state-npc3_median0.038702394904159915
sim_compute_robot_state-npc3_min0.038507350113080895
sim_compute_sim_state_max0.02779751515570488
sim_compute_sim_state_mean0.02352683611205367
sim_compute_sim_state_median0.022150664225868557
sim_compute_sim_state_min0.022089213132858276
sim_physics_max0.11640120644605796
sim_physics_mean0.09375733083442345
sim_physics_median0.08780226111412048
sim_physics_min0.08429893721704898
sim_render-ego_max0.04527475269696184
sim_render-ego_mean0.03777857849331505
sim_render-ego_median0.036114441553751625
sim_render-ego_min0.034740731996648455
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.990000000000009
survival_time_min2.0500000000000007
No reset possible
241983993Kenechukwu Nnodu 🇨🇦CNN-8logs-48by96-400aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:16:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0797778945248968
survival_time_median12.900000000000048
deviation-center-line_median0.3842570954855193
in-drivable-lane_median2.4499999999999913


other stats
agent_compute-ego_max0.11988204239058668
agent_compute-ego_mean0.1169678370790958
agent_compute-ego_median0.11633583068847655
agent_compute-ego_min0.11541304200194603
deviation-center-line_max0.6787029710182483
deviation-center-line_mean0.40729548959144096
deviation-center-line_min0.15271113176222087
deviation-heading_max2.4264832769330997
deviation-heading_mean1.3490665976523997
deviation-heading_median1.089159192135702
deviation-heading_min0.7820033819865391
driven_any_max1.6891244416240918
driven_any_mean1.1435936564495726
driven_any_median1.4476487951116503
driven_any_min0.23234149711205265
driven_lanedir_consec_max1.5821753039095463
driven_lanedir_consec_mean0.8948399674891288
driven_lanedir_consec_min0.19408431083084657
driven_lanedir_max1.5821753039095463
driven_lanedir_mean0.8962768003736306
driven_lanedir_median1.0797778945248968
driven_lanedir_min0.19408431083084657
in-drivable-lane_max3.000000000000042
in-drivable-lane_mean1.6100000000000143
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7597586061465279, "sim_physics": 0.09296599617839728, "survival_time": 6.849999999999984, "driven_lanedir": 0.43388314807549033, "sim_render-ego": 0.03524607985559171, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.11988204239058668, "deviation-heading": 0.7820033819865391, "set_robot_commands": 0.05403345692766844, "deviation-center-line": 0.3629902651355248, "driven_lanedir_consec": 0.43388314807549033, "sim_compute_sim_state": 0.022077426423121545, "sim_compute_performance-ego": 0.03806084437961996, "sim_compute_robot_state-ego": 0.040666298274576226, "sim_compute_robot_state-npc0": 0.03957366595303055, "sim_compute_robot_state-npc1": 0.03878218936224053, "sim_compute_robot_state-npc2": 0.03861076640386651, "sim_compute_robot_state-npc3": 0.03871018173050706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5890949422535396, "sim_physics": 0.09566062768300376, "survival_time": 14.950000000000076, "driven_lanedir": 1.5821753039095463, "sim_render-ego": 0.0351123038927714, "in-drivable-lane": 0, "agent_compute-ego": 0.11633583068847655, "deviation-heading": 1.089159192135702, "set_robot_commands": 0.05478250741958618, "deviation-center-line": 0.6787029710182483, "driven_lanedir_consec": 1.5821753039095463, "sim_compute_sim_state": 0.02217648983001709, "sim_compute_performance-ego": 0.038088670571645104, "sim_compute_robot_state-ego": 0.04032665014266968, "sim_compute_robot_state-npc0": 0.03961253643035888, "sim_compute_robot_state-npc1": 0.03894674936930338, "sim_compute_robot_state-npc2": 0.03867206255594889, "sim_compute_robot_state-npc3": 0.03895911773045858}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.4476487951116503, "sim_physics": 0.08533164142638214, "survival_time": 12.900000000000048, "driven_lanedir": 1.0797778945248968, "sim_render-ego": 0.03500465921653333, "in-drivable-lane": 2.550000000000036, "agent_compute-ego": 0.11541304200194603, "deviation-heading": 1.4359495558842914, "set_robot_commands": 0.05455670707909636, "deviation-center-line": 0.4578159845556917, "driven_lanedir_consec": 1.0797778945248968, "sim_compute_sim_state": 0.022193748821583828, "sim_compute_performance-ego": 0.03814644961394081, "sim_compute_robot_state-ego": 0.04019292472868927, "sim_compute_robot_state-npc0": 0.039929747581481934, "sim_compute_robot_state-npc1": 0.03905893388644669, "sim_compute_robot_state-npc2": 0.03885878056518791, "sim_compute_robot_state-npc3": 0.03912343350491782}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6891244416240918, "sim_physics": 0.08436912624803308, "survival_time": 14.600000000000072, "driven_lanedir": 1.191463344527373, "sim_render-ego": 0.03522006779500883, "in-drivable-lane": 3.000000000000042, "agent_compute-ego": 0.117329721581446, "deviation-heading": 2.4264832769330997, "set_robot_commands": 0.05458133432963123, "deviation-center-line": 0.3842570954855193, "driven_lanedir_consec": 1.184279180104864, "sim_compute_sim_state": 0.022130034557760577, "sim_compute_performance-ego": 0.03898329849112524, "sim_compute_robot_state-ego": 0.03996230314855706, "sim_compute_robot_state-npc0": 0.03956834502416114, "sim_compute_robot_state-npc1": 0.03899232573705177, "sim_compute_robot_state-npc2": 0.03861694384927619, "sim_compute_robot_state-npc3": 0.038715384594381674}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23234149711205265, "sim_physics": 0.08520120243693508, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19408431083084657, "sim_render-ego": 0.03487350774365802, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11587854873302372, "deviation-heading": 1.011737581322366, "set_robot_commands": 0.05397318684777548, "deviation-center-line": 0.15271113176222087, "driven_lanedir_consec": 0.19408431083084657, "sim_compute_sim_state": 0.022111099819804348, "sim_compute_performance-ego": 0.0389484915622445, "sim_compute_robot_state-ego": 0.03994293545567712, "sim_compute_robot_state-npc0": 0.03925288555233977, "sim_compute_robot_state-npc1": 0.038765868475270825, "sim_compute_robot_state-npc2": 0.03848664150681606, "sim_compute_robot_state-npc3": 0.038453839546026186}}
set_robot_commands_max0.05478250741958618
set_robot_commands_mean0.05438543852075154
set_robot_commands_median0.05455670707909636
set_robot_commands_min0.05397318684777548
sim_compute_performance-ego_max0.03898329849112524
sim_compute_performance-ego_mean0.03844555092371512
sim_compute_performance-ego_median0.03814644961394081
sim_compute_performance-ego_min0.03806084437961996
sim_compute_robot_state-ego_max0.040666298274576226
sim_compute_robot_state-ego_mean0.040218222350033875
sim_compute_robot_state-ego_median0.04019292472868927
sim_compute_robot_state-ego_min0.03994293545567712
sim_compute_robot_state-npc0_max0.039929747581481934
sim_compute_robot_state-npc0_mean0.03958743610827446
sim_compute_robot_state-npc0_median0.03957366595303055
sim_compute_robot_state-npc0_min0.03925288555233977
sim_compute_robot_state-npc1_max0.03905893388644669
sim_compute_robot_state-npc1_mean0.03890921336606264
sim_compute_robot_state-npc1_median0.03894674936930338
sim_compute_robot_state-npc1_min0.038765868475270825
sim_compute_robot_state-npc2_max0.03885878056518791
sim_compute_robot_state-npc2_mean0.03864903897621911
sim_compute_robot_state-npc2_median0.03861694384927619
sim_compute_robot_state-npc2_min0.03848664150681606
sim_compute_robot_state-npc3_max0.03912343350491782
sim_compute_robot_state-npc3_mean0.03879239142125827
sim_compute_robot_state-npc3_median0.038715384594381674
sim_compute_robot_state-npc3_min0.038453839546026186
sim_compute_sim_state_max0.022193748821583828
sim_compute_sim_state_mean0.02213775989045748
sim_compute_sim_state_median0.022130034557760577
sim_compute_sim_state_min0.022077426423121545
sim_physics_max0.09566062768300376
sim_physics_mean0.08870571879455028
sim_physics_median0.08533164142638214
sim_physics_min0.08436912624803308
sim_render-ego_max0.03524607985559171
sim_render-ego_mean0.03509132370071266
sim_render-ego_median0.0351123038927714
sim_render-ego_min0.03487350774365802
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.290000000000036
survival_time_min2.1500000000000004
No reset possible
241973992Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:22
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241943986Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:11:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241923990Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:06:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.15449255994260236
survival_time_median1.3000000000000005
deviation-center-line_median0.10561981513298954
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16796274807142175
agent_compute-ego_mean0.15997935885296544
agent_compute-ego_median0.1616802657092059
agent_compute-ego_min0.14310016998877892
deviation-center-line_max0.11675665902112815
deviation-center-line_mean0.09549558679718972
deviation-center-line_min0.058425774273412064
deviation-heading_max1.0420469745545748
deviation-heading_mean0.7240817127967657
deviation-heading_median0.693622343480995
deviation-heading_min0.4339030287688481
driven_any_max0.2431421302142493
driven_any_mean0.19339253096026215
driven_any_median0.1862760845307865
driven_any_min0.15991837678076093
driven_lanedir_consec_max0.16574266421346984
driven_lanedir_consec_mean0.14124416145190258
driven_lanedir_consec_min0.11203926886053096
driven_lanedir_max0.16574266421346984
driven_lanedir_mean0.14124416145190258
driven_lanedir_median0.15449255994260236
driven_lanedir_min0.11203926886053096
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2431421302142493, "sim_physics": 0.18689925968647003, "survival_time": 1.6000000000000008, "driven_lanedir": 0.16574266421346984, "sim_render-ego": 0.055416181683540344, "in-drivable-lane": 0, "agent_compute-ego": 0.16559477150440216, "deviation-heading": 0.990785945291892, "set_robot_commands": 0.09229914844036102, "deviation-center-line": 0.10561981513298954, "driven_lanedir_consec": 0.16574266421346984, "sim_compute_sim_state": 0.03606649488210678, "sim_compute_performance-ego": 0.0658918097615242, "sim_compute_robot_state-ego": 0.07124215364456177, "sim_compute_robot_state-npc0": 0.06540650874376297, "sim_compute_robot_state-npc1": 0.06788076460361481, "sim_compute_robot_state-npc2": 0.06604916602373123, "sim_compute_robot_state-npc3": 0.06324329227209091}, "udem1-1-0": {"driven_any": 0.19500115966948645, "sim_physics": 0.2081667670497188, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11203926886053096, "sim_render-ego": 0.05891380486664949, "in-drivable-lane": 0, "agent_compute-ego": 0.1616802657092059, "deviation-heading": 1.0420469745545748, "set_robot_commands": 0.09207014684323912, "deviation-center-line": 0.08990435575280982, "driven_lanedir_consec": 0.11203926886053096, "sim_compute_sim_state": 0.034187378706755464, "sim_compute_performance-ego": 0.06576130125257704, "sim_compute_robot_state-ego": 0.06878305364538122, "sim_compute_robot_state-npc0": 0.06387280534814906, "sim_compute_robot_state-npc1": 0.06198257870144314, "sim_compute_robot_state-npc2": 0.0635301183771204, "sim_compute_robot_state-npc3": 0.06468378172980414}, "udem1-2-0": {"driven_any": 0.1862760845307865, "sim_physics": 0.24117029630220857, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1611671915561601, "sim_render-ego": 0.059647899407606855, "in-drivable-lane": 0, "agent_compute-ego": 0.16155883899101844, "deviation-heading": 0.4339030287688481, "set_robot_commands": 0.08756216672750619, "deviation-center-line": 0.11675665902112815, "driven_lanedir_consec": 0.1611671915561601, "sim_compute_sim_state": 0.03463587394127479, "sim_compute_performance-ego": 0.06339727915250339, "sim_compute_robot_state-ego": 0.07032238520108737, "sim_compute_robot_state-npc0": 0.06334228699023907, "sim_compute_robot_state-npc1": 0.0638739145719088, "sim_compute_robot_state-npc2": 0.06508825375483586, "sim_compute_robot_state-npc3": 0.062004731251643255}, "udem1-3-0": {"driven_any": 0.18262490360602776, "sim_physics": 0.1840254435172448, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15449255994260236, "sim_render-ego": 0.05012242610637958, "in-drivable-lane": 0, "agent_compute-ego": 0.14310016998877892, "deviation-heading": 0.4600502718875181, "set_robot_commands": 0.0854655045729417, "deviation-center-line": 0.10677132980560904, "driven_lanedir_consec": 0.15449255994260236, "sim_compute_sim_state": 0.03145893720480112, "sim_compute_performance-ego": 0.05810995285327618, "sim_compute_robot_state-ego": 0.05822887787452111, "sim_compute_robot_state-npc0": 0.05447201545421894, "sim_compute_robot_state-npc1": 0.05696555284353403, "sim_compute_robot_state-npc2": 0.05426465548001803, "sim_compute_robot_state-npc3": 0.054171277926518366}, "udem1-4-0": {"driven_any": 0.15991837678076093, "sim_physics": 0.20421785893647568, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1127791226867496, "sim_render-ego": 0.06144187761389691, "in-drivable-lane": 0, "agent_compute-ego": 0.16796274807142175, "deviation-heading": 0.693622343480995, "set_robot_commands": 0.10543142194333284, "deviation-center-line": 0.058425774273412064, "driven_lanedir_consec": 0.1127791226867496, "sim_compute_sim_state": 0.042878949123880135, "sim_compute_performance-ego": 0.07077886747277301, "sim_compute_robot_state-ego": 0.06742256620655888, "sim_compute_robot_state-npc0": 0.07146659104720406, "sim_compute_robot_state-npc1": 0.07199581809665846, "sim_compute_robot_state-npc2": 0.07033544001371964, "sim_compute_robot_state-npc3": 0.06716587232506793}}
set_robot_commands_max0.10543142194333284
set_robot_commands_mean0.09256567770547616
set_robot_commands_median0.09207014684323912
set_robot_commands_min0.0854655045729417
sim_compute_performance-ego_max0.07077886747277301
sim_compute_performance-ego_mean0.06478784209853077
sim_compute_performance-ego_median0.06576130125257704
sim_compute_performance-ego_min0.05810995285327618
sim_compute_robot_state-ego_max0.07124215364456177
sim_compute_robot_state-ego_mean0.06719980731442207
sim_compute_robot_state-ego_median0.06878305364538122
sim_compute_robot_state-ego_min0.05822887787452111
sim_compute_robot_state-npc0_max0.07146659104720406
sim_compute_robot_state-npc0_mean0.0637120415167148
sim_compute_robot_state-npc0_median0.06387280534814906
sim_compute_robot_state-npc0_min0.05447201545421894
sim_compute_robot_state-npc1_max0.07199581809665846
sim_compute_robot_state-npc1_mean0.06453972576343184
sim_compute_robot_state-npc1_median0.0638739145719088
sim_compute_robot_state-npc1_min0.05696555284353403
sim_compute_robot_state-npc2_max0.07033544001371964
sim_compute_robot_state-npc2_mean0.06385352672988502
sim_compute_robot_state-npc2_median0.06508825375483586
sim_compute_robot_state-npc2_min0.05426465548001803
sim_compute_robot_state-npc3_max0.06716587232506793
sim_compute_robot_state-npc3_mean0.06225379110102493
sim_compute_robot_state-npc3_median0.06324329227209091
sim_compute_robot_state-npc3_min0.054171277926518366
sim_compute_sim_state_max0.042878949123880135
sim_compute_sim_state_mean0.035845526771763656
sim_compute_sim_state_median0.03463587394127479
sim_compute_sim_state_min0.03145893720480112
sim_physics_max0.24117029630220857
sim_physics_mean0.20489592509842355
sim_physics_median0.20421785893647568
sim_physics_min0.1840254435172448
sim_render-ego_max0.06144187761389691
sim_render-ego_mean0.05710843793561463
sim_render-ego_median0.05891380486664949
sim_render-ego_min0.05012242610637958
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.3400000000000003
survival_time_min1.1500000000000004
No reset possible
241893981Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:04:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.12325038673543531
survival_time_median1.4500000000000006
deviation-center-line_median0.10809078580236922
in-drivable-lane_median0


other stats
agent_compute-ego_max0.09848608641788878
agent_compute-ego_mean0.09644055996434824
agent_compute-ego_median0.09672806813166691
agent_compute-ego_min0.0934866790113778
deviation-center-line_max0.12119265669743222
deviation-center-line_mean0.10107917441905533
deviation-center-line_min0.06851222384495047
deviation-heading_max1.1055973475738787
deviation-heading_mean0.817609683247893
deviation-heading_median0.8179735961129668
deviation-heading_min0.504423240086942
driven_any_max0.2137042049458888
driven_any_mean0.18215728568881756
driven_any_median0.18600783001739896
driven_any_min0.1541362349533087
driven_lanedir_consec_max0.15459340479632822
driven_lanedir_consec_mean0.12592670687079016
driven_lanedir_consec_min0.10885535221418796
driven_lanedir_max0.15459340479632822
driven_lanedir_mean0.12592670687079016
driven_lanedir_median0.12325038673543531
driven_lanedir_min0.10885535221418796
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2137042049458888, "sim_physics": 0.16573666803764575, "survival_time": 1.6500000000000008, "driven_lanedir": 0.12325038673543531, "sim_render-ego": 0.036561070066509826, "in-drivable-lane": 0, "agent_compute-ego": 0.09782335252472849, "deviation-heading": 1.1055973475738787, "set_robot_commands": 0.056170015624075226, "deviation-center-line": 0.10809078580236922, "driven_lanedir_consec": 0.12325038673543531, "sim_compute_sim_state": 0.02275556506532611, "sim_compute_performance-ego": 0.03917457840659402, "sim_compute_robot_state-ego": 0.04199004895759351, "sim_compute_robot_state-npc0": 0.04031693574154016, "sim_compute_robot_state-npc1": 0.03965806238579027, "sim_compute_robot_state-npc2": 0.03975893511916652, "sim_compute_robot_state-npc3": 0.03981246370257753}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19809544474430765, "sim_physics": 0.0926276239855536, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1159500549344763, "sim_render-ego": 0.03476736463349441, "in-drivable-lane": 0, "agent_compute-ego": 0.0934866790113778, "deviation-heading": 1.0938175900130944, "set_robot_commands": 0.05368356047005489, "deviation-center-line": 0.09337801924718142, "driven_lanedir_consec": 0.1159500549344763, "sim_compute_sim_state": 0.022265894659634293, "sim_compute_performance-ego": 0.038370929915329505, "sim_compute_robot_state-ego": 0.04015577250513537, "sim_compute_robot_state-npc0": 0.039713374499616955, "sim_compute_robot_state-npc1": 0.03906851801378974, "sim_compute_robot_state-npc2": 0.03876119646532782, "sim_compute_robot_state-npc3": 0.03895900167267898}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1541362349533087, "sim_physics": 0.1016466709283682, "survival_time": 1.3000000000000005, "driven_lanedir": 0.12698433567352296, "sim_render-ego": 0.035851579446059004, "in-drivable-lane": 0, "agent_compute-ego": 0.09567861373607928, "deviation-heading": 0.504423240086942, "set_robot_commands": 0.054684969095083386, "deviation-center-line": 0.11422218650334327, "driven_lanedir_consec": 0.12698433567352296, "sim_compute_sim_state": 0.022407366679264948, "sim_compute_performance-ego": 0.039636694467984714, "sim_compute_robot_state-ego": 0.040525308022132285, "sim_compute_robot_state-npc0": 0.03993544211754432, "sim_compute_robot_state-npc1": 0.03879069364987887, "sim_compute_robot_state-npc2": 0.03898476637326754, "sim_compute_robot_state-npc3": 0.03891069155472975}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18600783001739896, "sim_physics": 0.10373439459965147, "survival_time": 1.4500000000000006, "driven_lanedir": 0.15459340479632822, "sim_render-ego": 0.0362396815727497, "in-drivable-lane": 0, "agent_compute-ego": 0.09848608641788878, "deviation-heading": 0.5662366424525823, "set_robot_commands": 0.05961529139814706, "deviation-center-line": 0.12119265669743222, "driven_lanedir_consec": 0.15459340479632822, "sim_compute_sim_state": 0.02277911120447619, "sim_compute_performance-ego": 0.03889318170218632, "sim_compute_robot_state-ego": 0.04077461670184958, "sim_compute_robot_state-npc0": 0.040218090188914334, "sim_compute_robot_state-npc1": 0.03948293883225013, "sim_compute_robot_state-npc2": 0.03935973397616682, "sim_compute_robot_state-npc3": 0.03930284237039501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1588427137831836, "sim_physics": 0.0955605598596426, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10885535221418796, "sim_render-ego": 0.0409390926361084, "in-drivable-lane": 0, "agent_compute-ego": 0.09672806813166691, "deviation-heading": 0.8179735961129668, "set_robot_commands": 0.05413778928609995, "deviation-center-line": 0.06851222384495047, "driven_lanedir_consec": 0.10885535221418796, "sim_compute_sim_state": 0.022675844339224007, "sim_compute_performance-ego": 0.038711052674513594, "sim_compute_robot_state-ego": 0.0404438513975877, "sim_compute_robot_state-npc0": 0.04023455656491793, "sim_compute_robot_state-npc1": 0.0395963742182805, "sim_compute_robot_state-npc2": 0.039476477182828464, "sim_compute_robot_state-npc3": 0.03966071972480187}}
set_robot_commands_max0.05961529139814706
set_robot_commands_mean0.0556583251746921
set_robot_commands_median0.054684969095083386
set_robot_commands_min0.05368356047005489
sim_compute_performance-ego_max0.039636694467984714
sim_compute_performance-ego_mean0.03895728743332163
sim_compute_performance-ego_median0.03889318170218632
sim_compute_performance-ego_min0.038370929915329505
sim_compute_robot_state-ego_max0.04199004895759351
sim_compute_robot_state-ego_mean0.0407779195168597
sim_compute_robot_state-ego_median0.040525308022132285
sim_compute_robot_state-ego_min0.04015577250513537
sim_compute_robot_state-npc0_max0.04031693574154016
sim_compute_robot_state-npc0_mean0.04008367982250674
sim_compute_robot_state-npc0_median0.040218090188914334
sim_compute_robot_state-npc0_min0.039713374499616955
sim_compute_robot_state-npc1_max0.03965806238579027
sim_compute_robot_state-npc1_mean0.039319317419997904
sim_compute_robot_state-npc1_median0.03948293883225013
sim_compute_robot_state-npc1_min0.03879069364987887
sim_compute_robot_state-npc2_max0.03975893511916652
sim_compute_robot_state-npc2_mean0.03926822182335143
sim_compute_robot_state-npc2_median0.03935973397616682
sim_compute_robot_state-npc2_min0.03876119646532782
sim_compute_robot_state-npc3_max0.03981246370257753
sim_compute_robot_state-npc3_mean0.039329143805036625
sim_compute_robot_state-npc3_median0.03930284237039501
sim_compute_robot_state-npc3_min0.03891069155472975
sim_compute_sim_state_max0.02277911120447619
sim_compute_sim_state_mean0.02257675638958511
sim_compute_sim_state_median0.022675844339224007
sim_compute_sim_state_min0.022265894659634293
sim_physics_max0.16573666803764575
sim_physics_mean0.11186118348217232
sim_physics_median0.1016466709283682
sim_physics_min0.0926276239855536
sim_render-ego_max0.0409390926361084
sim_render-ego_mean0.036871757670984266
sim_render-ego_median0.0362396815727497
sim_render-ego_min0.03476736463349441
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.4300000000000008
survival_time_min1.3000000000000005
No reset possible
241883980Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241863978Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241853977Kenechukwu Nnodu 🇨🇦CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:02:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 52, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 15, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241843976Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241833975Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:58
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241813973Kenechukwu Nnodu 🇨🇦CNN-More-Less-One-200-1607aido2-LFV-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:02:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 83, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 72, in compute_action
               ||     x: observation
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 929, in run
               ||     run_metadata_ptr)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/client/session.py", line 1128, in _run
               ||     str(subfeed_t.get_shape())))
               || ValueError: Cannot feed value of shape (1, 4608) for Tensor 'prefix/x:0', which has shape '(?, 14400)'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241803972Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:03:29
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241783970Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:32
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241763968Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241743967Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:08:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241683965Junghyun Seo 🇨🇦Baseline solution using reinforcement learningaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:16:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.05319053470519375
survival_time_median1.5000000000000009
deviation-center-line_median0.08872565100894553
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.16517682870229086
agent_compute-ego_mean0.1534850875426983
agent_compute-ego_median0.1578334935506185
agent_compute-ego_min0.14089012145996094
deviation-center-line_max0.6767356052525613
deviation-center-line_mean0.2256396102592435
deviation-center-line_min0.02671726496495251
deviation-heading_max6.132459275055254
deviation-heading_mean2.803276609404043
deviation-heading_median0.7318868542222161
deviation-heading_min0.5568814768626287
driven_any_max1.761531755729803
driven_any_mean0.7539832808561595
driven_any_median0.1397644289602451
driven_any_min0.1030488965565943
driven_lanedir_consec_max0.5771916037737432
driven_lanedir_consec_mean0.2437017811590759
driven_lanedir_consec_min0.037661052742133494
driven_lanedir_max0.5771916037737432
driven_lanedir_mean0.2437017811590759
driven_lanedir_median0.05319053470519375
driven_lanedir_min0.037661052742133494
in-drivable-lane_max7.250000000000033
in-drivable-lane_mean3.0400000000000125
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 1.761531755729803, "sim_physics": 0.19118844509124755, "survival_time": 14.950000000000076, "driven_lanedir": 0.5771916037737432, "sim_render-ego": 0.05989348967870076, "in-drivable-lane": 6.950000000000031, "agent_compute-ego": 0.16247899611790975, "deviation-heading": 6.132459275055254, "set_robot_commands": 0.0916451334953308, "deviation-center-line": 0.2591638512627785, "driven_lanedir_consec": 0.5771916037737432, "sim_compute_sim_state": 0.03826332410176595, "sim_compute_performance-ego": 0.06595141490300496, "sim_compute_robot_state-ego": 0.07078574339548747, "sim_compute_robot_state-npc0": 0.06708263397216797, "sim_compute_robot_state-npc1": 0.06563827117284139, "sim_compute_robot_state-npc2": 0.06480464617411295, "sim_compute_robot_state-npc3": 0.06650219440460205}, "udem1-1-0": {"driven_any": 1.6464161123203065, "sim_physics": 0.18140601634979248, "survival_time": 14.950000000000076, "driven_lanedir": 0.5074466051259168, "sim_render-ego": 0.05641024112701416, "in-drivable-lane": 7.250000000000033, "agent_compute-ego": 0.1578334935506185, "deviation-heading": 6.001645290705572, "set_robot_commands": 0.09003806273142496, "deviation-center-line": 0.6767356052525613, "driven_lanedir_consec": 0.5074466051259168, "sim_compute_sim_state": 0.036508407592773434, "sim_compute_performance-ego": 0.0622144349416097, "sim_compute_robot_state-ego": 0.06654099702835083, "sim_compute_robot_state-npc0": 0.0631827203432719, "sim_compute_robot_state-npc1": 0.0640666643778483, "sim_compute_robot_state-npc2": 0.06248686790466309, "sim_compute_robot_state-npc3": 0.06284919261932373}, "udem1-2-0": {"driven_any": 0.1030488965565943, "sim_physics": 0.24685121575991312, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05319053470519375, "sim_render-ego": 0.06282935539881389, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16517682870229086, "deviation-heading": 0.5935101501745453, "set_robot_commands": 0.09339635570844014, "deviation-center-line": 0.08872565100894553, "driven_lanedir_consec": 0.05319053470519375, "sim_compute_sim_state": 0.03528385361035665, "sim_compute_performance-ego": 0.0668407678604126, "sim_compute_robot_state-ego": 0.06973543763160706, "sim_compute_robot_state-npc0": 0.06757597128550212, "sim_compute_robot_state-npc1": 0.06693775455156963, "sim_compute_robot_state-npc2": 0.06379615267117818, "sim_compute_robot_state-npc3": 0.06575765212376912}, "udem1-3-0": {"driven_any": 0.11915521071384916, "sim_physics": 0.1875779464327056, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04301910944839227, "sim_render-ego": 0.055227608516298494, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1410459978827115, "deviation-heading": 0.5568814768626287, "set_robot_commands": 0.07856731579221528, "deviation-center-line": 0.07685567880697966, "driven_lanedir_consec": 0.04301910944839227, "sim_compute_sim_state": 0.034313456765536605, "sim_compute_performance-ego": 0.05926909939996127, "sim_compute_robot_state-ego": 0.06208648352787413, "sim_compute_robot_state-npc0": 0.058755858191128434, "sim_compute_robot_state-npc1": 0.06014707170683762, "sim_compute_robot_state-npc2": 0.06355708220909381, "sim_compute_robot_state-npc3": 0.06335687637329102}, "udem1-4-0": {"driven_any": 0.1397644289602451, "sim_physics": 0.17609313329060872, "survival_time": 1.5000000000000009, "driven_lanedir": 0.037661052742133494, "sim_render-ego": 0.06062184969584147, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.14089012145996094, "deviation-heading": 0.7318868542222161, "set_robot_commands": 0.07962566216786703, "deviation-center-line": 0.02671726496495251, "driven_lanedir_consec": 0.037661052742133494, "sim_compute_sim_state": 0.032918485005696614, "sim_compute_performance-ego": 0.06371587912241618, "sim_compute_robot_state-ego": 0.06512213548024495, "sim_compute_robot_state-npc0": 0.05817345778147379, "sim_compute_robot_state-npc1": 0.05945538679758708, "sim_compute_robot_state-npc2": 0.05779317220052083, "sim_compute_robot_state-npc3": 0.05534669558207194}}
set_robot_commands_max0.09339635570844014
set_robot_commands_mean0.08665450597905563
set_robot_commands_median0.09003806273142496
set_robot_commands_min0.07856731579221528
sim_compute_performance-ego_max0.0668407678604126
sim_compute_performance-ego_mean0.06359831924548094
sim_compute_performance-ego_median0.06371587912241618
sim_compute_performance-ego_min0.05926909939996127
sim_compute_robot_state-ego_max0.07078574339548747
sim_compute_robot_state-ego_mean0.06685415941271289
sim_compute_robot_state-ego_median0.06654099702835083
sim_compute_robot_state-ego_min0.06208648352787413
sim_compute_robot_state-npc0_max0.06757597128550212
sim_compute_robot_state-npc0_mean0.06295412831470884
sim_compute_robot_state-npc0_median0.0631827203432719
sim_compute_robot_state-npc0_min0.05817345778147379
sim_compute_robot_state-npc1_max0.06693775455156963
sim_compute_robot_state-npc1_mean0.06324902972133681
sim_compute_robot_state-npc1_median0.0640666643778483
sim_compute_robot_state-npc1_min0.05945538679758708
sim_compute_robot_state-npc2_max0.06480464617411295
sim_compute_robot_state-npc2_mean0.062487584231913765
sim_compute_robot_state-npc2_median0.06355708220909381
sim_compute_robot_state-npc2_min0.05779317220052083
sim_compute_robot_state-npc3_max0.06650219440460205
sim_compute_robot_state-npc3_mean0.06276252222061157
sim_compute_robot_state-npc3_median0.06335687637329102
sim_compute_robot_state-npc3_min0.05534669558207194
sim_compute_sim_state_max0.03826332410176595
sim_compute_sim_state_mean0.03545750541522585
sim_compute_sim_state_median0.03528385361035665
sim_compute_sim_state_min0.032918485005696614
sim_physics_max0.24685121575991312
sim_physics_mean0.19662335138485348
sim_physics_median0.1875779464327056
sim_physics_min0.17609313329060872
sim_render-ego_max0.06282935539881389
sim_render-ego_mean0.05899650888333376
sim_render-ego_median0.05989348967870076
sim_render-ego_min0.055227608516298494
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.810000000000031
survival_time_min1.2000000000000004
No reset possible
241673956Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:04
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241653954Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:07:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07861043890431585
survival_time_median1.5000000000000009
deviation-center-line_median0.0925292907717837
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.14184424151544986
agent_compute-ego_mean0.1210292406046666
agent_compute-ego_median0.12969269355138144
agent_compute-ego_min0.09885097194362331
deviation-center-line_max0.3293219766992911
deviation-center-line_mean0.12363359349477844
deviation-center-line_min0.02984642261976296
deviation-heading_max3.1082803521983315
deviation-heading_mean1.1297640045456148
deviation-heading_median0.6935838691470626
deviation-heading_min0.5649381579388664
driven_any_max1.9931312639701548
driven_any_mean0.5236946648765095
driven_any_median0.16023958228601415
driven_any_min0.1147808773372466
driven_lanedir_consec_max0.14056068678419775
driven_lanedir_consec_mean0.08770698417009141
driven_lanedir_consec_min0.04956030453101212
driven_lanedir_max0.14056068678419775
driven_lanedir_mean0.08770698417009141
driven_lanedir_median0.07861043890431585
driven_lanedir_min0.04956030453101212
in-drivable-lane_max12.050000000000075
in-drivable-lane_mean2.6400000000000152
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22079577919878723, "sim_physics": 0.0992474298219423, "survival_time": 1.850000000000001, "driven_lanedir": 0.07861043890431585, "sim_render-ego": 0.03602337837219238, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09885097194362331, "deviation-heading": 0.7079984024804801, "set_robot_commands": 0.05471963495821566, "deviation-center-line": 0.06241721008209275, "driven_lanedir_consec": 0.07861043890431585, "sim_compute_sim_state": 0.022427649111361116, "sim_compute_performance-ego": 0.03833668296401565, "sim_compute_robot_state-ego": 0.04071192483644228, "sim_compute_robot_state-npc0": 0.039733074806831976, "sim_compute_robot_state-npc1": 0.03907843538232752, "sim_compute_robot_state-npc2": 0.03911367622581688, "sim_compute_robot_state-npc3": 0.03896522521972656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.9931312639701548, "sim_physics": 0.09522852420806883, "survival_time": 14.950000000000076, "driven_lanedir": 0.14056068678419775, "sim_render-ego": 0.03862582524617513, "in-drivable-lane": 12.050000000000075, "agent_compute-ego": 0.10473135153452556, "deviation-heading": 3.1082803521983315, "set_robot_commands": 0.05815245548884074, "deviation-center-line": 0.3293219766992911, "driven_lanedir_consec": 0.14056068678419775, "sim_compute_sim_state": 0.024359974066416424, "sim_compute_performance-ego": 0.041845239003499346, "sim_compute_robot_state-ego": 0.04393174727757772, "sim_compute_robot_state-npc0": 0.04330559730529785, "sim_compute_robot_state-npc1": 0.042901959419250485, "sim_compute_robot_state-npc2": 0.04236151615778605, "sim_compute_robot_state-npc3": 0.042786657015482586}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12952582159034473, "sim_physics": 0.1315408448378245, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09187287381280916, "sim_render-ego": 0.04477124412854513, "in-drivable-lane": 0, "agent_compute-ego": 0.12969269355138144, "deviation-heading": 0.5649381579388664, "set_robot_commands": 0.07245855530103047, "deviation-center-line": 0.10405306730096156, "driven_lanedir_consec": 0.09187287381280916, "sim_compute_sim_state": 0.029050131638844807, "sim_compute_performance-ego": 0.04835054278373718, "sim_compute_robot_state-ego": 0.05092929800351461, "sim_compute_robot_state-npc0": 0.05772672096888224, "sim_compute_robot_state-npc1": 0.057859718799591064, "sim_compute_robot_state-npc2": 0.058460732301076256, "sim_compute_robot_state-npc3": 0.0542600949605306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1147808773372466, "sim_physics": 0.14166123970695163, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07793061681812219, "sim_render-ego": 0.04383025998654573, "in-drivable-lane": 0, "agent_compute-ego": 0.14184424151544986, "deviation-heading": 0.5740192409633336, "set_robot_commands": 0.07727030049199643, "deviation-center-line": 0.0925292907717837, "driven_lanedir_consec": 0.07793061681812219, "sim_compute_sim_state": 0.029622865759808083, "sim_compute_performance-ego": 0.04922910358594811, "sim_compute_robot_state-ego": 0.053419455238010574, "sim_compute_robot_state-npc0": 0.05969141877215842, "sim_compute_robot_state-npc1": 0.05396742406098739, "sim_compute_robot_state-npc2": 0.0513574973396633, "sim_compute_robot_state-npc3": 0.051432495531828507}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.16023958228601415, "sim_physics": 0.1231859048207601, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04956030453101212, "sim_render-ego": 0.04751433531443278, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.13002694447835286, "deviation-heading": 0.6935838691470626, "set_robot_commands": 0.07568442821502686, "deviation-center-line": 0.02984642261976296, "driven_lanedir_consec": 0.04956030453101212, "sim_compute_sim_state": 0.03212429682413737, "sim_compute_performance-ego": 0.05176841417948405, "sim_compute_robot_state-ego": 0.054657944043477374, "sim_compute_robot_state-npc0": 0.05627603530883789, "sim_compute_robot_state-npc1": 0.05406216780344645, "sim_compute_robot_state-npc2": 0.05621006488800049, "sim_compute_robot_state-npc3": 0.05656065940856934}}
set_robot_commands_max0.07727030049199643
set_robot_commands_mean0.06765707489102205
set_robot_commands_median0.07245855530103047
set_robot_commands_min0.05471963495821566
sim_compute_performance-ego_max0.05176841417948405
sim_compute_performance-ego_mean0.04590599650333687
sim_compute_performance-ego_median0.04835054278373718
sim_compute_performance-ego_min0.03833668296401565
sim_compute_robot_state-ego_max0.054657944043477374
sim_compute_robot_state-ego_mean0.048730073879804506
sim_compute_robot_state-ego_median0.05092929800351461
sim_compute_robot_state-ego_min0.04071192483644228
sim_compute_robot_state-npc0_max0.05969141877215842
sim_compute_robot_state-npc0_mean0.05134656943240168
sim_compute_robot_state-npc0_median0.05627603530883789
sim_compute_robot_state-npc0_min0.039733074806831976
sim_compute_robot_state-npc1_max0.057859718799591064
sim_compute_robot_state-npc1_mean0.049573941093120584
sim_compute_robot_state-npc1_median0.05396742406098739
sim_compute_robot_state-npc1_min0.03907843538232752
sim_compute_robot_state-npc2_max0.058460732301076256
sim_compute_robot_state-npc2_mean0.049500697382468595
sim_compute_robot_state-npc2_median0.0513574973396633
sim_compute_robot_state-npc2_min0.03911367622581688
sim_compute_robot_state-npc3_max0.05656065940856934
sim_compute_robot_state-npc3_mean0.048801026427227515
sim_compute_robot_state-npc3_median0.051432495531828507
sim_compute_robot_state-npc3_min0.03896522521972656
sim_compute_sim_state_max0.03212429682413737
sim_compute_sim_state_mean0.02751698348011356
sim_compute_sim_state_median0.029050131638844807
sim_compute_sim_state_min0.022427649111361116
sim_physics_max0.14166123970695163
sim_physics_mean0.11817278867910948
sim_physics_median0.1231859048207601
sim_physics_min0.09522852420806883
sim_render-ego_max0.04751433531443278
sim_render-ego_mean0.042153008609578234
sim_render-ego_median0.04383025998654573
sim_render-ego_min0.03602337837219238
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.130000000000015
survival_time_min1.1500000000000004
No reset possible
241643953Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:12:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241633952Kenechukwu Nnodu 🇨🇦ResNet-Combined-500aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4589478924646482
survival_time_median5.549999999999988
deviation-center-line_median0.2732370478243992
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.14823703157821758
agent_compute-ego_mean0.14413362705384553
agent_compute-ego_median0.14294548630714415
agent_compute-ego_min0.14255314338498
deviation-center-line_max0.34410229979389356
deviation-center-line_mean0.25188165950331576
deviation-center-line_min0.15636545654094347
deviation-heading_max1.56768180905471
deviation-heading_mean1.2419051427710806
deviation-heading_median1.2737719576940765
deviation-heading_min0.9227739414581312
driven_any_max1.09838571170569
driven_any_mean0.7838372691157963
driven_any_median0.8057429573770406
driven_any_min0.5609253507783094
driven_lanedir_consec_max0.7750688968866272
driven_lanedir_consec_mean0.447568640354591
driven_lanedir_consec_min0.24750251651826585
driven_lanedir_max0.7750688968866272
driven_lanedir_mean0.4486313519956516
driven_lanedir_median0.4589478924646482
driven_lanedir_min0.24833493117162275
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean1.8099999999999936
in-drivable-lane_min1.399999999999995
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8057429573770406, "sim_physics": 0.09423070555334692, "survival_time": 5.549999999999988, "driven_lanedir": 0.5027220691343182, "sim_render-ego": 0.03626152201815768, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.14410545589687587, "deviation-heading": 1.4204368369060838, "set_robot_commands": 0.05474168975074012, "deviation-center-line": 0.3120199445982953, "driven_lanedir_consec": 0.4982409255823717, "sim_compute_sim_state": 0.02274229505040624, "sim_compute_performance-ego": 0.03866694424603436, "sim_compute_robot_state-ego": 0.04059764501210805, "sim_compute_robot_state-npc0": 0.04011738837302268, "sim_compute_robot_state-npc1": 0.03941205600360492, "sim_compute_robot_state-npc2": 0.03933852642506092, "sim_compute_robot_state-npc3": 0.03944009703558844}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8725044774766706, "sim_physics": 0.09978856643040974, "survival_time": 5.999999999999987, "driven_lanedir": 0.4589478924646482, "sim_render-ego": 0.035581036408742266, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.1428270181020101, "deviation-heading": 0.9227739414581312, "set_robot_commands": 0.05576436320940654, "deviation-center-line": 0.2732370478243992, "driven_lanedir_consec": 0.4589478924646482, "sim_compute_sim_state": 0.02229543129603068, "sim_compute_performance-ego": 0.03814337849617004, "sim_compute_robot_state-ego": 0.04043074250221253, "sim_compute_robot_state-npc0": 0.040201954046885174, "sim_compute_robot_state-npc1": 0.03914828896522522, "sim_compute_robot_state-npc2": 0.03900692860285441, "sim_compute_robot_state-npc3": 0.03917133212089539}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5609253507783094, "sim_physics": 0.08666641116142274, "survival_time": 3.999999999999994, "driven_lanedir": 0.24833493117162275, "sim_render-ego": 0.034605520963668826, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.14294548630714415, "deviation-heading": 1.2737719576940765, "set_robot_commands": 0.05412046015262604, "deviation-center-line": 0.17368354875904737, "driven_lanedir_consec": 0.24750251651826585, "sim_compute_sim_state": 0.030200654268264772, "sim_compute_performance-ego": 0.03790692687034607, "sim_compute_robot_state-ego": 0.04004885256290436, "sim_compute_robot_state-npc0": 0.03980890810489655, "sim_compute_robot_state-npc1": 0.038994011282920835, "sim_compute_robot_state-npc2": 0.038772988319396975, "sim_compute_robot_state-npc3": 0.03890398442745209}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5816278482412709, "sim_physics": 0.08993402923025735, "survival_time": 4.099999999999993, "driven_lanedir": 0.25808297032104166, "sim_render-ego": 0.034812819666978786, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14255314338498, "deviation-heading": 1.024861168742401, "set_robot_commands": 0.05434452615133146, "deviation-center-line": 0.15636545654094347, "driven_lanedir_consec": 0.25808297032104166, "sim_compute_sim_state": 0.022277715729504096, "sim_compute_performance-ego": 0.038084768667453674, "sim_compute_robot_state-ego": 0.04278869745207996, "sim_compute_robot_state-npc0": 0.04042588792196134, "sim_compute_robot_state-npc1": 0.039004378202484875, "sim_compute_robot_state-npc2": 0.03912252623860429, "sim_compute_robot_state-npc3": 0.03890767039322272}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.09838571170569, "sim_physics": 0.08566444032144227, "survival_time": 7.449999999999981, "driven_lanedir": 0.7750688968866272, "sim_render-ego": 0.03582686545864848, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.14823703157821758, "deviation-heading": 1.56768180905471, "set_robot_commands": 0.05454113179405264, "deviation-center-line": 0.34410229979389356, "driven_lanedir_consec": 0.7750688968866272, "sim_compute_sim_state": 0.02372955155852657, "sim_compute_performance-ego": 0.038512735558836254, "sim_compute_robot_state-ego": 0.040792220390883066, "sim_compute_robot_state-npc0": 0.040215717866116725, "sim_compute_robot_state-npc1": 0.03955236857369442, "sim_compute_robot_state-npc2": 0.03937416428687589, "sim_compute_robot_state-npc3": 0.03942624354522501}}
set_robot_commands_max0.05576436320940654
set_robot_commands_mean0.05470243421163136
set_robot_commands_median0.05454113179405264
set_robot_commands_min0.05412046015262604
sim_compute_performance-ego_max0.03866694424603436
sim_compute_performance-ego_mean0.038262950767768075
sim_compute_performance-ego_median0.03814337849617004
sim_compute_performance-ego_min0.03790692687034607
sim_compute_robot_state-ego_max0.04278869745207996
sim_compute_robot_state-ego_mean0.04093163158403759
sim_compute_robot_state-ego_median0.04059764501210805
sim_compute_robot_state-ego_min0.04004885256290436
sim_compute_robot_state-npc0_max0.04042588792196134
sim_compute_robot_state-npc0_mean0.040153971262576485
sim_compute_robot_state-npc0_median0.040201954046885174
sim_compute_robot_state-npc0_min0.03980890810489655
sim_compute_robot_state-npc1_max0.03955236857369442
sim_compute_robot_state-npc1_mean0.039222220605586056
sim_compute_robot_state-npc1_median0.03914828896522522
sim_compute_robot_state-npc1_min0.038994011282920835
sim_compute_robot_state-npc2_max0.03937416428687589
sim_compute_robot_state-npc2_mean0.0391230267745585
sim_compute_robot_state-npc2_median0.03912252623860429
sim_compute_robot_state-npc2_min0.038772988319396975
sim_compute_robot_state-npc3_max0.03944009703558844
sim_compute_robot_state-npc3_mean0.03916986550447673
sim_compute_robot_state-npc3_median0.03917133212089539
sim_compute_robot_state-npc3_min0.03890398442745209
sim_compute_sim_state_max0.030200654268264772
sim_compute_sim_state_mean0.024249129580546473
sim_compute_sim_state_median0.02274229505040624
sim_compute_sim_state_min0.022277715729504096
sim_physics_max0.09978856643040974
sim_physics_mean0.0912568305393758
sim_physics_median0.08993402923025735
sim_physics_min0.08566444032144227
sim_render-ego_max0.03626152201815768
sim_render-ego_mean0.03541755290323921
sim_render-ego_median0.035581036408742266
sim_render-ego_min0.034605520963668826
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean5.419999999999989
survival_time_min3.999999999999994
No reset possible
241623951Kenechukwu Nnodu 🇨🇦ResNet-Combined-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:12:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.29508753702959556
survival_time_median5.749999999999988
deviation-center-line_median0.2059687425493089
in-drivable-lane_median2.5999999999999908


other stats
agent_compute-ego_max0.1925699517533586
agent_compute-ego_mean0.1817838355169224
agent_compute-ego_median0.18084408584253747
agent_compute-ego_min0.172406538327535
deviation-center-line_max0.43296025976298386
deviation-center-line_mean0.23348413724631295
deviation-center-line_min0.11419995840473224
deviation-heading_max1.391041140942218
deviation-heading_mean1.113795520692506
deviation-heading_median1.2022172017580914
deviation-heading_min0.6980494855980874
driven_any_max1.1010553022789005
driven_any_mean0.6832727007486209
driven_any_median0.6691345653210314
driven_any_min0.21149230325216872
driven_lanedir_consec_max0.5757554391847877
driven_lanedir_consec_mean0.330507412007999
driven_lanedir_consec_min0.1715530912881481
driven_lanedir_max0.5757554391847877
driven_lanedir_mean0.330507412007999
driven_lanedir_median0.29508753702959556
driven_lanedir_min0.1715530912881481
in-drivable-lane_max5.849999999999995
in-drivable-lane_mean2.519999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1010553022789005, "sim_physics": 0.11541490798646752, "survival_time": 8.79999999999999, "driven_lanedir": 0.5757554391847877, "sim_render-ego": 0.04397284984588623, "in-drivable-lane": 4.099999999999999, "agent_compute-ego": 0.17808677527037534, "deviation-heading": 0.6980494855980874, "set_robot_commands": 0.06855979426340623, "deviation-center-line": 0.43296025976298386, "driven_lanedir_consec": 0.5757554391847877, "sim_compute_sim_state": 0.028655501929196445, "sim_compute_performance-ego": 0.049017346718094566, "sim_compute_robot_state-ego": 0.05063325302167372, "sim_compute_robot_state-npc0": 0.05236324126070196, "sim_compute_robot_state-npc1": 0.05470769242806868, "sim_compute_robot_state-npc2": 0.05064139853824269, "sim_compute_robot_state-npc3": 0.05017097836191004}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3475890288176715, "sim_physics": 0.12257886330286662, "survival_time": 2.9999999999999973, "driven_lanedir": 0.29356588765843483, "sim_render-ego": 0.043844350179036456, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.172406538327535, "deviation-heading": 1.391041140942218, "set_robot_commands": 0.06911156177520753, "deviation-center-line": 0.19142854425691477, "driven_lanedir_consec": 0.29356588765843483, "sim_compute_sim_state": 0.028947106997172036, "sim_compute_performance-ego": 0.0502185583114624, "sim_compute_robot_state-ego": 0.05318384567896525, "sim_compute_robot_state-npc0": 0.050666956106821696, "sim_compute_robot_state-npc1": 0.0501931627591451, "sim_compute_robot_state-npc2": 0.04945802688598633, "sim_compute_robot_state-npc3": 0.04940900007883708}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6691345653210314, "sim_physics": 0.11006838757058848, "survival_time": 5.749999999999988, "driven_lanedir": 0.29508753702959556, "sim_render-ego": 0.04629520333331564, "in-drivable-lane": 2.5999999999999908, "agent_compute-ego": 0.18501182639080543, "deviation-heading": 1.3184311569069338, "set_robot_commands": 0.07620573043823242, "deviation-center-line": 0.2059687425493089, "driven_lanedir_consec": 0.29508753702959556, "sim_compute_sim_state": 0.029212522506713863, "sim_compute_performance-ego": 0.050793542032656465, "sim_compute_robot_state-ego": 0.05084130660347316, "sim_compute_robot_state-npc0": 0.05448712266009787, "sim_compute_robot_state-npc1": 0.05373456167138141, "sim_compute_robot_state-npc2": 0.052798430815986966, "sim_compute_robot_state-npc3": 0.05328532923822817}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0870923040733325, "sim_physics": 0.11514250393020374, "survival_time": 8.949999999999992, "driven_lanedir": 0.31657510487902885, "sim_render-ego": 0.045191956631964146, "in-drivable-lane": 5.849999999999995, "agent_compute-ego": 0.18084408584253747, "deviation-heading": 1.2022172017580914, "set_robot_commands": 0.0699584817087184, "deviation-center-line": 0.22286318125762528, "driven_lanedir_consec": 0.31657510487902885, "sim_compute_sim_state": 0.02851244191217689, "sim_compute_performance-ego": 0.049315408621420406, "sim_compute_robot_state-ego": 0.05012057746588851, "sim_compute_robot_state-npc0": 0.05339875700753494, "sim_compute_robot_state-npc1": 0.053196811143246446, "sim_compute_robot_state-npc2": 0.05175493282978761, "sim_compute_robot_state-npc3": 0.05149606619467283}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21149230325216872, "sim_physics": 0.12058456523998363, "survival_time": 1.850000000000001, "driven_lanedir": 0.1715530912881481, "sim_render-ego": 0.06660775236181311, "in-drivable-lane": 0, "agent_compute-ego": 0.1925699517533586, "deviation-heading": 0.9592386182571984, "set_robot_commands": 0.0797213670369741, "deviation-center-line": 0.11419995840473224, "driven_lanedir_consec": 0.1715530912881481, "sim_compute_sim_state": 0.029643677376412055, "sim_compute_performance-ego": 0.051481395154385955, "sim_compute_robot_state-ego": 0.05509873338647791, "sim_compute_robot_state-npc0": 0.05386203044169658, "sim_compute_robot_state-npc1": 0.05380888242979307, "sim_compute_robot_state-npc2": 0.053404421419710725, "sim_compute_robot_state-npc3": 0.05516947282327188}}
set_robot_commands_max0.0797213670369741
set_robot_commands_mean0.07271138704450772
set_robot_commands_median0.0699584817087184
set_robot_commands_min0.06855979426340623
sim_compute_performance-ego_max0.051481395154385955
sim_compute_performance-ego_mean0.05016525016760396
sim_compute_performance-ego_median0.0502185583114624
sim_compute_performance-ego_min0.049017346718094566
sim_compute_robot_state-ego_max0.05509873338647791
sim_compute_robot_state-ego_mean0.051975543231295704
sim_compute_robot_state-ego_median0.05084130660347316
sim_compute_robot_state-ego_min0.05012057746588851
sim_compute_robot_state-npc0_max0.05448712266009787
sim_compute_robot_state-npc0_mean0.05295562149537061
sim_compute_robot_state-npc0_median0.05339875700753494
sim_compute_robot_state-npc0_min0.050666956106821696
sim_compute_robot_state-npc1_max0.05470769242806868
sim_compute_robot_state-npc1_mean0.05312822208632695
sim_compute_robot_state-npc1_median0.05373456167138141
sim_compute_robot_state-npc1_min0.0501931627591451
sim_compute_robot_state-npc2_max0.053404421419710725
sim_compute_robot_state-npc2_mean0.05161144209794286
sim_compute_robot_state-npc2_median0.05175493282978761
sim_compute_robot_state-npc2_min0.04945802688598633
sim_compute_robot_state-npc3_max0.05516947282327188
sim_compute_robot_state-npc3_mean0.051906169339384
sim_compute_robot_state-npc3_median0.05149606619467283
sim_compute_robot_state-npc3_min0.04940900007883708
sim_compute_sim_state_max0.029643677376412055
sim_compute_sim_state_mean0.02899425014433426
sim_compute_sim_state_median0.028947106997172036
sim_compute_sim_state_min0.02851244191217689
sim_physics_max0.12257886330286662
sim_physics_mean0.116757845606022
sim_physics_median0.11541490798646752
sim_physics_min0.11006838757058848
sim_render-ego_max0.06660775236181311
sim_render-ego_mean0.04918242247040312
sim_render-ego_median0.045191956631964146
sim_render-ego_min0.043844350179036456
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean5.669999999999994
survival_time_min1.850000000000001
No reset possible
241603950Kenechukwu Nnodu 🇨🇦ResNet-First-500aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2746668393238183
survival_time_median3.349999999999996
deviation-center-line_median0.2493966621579762
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13243227005004882
agent_compute-ego_mean0.1307094551550347
agent_compute-ego_median0.13034532286904074
agent_compute-ego_min0.12977418303489685
deviation-center-line_max0.35261397432018726
deviation-center-line_mean0.2725011981027062
deviation-center-line_min0.2143901225150106
deviation-heading_max1.9550795655786484
deviation-heading_mean1.1657117778599588
deviation-heading_median0.8827120309855782
deviation-heading_min0.5627400348400277
driven_any_max0.4549362764475247
driven_any_mean0.33260881004308895
driven_any_median0.3118273862187141
driven_any_min0.24451066059497653
driven_lanedir_consec_max0.4064316650562807
driven_lanedir_consec_mean0.3043818705630216
driven_lanedir_consec_min0.23488859602179657
driven_lanedir_max0.4064316650562807
driven_lanedir_mean0.3043818705630216
driven_lanedir_median0.2746668393238183
driven_lanedir_min0.23488859602179657
in-drivable-lane_max0.1999999999999993
in-drivable-lane_mean0.04999999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4549362764475247, "sim_physics": 0.09344662102785978, "survival_time": 5.4999999999999885, "driven_lanedir": 0.4064316650562807, "sim_render-ego": 0.0362589337609031, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.13243227005004882, "deviation-heading": 1.9550795655786484, "set_robot_commands": 0.05524171482432972, "deviation-center-line": 0.35261397432018726, "driven_lanedir_consec": 0.4064316650562807, "sim_compute_sim_state": 0.022411179542541505, "sim_compute_performance-ego": 0.03837053342299028, "sim_compute_robot_state-ego": 0.04040866981853138, "sim_compute_robot_state-npc0": 0.03968778090043502, "sim_compute_robot_state-npc1": 0.0391209754076871, "sim_compute_robot_state-npc2": 0.038938533176075325, "sim_compute_robot_state-npc3": 0.03975115472620184}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3118273862187141, "sim_physics": 0.08962391151322259, "survival_time": 3.599999999999995, "driven_lanedir": 0.25675940500194505, "sim_render-ego": 0.03465605444378323, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12977418303489685, "deviation-heading": 1.811494882196615, "set_robot_commands": 0.054713586966196694, "deviation-center-line": 0.24495706221834396, "driven_lanedir_consec": 0.25675940500194505, "sim_compute_sim_state": 0.022301418913735285, "sim_compute_performance-ego": 0.03834600249926249, "sim_compute_robot_state-ego": 0.039982640080981784, "sim_compute_robot_state-npc0": 0.03969201445579529, "sim_compute_robot_state-npc1": 0.04213465915785895, "sim_compute_robot_state-npc2": 0.03878019253412882, "sim_compute_robot_state-npc3": 0.03899160027503967}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24451066059497653, "sim_physics": 0.09639231074940074, "survival_time": 2.7499999999999982, "driven_lanedir": 0.23488859602179657, "sim_render-ego": 0.03518643379211426, "in-drivable-lane": 0, "agent_compute-ego": 0.13034532286904074, "deviation-heading": 0.616532375698925, "set_robot_commands": 0.05426044030623003, "deviation-center-line": 0.2493966621579762, "driven_lanedir_consec": 0.23488859602179657, "sim_compute_sim_state": 0.02207747372713956, "sim_compute_performance-ego": 0.03803690130060369, "sim_compute_robot_state-ego": 0.039972691102461384, "sim_compute_robot_state-npc0": 0.039342004602605646, "sim_compute_robot_state-npc1": 0.03866985494440252, "sim_compute_robot_state-npc2": 0.039189720153808595, "sim_compute_robot_state-npc3": 0.03864495970986106}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2855132245954165, "sim_physics": 0.09671634098268904, "survival_time": 2.6499999999999986, "driven_lanedir": 0.2746668393238183, "sim_render-ego": 0.03546766515048045, "in-drivable-lane": 0, "agent_compute-ego": 0.1303028790455944, "deviation-heading": 0.5627400348400277, "set_robot_commands": 0.05432827967517781, "deviation-center-line": 0.2143901225150106, "driven_lanedir_consec": 0.2746668393238183, "sim_compute_sim_state": 0.022295731418537645, "sim_compute_performance-ego": 0.03876945657550164, "sim_compute_robot_state-ego": 0.03998785198859449, "sim_compute_robot_state-npc0": 0.039528662303708634, "sim_compute_robot_state-npc1": 0.03909557720400252, "sim_compute_robot_state-npc2": 0.03867507880588747, "sim_compute_robot_state-npc3": 0.038966021447811486}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.36625650235881296, "sim_physics": 0.08555191310484019, "survival_time": 3.349999999999996, "driven_lanedir": 0.34916284741126713, "sim_render-ego": 0.03536779844938819, "in-drivable-lane": 0, "agent_compute-ego": 0.13069262077559285, "deviation-heading": 0.8827120309855782, "set_robot_commands": 0.05497287280523955, "deviation-center-line": 0.3011481693020129, "driven_lanedir_consec": 0.34916284741126713, "sim_compute_sim_state": 0.022237674513859537, "sim_compute_performance-ego": 0.038058551389779614, "sim_compute_robot_state-ego": 0.03996752269232451, "sim_compute_robot_state-npc0": 0.039549098086001266, "sim_compute_robot_state-npc1": 0.03889600554508949, "sim_compute_robot_state-npc2": 0.03869755588360687, "sim_compute_robot_state-npc3": 0.03891397234219224}}
set_robot_commands_max0.05524171482432972
set_robot_commands_mean0.05470337891543475
set_robot_commands_median0.054713586966196694
set_robot_commands_min0.05426044030623003
sim_compute_performance-ego_max0.03876945657550164
sim_compute_performance-ego_mean0.03831628903762754
sim_compute_performance-ego_median0.03834600249926249
sim_compute_performance-ego_min0.03803690130060369
sim_compute_robot_state-ego_max0.04040866981853138
sim_compute_robot_state-ego_mean0.040063875136578705
sim_compute_robot_state-ego_median0.039982640080981784
sim_compute_robot_state-ego_min0.03996752269232451
sim_compute_robot_state-npc0_max0.03969201445579529
sim_compute_robot_state-npc0_mean0.03955991206970917
sim_compute_robot_state-npc0_median0.039549098086001266
sim_compute_robot_state-npc0_min0.039342004602605646
sim_compute_robot_state-npc1_max0.04213465915785895
sim_compute_robot_state-npc1_mean0.03958341445180811
sim_compute_robot_state-npc1_median0.03909557720400252
sim_compute_robot_state-npc1_min0.03866985494440252
sim_compute_robot_state-npc2_max0.039189720153808595
sim_compute_robot_state-npc2_mean0.03885621611070142
sim_compute_robot_state-npc2_median0.03878019253412882
sim_compute_robot_state-npc2_min0.03867507880588747
sim_compute_robot_state-npc3_max0.03975115472620184
sim_compute_robot_state-npc3_mean0.03905354170022126
sim_compute_robot_state-npc3_median0.038966021447811486
sim_compute_robot_state-npc3_min0.03864495970986106
sim_compute_sim_state_max0.022411179542541505
sim_compute_sim_state_mean0.022264695623162703
sim_compute_sim_state_median0.022295731418537645
sim_compute_sim_state_min0.02207747372713956
sim_physics_max0.09671634098268904
sim_physics_mean0.09234621947560248
sim_physics_median0.09344662102785978
sim_physics_min0.08555191310484019
sim_render-ego_max0.0362589337609031
sim_render-ego_mean0.035387377119333846
sim_render-ego_median0.03536779844938819
sim_render-ego_min0.03465605444378323
simulation-passed1
survival_time_max5.4999999999999885
survival_time_mean3.5699999999999954
survival_time_min2.6499999999999986
No reset possible
241593949Kenechukwu Nnodu 🇨🇦ResNet-First-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:08:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3146426904693782
survival_time_median3.399999999999996
deviation-center-line_median0.2905707012218368
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13560217145889525
agent_compute-ego_mean0.13111274918293556
agent_compute-ego_median0.13053399403889973
agent_compute-ego_min0.1269652274117541
deviation-center-line_max0.32605608765525007
deviation-center-line_mean0.2829819167900262
deviation-center-line_min0.23839925792125427
deviation-heading_max1.9886792073753896
deviation-heading_mean1.1551162037221194
deviation-heading_median0.9354687362217136
deviation-heading_min0.586796931705462
driven_any_max0.42459458520693305
driven_any_mean0.3377772576865833
driven_any_median0.3252687014325032
driven_any_min0.2780384066147995
driven_lanedir_consec_max0.39360276940393835
driven_lanedir_consec_mean0.3136197833498578
driven_lanedir_consec_min0.25219949810362996
driven_lanedir_max0.39360276940393835
driven_lanedir_mean0.3136197833498578
driven_lanedir_median0.3146426904693782
driven_lanedir_min0.25219949810362996
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.42459458520693305, "sim_physics": 0.0921651452452272, "survival_time": 4.549999999999992, "driven_lanedir": 0.39360276940393835, "sim_render-ego": 0.03692013876778739, "in-drivable-lane": 0, "agent_compute-ego": 0.13297581672668457, "deviation-heading": 1.5936349349510563, "set_robot_commands": 0.05438794146527301, "deviation-center-line": 0.32605608765525007, "driven_lanedir_consec": 0.39360276940393835, "sim_compute_sim_state": 0.02293273904821375, "sim_compute_performance-ego": 0.04127369870196332, "sim_compute_robot_state-ego": 0.04061549050467355, "sim_compute_robot_state-npc0": 0.04040292069152161, "sim_compute_robot_state-npc1": 0.03988532705621405, "sim_compute_robot_state-npc2": 0.039748553391341326, "sim_compute_robot_state-npc3": 0.03973352516090477}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3041950863577518, "sim_physics": 0.09033322016398113, "survival_time": 3.7499999999999942, "driven_lanedir": 0.25219949810362996, "sim_render-ego": 0.0348824151357015, "in-drivable-lane": 0, "agent_compute-ego": 0.13053399403889973, "deviation-heading": 1.9886792073753896, "set_robot_commands": 0.05372927347819011, "deviation-center-line": 0.265640937890693, "driven_lanedir_consec": 0.25219949810362996, "sim_compute_sim_state": 0.02250668525695801, "sim_compute_performance-ego": 0.03830652872721354, "sim_compute_robot_state-ego": 0.040291032791137694, "sim_compute_robot_state-npc0": 0.03994073232014974, "sim_compute_robot_state-npc1": 0.039135281244913736, "sim_compute_robot_state-npc2": 0.04177555084228515, "sim_compute_robot_state-npc3": 0.0392715326944987}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2780384066147995, "sim_physics": 0.09395834581175846, "survival_time": 3.349999999999996, "driven_lanedir": 0.2684238379205497, "sim_render-ego": 0.035576745645323794, "in-drivable-lane": 0, "agent_compute-ego": 0.1269652274117541, "deviation-heading": 0.6710012083569757, "set_robot_commands": 0.05367310723262047, "deviation-center-line": 0.294242599261097, "driven_lanedir_consec": 0.2684238379205497, "sim_compute_sim_state": 0.02231698249703023, "sim_compute_performance-ego": 0.038131528825902226, "sim_compute_robot_state-ego": 0.04030258975811859, "sim_compute_robot_state-npc0": 0.040559064096479275, "sim_compute_robot_state-npc1": 0.03906322948968233, "sim_compute_robot_state-npc2": 0.038827465541327176, "sim_compute_robot_state-npc3": 0.03902516080372369}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3252687014325032, "sim_physics": 0.097874054833064, "survival_time": 3.149999999999997, "driven_lanedir": 0.3146426904693782, "sim_render-ego": 0.03607183411007836, "in-drivable-lane": 0, "agent_compute-ego": 0.13560217145889525, "deviation-heading": 0.586796931705462, "set_robot_commands": 0.05373563463725741, "deviation-center-line": 0.23839925792125427, "driven_lanedir_consec": 0.3146426904693782, "sim_compute_sim_state": 0.022659483410063245, "sim_compute_performance-ego": 0.038436760978093225, "sim_compute_robot_state-ego": 0.04065094296894376, "sim_compute_robot_state-npc0": 0.040080660865420385, "sim_compute_robot_state-npc1": 0.03930825278872535, "sim_compute_robot_state-npc2": 0.039288006131611174, "sim_compute_robot_state-npc3": 0.03997681254432315}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.35678950882092886, "sim_physics": 0.0880545412792879, "survival_time": 3.399999999999996, "driven_lanedir": 0.3392301208517927, "sim_render-ego": 0.0361782663008746, "in-drivable-lane": 0, "agent_compute-ego": 0.12948653627844417, "deviation-heading": 0.9354687362217136, "set_robot_commands": 0.05392141201916863, "deviation-center-line": 0.2905707012218368, "driven_lanedir_consec": 0.3392301208517927, "sim_compute_sim_state": 0.02288971227758071, "sim_compute_performance-ego": 0.038588443223167866, "sim_compute_robot_state-ego": 0.04055072279537425, "sim_compute_robot_state-npc0": 0.04041621965520522, "sim_compute_robot_state-npc1": 0.03956943399765912, "sim_compute_robot_state-npc2": 0.03940596650628483, "sim_compute_robot_state-npc3": 0.0395401821416967}}
set_robot_commands_max0.05438794146527301
set_robot_commands_mean0.053889473766501925
set_robot_commands_median0.05373563463725741
set_robot_commands_min0.05367310723262047
sim_compute_performance-ego_max0.04127369870196332
sim_compute_performance-ego_mean0.03894739209126804
sim_compute_performance-ego_median0.038436760978093225
sim_compute_performance-ego_min0.038131528825902226
sim_compute_robot_state-ego_max0.04065094296894376
sim_compute_robot_state-ego_mean0.040482155763649566
sim_compute_robot_state-ego_median0.04055072279537425
sim_compute_robot_state-ego_min0.040291032791137694
sim_compute_robot_state-npc0_max0.040559064096479275
sim_compute_robot_state-npc0_mean0.04027991952575525
sim_compute_robot_state-npc0_median0.04040292069152161
sim_compute_robot_state-npc0_min0.03994073232014974
sim_compute_robot_state-npc1_max0.03988532705621405
sim_compute_robot_state-npc1_mean0.039392304915438915
sim_compute_robot_state-npc1_median0.03930825278872535
sim_compute_robot_state-npc1_min0.03906322948968233
sim_compute_robot_state-npc2_max0.04177555084228515
sim_compute_robot_state-npc2_mean0.03980910848256993
sim_compute_robot_state-npc2_median0.03940596650628483
sim_compute_robot_state-npc2_min0.038827465541327176
sim_compute_robot_state-npc3_max0.03997681254432315
sim_compute_robot_state-npc3_mean0.03950944266902941
sim_compute_robot_state-npc3_median0.0395401821416967
sim_compute_robot_state-npc3_min0.03902516080372369
sim_compute_sim_state_max0.02293273904821375
sim_compute_sim_state_mean0.02266112049796919
sim_compute_sim_state_median0.022659483410063245
sim_compute_sim_state_min0.02231698249703023
sim_physics_max0.097874054833064
sim_physics_mean0.09247706146666376
sim_physics_median0.0921651452452272
sim_physics_min0.0880545412792879
sim_render-ego_max0.03692013876778739
sim_render-ego_mean0.035925879991953125
sim_render-ego_median0.03607183411007836
sim_render-ego_min0.0348824151357015
simulation-passed1
survival_time_max4.549999999999992
survival_time_mean3.639999999999995
survival_time_min3.149999999999997
No reset possible
241583948Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241573947Kun Ni 🇨🇦challenge-aido_LF-template-randomaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.08836619159843348
agent_compute-ego_mean0.08722168107092083
agent_compute-ego_median0.08707602351319556
agent_compute-ego_min0.08629052779253792
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05746628178490533, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.03515225428122061, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.0874064012810036, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.05456455107088442, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.022593171508223923, "sim_compute_performance-ego": 0.03941203929759838, "sim_compute_robot_state-ego": 0.040259869010360154}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05531026802810968, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03519624354792576, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08707602351319556, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.054511706034342446, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.022791619394339768, "sim_compute_performance-ego": 0.038183226304895734, "sim_compute_robot_state-ego": 0.04014192375482297}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06063055992126465, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03492830781375661, "in-drivable-lane": 0, "agent_compute-ego": 0.08629052779253792, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.05398886344012093, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.022525576984181124, "sim_compute_performance-ego": 0.03784700000987334, "sim_compute_robot_state-ego": 0.040166013381060434}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06363832473754882, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.03518622398376465, "in-drivable-lane": 0, "agent_compute-ego": 0.0869692611694336, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.06007771492004395, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.022593259811401367, "sim_compute_performance-ego": 0.03827417373657226, "sim_compute_robot_state-ego": 0.040163002014160155}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05356701114509679, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.03589986245843429, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08836619159843348, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05501582954503313, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.022442802598204793, "sim_compute_performance-ego": 0.03773496724382232, "sim_compute_robot_state-ego": 0.03991325595710851}}
set_robot_commands_max0.06007771492004395
set_robot_commands_mean0.055631733002084974
set_robot_commands_median0.05456455107088442
set_robot_commands_min0.05398886344012093
sim_compute_performance-ego_max0.03941203929759838
sim_compute_performance-ego_mean0.03829028131855241
sim_compute_performance-ego_median0.038183226304895734
sim_compute_performance-ego_min0.03773496724382232
sim_compute_robot_state-ego_max0.040259869010360154
sim_compute_robot_state-ego_mean0.04012881282350245
sim_compute_robot_state-ego_median0.040163002014160155
sim_compute_robot_state-ego_min0.03991325595710851
sim_compute_sim_state_max0.022791619394339768
sim_compute_sim_state_mean0.022589286059270193
sim_compute_sim_state_median0.022593171508223923
sim_compute_sim_state_min0.022442802598204793
sim_physics_max0.06363832473754882
sim_physics_mean0.05812248912338506
sim_physics_median0.05746628178490533
sim_physics_min0.05356701114509679
sim_render-ego_max0.03589986245843429
sim_render-ego_mean0.03527257841702038
sim_render-ego_median0.03518622398376465
sim_render-ego_min0.03492830781375661
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
241553945Inderpal Singh 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1294404405248777
survival_time_median1.3000000000000005
deviation-center-line_median0.09338622725274218
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12728214263916016
agent_compute-ego_mean0.11524603397790403
agent_compute-ego_median0.1191264115847074
agent_compute-ego_min0.09654423464899478
deviation-center-line_max0.10892192753213874
deviation-center-line_mean0.09194580968447356
deviation-center-line_min0.06140937149608804
deviation-heading_max0.9592597135890456
deviation-heading_mean0.7017331914578778
deviation-heading_median0.754312185079301
deviation-heading_min0.4011457954992934
driven_any_max0.2122875299110134
driven_any_mean0.1926594805075889
driven_any_median0.19860515510732793
driven_any_min0.1606683916839803
driven_lanedir_consec_max0.1687086810735563
driven_lanedir_consec_mean0.136364879497661
driven_lanedir_consec_min0.10803961476731394
driven_lanedir_max0.1687086810735563
driven_lanedir_mean0.136364879497661
driven_lanedir_median0.1294404405248777
driven_lanedir_min0.10803961476731394
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2023424889894566, "sim_physics": 0.12413289717265538, "survival_time": 1.4000000000000006, "driven_lanedir": 0.11018226125799836, "sim_render-ego": 0.04092953034809658, "in-drivable-lane": 0, "agent_compute-ego": 0.12728214263916016, "deviation-heading": 0.9592597135890456, "set_robot_commands": 0.06524669272559029, "deviation-center-line": 0.09338622725274218, "driven_lanedir_consec": 0.11018226125799836, "sim_compute_sim_state": 0.0253203170640128, "sim_compute_performance-ego": 0.04458613906587873, "sim_compute_robot_state-ego": 0.048019307000296454, "sim_compute_robot_state-npc0": 0.04615435429981777, "sim_compute_robot_state-npc1": 0.046870597771235874, "sim_compute_robot_state-npc2": 0.04735968794141497, "sim_compute_robot_state-npc3": 0.046011899198804586}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2122875299110134, "sim_physics": 0.12508840744311994, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1294404405248777, "sim_render-ego": 0.04274342610285832, "in-drivable-lane": 0, "agent_compute-ego": 0.11254613216106708, "deviation-heading": 0.9473784691800065, "set_robot_commands": 0.05962546055133526, "deviation-center-line": 0.08797329943426593, "driven_lanedir_consec": 0.1294404405248777, "sim_compute_sim_state": 0.025864555285527155, "sim_compute_performance-ego": 0.04762036983783429, "sim_compute_robot_state-ego": 0.049658546080956094, "sim_compute_robot_state-npc0": 0.04507593925182636, "sim_compute_robot_state-npc1": 0.04573812851539025, "sim_compute_robot_state-npc2": 0.0452342125085684, "sim_compute_robot_state-npc3": 0.04473062661977915}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.18939383684616645, "sim_physics": 0.1222874927520752, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16545339986455865, "sim_render-ego": 0.04242095947265625, "in-drivable-lane": 0, "agent_compute-ego": 0.12073124885559082, "deviation-heading": 0.4011457954992934, "set_robot_commands": 0.06597446441650391, "deviation-center-line": 0.10803822270713292, "driven_lanedir_consec": 0.16545339986455865, "sim_compute_sim_state": 0.02776669502258301, "sim_compute_performance-ego": 0.04461875915527344, "sim_compute_robot_state-ego": 0.04377845764160156, "sim_compute_robot_state-npc0": 0.05293529510498047, "sim_compute_robot_state-npc1": 0.05110466003417969, "sim_compute_robot_state-npc2": 0.04878972053527832, "sim_compute_robot_state-npc3": 0.04946917533874512}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19860515510732793, "sim_physics": 0.137157339316148, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1687086810735563, "sim_render-ego": 0.043482652077308066, "in-drivable-lane": 0, "agent_compute-ego": 0.1191264115847074, "deviation-heading": 0.4465697939417433, "set_robot_commands": 0.06366384029388428, "deviation-center-line": 0.10892192753213874, "driven_lanedir_consec": 0.1687086810735563, "sim_compute_sim_state": 0.028508433928856484, "sim_compute_performance-ego": 0.04742388541881855, "sim_compute_robot_state-ego": 0.05076782520000751, "sim_compute_robot_state-npc0": 0.05132241432483379, "sim_compute_robot_state-npc1": 0.05246884089249831, "sim_compute_robot_state-npc2": 0.05062570938697228, "sim_compute_robot_state-npc3": 0.04979557257432204}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1606683916839803, "sim_physics": 0.090712018634962, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10803961476731394, "sim_render-ego": 0.03545068657916525, "in-drivable-lane": 0, "agent_compute-ego": 0.09654423464899478, "deviation-heading": 0.754312185079301, "set_robot_commands": 0.061320097550101905, "deviation-center-line": 0.06140937149608804, "driven_lanedir_consec": 0.10803961476731394, "sim_compute_sim_state": 0.02248483118803605, "sim_compute_performance-ego": 0.03805222718612007, "sim_compute_robot_state-ego": 0.04034085895704186, "sim_compute_robot_state-npc0": 0.039841745210730514, "sim_compute_robot_state-npc1": 0.03929100865903108, "sim_compute_robot_state-npc2": 0.039350945016612175, "sim_compute_robot_state-npc3": 0.03918680937393852}}
set_robot_commands_max0.06597446441650391
set_robot_commands_mean0.06316611110748313
set_robot_commands_median0.06366384029388428
set_robot_commands_min0.05962546055133526
sim_compute_performance-ego_max0.04762036983783429
sim_compute_performance-ego_mean0.04446027613278501
sim_compute_performance-ego_median0.04461875915527344
sim_compute_performance-ego_min0.03805222718612007
sim_compute_robot_state-ego_max0.05076782520000751
sim_compute_robot_state-ego_mean0.0465129989759807
sim_compute_robot_state-ego_median0.048019307000296454
sim_compute_robot_state-ego_min0.04034085895704186
sim_compute_robot_state-npc0_max0.05293529510498047
sim_compute_robot_state-npc0_mean0.047065949638437785
sim_compute_robot_state-npc0_median0.04615435429981777
sim_compute_robot_state-npc0_min0.039841745210730514
sim_compute_robot_state-npc1_max0.05246884089249831
sim_compute_robot_state-npc1_mean0.04709464717446704
sim_compute_robot_state-npc1_median0.046870597771235874
sim_compute_robot_state-npc1_min0.03929100865903108
sim_compute_robot_state-npc2_max0.05062570938697228
sim_compute_robot_state-npc2_mean0.04627205507776923
sim_compute_robot_state-npc2_median0.04735968794141497
sim_compute_robot_state-npc2_min0.039350945016612175
sim_compute_robot_state-npc3_max0.04979557257432204
sim_compute_robot_state-npc3_mean0.04583881662111789
sim_compute_robot_state-npc3_median0.046011899198804586
sim_compute_robot_state-npc3_min0.03918680937393852
sim_compute_sim_state_max0.028508433928856484
sim_compute_sim_state_mean0.0259889664978031
sim_compute_sim_state_median0.025864555285527155
sim_compute_sim_state_min0.02248483118803605
sim_physics_max0.137157339316148
sim_physics_mean0.1198756310637921
sim_physics_median0.12413289717265538
sim_physics_min0.090712018634962
sim_render-ego_max0.043482652077308066
sim_render-ego_mean0.04100545091601689
sim_render-ego_median0.04242095947265625
sim_render-ego_min0.03545068657916525
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2800000000000005
survival_time_min1.1500000000000004
No reset possible
241533943Kenechukwu Nnodu 🇨🇦ResNet-Adam-More-Data-Less-One-200aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:06:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33984019106939245
survival_time_median3.4499999999999957
deviation-center-line_median0.20091872933256769
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14455853058741644
agent_compute-ego_mean0.14351070097802832
agent_compute-ego_median0.14327181594959204
agent_compute-ego_min0.14258367439796185
deviation-center-line_max0.24649560031253304
deviation-center-line_mean0.17093315491253477
deviation-center-line_min0.0686933620052518
deviation-heading_max1.4050632838700603
deviation-heading_mean1.072935327142821
deviation-heading_median1.0627273086158018
deviation-heading_min0.6783427176799068
driven_any_max0.6245873955281743
driven_any_mean0.38789938153347
driven_any_median0.3897167487538862
driven_any_min0.14941949188402762
driven_lanedir_consec_max0.5814710947060013
driven_lanedir_consec_mean0.33199450974066796
driven_lanedir_consec_min0.09642255853610215
driven_lanedir_max0.5814710947060013
driven_lanedir_mean0.33199450974066796
driven_lanedir_median0.33984019106939245
driven_lanedir_min0.09642255853610215
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.1099999999999996
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3859428783046955, "sim_physics": 0.10050491491953532, "survival_time": 3.599999999999995, "driven_lanedir": 0.2822607979802827, "sim_render-ego": 0.03609509600533379, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14395981695916918, "deviation-heading": 1.0627273086158018, "set_robot_commands": 0.054005334774653115, "deviation-center-line": 0.13424637584629232, "driven_lanedir_consec": 0.2822607979802827, "sim_compute_sim_state": 0.022652318080266316, "sim_compute_performance-ego": 0.03917070229848226, "sim_compute_robot_state-ego": 0.04078402121861776, "sim_compute_robot_state-npc0": 0.040157695611317955, "sim_compute_robot_state-npc1": 0.03966520561112298, "sim_compute_robot_state-npc2": 0.03955557280116611, "sim_compute_robot_state-npc3": 0.03944059544139438}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3898303931965665, "sim_physics": 0.09352204074030336, "survival_time": 3.4499999999999957, "driven_lanedir": 0.33984019106939245, "sim_render-ego": 0.038258054982060974, "in-drivable-lane": 0, "agent_compute-ego": 0.14327181594959204, "deviation-heading": 1.4050632838700603, "set_robot_commands": 0.054211170777030616, "deviation-center-line": 0.20091872933256769, "driven_lanedir_consec": 0.33984019106939245, "sim_compute_sim_state": 0.02282244226206904, "sim_compute_performance-ego": 0.03919551337974659, "sim_compute_robot_state-ego": 0.040607210518657295, "sim_compute_robot_state-npc0": 0.040147283802861755, "sim_compute_robot_state-npc1": 0.03951212979745174, "sim_compute_robot_state-npc2": 0.0393949107847352, "sim_compute_robot_state-npc3": 0.03931530316670736}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6245873955281743, "sim_physics": 0.09542781320111506, "survival_time": 5.799999999999987, "driven_lanedir": 0.5814710947060013, "sim_render-ego": 0.038461204232840704, "in-drivable-lane": 0, "agent_compute-ego": 0.14258367439796185, "deviation-heading": 1.3413303256811508, "set_robot_commands": 0.054756209768097974, "deviation-center-line": 0.24649560031253304, "driven_lanedir_consec": 0.5814710947060013, "sim_compute_sim_state": 0.022674096041712267, "sim_compute_performance-ego": 0.03853375541752782, "sim_compute_robot_state-ego": 0.040551181497245, "sim_compute_robot_state-npc0": 0.04024701488429103, "sim_compute_robot_state-npc1": 0.041397394805118955, "sim_compute_robot_state-npc2": 0.03993703784613774, "sim_compute_robot_state-npc3": 0.039679301196131216}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3897167487538862, "sim_physics": 0.10057848691940308, "survival_time": 2.9999999999999973, "driven_lanedir": 0.35997790641156113, "sim_render-ego": 0.03566553592681885, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1431796669960022, "deviation-heading": 0.6783427176799068, "set_robot_commands": 0.05436696211496989, "deviation-center-line": 0.20431170706602905, "driven_lanedir_consec": 0.35997790641156113, "sim_compute_sim_state": 0.022521682580312095, "sim_compute_performance-ego": 0.03835423787434896, "sim_compute_robot_state-ego": 0.0404343843460083, "sim_compute_robot_state-npc0": 0.040161621570587155, "sim_compute_robot_state-npc1": 0.03948256572087606, "sim_compute_robot_state-npc2": 0.04021254777908325, "sim_compute_robot_state-npc3": 0.03951239983240763}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14941949188402762, "sim_physics": 0.09170385507436898, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09642255853610215, "sim_render-ego": 0.04297491220327524, "in-drivable-lane": 0, "agent_compute-ego": 0.14455853058741644, "deviation-heading": 0.8772129998671855, "set_robot_commands": 0.05439115487612211, "deviation-center-line": 0.0686933620052518, "driven_lanedir_consec": 0.09642255853610215, "sim_compute_sim_state": 0.0225447599704449, "sim_compute_performance-ego": 0.03827989101409912, "sim_compute_robot_state-ego": 0.04038053292494554, "sim_compute_robot_state-npc0": 0.04019640959226168, "sim_compute_robot_state-npc1": 0.039846374438359186, "sim_compute_robot_state-npc2": 0.03957521915435791, "sim_compute_robot_state-npc3": 0.039452314376831055}}
set_robot_commands_max0.054756209768097974
set_robot_commands_mean0.05434616646217474
set_robot_commands_median0.05436696211496989
set_robot_commands_min0.054005334774653115
sim_compute_performance-ego_max0.03919551337974659
sim_compute_performance-ego_mean0.038706819996840953
sim_compute_performance-ego_median0.03853375541752782
sim_compute_performance-ego_min0.03827989101409912
sim_compute_robot_state-ego_max0.04078402121861776
sim_compute_robot_state-ego_mean0.04055146610109478
sim_compute_robot_state-ego_median0.040551181497245
sim_compute_robot_state-ego_min0.04038053292494554
sim_compute_robot_state-npc0_max0.04024701488429103
sim_compute_robot_state-npc0_mean0.04018200509226392
sim_compute_robot_state-npc0_median0.040161621570587155
sim_compute_robot_state-npc0_min0.040147283802861755
sim_compute_robot_state-npc1_max0.041397394805118955
sim_compute_robot_state-npc1_mean0.03998073407458578
sim_compute_robot_state-npc1_median0.03966520561112298
sim_compute_robot_state-npc1_min0.03948256572087606
sim_compute_robot_state-npc2_max0.04021254777908325
sim_compute_robot_state-npc2_mean0.03973505767309604
sim_compute_robot_state-npc2_median0.03957521915435791
sim_compute_robot_state-npc2_min0.0393949107847352
sim_compute_robot_state-npc3_max0.039679301196131216
sim_compute_robot_state-npc3_mean0.03947998280269432
sim_compute_robot_state-npc3_median0.039452314376831055
sim_compute_robot_state-npc3_min0.03931530316670736
sim_compute_sim_state_max0.02282244226206904
sim_compute_sim_state_mean0.022643059786960924
sim_compute_sim_state_median0.022652318080266316
sim_compute_sim_state_min0.022521682580312095
sim_physics_max0.10057848691940308
sim_physics_mean0.09634742217094516
sim_physics_median0.09542781320111506
sim_physics_min0.09170385507436898
sim_render-ego_max0.04297491220327524
sim_render-ego_mean0.03829096067006591
sim_render-ego_median0.038258054982060974
sim_render-ego_min0.03566553592681885
simulation-passed1
survival_time_max5.799999999999987
survival_time_mean3.4299999999999953
survival_time_min1.3000000000000005
No reset possible
241523942Kenechukwu Nnodu 🇨🇦ResNet-Adam-More-Data-Less-One-200aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:10:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8916754334336016
survival_time_median6.349999999999985
deviation-center-line_median0.22601831842281095
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13219511124395555
agent_compute-ego_mean0.12989220540648333
agent_compute-ego_median0.13024107261940285
agent_compute-ego_min0.12668553807518698
deviation-center-line_max0.4075189835322025
deviation-center-line_mean0.22154303544849316
deviation-center-line_min0.0890829941225665
deviation-heading_max2.6265166887447964
deviation-heading_mean1.4518079821159378
deviation-heading_median1.2671669825698508
deviation-heading_min0.8204846906895403
driven_any_max1.376085903433618
driven_any_mean0.7698282850492163
driven_any_median0.9596449810534988
driven_any_min0.1980574571263778
driven_lanedir_consec_max0.975589132041604
driven_lanedir_consec_mean0.6349293385700381
driven_lanedir_consec_min0.14970234342329958
driven_lanedir_max0.975589132041604
driven_lanedir_mean0.6349293385700381
driven_lanedir_median0.8916754334336016
driven_lanedir_min0.14970234342329958
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean0.40999999999999853
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.376085903433618, "sim_physics": 0.09950037508703476, "survival_time": 8.949999999999992, "driven_lanedir": 0.8916754334336016, "sim_render-ego": 0.03628572272188837, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.13089610078481323, "deviation-heading": 2.6265166887447964, "set_robot_commands": 0.055289317775705005, "deviation-center-line": 0.4075189835322025, "driven_lanedir_consec": 0.8916754334336016, "sim_compute_sim_state": 0.022847058386776035, "sim_compute_performance-ego": 0.03918303724107795, "sim_compute_robot_state-ego": 0.04076762572347119, "sim_compute_robot_state-npc0": 0.040377583583639985, "sim_compute_robot_state-npc1": 0.03974395224501967, "sim_compute_robot_state-npc2": 0.03968776937303596, "sim_compute_robot_state-npc3": 0.03974785751470641}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.29990361874675686, "sim_physics": 0.09916965527967972, "survival_time": 2.2, "driven_lanedir": 0.2441696698653173, "sim_render-ego": 0.03527446768500588, "in-drivable-lane": 0, "agent_compute-ego": 0.12668553807518698, "deviation-heading": 1.1564233016705368, "set_robot_commands": 0.054774750362743034, "deviation-center-line": 0.13658501833997166, "driven_lanedir_consec": 0.2441696698653173, "sim_compute_sim_state": 0.02285524931820956, "sim_compute_performance-ego": 0.038361110470511696, "sim_compute_robot_state-ego": 0.04074073921550403, "sim_compute_robot_state-npc0": 0.04042625427246094, "sim_compute_robot_state-npc1": 0.03995401209050959, "sim_compute_robot_state-npc2": 0.04095875133167614, "sim_compute_robot_state-npc3": 0.039650153030048714}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.01544946488583, "sim_physics": 0.09669081723248515, "survival_time": 6.749999999999984, "driven_lanedir": 0.975589132041604, "sim_render-ego": 0.036044786594532155, "in-drivable-lane": 0, "agent_compute-ego": 0.13024107261940285, "deviation-heading": 1.2671669825698508, "set_robot_commands": 0.05493155232182256, "deviation-center-line": 0.24850986282491416, "driven_lanedir_consec": 0.975589132041604, "sim_compute_sim_state": 0.022839669828061702, "sim_compute_performance-ego": 0.039226819850780345, "sim_compute_robot_state-ego": 0.04080705642700195, "sim_compute_robot_state-npc0": 0.040558883878919816, "sim_compute_robot_state-npc1": 0.039847004855120625, "sim_compute_robot_state-npc2": 0.03954573384037724, "sim_compute_robot_state-npc3": 0.039714954517505785}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9596449810534988, "sim_physics": 0.09947671852712556, "survival_time": 6.349999999999985, "driven_lanedir": 0.913510114086368, "sim_render-ego": 0.035862703022994394, "in-drivable-lane": 0, "agent_compute-ego": 0.129443204309058, "deviation-heading": 1.3884482469049648, "set_robot_commands": 0.05419477139870951, "deviation-center-line": 0.22601831842281095, "driven_lanedir_consec": 0.913510114086368, "sim_compute_sim_state": 0.022631983118733084, "sim_compute_performance-ego": 0.0388443319816289, "sim_compute_robot_state-ego": 0.04054345859317329, "sim_compute_robot_state-npc0": 0.04033908130615715, "sim_compute_robot_state-npc1": 0.0397106531098133, "sim_compute_robot_state-npc2": 0.039348001555195, "sim_compute_robot_state-npc3": 0.039514243133424776}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1980574571263778, "sim_physics": 0.0925838178203952, "survival_time": 1.5500000000000007, "driven_lanedir": 0.14970234342329958, "sim_render-ego": 0.035812324093234156, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.13219511124395555, "deviation-heading": 0.8204846906895403, "set_robot_commands": 0.05432899536625031, "deviation-center-line": 0.0890829941225665, "driven_lanedir_consec": 0.14970234342329958, "sim_compute_sim_state": 0.022618747526599516, "sim_compute_performance-ego": 0.038261767356626446, "sim_compute_robot_state-ego": 0.04036865695830314, "sim_compute_robot_state-npc0": 0.04174796227485903, "sim_compute_robot_state-npc1": 0.03975186040324549, "sim_compute_robot_state-npc2": 0.039464896725070094, "sim_compute_robot_state-npc3": 0.039475264087800055}}
set_robot_commands_max0.055289317775705005
set_robot_commands_mean0.05470387744504609
set_robot_commands_median0.054774750362743034
set_robot_commands_min0.05419477139870951
sim_compute_performance-ego_max0.039226819850780345
sim_compute_performance-ego_mean0.038775413380125065
sim_compute_performance-ego_median0.0388443319816289
sim_compute_performance-ego_min0.038261767356626446
sim_compute_robot_state-ego_max0.04080705642700195
sim_compute_robot_state-ego_mean0.04064550738349072
sim_compute_robot_state-ego_median0.04074073921550403
sim_compute_robot_state-ego_min0.04036865695830314
sim_compute_robot_state-npc0_max0.04174796227485903
sim_compute_robot_state-npc0_mean0.040689953063207385
sim_compute_robot_state-npc0_median0.04042625427246094
sim_compute_robot_state-npc0_min0.04033908130615715
sim_compute_robot_state-npc1_max0.03995401209050959
sim_compute_robot_state-npc1_mean0.039801496540741735
sim_compute_robot_state-npc1_median0.03975186040324549
sim_compute_robot_state-npc1_min0.0397106531098133
sim_compute_robot_state-npc2_max0.04095875133167614
sim_compute_robot_state-npc2_mean0.03980103056507088
sim_compute_robot_state-npc2_median0.03954573384037724
sim_compute_robot_state-npc2_min0.039348001555195
sim_compute_robot_state-npc3_max0.03974785751470641
sim_compute_robot_state-npc3_mean0.039620494456697145
sim_compute_robot_state-npc3_median0.039650153030048714
sim_compute_robot_state-npc3_min0.039475264087800055
sim_compute_sim_state_max0.02285524931820956
sim_compute_sim_state_mean0.022758541635675984
sim_compute_sim_state_median0.022839669828061702
sim_compute_sim_state_min0.022618747526599516
sim_physics_max0.09950037508703476
sim_physics_mean0.0974842767893441
sim_physics_median0.09916965527967972
sim_physics_min0.0925838178203952
sim_render-ego_max0.03628572272188837
sim_render-ego_mean0.035856000823530985
sim_render-ego_median0.035862703022994394
sim_render-ego_min0.03527446768500588
simulation-passed1
survival_time_max8.949999999999992
survival_time_mean5.159999999999993
survival_time_min1.5500000000000007
No reset possible
241483938Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:16:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9283651264960432
survival_time_median14.950000000000076
deviation-center-line_median0.6754232041223853
in-drivable-lane_median6.850000000000031


other stats
agent_compute-ego_max0.12779506106874836
agent_compute-ego_mean0.1192649700216858
agent_compute-ego_median0.11801851987838743
agent_compute-ego_min0.11570240418116252
deviation-center-line_max0.7898221522863711
deviation-center-line_mean0.5732872071586015
deviation-center-line_min0.11813053478971323
deviation-heading_max2.3316182564563026
deviation-heading_mean1.5566861653133068
deviation-heading_median1.695694963472156
deviation-heading_min0.8066302781451287
driven_any_max2.3902864324830984
driven_any_mean1.907142614310964
driven_any_median2.37297177263376
driven_any_min0.2454760801580007
driven_lanedir_consec_max1.2240373867707417
driven_lanedir_consec_mean0.8352459830606127
driven_lanedir_consec_min0.19921548771784947
driven_lanedir_max1.2240373867707417
driven_lanedir_mean0.8352459830606127
driven_lanedir_median0.9283651264960432
driven_lanedir_min0.19921548771784947
in-drivable-lane_max9.250000000000068
in-drivable-lane_mean6.2400000000000375
in-drivable-lane_min0.10000000000000007
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.137656429178905, "sim_physics": 0.1045457000163064, "survival_time": 13.400000000000055, "driven_lanedir": 0.9283651264960432, "sim_render-ego": 0.0399918235949616, "in-drivable-lane": 6.700000000000037, "agent_compute-ego": 0.12779506106874836, "deviation-heading": 2.3316182564563026, "set_robot_commands": 0.05892605479083844, "deviation-center-line": 0.7013931773232394, "driven_lanedir_consec": 0.9283651264960432, "sim_compute_sim_state": 0.02450909543393263, "sim_compute_performance-ego": 0.04188422124777267, "sim_compute_robot_state-ego": 0.04326641915449456, "sim_compute_robot_state-npc0": 0.04397973818565482, "sim_compute_robot_state-npc1": 0.04268130971424615, "sim_compute_robot_state-npc2": 0.04306854151967746, "sim_compute_robot_state-npc3": 0.04305526658670226}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.37297177263376, "sim_physics": 0.09724696477254231, "survival_time": 14.950000000000076, "driven_lanedir": 0.8391342061577314, "sim_render-ego": 0.03553317864735921, "in-drivable-lane": 9.250000000000068, "agent_compute-ego": 0.11596015453338623, "deviation-heading": 1.1616048429085866, "set_robot_commands": 0.053972707589467366, "deviation-center-line": 0.5816669672712985, "driven_lanedir_consec": 0.8391342061577314, "sim_compute_sim_state": 0.022339287598927816, "sim_compute_performance-ego": 0.03821731646855672, "sim_compute_robot_state-ego": 0.03999705632527669, "sim_compute_robot_state-npc0": 0.03961199283599853, "sim_compute_robot_state-npc1": 0.038889443079630534, "sim_compute_robot_state-npc2": 0.03865925629933675, "sim_compute_robot_state-npc3": 0.03994410514831543}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.389322357101056, "sim_physics": 0.08966590801874796, "survival_time": 14.950000000000076, "driven_lanedir": 1.2240373867707417, "sim_render-ego": 0.035050046443939206, "in-drivable-lane": 6.850000000000031, "agent_compute-ego": 0.11570240418116252, "deviation-heading": 1.7878824855843611, "set_robot_commands": 0.0537849227587382, "deviation-center-line": 0.7898221522863711, "driven_lanedir_consec": 1.2240373867707417, "sim_compute_sim_state": 0.02217422564824422, "sim_compute_performance-ego": 0.03769195795059204, "sim_compute_robot_state-ego": 0.039635848999023435, "sim_compute_robot_state-npc0": 0.03930387179056803, "sim_compute_robot_state-npc1": 0.03865574598312378, "sim_compute_robot_state-npc2": 0.038552323977152504, "sim_compute_robot_state-npc3": 0.03878864526748657}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.3902864324830984, "sim_physics": 0.09185556650161744, "survival_time": 14.950000000000076, "driven_lanedir": 0.985477708160698, "sim_render-ego": 0.03501791556676229, "in-drivable-lane": 8.30000000000005, "agent_compute-ego": 0.11801851987838743, "deviation-heading": 1.695694963472156, "set_robot_commands": 0.05405122836430867, "deviation-center-line": 0.6754232041223853, "driven_lanedir_consec": 0.985477708160698, "sim_compute_sim_state": 0.02217038154602051, "sim_compute_performance-ego": 0.039381376107533776, "sim_compute_robot_state-ego": 0.03951612075169881, "sim_compute_robot_state-npc0": 0.039461337725321455, "sim_compute_robot_state-npc1": 0.03866757074991862, "sim_compute_robot_state-npc2": 0.03836783250172933, "sim_compute_robot_state-npc3": 0.03883686145146688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2454760801580007, "sim_physics": 0.08977457639333364, "survival_time": 1.850000000000001, "driven_lanedir": 0.19921548771784947, "sim_render-ego": 0.034805323626544024, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.11884871044674436, "deviation-heading": 0.8066302781451287, "set_robot_commands": 0.054095036274678, "deviation-center-line": 0.11813053478971323, "driven_lanedir_consec": 0.19921548771784947, "sim_compute_sim_state": 0.022141044204299513, "sim_compute_performance-ego": 0.037741016697239234, "sim_compute_robot_state-ego": 0.03941786611402357, "sim_compute_robot_state-npc0": 0.03952759021037334, "sim_compute_robot_state-npc1": 0.038701933783453865, "sim_compute_robot_state-npc2": 0.03839760213284879, "sim_compute_robot_state-npc3": 0.038527682020857525}}
set_robot_commands_max0.05892605479083844
set_robot_commands_mean0.05496598995560613
set_robot_commands_median0.05405122836430867
set_robot_commands_min0.0537849227587382
sim_compute_performance-ego_max0.04188422124777267
sim_compute_performance-ego_mean0.038983177694338886
sim_compute_performance-ego_median0.03821731646855672
sim_compute_performance-ego_min0.03769195795059204
sim_compute_robot_state-ego_max0.04326641915449456
sim_compute_robot_state-ego_mean0.04036666226890341
sim_compute_robot_state-ego_median0.039635848999023435
sim_compute_robot_state-ego_min0.03941786611402357
sim_compute_robot_state-npc0_max0.04397973818565482
sim_compute_robot_state-npc0_mean0.04037690614958324
sim_compute_robot_state-npc0_median0.03952759021037334
sim_compute_robot_state-npc0_min0.03930387179056803
sim_compute_robot_state-npc1_max0.04268130971424615
sim_compute_robot_state-npc1_mean0.039519200662074594
sim_compute_robot_state-npc1_median0.038701933783453865
sim_compute_robot_state-npc1_min0.03865574598312378
sim_compute_robot_state-npc2_max0.04306854151967746
sim_compute_robot_state-npc2_mean0.03940911128614896
sim_compute_robot_state-npc2_median0.038552323977152504
sim_compute_robot_state-npc2_min0.03836783250172933
sim_compute_robot_state-npc3_max0.04305526658670226
sim_compute_robot_state-npc3_mean0.03983051209496573
sim_compute_robot_state-npc3_median0.03883686145146688
sim_compute_robot_state-npc3_min0.038527682020857525
sim_compute_sim_state_max0.02450909543393263
sim_compute_sim_state_mean0.022666806886284935
sim_compute_sim_state_median0.02217422564824422
sim_compute_sim_state_min0.022141044204299513
sim_physics_max0.1045457000163064
sim_physics_mean0.09461774314050957
sim_physics_median0.09185556650161744
sim_physics_min0.08966590801874796
sim_render-ego_max0.0399918235949616
sim_render-ego_mean0.03607965757591327
sim_render-ego_median0.035050046443939206
sim_render-ego_min0.034805323626544024
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.020000000000056
survival_time_min1.850000000000001
No reset possible
241473930Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:14:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241463931Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241443937Kenechukwu Nnodu 🇨🇦CNN-Adam-More-Data-Less-One-300aido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:21:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5994227130761502
survival_time_median4.749999999999991
deviation-center-line_median0.30857845902368236
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.19370741605758668
agent_compute-ego_mean0.1810226011745677
agent_compute-ego_median0.17941145759692295
agent_compute-ego_min0.16839055454029755
deviation-center-line_max1.084664527984148
deviation-center-line_mean0.474721554724556
deviation-center-line_min0.11480871786724324
deviation-heading_max2.305586741175672
deviation-heading_mean1.556798893313569
deviation-heading_median1.506905135070767
deviation-heading_min0.8378018914383335
driven_any_max2.363343646474145
driven_any_mean1.1577759430913288
driven_any_median0.7222031080082241
driven_any_min0.22079798489695793
driven_lanedir_consec_max1.7505118536572235
driven_lanedir_consec_mean0.8605819441147059
driven_lanedir_consec_min0.17815303340255562
driven_lanedir_max2.03579634538389
driven_lanedir_mean0.9867831108358234
driven_lanedir_median0.6334388376792676
driven_lanedir_min0.17815303340255562
in-drivable-lane_max2.7999999999999936
in-drivable-lane_mean0.7300000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 2.188896037342168, "sim_physics": 0.16656424330292846, "survival_time": 13.900000000000064, "driven_lanedir": 2.03579634538389, "sim_render-ego": 0.05829061621384655, "in-drivable-lane": 0.6000000000000085, "agent_compute-ego": 0.17941145759692295, "deviation-heading": 2.0096106583285898, "set_robot_commands": 0.08334131378064052, "deviation-center-line": 0.7291535670536762, "driven_lanedir_consec": 1.7505118536572235, "sim_compute_sim_state": 0.03547325923288469, "sim_compute_performance-ego": 0.06378785225984862, "sim_compute_robot_state-ego": 0.06566147667040928, "sim_compute_robot_state-npc0": 0.0624189428288302, "sim_compute_robot_state-npc1": 0.0615068271005754, "sim_compute_robot_state-npc2": 0.06212737234376317, "sim_compute_robot_state-npc3": 0.06392017885935393}, "udem1-1-0": {"driven_any": 0.29363893873514874, "sim_physics": 0.17654757167017737, "survival_time": 2.1500000000000004, "driven_lanedir": 0.24112463585586852, "sim_render-ego": 0.060471046802609466, "in-drivable-lane": 0, "agent_compute-ego": 0.17219848965489587, "deviation-heading": 1.1240900405544838, "set_robot_commands": 0.08570919480434684, "deviation-center-line": 0.1364025016940298, "driven_lanedir_consec": 0.24112463585586852, "sim_compute_sim_state": 0.036176687063172806, "sim_compute_performance-ego": 0.06024157723715139, "sim_compute_robot_state-ego": 0.06439289935799532, "sim_compute_robot_state-npc0": 0.06509076162826183, "sim_compute_robot_state-npc1": 0.0635546418123467, "sim_compute_robot_state-npc2": 0.0651842106220334, "sim_compute_robot_state-npc3": 0.05997634488482808}, "udem1-2-0": {"driven_any": 2.363343646474145, "sim_physics": 0.20096118529637655, "survival_time": 14.950000000000076, "driven_lanedir": 1.8454027018575352, "sim_render-ego": 0.06076358159383138, "in-drivable-lane": 2.7999999999999936, "agent_compute-ego": 0.19370741605758668, "deviation-heading": 2.305586741175672, "set_robot_commands": 0.09056256612141927, "deviation-center-line": 1.084664527984148, "driven_lanedir_consec": 1.5336974845817315, "sim_compute_sim_state": 0.038951040108998615, "sim_compute_performance-ego": 0.06789038976033529, "sim_compute_robot_state-ego": 0.07114229202270508, "sim_compute_robot_state-npc0": 0.06672600746154785, "sim_compute_robot_state-npc1": 0.0662579886118571, "sim_compute_robot_state-npc2": 0.06641668796539307, "sim_compute_robot_state-npc3": 0.06803383111953736}, "udem1-3-0": {"driven_any": 0.7222031080082241, "sim_physics": 0.19728373226366544, "survival_time": 4.749999999999991, "driven_lanedir": 0.6334388376792676, "sim_render-ego": 0.06288451144569798, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.19140508802313555, "deviation-heading": 1.506905135070767, "set_robot_commands": 0.09802196904232628, "deviation-center-line": 0.30857845902368236, "driven_lanedir_consec": 0.5994227130761502, "sim_compute_sim_state": 0.03836264359323602, "sim_compute_performance-ego": 0.06701117063823499, "sim_compute_robot_state-ego": 0.07114693240115517, "sim_compute_robot_state-npc0": 0.06905575049550909, "sim_compute_robot_state-npc1": 0.06863906007064016, "sim_compute_robot_state-npc2": 0.06812775511490671, "sim_compute_robot_state-npc3": 0.0669631230203729}, "udem1-4-0": {"driven_any": 0.22079798489695793, "sim_physics": 0.1814290495479808, "survival_time": 1.7000000000000008, "driven_lanedir": 0.17815303340255562, "sim_render-ego": 0.05906691971947165, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16839055454029755, "deviation-heading": 0.8378018914383335, "set_robot_commands": 0.08313886558308321, "deviation-center-line": 0.11480871786724324, "driven_lanedir_consec": 0.17815303340255562, "sim_compute_sim_state": 0.03850196389590993, "sim_compute_performance-ego": 0.06667623099158793, "sim_compute_robot_state-ego": 0.07059119729434743, "sim_compute_robot_state-npc0": 0.06056003710802864, "sim_compute_robot_state-npc1": 0.060982500805574304, "sim_compute_robot_state-npc2": 0.0641188200782327, "sim_compute_robot_state-npc3": 0.0661020419176887}}
set_robot_commands_max0.09802196904232628
set_robot_commands_mean0.08815478186636322
set_robot_commands_median0.08570919480434684
set_robot_commands_min0.08313886558308321
sim_compute_performance-ego_max0.06789038976033529
sim_compute_performance-ego_mean0.06512144417743164
sim_compute_performance-ego_median0.06667623099158793
sim_compute_performance-ego_min0.06024157723715139
sim_compute_robot_state-ego_max0.07114693240115517
sim_compute_robot_state-ego_mean0.06858695954932245
sim_compute_robot_state-ego_median0.07059119729434743
sim_compute_robot_state-ego_min0.06439289935799532
sim_compute_robot_state-npc0_max0.06905575049550909
sim_compute_robot_state-npc0_mean0.06477029990443553
sim_compute_robot_state-npc0_median0.06509076162826183
sim_compute_robot_state-npc0_min0.06056003710802864
sim_compute_robot_state-npc1_max0.06863906007064016
sim_compute_robot_state-npc1_mean0.06418820368019873
sim_compute_robot_state-npc1_median0.0635546418123467
sim_compute_robot_state-npc1_min0.060982500805574304
sim_compute_robot_state-npc2_max0.06812775511490671
sim_compute_robot_state-npc2_mean0.06519496922486581
sim_compute_robot_state-npc2_median0.0651842106220334
sim_compute_robot_state-npc2_min0.06212737234376317
sim_compute_robot_state-npc3_max0.06803383111953736
sim_compute_robot_state-npc3_mean0.06499910396035619
sim_compute_robot_state-npc3_median0.0661020419176887
sim_compute_robot_state-npc3_min0.05997634488482808
sim_compute_sim_state_max0.038951040108998615
sim_compute_sim_state_mean0.037493118778840415
sim_compute_sim_state_median0.03836264359323602
sim_compute_sim_state_min0.03547325923288469
sim_physics_max0.20096118529637655
sim_physics_mean0.18455715641622572
sim_physics_median0.1814290495479808
sim_physics_min0.16656424330292846
sim_render-ego_max0.06288451144569798
sim_render-ego_mean0.06029533515509141
sim_render-ego_median0.060471046802609466
sim_render-ego_min0.05829061621384655
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.490000000000026
survival_time_min1.7000000000000008
No reset possible
241383921Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241333922Kun Ni 🇨🇦Baseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241293914Gabriel Descoteaux 🇨🇦aido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241283913Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241053903Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LFV-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
241033907Gabriel Descoteaux 🇨🇦challenge-aido_LF-template-tensorflowaido2-LFVI-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240973895Yeong-Jia ChuChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240893882Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:04:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08571151642369346
survival_time_median1.5500000000000007
deviation-center-line_median0.06409428690010577
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16554415888256496
agent_compute-ego_mean0.15061350798326428
agent_compute-ego_median0.15389921448447488
agent_compute-ego_min0.12643179400213833
deviation-center-line_max0.08214055855485246
deviation-center-line_mean0.06265572674847514
deviation-center-line_min0.04694939818633675
deviation-heading_max0.8309171532564221
deviation-heading_mean0.7509204170765138
deviation-heading_median0.7778672810284888
deviation-heading_min0.6095014518453489
driven_any_max0.21533062460019672
driven_any_mean0.17797577247458798
driven_any_median0.19493286402130255
driven_any_min0.09015220879211878
driven_lanedir_consec_max0.12874424605593937
driven_lanedir_consec_mean0.09043612248019746
driven_lanedir_consec_min0.05458586061136739
driven_lanedir_max0.12874424605593937
driven_lanedir_mean0.09043612248019746
driven_lanedir_median0.08571151642369346
driven_lanedir_min0.05458586061136739
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.26000000000000023
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21533062460019672, "sim_physics": 0.11511071523030598, "survival_time": 1.800000000000001, "driven_lanedir": 0.08571151642369346, "sim_render-ego": 0.06294830640157063, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.16554415888256496, "deviation-heading": 0.7236405044166995, "set_robot_commands": 0.08861029148101807, "deviation-center-line": 0.06409428690010577, "driven_lanedir_consec": 0.08571151642369346, "sim_compute_sim_state": 0.03725050555335151, "sim_compute_performance-ego": 0.06917726331286961, "sim_compute_robot_state-ego": 0.07640869749916925}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19493286402130255, "sim_physics": 0.10961797929579212, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1124813263645692, "sim_render-ego": 0.06280070735562232, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15499218817680113, "deviation-heading": 0.7778672810284888, "set_robot_commands": 0.09064838194078016, "deviation-center-line": 0.04694939818633675, "driven_lanedir_consec": 0.1124813263645692, "sim_compute_sim_state": 0.04161253283100744, "sim_compute_performance-ego": 0.06769731736952259, "sim_compute_robot_state-ego": 0.07074789847097089}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09015220879211878, "sim_physics": 0.10718302977712532, "survival_time": 0.9500000000000004, "driven_lanedir": 0.05458586061136739, "sim_render-ego": 0.05362654987134432, "in-drivable-lane": 0, "agent_compute-ego": 0.15220018437034205, "deviation-heading": 0.6095014518453489, "set_robot_commands": 0.086911352057206, "deviation-center-line": 0.08214055855485246, "driven_lanedir_consec": 0.05458586061136739, "sim_compute_sim_state": 0.03701661762438322, "sim_compute_performance-ego": 0.0680097404279207, "sim_compute_robot_state-ego": 0.07058244002492804}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19327564131210817, "sim_physics": 0.11289673140554717, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07065766294541787, "sim_render-ego": 0.056658968780979965, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.15389921448447488, "deviation-heading": 0.8126756948356093, "set_robot_commands": 0.08809329524184718, "deviation-center-line": 0.048049267440574986, "driven_lanedir_consec": 0.07065766294541787, "sim_compute_sim_state": 0.03628157124374852, "sim_compute_performance-ego": 0.06702004056988341, "sim_compute_robot_state-ego": 0.06855937206383908}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19618752364721356, "sim_physics": 0.08675767635477, "survival_time": 1.4500000000000006, "driven_lanedir": 0.12874424605593937, "sim_render-ego": 0.04738118730742356, "in-drivable-lane": 0, "agent_compute-ego": 0.12643179400213833, "deviation-heading": 0.8309171532564221, "set_robot_commands": 0.07167983055114746, "deviation-center-line": 0.07204512266050571, "driven_lanedir_consec": 0.12874424605593937, "sim_compute_sim_state": 0.030076084465816104, "sim_compute_performance-ego": 0.0519460809641871, "sim_compute_robot_state-ego": 0.05458315487565665}}
set_robot_commands_max0.09064838194078016
set_robot_commands_mean0.08518863025439977
set_robot_commands_median0.08809329524184718
set_robot_commands_min0.07167983055114746
sim_compute_performance-ego_max0.06917726331286961
sim_compute_performance-ego_mean0.0647700885288767
sim_compute_performance-ego_median0.06769731736952259
sim_compute_performance-ego_min0.0519460809641871
sim_compute_robot_state-ego_max0.07640869749916925
sim_compute_robot_state-ego_mean0.06817631258691279
sim_compute_robot_state-ego_median0.07058244002492804
sim_compute_robot_state-ego_min0.05458315487565665
sim_compute_sim_state_max0.04161253283100744
sim_compute_sim_state_mean0.03644746234366136
sim_compute_sim_state_median0.03701661762438322
sim_compute_sim_state_min0.030076084465816104
sim_physics_max0.11511071523030598
sim_physics_mean0.1063132264127081
sim_physics_median0.10961797929579212
sim_physics_min0.08675767635477
sim_render-ego_max0.06294830640157063
sim_render-ego_mean0.05668314394338816
sim_render-ego_median0.056658968780979965
sim_render-ego_min0.04738118730742356
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.4800000000000009
survival_time_min0.9500000000000004
No reset possible
240863885Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240833878Kenechukwu Nnodu 🇨🇦ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:09:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33279926730365705
survival_time_median5.849999999999987
deviation-center-line_median0.21022023296625092
in-drivable-lane_median2.0999999999999925


other stats
agent_compute-ego_max0.1287631160683102
agent_compute-ego_mean0.12771073839579872
agent_compute-ego_median0.12776276339655335
agent_compute-ego_min0.126483491822785
deviation-center-line_max0.2262868523213402
deviation-center-line_mean0.1965654273718572
deviation-center-line_min0.14645975179579562
deviation-heading_max1.2131711311570286
deviation-heading_mean1.0827998868533266
deviation-heading_median1.1008009336224678
deviation-heading_min0.8478430824265855
driven_any_max1.1055931573373332
driven_any_mean0.6885620593603189
driven_any_median0.7471676798578288
driven_any_min0.25873035421963597
driven_lanedir_consec_max0.6563085287922115
driven_lanedir_consec_mean0.3735421108334759
driven_lanedir_consec_min0.23163114629630965
driven_lanedir_max0.6563085287922115
driven_lanedir_mean0.3735421108334759
driven_lanedir_median0.33279926730365705
driven_lanedir_min0.23163114629630965
in-drivable-lane_max4.949999999999982
in-drivable-lane_mean1.9799999999999929
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9907644976495152, "sim_physics": 0.08968806266784668, "survival_time": 7.199999999999982, "driven_lanedir": 0.6563085287922115, "sim_render-ego": 0.03534017503261566, "in-drivable-lane": 2.0999999999999925, "agent_compute-ego": 0.1287631160683102, "deviation-heading": 1.1008009336224678, "set_robot_commands": 0.053878150052494474, "deviation-center-line": 0.2262868523213402, "driven_lanedir_consec": 0.6563085287922115, "sim_compute_sim_state": 0.023695864611201815, "sim_compute_performance-ego": 0.03831834759977129, "sim_compute_robot_state-ego": 0.04331002632776896, "sim_compute_robot_state-npc0": 0.03993704252772861, "sim_compute_robot_state-npc1": 0.03943177064259847, "sim_compute_robot_state-npc2": 0.03910762071609497, "sim_compute_robot_state-npc3": 0.03901538915104336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.34055460773728163, "sim_physics": 0.0923160337934307, "survival_time": 2.549999999999999, "driven_lanedir": 0.2891427668852411, "sim_render-ego": 0.034804339502371995, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.126483491822785, "deviation-heading": 1.2131711311570286, "set_robot_commands": 0.05349427111008588, "deviation-center-line": 0.18578030876369211, "driven_lanedir_consec": 0.2891427668852411, "sim_compute_sim_state": 0.05469674690096986, "sim_compute_performance-ego": 0.03814316730873257, "sim_compute_robot_state-ego": 0.04060883615531173, "sim_compute_robot_state-npc0": 0.03994904312432981, "sim_compute_robot_state-npc1": 0.03975808386709176, "sim_compute_robot_state-npc2": 0.03898057750627106, "sim_compute_robot_state-npc3": 0.03899912273182588}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7471676798578288, "sim_physics": 0.08595298905657907, "survival_time": 5.849999999999987, "driven_lanedir": 0.33279926730365705, "sim_render-ego": 0.03496418243799454, "in-drivable-lane": 2.79999999999999, "agent_compute-ego": 0.12808084284138477, "deviation-heading": 1.1694069693061715, "set_robot_commands": 0.055320888502984986, "deviation-center-line": 0.21022023296625092, "driven_lanedir_consec": 0.33279926730365705, "sim_compute_sim_state": 0.02282600321321406, "sim_compute_performance-ego": 0.03828362725738786, "sim_compute_robot_state-ego": 0.040419829197418995, "sim_compute_robot_state-npc0": 0.04012658453395224, "sim_compute_robot_state-npc1": 0.03913182682461209, "sim_compute_robot_state-npc2": 0.039075038371941984, "sim_compute_robot_state-npc3": 0.03914115775344718}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1055931573373332, "sim_physics": 0.08878081481649268, "survival_time": 8.04999999999998, "driven_lanedir": 0.35782884488996025, "sim_render-ego": 0.03508263493176573, "in-drivable-lane": 4.949999999999982, "agent_compute-ego": 0.12776276339655335, "deviation-heading": 1.0827773177543794, "set_robot_commands": 0.05351628576006208, "deviation-center-line": 0.2140799910122072, "driven_lanedir_consec": 0.35782884488996025, "sim_compute_sim_state": 0.022402918857076893, "sim_compute_performance-ego": 0.038046217853238126, "sim_compute_robot_state-ego": 0.0405316604590564, "sim_compute_robot_state-npc0": 0.0399917104969854, "sim_compute_robot_state-npc1": 0.03922086620923155, "sim_compute_robot_state-npc2": 0.039186402137235087, "sim_compute_robot_state-npc3": 0.03919306008712105}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.25873035421963597, "sim_physics": 0.08760219812393188, "survival_time": 2.000000000000001, "driven_lanedir": 0.23163114629630965, "sim_render-ego": 0.03545739054679871, "in-drivable-lane": 0, "agent_compute-ego": 0.12746347784996032, "deviation-heading": 0.8478430824265855, "set_robot_commands": 0.05996580719947815, "deviation-center-line": 0.14645975179579562, "driven_lanedir_consec": 0.23163114629630965, "sim_compute_sim_state": 0.02250462770462036, "sim_compute_performance-ego": 0.039312970638275144, "sim_compute_robot_state-ego": 0.04055095911026001, "sim_compute_robot_state-npc0": 0.03997097611427307, "sim_compute_robot_state-npc1": 0.03939003348350525, "sim_compute_robot_state-npc2": 0.039150315523147586, "sim_compute_robot_state-npc3": 0.0392932653427124}}
set_robot_commands_max0.05996580719947815
set_robot_commands_mean0.05523508052502111
set_robot_commands_median0.053878150052494474
set_robot_commands_min0.05349427111008588
sim_compute_performance-ego_max0.039312970638275144
sim_compute_performance-ego_mean0.038420866131481005
sim_compute_performance-ego_median0.03828362725738786
sim_compute_performance-ego_min0.038046217853238126
sim_compute_robot_state-ego_max0.04331002632776896
sim_compute_robot_state-ego_mean0.04108426224996322
sim_compute_robot_state-ego_median0.04055095911026001
sim_compute_robot_state-ego_min0.040419829197418995
sim_compute_robot_state-npc0_max0.04012658453395224
sim_compute_robot_state-npc0_mean0.03999507135945383
sim_compute_robot_state-npc0_median0.03997097611427307
sim_compute_robot_state-npc0_min0.03993704252772861
sim_compute_robot_state-npc1_max0.03975808386709176
sim_compute_robot_state-npc1_mean0.039386516205407826
sim_compute_robot_state-npc1_median0.03939003348350525
sim_compute_robot_state-npc1_min0.03913182682461209
sim_compute_robot_state-npc2_max0.039186402137235087
sim_compute_robot_state-npc2_mean0.03909999085093814
sim_compute_robot_state-npc2_median0.03910762071609497
sim_compute_robot_state-npc2_min0.03898057750627106
sim_compute_robot_state-npc3_max0.0392932653427124
sim_compute_robot_state-npc3_mean0.03912839901322998
sim_compute_robot_state-npc3_median0.03914115775344718
sim_compute_robot_state-npc3_min0.03899912273182588
sim_compute_sim_state_max0.05469674690096986
sim_compute_sim_state_mean0.029225232257416595
sim_compute_sim_state_median0.02282600321321406
sim_compute_sim_state_min0.022402918857076893
sim_physics_max0.0923160337934307
sim_physics_mean0.08886801969165621
sim_physics_median0.08878081481649268
sim_physics_min0.08595298905657907
sim_render-ego_max0.03545739054679871
sim_render-ego_mean0.035129744490309325
sim_render-ego_median0.03508263493176573
sim_render-ego_min0.034804339502371995
simulation-passed1
survival_time_max8.04999999999998
survival_time_mean5.12999999999999
survival_time_min2.000000000000001
No reset possible
240823877Kenechukwu Nnodu 🇨🇦ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:09:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2325888948459751
survival_time_median4.699999999999991
deviation-center-line_median0.20519370129928063
in-drivable-lane_median1.5999999999999943


other stats
agent_compute-ego_max0.1426428607169618
agent_compute-ego_mean0.14207917895822617
agent_compute-ego_median0.14221031553793273
agent_compute-ego_min0.14105623208203363
deviation-center-line_max0.3944978820386541
deviation-center-line_mean0.26074188312324365
deviation-center-line_min0.15040450785110265
deviation-heading_max1.883700490427273
deviation-heading_mean1.3099016593565351
deviation-heading_median1.3569110353714675
deviation-heading_min0.8184218680195565
driven_any_max0.7868129396802005
driven_any_mean0.5169737117137255
driven_any_median0.5135884632677558
driven_any_min0.25270480564285747
driven_lanedir_consec_max0.4747302601189896
driven_lanedir_consec_mean0.2849250544812904
driven_lanedir_consec_min0.1777004155236721
driven_lanedir_max0.4747302601189896
driven_lanedir_mean0.2849250544812904
driven_lanedir_median0.2325888948459751
driven_lanedir_min0.1777004155236721
in-drivable-lane_max3.149999999999989
in-drivable-lane_mean1.3499999999999952
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7868129396802005, "sim_physics": 0.09413236579639, "survival_time": 7.449999999999981, "driven_lanedir": 0.3576372650310624, "sim_render-ego": 0.03539906732187975, "in-drivable-lane": 3.149999999999989, "agent_compute-ego": 0.14221031553793273, "deviation-heading": 0.8388870976517899, "set_robot_commands": 0.054867746045925474, "deviation-center-line": 0.3794862259084424, "driven_lanedir_consec": 0.3576372650310624, "sim_compute_sim_state": 0.02220655767709617, "sim_compute_performance-ego": 0.03795663622401705, "sim_compute_robot_state-ego": 0.04058574510100704, "sim_compute_robot_state-npc0": 0.0395853183413512, "sim_compute_robot_state-npc1": 0.03883007228774513, "sim_compute_robot_state-npc2": 0.03864145438943133, "sim_compute_robot_state-npc3": 0.038727243474665905}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.501415989191816, "sim_physics": 0.09230301481612184, "survival_time": 4.699999999999991, "driven_lanedir": 0.4747302601189896, "sim_render-ego": 0.0353072019333535, "in-drivable-lane": 0, "agent_compute-ego": 0.1426428607169618, "deviation-heading": 1.3569110353714675, "set_robot_commands": 0.054527305542154514, "deviation-center-line": 0.3944978820386541, "driven_lanedir_consec": 0.4747302601189896, "sim_compute_sim_state": 0.022410737707259806, "sim_compute_performance-ego": 0.03779991636884973, "sim_compute_robot_state-ego": 0.040300272880716526, "sim_compute_robot_state-npc0": 0.03949160525139342, "sim_compute_robot_state-npc1": 0.03871567452207525, "sim_compute_robot_state-npc2": 0.038650593859084106, "sim_compute_robot_state-npc3": 0.03870958723920457}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.530346360785998, "sim_physics": 0.08643660499054251, "survival_time": 5.14999999999999, "driven_lanedir": 0.1819684368867529, "sim_render-ego": 0.03459578115963242, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.14105623208203363, "deviation-heading": 1.883700490427273, "set_robot_commands": 0.054592546907443446, "deviation-center-line": 0.20519370129928063, "driven_lanedir_consec": 0.1819684368867529, "sim_compute_sim_state": 0.022229365932131276, "sim_compute_performance-ego": 0.0395849815850119, "sim_compute_robot_state-ego": 0.04016252628807883, "sim_compute_robot_state-npc0": 0.039614524656129114, "sim_compute_robot_state-npc1": 0.038838680508067304, "sim_compute_robot_state-npc2": 0.039165885703077594, "sim_compute_robot_state-npc3": 0.03870968448305593}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5135884632677558, "sim_physics": 0.08477173381381564, "survival_time": 4.499999999999992, "driven_lanedir": 0.1777004155236721, "sim_render-ego": 0.034720722834269205, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.1426173316107856, "deviation-heading": 1.651587805312589, "set_robot_commands": 0.054001752535502115, "deviation-center-line": 0.17412709851873853, "driven_lanedir_consec": 0.1777004155236721, "sim_compute_sim_state": 0.02261038621266683, "sim_compute_performance-ego": 0.03788363933563232, "sim_compute_robot_state-ego": 0.03990389506022136, "sim_compute_robot_state-npc0": 0.03977232774098714, "sim_compute_robot_state-npc1": 0.038764055569966635, "sim_compute_robot_state-npc2": 0.03861265447404649, "sim_compute_robot_state-npc3": 0.03874883651733398}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.25270480564285747, "sim_physics": 0.09255985780195757, "survival_time": 2.2, "driven_lanedir": 0.2325888948459751, "sim_render-ego": 0.03512871807271784, "in-drivable-lane": 0, "agent_compute-ego": 0.14186915484341708, "deviation-heading": 0.8184218680195565, "set_robot_commands": 0.05502085252241655, "deviation-center-line": 0.15040450785110265, "driven_lanedir_consec": 0.2325888948459751, "sim_compute_sim_state": 0.02226532589305531, "sim_compute_performance-ego": 0.03784096782857722, "sim_compute_robot_state-ego": 0.040135221047834915, "sim_compute_robot_state-npc0": 0.03969298167662187, "sim_compute_robot_state-npc1": 0.03885148872028698, "sim_compute_robot_state-npc2": 0.03873466903513128, "sim_compute_robot_state-npc3": 0.038951890035109085}}
set_robot_commands_max0.05502085252241655
set_robot_commands_mean0.05460204071068843
set_robot_commands_median0.054592546907443446
set_robot_commands_min0.054001752535502115
sim_compute_performance-ego_max0.0395849815850119
sim_compute_performance-ego_mean0.03821322826841765
sim_compute_performance-ego_median0.03788363933563232
sim_compute_performance-ego_min0.03779991636884973
sim_compute_robot_state-ego_max0.04058574510100704
sim_compute_robot_state-ego_mean0.04021753207557174
sim_compute_robot_state-ego_median0.04016252628807883
sim_compute_robot_state-ego_min0.03990389506022136
sim_compute_robot_state-npc0_max0.03977232774098714
sim_compute_robot_state-npc0_mean0.039631351533296555
sim_compute_robot_state-npc0_median0.039614524656129114
sim_compute_robot_state-npc0_min0.03949160525139342
sim_compute_robot_state-npc1_max0.03885148872028698
sim_compute_robot_state-npc1_mean0.03879999432162826
sim_compute_robot_state-npc1_median0.03883007228774513
sim_compute_robot_state-npc1_min0.03871567452207525
sim_compute_robot_state-npc2_max0.039165885703077594
sim_compute_robot_state-npc2_mean0.03876105149215416
sim_compute_robot_state-npc2_median0.038650593859084106
sim_compute_robot_state-npc2_min0.03861265447404649
sim_compute_robot_state-npc3_max0.038951890035109085
sim_compute_robot_state-npc3_mean0.03876944834987389
sim_compute_robot_state-npc3_median0.038727243474665905
sim_compute_robot_state-npc3_min0.03870958723920457
sim_compute_sim_state_max0.02261038621266683
sim_compute_sim_state_mean0.02234447468444188
sim_compute_sim_state_median0.02226532589305531
sim_compute_sim_state_min0.02220655767709617
sim_physics_max0.09413236579639
sim_physics_mean0.09004071544376552
sim_physics_median0.09230301481612184
sim_physics_min0.08477173381381564
sim_render-ego_max0.03539906732187975
sim_render-ego_mean0.03503029826437054
sim_render-ego_median0.03512871807271784
sim_render-ego_min0.03459578115963242
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean4.799999999999991
survival_time_min2.2
No reset possible
240813876Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3675080545743271
survival_time_median6.249999999999986
deviation-center-line_median0.2965447427870658
in-drivable-lane_median2.199999999999992


other stats
agent_compute-ego_max0.14249171619921658
agent_compute-ego_mean0.14224431368274132
agent_compute-ego_median0.142472505569458
agent_compute-ego_min0.1415359992980957
deviation-center-line_max0.502780561610695
deviation-center-line_mean0.3161493322362382
deviation-center-line_min0.200283345726444
deviation-heading_max1.7101667772152096
deviation-heading_mean1.3163083605250905
deviation-heading_median1.54403723100336
deviation-heading_min0.835925562236027
driven_any_max0.7414594899441834
driven_any_mean0.5997161783290534
driven_any_median0.5746177764942553
driven_any_min0.3828625879524511
driven_lanedir_consec_max0.721858504154008
driven_lanedir_consec_mean0.3973510219779481
driven_lanedir_consec_min0.24995251430571308
driven_lanedir_max0.721858504154008
driven_lanedir_mean0.3973510219779481
driven_lanedir_median0.3675080545743271
driven_lanedir_min0.24995251430571308
in-drivable-lane_max2.6999999999999904
in-drivable-lane_mean1.4899999999999949
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7258903159008789, "sim_physics": 0.09723767593725403, "survival_time": 6.699999999999984, "driven_lanedir": 0.3970209812753591, "sim_render-ego": 0.03536459937024472, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.1424752420453883, "deviation-heading": 0.835925562236027, "set_robot_commands": 0.05409862568129355, "deviation-center-line": 0.365759055809039, "driven_lanedir_consec": 0.3970209812753591, "sim_compute_sim_state": 0.02217911784328631, "sim_compute_performance-ego": 0.03814115986895206, "sim_compute_robot_state-ego": 0.040497317242978226, "sim_compute_robot_state-npc0": 0.03967960912789872, "sim_compute_robot_state-npc1": 0.03886110391189803, "sim_compute_robot_state-npc2": 0.0385749980584899, "sim_compute_robot_state-npc3": 0.038749554264011665}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7414594899441834, "sim_physics": 0.09273102939528909, "survival_time": 7.449999999999981, "driven_lanedir": 0.721858504154008, "sim_render-ego": 0.03486212788012204, "in-drivable-lane": 0, "agent_compute-ego": 0.142472505569458, "deviation-heading": 1.54403723100336, "set_robot_commands": 0.05379382715929275, "deviation-center-line": 0.502780561610695, "driven_lanedir_consec": 0.721858504154008, "sim_compute_sim_state": 0.0221921277526241, "sim_compute_performance-ego": 0.0379980458509202, "sim_compute_robot_state-ego": 0.04017216407212635, "sim_compute_robot_state-npc0": 0.03966037219002743, "sim_compute_robot_state-npc1": 0.039093121586229976, "sim_compute_robot_state-npc2": 0.038702188722239246, "sim_compute_robot_state-npc3": 0.03879737693991437}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5746177764942553, "sim_physics": 0.08303946113586426, "survival_time": 6.249999999999986, "driven_lanedir": 0.24995251430571308, "sim_render-ego": 0.03450054740905762, "in-drivable-lane": 2.6999999999999904, "agent_compute-ego": 0.1415359992980957, "deviation-heading": 1.7101667772152096, "set_robot_commands": 0.05394504928588867, "deviation-center-line": 0.21537895524794728, "driven_lanedir_consec": 0.24995251430571308, "sim_compute_sim_state": 0.022240015029907228, "sim_compute_performance-ego": 0.03822783088684082, "sim_compute_robot_state-ego": 0.040259922027587894, "sim_compute_robot_state-npc0": 0.03959039878845215, "sim_compute_robot_state-npc1": 0.03877754783630371, "sim_compute_robot_state-npc2": 0.03862243843078613, "sim_compute_robot_state-npc3": 0.03876107978820801}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5737507213534986, "sim_physics": 0.08939439427536146, "survival_time": 5.649999999999988, "driven_lanedir": 0.25041505558033306, "sim_render-ego": 0.03505208007002299, "in-drivable-lane": 2.199999999999992, "agent_compute-ego": 0.14249171619921658, "deviation-heading": 1.6011030791933836, "set_robot_commands": 0.0562770493262637, "deviation-center-line": 0.200283345726444, "driven_lanedir_consec": 0.25041505558033306, "sim_compute_sim_state": 0.02227118373972125, "sim_compute_performance-ego": 0.03820469105138188, "sim_compute_robot_state-ego": 0.040148445990233296, "sim_compute_robot_state-npc0": 0.03980777115948432, "sim_compute_robot_state-npc1": 0.03888515877512704, "sim_compute_robot_state-npc2": 0.03866351389251979, "sim_compute_robot_state-npc3": 0.03917710127028744}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3828625879524511, "sim_physics": 0.08745633380513795, "survival_time": 3.5499999999999954, "driven_lanedir": 0.3675080545743271, "sim_render-ego": 0.03533963082541882, "in-drivable-lane": 0, "agent_compute-ego": 0.14224610530154805, "deviation-heading": 0.8903091529774714, "set_robot_commands": 0.05418194179803553, "deviation-center-line": 0.2965447427870658, "driven_lanedir_consec": 0.3675080545743271, "sim_compute_sim_state": 0.02230795336441255, "sim_compute_performance-ego": 0.03796863555908203, "sim_compute_robot_state-ego": 0.04018960200564962, "sim_compute_robot_state-npc0": 0.04298190667595662, "sim_compute_robot_state-npc1": 0.03882207333202094, "sim_compute_robot_state-npc2": 0.03931924994562713, "sim_compute_robot_state-npc3": 0.03877376502668354}}
set_robot_commands_max0.0562770493262637
set_robot_commands_mean0.05445929865015484
set_robot_commands_median0.05409862568129355
set_robot_commands_min0.05379382715929275
sim_compute_performance-ego_max0.03822783088684082
sim_compute_performance-ego_mean0.038108072643435395
sim_compute_performance-ego_median0.03814115986895206
sim_compute_performance-ego_min0.03796863555908203
sim_compute_robot_state-ego_max0.040497317242978226
sim_compute_robot_state-ego_mean0.040253490267715075
sim_compute_robot_state-ego_median0.04018960200564962
sim_compute_robot_state-ego_min0.040148445990233296
sim_compute_robot_state-npc0_max0.04298190667595662
sim_compute_robot_state-npc0_mean0.04034401158836384
sim_compute_robot_state-npc0_median0.03967960912789872
sim_compute_robot_state-npc0_min0.03959039878845215
sim_compute_robot_state-npc1_max0.039093121586229976
sim_compute_robot_state-npc1_mean0.038887801088315944
sim_compute_robot_state-npc1_median0.03886110391189803
sim_compute_robot_state-npc1_min0.03877754783630371
sim_compute_robot_state-npc2_max0.03931924994562713
sim_compute_robot_state-npc2_mean0.03877647780993245
sim_compute_robot_state-npc2_median0.03866351389251979
sim_compute_robot_state-npc2_min0.0385749980584899
sim_compute_robot_state-npc3_max0.03917710127028744
sim_compute_robot_state-npc3_mean0.038851775457820995
sim_compute_robot_state-npc3_median0.03877376502668354
sim_compute_robot_state-npc3_min0.038749554264011665
sim_compute_sim_state_max0.02230795336441255
sim_compute_sim_state_mean0.022238079545990285
sim_compute_sim_state_median0.022240015029907228
sim_compute_sim_state_min0.02217911784328631
sim_physics_max0.09723767593725403
sim_physics_mean0.08997177890978135
sim_physics_median0.08939439427536146
sim_physics_min0.08303946113586426
sim_render-ego_max0.03536459937024472
sim_render-ego_mean0.03502379711097324
sim_render-ego_median0.03505208007002299
sim_render-ego_min0.03450054740905762
simulation-passed1
survival_time_max7.449999999999981
survival_time_mean5.9199999999999875
survival_time_min3.5499999999999954
No reset possible
240793874Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:07:25
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240783873Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:16:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.225963669352753
survival_time_median14.700000000000074
deviation-center-line_median0.32499624241951536
in-drivable-lane_median1.9500000000000275


other stats
agent_compute-ego_max0.12095973457115285
agent_compute-ego_mean0.11885629021748056
agent_compute-ego_median0.11859255205860454
agent_compute-ego_min0.11753423611323038
deviation-center-line_max0.5197457509417088
deviation-center-line_mean0.3545294018982278
deviation-center-line_min0.27188759915307575
deviation-heading_max2.821300237394604
deviation-heading_mean1.525743687194269
deviation-heading_median1.154542704336736
deviation-heading_min0.9169501529164946
driven_any_max1.6123967099239709
driven_any_mean1.2086815900426546
driven_any_median1.412550742658916
driven_any_min0.39715175640098854
driven_lanedir_consec_max1.4073403927561352
driven_lanedir_consec_mean0.9760534268685678
driven_lanedir_consec_min0.3775597171788704
driven_lanedir_max1.4073403927561352
driven_lanedir_mean0.9767608362686996
driven_lanedir_median1.225963669352753
driven_lanedir_min0.3775597171788704
in-drivable-lane_max3.600000000000051
in-drivable-lane_mean1.760000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.029522663409033, "sim_physics": 0.08818714658199753, "survival_time": 9.049999999999994, "driven_lanedir": 0.6347961055068527, "sim_render-ego": 0.03647119564246078, "in-drivable-lane": 3.250000000000006, "agent_compute-ego": 0.11859255205860454, "deviation-heading": 1.154542704336736, "set_robot_commands": 0.054130670115434, "deviation-center-line": 0.30726351636942645, "driven_lanedir_consec": 0.6347961055068527, "sim_compute_sim_state": 0.02279914281644874, "sim_compute_performance-ego": 0.0388902867037947, "sim_compute_robot_state-ego": 0.04077567975165436, "sim_compute_robot_state-npc0": 0.04054103898738629, "sim_compute_robot_state-npc1": 0.04026242646064548, "sim_compute_robot_state-npc2": 0.039531373187323304, "sim_compute_robot_state-npc3": 0.0395660400390625}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.412550742658916, "sim_physics": 0.09398037830988566, "survival_time": 14.950000000000076, "driven_lanedir": 1.4073403927561352, "sim_render-ego": 0.03592634757359823, "in-drivable-lane": 0, "agent_compute-ego": 0.11753423611323038, "deviation-heading": 0.9723549014458814, "set_robot_commands": 0.05386878331502279, "deviation-center-line": 0.5197457509417088, "driven_lanedir_consec": 1.4073403927561352, "sim_compute_sim_state": 0.022815579573313396, "sim_compute_performance-ego": 0.03879493395487467, "sim_compute_robot_state-ego": 0.04076599915822347, "sim_compute_robot_state-npc0": 0.040391914049784344, "sim_compute_robot_state-npc1": 0.041047099431355795, "sim_compute_robot_state-npc2": 0.039551221529642744, "sim_compute_robot_state-npc3": 0.03993306636810303}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6123967099239709, "sim_physics": 0.08588542620340983, "survival_time": 14.950000000000076, "driven_lanedir": 1.2381442965488854, "sim_render-ego": 0.0360284686088562, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.11834374268849691, "deviation-heading": 2.821300237394604, "set_robot_commands": 0.05421180804570516, "deviation-center-line": 0.3487539006074123, "driven_lanedir_consec": 1.2346072495482274, "sim_compute_sim_state": 0.022870856126149496, "sim_compute_performance-ego": 0.03919635852177938, "sim_compute_robot_state-ego": 0.040853374004364014, "sim_compute_robot_state-npc0": 0.04173196077346802, "sim_compute_robot_state-npc1": 0.040239235560099285, "sim_compute_robot_state-npc2": 0.039914185206095375, "sim_compute_robot_state-npc3": 0.039761478106180824}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5917860778203643, "sim_physics": 0.088339461761267, "survival_time": 14.700000000000074, "driven_lanedir": 1.225963669352753, "sim_render-ego": 0.03723057678767613, "in-drivable-lane": 3.600000000000051, "agent_compute-ego": 0.11885118565591823, "deviation-heading": 1.7635704398776282, "set_robot_commands": 0.05473826288365993, "deviation-center-line": 0.27188759915307575, "driven_lanedir_consec": 1.225963669352753, "sim_compute_sim_state": 0.02306052454474832, "sim_compute_performance-ego": 0.03891507379051779, "sim_compute_robot_state-ego": 0.040728917738207346, "sim_compute_robot_state-npc0": 0.04116316474213892, "sim_compute_robot_state-npc1": 0.03984445374028212, "sim_compute_robot_state-npc2": 0.03991079087160072, "sim_compute_robot_state-npc3": 0.03976367363313429}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.39715175640098854, "sim_physics": 0.08445552812106367, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3775597171788704, "sim_render-ego": 0.0364157289698504, "in-drivable-lane": 0, "agent_compute-ego": 0.12095973457115285, "deviation-heading": 0.9169501529164946, "set_robot_commands": 0.05389442996702332, "deviation-center-line": 0.32499624241951536, "driven_lanedir_consec": 0.3775597171788704, "sim_compute_sim_state": 0.022905408472254658, "sim_compute_performance-ego": 0.03891054443691088, "sim_compute_robot_state-ego": 0.04058672725290492, "sim_compute_robot_state-npc0": 0.04090702015420665, "sim_compute_robot_state-npc1": 0.039649248123168945, "sim_compute_robot_state-npc2": 0.03951226801112078, "sim_compute_robot_state-npc3": 0.03950456950975501}}
set_robot_commands_max0.05473826288365993
set_robot_commands_mean0.05416879086536904
set_robot_commands_median0.054130670115434
set_robot_commands_min0.05386878331502279
sim_compute_performance-ego_max0.03919635852177938
sim_compute_performance-ego_mean0.03894143948157548
sim_compute_performance-ego_median0.03891054443691088
sim_compute_performance-ego_min0.03879493395487467
sim_compute_robot_state-ego_max0.040853374004364014
sim_compute_robot_state-ego_mean0.04074213958107083
sim_compute_robot_state-ego_median0.04076599915822347
sim_compute_robot_state-ego_min0.04058672725290492
sim_compute_robot_state-npc0_max0.04173196077346802
sim_compute_robot_state-npc0_mean0.04094701974139685
sim_compute_robot_state-npc0_median0.04090702015420665
sim_compute_robot_state-npc0_min0.040391914049784344
sim_compute_robot_state-npc1_max0.041047099431355795
sim_compute_robot_state-npc1_mean0.04020849266311032
sim_compute_robot_state-npc1_median0.040239235560099285
sim_compute_robot_state-npc1_min0.039649248123168945
sim_compute_robot_state-npc2_max0.039914185206095375
sim_compute_robot_state-npc2_mean0.03968396776115658
sim_compute_robot_state-npc2_median0.039551221529642744
sim_compute_robot_state-npc2_min0.03951226801112078
sim_compute_robot_state-npc3_max0.03993306636810303
sim_compute_robot_state-npc3_mean0.039705765531247134
sim_compute_robot_state-npc3_median0.039761478106180824
sim_compute_robot_state-npc3_min0.03950456950975501
sim_compute_sim_state_max0.02306052454474832
sim_compute_sim_state_mean0.02289030230658292
sim_compute_sim_state_median0.022870856126149496
sim_compute_sim_state_min0.02279914281644874
sim_physics_max0.09398037830988566
sim_physics_mean0.08816958819552474
sim_physics_median0.08818714658199753
sim_physics_min0.08445552812106367
sim_render-ego_max0.03723057678767613
sim_render-ego_mean0.036414463516488346
sim_render-ego_median0.0364157289698504
sim_render-ego_min0.03592634757359823
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.420000000000044
survival_time_min3.4499999999999957
No reset possible
240773872Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:15:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240763871Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:10:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240753870Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:03:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240683858Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflow-keneaido2-LF-sim-testing-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240673864Kenechukwu Nnodu 🇨🇦Baseline-IL-logs-tensorflow-keneaido2-LFVI-sim-testing-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:03:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240583848Junghyun Seo 🇨🇦challenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:08:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1229443581134273
survival_time_median1.3500000000000003
deviation-center-line_median0.07666609549956557
in-drivable-lane_median0


other stats
agent_compute-ego_max0.11029372612635296
agent_compute-ego_mean0.09718670064441325
agent_compute-ego_median0.09571255170381986
agent_compute-ego_min0.09446550499309192
deviation-center-line_max0.13280535346761538
deviation-center-line_mean0.08341721544931532
deviation-center-line_min0.044634091985992545
deviation-heading_max1.0509843201450328
deviation-heading_mean0.7268228368430759
deviation-heading_median0.7571356106125486
deviation-heading_min0.4407891421364369
driven_any_max0.24341132515354225
driven_any_mean0.1782360757850334
driven_any_median0.17394321290463016
driven_any_min0.1231734531965312
driven_lanedir_consec_max0.19202791779080508
driven_lanedir_consec_mean0.11795308596805625
driven_lanedir_consec_min0.058553136577239595
driven_lanedir_max0.19202791779080508
driven_lanedir_mean0.11795308596805625
driven_lanedir_median0.1229443581134273
driven_lanedir_min0.058553136577239595
in-drivable-lane_max0.4500000000000004
in-drivable-lane_mean0.08000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21784388970386043, "sim_physics": 0.059850431978702545, "survival_time": 1.6000000000000008, "driven_lanedir": 0.13562462050107582, "sim_render-ego": 0.03619995713233948, "in-drivable-lane": 0, "agent_compute-ego": 0.10377609729766846, "deviation-heading": 1.0509843201450328, "set_robot_commands": 0.055401675403118134, "deviation-center-line": 0.10424047374846002, "driven_lanedir_consec": 0.13562462050107582, "sim_compute_sim_state": 0.023091517388820648, "sim_compute_performance-ego": 0.03881244361400604, "sim_compute_robot_state-ego": 0.040485478937625885}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24341132515354225, "sim_physics": 0.059744467054094585, "survival_time": 1.7500000000000009, "driven_lanedir": 0.17236304027848937, "sim_render-ego": 0.03575107710702079, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09633346966334752, "deviation-heading": 0.8881560403107783, "set_robot_commands": 0.05454801150730678, "deviation-center-line": 0.06549435431208495, "driven_lanedir_consec": 0.17236304027848937, "sim_compute_sim_state": 0.02344212532043457, "sim_compute_performance-ego": 0.039439208166939875, "sim_compute_robot_state-ego": 0.04088039398193359}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1231734531965312, "sim_physics": 0.05874059313819522, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09414985618509952, "sim_render-ego": 0.035969745545160206, "in-drivable-lane": 0, "agent_compute-ego": 0.0961693014417376, "deviation-heading": 0.5586926307322083, "set_robot_commands": 0.05385372752235049, "deviation-center-line": 0.09794670099385716, "driven_lanedir_consec": 0.09414985618509952, "sim_compute_sim_state": 0.02333891959417434, "sim_compute_performance-ego": 0.039209116072881786, "sim_compute_robot_state-ego": 0.040715172177269346}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.17633006573155224, "sim_physics": 0.06504533208649733, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07616191045725307, "sim_render-ego": 0.03674069766340585, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09720968378001246, "deviation-heading": 0.9805094729677124, "set_robot_commands": 0.05557279751218598, "deviation-center-line": 0.06413429802505513, "driven_lanedir_consec": 0.07616191045725307, "sim_compute_sim_state": 0.023410164076706454, "sim_compute_performance-ego": 0.03890867068849761, "sim_compute_robot_state-ego": 0.04067992341929469}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22275054588977952, "sim_physics": 0.06380349217039166, "survival_time": 1.6500000000000008, "driven_lanedir": 0.14638465078058038, "sim_render-ego": 0.03652576966719194, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09683557712670528, "deviation-heading": 0.8492114904895192, "set_robot_commands": 0.0578853144790187, "deviation-center-line": 0.0712737219748357, "driven_lanedir_consec": 0.14638465078058038, "sim_compute_sim_state": 0.02341732834324692, "sim_compute_performance-ego": 0.039356202790231415, "sim_compute_robot_state-ego": 0.04107469500917377}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18773213486094453, "sim_physics": 0.06225159764289856, "survival_time": 1.6000000000000008, "driven_lanedir": 0.058553136577239595, "sim_render-ego": 0.03682372719049454, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09568683058023451, "deviation-heading": 0.8976997876744849, "set_robot_commands": 0.05429675430059433, "deviation-center-line": 0.06037512768288391, "driven_lanedir_consec": 0.058553136577239595, "sim_compute_sim_state": 0.023168981075286865, "sim_compute_performance-ego": 0.03872343897819519, "sim_compute_robot_state-ego": 0.04045236110687256}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.2251873551058529, "sim_physics": 0.06152981122334798, "survival_time": 1.5000000000000009, "driven_lanedir": 0.19202791779080508, "sim_render-ego": 0.035486761728922525, "in-drivable-lane": 0, "agent_compute-ego": 0.09548126856486004, "deviation-heading": 0.5836644222385844, "set_robot_commands": 0.053549154599507647, "deviation-center-line": 0.10143054101209424, "driven_lanedir_consec": 0.19202791779080508, "sim_compute_sim_state": 0.023042448361714683, "sim_compute_performance-ego": 0.03862470785776774, "sim_compute_robot_state-ego": 0.04034092426300049}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13775473224063794, "sim_physics": 0.05523665384812789, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1051179778500404, "sim_render-ego": 0.035022063688798385, "in-drivable-lane": 0, "agent_compute-ego": 0.09446550499309192, "deviation-heading": 0.5783914395686329, "set_robot_commands": 0.0543942776593295, "deviation-center-line": 0.10137170634845805, "driven_lanedir_consec": 0.1051179778500404, "sim_compute_sim_state": 0.023315711454911667, "sim_compute_performance-ego": 0.03868713162162087, "sim_compute_robot_state-ego": 0.04071886972947554}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14382652503473223, "sim_physics": 0.05701860097738413, "survival_time": 1.3000000000000005, "driven_lanedir": 0.07639718955321007, "sim_render-ego": 0.03588681037609394, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0946797040792612, "deviation-heading": 0.7775430075810775, "set_robot_commands": 0.05432403087615967, "deviation-center-line": 0.044634091985992545, "driven_lanedir_consec": 0.07639718955321007, "sim_compute_sim_state": 0.023384992892925557, "sim_compute_performance-ego": 0.03883211429302509, "sim_compute_robot_state-ego": 0.04079767373891977}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.16575475257370412, "sim_physics": 0.0612483574793889, "survival_time": 1.3000000000000005, "driven_lanedir": 0.128276307911535, "sim_render-ego": 0.04227846402388353, "in-drivable-lane": 0, "agent_compute-ego": 0.09571255170381986, "deviation-heading": 0.5991811933956286, "set_robot_commands": 0.05450230378371019, "deviation-center-line": 0.09840410208342552, "driven_lanedir_consec": 0.128276307911535, "sim_compute_sim_state": 0.023311449931218073, "sim_compute_performance-ego": 0.039297085541945234, "sim_compute_robot_state-ego": 0.04104258463932918}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1586243662901447, "sim_physics": 0.06124300003051758, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1264633834032557, "sim_render-ego": 0.04200637817382812, "in-drivable-lane": 0, "agent_compute-ego": 0.09501618385314942, "deviation-heading": 0.5191351250629405, "set_robot_commands": 0.05459192276000977, "deviation-center-line": 0.11102855621744924, "driven_lanedir_consec": 0.1264633834032557, "sim_compute_sim_state": 0.023310766220092777, "sim_compute_performance-ego": 0.03858145713806152, "sim_compute_robot_state-ego": 0.0406609058380127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14532602778681517, "sim_physics": 0.06638988852500916, "survival_time": 1.2000000000000004, "driven_lanedir": 0.10552075516404393, "sim_render-ego": 0.036208927631378174, "in-drivable-lane": 0, "agent_compute-ego": 0.11029372612635296, "deviation-heading": 0.6433314660550675, "set_robot_commands": 0.05407660206158956, "deviation-center-line": 0.07666609549956557, "driven_lanedir_consec": 0.10552075516404393, "sim_compute_sim_state": 0.023110419511795044, "sim_compute_performance-ego": 0.03887237111727397, "sim_compute_robot_state-ego": 0.04650078217188517}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18283249884991845, "sim_physics": 0.05930591374635696, "survival_time": 1.6000000000000008, "driven_lanedir": 0.08043569777929549, "sim_render-ego": 0.03660367429256439, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09504076093435287, "deviation-heading": 0.7779174036754858, "set_robot_commands": 0.05382777750492096, "deviation-center-line": 0.053782878450133, "driven_lanedir_consec": 0.08043569777929549, "sim_compute_sim_state": 0.023179173469543457, "sim_compute_performance-ego": 0.03899698704481125, "sim_compute_robot_state-ego": 0.04077526181936264}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16905025145285457, "sim_physics": 0.05866719209230863, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1229443581134273, "sim_render-ego": 0.03519900028522198, "in-drivable-lane": 0, "agent_compute-ego": 0.09491450969989484, "deviation-heading": 0.7571356106125486, "set_robot_commands": 0.05364535405085637, "deviation-center-line": 0.06767022993781907, "driven_lanedir_consec": 0.1229443581134273, "sim_compute_sim_state": 0.023006109090951778, "sim_compute_performance-ego": 0.03866552389585055, "sim_compute_robot_state-ego": 0.04037053768451397}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.17394321290463016, "sim_physics": 0.05840714772542318, "survival_time": 1.3500000000000003, "driven_lanedir": 0.14887548717549315, "sim_render-ego": 0.036333931816948786, "in-drivable-lane": 0, "agent_compute-ego": 0.09618533982170951, "deviation-heading": 0.4407891421364369, "set_robot_commands": 0.05514686195938675, "deviation-center-line": 0.13280535346761538, "driven_lanedir_consec": 0.14887548717549315, "sim_compute_sim_state": 0.023279825846354168, "sim_compute_performance-ego": 0.03884870917708785, "sim_compute_robot_state-ego": 0.040822894484908494}}
set_robot_commands_max0.0578853144790187
set_robot_commands_mean0.05464110439866966
set_robot_commands_median0.0543942776593295
set_robot_commands_min0.053549154599507647
sim_compute_performance-ego_max0.039439208166939875
sim_compute_performance-ego_mean0.0389236778665464
sim_compute_performance-ego_median0.03884870917708785
sim_compute_performance-ego_min0.03858145713806152
sim_compute_robot_state-ego_max0.04650078217188517
sim_compute_robot_state-ego_mean0.04108789726677186
sim_compute_robot_state-ego_median0.04071886972947554
sim_compute_robot_state-ego_min0.04034092426300049
sim_compute_sim_state_max0.02344212532043457
sim_compute_sim_state_mean0.0232539955052118
sim_compute_sim_state_median0.023310766220092777
sim_compute_sim_state_min0.023006109090951778
sim_physics_max0.06638988852500916
sim_physics_mean0.060565498647909624
sim_physics_median0.059850431978702545
sim_physics_min0.05523665384812789
sim_render-ego_max0.04227846402388353
sim_render-ego_mean0.036869132421550176
sim_render-ego_median0.036208927631378174
sim_render-ego_min0.035022063688798385
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.4000000000000008
survival_time_min1.0500000000000005
No reset possible
240553851Junghyun Seo 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.06947524826232065
survival_time_median1.3000000000000005
deviation-center-line_median0.06512377432009957
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.16704841454823813
agent_compute-ego_mean0.1450840945902538
agent_compute-ego_median0.1480418806490691
agent_compute-ego_min0.12042725086212158
deviation-center-line_max0.09912182735535308
deviation-center-line_mean0.06956223729060027
deviation-center-line_min0.034221115106860704
deviation-heading_max0.9568908317311412
deviation-heading_mean0.7331424734268113
deviation-heading_median0.6918688301065948
deviation-heading_min0.6093679154268812
driven_any_max0.2664548389627696
driven_any_mean0.16158241740697565
driven_any_median0.16635266971035748
driven_any_min0.09830786333507666
driven_lanedir_consec_max0.14117875567636862
driven_lanedir_consec_mean0.07727458275898706
driven_lanedir_consec_min0.05206771627714435
driven_lanedir_max0.14117875567636862
driven_lanedir_mean0.07727458275898706
driven_lanedir_median0.06947524826232065
driven_lanedir_min0.05206771627714435
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.2600000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2216939397145425, "sim_physics": 0.18235335085127088, "survival_time": 1.800000000000001, "driven_lanedir": 0.07943468613563676, "sim_render-ego": 0.056959728399912514, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.16704841454823813, "deviation-heading": 0.6918688301065948, "set_robot_commands": 0.09787617127100628, "deviation-center-line": 0.05811903637043487, "driven_lanedir_consec": 0.07943468613563676, "sim_compute_sim_state": 0.03633320331573486, "sim_compute_performance-ego": 0.06499005688561334, "sim_compute_robot_state-ego": 0.07335406541824341, "sim_compute_robot_state-npc0": 0.06719151470396253, "sim_compute_robot_state-npc1": 0.07012327512105306, "sim_compute_robot_state-npc2": 0.07034833563698663, "sim_compute_robot_state-npc3": 0.0688115225897895}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20615819948533312, "sim_physics": 0.1589486522059287, "survival_time": 1.5500000000000007, "driven_lanedir": 0.09157991248925246, "sim_render-ego": 0.05703136228745984, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16113135122483777, "deviation-heading": 0.9568908317311412, "set_robot_commands": 0.09058475494384766, "deviation-center-line": 0.07001847109510527, "driven_lanedir_consec": 0.09157991248925246, "sim_compute_sim_state": 0.039651801509241906, "sim_compute_performance-ego": 0.061763078935684695, "sim_compute_robot_state-ego": 0.06340051466418851, "sim_compute_robot_state-npc0": 0.06369275431479177, "sim_compute_robot_state-npc1": 0.06507884302446919, "sim_compute_robot_state-npc2": 0.0643343617839198, "sim_compute_robot_state-npc3": 0.06955517491986675}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.09830786333507666, "sim_physics": 0.20347898939381476, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06330370880935465, "sim_render-ego": 0.06764827603879182, "in-drivable-lane": 0, "agent_compute-ego": 0.1480418806490691, "deviation-heading": 0.6093679154268812, "set_robot_commands": 0.09097525347834048, "deviation-center-line": 0.09912182735535308, "driven_lanedir_consec": 0.06330370880935465, "sim_compute_sim_state": 0.04063751386559528, "sim_compute_performance-ego": 0.0745113932568094, "sim_compute_robot_state-ego": 0.07761051343834918, "sim_compute_robot_state-npc0": 0.06494205930958623, "sim_compute_robot_state-npc1": 0.06941005458002505, "sim_compute_robot_state-npc2": 0.06838686569877293, "sim_compute_robot_state-npc3": 0.07157523735709813}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1133320044931791, "sim_physics": 0.1933247184753418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.06814144662571531, "sim_render-ego": 0.05544223785400391, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15899683952331542, "deviation-heading": 0.638366169946637, "set_robot_commands": 0.08558884620666504, "deviation-center-line": 0.09466029891830084, "driven_lanedir_consec": 0.06814144662571531, "sim_compute_sim_state": 0.03705830574035644, "sim_compute_performance-ego": 0.05993223190307617, "sim_compute_robot_state-ego": 0.06578329086303711, "sim_compute_robot_state-npc0": 0.060085411071777346, "sim_compute_robot_state-npc1": 0.060624094009399415, "sim_compute_robot_state-npc2": 0.06081487655639648, "sim_compute_robot_state-npc3": 0.05813167572021485}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1360913024836359, "sim_physics": 0.1206211126767672, "survival_time": 1.3000000000000005, "driven_lanedir": 0.062190920984986575, "sim_render-ego": 0.041885201747600846, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1210268002289992, "deviation-heading": 0.8365001779512337, "set_robot_commands": 0.06595696852757381, "deviation-center-line": 0.04654452675863551, "driven_lanedir_consec": 0.062190920984986575, "sim_compute_sim_state": 0.027146293566777155, "sim_compute_performance-ego": 0.04698711175184984, "sim_compute_robot_state-ego": 0.04767457338479849, "sim_compute_robot_state-npc0": 0.04708421230316162, "sim_compute_robot_state-npc1": 0.045769498898432806, "sim_compute_robot_state-npc2": 0.04547284199641301, "sim_compute_robot_state-npc3": 0.0462725804402278}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2156692827764211, "sim_physics": 0.1782274674146603, "survival_time": 1.950000000000001, "driven_lanedir": 0.06947524826232065, "sim_render-ego": 0.06243216685759716, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16631625860165328, "deviation-heading": 0.6906570612038296, "set_robot_commands": 0.09298043373303536, "deviation-center-line": 0.04774932989614036, "driven_lanedir_consec": 0.06947524826232065, "sim_compute_sim_state": 0.04152528444925944, "sim_compute_performance-ego": 0.07140862024747409, "sim_compute_robot_state-ego": 0.0779262016981076, "sim_compute_robot_state-npc0": 0.06909989699339256, "sim_compute_robot_state-npc1": 0.0684819649427365, "sim_compute_robot_state-npc2": 0.06957450891152406, "sim_compute_robot_state-npc3": 0.06881208908863556}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.11992072199147588, "sim_physics": 0.1927576706959651, "survival_time": 1.3000000000000005, "driven_lanedir": 0.05373239123963269, "sim_render-ego": 0.058785502727215104, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.15995104496295637, "deviation-heading": 0.6137971284761422, "set_robot_commands": 0.09189346203437218, "deviation-center-line": 0.06512377432009957, "driven_lanedir_consec": 0.05373239123963269, "sim_compute_sim_state": 0.03601824320279635, "sim_compute_performance-ego": 0.06257947591634896, "sim_compute_robot_state-ego": 0.06917618788205661, "sim_compute_robot_state-npc0": 0.06844513232891376, "sim_compute_robot_state-npc1": 0.05966759645021879, "sim_compute_robot_state-npc2": 0.06216304118816669, "sim_compute_robot_state-npc3": 0.0634528581912701}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10322377002716536, "sim_physics": 0.16976577043533325, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05775063107126677, "sim_render-ego": 0.058421184619267784, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16690322756767273, "deviation-heading": 0.635272022705146, "set_robot_commands": 0.08777597546577454, "deviation-center-line": 0.08173861480172218, "driven_lanedir_consec": 0.05775063107126677, "sim_compute_sim_state": 0.03720415631930033, "sim_compute_performance-ego": 0.06373035907745361, "sim_compute_robot_state-ego": 0.06808560093243916, "sim_compute_robot_state-npc0": 0.06465348601341248, "sim_compute_robot_state-npc1": 0.06982527176539104, "sim_compute_robot_state-npc2": 0.0665293534596761, "sim_compute_robot_state-npc3": 0.06590592861175537}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2664548389627696, "sim_physics": 0.1790088176727295, "survival_time": 2.000000000000001, "driven_lanedir": 0.14117875567636862, "sim_render-ego": 0.06046784520149231, "in-drivable-lane": 0.5000000000000002, "agent_compute-ego": 0.16685298681259156, "deviation-heading": 0.7666971028646175, "set_robot_commands": 0.08462631702423096, "deviation-center-line": 0.04455787468573659, "driven_lanedir_consec": 0.14117875567636862, "sim_compute_sim_state": 0.03818677663803101, "sim_compute_performance-ego": 0.06707600355148316, "sim_compute_robot_state-ego": 0.07247701287269592, "sim_compute_robot_state-npc0": 0.06787875890731812, "sim_compute_robot_state-npc1": 0.06965561509132386, "sim_compute_robot_state-npc2": 0.06925073266029358, "sim_compute_robot_state-npc3": 0.06856895685195923}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1684502708468383, "sim_physics": 0.1161815936748798, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0877210200270544, "sim_render-ego": 0.04508034999553974, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12891615354097807, "deviation-heading": 0.8684815001261574, "set_robot_commands": 0.06699111828437218, "deviation-center-line": 0.05669407424921031, "driven_lanedir_consec": 0.0877210200270544, "sim_compute_sim_state": 0.02840133813711313, "sim_compute_performance-ego": 0.04933460859151987, "sim_compute_robot_state-ego": 0.049698206094595104, "sim_compute_robot_state-npc0": 0.04773864379295936, "sim_compute_robot_state-npc1": 0.04714820935175969, "sim_compute_robot_state-npc2": 0.05010886375720684, "sim_compute_robot_state-npc3": 0.048369838641240046}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16635266971035748, "sim_physics": 0.13589370250701904, "survival_time": 1.6000000000000008, "driven_lanedir": 0.05206771627714435, "sim_render-ego": 0.04869455844163895, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1307450607419014, "deviation-heading": 0.842795983716735, "set_robot_commands": 0.07418506592512131, "deviation-center-line": 0.034221115106860704, "driven_lanedir_consec": 0.05206771627714435, "sim_compute_sim_state": 0.029382482171058655, "sim_compute_performance-ego": 0.0518643856048584, "sim_compute_robot_state-ego": 0.05227695405483246, "sim_compute_robot_state-npc0": 0.05606383830308914, "sim_compute_robot_state-npc1": 0.05469105392694473, "sim_compute_robot_state-npc2": 0.05288615822792053, "sim_compute_robot_state-npc3": 0.05510794371366501}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.11152707836209318, "sim_physics": 0.11044746095483954, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07430216811015633, "sim_render-ego": 0.04369520057331432, "in-drivable-lane": 0, "agent_compute-ego": 0.12042725086212158, "deviation-heading": 0.633161668341792, "set_robot_commands": 0.07578564773906361, "deviation-center-line": 0.09856101392100196, "driven_lanedir_consec": 0.07430216811015633, "sim_compute_sim_state": 0.02698223157362505, "sim_compute_performance-ego": 0.049310619180852715, "sim_compute_robot_state-ego": 0.05137376351789995, "sim_compute_robot_state-npc0": 0.0521550178527832, "sim_compute_robot_state-npc1": 0.05090663649819114, "sim_compute_robot_state-npc2": 0.05012174086137251, "sim_compute_robot_state-npc3": 0.051370891657742584}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.213121520801667, "sim_physics": 0.12741071299502724, "survival_time": 1.900000000000001, "driven_lanedir": 0.07342749917038549, "sim_render-ego": 0.0453889809156719, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.1218564698570653, "deviation-heading": 0.7208020674825103, "set_robot_commands": 0.06580694098221629, "deviation-center-line": 0.06432396279468568, "driven_lanedir_consec": 0.07342749917038549, "sim_compute_sim_state": 0.028651852356760127, "sim_compute_performance-ego": 0.04859908003556101, "sim_compute_robot_state-ego": 0.049504562428123074, "sim_compute_robot_state-npc0": 0.05017357123525519, "sim_compute_robot_state-npc1": 0.04988887435511539, "sim_compute_robot_state-npc2": 0.050419518822117856, "sim_compute_robot_state-npc3": 0.05154264600653397}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11543104782289168, "sim_physics": 0.12491594190182892, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06880245823933606, "sim_render-ego": 0.04531669616699219, "in-drivable-lane": 0, "agent_compute-ego": 0.13515500400377356, "deviation-heading": 0.687341124254223, "set_robot_commands": 0.06442269035007643, "deviation-center-line": 0.09017432794428108, "driven_lanedir_consec": 0.06880245823933606, "sim_compute_sim_state": 0.026953831962917164, "sim_compute_performance-ego": 0.047048641287762184, "sim_compute_robot_state-ego": 0.04680087255394977, "sim_compute_robot_state-npc0": 0.05067781780077064, "sim_compute_robot_state-npc1": 0.04745799562205439, "sim_compute_robot_state-npc2": 0.04632307135540506, "sim_compute_robot_state-npc3": 0.04648586978083071}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1680017502911879, "sim_physics": 0.1303401651053593, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11601017826619486, "sim_render-ego": 0.0469716006311877, "in-drivable-lane": 0, "agent_compute-ego": 0.12289267572863348, "deviation-heading": 0.8051375170685292, "set_robot_commands": 0.07019320849714608, "deviation-center-line": 0.09182531114143604, "driven_lanedir_consec": 0.11601017826619486, "sim_compute_sim_state": 0.029662428231074893, "sim_compute_performance-ego": 0.051585526301943026, "sim_compute_robot_state-ego": 0.05165175733895137, "sim_compute_robot_state-npc0": 0.05113275297756853, "sim_compute_robot_state-npc1": 0.05358579240996262, "sim_compute_robot_state-npc2": 0.05109383319986278, "sim_compute_robot_state-npc3": 0.04864432071817333}}
set_robot_commands_max0.09787617127100628
set_robot_commands_mean0.08037619029752283
set_robot_commands_median0.08462631702423096
set_robot_commands_min0.06442269035007643
sim_compute_performance-ego_max0.0745113932568094
sim_compute_performance-ego_mean0.05804807950188603
sim_compute_performance-ego_median0.05993223190307617
sim_compute_performance-ego_min0.04698711175184984
sim_compute_robot_state-ego_max0.0779262016981076
sim_compute_robot_state-ego_mean0.06111960514281783
sim_compute_robot_state-ego_median0.06340051466418851
sim_compute_robot_state-ego_min0.04680087255394977
sim_compute_robot_state-npc0_max0.06909989699339256
sim_compute_robot_state-npc0_mean0.05873432452724949
sim_compute_robot_state-npc0_median0.060085411071777346
sim_compute_robot_state-npc0_min0.04708421230316162
sim_compute_robot_state-npc1_max0.07012327512105306
sim_compute_robot_state-npc1_mean0.05882098506980518
sim_compute_robot_state-npc1_median0.05966759645021879
sim_compute_robot_state-npc1_min0.045769498898432806
sim_compute_robot_state-npc2_max0.07034833563698663
sim_compute_robot_state-npc2_mean0.058521873607735655
sim_compute_robot_state-npc2_median0.06081487655639648
sim_compute_robot_state-npc2_min0.04547284199641301
sim_compute_robot_state-npc3_max0.07157523735709813
sim_compute_robot_state-npc3_mean0.05884050228593353
sim_compute_robot_state-npc3_median0.05813167572021485
sim_compute_robot_state-npc3_min0.0462725804402278
sim_compute_sim_state_max0.04152528444925944
sim_compute_sim_state_mean0.033586382869309456
sim_compute_sim_state_median0.03601824320279635
sim_compute_sim_state_min0.026953831962917164
sim_physics_max0.20347898939381476
sim_physics_mean0.15491174179738437
sim_physics_median0.1589486522059287
sim_physics_min0.11044746095483954
sim_render-ego_max0.06764827603879182
sim_render-ego_mean0.052948059497179074
sim_render-ego_median0.05544223785400391
sim_render-ego_min0.041885201747600846
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.4666666666666677
survival_time_min1.1000000000000003
No reset possible
240523855Junghyun Seo 🇨🇦challenge-aido_LF-template-pytorchaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10841242970988851
survival_time_median1.2000000000000004
deviation-center-line_median0.0785272864481927
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17366300929676404
agent_compute-ego_mean0.16165763564378377
agent_compute-ego_median0.16038896726525348
agent_compute-ego_min0.15099177153214163
deviation-center-line_max0.10137678827910948
deviation-center-line_mean0.08217518204448526
deviation-center-line_min0.06101048778196971
deviation-heading_max0.9811581264325268
deviation-heading_mean0.7196417831175996
deviation-heading_median0.816459206838672
deviation-heading_min0.4765154978536198
driven_any_max0.22408440128729695
driven_any_mean0.1701541383747119
driven_any_median0.14239899680454415
driven_any_min0.13840448083518486
driven_lanedir_consec_max0.12614560964674926
driven_lanedir_consec_mean0.1059152289990144
driven_lanedir_consec_min0.08715686275611012
driven_lanedir_max0.12614560964674926
driven_lanedir_mean0.1059152289990144
driven_lanedir_median0.10841242970988851
driven_lanedir_min0.08715686275611012
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.1100000000000001
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22408440128729695, "sim_physics": 0.20000138427271988, "survival_time": 1.6500000000000008, "driven_lanedir": 0.12614560964674926, "sim_render-ego": 0.057723558310306435, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.17366300929676404, "deviation-heading": 0.816459206838672, "set_robot_commands": 0.09098248048262164, "deviation-center-line": 0.0785272864481927, "driven_lanedir_consec": 0.12614560964674926, "sim_compute_sim_state": 0.040144761403401695, "sim_compute_performance-ego": 0.06353425979614258, "sim_compute_robot_state-ego": 0.07103196779886882, "sim_compute_robot_state-npc0": 0.06677364580559009, "sim_compute_robot_state-npc1": 0.06539917714668042, "sim_compute_robot_state-npc2": 0.06717796036691377, "sim_compute_robot_state-npc3": 0.07061535661870783}, "udem1-1-0": {"driven_any": 0.20562433161597565, "sim_physics": 0.21806523948907852, "survival_time": 1.6000000000000008, "driven_lanedir": 0.09918140686845732, "sim_render-ego": 0.06793069839477539, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.16751647740602493, "deviation-heading": 0.9811581264325268, "set_robot_commands": 0.08753719180822372, "deviation-center-line": 0.07412798602141865, "driven_lanedir_consec": 0.09918140686845732, "sim_compute_sim_state": 0.03910890966653824, "sim_compute_performance-ego": 0.07015541940927505, "sim_compute_robot_state-ego": 0.1072678044438362, "sim_compute_robot_state-npc0": 0.06583426147699356, "sim_compute_robot_state-npc1": 0.06724468618631363, "sim_compute_robot_state-npc2": 0.07822313904762268, "sim_compute_robot_state-npc3": 0.0713609978556633}, "udem1-2-0": {"driven_any": 0.14025848133055793, "sim_physics": 0.23656636735667352, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10841242970988851, "sim_render-ego": 0.06362561557603919, "in-drivable-lane": 0, "agent_compute-ego": 0.16038896726525348, "deviation-heading": 0.4765154978536198, "set_robot_commands": 0.09031105041503906, "deviation-center-line": 0.10137678827910948, "driven_lanedir_consec": 0.10841242970988851, "sim_compute_sim_state": 0.03902503718500552, "sim_compute_performance-ego": 0.06942088707633641, "sim_compute_robot_state-ego": 0.07832657772561778, "sim_compute_robot_state-npc0": 0.06632314557614534, "sim_compute_robot_state-npc1": 0.06504446527232295, "sim_compute_robot_state-npc2": 0.06802041634269383, "sim_compute_robot_state-npc3": 0.06594068071116573}, "udem1-3-0": {"driven_any": 0.13840448083518486, "sim_physics": 0.21385299641153083, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10867983601386676, "sim_render-ego": 0.05900790380394977, "in-drivable-lane": 0, "agent_compute-ego": 0.15099177153214163, "deviation-heading": 0.48578061144859186, "set_robot_commands": 0.08661710697671642, "deviation-center-line": 0.0958333616917358, "driven_lanedir_consec": 0.10867983601386676, "sim_compute_sim_state": 0.03655789209448773, "sim_compute_performance-ego": 0.06698414553766666, "sim_compute_robot_state-ego": 0.06967255343561587, "sim_compute_robot_state-npc0": 0.06803417205810547, "sim_compute_robot_state-npc1": 0.06968230786530868, "sim_compute_robot_state-npc2": 0.06875857062961745, "sim_compute_robot_state-npc3": 0.06878825892572818}, "udem1-4-0": {"driven_any": 0.14239899680454415, "sim_physics": 0.21248593926429749, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08715686275611012, "sim_render-ego": 0.06263730923334758, "in-drivable-lane": 0, "agent_compute-ego": 0.15572795271873474, "deviation-heading": 0.8382954730145875, "set_robot_commands": 0.08868125081062317, "deviation-center-line": 0.06101048778196971, "driven_lanedir_consec": 0.08715686275611012, "sim_compute_sim_state": 0.03820039828618368, "sim_compute_performance-ego": 0.07082422574361165, "sim_compute_robot_state-ego": 0.07698733607927959, "sim_compute_robot_state-npc0": 0.07029362519582112, "sim_compute_robot_state-npc1": 0.0717146893342336, "sim_compute_robot_state-npc2": 0.07128756244977315, "sim_compute_robot_state-npc3": 0.06453742583592732}}
set_robot_commands_max0.09098248048262164
set_robot_commands_mean0.0888258160986448
set_robot_commands_median0.08868125081062317
set_robot_commands_min0.08661710697671642
sim_compute_performance-ego_max0.07082422574361165
sim_compute_performance-ego_mean0.06818378751260647
sim_compute_performance-ego_median0.06942088707633641
sim_compute_performance-ego_min0.06353425979614258
sim_compute_robot_state-ego_max0.1072678044438362
sim_compute_robot_state-ego_mean0.08065724789664366
sim_compute_robot_state-ego_median0.07698733607927959
sim_compute_robot_state-ego_min0.06967255343561587
sim_compute_robot_state-npc0_max0.07029362519582112
sim_compute_robot_state-npc0_mean0.06745177002253111
sim_compute_robot_state-npc0_median0.06677364580559009
sim_compute_robot_state-npc0_min0.06583426147699356
sim_compute_robot_state-npc1_max0.0717146893342336
sim_compute_robot_state-npc1_mean0.06781706516097184
sim_compute_robot_state-npc1_median0.06724468618631363
sim_compute_robot_state-npc1_min0.06504446527232295
sim_compute_robot_state-npc2_max0.07822313904762268
sim_compute_robot_state-npc2_mean0.07069352976732417
sim_compute_robot_state-npc2_median0.06875857062961745
sim_compute_robot_state-npc2_min0.06717796036691377
sim_compute_robot_state-npc3_max0.0713609978556633
sim_compute_robot_state-npc3_mean0.06824854398943846
sim_compute_robot_state-npc3_median0.06878825892572818
sim_compute_robot_state-npc3_min0.06453742583592732
sim_compute_sim_state_max0.040144761403401695
sim_compute_sim_state_mean0.038607399727123376
sim_compute_sim_state_median0.03902503718500552
sim_compute_sim_state_min0.03655789209448773
sim_physics_max0.23656636735667352
sim_physics_mean0.21619438535886007
sim_physics_median0.21385299641153083
sim_physics_min0.20000138427271988
sim_render-ego_max0.06793069839477539
sim_render-ego_mean0.062185017063683665
sim_render-ego_median0.06263730923334758
sim_render-ego_min0.057723558310306435
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3500000000000003
survival_time_min1.1500000000000004
No reset possible
240513839Kenechukwu Nnodu 🇨🇦kene-template-randomaido2-LF-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.10567373340412722
agent_compute-ego_mean0.08828905747662495
agent_compute-ego_median0.08667568284638073
agent_compute-ego_min0.0853923515037254
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.05754892031351725, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.035991664286013005, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.08758476045396593, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0564713301482024, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.02311914496951633, "sim_compute_performance-ego": 0.038981000582377114, "sim_compute_robot_state-ego": 0.04060816323315656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.05988408537471995, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.03542415768492455, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.08681893348693848, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.055281849468455595, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.023221043979420385, "sim_compute_performance-ego": 0.039093728158988206, "sim_compute_robot_state-ego": 0.04029261832143746}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.06022742215324851, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.03663997089161592, "in-drivable-lane": 0, "agent_compute-ego": 0.08745193481445312, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.0554507760440602, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.02346003756803625, "sim_compute_performance-ego": 0.03938226138844209, "sim_compute_robot_state-ego": 0.04094175731434541}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.06408195495605469, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0368233585357666, "in-drivable-lane": 0, "agent_compute-ego": 0.09353622436523436, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.05487502098083496, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0234027099609375, "sim_compute_performance-ego": 0.03886502265930176, "sim_compute_robot_state-ego": 0.04064421653747559}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.05989903136144711, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0379552237595184, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.08655439751057685, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.05518694467182401, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.02320653577394123, "sim_compute_performance-ego": 0.03860976726193971, "sim_compute_robot_state-ego": 0.04137445401541794}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.05828631167509118, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.03635723736821389, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.08667568284638073, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.05492612780356894, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.02333019704234843, "sim_compute_performance-ego": 0.03892149244035993, "sim_compute_robot_state-ego": 0.040773975605867346}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.05630562560898917, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.03629807915006365, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.08677088788577489, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.0550339264529092, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.023259260824748447, "sim_compute_performance-ego": 0.038823923894337246, "sim_compute_robot_state-ego": 0.040748540844236104}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.061629352115449454, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.035855304627191456, "in-drivable-lane": 0, "agent_compute-ego": 0.0858741941906157, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.05450621105375744, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.023022765205019995, "sim_compute_performance-ego": 0.03853568576631092, "sim_compute_robot_state-ego": 0.040723164876302086}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.06176831358570164, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.03637610047550525, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.10567373340412722, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.057692580303903354, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.023932412519293317, "sim_compute_performance-ego": 0.03887203184224791, "sim_compute_robot_state-ego": 0.04041864912388688}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.06055666316639293, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.03635511831803755, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.08641171888871627, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.05523879744789817, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.023175920139659533, "sim_compute_performance-ego": 0.0387467471036044, "sim_compute_robot_state-ego": 0.04051625078374689}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.05767479500213227, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.0367173653144341, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.08637983148748224, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.05692771193269011, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.023354753271325843, "sim_compute_performance-ego": 0.03865686020293793, "sim_compute_robot_state-ego": 0.04058615882675369}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.06401261261531285, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.03719432864870344, "in-drivable-lane": 0, "agent_compute-ego": 0.08771087442125593, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.05498570203781128, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.023481317928859165, "sim_compute_performance-ego": 0.039391900811876567, "sim_compute_robot_state-ego": 0.04084088121141706}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.06086548636941349, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.03564663026847091, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.08567020472358255, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.05389673102135752, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.02332750021242628, "sim_compute_performance-ego": 0.03909013785567938, "sim_compute_robot_state-ego": 0.04132581692115933}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.0591787232293023, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.035411993662516274, "in-drivable-lane": 0, "agent_compute-ego": 0.0853923515037254, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.05345922929269296, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.022890550118905527, "sim_compute_performance-ego": 0.03824090074609827, "sim_compute_robot_state-ego": 0.0403399908984149}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.05713002821978401, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.03612395595101749, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.0858301321665446, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.05388251472921932, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02306206086102654, "sim_compute_performance-ego": 0.03844993254717659, "sim_compute_robot_state-ego": 0.04062299401152367}}
set_robot_commands_max0.057692580303903354
set_robot_commands_mean0.05518769689261237
set_robot_commands_median0.0550339264529092
set_robot_commands_min0.05345922929269296
sim_compute_performance-ego_max0.039391900811876567
sim_compute_performance-ego_mean0.038844092884111864
sim_compute_performance-ego_median0.03886502265930176
sim_compute_performance-ego_min0.03824090074609827
sim_compute_robot_state-ego_max0.04137445401541794
sim_compute_robot_state-ego_mean0.04071717550167606
sim_compute_robot_state-ego_median0.04064421653747559
sim_compute_robot_state-ego_min0.04029261832143746
sim_compute_sim_state_max0.023932412519293317
sim_compute_sim_state_mean0.023283080691697648
sim_compute_sim_state_median0.023259260824748447
sim_compute_sim_state_min0.022890550118905527
sim_physics_max0.06408195495605469
sim_physics_mean0.05993662171643711
sim_physics_median0.05989903136144711
sim_physics_min0.05630562560898917
sim_render-ego_max0.0379552237595184
sim_render-ego_mean0.0363446992627995
sim_render-ego_median0.03635511831803755
sim_render-ego_min0.035411993662516274
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
No reset possible
240503840Kenechukwu Nnodu 🇨🇦kene-template-randomaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240463846Kenechukwu Nnodu 🇨🇦kene-template-randomaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:09:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15225677550593508
agent_compute-ego_mean0.14105627559261852
agent_compute-ego_median0.14303297088259742
agent_compute-ego_min0.1305269173213414
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19762217545811137, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06303895877886422, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.15225677550593508, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09310173988342284, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03987477399125884, "sim_compute_performance-ego": 0.06963047800184805, "sim_compute_robot_state-ego": 0.07090689864339708, "sim_compute_robot_state-npc0": 0.06940295424642443, "sim_compute_robot_state-npc1": 0.0692497899260702, "sim_compute_robot_state-npc2": 0.06844821760926066, "sim_compute_robot_state-npc3": 0.06731489942043642}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.18520689010620117, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06220605543681553, "in-drivable-lane": 0, "agent_compute-ego": 0.1305269173213414, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.08470879282270159, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03708258696964809, "sim_compute_performance-ego": 0.06477619068963188, "sim_compute_robot_state-ego": 0.07441197974341256, "sim_compute_robot_state-npc0": 0.06683300222669329, "sim_compute_robot_state-npc1": 0.06334818261010307, "sim_compute_robot_state-npc2": 0.06345361471176147, "sim_compute_robot_state-npc3": 0.06284972599574498}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18714643219142285, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05948456282754546, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14676795653926517, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08900121346260738, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03761644270813581, "sim_compute_performance-ego": 0.06518250298731536, "sim_compute_robot_state-ego": 0.07082680822576135, "sim_compute_robot_state-npc0": 0.06427738967451077, "sim_compute_robot_state-npc1": 0.06579373878182716, "sim_compute_robot_state-npc2": 0.0678421293647544, "sim_compute_robot_state-npc3": 0.06611233313106796}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.18824073175589243, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.05906169613202413, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.13269675771395364, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08286091685295105, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03575885792573293, "sim_compute_performance-ego": 0.0747957577308019, "sim_compute_robot_state-ego": 0.06763852636019389, "sim_compute_robot_state-npc0": 0.061636035641034446, "sim_compute_robot_state-npc1": 0.060223355889320374, "sim_compute_robot_state-npc2": 0.0649541715780894, "sim_compute_robot_state-npc3": 0.06558084487915039}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.19202797753470283, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05321259725661505, "in-drivable-lane": 0, "agent_compute-ego": 0.14303297088259742, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08845733460925874, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.039272149403889976, "sim_compute_performance-ego": 0.06504238219488234, "sim_compute_robot_state-ego": 0.06291411036536806, "sim_compute_robot_state-npc0": 0.06815162159147717, "sim_compute_robot_state-npc1": 0.06517521540323894, "sim_compute_robot_state-npc2": 0.06764262063162667, "sim_compute_robot_state-npc3": 0.06623448644365583}}
set_robot_commands_max0.09310173988342284
set_robot_commands_mean0.08762599952618833
set_robot_commands_median0.08845733460925874
set_robot_commands_min0.08286091685295105
sim_compute_performance-ego_max0.0747957577308019
sim_compute_performance-ego_mean0.0678854623208959
sim_compute_performance-ego_median0.06518250298731536
sim_compute_performance-ego_min0.06477619068963188
sim_compute_robot_state-ego_max0.07441197974341256
sim_compute_robot_state-ego_mean0.06933966466762657
sim_compute_robot_state-ego_median0.07082680822576135
sim_compute_robot_state-ego_min0.06291411036536806
sim_compute_robot_state-npc0_max0.06940295424642443
sim_compute_robot_state-npc0_mean0.06606020067602802
sim_compute_robot_state-npc0_median0.06683300222669329
sim_compute_robot_state-npc0_min0.061636035641034446
sim_compute_robot_state-npc1_max0.0692497899260702
sim_compute_robot_state-npc1_mean0.06475805652211195
sim_compute_robot_state-npc1_median0.06517521540323894
sim_compute_robot_state-npc1_min0.060223355889320374
sim_compute_robot_state-npc2_max0.06844821760926066
sim_compute_robot_state-npc2_mean0.06646815077909853
sim_compute_robot_state-npc2_median0.06764262063162667
sim_compute_robot_state-npc2_min0.06345361471176147
sim_compute_robot_state-npc3_max0.06731489942043642
sim_compute_robot_state-npc3_mean0.06561845797401111
sim_compute_robot_state-npc3_median0.06611233313106796
sim_compute_robot_state-npc3_min0.06284972599574498
sim_compute_sim_state_max0.03987477399125884
sim_compute_sim_state_mean0.037920962199733135
sim_compute_sim_state_median0.03761644270813581
sim_compute_sim_state_min0.03575885792573293
sim_physics_max0.19762217545811137
sim_physics_mean0.19004884140926612
sim_physics_median0.18824073175589243
sim_physics_min0.18520689010620117
sim_render-ego_max0.06303895877886422
sim_render-ego_mean0.05940077408637288
sim_render-ego_median0.05948456282754546
sim_render-ego_min0.05321259725661505
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
240453837Kenechukwu Nnodu 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-71940:00:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.09492392580310964
error_L20.014957697957094116


No reset possible
240423835Kun Ni 🇨🇦PredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-71940:00:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.1157008368396059
error_L20.021441392589954644


No reset possible
240383831Donghoon Leechallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:19:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35786221158093356
survival_time_median10.800000000000018
deviation-center-line_median0.1725980454374791
in-drivable-lane_median5.000000000000013


other stats
agent_compute-ego_max0.1762944459915161
agent_compute-ego_mean0.16135973931241918
agent_compute-ego_median0.1575172185897827
agent_compute-ego_min0.15464136362075806
deviation-center-line_max0.9364938179889484
deviation-center-line_mean0.4118788869612856
deviation-center-line_min0.08744248313548349
deviation-heading_max6.0318917484945525
deviation-heading_mean3.478698603966555
deviation-heading_median4.409906515582579
deviation-heading_min0.5562821893998362
driven_any_max1.3586464211760976
driven_any_mean0.7956568709515786
driven_any_median0.9940565666269422
driven_any_min0.13438802308427183
driven_lanedir_consec_max0.4105306724900455
driven_lanedir_consec_mean0.25919767603623295
driven_lanedir_consec_min0.06519042473766756
driven_lanedir_max0.4105306724900455
driven_lanedir_mean0.25919767603623295
driven_lanedir_median0.35786221158093356
driven_lanedir_min0.06519042473766756
in-drivable-lane_max7.500000000000044
in-drivable-lane_mean4.090000000000019
in-drivable-lane_min0.4000000000000003
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3586464211760976, "sim_physics": 0.15150328079859415, "survival_time": 14.950000000000076, "driven_lanedir": 0.4105306724900455, "sim_render-ego": 0.05562659740447998, "in-drivable-lane": 7.15000000000004, "agent_compute-ego": 0.15464136362075806, "deviation-heading": 5.827164872408666, "set_robot_commands": 0.0826386562983195, "deviation-center-line": 0.7729577344796874, "driven_lanedir_consec": 0.4105306724900455, "sim_compute_sim_state": 0.03551085392634074, "sim_compute_performance-ego": 0.05914116621017456, "sim_compute_robot_state-ego": 0.06510607560475667, "sim_compute_robot_state-npc0": 0.06199576775232951, "sim_compute_robot_state-npc1": 0.06248692671457926, "sim_compute_robot_state-npc2": 0.060802846749623614, "sim_compute_robot_state-npc3": 0.06105844497680664}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.3532358766863517, "sim_physics": 0.15480210860570273, "survival_time": 14.950000000000076, "driven_lanedir": 0.3918087388754099, "sim_render-ego": 0.05807198206583659, "in-drivable-lane": 7.500000000000044, "agent_compute-ego": 0.162668772538503, "deviation-heading": 6.0318917484945525, "set_robot_commands": 0.08707692623138427, "deviation-center-line": 0.9364938179889484, "driven_lanedir_consec": 0.3918087388754099, "sim_compute_sim_state": 0.03782718261082967, "sim_compute_performance-ego": 0.06462070862452189, "sim_compute_robot_state-ego": 0.0691019868850708, "sim_compute_robot_state-npc0": 0.06433158159255982, "sim_compute_robot_state-npc1": 0.06282595078150431, "sim_compute_robot_state-npc2": 0.06156563440958659, "sim_compute_robot_state-npc3": 0.06484601100285849}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13795746718422938, "sim_physics": 0.17842224438985188, "survival_time": 1.5000000000000009, "driven_lanedir": 0.07059633249710817, "sim_render-ego": 0.06287392775217691, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1762944459915161, "deviation-heading": 0.5562821893998362, "set_robot_commands": 0.10201715628306073, "deviation-center-line": 0.08990235376482977, "driven_lanedir_consec": 0.07059633249710817, "sim_compute_sim_state": 0.040337777137756346, "sim_compute_performance-ego": 0.06804992357889811, "sim_compute_robot_state-ego": 0.07090872923533122, "sim_compute_robot_state-npc0": 0.07381138801574708, "sim_compute_robot_state-npc1": 0.06838573614756266, "sim_compute_robot_state-npc2": 0.07056996822357178, "sim_compute_robot_state-npc3": 0.1081571102142334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.13438802308427183, "sim_physics": 0.16810941696166992, "survival_time": 1.5000000000000009, "driven_lanedir": 0.06519042473766756, "sim_render-ego": 0.05501742362976074, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.1575172185897827, "deviation-heading": 0.5682476939471425, "set_robot_commands": 0.08306884765625, "deviation-center-line": 0.08744248313548349, "driven_lanedir_consec": 0.06519042473766756, "sim_compute_sim_state": 0.037286925315856936, "sim_compute_performance-ego": 0.06218255360921224, "sim_compute_robot_state-ego": 0.06949561436971029, "sim_compute_robot_state-npc0": 0.06381951967875163, "sim_compute_robot_state-npc1": 0.0618907372156779, "sim_compute_robot_state-npc2": 0.06388692061106364, "sim_compute_robot_state-npc3": 0.06357952753702799}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9940565666269422, "sim_physics": 0.15636495528397737, "survival_time": 10.800000000000018, "driven_lanedir": 0.35786221158093356, "sim_render-ego": 0.056787844057436344, "in-drivable-lane": 5.000000000000013, "agent_compute-ego": 0.15567689582153602, "deviation-heading": 4.409906515582579, "set_robot_commands": 0.08597295814090306, "deviation-center-line": 0.1725980454374791, "driven_lanedir_consec": 0.35786221158093356, "sim_compute_sim_state": 0.03517134211681507, "sim_compute_performance-ego": 0.06210300547105295, "sim_compute_robot_state-ego": 0.06803852871612266, "sim_compute_robot_state-npc0": 0.06235945335140935, "sim_compute_robot_state-npc1": 0.06326135220351042, "sim_compute_robot_state-npc2": 0.06266436422312702, "sim_compute_robot_state-npc3": 0.062070761565808895}}
set_robot_commands_max0.10201715628306073
set_robot_commands_mean0.08815490892198351
set_robot_commands_median0.08597295814090306
set_robot_commands_min0.0826386562983195
sim_compute_performance-ego_max0.06804992357889811
sim_compute_performance-ego_mean0.06321947149877195
sim_compute_performance-ego_median0.06218255360921224
sim_compute_performance-ego_min0.05914116621017456
sim_compute_robot_state-ego_max0.07090872923533122
sim_compute_robot_state-ego_mean0.06853018696219833
sim_compute_robot_state-ego_median0.0691019868850708
sim_compute_robot_state-ego_min0.06510607560475667
sim_compute_robot_state-npc0_max0.07381138801574708
sim_compute_robot_state-npc0_mean0.06526354207815947
sim_compute_robot_state-npc0_median0.06381951967875163
sim_compute_robot_state-npc0_min0.06199576775232951
sim_compute_robot_state-npc1_max0.06838573614756266
sim_compute_robot_state-npc1_mean0.06377014061256692
sim_compute_robot_state-npc1_median0.06282595078150431
sim_compute_robot_state-npc1_min0.0618907372156779
sim_compute_robot_state-npc2_max0.07056996822357178
sim_compute_robot_state-npc2_mean0.06389794684339453
sim_compute_robot_state-npc2_median0.06266436422312702
sim_compute_robot_state-npc2_min0.060802846749623614
sim_compute_robot_state-npc3_max0.1081571102142334
sim_compute_robot_state-npc3_mean0.07194237105934707
sim_compute_robot_state-npc3_median0.06357952753702799
sim_compute_robot_state-npc3_min0.06105844497680664
sim_compute_sim_state_max0.040337777137756346
sim_compute_sim_state_mean0.03722681622151976
sim_compute_sim_state_median0.037286925315856936
sim_compute_sim_state_min0.03517134211681507
sim_physics_max0.17842224438985188
sim_physics_mean0.1618404012079592
sim_physics_median0.15636495528397737
sim_physics_min0.15150328079859415
sim_render-ego_max0.06287392775217691
sim_render-ego_mean0.05767555498193812
sim_render-ego_median0.056787844057436344
sim_render-ego_min0.05501742362976074
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.740000000000034
survival_time_min1.5000000000000009
No reset possible
240273821Eric LuStudent 0756813aido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240263820Eric LuStudent A043022aido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240243815Philippe LaferrierePredictorLastaido2-PREDstep1-simulationsuccessnoip-172-31-42-167-71940:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.11237899343548824
error_L20.019981468864290263


No reset possible
240203813Amaury Camus 🇨🇭Let's do this one todayaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:28:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1563138484954834
agent_compute-ego_mean0.14224538226374
agent_compute-ego_median0.14316874458676293
agent_compute-ego_min0.11374047824314662
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.19785743121859395, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05972365789775607, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.1459732417818866, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09405065488211715, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03700873218005216, "sim_compute_performance-ego": 0.06902700134470494, "sim_compute_robot_state-ego": 0.07283587697186047, "sim_compute_robot_state-npc0": 0.06513374666624432, "sim_compute_robot_state-npc1": 0.06566875493979152, "sim_compute_robot_state-npc2": 0.0660276594041269, "sim_compute_robot_state-npc3": 0.06603033029580418}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2204183510371617, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06369439193180629, "in-drivable-lane": 0, "agent_compute-ego": 0.1533781119755336, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09530054671423777, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03836854015077863, "sim_compute_performance-ego": 0.0641306894166129, "sim_compute_robot_state-ego": 0.07295445033482142, "sim_compute_robot_state-npc0": 0.06915511403764997, "sim_compute_robot_state-npc1": 0.06475349834987096, "sim_compute_robot_state-npc2": 0.0654194610459464, "sim_compute_robot_state-npc3": 0.06729290315083095}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18819466146450595, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05909788029865154, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14728875299101896, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.08812848572592133, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.037783027852623205, "sim_compute_performance-ego": 0.06466824568591072, "sim_compute_robot_state-ego": 0.07310150664986916, "sim_compute_robot_state-npc0": 0.06780302640303824, "sim_compute_robot_state-npc1": 0.06758026243413537, "sim_compute_robot_state-npc2": 0.06639687528887998, "sim_compute_robot_state-npc3": 0.06516352209072669}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.17660076916217804, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.054342254996299744, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.1417760302623113, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.08520347376664479, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.033539911111195884, "sim_compute_performance-ego": 0.05998608469963074, "sim_compute_robot_state-ego": 0.07065149148305257, "sim_compute_robot_state-npc0": 0.06458088755607605, "sim_compute_robot_state-npc1": 0.06328063706556956, "sim_compute_robot_state-npc2": 0.060044233997662864, "sim_compute_robot_state-npc3": 0.0594738374153773}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.16089812914530435, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.045429808752877374, "in-drivable-lane": 0, "agent_compute-ego": 0.11374047824314662, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.07363063948495048, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.030543520337059385, "sim_compute_performance-ego": 0.05537318048023042, "sim_compute_robot_state-ego": 0.05572102183387393, "sim_compute_robot_state-npc0": 0.06285956927708217, "sim_compute_robot_state-npc1": 0.05834874652680896, "sim_compute_robot_state-npc2": 0.05909637042454311, "sim_compute_robot_state-npc3": 0.055411032267979214}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.17108180280217153, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05619439250694777, "in-drivable-lane": 2, "agent_compute-ego": 0.13783249455297775, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.08656680227039817, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.0375423445673046, "sim_compute_performance-ego": 0.0601132958235141, "sim_compute_robot_state-ego": 0.06520537273612564, "sim_compute_robot_state-npc0": 0.06268375505230384, "sim_compute_robot_state-npc1": 0.061752339323123774, "sim_compute_robot_state-npc2": 0.05969838039603776, "sim_compute_robot_state-npc3": 0.060014931741588846}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.20403395115750508, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05656913646216531, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14411924649210808, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.08860076746894317, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.042737481663528, "sim_compute_performance-ego": 0.06489615532958391, "sim_compute_robot_state-ego": 0.06909627590364623, "sim_compute_robot_state-npc0": 0.06552021943249749, "sim_compute_robot_state-npc1": 0.06519616460337223, "sim_compute_robot_state-npc2": 0.06617130122138458, "sim_compute_robot_state-npc3": 0.06645399621389445}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.21505807399749757, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06473001480102539, "in-drivable-lane": 0, "agent_compute-ego": 0.1563138484954834, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.0938023328781128, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03822293758392334, "sim_compute_performance-ego": 0.07534383296966553, "sim_compute_robot_state-ego": 0.07400619983673096, "sim_compute_robot_state-npc0": 0.06648483753204346, "sim_compute_robot_state-npc1": 0.06820342540740967, "sim_compute_robot_state-npc2": 0.06663676738739013, "sim_compute_robot_state-npc3": 0.073778657913208}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1992738155218271, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05938854584327111, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1416816252928514, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09859112592843863, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03698029426427988, "sim_compute_performance-ego": 0.06592382376010601, "sim_compute_robot_state-ego": 0.07648106721731332, "sim_compute_robot_state-npc0": 0.06614183921080369, "sim_compute_robot_state-npc1": 0.06489477249292228, "sim_compute_robot_state-npc2": 0.062474800990178034, "sim_compute_robot_state-npc3": 0.0632331004509559}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.21978918405679557, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.05933631383455717, "in-drivable-lane": 0, "agent_compute-ego": 0.14464750656714806, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.08546737524179313, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0362558181469257, "sim_compute_performance-ego": 0.06528013486128587, "sim_compute_robot_state-ego": 0.06937809173877423, "sim_compute_robot_state-npc0": 0.06469456966106708, "sim_compute_robot_state-npc1": 0.06407546080075778, "sim_compute_robot_state-npc2": 0.06316908506246713, "sim_compute_robot_state-npc3": 0.06239513250497671}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2014577497135509, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.055626966736533424, "in-drivable-lane": 0, "agent_compute-ego": 0.1413579095493663, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.08418777855959805, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04120331460779363, "sim_compute_performance-ego": 0.06291391632773659, "sim_compute_robot_state-ego": 0.07174154845151035, "sim_compute_robot_state-npc0": 0.0672144889831543, "sim_compute_robot_state-npc1": 0.06528068672526967, "sim_compute_robot_state-npc2": 0.06138299811970104, "sim_compute_robot_state-npc3": 0.06736912510611794}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1753295087814331, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05656915664672851, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.13584393978118897, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0844034767150879, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03446864128112793, "sim_compute_performance-ego": 0.06371952056884765, "sim_compute_robot_state-ego": 0.06901931285858154, "sim_compute_robot_state-npc0": 0.05993995189666748, "sim_compute_robot_state-npc1": 0.06075715065002441, "sim_compute_robot_state-npc2": 0.059779939651489256, "sim_compute_robot_state-npc3": 0.06265366077423096}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.1977610004709122, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.05860028368361453, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.14432274027073638, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.089206226328586, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.036524853807814575, "sim_compute_performance-ego": 0.06681065102840991, "sim_compute_robot_state-ego": 0.07204739337271833, "sim_compute_robot_state-npc0": 0.06345987319946289, "sim_compute_robot_state-npc1": 0.06392853057130854, "sim_compute_robot_state-npc2": 0.06237771916896739, "sim_compute_robot_state-npc3": 0.06197723682890547}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.18177090699856097, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.05955348106530997, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1422360631135794, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.08723753690719604, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.03632171795918392, "sim_compute_performance-ego": 0.0671042249752925, "sim_compute_robot_state-ego": 0.06718605756759644, "sim_compute_robot_state-npc0": 0.06817240898425762, "sim_compute_robot_state-npc1": 0.06518360284658578, "sim_compute_robot_state-npc2": 0.06172108191710252, "sim_compute_robot_state-npc3": 0.06568951331652127}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.17610240436735608, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.057875733148484, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.14316874458676293, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.08775440851847331, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03567985580081032, "sim_compute_performance-ego": 0.06254329227265858, "sim_compute_robot_state-ego": 0.06802017575218564, "sim_compute_robot_state-npc0": 0.0659514586130778, "sim_compute_robot_state-npc1": 0.06449282737005324, "sim_compute_robot_state-npc2": 0.06393530255272276, "sim_compute_robot_state-npc3": 0.06280323210216704}}
set_robot_commands_max0.09859112592843863
set_robot_commands_mean0.0881421087593666
set_robot_commands_median0.08775440851847331
set_robot_commands_min0.07363063948495048
sim_compute_performance-ego_max0.07534383296966553
sim_compute_performance-ego_mean0.06452226996961268
sim_compute_performance-ego_median0.06466824568591072
sim_compute_performance-ego_min0.05537318048023042
sim_compute_robot_state-ego_max0.07648106721731332
sim_compute_robot_state-ego_mean0.06982972284724401
sim_compute_robot_state-ego_median0.07065149148305257
sim_compute_robot_state-ego_min0.05572102183387393
sim_compute_robot_state-npc0_max0.06915511403764997
sim_compute_robot_state-npc0_mean0.06531971643369511
sim_compute_robot_state-npc0_median0.06552021943249749
sim_compute_robot_state-npc0_min0.05993995189666748
sim_compute_robot_state-npc1_max0.06820342540740967
sim_compute_robot_state-npc1_mean0.06422645734046692
sim_compute_robot_state-npc1_median0.06475349834987096
sim_compute_robot_state-npc1_min0.05834874652680896
sim_compute_robot_state-npc2_max0.06663676738739013
sim_compute_robot_state-npc2_mean0.06295546510857332
sim_compute_robot_state-npc2_median0.062474800990178034
sim_compute_robot_state-npc2_min0.05909637042454311
sim_compute_robot_state-npc3_max0.073778657913208
sim_compute_robot_state-npc3_mean0.06398268081155231
sim_compute_robot_state-npc3_median0.0632331004509559
sim_compute_robot_state-npc3_min0.055411032267979214
sim_compute_sim_state_max0.042737481663528
sim_compute_sim_state_mean0.03687873275429341
sim_compute_sim_state_median0.03698029426427988
sim_compute_sim_state_min0.030543520337059385
sim_physics_max0.2204183510371617
sim_physics_mean0.19237518265969028
sim_physics_median0.1977610004709122
sim_physics_min0.16089812914530435
sim_render-ego_max0.06473001480102539
sim_render-ego_mean0.057782134573735225
sim_render-ego_median0.05860028368361453
sim_render-ego_min0.045429808752877374
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
240133804Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:06:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.319488299473331
survival_time_median3.649999999999995
deviation-center-line_median0.22383456082410105
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.0965159833431244
agent_compute-ego_mean0.0960786805132249
agent_compute-ego_median0.09619516542513076
agent_compute-ego_min0.09570563832918803
deviation-center-line_max0.5041244339741484
deviation-center-line_mean0.2952751295937134
deviation-center-line_min0.10352795783771118
deviation-heading_max2.119486240215086
deviation-heading_mean1.0826656537238424
deviation-heading_median0.5336681486530255
deviation-heading_min0.4285776638996418
driven_any_max4.027169245536098
driven_any_mean2.3885020521560607
driven_any_median1.6927430020494696
driven_any_min1.1231152018644142
driven_lanedir_consec_max2.451328684317319
driven_lanedir_consec_mean1.583559278758105
driven_lanedir_consec_min0.7089212038122639
driven_lanedir_max2.466751109446747
driven_lanedir_mean1.5866437637839903
driven_lanedir_median1.319488299473331
driven_lanedir_min0.7089212038122639
in-drivable-lane_max3.700000000000012
in-drivable-lane_mean1.7999999999999996
in-drivable-lane_min0.6499999999999986
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1231152018644142, "sim_physics": 0.05530280371507009, "survival_time": 2.3999999999999995, "driven_lanedir": 0.7089212038122639, "sim_render-ego": 0.035934507846832275, "in-drivable-lane": 0.6499999999999986, "agent_compute-ego": 0.0965159833431244, "deviation-heading": 0.5336681486530255, "set_robot_commands": 0.0539746085802714, "deviation-center-line": 0.10352795783771118, "driven_lanedir_consec": 0.7089212038122639, "sim_compute_sim_state": 0.023049533367156982, "sim_compute_performance-ego": 0.03920093675454458, "sim_compute_robot_state-ego": 0.0405824879805247}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.027169245536098, "sim_physics": 0.055218875744922014, "survival_time": 8.84999999999999, "driven_lanedir": 2.193121651141115, "sim_render-ego": 0.035552269994875804, "in-drivable-lane": 3.0999999999999934, "agent_compute-ego": 0.09627002376621052, "deviation-heading": 1.8864126705741, "set_robot_commands": 0.05364074410691773, "deviation-center-line": 0.500596347890897, "driven_lanedir_consec": 2.193121651141115, "sim_compute_sim_state": 0.02309624219344834, "sim_compute_performance-ego": 0.03897279399936482, "sim_compute_robot_state-ego": 0.04064428469555526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.458879329068231, "sim_physics": 0.057197604516539914, "survival_time": 9.900000000000006, "driven_lanedir": 2.466751109446747, "sim_render-ego": 0.03569887141988735, "in-drivable-lane": 3.700000000000012, "agent_compute-ego": 0.09570659170247088, "deviation-heading": 2.119486240215086, "set_robot_commands": 0.05329026597918886, "deviation-center-line": 0.5041244339741484, "driven_lanedir_consec": 2.451328684317319, "sim_compute_sim_state": 0.022997561127248437, "sim_compute_performance-ego": 0.038549193228134, "sim_compute_robot_state-ego": 0.04082696847241334}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6406034822620883, "sim_physics": 0.057579922349485634, "survival_time": 3.649999999999995, "driven_lanedir": 1.2449365550464957, "sim_render-ego": 0.03580527762844138, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.09619516542513076, "deviation-heading": 0.44518354527735954, "set_robot_commands": 0.05394793209964282, "deviation-center-line": 0.22383456082410105, "driven_lanedir_consec": 1.2449365550464957, "sim_compute_sim_state": 0.02327697244409013, "sim_compute_performance-ego": 0.0387748071592148, "sim_compute_robot_state-ego": 0.04058976369361355}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6927430020494696, "sim_physics": 0.056349873542785645, "survival_time": 3.599999999999995, "driven_lanedir": 1.319488299473331, "sim_render-ego": 0.036262969175974526, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.09570563832918803, "deviation-heading": 0.4285776638996418, "set_robot_commands": 0.054116517305374146, "deviation-center-line": 0.14429234744170946, "driven_lanedir_consec": 1.319488299473331, "sim_compute_sim_state": 0.02328749166594611, "sim_compute_performance-ego": 0.038879311747021146, "sim_compute_robot_state-ego": 0.0408335824807485}}
set_robot_commands_max0.054116517305374146
set_robot_commands_mean0.05379401361427899
set_robot_commands_median0.05394793209964282
set_robot_commands_min0.05329026597918886
sim_compute_performance-ego_max0.03920093675454458
sim_compute_performance-ego_mean0.03887540857765587
sim_compute_performance-ego_median0.038879311747021146
sim_compute_performance-ego_min0.038549193228134
sim_compute_robot_state-ego_max0.0408335824807485
sim_compute_robot_state-ego_mean0.040695417464571074
sim_compute_robot_state-ego_median0.04064428469555526
sim_compute_robot_state-ego_min0.0405824879805247
sim_compute_sim_state_max0.02328749166594611
sim_compute_sim_state_mean0.023141560159578
sim_compute_sim_state_median0.02309624219344834
sim_compute_sim_state_min0.022997561127248437
sim_physics_max0.057579922349485634
sim_physics_mean0.056329815973760654
sim_physics_median0.056349873542785645
sim_physics_min0.055218875744922014
sim_render-ego_max0.036262969175974526
sim_render-ego_mean0.03585077921320227
sim_render-ego_median0.03580527762844138
sim_render-ego_min0.035552269994875804
simulation-passed1
survival_time_max9.900000000000006
survival_time_mean5.679999999999997
survival_time_min2.3999999999999995
No reset possible
240053796Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:03:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7232895676919848
survival_time_median2.000000000000001
deviation-center-line_median0.11123144500941264
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.09825950577145531
agent_compute-ego_mean0.09602803819127136
agent_compute-ego_median0.09645414046752147
agent_compute-ego_min0.09380485117435455
deviation-center-line_max0.2274233462652022
deviation-center-line_mean0.13342380717935837
deviation-center-line_min0.07504719484739283
deviation-heading_max0.5818730682625293
deviation-heading_mean0.3292482562980156
deviation-heading_median0.3145505780820485
deviation-heading_min0.1900354247685071
driven_any_max1.6189646584674098
driven_any_mean0.9338254047929304
driven_any_median0.9996632207705848
driven_any_min0.28362940600638153
driven_lanedir_consec_max1.1250809112117863
driven_lanedir_consec_mean0.7405112329435293
driven_lanedir_consec_min0.275488859799796
driven_lanedir_max1.1250809112117863
driven_lanedir_mean0.7405112329435293
driven_lanedir_median0.7232895676919848
driven_lanedir_min0.275488859799796
in-drivable-lane_max1.5499999999999945
in-drivable-lane_mean0.4199999999999989
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9996632207705848, "sim_physics": 0.06014494895935059, "survival_time": 2.000000000000001, "driven_lanedir": 0.6856800730956207, "sim_render-ego": 0.037070071697235106, "in-drivable-lane": 0.4500000000000002, "agent_compute-ego": 0.09666680097579956, "deviation-heading": 0.3145505780820485, "set_robot_commands": 0.0544408917427063, "deviation-center-line": 0.08877415228107144, "driven_lanedir_consec": 0.6856800730956207, "sim_compute_sim_state": 0.02317131161689758, "sim_compute_performance-ego": 0.03881134390830994, "sim_compute_robot_state-ego": 0.04207938313484192}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0311750388448655, "sim_physics": 0.06021393480755034, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8930167529184583, "sim_render-ego": 0.0359574556350708, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.09825950577145531, "deviation-heading": 0.5818730682625293, "set_robot_commands": 0.05472036202748617, "deviation-center-line": 0.1646428974937126, "driven_lanedir_consec": 0.8930167529184583, "sim_compute_sim_state": 0.023456136385599773, "sim_compute_performance-ego": 0.03941571144830613, "sim_compute_robot_state-ego": 0.04027116866338821}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.28362940600638153, "sim_physics": 0.0593084990978241, "survival_time": 0.8000000000000002, "driven_lanedir": 0.275488859799796, "sim_render-ego": 0.035214170813560486, "in-drivable-lane": 0, "agent_compute-ego": 0.09380485117435455, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.06809341907501221, "deviation-center-line": 0.07504719484739283, "driven_lanedir_consec": 0.275488859799796, "sim_compute_sim_state": 0.023242443799972538, "sim_compute_performance-ego": 0.03866367042064667, "sim_compute_robot_state-ego": 0.04001890122890472}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7356946998754108, "sim_physics": 0.06152124404907226, "survival_time": 1.7500000000000009, "driven_lanedir": 0.7232895676919848, "sim_render-ego": 0.03640792710440499, "in-drivable-lane": 0, "agent_compute-ego": 0.09495489256722586, "deviation-heading": 0.3676667771044827, "set_robot_commands": 0.05424473626273019, "deviation-center-line": 0.11123144500941264, "driven_lanedir_consec": 0.7232895676919848, "sim_compute_sim_state": 0.023250797816685268, "sim_compute_performance-ego": 0.03877718108040946, "sim_compute_robot_state-ego": 0.0407120909009661}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6189646584674098, "sim_physics": 0.054783925032004334, "survival_time": 3.899999999999994, "driven_lanedir": 1.1250809112117863, "sim_render-ego": 0.036098321278889976, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.09645414046752147, "deviation-heading": 0.1900354247685071, "set_robot_commands": 0.053956921284015365, "deviation-center-line": 0.2274233462652022, "driven_lanedir_consec": 1.1250809112117863, "sim_compute_sim_state": 0.023311324608631626, "sim_compute_performance-ego": 0.03979088404239752, "sim_compute_robot_state-ego": 0.04060274515396509}}
set_robot_commands_max0.06809341907501221
set_robot_commands_mean0.057091266078390046
set_robot_commands_median0.0544408917427063
set_robot_commands_min0.053956921284015365
sim_compute_performance-ego_max0.03979088404239752
sim_compute_performance-ego_mean0.03909175818001394
sim_compute_performance-ego_median0.03881134390830994
sim_compute_performance-ego_min0.03866367042064667
sim_compute_robot_state-ego_max0.04207938313484192
sim_compute_robot_state-ego_mean0.04073685781641321
sim_compute_robot_state-ego_median0.04060274515396509
sim_compute_robot_state-ego_min0.04001890122890472
sim_compute_sim_state_max0.023456136385599773
sim_compute_sim_state_mean0.02328640284555735
sim_compute_sim_state_median0.023250797816685268
sim_compute_sim_state_min0.02317131161689758
sim_physics_max0.06152124404907226
sim_physics_mean0.05919451038916033
sim_physics_median0.06014494895935059
sim_physics_min0.054783925032004334
sim_render-ego_max0.037070071697235106
sim_render-ego_mean0.03614958930583227
sim_render-ego_median0.036098321278889976
sim_render-ego_min0.035214170813560486
simulation-passed1
survival_time_max3.899999999999994
survival_time_mean2.109999999999999
survival_time_min0.8000000000000002
No reset possible
240043795Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:01:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240023794Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyesip-172-31-42-167-71940:00:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 73, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     k_r = self.k
               || AttributeError: 'PytorchRLBaseline' object has no attribute 'k'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
240013793Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:04:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.405216831454843
survival_time_median1.5000000000000009
deviation-center-line_median0.07504719483005236
in-drivable-lane_median0.10000000000000007


other stats
agent_compute-ego_max0.09889365037282308
agent_compute-ego_mean0.0958973729744865
agent_compute-ego_median0.09551022201776505
agent_compute-ego_min0.09448498487472534
deviation-center-line_max0.4814966407152546
deviation-center-line_mean0.1476072749309575
deviation-center-line_min0.03346317817245914
deviation-heading_max4.1524288955983195
deviation-heading_mean1.1483549891839573
deviation-heading_median0.4542830623759403
deviation-heading_min0.19211543327251043
driven_any_max2.121664707940838
driven_any_mean0.7250005014907428
driven_any_median0.5312466152394437
driven_any_min0.14671966767306738
driven_lanedir_consec_max1.0971328152564688
driven_lanedir_consec_mean0.45506643909907113
driven_lanedir_consec_min0.041168469500798555
driven_lanedir_max1.0971328152564688
driven_lanedir_mean0.45506643909907113
driven_lanedir_median0.405216831454843
driven_lanedir_min0.041168469500798555
in-drivable-lane_max3.9
in-drivable-lane_mean0.85
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5417421381665942, "sim_physics": 0.0580013910929362, "survival_time": 1.5000000000000009, "driven_lanedir": 0.4563252463585652, "sim_render-ego": 0.03685693740844727, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.09889365037282308, "deviation-heading": 0.4542830623759403, "set_robot_commands": 0.05860037008921305, "deviation-center-line": 0.08706745255629056, "driven_lanedir_consec": 0.4563252463585652, "sim_compute_sim_state": 0.02331703503926595, "sim_compute_performance-ego": 0.039561740557352704, "sim_compute_robot_state-ego": 0.040798338254292806}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.121664707940838, "sim_physics": 0.05735039829027535, "survival_time": 10.100000000000009, "driven_lanedir": 1.0971328152564688, "sim_render-ego": 0.03658982314685784, "in-drivable-lane": 3.9, "agent_compute-ego": 0.09488587568301966, "deviation-heading": 4.1524288955983195, "set_robot_commands": 0.05455787701181846, "deviation-center-line": 0.4814966407152546, "driven_lanedir_consec": 1.0971328152564688, "sim_compute_sim_state": 0.023194517239485637, "sim_compute_performance-ego": 0.038909445894826755, "sim_compute_robot_state-ego": 0.0407944115081636}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2836293784337706, "sim_physics": 0.06326423585414886, "survival_time": 0.8000000000000002, "driven_lanedir": 0.27548883292468007, "sim_render-ego": 0.03541463613510132, "in-drivable-lane": 0, "agent_compute-ego": 0.09448498487472534, "deviation-heading": 0.19211543327251043, "set_robot_commands": 0.053917139768600464, "deviation-center-line": 0.07504719483005236, "driven_lanedir_consec": 0.27548883292468007, "sim_compute_sim_state": 0.0229949951171875, "sim_compute_performance-ego": 0.038997918367385864, "sim_compute_robot_state-ego": 0.04104362428188324}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5312466152394437, "sim_physics": 0.060377366840839386, "survival_time": 1.6000000000000008, "driven_lanedir": 0.405216831454843, "sim_render-ego": 0.03639849275350571, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.09551022201776505, "deviation-heading": 0.44800362931808274, "set_robot_commands": 0.05467734485864639, "deviation-center-line": 0.06096190838073073, "driven_lanedir_consec": 0.405216831454843, "sim_compute_sim_state": 0.023262523114681244, "sim_compute_performance-ego": 0.04491182416677475, "sim_compute_robot_state-ego": 0.04044823348522186}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14671966767306738, "sim_physics": 0.06436340014139812, "survival_time": 0.9000000000000002, "driven_lanedir": 0.041168469500798555, "sim_render-ego": 0.03606779045528836, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.0957121319240994, "deviation-heading": 0.49494392535493303, "set_robot_commands": 0.05413919024997287, "deviation-center-line": 0.03346317817245914, "driven_lanedir_consec": 0.041168469500798555, "sim_compute_sim_state": 0.02321030033959283, "sim_compute_performance-ego": 0.03877451684739855, "sim_compute_robot_state-ego": 0.04069530963897705}}
set_robot_commands_max0.05860037008921305
set_robot_commands_mean0.055178384395650246
set_robot_commands_median0.05455787701181846
set_robot_commands_min0.053917139768600464
sim_compute_performance-ego_max0.04491182416677475
sim_compute_performance-ego_mean0.04023108916674773
sim_compute_performance-ego_median0.038997918367385864
sim_compute_performance-ego_min0.03877451684739855
sim_compute_robot_state-ego_max0.04104362428188324
sim_compute_robot_state-ego_mean0.04075598343370771
sim_compute_robot_state-ego_median0.0407944115081636
sim_compute_robot_state-ego_min0.04044823348522186
sim_compute_sim_state_max0.02331703503926595
sim_compute_sim_state_mean0.02319587417004263
sim_compute_sim_state_median0.02321030033959283
sim_compute_sim_state_min0.0229949951171875
sim_physics_max0.06436340014139812
sim_physics_mean0.06067135844391959
sim_physics_median0.060377366840839386
sim_physics_min0.05735039829027535
sim_render-ego_max0.03685693740844727
sim_render-ego_mean0.0362655359798401
sim_render-ego_median0.03639849275350571
sim_render-ego_min0.03541463613510132
simulation-passed1
survival_time_max10.100000000000009
survival_time_mean2.980000000000002
survival_time_min0.8000000000000002
No reset possible
240003792Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239993791Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2679222231321656
survival_time_median1.6500000000000008
deviation-center-line_median0.0943858230924602
in-drivable-lane_median0


other stats
agent_compute-ego_max0.10426025390625
agent_compute-ego_mean0.0987961681941887
agent_compute-ego_median0.09716988332343823
agent_compute-ego_min0.09641059239705405
deviation-center-line_max0.11569874380011312
deviation-center-line_mean0.09587568609314276
deviation-center-line_min0.08371873596982482
deviation-heading_max0.7895755749062322
deviation-heading_mean0.6609422960382333
deviation-heading_median0.68115961650565
deviation-heading_min0.49450636808312326
driven_any_max0.3811011302421271
driven_any_mean0.28196229632139297
driven_any_median0.30980836081601304
driven_any_min0.1403954417726464
driven_lanedir_consec_max0.3405801336410198
driven_lanedir_consec_mean0.23751203909611637
driven_lanedir_consec_min0.11135716229552096
driven_lanedir_max0.3405801336410198
driven_lanedir_mean0.23751203909611637
driven_lanedir_median0.2679222231321656
driven_lanedir_min0.11135716229552096
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.3388550212196471, "sim_physics": 0.06181313650948661, "survival_time": 1.7500000000000009, "driven_lanedir": 0.287986893676873, "sim_render-ego": 0.035861662455967495, "in-drivable-lane": 0, "agent_compute-ego": 0.09912324632917131, "deviation-heading": 0.7375204051195551, "set_robot_commands": 0.05416088785443987, "deviation-center-line": 0.11569874380011312, "driven_lanedir_consec": 0.287986893676873, "sim_compute_sim_state": 0.022968237740652903, "sim_compute_performance-ego": 0.03911147117614746, "sim_compute_robot_state-ego": 0.04059091976710728}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3811011302421271, "sim_physics": 0.05918384194374084, "survival_time": 2.000000000000001, "driven_lanedir": 0.3405801336410198, "sim_render-ego": 0.035386127233505246, "in-drivable-lane": 0, "agent_compute-ego": 0.0970168650150299, "deviation-heading": 0.68115961650565, "set_robot_commands": 0.05427998900413513, "deviation-center-line": 0.09621492941191535, "driven_lanedir_consec": 0.3405801336410198, "sim_compute_sim_state": 0.023284685611724858, "sim_compute_performance-ego": 0.03908435106277466, "sim_compute_robot_state-ego": 0.03997340202331543}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1403954417726464, "sim_physics": 0.06004089117050171, "survival_time": 1.0000000000000002, "driven_lanedir": 0.11135716229552096, "sim_render-ego": 0.034908521175384524, "in-drivable-lane": 0, "agent_compute-ego": 0.10426025390625, "deviation-heading": 0.49450636808312326, "set_robot_commands": 0.0536878228187561, "deviation-center-line": 0.0943858230924602, "driven_lanedir_consec": 0.11135716229552096, "sim_compute_sim_state": 0.023104560375213624, "sim_compute_performance-ego": 0.0385317325592041, "sim_compute_robot_state-ego": 0.04028111696243286}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.23965152755653132, "sim_physics": 0.05761112107170953, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1797137827350026, "sim_render-ego": 0.03636690422340676, "in-drivable-lane": 0, "agent_compute-ego": 0.09641059239705405, "deviation-heading": 0.7895755749062322, "set_robot_commands": 0.05878242739924678, "deviation-center-line": 0.08371873596982482, "driven_lanedir_consec": 0.1797137827350026, "sim_compute_sim_state": 0.02313555611504449, "sim_compute_performance-ego": 0.03846492590727629, "sim_compute_robot_state-ego": 0.04032249803896303}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.30980836081601304, "sim_physics": 0.06428457751418605, "survival_time": 1.6500000000000008, "driven_lanedir": 0.2679222231321656, "sim_render-ego": 0.03632278153390595, "in-drivable-lane": 0, "agent_compute-ego": 0.09716988332343823, "deviation-heading": 0.6019495155766061, "set_robot_commands": 0.05404311960393733, "deviation-center-line": 0.08936019819140023, "driven_lanedir_consec": 0.2679222231321656, "sim_compute_sim_state": 0.023126175909331352, "sim_compute_performance-ego": 0.03928240140279134, "sim_compute_robot_state-ego": 0.040688160694006714}}
set_robot_commands_max0.05878242739924678
set_robot_commands_mean0.05499084933610304
set_robot_commands_median0.05416088785443987
set_robot_commands_min0.0536878228187561
sim_compute_performance-ego_max0.03928240140279134
sim_compute_performance-ego_mean0.03889497642163877
sim_compute_performance-ego_median0.03908435106277466
sim_compute_performance-ego_min0.03846492590727629
sim_compute_robot_state-ego_max0.040688160694006714
sim_compute_robot_state-ego_mean0.040371219497165066
sim_compute_robot_state-ego_median0.04032249803896303
sim_compute_robot_state-ego_min0.03997340202331543
sim_compute_sim_state_max0.023284685611724858
sim_compute_sim_state_mean0.02312384315039344
sim_compute_sim_state_median0.023126175909331352
sim_compute_sim_state_min0.022968237740652903
sim_physics_max0.06428457751418605
sim_physics_mean0.06058671364192495
sim_physics_median0.06004089117050171
sim_physics_min0.05761112107170953
sim_render-ego_max0.03636690422340676
sim_render-ego_mean0.035769199324433995
sim_render-ego_median0.035861662455967495
sim_render-ego_min0.034908521175384524
simulation-passed1
survival_time_max2.000000000000001
survival_time_mean1.5500000000000007
survival_time_min1.0000000000000002
No reset possible
239983790Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyesip-172-31-42-167-71940:03:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07033725840374228
survival_time_median1.800000000000001
deviation-center-line_median0.04804875518080813
in-drivable-lane_median0.5500000000000005


other stats
agent_compute-ego_max0.09760514232847424
agent_compute-ego_mean0.09662577550807776
agent_compute-ego_median0.09662849295373056
agent_compute-ego_min0.09582858472257048
deviation-center-line_max0.11087661991474489
deviation-center-line_mean0.06607935828637886
deviation-center-line_min0.034702296918071716
deviation-heading_max1.9905815563488944
deviation-heading_mean0.9867628655372414
deviation-heading_median0.7435769161601652
deviation-heading_min0.6427615728979265
driven_any_max0.5904190194854401
driven_any_mean0.2507895103672611
driven_any_median0.18540154227334435
driven_any_min0.1020115535648569
driven_lanedir_consec_max0.19107115625219473
driven_lanedir_consec_mean0.09454604553923932
driven_lanedir_consec_min0.06784162189370324
driven_lanedir_max0.19107115625219473
driven_lanedir_mean0.09454604553923932
driven_lanedir_median0.07033725840374228
driven_lanedir_min0.06784162189370324
in-drivable-lane_max2.2999999999999954
in-drivable-lane_mean0.8099999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5904190194854401, "sim_physics": 0.0583351640140309, "survival_time": 5.09999999999999, "driven_lanedir": 0.19107115625219473, "sim_render-ego": 0.03666300867118087, "in-drivable-lane": 2.2999999999999954, "agent_compute-ego": 0.09662849295373056, "deviation-heading": 1.9905815563488944, "set_robot_commands": 0.05466751257578532, "deviation-center-line": 0.11087661991474489, "driven_lanedir_consec": 0.19107115625219473, "sim_compute_sim_state": 0.02336597442626953, "sim_compute_performance-ego": 0.03948041971992044, "sim_compute_robot_state-ego": 0.0409466215208465}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18305606435585867, "sim_physics": 0.056579886256037534, "survival_time": 1.850000000000001, "driven_lanedir": 0.07381003243865136, "sim_render-ego": 0.03492714263297416, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09582858472257048, "deviation-heading": 0.7181203868548293, "set_robot_commands": 0.0538970457540976, "deviation-center-line": 0.034702296918071716, "driven_lanedir_consec": 0.07381003243865136, "sim_compute_sim_state": 0.023085362202412373, "sim_compute_performance-ego": 0.0386302020098712, "sim_compute_robot_state-ego": 0.04059938482336096}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1020115535648569, "sim_physics": 0.05688755852835519, "survival_time": 1.0500000000000005, "driven_lanedir": 0.06967015870790494, "sim_render-ego": 0.035158236821492515, "in-drivable-lane": 0, "agent_compute-ego": 0.0960034075237456, "deviation-heading": 0.6427615728979265, "set_robot_commands": 0.05411069733755929, "deviation-center-line": 0.09470036841017418, "driven_lanedir_consec": 0.06967015870790494, "sim_compute_sim_state": 0.02303227924165271, "sim_compute_performance-ego": 0.038905189150855654, "sim_compute_robot_state-ego": 0.04068296296255929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19305937215680535, "sim_physics": 0.06106236908170912, "survival_time": 1.800000000000001, "driven_lanedir": 0.07033725840374228, "sim_render-ego": 0.03785369131300184, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.09706325001186794, "deviation-heading": 0.838773895424391, "set_robot_commands": 0.05454615089628431, "deviation-center-line": 0.04804875518080813, "driven_lanedir_consec": 0.07033725840374228, "sim_compute_sim_state": 0.02291078699959649, "sim_compute_performance-ego": 0.03846840726004706, "sim_compute_robot_state-ego": 0.04083634747399224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.18540154227334435, "sim_physics": 0.06345576047897339, "survival_time": 1.800000000000001, "driven_lanedir": 0.06784162189370324, "sim_render-ego": 0.036018298731909856, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.09760514232847424, "deviation-heading": 0.7435769161601652, "set_robot_commands": 0.05408503611882528, "deviation-center-line": 0.04206875100809539, "driven_lanedir_consec": 0.06784162189370324, "sim_compute_sim_state": 0.023146629333496097, "sim_compute_performance-ego": 0.03888440794414944, "sim_compute_robot_state-ego": 0.040535185072157115}}
set_robot_commands_max0.05466751257578532
set_robot_commands_mean0.054261288536510355
set_robot_commands_median0.05411069733755929
set_robot_commands_min0.0538970457540976
sim_compute_performance-ego_max0.03948041971992044
sim_compute_performance-ego_mean0.03887372521696876
sim_compute_performance-ego_median0.03888440794414944
sim_compute_performance-ego_min0.03846840726004706
sim_compute_robot_state-ego_max0.0409466215208465
sim_compute_robot_state-ego_mean0.04072010037058322
sim_compute_robot_state-ego_median0.04068296296255929
sim_compute_robot_state-ego_min0.040535185072157115
sim_compute_sim_state_max0.02336597442626953
sim_compute_sim_state_mean0.02310820644068544
sim_compute_sim_state_median0.023085362202412373
sim_compute_sim_state_min0.02291078699959649
sim_physics_max0.06345576047897339
sim_physics_mean0.05926414767182122
sim_physics_median0.0583351640140309
sim_physics_min0.056579886256037534
sim_render-ego_max0.03785369131300184
sim_render-ego_mean0.03612407563411185
sim_render-ego_median0.036018298731909856
sim_render-ego_min0.03492714263297416
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.3199999999999985
survival_time_min1.0500000000000005
No reset possible
239973789Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:07
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239963787Andrés Calderón 🇨🇴challenge-aido_LF-template-randomaido2-LFVI-sim-testing-offseasonstep1-simulationerroryesip-172-31-42-167-71940:08:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
239823781Yeong-Jia ChuBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryesip-172-31-42-167-71940:02:14
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
237153742jiang pengLF sim test - whaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-71940:14:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2713083739772268
survival_time_median5.04999999999999
deviation-center-line_median0.31806683794475604
in-drivable-lane_median1.2499999999999956


other stats
agent_compute-ego_max0.12809320992114498
agent_compute-ego_mean0.12706089946052476
agent_compute-ego_median0.12697452306747437
agent_compute-ego_min0.1261438562514934
deviation-center-line_max0.7211916231786494
deviation-center-line_mean0.40134617476411893
deviation-center-line_min0.24061218009407292
deviation-heading_max1.985444502691372
deviation-heading_mean1.1717402545301725
deviation-heading_median1.1890551848742072
deviation-heading_min0.6122663580637252
driven_any_max2.9584410343291796
driven_any_mean1.7571256515469826
driven_any_median1.6063054545284894
driven_any_min1.017458319867132
driven_lanedir_consec_max2.0982209947890547
driven_lanedir_consec_mean1.3456197615935737
driven_lanedir_consec_min0.580820957536107
driven_lanedir_max2.0982209947890547
driven_lanedir_mean1.3457070443631491
driven_lanedir_median1.2713083739772268
driven_lanedir_min0.5812573713839839
in-drivable-lane_max6.399999999999993
in-drivable-lane_mean1.9999999999999964
in-drivable-lane_min0.04999999999999982
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.017458319867132, "sim_physics": 0.1137802547582701, "survival_time": 8.949999999999992, "driven_lanedir": 0.5812573713839839, "sim_render-ego": 0.045858404489868845, "in-drivable-lane": 6.399999999999993, "agent_compute-ego": 0.12755458181796794, "deviation-heading": 1.1890551848742072, "set_robot_commands": 0.0723043114113408, "deviation-center-line": 0.24061218009407292, "driven_lanedir_consec": 0.580820957536107, "sim_compute_sim_state": 0.030705479936226788, "sim_compute_performance-ego": 0.05045981513721317, "sim_compute_robot_state-ego": 0.05341458853396624, "sim_compute_robot_state-npc0": 0.053941803937517734, "sim_compute_robot_state-npc1": 0.05333603161007333, "sim_compute_robot_state-npc2": 0.05251708377006999, "sim_compute_robot_state-npc3": 0.05275397194164425}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.5904643431334025, "sim_physics": 0.13596063321179683, "survival_time": 5.04999999999999, "driven_lanedir": 1.5184432423416716, "sim_render-ego": 0.04774908264084618, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.1265383262445431, "deviation-heading": 1.3345399387232824, "set_robot_commands": 0.06983025947419724, "deviation-center-line": 0.4567767219955693, "driven_lanedir_consec": 1.5184432423416716, "sim_compute_sim_state": 0.02997649070059899, "sim_compute_performance-ego": 0.05102222980839191, "sim_compute_robot_state-ego": 0.051745905734524866, "sim_compute_robot_state-npc0": 0.05372370587717189, "sim_compute_robot_state-npc1": 0.051880281750518495, "sim_compute_robot_state-npc2": 0.05296339138899699, "sim_compute_robot_state-npc3": 0.05187496572437853}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6129591058767103, "sim_physics": 0.11541854574325236, "survival_time": 4.699999999999991, "driven_lanedir": 1.2713083739772268, "sim_render-ego": 0.04407357155008519, "in-drivable-lane": 1.2499999999999956, "agent_compute-ego": 0.1261438562514934, "deviation-heading": 0.7373952882982748, "set_robot_commands": 0.06810627592370865, "deviation-center-line": 0.31806683794475604, "driven_lanedir_consec": 1.2713083739772268, "sim_compute_sim_state": 0.02811949811083205, "sim_compute_performance-ego": 0.047308346058459995, "sim_compute_robot_state-ego": 0.051389782986742384, "sim_compute_robot_state-npc0": 0.05199335737431303, "sim_compute_robot_state-npc1": 0.04970532528897549, "sim_compute_robot_state-npc2": 0.04895916137289494, "sim_compute_robot_state-npc3": 0.04921962352509194}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6063054545284894, "sim_physics": 0.12080603539943696, "survival_time": 3.999999999999994, "driven_lanedir": 1.2593052393238082, "sim_render-ego": 0.04765730202198029, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.12697452306747437, "deviation-heading": 0.6122663580637252, "set_robot_commands": 0.06882000863552093, "deviation-center-line": 0.2700835106075473, "driven_lanedir_consec": 1.2593052393238082, "sim_compute_sim_state": 0.03032896816730499, "sim_compute_performance-ego": 0.05233608782291412, "sim_compute_robot_state-ego": 0.052488818764686584, "sim_compute_robot_state-npc0": 0.05349414348602295, "sim_compute_robot_state-npc1": 0.051941245794296265, "sim_compute_robot_state-npc2": 0.05140843093395233, "sim_compute_robot_state-npc3": 0.05299774706363678}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.9584410343291796, "sim_physics": 0.11866556078779932, "survival_time": 10.20000000000001, "driven_lanedir": 2.0982209947890547, "sim_render-ego": 0.04629065709955552, "in-drivable-lane": 1.4999999999999956, "agent_compute-ego": 0.12809320992114498, "deviation-heading": 1.985444502691372, "set_robot_commands": 0.07031136283687517, "deviation-center-line": 0.7211916231786494, "driven_lanedir_consec": 2.0982209947890547, "sim_compute_sim_state": 0.029317083312015907, "sim_compute_performance-ego": 0.0507508773429721, "sim_compute_robot_state-ego": 0.051670755825790705, "sim_compute_robot_state-npc0": 0.05242313941319784, "sim_compute_robot_state-npc1": 0.051698477829203886, "sim_compute_robot_state-npc2": 0.0520554780960083, "sim_compute_robot_state-npc3": 0.05169609831828697}}
set_robot_commands_max0.0723043114113408
set_robot_commands_mean0.06987444365632857
set_robot_commands_median0.06983025947419724
set_robot_commands_min0.06810627592370865
sim_compute_performance-ego_max0.05233608782291412
sim_compute_performance-ego_mean0.05037547123399026
sim_compute_performance-ego_median0.0507508773429721
sim_compute_performance-ego_min0.047308346058459995
sim_compute_robot_state-ego_max0.05341458853396624
sim_compute_robot_state-ego_mean0.05214197036914216
sim_compute_robot_state-ego_median0.051745905734524866
sim_compute_robot_state-ego_min0.051389782986742384
sim_compute_robot_state-npc0_max0.053941803937517734
sim_compute_robot_state-npc0_mean0.05311523001764468
sim_compute_robot_state-npc0_median0.05349414348602295
sim_compute_robot_state-npc0_min0.05199335737431303
sim_compute_robot_state-npc1_max0.05333603161007333
sim_compute_robot_state-npc1_mean0.051712272454613496
sim_compute_robot_state-npc1_median0.051880281750518495
sim_compute_robot_state-npc1_min0.04970532528897549
sim_compute_robot_state-npc2_max0.05296339138899699
sim_compute_robot_state-npc2_mean0.05158070911238451
sim_compute_robot_state-npc2_median0.0520554780960083
sim_compute_robot_state-npc2_min0.04895916137289494
sim_compute_robot_state-npc3_max0.05299774706363678
sim_compute_robot_state-npc3_mean0.05170848131460769
sim_compute_robot_state-npc3_median0.05187496572437853
sim_compute_robot_state-npc3_min0.04921962352509194
sim_compute_sim_state_max0.030705479936226788
sim_compute_sim_state_mean0.02968950404539574
sim_compute_sim_state_median0.02997649070059899
sim_compute_sim_state_min0.02811949811083205
sim_physics_max0.13596063321179683
sim_physics_mean0.12092620598011113
sim_physics_median0.11866556078779932
sim_physics_min0.1137802547582701
sim_render-ego_max0.04774908264084618
sim_render-ego_mean0.046325803560467206
sim_render-ego_median0.04629065709955552
sim_render-ego_min0.04407357155008519
simulation-passed1
survival_time_max10.20000000000001
survival_time_mean6.579999999999996
survival_time_min3.999999999999994
No reset possible
236753717jiang pengSecond test -RGB- TH-jpaido2-LF-sim-testingstep1-simulationfailedyesip-172-31-42-167-71940:02:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 58, in on_received_get_commands
               ||     action = (action + np.random.normal(0,0.2,size=env.action_space.shape[0])).clip(env.action_space.low, env.action_space.high)
               || NameError: name 'env' is not defined
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
235913694Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-42-167-71940:16:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
234833659Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-71940:16:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6642436660663087
survival_time_median14.950000000000076
deviation-center-line_median0.6127901567591342
in-drivable-lane_median0


other stats
agent_compute-ego_max0.3206735249537571
agent_compute-ego_mean0.31700625580100394
agent_compute-ego_median0.31648379961649575
agent_compute-ego_min0.312611513932546
deviation-center-line_max1.3019541099294043
deviation-center-line_mean0.8511498118650721
deviation-center-line_min0.5066981329943391
deviation-heading_max4.055717681436225
deviation-heading_mean2.2639447928188265
deviation-heading_median2.4218493396621237
deviation-heading_min1.055344347110816
driven_any_max0.8769654767822298
driven_any_mean0.6687654736799274
driven_any_median0.8769654767821278
driven_any_min0.2619654676188363
driven_lanedir_consec_max0.8747874033840302
driven_lanedir_consec_mean0.6098641630266942
driven_lanedir_consec_min0.25444128804097765
driven_lanedir_max0.8747874033840302
driven_lanedir_mean0.6098641630266942
driven_lanedir_median0.6642436660663087
driven_lanedir_min0.25444128804097765
in-drivable-lane_max2.900000000000041
in-drivable-lane_mean0.5800000000000083
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8769654767821669, "sim_physics": 0.05316559235254924, "survival_time": 14.950000000000076, "driven_lanedir": 0.6642436660663087, "sim_render-ego": 0.0351360551516215, "in-drivable-lane": 2.900000000000041, "agent_compute-ego": 0.312611513932546, "deviation-heading": 2.6581344254089676, "set_robot_commands": 0.0546033787727356, "deviation-center-line": 0.6127901567591342, "driven_lanedir_consec": 0.6642436660663087, "sim_compute_sim_state": 0.022707699139912923, "sim_compute_performance-ego": 0.0380490779876709, "sim_compute_robot_state-ego": 0.03976110140482585}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8769654767822298, "sim_physics": 0.05472138404846191, "survival_time": 14.950000000000076, "driven_lanedir": 0.8261690326522699, "sim_render-ego": 0.03522776206334432, "in-drivable-lane": 0, "agent_compute-ego": 0.31630295832951866, "deviation-heading": 4.055717681436225, "set_robot_commands": 0.05412618080774943, "deviation-center-line": 1.281715573033011, "driven_lanedir_consec": 0.8261690326522699, "sim_compute_sim_state": 0.022726482550303143, "sim_compute_performance-ego": 0.03933650255203247, "sim_compute_robot_state-ego": 0.03994382381439209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2619654676188363, "sim_physics": 0.0522937444930381, "survival_time": 4.699999999999991, "driven_lanedir": 0.25444128804097765, "sim_render-ego": 0.0349651980907359, "in-drivable-lane": 0, "agent_compute-ego": 0.3189594821727022, "deviation-heading": 1.128678170475998, "set_robot_commands": 0.054122940022894674, "deviation-center-line": 0.5066981329943391, "driven_lanedir_consec": 0.25444128804097765, "sim_compute_sim_state": 0.022730644713056847, "sim_compute_performance-ego": 0.03846039416942191, "sim_compute_robot_state-ego": 0.043848676884427985}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4509654704342765, "sim_physics": 0.0549343270101365, "survival_time": 7.84999999999998, "driven_lanedir": 0.4296794249898848, "sim_render-ego": 0.03567575497232425, "in-drivable-lane": 0, "agent_compute-ego": 0.3206735249537571, "deviation-heading": 2.4218493396621237, "set_robot_commands": 0.05472214510486384, "deviation-center-line": 0.5525910866094718, "driven_lanedir_consec": 0.4296794249898848, "sim_compute_sim_state": 0.0228283724207787, "sim_compute_performance-ego": 0.03787975554253645, "sim_compute_robot_state-ego": 0.03983632774110053}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.8769654767821278, "sim_physics": 0.05427723884582519, "survival_time": 14.950000000000076, "driven_lanedir": 0.8747874033840302, "sim_render-ego": 0.03501849174499512, "in-drivable-lane": 0, "agent_compute-ego": 0.31648379961649575, "deviation-heading": 1.055344347110816, "set_robot_commands": 0.05342774391174317, "deviation-center-line": 1.3019541099294043, "driven_lanedir_consec": 0.8747874033840302, "sim_compute_sim_state": 0.02257968266805013, "sim_compute_performance-ego": 0.03816560904184977, "sim_compute_robot_state-ego": 0.040784647464752195}}
set_robot_commands_max0.05472214510486384
set_robot_commands_mean0.054200477723997345
set_robot_commands_median0.05412618080774943
set_robot_commands_min0.05342774391174317
sim_compute_performance-ego_max0.03933650255203247
sim_compute_performance-ego_mean0.0383782678587023
sim_compute_performance-ego_median0.03816560904184977
sim_compute_performance-ego_min0.03787975554253645
sim_compute_robot_state-ego_max0.043848676884427985
sim_compute_robot_state-ego_mean0.040834915461899726
sim_compute_robot_state-ego_median0.03994382381439209
sim_compute_robot_state-ego_min0.03976110140482585
sim_compute_sim_state_max0.0228283724207787
sim_compute_sim_state_mean0.02271457629842035
sim_compute_sim_state_median0.022726482550303143
sim_compute_sim_state_min0.02257968266805013
sim_physics_max0.0549343270101365
sim_physics_mean0.053878457350002185
sim_physics_median0.05427723884582519
sim_physics_min0.0522937444930381
sim_render-ego_max0.03567575497232425
sim_render-ego_mean0.03520465240460422
sim_render-ego_median0.0351360551516215
sim_render-ego_min0.0349651980907359
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.48000000000004
survival_time_min4.699999999999991
No reset possible
234573648Tony Hsu 🇹🇼Baseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-42-167-71940:18:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4569501890103642
survival_time_median14.950000000000076
deviation-center-line_median1.301168569795478
in-drivable-lane_median1.8000000000000107


other stats
agent_compute-ego_max0.26276496092478435
agent_compute-ego_mean0.23110902166366576
agent_compute-ego_median0.21996260643005372
agent_compute-ego_min0.21616416136423747
deviation-center-line_max1.3125511488831354
deviation-center-line_mean1.1985086282065969
deviation-center-line_min0.8168503090782064
deviation-heading_max9.114488416750689
deviation-heading_mean8.49621536573682
deviation-heading_median8.958328817197787
deviation-heading_min6.498379844353641
driven_any_max4.817677691380996
driven_any_mean4.817677691380984
driven_any_median4.817677691380987
driven_any_min4.817677691380966
driven_lanedir_consec_max1.4959818706634302
driven_lanedir_consec_mean1.447454660198641
driven_lanedir_consec_min1.3598522055779538
driven_lanedir_max3.002156010752614
driven_lanedir_mean2.841506234756632
driven_lanedir_median2.9457788003480623
driven_lanedir_min2.3634970567089493
in-drivable-lane_max4.650000000000027
in-drivable-lane_mean2.380000000000014
in-drivable-lane_min1.7500000000000098
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.817677691380996, "sim_physics": 0.05548554420471191, "survival_time": 14.950000000000076, "driven_lanedir": 2.918088194757594, "sim_render-ego": 0.03555293798446655, "in-drivable-lane": 1.9000000000000103, "agent_compute-ego": 0.21616416136423747, "deviation-heading": 8.958328817197787, "set_robot_commands": 0.055363659063975015, "deviation-center-line": 1.2532391684123592, "driven_lanedir_consec": 1.3598522055779538, "sim_compute_sim_state": 0.02263363202412923, "sim_compute_performance-ego": 0.03818883101145427, "sim_compute_robot_state-ego": 0.03993381579717}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.817677691380987, "sim_physics": 0.05394798437754313, "survival_time": 14.950000000000076, "driven_lanedir": 2.9457788003480623, "sim_render-ego": 0.03519783814748128, "in-drivable-lane": 1.8000000000000105, "agent_compute-ego": 0.2190894079208374, "deviation-heading": 9.114488416750689, "set_robot_commands": 0.05487186829249064, "deviation-center-line": 1.301168569795478, "driven_lanedir_consec": 1.46991933974784, "sim_compute_sim_state": 0.022661914030710856, "sim_compute_performance-ego": 0.03837620496749878, "sim_compute_robot_state-ego": 0.04085246483484904}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.817677691380966, "sim_physics": 0.05493957201639811, "survival_time": 14.950000000000076, "driven_lanedir": 2.3634970567089493, "sim_render-ego": 0.03505817810694377, "in-drivable-lane": 4.650000000000027, "agent_compute-ego": 0.21996260643005372, "deviation-heading": 6.498379844353641, "set_robot_commands": 0.05521396239598592, "deviation-center-line": 0.8168503090782064, "driven_lanedir_consec": 1.4959818706634302, "sim_compute_sim_state": 0.022768457730611164, "sim_compute_performance-ego": 0.03861080884933472, "sim_compute_robot_state-ego": 0.03966735521952311}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.817677691380982, "sim_physics": 0.05699605305989584, "survival_time": 14.950000000000076, "driven_lanedir": 3.002156010752614, "sim_render-ego": 0.035965359210968016, "in-drivable-lane": 1.7500000000000098, "agent_compute-ego": 0.23756397167841595, "deviation-heading": 8.944077312138214, "set_robot_commands": 0.05598080317179362, "deviation-center-line": 1.3087339448638062, "driven_lanedir_consec": 1.4569501890103642, "sim_compute_sim_state": 0.023410643736521405, "sim_compute_performance-ego": 0.03998084545135498, "sim_compute_robot_state-ego": 0.041617360115051266}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.817677691380995, "sim_physics": 0.06528013785680135, "survival_time": 14.950000000000076, "driven_lanedir": 2.9780111112159418, "sim_render-ego": 0.04436314582824707, "in-drivable-lane": 1.8000000000000107, "agent_compute-ego": 0.26276496092478435, "deviation-heading": 8.965802438243768, "set_robot_commands": 0.07097762028376262, "deviation-center-line": 1.3125511488831354, "driven_lanedir_consec": 1.4545696959936176, "sim_compute_sim_state": 0.02550589164098104, "sim_compute_performance-ego": 0.04383865038553874, "sim_compute_robot_state-ego": 0.0495304807027181}}
set_robot_commands_max0.07097762028376262
set_robot_commands_mean0.05848158264160157
set_robot_commands_median0.055363659063975015
set_robot_commands_min0.05487186829249064
sim_compute_performance-ego_max0.04383865038553874
sim_compute_performance-ego_mean0.0397990681330363
sim_compute_performance-ego_median0.03861080884933472
sim_compute_performance-ego_min0.03818883101145427
sim_compute_robot_state-ego_max0.0495304807027181
sim_compute_robot_state-ego_mean0.0423202953338623
sim_compute_robot_state-ego_median0.04085246483484904
sim_compute_robot_state-ego_min0.03966735521952311
sim_compute_sim_state_max0.02550589164098104
sim_compute_sim_state_mean0.02339610783259074
sim_compute_sim_state_median0.022768457730611164
sim_compute_sim_state_min0.02263363202412923
sim_physics_max0.06528013785680135
sim_physics_mean0.057329858303070066
sim_physics_median0.05548554420471191
sim_physics_min0.05394798437754313
sim_render-ego_max0.04436314582824707
sim_render-ego_mean0.03722749185562134
sim_render-ego_median0.03555293798446655
sim_render-ego_min0.03505817810694377
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible
233613612Riza Velioglu 🇩🇪aido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-71940:06:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233263598Victor Adolfo Romero Cano 🇨🇴aido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-42-167-71940:06:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.12759084360940115
agent_compute-ego_mean0.11145593134653108
agent_compute-ego_median0.11172129232672195
agent_compute-ego_min0.09938619754932544
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11284206531665944, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.0408646442272045, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.09938619754932544, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.07345981068081325, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.025333205858866375, "sim_compute_performance-ego": 0.05217196764769377, "sim_compute_robot_state-ego": 0.05326533317565918, "sim_compute_robot_state-npc0": 0.04864901966518826, "sim_compute_robot_state-npc1": 0.045478352793940795, "sim_compute_robot_state-npc2": 0.04670650870711715, "sim_compute_robot_state-npc3": 0.045170364556489165}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.122734317779541, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.050302648544311525, "in-drivable-lane": 0, "agent_compute-ego": 0.11299166679382323, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.0751535415649414, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.02798310279846191, "sim_compute_performance-ego": 0.05431384086608887, "sim_compute_robot_state-ego": 0.057003202438354494, "sim_compute_robot_state-npc0": 0.05496631622314453, "sim_compute_robot_state-npc1": 0.05842295646667481, "sim_compute_robot_state-npc2": 0.05555746078491211, "sim_compute_robot_state-npc3": 0.0519480037689209}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12007968990426314, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.04323607683181763, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1055896564533836, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.0645371675491333, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.02730455524043033, "sim_compute_performance-ego": 0.04650271879999261, "sim_compute_robot_state-ego": 0.048784729681516946, "sim_compute_robot_state-npc0": 0.04910896326366224, "sim_compute_robot_state-npc1": 0.04836492475710417, "sim_compute_robot_state-npc2": 0.04923229468496222, "sim_compute_robot_state-npc3": 0.04881271563078228}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.1262460509433022, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.04079777077783512, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.11172129232672195, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.069595581368555, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.026764990408209306, "sim_compute_performance-ego": 0.04545927651320832, "sim_compute_robot_state-ego": 0.04796127729778048, "sim_compute_robot_state-npc0": 0.05043248285221148, "sim_compute_robot_state-npc1": 0.04919333699383313, "sim_compute_robot_state-npc2": 0.047759291491931, "sim_compute_robot_state-npc3": 0.04577439947973324}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.12065327167510986, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.04872921534946987, "in-drivable-lane": 0, "agent_compute-ego": 0.12759084360940115, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.06985628604888916, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.028628204550061907, "sim_compute_performance-ego": 0.0503378084727696, "sim_compute_robot_state-ego": 0.047922755990709574, "sim_compute_robot_state-npc0": 0.05508664676121303, "sim_compute_robot_state-npc1": 0.05134316001619611, "sim_compute_robot_state-npc2": 0.0480705840247018, "sim_compute_robot_state-npc3": 0.048564297812325616}}
set_robot_commands_max0.0751535415649414
set_robot_commands_mean0.07052047744246642
set_robot_commands_median0.06985628604888916
set_robot_commands_min0.0645371675491333
sim_compute_performance-ego_max0.05431384086608887
sim_compute_performance-ego_mean0.049757122459950634
sim_compute_performance-ego_median0.0503378084727696
sim_compute_performance-ego_min0.04545927651320832
sim_compute_robot_state-ego_max0.057003202438354494
sim_compute_robot_state-ego_mean0.05098745971680414
sim_compute_robot_state-ego_median0.048784729681516946
sim_compute_robot_state-ego_min0.047922755990709574
sim_compute_robot_state-npc0_max0.05508664676121303
sim_compute_robot_state-npc0_mean0.051648685753083914
sim_compute_robot_state-npc0_median0.05043248285221148
sim_compute_robot_state-npc0_min0.04864901966518826
sim_compute_robot_state-npc1_max0.05842295646667481
sim_compute_robot_state-npc1_mean0.05056054620554981
sim_compute_robot_state-npc1_median0.04919333699383313
sim_compute_robot_state-npc1_min0.045478352793940795
sim_compute_robot_state-npc2_max0.05555746078491211
sim_compute_robot_state-npc2_mean0.049465227938724855
sim_compute_robot_state-npc2_median0.0480705840247018
sim_compute_robot_state-npc2_min0.04670650870711715
sim_compute_robot_state-npc3_max0.0519480037689209
sim_compute_robot_state-npc3_mean0.04805395624965024
sim_compute_robot_state-npc3_median0.048564297812325616
sim_compute_robot_state-npc3_min0.045170364556489165
sim_compute_sim_state_max0.028628204550061907
sim_compute_sim_state_mean0.027202811771205964
sim_compute_sim_state_median0.02730455524043033
sim_compute_sim_state_min0.025333205858866375
sim_physics_max0.1262460509433022
sim_physics_mean0.12051107912377512
sim_physics_median0.12065327167510986
sim_physics_min0.11284206531665944
sim_render-ego_max0.050302648544311525
sim_render-ego_mean0.044786071146127725
sim_render-ego_median0.04323607683181763
sim_render-ego_min0.04079777077783512
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
233063584Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-71940:02:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
233033581Peter Almasi 🇭🇺My solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-71940:33:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
232852873Peter Almasi 🇭🇺challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-42-167-71940:10:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231733573Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-42-167-71940:01:18
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
231643566Bhairav MehtaBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-42-167-71940:02:13
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible