AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1292

evaluator1292
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success49
# timeout
# failed6
# error33
# aborted1
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors100%
RAM total (MB)60.0 GB
RAM free (MB)57.2 GB
Disk (MB)96.9 GB
Disk available (MB)45.3 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
242504026dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:24(hidden)
driven_lanedir_consec_median0.06764961440318373
survival_time_median1.5500000000000007
deviation-center-line_median0.05353922704599162
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.17584759189236548
agent_compute-ego_mean0.15967225935874169
agent_compute-ego_median0.1637249443982099
agent_compute-ego_min0.13013916015625
deviation-center-line_max0.07228728063544432
deviation-center-line_mean0.05568939937029442
deviation-center-line_min0.04595955293841583
deviation-heading_max0.8102797062752097
deviation-heading_mean0.7189929988229335
deviation-heading_median0.7076820869772857
deviation-heading_min0.6413040214090833
driven_any_max0.23414043196558365
driven_any_mean0.1817946759897741
driven_any_median0.19494332741715545
driven_any_min0.07983512896685699
driven_lanedir_consec_max0.13269067689543812
driven_lanedir_consec_mean0.08174405942753796
driven_lanedir_consec_min0.031163125050107876
driven_lanedir_max0.13269067689543812
driven_lanedir_mean0.08174405942753796
driven_lanedir_median0.06764961440318373
driven_lanedir_min0.031163125050107876
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.3700000000000003
in-drivable-lane_min0.09999999999999998
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.20758257325870597, "sim_physics": 0.11502810426660486, "survival_time": 1.850000000000001, "driven_lanedir": 0.06764961440318373, "sim_render-ego": 0.06213520668648385, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.1637249443982099, "deviation-heading": 0.7396387120695755, "set_robot_commands": 0.0851498487833384, "deviation-center-line": 0.05988062769741462, "driven_lanedir_consec": 0.06764961440318373, "sim_compute_sim_state": 0.038930544982085355, "sim_compute_performance-ego": 0.06618240717295054, "sim_compute_robot_state-ego": 0.07183823714385161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19494332741715545, "sim_physics": 0.11551086107889812, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12003769089090845, "sim_render-ego": 0.0598755677541097, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15996412436167398, "deviation-heading": 0.6960604673835139, "set_robot_commands": 0.09281915823618572, "deviation-center-line": 0.04595955293841583, "driven_lanedir_consec": 0.12003769089090845, "sim_compute_sim_state": 0.03924883206685384, "sim_compute_performance-ego": 0.06790339946746826, "sim_compute_robot_state-ego": 0.07411030133565268}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.07983512896685699, "sim_physics": 0.08087834119796752, "survival_time": 1.0000000000000002, "driven_lanedir": 0.031163125050107876, "sim_render-ego": 0.04409643411636353, "in-drivable-lane": 0.09999999999999998, "agent_compute-ego": 0.13013916015625, "deviation-heading": 0.6413040214090833, "set_robot_commands": 0.06736184358596801, "deviation-center-line": 0.07228728063544432, "driven_lanedir_consec": 0.031163125050107876, "sim_compute_sim_state": 0.02943474054336548, "sim_compute_performance-ego": 0.05043606758117676, "sim_compute_robot_state-ego": 0.05418543815612793}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1924719183405686, "sim_physics": 0.11269831657409668, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0571791898980516, "sim_render-ego": 0.06678268217271374, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17584759189236548, "deviation-heading": 0.8102797062752097, "set_robot_commands": 0.11099821521389867, "deviation-center-line": 0.0467803085342057, "driven_lanedir_consec": 0.0571791898980516, "sim_compute_sim_state": 0.08366520943180207, "sim_compute_performance-ego": 0.07453630047459756, "sim_compute_robot_state-ego": 0.08079055816896501}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.23414043196558365, "sim_physics": 0.10849816931618585, "survival_time": 1.800000000000001, "driven_lanedir": 0.13269067689543812, "sim_render-ego": 0.060362941688961454, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.16868547598520914, "deviation-heading": 0.7076820869772857, "set_robot_commands": 0.0898665255970425, "deviation-center-line": 0.05353922704599162, "driven_lanedir_consec": 0.13269067689543812, "sim_compute_sim_state": 0.03742991553412543, "sim_compute_performance-ego": 0.06548131174511379, "sim_compute_robot_state-ego": 0.06767360369364421}}
set_robot_commands_max0.11099821521389867
set_robot_commands_mean0.08923911828328666
set_robot_commands_median0.0898665255970425
set_robot_commands_min0.06736184358596801
sim_compute_performance-ego_max0.07453630047459756
sim_compute_performance-ego_mean0.06490789728826138
sim_compute_performance-ego_median0.06618240717295054
sim_compute_performance-ego_min0.05043606758117676
sim_compute_robot_state-ego_max0.08079055816896501
sim_compute_robot_state-ego_mean0.06971962769964829
sim_compute_robot_state-ego_median0.07183823714385161
sim_compute_robot_state-ego_min0.05418543815612793
sim_compute_sim_state_max0.08366520943180207
sim_compute_sim_state_mean0.045741848511646435
sim_compute_sim_state_median0.038930544982085355
sim_compute_sim_state_min0.02943474054336548
sim_physics_max0.11551086107889812
sim_physics_mean0.1065227584867506
sim_physics_median0.11269831657409668
sim_physics_min0.08087834119796752
sim_render-ego_max0.06678268217271374
sim_render-ego_mean0.05865056648372645
sim_render-ego_median0.060362941688961454
sim_render-ego_min0.04409643411636353
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5400000000000005
survival_time_min1.0000000000000002
242494027frank_qcd_qkPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:22(hidden)
error_L10.1040164350658957
error_L20.01700436587691519


242484028frank_qcd_qkPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:25(hidden)
error_L10.10569992223446162
error_L20.016952521931323884


242474029frank_qcd_qkPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:28(hidden)
error_L10.1138016477386455
error_L20.020892323812484737


242464030frank_qcd_qkPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:24(hidden)
error_L10.1084108905153192
error_L20.01915055244104676


242454031frank_qcd_qkPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:54(hidden)
error_L10.10092962609094744
error_L20.015567438662365382


242444034frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:29(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07387472235638162
agent_compute-ego_mean0.06776243373835977
agent_compute-ego_median0.06671712795893352
agent_compute-ego_min0.06208847463130951
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.11159967704558035, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0639638900756836, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07063607094993055, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.09488685366133567, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04010172629020584, "sim_compute_performance-ego": 0.07024488314776353, "sim_compute_robot_state-ego": 0.07419886387569803}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11420814593633016, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05980888605117798, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.06671712795893352, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09478038549423218, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.039321517944335936, "sim_compute_performance-ego": 0.06505465507507324, "sim_compute_robot_state-ego": 0.07204765876134236}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.11151326786388052, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.05780239538712935, "in-drivable-lane": 0, "agent_compute-ego": 0.0654957727952437, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.090634671124545, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.03758197480982, "sim_compute_performance-ego": 0.06671703945506703, "sim_compute_robot_state-ego": 0.06981999223882501}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.101223220427831, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05602602660655975, "in-drivable-lane": 0, "agent_compute-ego": 0.06208847463130951, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.08518689374128978, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03486282626787821, "sim_compute_performance-ego": 0.06647999087969463, "sim_compute_robot_state-ego": 0.06664476792017619}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.1181959691254989, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.061122220495472786, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07387472235638162, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09428653509720512, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.039995820625968605, "sim_compute_performance-ego": 0.06951054282810377, "sim_compute_robot_state-ego": 0.07086284264274266}}
set_robot_commands_max0.09488685366133567
set_robot_commands_mean0.09195506782372156
set_robot_commands_median0.09428653509720512
set_robot_commands_min0.08518689374128978
sim_compute_performance-ego_max0.07024488314776353
sim_compute_performance-ego_mean0.06760142227714044
sim_compute_performance-ego_median0.06671703945506703
sim_compute_performance-ego_min0.06505465507507324
sim_compute_robot_state-ego_max0.07419886387569803
sim_compute_robot_state-ego_mean0.07071482508775687
sim_compute_robot_state-ego_median0.07086284264274266
sim_compute_robot_state-ego_min0.06664476792017619
sim_compute_sim_state_max0.04010172629020584
sim_compute_sim_state_mean0.03837277318764172
sim_compute_sim_state_median0.039321517944335936
sim_compute_sim_state_min0.03486282626787821
sim_physics_max0.1181959691254989
sim_physics_mean0.1113480560798242
sim_physics_median0.11159967704558035
sim_physics_min0.101223220427831
sim_render-ego_max0.0639638900756836
sim_render-ego_mean0.0597446837232047
sim_render-ego_median0.05980888605117798
sim_render-ego_min0.05602602660655975
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
242404039frank_qcd_qkchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12920:07:27
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242374042stoplightPredictorLastaido2-PREDstep1-simulationsuccessyes12920:01:43(hidden)
error_L10.11179044971560376
error_L20.01930513216973891


242314024meanstreetsPredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:22(hidden)
error_L10.11132477878434434
error_L20.01886465972354833


242294023dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242274022dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:01:20
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242264021dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242254013dgmds17avchallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242204017dgmds17avchallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242104004InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:00:28
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242094003InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:01:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242084002InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:00:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
242023997kene4192CNN-8logs-60by80-300aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:12:08(hidden)
driven_lanedir_consec_median0.6491524015194221
survival_time_median7.7499999999999805
deviation-center-line_median0.298159762582589
in-drivable-lane_median2.3499999999999917


other stats
agent_compute-ego_max0.13979810899303804
agent_compute-ego_mean0.12227577906954874
agent_compute-ego_median0.1187941866100959
agent_compute-ego_min0.1167394765337607
deviation-center-line_max0.35748352735032685
deviation-center-line_mean0.2706053587683885
deviation-center-line_min0.1426722627851455
deviation-heading_max1.6310745373495217
deviation-heading_mean1.2601255519307408
deviation-heading_median1.3033231817169522
deviation-heading_min0.9398180550756896
driven_any_max1.6761163956593674
driven_any_mean0.9779301726988652
driven_any_median0.992764740238928
driven_any_min0.22811936416882608
driven_lanedir_consec_max1.2352099622008397
driven_lanedir_consec_mean0.7302314087109985
driven_lanedir_consec_min0.19930484547145577
driven_lanedir_max1.2352099622008397
driven_lanedir_mean0.7302314087109985
driven_lanedir_median0.6491524015194221
driven_lanedir_min0.19930484547145577
in-drivable-lane_max3.4000000000000483
in-drivable-lane_mean1.6300000000000143
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.992764740238928, "sim_physics": 0.10615214070966168, "survival_time": 7.7499999999999805, "driven_lanedir": 0.6491524015194221, "sim_render-ego": 0.043186776868758665, "in-drivable-lane": 2.3499999999999917, "agent_compute-ego": 0.13979810899303804, "deviation-heading": 0.9694596828753403, "set_robot_commands": 0.06584599095006143, "deviation-center-line": 0.33616364716269703, "driven_lanedir_consec": 0.6491524015194221, "sim_compute_sim_state": 0.02646426077811949, "sim_compute_performance-ego": 0.04569629853771579, "sim_compute_robot_state-ego": 0.04782005433113344, "sim_compute_robot_state-npc0": 0.04687885469005954, "sim_compute_robot_state-npc1": 0.046975714160550026, "sim_compute_robot_state-npc2": 0.04575025804581181, "sim_compute_robot_state-npc3": 0.0464610222847231}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4029992407055608, "sim_physics": 0.09050892746966818, "survival_time": 3.4499999999999957, "driven_lanedir": 0.37142321755188945, "sim_render-ego": 0.0344750432000644, "in-drivable-lane": 0, "agent_compute-ego": 0.1171731257784194, "deviation-heading": 1.3033231817169522, "set_robot_commands": 0.05403304445570794, "deviation-center-line": 0.21854759396118417, "driven_lanedir_consec": 0.37142321755188945, "sim_compute_sim_state": 0.02214203710141389, "sim_compute_performance-ego": 0.037969108940898506, "sim_compute_robot_state-ego": 0.04022457288659137, "sim_compute_robot_state-npc0": 0.040077986924544624, "sim_compute_robot_state-npc1": 0.03876313264819159, "sim_compute_robot_state-npc2": 0.038589373878810715, "sim_compute_robot_state-npc3": 0.03875874781954116}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.589651122721644, "sim_physics": 0.08535975960065734, "survival_time": 13.250000000000052, "driven_lanedir": 1.2352099622008397, "sim_render-ego": 0.03501664467577664, "in-drivable-lane": 2.400000000000034, "agent_compute-ego": 0.1187941866100959, "deviation-heading": 1.6310745373495217, "set_robot_commands": 0.05410081845409465, "deviation-center-line": 0.298159762582589, "driven_lanedir_consec": 1.2352099622008397, "sim_compute_sim_state": 0.02215164922318369, "sim_compute_performance-ego": 0.03852760926732477, "sim_compute_robot_state-ego": 0.04002250005614083, "sim_compute_robot_state-npc0": 0.04100292943558603, "sim_compute_robot_state-npc1": 0.0388627457168867, "sim_compute_robot_state-npc2": 0.03861392129142329, "sim_compute_robot_state-npc3": 0.0418024369005887}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6761163956593674, "sim_physics": 0.08663078358298854, "survival_time": 13.300000000000054, "driven_lanedir": 1.1960666168113852, "sim_render-ego": 0.03511620912336765, "in-drivable-lane": 3.4000000000000483, "agent_compute-ego": 0.1167394765337607, "deviation-heading": 1.4569523026362, "set_robot_commands": 0.05410893250228767, "deviation-center-line": 0.35748352735032685, "driven_lanedir_consec": 1.1960666168113852, "sim_compute_sim_state": 0.023349989625744354, "sim_compute_performance-ego": 0.03804863754071688, "sim_compute_robot_state-ego": 0.04016167418401044, "sim_compute_robot_state-npc0": 0.03961514530325294, "sim_compute_robot_state-npc1": 0.03875484054249929, "sim_compute_robot_state-npc2": 0.03867209047303164, "sim_compute_robot_state-npc3": 0.03868743261896578}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22811936416882608, "sim_physics": 0.08989255021258098, "survival_time": 2.0500000000000007, "driven_lanedir": 0.19930484547145577, "sim_render-ego": 0.036626827426073025, "in-drivable-lane": 0, "agent_compute-ego": 0.11887399743242962, "deviation-heading": 0.9398180550756896, "set_robot_commands": 0.05463023883540456, "deviation-center-line": 0.1426722627851455, "driven_lanedir_consec": 0.19930484547145577, "sim_compute_sim_state": 0.023356106223129645, "sim_compute_performance-ego": 0.03941139942262231, "sim_compute_robot_state-ego": 0.04060751635853837, "sim_compute_robot_state-npc0": 0.04063352724400962, "sim_compute_robot_state-npc1": 0.04039428292251215, "sim_compute_robot_state-npc2": 0.04113325840089379, "sim_compute_robot_state-npc3": 0.04022834940654475}}
set_robot_commands_max0.06584599095006143
set_robot_commands_mean0.05654380503951125
set_robot_commands_median0.05410893250228767
set_robot_commands_min0.05403304445570794
sim_compute_performance-ego_max0.04569629853771579
sim_compute_performance-ego_mean0.03993061074185565
sim_compute_performance-ego_median0.03852760926732477
sim_compute_performance-ego_min0.037969108940898506
sim_compute_robot_state-ego_max0.04782005433113344
sim_compute_robot_state-ego_mean0.0417672635632829
sim_compute_robot_state-ego_median0.04022457288659137
sim_compute_robot_state-ego_min0.04002250005614083
sim_compute_robot_state-npc0_max0.04687885469005954
sim_compute_robot_state-npc0_mean0.04164168871949055
sim_compute_robot_state-npc0_median0.04063352724400962
sim_compute_robot_state-npc0_min0.03961514530325294
sim_compute_robot_state-npc1_max0.046975714160550026
sim_compute_robot_state-npc1_mean0.04075014319812795
sim_compute_robot_state-npc1_median0.0388627457168867
sim_compute_robot_state-npc1_min0.03875484054249929
sim_compute_robot_state-npc2_max0.04575025804581181
sim_compute_robot_state-npc2_mean0.040551780417994246
sim_compute_robot_state-npc2_median0.03867209047303164
sim_compute_robot_state-npc2_min0.038589373878810715
sim_compute_robot_state-npc3_max0.0464610222847231
sim_compute_robot_state-npc3_mean0.041187597806072694
sim_compute_robot_state-npc3_median0.04022834940654475
sim_compute_robot_state-npc3_min0.03868743261896578
sim_compute_sim_state_max0.02646426077811949
sim_compute_sim_state_mean0.023492808590318215
sim_compute_sim_state_median0.023349989625744354
sim_compute_sim_state_min0.02214203710141389
sim_physics_max0.10615214070966168
sim_physics_mean0.09170883231511132
sim_physics_median0.08989255021258098
sim_physics_min0.08535975960065734
sim_render-ego_max0.043186776868758665
sim_render-ego_mean0.03688430025880808
sim_render-ego_median0.03511620912336765
sim_render-ego_min0.0344750432000644
simulation-passed1
survival_time_max13.300000000000054
survival_time_mean7.960000000000017
survival_time_min2.0500000000000007
242003995jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:51(hidden)
driven_lanedir_consec_median0.13500147650407524
survival_time_median1.7000000000000008
deviation-center-line_median0.09347815402527108
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13373474847702754
agent_compute-ego_mean0.1248160060647489
agent_compute-ego_median0.1271025573506075
agent_compute-ego_min0.10777777784010945
deviation-center-line_max0.09807564877200577
deviation-center-line_mean0.0908409692147764
deviation-center-line_min0.0761656551873965
deviation-heading_max1.026322316484246
deviation-heading_mean0.8669480645103753
deviation-heading_median0.9392355268045351
deviation-heading_min0.5956093376057996
driven_any_max0.24588078734609584
driven_any_mean0.2006102799716876
driven_any_median0.21535840211668977
driven_any_min0.10610082794214762
driven_lanedir_consec_max0.1933669468962771
driven_lanedir_consec_mean0.1401030533669637
driven_lanedir_consec_min0.07575073737565585
driven_lanedir_max0.1933669468962771
driven_lanedir_mean0.1401030533669637
driven_lanedir_median0.13500147650407524
driven_lanedir_min0.07575073737565585
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.030000000000000027
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21535840211668977, "sim_physics": 0.08313416753496443, "survival_time": 1.7500000000000009, "driven_lanedir": 0.12402400378940204, "sim_render-ego": 0.04602439744131906, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1269242559160505, "deviation-heading": 1.026322316484246, "set_robot_commands": 0.0708148683820452, "deviation-center-line": 0.09807564877200577, "driven_lanedir_consec": 0.12402400378940204, "sim_compute_sim_state": 0.02963085174560547, "sim_compute_performance-ego": 0.05155196189880371, "sim_compute_robot_state-ego": 0.052898291179112024}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.24588078734609584, "sim_physics": 0.0778801160700181, "survival_time": 1.7000000000000008, "driven_lanedir": 0.1933669468962771, "sim_render-ego": 0.04623878002166748, "in-drivable-lane": 0, "agent_compute-ego": 0.1271025573506075, "deviation-heading": 0.783000417545756, "set_robot_commands": 0.06847026067621567, "deviation-center-line": 0.0761656551873965, "driven_lanedir_consec": 0.1933669468962771, "sim_compute_sim_state": 0.029986234272227567, "sim_compute_performance-ego": 0.05234433622921214, "sim_compute_robot_state-ego": 0.054125379113590014}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10610082794214762, "sim_physics": 0.07846747125898089, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07575073737565585, "sim_render-ego": 0.0457764466603597, "in-drivable-lane": 0, "agent_compute-ego": 0.13373474847702754, "deviation-heading": 0.5956093376057996, "set_robot_commands": 0.06790685653686523, "deviation-center-line": 0.0929654751914286, "driven_lanedir_consec": 0.07575073737565585, "sim_compute_sim_state": 0.02841971034095401, "sim_compute_performance-ego": 0.0486847786676316, "sim_compute_robot_state-ego": 0.051993006751650854}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2335001009317751, "sim_physics": 0.0891603946685791, "survival_time": 1.5000000000000009, "driven_lanedir": 0.17237210226940824, "sim_render-ego": 0.04299335479736328, "in-drivable-lane": 0, "agent_compute-ego": 0.12854069073994953, "deviation-heading": 0.9392355268045351, "set_robot_commands": 0.06133202711741129, "deviation-center-line": 0.09347815402527108, "driven_lanedir_consec": 0.17237210226940824, "sim_compute_sim_state": 0.028332098325093587, "sim_compute_performance-ego": 0.04871930281321208, "sim_compute_robot_state-ego": 0.04915723005930583}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2022112815217296, "sim_physics": 0.08018624081331141, "survival_time": 1.7000000000000008, "driven_lanedir": 0.13500147650407524, "sim_render-ego": 0.039191729882184195, "in-drivable-lane": 0, "agent_compute-ego": 0.10777777784010945, "deviation-heading": 0.9905727241115394, "set_robot_commands": 0.056110045489142925, "deviation-center-line": 0.09351991289778012, "driven_lanedir_consec": 0.13500147650407524, "sim_compute_sim_state": 0.024882211404688215, "sim_compute_performance-ego": 0.04361400884740493, "sim_compute_robot_state-ego": 0.045941219610326434}}
set_robot_commands_max0.0708148683820452
set_robot_commands_mean0.06492681164033606
set_robot_commands_median0.06790685653686523
set_robot_commands_min0.056110045489142925
sim_compute_performance-ego_max0.05234433622921214
sim_compute_performance-ego_mean0.04898287769125289
sim_compute_performance-ego_median0.04871930281321208
sim_compute_performance-ego_min0.04361400884740493
sim_compute_robot_state-ego_max0.054125379113590014
sim_compute_robot_state-ego_mean0.050823025342797035
sim_compute_robot_state-ego_median0.051993006751650854
sim_compute_robot_state-ego_min0.045941219610326434
sim_compute_sim_state_max0.029986234272227567
sim_compute_sim_state_mean0.028250221217713773
sim_compute_sim_state_median0.02841971034095401
sim_compute_sim_state_min0.024882211404688215
sim_physics_max0.0891603946685791
sim_physics_mean0.08176567806917079
sim_physics_median0.08018624081331141
sim_physics_min0.0778801160700181
sim_render-ego_max0.04623878002166748
sim_render-ego_mean0.04404494176057874
sim_render-ego_median0.0457764466603597
sim_render-ego_min0.039191729882184195
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.5400000000000007
survival_time_min1.0500000000000005
241963991InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:04:15(hidden)
driven_lanedir_consec_median0.09103428707701776
survival_time_median1.4000000000000006
deviation-center-line_median0.07347504166725541
in-drivable-lane_median0.2500000000000002


other stats
agent_compute-ego_max0.09854443611637238
agent_compute-ego_mean0.09485947170968062
agent_compute-ego_median0.09409027298291524
agent_compute-ego_min0.09370070119057931
deviation-center-line_max0.1045220519706366
deviation-center-line_mean0.07850302544892365
deviation-center-line_min0.04486851266996518
deviation-heading_max0.9013842713603002
deviation-heading_mean0.7287210431313083
deviation-heading_median0.8008927403046802
deviation-heading_min0.5025545349268744
driven_any_max0.2018261316383413
driven_any_mean0.1614488397293403
driven_any_median0.15047536487366542
driven_any_min0.12455944125342223
driven_lanedir_consec_max0.11903877827275532
driven_lanedir_consec_mean0.0885219379313386
driven_lanedir_consec_min0.0660902909208313
driven_lanedir_max0.11903877827275532
driven_lanedir_mean0.0885219379313386
driven_lanedir_median0.09103428707701776
driven_lanedir_min0.0660902909208313
in-drivable-lane_max0.30000000000000027
in-drivable-lane_mean0.16000000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.18592795226350772, "sim_physics": 0.0985280083071801, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07225083220351491, "sim_render-ego": 0.04495601500234296, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09854443611637238, "deviation-heading": 0.9013842713603002, "set_robot_commands": 0.054713118460870555, "deviation-center-line": 0.07347504166725541, "driven_lanedir_consec": 0.07225083220351491, "sim_compute_sim_state": 0.02189280140784479, "sim_compute_performance-ego": 0.03804942869370984, "sim_compute_robot_state-ego": 0.0401391290849255, "sim_compute_robot_state-npc0": 0.039419820231776086, "sim_compute_robot_state-npc1": 0.0388704115344632, "sim_compute_robot_state-npc2": 0.03849018773724956, "sim_compute_robot_state-npc3": 0.03843785870459772}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.2018261316383413, "sim_physics": 0.08815604640591529, "survival_time": 1.5500000000000007, "driven_lanedir": 0.0941955011825737, "sim_render-ego": 0.034242606932117094, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.09370070119057931, "deviation-heading": 0.9004772329163044, "set_robot_commands": 0.0545677908005253, "deviation-center-line": 0.06569388843425034, "driven_lanedir_consec": 0.0941955011825737, "sim_compute_sim_state": 0.02192492638864825, "sim_compute_performance-ego": 0.037655099745719664, "sim_compute_robot_state-ego": 0.040070495297831875, "sim_compute_robot_state-npc0": 0.0394017388743739, "sim_compute_robot_state-npc1": 0.03876724550800939, "sim_compute_robot_state-npc2": 0.038429006453483336, "sim_compute_robot_state-npc3": 0.03849099528404974}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12455944125342223, "sim_physics": 0.09763179222742716, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09103428707701776, "sim_render-ego": 0.03500562906265259, "in-drivable-lane": 0, "agent_compute-ego": 0.09409027298291524, "deviation-heading": 0.5382964361483829, "set_robot_commands": 0.0541115403175354, "deviation-center-line": 0.10395563250251068, "driven_lanedir_consec": 0.09103428707701776, "sim_compute_sim_state": 0.021876821915308636, "sim_compute_performance-ego": 0.04899753133455912, "sim_compute_robot_state-ego": 0.03994985421498617, "sim_compute_robot_state-npc0": 0.03915905952453613, "sim_compute_robot_state-npc1": 0.03853991627693176, "sim_compute_robot_state-npc2": 0.038557747999827065, "sim_compute_robot_state-npc3": 0.03835801283518473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.15047536487366542, "sim_physics": 0.10246379852294922, "survival_time": 1.2500000000000004, "driven_lanedir": 0.11903877827275532, "sim_render-ego": 0.03515209197998047, "in-drivable-lane": 0, "agent_compute-ego": 0.09418904304504394, "deviation-heading": 0.5025545349268744, "set_robot_commands": 0.05506420135498047, "deviation-center-line": 0.1045220519706366, "driven_lanedir_consec": 0.11903877827275532, "sim_compute_sim_state": 0.02196080207824707, "sim_compute_performance-ego": 0.03750899314880371, "sim_compute_robot_state-ego": 0.04000725746154785, "sim_compute_robot_state-npc0": 0.03945415496826172, "sim_compute_robot_state-npc1": 0.03841639518737793, "sim_compute_robot_state-npc2": 0.03836333274841309, "sim_compute_robot_state-npc3": 0.03836407661437989}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1444553086177646, "sim_physics": 0.08823115485055107, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0660902909208313, "sim_render-ego": 0.03487658500671387, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.09377290521349226, "deviation-heading": 0.8008927403046802, "set_robot_commands": 0.05380064249038696, "deviation-center-line": 0.04486851266996518, "driven_lanedir_consec": 0.0660902909208313, "sim_compute_sim_state": 0.022076972893306183, "sim_compute_performance-ego": 0.03757727997643607, "sim_compute_robot_state-ego": 0.039757771151406426, "sim_compute_robot_state-npc0": 0.03945342983518328, "sim_compute_robot_state-npc1": 0.03850806610924857, "sim_compute_robot_state-npc2": 0.03844536202294486, "sim_compute_robot_state-npc3": 0.038510773863111226}}
set_robot_commands_max0.05506420135498047
set_robot_commands_mean0.054451458684859746
set_robot_commands_median0.0545677908005253
set_robot_commands_min0.05380064249038696
sim_compute_performance-ego_max0.04899753133455912
sim_compute_performance-ego_mean0.03995766657984568
sim_compute_performance-ego_median0.037655099745719664
sim_compute_performance-ego_min0.03750899314880371
sim_compute_robot_state-ego_max0.0401391290849255
sim_compute_robot_state-ego_mean0.03998490144213957
sim_compute_robot_state-ego_median0.04000725746154785
sim_compute_robot_state-ego_min0.039757771151406426
sim_compute_robot_state-npc0_max0.03945415496826172
sim_compute_robot_state-npc0_mean0.03937764068682622
sim_compute_robot_state-npc0_median0.039419820231776086
sim_compute_robot_state-npc0_min0.03915905952453613
sim_compute_robot_state-npc1_max0.0388704115344632
sim_compute_robot_state-npc1_mean0.03862040692320617
sim_compute_robot_state-npc1_median0.03853991627693176
sim_compute_robot_state-npc1_min0.03841639518737793
sim_compute_robot_state-npc2_max0.038557747999827065
sim_compute_robot_state-npc2_mean0.03845712739238358
sim_compute_robot_state-npc2_median0.03844536202294486
sim_compute_robot_state-npc2_min0.03836333274841309
sim_compute_robot_state-npc3_max0.038510773863111226
sim_compute_robot_state-npc3_mean0.038432343460264654
sim_compute_robot_state-npc3_median0.03843785870459772
sim_compute_robot_state-npc3_min0.03835801283518473
sim_compute_sim_state_max0.022076972893306183
sim_compute_sim_state_mean0.021946464936670983
sim_compute_sim_state_median0.02192492638864825
sim_compute_sim_state_min0.021876821915308636
sim_physics_max0.10246379852294922
sim_physics_mean0.09500216006280456
sim_physics_median0.09763179222742716
sim_physics_min0.08815604640591529
sim_render-ego_max0.04495601500234296
sim_render-ego_mean0.03684658559676139
sim_render-ego_median0.03500562906265259
sim_render-ego_min0.034242606932117094
simulation-passed1
survival_time_max1.5500000000000007
survival_time_mean1.3900000000000006
survival_time_min1.2000000000000004
241953983jagwarBaseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:03:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241913987jagwarBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:13:26(hidden)
driven_lanedir_consec_median0.07146177434456735
survival_time_median1.5500000000000007
deviation-center-line_median0.09820782984989168
in-drivable-lane_median0.6000000000000004


other stats
agent_compute-ego_max0.16060907610001102
agent_compute-ego_mean0.1555725130309395
agent_compute-ego_median0.15475966612497966
agent_compute-ego_min0.15204803148905435
deviation-center-line_max0.5200348808056056
deviation-center-line_mean0.17415405516010057
deviation-center-line_min0.025131035096672444
deviation-heading_max6.105377691907242
deviation-heading_mean2.1592233310877096
deviation-heading_median0.6474877438208156
deviation-heading_min0.5710291486499823
driven_any_max1.942029678670349
driven_any_mean0.6349466193437678
driven_any_median0.1402937237589409
driven_any_min0.115556871569795
driven_lanedir_consec_max0.7049888387731444
driven_lanedir_consec_mean0.23792754022849713
driven_lanedir_consec_min0.04709428225818912
driven_lanedir_max0.7049888387731444
driven_lanedir_mean0.23792754022849713
driven_lanedir_median0.07146177434456735
driven_lanedir_min0.04709428225818912
in-drivable-lane_max6.800000000000031
in-drivable-lane_mean2.140000000000005
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8606932970119399, "sim_physics": 0.1676585353012626, "survival_time": 7.049999999999983, "driven_lanedir": 0.2978622256185588, "sim_render-ego": 0.06106623182905481, "in-drivable-lane": 3.1499999999999924, "agent_compute-ego": 0.1577698051506746, "deviation-heading": 2.8559928359992424, "set_robot_commands": 0.0871270108730235, "deviation-center-line": 0.14104270650948947, "driven_lanedir_consec": 0.2978622256185588, "sim_compute_sim_state": 0.038335732534422094, "sim_compute_performance-ego": 0.068674513634215, "sim_compute_robot_state-ego": 0.07341446775071164, "sim_compute_robot_state-npc0": 0.06486501930453253, "sim_compute_robot_state-npc1": 0.0643276221363257, "sim_compute_robot_state-npc2": 0.06501558824633875, "sim_compute_robot_state-npc3": 0.0658463180487883}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.942029678670349, "sim_physics": 0.1440636126200358, "survival_time": 14.950000000000076, "driven_lanedir": 0.7049888387731444, "sim_render-ego": 0.05833797216415405, "in-drivable-lane": 6.800000000000031, "agent_compute-ego": 0.15475966612497966, "deviation-heading": 6.105377691907242, "set_robot_commands": 0.08509961684544881, "deviation-center-line": 0.5200348808056056, "driven_lanedir_consec": 0.7049888387731444, "sim_compute_sim_state": 0.035726904074350994, "sim_compute_performance-ego": 0.06546767632166545, "sim_compute_robot_state-ego": 0.06671229521433512, "sim_compute_robot_state-npc0": 0.06244592348734538, "sim_compute_robot_state-npc1": 0.062186246713002526, "sim_compute_robot_state-npc2": 0.06081218242645264, "sim_compute_robot_state-npc3": 0.06124133268992106}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.115556871569795, "sim_physics": 0.17407425244649252, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07146177434456735, "sim_render-ego": 0.05858718355496725, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15267598628997803, "deviation-heading": 0.6162292350612638, "set_robot_commands": 0.08865949511528015, "deviation-center-line": 0.09820782984989168, "driven_lanedir_consec": 0.07146177434456735, "sim_compute_sim_state": 0.03710872928301493, "sim_compute_performance-ego": 0.06157435973485311, "sim_compute_robot_state-ego": 0.0642133355140686, "sim_compute_robot_state-npc0": 0.06425828735033672, "sim_compute_robot_state-npc1": 0.06738489866256714, "sim_compute_robot_state-npc2": 0.06444990634918213, "sim_compute_robot_state-npc3": 0.06732812523841858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.11615952570781404, "sim_physics": 0.15970670183499655, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06823058014802585, "sim_render-ego": 0.05923012892405192, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15204803148905435, "deviation-heading": 0.5710291486499823, "set_robot_commands": 0.08405160903930664, "deviation-center-line": 0.08635382353884369, "driven_lanedir_consec": 0.06823058014802585, "sim_compute_sim_state": 0.034205387036005654, "sim_compute_performance-ego": 0.06282452742258708, "sim_compute_robot_state-ego": 0.06609043478965759, "sim_compute_robot_state-npc0": 0.06006335218747457, "sim_compute_robot_state-npc1": 0.06309638420740764, "sim_compute_robot_state-npc2": 0.06406288345654805, "sim_compute_robot_state-npc3": 0.058907767136891685}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1402937237589409, "sim_physics": 0.14049113181329542, "survival_time": 1.5500000000000007, "driven_lanedir": 0.04709428225818912, "sim_render-ego": 0.05883980566455472, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.16060907610001102, "deviation-heading": 0.6474877438208156, "set_robot_commands": 0.08471695838436004, "deviation-center-line": 0.025131035096672444, "driven_lanedir_consec": 0.04709428225818912, "sim_compute_sim_state": 0.03679993075709189, "sim_compute_performance-ego": 0.06178972028916882, "sim_compute_robot_state-ego": 0.06520485108898531, "sim_compute_robot_state-npc0": 0.06419608669896279, "sim_compute_robot_state-npc1": 0.06608050869357202, "sim_compute_robot_state-npc2": 0.06452193567829748, "sim_compute_robot_state-npc3": 0.06289558256826093}}
set_robot_commands_max0.08865949511528015
set_robot_commands_mean0.08593093805148383
set_robot_commands_median0.08509961684544881
set_robot_commands_min0.08405160903930664
sim_compute_performance-ego_max0.068674513634215
sim_compute_performance-ego_mean0.0640661594804979
sim_compute_performance-ego_median0.06282452742258708
sim_compute_performance-ego_min0.06157435973485311
sim_compute_robot_state-ego_max0.07341446775071164
sim_compute_robot_state-ego_mean0.06712707687155166
sim_compute_robot_state-ego_median0.06609043478965759
sim_compute_robot_state-ego_min0.0642133355140686
sim_compute_robot_state-npc0_max0.06486501930453253
sim_compute_robot_state-npc0_mean0.06316573380573039
sim_compute_robot_state-npc0_median0.06419608669896279
sim_compute_robot_state-npc0_min0.06006335218747457
sim_compute_robot_state-npc1_max0.06738489866256714
sim_compute_robot_state-npc1_mean0.064615132082575
sim_compute_robot_state-npc1_median0.0643276221363257
sim_compute_robot_state-npc1_min0.062186246713002526
sim_compute_robot_state-npc2_max0.06501558824633875
sim_compute_robot_state-npc2_mean0.06377249923136381
sim_compute_robot_state-npc2_median0.06444990634918213
sim_compute_robot_state-npc2_min0.06081218242645264
sim_compute_robot_state-npc3_max0.06732812523841858
sim_compute_robot_state-npc3_mean0.06324382513645611
sim_compute_robot_state-npc3_median0.06289558256826093
sim_compute_robot_state-npc3_min0.058907767136891685
sim_compute_sim_state_max0.038335732534422094
sim_compute_sim_state_mean0.03643533673697712
sim_compute_sim_state_median0.03679993075709189
sim_compute_sim_state_min0.034205387036005654
sim_physics_max0.17407425244649252
sim_physics_mean0.15719884680321658
sim_physics_median0.15970670183499655
sim_physics_min0.14049113181329542
sim_render-ego_max0.06106623182905481
sim_render-ego_mean0.059212264427356553
sim_render-ego_median0.05883980566455472
sim_render-ego_min0.05833797216415405
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean5.190000000000012
survival_time_min1.2000000000000004
241753958jagwarBaseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:04:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241733959jagwarBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:04:20(hidden)
driven_lanedir_consec_median0.1173463944928188
survival_time_median1.4500000000000006
deviation-center-line_median0.08130657099986943
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17554755210876466
agent_compute-ego_mean0.1575145538931596
agent_compute-ego_median0.1561292944283321
agent_compute-ego_min0.14622875360342172
deviation-center-line_max0.08852313630411515
deviation-center-line_mean0.07789499700688966
deviation-center-line_min0.06089457356967892
deviation-heading_max0.966259800659606
deviation-heading_mean0.8167423095226483
deviation-heading_median0.8148900608222223
deviation-heading_min0.6147916915952095
driven_any_max0.23691052383568212
driven_any_mean0.19149548732735375
driven_any_median0.20967115839525363
driven_any_min0.1023272008529338
driven_lanedir_consec_max0.1625563878937013
driven_lanedir_consec_mean0.12148942792311748
driven_lanedir_consec_min0.06473575684808974
driven_lanedir_max0.1625563878937013
driven_lanedir_mean0.12148942792311748
driven_lanedir_median0.1173463944928188
driven_lanedir_min0.06473575684808974
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.04000000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21028901847479736, "sim_physics": 0.12450808684031169, "survival_time": 1.5000000000000009, "driven_lanedir": 0.11426161755672704, "sim_render-ego": 0.07786980470021566, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17554755210876466, "deviation-heading": 0.9171186957686566, "set_robot_commands": 0.09257846673329671, "deviation-center-line": 0.08560118198542152, "driven_lanedir_consec": 0.11426161755672704, "sim_compute_sim_state": 0.03615020116170247, "sim_compute_performance-ego": 0.06908659934997559, "sim_compute_robot_state-ego": 0.08005922635396322}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23691052383568212, "sim_physics": 0.10106054219332608, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1625563878937013, "sim_render-ego": 0.0587959217302727, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16107242035143304, "deviation-heading": 0.8148900608222223, "set_robot_commands": 0.0881774497754646, "deviation-center-line": 0.06089457356967892, "driven_lanedir_consec": 0.1625563878937013, "sim_compute_sim_state": 0.03738436554417466, "sim_compute_performance-ego": 0.06548928491996997, "sim_compute_robot_state-ego": 0.06782144488710345}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1023272008529338, "sim_physics": 0.10855575799942016, "survival_time": 1.0000000000000002, "driven_lanedir": 0.06473575684808974, "sim_render-ego": 0.05670520067214966, "in-drivable-lane": 0, "agent_compute-ego": 0.14859474897384645, "deviation-heading": 0.6147916915952095, "set_robot_commands": 0.08407092094421387, "deviation-center-line": 0.08852313630411515, "driven_lanedir_consec": 0.06473575684808974, "sim_compute_sim_state": 0.03782958984375, "sim_compute_performance-ego": 0.060715782642364505, "sim_compute_robot_state-ego": 0.06124976873397827}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1982795350781019, "sim_physics": 0.11382654997018668, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1173463944928188, "sim_render-ego": 0.05634486675262451, "in-drivable-lane": 0, "agent_compute-ego": 0.14622875360342172, "deviation-heading": 0.966259800659606, "set_robot_commands": 0.0824439158806434, "deviation-center-line": 0.08130657099986943, "driven_lanedir_consec": 0.1173463944928188, "sim_compute_sim_state": 0.03672404472644512, "sim_compute_performance-ego": 0.05866836584531344, "sim_compute_robot_state-ego": 0.06412026515373817}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20967115839525363, "sim_physics": 0.11195031527815194, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1485469828242505, "sim_render-ego": 0.05472037709992507, "in-drivable-lane": 0, "agent_compute-ego": 0.1561292944283321, "deviation-heading": 0.7706512987675468, "set_robot_commands": 0.08358370024582436, "deviation-center-line": 0.07314952217536333, "driven_lanedir_consec": 0.1485469828242505, "sim_compute_sim_state": 0.034836588234737, "sim_compute_performance-ego": 0.06206196752087823, "sim_compute_robot_state-ego": 0.06510832391936204}}
set_robot_commands_max0.09257846673329671
set_robot_commands_mean0.08617089071588858
set_robot_commands_median0.08407092094421387
set_robot_commands_min0.0824439158806434
sim_compute_performance-ego_max0.06908659934997559
sim_compute_performance-ego_mean0.06320440005570034
sim_compute_performance-ego_median0.06206196752087823
sim_compute_performance-ego_min0.05866836584531344
sim_compute_robot_state-ego_max0.08005922635396322
sim_compute_robot_state-ego_mean0.06767180580962903
sim_compute_robot_state-ego_median0.06510832391936204
sim_compute_robot_state-ego_min0.06124976873397827
sim_compute_sim_state_max0.03782958984375
sim_compute_sim_state_mean0.03658495790216185
sim_compute_sim_state_median0.03672404472644512
sim_compute_sim_state_min0.034836588234737
sim_physics_max0.12450808684031169
sim_physics_mean0.11198025045627932
sim_physics_median0.11195031527815194
sim_physics_min0.10106054219332608
sim_render-ego_max0.07786980470021566
sim_render-ego_mean0.06088723419103752
sim_render-ego_median0.05670520067214966
sim_render-ego_min0.05472037709992507
simulation-passed1
survival_time_max1.6500000000000008
survival_time_mean1.3800000000000003
survival_time_min1.0000000000000002
241703964jagwarBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyes12920:15:27(hidden)
driven_lanedir_consec_median0.17936025855289817
survival_time_median1.4000000000000006
deviation-center-line_median0.09708644074530565
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1886042356491089
agent_compute-ego_mean0.16255350838944002
agent_compute-ego_median0.1613065997759501
agent_compute-ego_min0.1297280192375183
deviation-center-line_max0.12341601105462724
deviation-center-line_mean0.09685347038459828
deviation-center-line_min0.05797792697912947
deviation-heading_max1.0592490920783189
deviation-heading_mean0.6765103124740133
deviation-heading_median0.6922725404679463
deviation-heading_min0.4053793220622803
driven_any_max0.35627781537910846
driven_any_mean0.22359049981023343
driven_any_median0.20921291960226565
driven_any_min0.14676607039500444
driven_lanedir_consec_max0.29822512704750803
driven_lanedir_consec_mean0.1756226449002365
driven_lanedir_consec_min0.1130676053863513
driven_lanedir_max0.29822512704750803
driven_lanedir_mean0.1756226449002365
driven_lanedir_median0.17936025855289817
driven_lanedir_min0.1130676053863513
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.003333333333333336
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.23579476020261456, "sim_physics": 0.19333495299021403, "survival_time": 1.5000000000000009, "driven_lanedir": 0.15796808196981127, "sim_render-ego": 0.05521849791208903, "in-drivable-lane": 0, "agent_compute-ego": 0.16232415040334067, "deviation-heading": 0.9080098114650692, "set_robot_commands": 0.08827861150105794, "deviation-center-line": 0.09708644074530565, "driven_lanedir_consec": 0.15796808196981127, "sim_compute_sim_state": 0.03679037094116211, "sim_compute_performance-ego": 0.06522380510965983, "sim_compute_robot_state-ego": 0.07292789618174235, "sim_compute_robot_state-npc0": 0.06611181100209554, "sim_compute_robot_state-npc1": 0.06499384244283041, "sim_compute_robot_state-npc2": 0.07075115044911702, "sim_compute_robot_state-npc3": 0.06996377309163411}, "udem1-1-0": {"driven_any": 0.20320264893367565, "sim_physics": 0.19019656711154517, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1130676053863513, "sim_render-ego": 0.060755270498770254, "in-drivable-lane": 0, "agent_compute-ego": 0.15227486469127513, "deviation-heading": 1.0592490920783189, "set_robot_commands": 0.0869563862129494, "deviation-center-line": 0.09148243006180272, "driven_lanedir_consec": 0.1130676053863513, "sim_compute_sim_state": 0.040322445057056566, "sim_compute_performance-ego": 0.06695216673391836, "sim_compute_robot_state-ego": 0.06362081457067419, "sim_compute_robot_state-npc0": 0.06425015131632487, "sim_compute_robot_state-npc1": 0.06426267270688657, "sim_compute_robot_state-npc2": 0.05938362192224573, "sim_compute_robot_state-npc3": 0.06424245127925167}, "udem1-2-0": {"driven_any": 0.20380318813798484, "sim_physics": 0.24588819650503305, "survival_time": 1.3000000000000005, "driven_lanedir": 0.18057193799716664, "sim_render-ego": 0.06155106654533973, "in-drivable-lane": 0, "agent_compute-ego": 0.17700595122117263, "deviation-heading": 0.4081718850052205, "set_robot_commands": 0.0978408593397874, "deviation-center-line": 0.12074350072278324, "driven_lanedir_consec": 0.18057193799716664, "sim_compute_sim_state": 0.03898540826944205, "sim_compute_performance-ego": 0.06753117304581863, "sim_compute_robot_state-ego": 0.07438155320974496, "sim_compute_robot_state-npc0": 0.06881980712597187, "sim_compute_robot_state-npc1": 0.06934010982513428, "sim_compute_robot_state-npc2": 0.06802655183351956, "sim_compute_robot_state-npc3": 0.06542680813716008}, "udem1-3-0": {"driven_any": 0.24483696923572004, "sim_physics": 0.19645270807989712, "survival_time": 1.4500000000000006, "driven_lanedir": 0.21284385987680188, "sim_render-ego": 0.06383727336752004, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16144625071821542, "deviation-heading": 0.4053793220622803, "set_robot_commands": 0.09210349773538525, "deviation-center-line": 0.12097630888718072, "driven_lanedir_consec": 0.21284385987680188, "sim_compute_sim_state": 0.03613416901950178, "sim_compute_performance-ego": 0.0710220090274153, "sim_compute_robot_state-ego": 0.07203688292667784, "sim_compute_robot_state-npc0": 0.07000687204558274, "sim_compute_robot_state-npc1": 0.06514477729797363, "sim_compute_robot_state-npc2": 0.06072905967975485, "sim_compute_robot_state-npc3": 0.0572624946462697}, "udem1-4-0": {"driven_any": 0.17720936396218126, "sim_physics": 0.19787264863650003, "survival_time": 1.2000000000000004, "driven_lanedir": 0.12931117307408857, "sim_render-ego": 0.06160968542098999, "in-drivable-lane": 0, "agent_compute-ego": 0.15771469473838806, "deviation-heading": 0.6922725404679463, "set_robot_commands": 0.09791415929794312, "deviation-center-line": 0.0638666557147622, "driven_lanedir_consec": 0.12931117307408857, "sim_compute_sim_state": 0.04042185346285502, "sim_compute_performance-ego": 0.06882428129514058, "sim_compute_robot_state-ego": 0.07101779182751973, "sim_compute_robot_state-npc0": 0.06534675757090251, "sim_compute_robot_state-npc1": 0.07285383343696594, "sim_compute_robot_state-npc2": 0.06907065709431966, "sim_compute_robot_state-npc3": 0.07073378562927246}, "udem1-5-0": {"driven_any": 0.35627781537910846, "sim_physics": 0.19316827945220164, "survival_time": 1.950000000000001, "driven_lanedir": 0.29822512704750803, "sim_render-ego": 0.06402840369786972, "in-drivable-lane": 0, "agent_compute-ego": 0.17296352141942734, "deviation-heading": 0.8630060737823859, "set_robot_commands": 0.09175573251186273, "deviation-center-line": 0.11465523612918252, "driven_lanedir_consec": 0.29822512704750803, "sim_compute_sim_state": 0.03932508444174742, "sim_compute_performance-ego": 0.06862192276196602, "sim_compute_robot_state-ego": 0.07539656834724622, "sim_compute_robot_state-npc0": 0.06952736927912785, "sim_compute_robot_state-npc1": 0.07143790293962528, "sim_compute_robot_state-npc2": 0.06788421899844439, "sim_compute_robot_state-npc3": 0.06956213559859838}, "udem1-6-0": {"driven_any": 0.1877413005213298, "sim_physics": 0.18856299916903177, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1558162105759866, "sim_render-ego": 0.05048587918281555, "in-drivable-lane": 0, "agent_compute-ego": 0.1297280192375183, "deviation-heading": 0.4862609758451484, "set_robot_commands": 0.06787663698196411, "deviation-center-line": 0.09542367316869196, "driven_lanedir_consec": 0.1558162105759866, "sim_compute_sim_state": 0.032961895068486534, "sim_compute_performance-ego": 0.05395974715550741, "sim_compute_robot_state-ego": 0.05788166324297587, "sim_compute_robot_state-npc0": 0.055108447869618736, "sim_compute_robot_state-npc1": 0.055827091137568154, "sim_compute_robot_state-npc2": 0.05769388874371847, "sim_compute_robot_state-npc3": 0.056799362103144325}, "udem1-7-0": {"driven_any": 0.20921291960226565, "sim_physics": 0.20340645754778827, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17936025855289817, "sim_render-ego": 0.05908625214188187, "in-drivable-lane": 0, "agent_compute-ego": 0.14620867481938116, "deviation-heading": 0.5105276571185644, "set_robot_commands": 0.08025766302038122, "deviation-center-line": 0.11152915772838728, "driven_lanedir_consec": 0.17936025855289817, "sim_compute_sim_state": 0.03530297455964265, "sim_compute_performance-ego": 0.06328754071836118, "sim_compute_robot_state-ego": 0.06371902536462855, "sim_compute_robot_state-npc0": 0.06073088116115994, "sim_compute_robot_state-npc1": 0.05980684139110424, "sim_compute_robot_state-npc2": 0.059475713306003146, "sim_compute_robot_state-npc3": 0.05932613655372902}, "udem1-8-0": {"driven_any": 0.20730821649567988, "sim_physics": 0.18796583811442055, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14657137290761213, "sim_render-ego": 0.06138500372568766, "in-drivable-lane": 0, "agent_compute-ego": 0.18140757083892825, "deviation-heading": 0.8281639837843198, "set_robot_commands": 0.08880741596221924, "deviation-center-line": 0.07326062201892533, "driven_lanedir_consec": 0.14657137290761213, "sim_compute_sim_state": 0.040300973256429035, "sim_compute_performance-ego": 0.06962114969889323, "sim_compute_robot_state-ego": 0.07729551792144776, "sim_compute_robot_state-npc0": 0.06092475255330403, "sim_compute_robot_state-npc1": 0.07464617093404134, "sim_compute_robot_state-npc2": 0.06847843329111734, "sim_compute_robot_state-npc3": 0.06705987453460693}, "udem1-9-0": {"driven_any": 0.23257586339389705, "sim_physics": 0.2285673107419695, "survival_time": 1.4000000000000006, "driven_lanedir": 0.18485765709412205, "sim_render-ego": 0.05893785612923758, "in-drivable-lane": 0, "agent_compute-ego": 0.15874783481870378, "deviation-heading": 0.7504580247963909, "set_robot_commands": 0.09391022580010552, "deviation-center-line": 0.07494748969837904, "driven_lanedir_consec": 0.18485765709412205, "sim_compute_sim_state": 0.04062385218484061, "sim_compute_performance-ego": 0.0643782104764666, "sim_compute_robot_state-ego": 0.06841410057885307, "sim_compute_robot_state-npc0": 0.06487103019441877, "sim_compute_robot_state-npc1": 0.06617950541632515, "sim_compute_robot_state-npc2": 0.06780705281666347, "sim_compute_robot_state-npc3": 0.0658777015549796}, "udem1-10-0": {"driven_any": 0.1819260291319965, "sim_physics": 0.19317898154258728, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13075085236402706, "sim_render-ego": 0.06040326754252116, "in-drivable-lane": 0, "agent_compute-ego": 0.1613065997759501, "deviation-heading": 0.7357306113386274, "set_robot_commands": 0.08487412333488464, "deviation-center-line": 0.05797792697912947, "driven_lanedir_consec": 0.13075085236402706, "sim_compute_sim_state": 0.03788940111796061, "sim_compute_performance-ego": 0.0641375184059143, "sim_compute_robot_state-ego": 0.0634571115175883, "sim_compute_robot_state-npc0": 0.06437504291534424, "sim_compute_robot_state-npc1": 0.06388988097508748, "sim_compute_robot_state-npc2": 0.060592194398244224, "sim_compute_robot_state-npc3": 0.06488218903541565}, "udem1-11-0": {"driven_any": 0.14676607039500444, "sim_physics": 0.1824332909150557, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11713116028757664, "sim_render-ego": 0.06017588485370983, "in-drivable-lane": 0, "agent_compute-ego": 0.15179563652385364, "deviation-heading": 0.4875222646218349, "set_robot_commands": 0.08530980890447443, "deviation-center-line": 0.09798103554681388, "driven_lanedir_consec": 0.11713116028757664, "sim_compute_sim_state": 0.037645849314602936, "sim_compute_performance-ego": 0.06278737024827437, "sim_compute_robot_state-ego": 0.06692695617675781, "sim_compute_robot_state-npc0": 0.06807448647238991, "sim_compute_robot_state-npc1": 0.06365292722528632, "sim_compute_robot_state-npc2": 0.060471328822049225, "sim_compute_robot_state-npc3": 0.061105262149464}, "udem1-12-0": {"driven_any": 0.28105391361126775, "sim_physics": 0.22695302282060895, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2034192718431933, "sim_render-ego": 0.06317354610988073, "in-drivable-lane": 0, "agent_compute-ego": 0.1828521864754813, "deviation-heading": 0.9296058691932696, "set_robot_commands": 0.0944192750113351, "deviation-center-line": 0.1138620899288437, "driven_lanedir_consec": 0.2034192718431933, "sim_compute_sim_state": 0.03925652503967285, "sim_compute_performance-ego": 0.0695728029523577, "sim_compute_robot_state-ego": 0.07589712142944335, "sim_compute_robot_state-npc0": 0.06880971363612584, "sim_compute_robot_state-npc1": 0.06922625132969447, "sim_compute_robot_state-npc2": 0.06718613760811942, "sim_compute_robot_state-npc3": 0.06656340871538435}, "udem1-13-0": {"driven_any": 0.24282372757293413, "sim_physics": 0.1825281340500404, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2185645234991722, "sim_render-ego": 0.05802263884708799, "in-drivable-lane": 0, "agent_compute-ego": 0.15392243451085583, "deviation-heading": 0.4616363755948083, "set_robot_commands": 0.08973632187678895, "deviation-center-line": 0.12341601105462724, "driven_lanedir_consec": 0.2185645234991722, "sim_compute_sim_state": 0.03423213136607203, "sim_compute_performance-ego": 0.06572871372617524, "sim_compute_robot_state-ego": 0.06737161504811254, "sim_compute_robot_state-npc0": 0.06177870980624495, "sim_compute_robot_state-npc1": 0.06577768819085483, "sim_compute_robot_state-npc2": 0.06407816656704607, "sim_compute_robot_state-npc3": 0.06421360476263638}, "udem1-14-0": {"driven_any": 0.2433247105778423, "sim_physics": 0.2194858471552531, "survival_time": 1.5000000000000009, "driven_lanedir": 0.20588058102723128, "sim_render-ego": 0.06826727390289307, "in-drivable-lane": 0, "agent_compute-ego": 0.1886042356491089, "deviation-heading": 0.6216601999560148, "set_robot_commands": 0.09847163359324138, "deviation-center-line": 0.09559347738415924, "driven_lanedir_consec": 0.20588058102723128, "sim_compute_sim_state": 0.04056087334950765, "sim_compute_performance-ego": 0.0744309663772583, "sim_compute_robot_state-ego": 0.08548933664957682, "sim_compute_robot_state-npc0": 0.06656737327575683, "sim_compute_robot_state-npc1": 0.0668702522913615, "sim_compute_robot_state-npc2": 0.06861433982849122, "sim_compute_robot_state-npc3": 0.07288192907969157}}
set_robot_commands_max0.09847163359324138
set_robot_commands_mean0.08923415673895871
set_robot_commands_median0.08973632187678895
set_robot_commands_min0.06787663698196411
sim_compute_performance-ego_max0.0744309663772583
sim_compute_performance-ego_mean0.06640529184887514
sim_compute_performance-ego_median0.06695216673391836
sim_compute_performance-ego_min0.05395974715550741
sim_compute_robot_state-ego_max0.08548933664957682
sim_compute_robot_state-ego_mean0.07038893033286596
sim_compute_robot_state-ego_median0.07101779182751973
sim_compute_robot_state-ego_min0.05788166324297587
sim_compute_robot_state-npc0_max0.07000687204558274
sim_compute_robot_state-npc0_mean0.06502021374829123
sim_compute_robot_state-npc0_median0.06534675757090251
sim_compute_robot_state-npc0_min0.055108447869618736
sim_compute_robot_state-npc1_max0.07464617093404134
sim_compute_robot_state-npc1_mean0.0662606498360493
sim_compute_robot_state-npc1_median0.06577768819085483
sim_compute_robot_state-npc1_min0.055827091137568154
sim_compute_robot_state-npc2_max0.07075115044911702
sim_compute_robot_state-npc2_mean0.06468283435725691
sim_compute_robot_state-npc2_median0.06718613760811942
sim_compute_robot_state-npc2_min0.05769388874371847
sim_compute_robot_state-npc3_max0.07288192907969157
sim_compute_robot_state-npc3_mean0.06506006112474921
sim_compute_robot_state-npc3_median0.06542680813716008
sim_compute_robot_state-npc3_min0.056799362103144325
sim_compute_sim_state_max0.04062385218484061
sim_compute_sim_state_mean0.03805025376326532
sim_compute_sim_state_median0.03898540826944205
sim_compute_sim_state_min0.032961895068486534
sim_physics_max0.24588819650503305
sim_physics_mean0.2019996823221431
sim_physics_median0.19333495299021403
sim_physics_min0.1824332909150557
sim_render-ego_max0.06826727390289307
sim_render-ego_mean0.06046251999188628
sim_render-ego_median0.060755270498770254
sim_render-ego_min0.05048587918281555
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.4133333333333338
survival_time_min1.1000000000000003
241663955InderpalBaseline solution using reinforcement learningaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:04:15(hidden)
driven_lanedir_consec_median0.08258472576149511
survival_time_median1.2000000000000004
deviation-center-line_median0.06470910686335131
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13219820459683737
agent_compute-ego_mean0.12729924812902862
agent_compute-ego_median0.1278234286741777
agent_compute-ego_min0.11944710124622691
deviation-center-line_max0.09563817321808844
deviation-center-line_mean0.07383801819164318
deviation-center-line_min0.05370163102480888
deviation-heading_max0.8598728343355607
deviation-heading_mean0.6838311478963103
deviation-heading_median0.7216060600533464
deviation-heading_min0.5039361222611668
driven_any_max0.2301571669272056
driven_any_mean0.1585928458767151
driven_any_median0.1392677637202442
driven_any_min0.11225536755816816
driven_lanedir_consec_max0.09807774570084817
driven_lanedir_consec_mean0.07932298033490275
driven_lanedir_consec_min0.044014170759389515
driven_lanedir_max0.09807774570084817
driven_lanedir_mean0.07932298033490275
driven_lanedir_median0.08258472576149511
driven_lanedir_min0.044014170759389515
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.2500000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2301571669272056, "sim_physics": 0.13015250257543615, "survival_time": 1.850000000000001, "driven_lanedir": 0.09807774570084817, "sim_render-ego": 0.04943788373792494, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.1306811667777397, "deviation-heading": 0.7216060600533464, "set_robot_commands": 0.07425433236199457, "deviation-center-line": 0.06470910686335131, "driven_lanedir_consec": 0.09807774570084817, "sim_compute_sim_state": 0.02904821086574245, "sim_compute_performance-ego": 0.05459990372528901, "sim_compute_robot_state-ego": 0.05548690460823678, "sim_compute_robot_state-npc0": 0.05245100485311972, "sim_compute_robot_state-npc1": 0.05248973176286027, "sim_compute_robot_state-npc2": 0.05118297886204075, "sim_compute_robot_state-npc3": 0.051107503272391656}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18572062038559808, "sim_physics": 0.10648352449590508, "survival_time": 1.6500000000000008, "driven_lanedir": 0.044014170759389515, "sim_render-ego": 0.04136149811022209, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.11944710124622691, "deviation-heading": 0.7950848129663886, "set_robot_commands": 0.059123537757179954, "deviation-center-line": 0.05370163102480888, "driven_lanedir_consec": 0.044014170759389515, "sim_compute_sim_state": 0.025744365923332447, "sim_compute_performance-ego": 0.04658019181453821, "sim_compute_robot_state-ego": 0.048639160214048446, "sim_compute_robot_state-npc0": 0.04619655464634751, "sim_compute_robot_state-npc1": 0.045867537007187355, "sim_compute_robot_state-npc2": 0.04551775527722908, "sim_compute_robot_state-npc3": 0.04468917124199145}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11225536755816816, "sim_physics": 0.12571154941212048, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07973049862663606, "sim_render-ego": 0.04815646735104648, "in-drivable-lane": 0, "agent_compute-ego": 0.1278234286741777, "deviation-heading": 0.5039361222611668, "set_robot_commands": 0.07082749496806752, "deviation-center-line": 0.09309050451942784, "driven_lanedir_consec": 0.07973049862663606, "sim_compute_sim_state": 0.028899853879755192, "sim_compute_performance-ego": 0.0515926642851396, "sim_compute_robot_state-ego": 0.0559422644701871, "sim_compute_robot_state-npc0": 0.05118878321214155, "sim_compute_robot_state-npc1": 0.05444982918826016, "sim_compute_robot_state-npc2": 0.05197585712779652, "sim_compute_robot_state-npc3": 0.052249366586858574}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.12556331079235947, "sim_physics": 0.13040946877521015, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0922077608261449, "sim_render-ego": 0.04080974537393321, "in-drivable-lane": 0, "agent_compute-ego": 0.12634633935016135, "deviation-heading": 0.5386559098650887, "set_robot_commands": 0.07606585129447606, "deviation-center-line": 0.09563817321808844, "driven_lanedir_consec": 0.0922077608261449, "sim_compute_sim_state": 0.0285042783488398, "sim_compute_performance-ego": 0.04476689255755881, "sim_compute_robot_state-ego": 0.048499864080677864, "sim_compute_robot_state-npc0": 0.05266180245772652, "sim_compute_robot_state-npc1": 0.04890688605930494, "sim_compute_robot_state-npc2": 0.051390554593956986, "sim_compute_robot_state-npc3": 0.05280517495196799}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1392677637202442, "sim_physics": 0.12326038877169292, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08258472576149511, "sim_render-ego": 0.04993957281112671, "in-drivable-lane": 0, "agent_compute-ego": 0.13219820459683737, "deviation-heading": 0.8598728343355607, "set_robot_commands": 0.06959737340609233, "deviation-center-line": 0.06205067533253946, "driven_lanedir_consec": 0.08258472576149511, "sim_compute_sim_state": 0.030709465344746903, "sim_compute_performance-ego": 0.055053512255350746, "sim_compute_robot_state-ego": 0.055200149615605675, "sim_compute_robot_state-npc0": 0.053974300622940063, "sim_compute_robot_state-npc1": 0.04883870482444763, "sim_compute_robot_state-npc2": 0.05278351902961731, "sim_compute_robot_state-npc3": 0.055048088232676186}}
set_robot_commands_max0.07606585129447606
set_robot_commands_mean0.06997371795756209
set_robot_commands_median0.07082749496806752
set_robot_commands_min0.059123537757179954
sim_compute_performance-ego_max0.055053512255350746
sim_compute_performance-ego_mean0.05051863292757527
sim_compute_performance-ego_median0.0515926642851396
sim_compute_performance-ego_min0.04476689255755881
sim_compute_robot_state-ego_max0.0559422644701871
sim_compute_robot_state-ego_mean0.05275366859775117
sim_compute_robot_state-ego_median0.055200149615605675
sim_compute_robot_state-ego_min0.048499864080677864
sim_compute_robot_state-npc0_max0.053974300622940063
sim_compute_robot_state-npc0_mean0.05129448915845507
sim_compute_robot_state-npc0_median0.05245100485311972
sim_compute_robot_state-npc0_min0.04619655464634751
sim_compute_robot_state-npc1_max0.05444982918826016
sim_compute_robot_state-npc1_mean0.05011053776841208
sim_compute_robot_state-npc1_median0.04890688605930494
sim_compute_robot_state-npc1_min0.045867537007187355
sim_compute_robot_state-npc2_max0.05278351902961731
sim_compute_robot_state-npc2_mean0.05057013297812813
sim_compute_robot_state-npc2_median0.051390554593956986
sim_compute_robot_state-npc2_min0.04551775527722908
sim_compute_robot_state-npc3_max0.055048088232676186
sim_compute_robot_state-npc3_mean0.05117986085717717
sim_compute_robot_state-npc3_median0.052249366586858574
sim_compute_robot_state-npc3_min0.04468917124199145
sim_compute_sim_state_max0.030709465344746903
sim_compute_sim_state_mean0.028581234872483357
sim_compute_sim_state_median0.028899853879755192
sim_compute_sim_state_min0.025744365923332447
sim_physics_max0.13040946877521015
sim_physics_mean0.12320348680607296
sim_physics_median0.12571154941212048
sim_physics_min0.10648352449590508
sim_render-ego_max0.04993957281112671
sim_render-ego_mean0.04594103347685069
sim_render-ego_median0.04815646735104648
sim_render-ego_min0.04080974537393321
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.3900000000000006
survival_time_min1.1000000000000003
241613951kene4192ResNet-Combined-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:14:00(hidden)
driven_lanedir_consec_median0.28060955217450045
survival_time_median5.799999999999987
deviation-center-line_median0.2104956156699747
in-drivable-lane_median2.7499999999999902


other stats
agent_compute-ego_max0.18340906603582977
agent_compute-ego_mean0.1758094011767257
agent_compute-ego_median0.17790821939706802
agent_compute-ego_min0.16034225261572635
deviation-center-line_max0.75548417971092
deviation-center-line_mean0.3289196853136922
deviation-center-line_min0.09908689143204732
deviation-heading_max1.5132624379137651
deviation-heading_mean1.168137102186191
deviation-heading_median1.3145146580698246
deviation-heading_min0.7172574151741051
driven_any_max1.661541838650526
driven_any_mean0.7661523652116193
driven_any_median0.6261051300120908
driven_any_min0.19654792412116248
driven_lanedir_consec_max0.7105357709254481
driven_lanedir_consec_mean0.39228597329948667
driven_lanedir_consec_min0.15395063280478627
driven_lanedir_max0.7105357709254481
driven_lanedir_mean0.39228597329948667
driven_lanedir_median0.28060955217450045
driven_lanedir_min0.15395063280478627
in-drivable-lane_max6.800000000000044
in-drivable-lane_mean2.6200000000000045
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0032717328069511, "sim_physics": 0.11496723905394347, "survival_time": 7.89999999999998, "driven_lanedir": 0.5373572615196172, "sim_render-ego": 0.045829246315775035, "in-drivable-lane": 3.399999999999988, "agent_compute-ego": 0.1775542784340774, "deviation-heading": 0.7172574151741051, "set_robot_commands": 0.06890408902228633, "deviation-center-line": 0.38929681629978546, "driven_lanedir_consec": 0.5373572615196172, "sim_compute_sim_state": 0.03336433971984477, "sim_compute_performance-ego": 0.04929684234570853, "sim_compute_robot_state-ego": 0.050899505615234375, "sim_compute_robot_state-npc0": 0.05296091791949695, "sim_compute_robot_state-npc1": 0.05176372920410543, "sim_compute_robot_state-npc2": 0.050961337512052514, "sim_compute_robot_state-npc3": 0.05247787282436709}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3432952004673659, "sim_physics": 0.1199398823082447, "survival_time": 3.1999999999999966, "driven_lanedir": 0.28060955217450045, "sim_render-ego": 0.04453368857502937, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.17790821939706802, "deviation-heading": 1.5132624379137651, "set_robot_commands": 0.06929562240839005, "deviation-center-line": 0.2104956156699747, "driven_lanedir_consec": 0.28060955217450045, "sim_compute_sim_state": 0.029513459652662277, "sim_compute_performance-ego": 0.05112124979496002, "sim_compute_robot_state-ego": 0.0528290681540966, "sim_compute_robot_state-npc0": 0.05271143093705177, "sim_compute_robot_state-npc1": 0.04999784007668495, "sim_compute_robot_state-npc2": 0.049344342201948166, "sim_compute_robot_state-npc3": 0.05057342350482941}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6261051300120908, "sim_physics": 0.1069599986076355, "survival_time": 5.799999999999987, "driven_lanedir": 0.2789766490730812, "sim_render-ego": 0.04560322186042522, "in-drivable-lane": 2.7499999999999902, "agent_compute-ego": 0.18340906603582977, "deviation-heading": 1.3145146580698246, "set_robot_commands": 0.07013061745413418, "deviation-center-line": 0.19023492345573367, "driven_lanedir_consec": 0.2789766490730812, "sim_compute_sim_state": 0.029291707893897748, "sim_compute_performance-ego": 0.05176744789912783, "sim_compute_robot_state-ego": 0.05125161491591355, "sim_compute_robot_state-npc0": 0.052991749911472714, "sim_compute_robot_state-npc1": 0.05186732267511302, "sim_compute_robot_state-npc2": 0.050503623896631704, "sim_compute_robot_state-npc3": 0.05097448414769666}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.661541838650526, "sim_physics": 0.11312152612163294, "survival_time": 12.950000000000047, "driven_lanedir": 0.7105357709254481, "sim_render-ego": 0.045411720239057506, "in-drivable-lane": 6.800000000000044, "agent_compute-ego": 0.179833189400927, "deviation-heading": 1.3901219388111603, "set_robot_commands": 0.06983397365997196, "deviation-center-line": 0.75548417971092, "driven_lanedir_consec": 0.7105357709254481, "sim_compute_sim_state": 0.02898637576453014, "sim_compute_performance-ego": 0.05044967879659881, "sim_compute_robot_state-ego": 0.054860334138612486, "sim_compute_robot_state-npc0": 0.05141776777142263, "sim_compute_robot_state-npc1": 0.05027904473676645, "sim_compute_robot_state-npc2": 0.05054121312027272, "sim_compute_robot_state-npc3": 0.05098091589437949}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19654792412116248, "sim_physics": 0.09732648820588084, "survival_time": 1.6500000000000008, "driven_lanedir": 0.15395063280478627, "sim_render-ego": 0.04032645803509337, "in-drivable-lane": 0, "agent_compute-ego": 0.16034225261572635, "deviation-heading": 0.9055290609620998, "set_robot_commands": 0.06128761985085227, "deviation-center-line": 0.09908689143204732, "driven_lanedir_consec": 0.15395063280478627, "sim_compute_sim_state": 0.023860469008937027, "sim_compute_performance-ego": 0.04363312143268007, "sim_compute_robot_state-ego": 0.0454793626611883, "sim_compute_robot_state-npc0": 0.0479610977750836, "sim_compute_robot_state-npc1": 0.04615597291426225, "sim_compute_robot_state-npc2": 0.04128356413407759, "sim_compute_robot_state-npc3": 0.042086254466663704}}
set_robot_commands_max0.07013061745413418
set_robot_commands_mean0.06789038447912696
set_robot_commands_median0.06929562240839005
set_robot_commands_min0.06128761985085227
sim_compute_performance-ego_max0.05176744789912783
sim_compute_performance-ego_mean0.04925366805381505
sim_compute_performance-ego_median0.05044967879659881
sim_compute_performance-ego_min0.04363312143268007
sim_compute_robot_state-ego_max0.054860334138612486
sim_compute_robot_state-ego_mean0.051063977097009064
sim_compute_robot_state-ego_median0.05125161491591355
sim_compute_robot_state-ego_min0.0454793626611883
sim_compute_robot_state-npc0_max0.052991749911472714
sim_compute_robot_state-npc0_mean0.051608592862905533
sim_compute_robot_state-npc0_median0.05271143093705177
sim_compute_robot_state-npc0_min0.0479610977750836
sim_compute_robot_state-npc1_max0.05186732267511302
sim_compute_robot_state-npc1_mean0.05001278192138642
sim_compute_robot_state-npc1_median0.05027904473676645
sim_compute_robot_state-npc1_min0.04615597291426225
sim_compute_robot_state-npc2_max0.050961337512052514
sim_compute_robot_state-npc2_mean0.048526816172996534
sim_compute_robot_state-npc2_median0.050503623896631704
sim_compute_robot_state-npc2_min0.04128356413407759
sim_compute_robot_state-npc3_max0.05247787282436709
sim_compute_robot_state-npc3_mean0.04941859016758726
sim_compute_robot_state-npc3_median0.05097448414769666
sim_compute_robot_state-npc3_min0.042086254466663704
sim_compute_sim_state_max0.03336433971984477
sim_compute_sim_state_mean0.02900327040797439
sim_compute_sim_state_median0.029291707893897748
sim_compute_sim_state_min0.023860469008937027
sim_physics_max0.1199398823082447
sim_physics_mean0.11046302685946748
sim_physics_median0.11312152612163294
sim_physics_min0.09732648820588084
sim_render-ego_max0.045829246315775035
sim_render-ego_mean0.0443408670050761
sim_render-ego_median0.045411720239057506
sim_render-ego_min0.04032645803509337
simulation-passed1
survival_time_max12.950000000000047
survival_time_mean6.3000000000000025
survival_time_min1.6500000000000008
241563946ekunniiBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:01:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241513941kene4192CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:04:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241493939kene4192CNN-Adam-More-Data-Less-One-400aido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:07:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241453933kene4192CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-testing-offseasonstep1-simulationerroryes12920:35:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241423934kene4192CNN-Adam-More-Data-Less-One-300aido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:04:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241403927gadeseaido_LF-tensorflow_modifaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:19:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241393926kene4192CNN-Adam-More-Data-Less-One-100aido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:13:55(hidden)
driven_lanedir_consec_median0.5823469785610742
survival_time_median7.099999999999983
deviation-center-line_median0.2462242769502076
in-drivable-lane_median2.9999999999999893


other stats
agent_compute-ego_max0.1172220143404874
agent_compute-ego_mean0.11677453970898943
agent_compute-ego_median0.1165895938873291
agent_compute-ego_min0.11642199436823528
deviation-center-line_max0.7234022578611767
deviation-center-line_mean0.3838123461238029
deviation-center-line_min0.09348761400350478
deviation-heading_max1.7368278966785715
deviation-heading_mean1.1697005877313944
deviation-heading_median0.9214712692643042
deviation-heading_min0.6853803059852271
driven_any_max2.3878033606962408
driven_any_mean1.2871329498128028
driven_any_median1.0966925948574613
driven_any_min0.19025671959919832
driven_lanedir_consec_max1.110391889411491
driven_lanedir_consec_mean0.6592420863834139
driven_lanedir_consec_min0.1455143349710638
driven_lanedir_max1.110391889411491
driven_lanedir_mean0.6592420863834139
driven_lanedir_median0.5823469785610742
driven_lanedir_min0.1455143349710638
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.6100000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0966925948574613, "sim_physics": 0.09128769686524298, "survival_time": 7.099999999999983, "driven_lanedir": 0.5823469785610742, "sim_render-ego": 0.035862125141519895, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.1170585961409018, "deviation-heading": 0.9214712692643042, "set_robot_commands": 0.05432745100746692, "deviation-center-line": 0.2462242769502076, "driven_lanedir_consec": 0.5823469785610742, "sim_compute_sim_state": 0.022632563617867484, "sim_compute_performance-ego": 0.0384472776466692, "sim_compute_robot_state-ego": 0.04051704641798852, "sim_compute_robot_state-npc0": 0.039982127471708914, "sim_compute_robot_state-npc1": 0.03936095976493728, "sim_compute_robot_state-npc2": 0.03920985443491331, "sim_compute_robot_state-npc3": 0.03929865528160418}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.3696968276848964, "sim_physics": 0.09505954504013062, "survival_time": 14.950000000000076, "driven_lanedir": 1.110391889411491, "sim_render-ego": 0.03653227170308431, "in-drivable-lane": 7.450000000000038, "agent_compute-ego": 0.11658049980799357, "deviation-heading": 1.7368278966785715, "set_robot_commands": 0.05369458675384522, "deviation-center-line": 0.663451838798104, "driven_lanedir_consec": 1.110391889411491, "sim_compute_sim_state": 0.022725499471028646, "sim_compute_performance-ego": 0.03854618310928345, "sim_compute_robot_state-ego": 0.04049475987752279, "sim_compute_robot_state-npc0": 0.04015259901682536, "sim_compute_robot_state-npc1": 0.03975240707397461, "sim_compute_robot_state-npc2": 0.039515305360158286, "sim_compute_robot_state-npc3": 0.03948990027109782}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.3878033606962408, "sim_physics": 0.08854622681935628, "survival_time": 14.950000000000076, "driven_lanedir": 1.0936644498344046, "sim_render-ego": 0.03588967323303223, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.11642199436823528, "deviation-heading": 1.643366469437867, "set_robot_commands": 0.054195801417032875, "deviation-center-line": 0.7234022578611767, "driven_lanedir_consec": 1.0936644498344046, "sim_compute_sim_state": 0.022788169384002684, "sim_compute_performance-ego": 0.03857185443242391, "sim_compute_robot_state-ego": 0.04052853107452393, "sim_compute_robot_state-npc0": 0.040067747433980304, "sim_compute_robot_state-npc1": 0.03946624914805094, "sim_compute_robot_state-npc2": 0.039429489771525064, "sim_compute_robot_state-npc3": 0.04087004979451497}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.3912152462262175, "sim_physics": 0.10090804533524948, "survival_time": 2.7499999999999982, "driven_lanedir": 0.3642927791390358, "sim_render-ego": 0.036938775669444694, "in-drivable-lane": 0, "agent_compute-ego": 0.1172220143404874, "deviation-heading": 0.6853803059852271, "set_robot_commands": 0.05369790250604803, "deviation-center-line": 0.19249574300602157, "driven_lanedir_consec": 0.3642927791390358, "sim_compute_sim_state": 0.022864172675392844, "sim_compute_performance-ego": 0.038607853109186345, "sim_compute_robot_state-ego": 0.04052263606678356, "sim_compute_robot_state-npc0": 0.04011996442621405, "sim_compute_robot_state-npc1": 0.03957732374017889, "sim_compute_robot_state-npc2": 0.039454165371981535, "sim_compute_robot_state-npc3": 0.03950595422224565}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.19025671959919832, "sim_physics": 0.08873693943023682, "survival_time": 1.5000000000000009, "driven_lanedir": 0.1455143349710638, "sim_render-ego": 0.03563062349955241, "in-drivable-lane": 0, "agent_compute-ego": 0.1165895938873291, "deviation-heading": 0.8614569972910021, "set_robot_commands": 0.05425286293029785, "deviation-center-line": 0.09348761400350478, "driven_lanedir_consec": 0.1455143349710638, "sim_compute_sim_state": 0.022525922457377116, "sim_compute_performance-ego": 0.038512984911600746, "sim_compute_robot_state-ego": 0.04039136568705241, "sim_compute_robot_state-npc0": 0.04003702799479167, "sim_compute_robot_state-npc1": 0.0392817497253418, "sim_compute_robot_state-npc2": 0.03912380536397298, "sim_compute_robot_state-npc3": 0.038997284571329754}}
set_robot_commands_max0.05432745100746692
set_robot_commands_mean0.05403372092293818
set_robot_commands_median0.054195801417032875
set_robot_commands_min0.05369458675384522
sim_compute_performance-ego_max0.038607853109186345
sim_compute_performance-ego_mean0.03853723064183273
sim_compute_performance-ego_median0.03854618310928345
sim_compute_performance-ego_min0.0384472776466692
sim_compute_robot_state-ego_max0.04052853107452393
sim_compute_robot_state-ego_mean0.040490867824774235
sim_compute_robot_state-ego_median0.04051704641798852
sim_compute_robot_state-ego_min0.04039136568705241
sim_compute_robot_state-npc0_max0.04015259901682536
sim_compute_robot_state-npc0_mean0.040071893268704056
sim_compute_robot_state-npc0_median0.040067747433980304
sim_compute_robot_state-npc0_min0.039982127471708914
sim_compute_robot_state-npc1_max0.03975240707397461
sim_compute_robot_state-npc1_mean0.039487737890496706
sim_compute_robot_state-npc1_median0.03946624914805094
sim_compute_robot_state-npc1_min0.0392817497253418
sim_compute_robot_state-npc2_max0.039515305360158286
sim_compute_robot_state-npc2_mean0.03934652406051024
sim_compute_robot_state-npc2_median0.039429489771525064
sim_compute_robot_state-npc2_min0.03912380536397298
sim_compute_robot_state-npc3_max0.04087004979451497
sim_compute_robot_state-npc3_mean0.039632368828158474
sim_compute_robot_state-npc3_median0.03948990027109782
sim_compute_robot_state-npc3_min0.038997284571329754
sim_compute_sim_state_max0.022864172675392844
sim_compute_sim_state_mean0.022707265521133755
sim_compute_sim_state_median0.022725499471028646
sim_compute_sim_state_min0.022525922457377116
sim_physics_max0.10090804533524948
sim_physics_mean0.09290769069804322
sim_physics_median0.09128769686524298
sim_physics_min0.08854622681935628
sim_render-ego_max0.036938775669444694
sim_render-ego_mean0.03617069384932671
sim_render-ego_median0.03588967323303223
sim_render-ego_min0.03563062349955241
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.250000000000028
survival_time_min1.5000000000000009
241373918ekunniiBaseline solution using reinforcement learningaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:00:38
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241343924ekunniiBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12920:02:34
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241263912gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:03:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241223911chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:04:53(hidden)
driven_lanedir_consec_median0.8738231708415505
survival_time_median3.099999999999997
deviation-center-line_median0.1847162605179493
in-drivable-lane_median0.8999999999999968


other stats
agent_compute-ego_max0.09753886345894106
agent_compute-ego_mean0.09634420655608632
agent_compute-ego_median0.09664022922515868
agent_compute-ego_min0.09454602124739668
deviation-center-line_max0.5921431212461046
deviation-center-line_mean0.2575017218594127
deviation-center-line_min0.1051202872202727
deviation-heading_max1.8520704133301364
deviation-heading_mean0.7655696111328215
deviation-heading_median0.6174853774728838
deviation-heading_min0.2826315501819024
driven_any_max3.064981160840033
driven_any_mean1.649108502300494
driven_any_median1.2797328979906255
driven_any_min1.0121624679769583
driven_lanedir_consec_max2.1770904199396357
driven_lanedir_consec_mean1.1034292597580089
driven_lanedir_consec_min0.4056124083139392
driven_lanedir_max2.1770904199396357
driven_lanedir_mean1.1036387883150651
driven_lanedir_median0.8738231708415505
driven_lanedir_min0.4056124083139392
in-drivable-lane_max1.999999999999993
in-drivable-lane_mean1.1099999999999968
in-drivable-lane_min0.14999999999999947
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0121624679769583, "sim_physics": 0.05659782652761422, "survival_time": 2.549999999999999, "driven_lanedir": 0.6697678922681867, "sim_render-ego": 0.03667261553745644, "in-drivable-lane": 0.6999999999999982, "agent_compute-ego": 0.09684026942533604, "deviation-heading": 0.41852124132079976, "set_robot_commands": 0.054810411789838, "deviation-center-line": 0.1051202872202727, "driven_lanedir_consec": 0.6687202494829045, "sim_compute_sim_state": 0.023063014535342947, "sim_compute_performance-ego": 0.04050919121386958, "sim_compute_robot_state-ego": 0.04081484850715189}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.015724397125961, "sim_physics": 0.054215241451652685, "survival_time": 2.4499999999999993, "driven_lanedir": 0.8738231708415505, "sim_render-ego": 0.03573679437442702, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.09454602124739668, "deviation-heading": 0.6571394733583847, "set_robot_commands": 0.05420502837823362, "deviation-center-line": 0.1847162605179493, "driven_lanedir_consec": 0.8738231708415505, "sim_compute_sim_state": 0.023228771832524513, "sim_compute_performance-ego": 0.03901850447362783, "sim_compute_robot_state-ego": 0.04020327937846281}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.064981160840033, "sim_physics": 0.05775255113840103, "survival_time": 7.99999999999998, "driven_lanedir": 2.1770904199396357, "sim_render-ego": 0.03729516863822937, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.09615564942359923, "deviation-heading": 1.8520704133301364, "set_robot_commands": 0.0555449515581131, "deviation-center-line": 0.5921431212461046, "driven_lanedir_consec": 2.1770904199396357, "sim_compute_sim_state": 0.02343703061342239, "sim_compute_performance-ego": 0.03904695957899094, "sim_compute_robot_state-ego": 0.04085390865802765}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2797328979906255, "sim_physics": 0.058775190384157246, "survival_time": 3.099999999999997, "driven_lanedir": 0.4056124083139392, "sim_render-ego": 0.036311757179998586, "in-drivable-lane": 1.7999999999999965, "agent_compute-ego": 0.09753886345894106, "deviation-heading": 0.2826315501819024, "set_robot_commands": 0.05474475506813296, "deviation-center-line": 0.1185731000208567, "driven_lanedir_consec": 0.4056124083139392, "sim_compute_sim_state": 0.023574433019084316, "sim_compute_performance-ego": 0.039578591623613914, "sim_compute_robot_state-ego": 0.04090753678352602}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.872941587568892, "sim_physics": 0.05462557619268244, "survival_time": 4.399999999999992, "driven_lanedir": 1.3919000502120136, "sim_render-ego": 0.0359617065299641, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.09664022922515868, "deviation-heading": 0.6174853774728838, "set_robot_commands": 0.054906454953280365, "deviation-center-line": 0.2869558402918804, "driven_lanedir_consec": 1.3919000502120136, "sim_compute_sim_state": 0.023744371804324062, "sim_compute_performance-ego": 0.039045450362292206, "sim_compute_robot_state-ego": 0.040892313827167855}}
set_robot_commands_max0.0555449515581131
set_robot_commands_mean0.054842320349519615
set_robot_commands_median0.054810411789838
set_robot_commands_min0.05420502837823362
sim_compute_performance-ego_max0.04050919121386958
sim_compute_performance-ego_mean0.03943973945047889
sim_compute_performance-ego_median0.03904695957899094
sim_compute_performance-ego_min0.03901850447362783
sim_compute_robot_state-ego_max0.04090753678352602
sim_compute_robot_state-ego_mean0.04073437743086724
sim_compute_robot_state-ego_median0.04085390865802765
sim_compute_robot_state-ego_min0.04020327937846281
sim_compute_sim_state_max0.023744371804324062
sim_compute_sim_state_mean0.023409524360939647
sim_compute_sim_state_median0.02343703061342239
sim_compute_sim_state_min0.023063014535342947
sim_physics_max0.058775190384157246
sim_physics_mean0.05639327713890152
sim_physics_median0.05659782652761422
sim_physics_min0.054215241451652685
sim_render-ego_max0.03729516863822937
sim_render-ego_mean0.0363956084520151
sim_render-ego_median0.036311757179998586
sim_render-ego_min0.03573679437442702
simulation-passed1
survival_time_max7.99999999999998
survival_time_mean4.099999999999993
survival_time_min2.4499999999999993
241213910chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:02:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
241203909Inderpalchallenge-aido_LF-template-pytorchaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:08:24(hidden)
driven_lanedir_consec_median0.05993730129531016
survival_time_median1.5000000000000009
deviation-center-line_median0.09124544136904356
in-drivable-lane_median0.4000000000000003


other stats
agent_compute-ego_max0.10344248016675311
agent_compute-ego_mean0.09801451938031916
agent_compute-ego_median0.09650859038035074
agent_compute-ego_min0.09597037347514978
deviation-center-line_max0.48002780354973745
deviation-center-line_mean0.15731180228851607
deviation-center-line_min0.03334001494833579
deviation-heading_max6.083839113260557
deviation-heading_mean2.0103512124819156
deviation-heading_median0.7763961697467976
deviation-heading_min0.6218288529291067
driven_any_max1.60250245026633
driven_any_mean0.4919191722727621
driven_any_median0.14826824466145777
driven_any_min0.10356461439159542
driven_lanedir_consec_max0.5605743419139819
driven_lanedir_consec_mean0.17613814858272692
driven_lanedir_consec_min0.04567833602559679
driven_lanedir_max0.5605743419139819
driven_lanedir_mean0.17613814858272692
driven_lanedir_median0.05993730129531016
driven_lanedir_min0.04567833602559679
in-drivable-lane_max6.850000000000027
in-drivable-lane_mean1.930000000000005
in-drivable-lane_min0.05000000000000005
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.60250245026633, "sim_physics": 0.09540316343307496, "survival_time": 14.950000000000076, "driven_lanedir": 0.5605743419139819, "sim_render-ego": 0.03696027596791585, "in-drivable-lane": 6.850000000000027, "agent_compute-ego": 0.09790218909581502, "deviation-heading": 6.083839113260557, "set_robot_commands": 0.05638434966405233, "deviation-center-line": 0.48002780354973745, "driven_lanedir_consec": 0.5605743419139819, "sim_compute_sim_state": 0.023322717348734538, "sim_compute_performance-ego": 0.03959758122762044, "sim_compute_robot_state-ego": 0.041045053005218504, "sim_compute_robot_state-npc0": 0.040843264261881514, "sim_compute_robot_state-npc1": 0.040427969296773274, "sim_compute_robot_state-npc2": 0.04041035811106364, "sim_compute_robot_state-npc3": 0.04037842988967896}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4898976687431165, "sim_physics": 0.09177291259337007, "survival_time": 4.449999999999992, "driven_lanedir": 0.16675055322956167, "sim_render-ego": 0.03609767120875669, "in-drivable-lane": 1.949999999999997, "agent_compute-ego": 0.09597037347514978, "deviation-heading": 1.9183914169387688, "set_robot_commands": 0.0552641541770335, "deviation-center-line": 0.09124544136904356, "driven_lanedir_consec": 0.16675055322956167, "sim_compute_sim_state": 0.023305619700571125, "sim_compute_performance-ego": 0.03954453414745545, "sim_compute_robot_state-ego": 0.04098522797059477, "sim_compute_robot_state-npc0": 0.04092117641749007, "sim_compute_robot_state-npc1": 0.04040898365920849, "sim_compute_robot_state-npc2": 0.04021664951624495, "sim_compute_robot_state-npc3": 0.040541038084565925}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.11536288330131056, "sim_physics": 0.10237376689910888, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04775021044918404, "sim_render-ego": 0.03636945883433024, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09650859038035074, "deviation-heading": 0.6218288529291067, "set_robot_commands": 0.05502699216206868, "deviation-center-line": 0.08991747854111154, "driven_lanedir_consec": 0.04775021044918404, "sim_compute_sim_state": 0.023089011510213215, "sim_compute_performance-ego": 0.039226682980855306, "sim_compute_robot_state-ego": 0.04264354705810547, "sim_compute_robot_state-npc0": 0.0404877503712972, "sim_compute_robot_state-npc1": 0.03991045157114665, "sim_compute_robot_state-npc2": 0.04007203578948974, "sim_compute_robot_state-npc3": 0.04022255738576253}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.10356461439159542, "sim_physics": 0.10517905155817668, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05993730129531016, "sim_render-ego": 0.03669308622678121, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.10344248016675311, "deviation-heading": 0.6513005095343489, "set_robot_commands": 0.056304325660069786, "deviation-center-line": 0.0920282730343519, "driven_lanedir_consec": 0.05993730129531016, "sim_compute_sim_state": 0.02327723304430644, "sim_compute_performance-ego": 0.03972575068473816, "sim_compute_robot_state-ego": 0.04099212090174357, "sim_compute_robot_state-npc0": 0.04057340820630392, "sim_compute_robot_state-npc1": 0.04024451971054077, "sim_compute_robot_state-npc2": 0.040054251750310264, "sim_compute_robot_state-npc3": 0.04029778639475504}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14826824466145777, "sim_physics": 0.09026474788271148, "survival_time": 1.4500000000000006, "driven_lanedir": 0.04567833602559679, "sim_render-ego": 0.03643679618835449, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.09624896378352724, "deviation-heading": 0.7763961697467976, "set_robot_commands": 0.054992256493403995, "deviation-center-line": 0.03334001494833579, "driven_lanedir_consec": 0.04567833602559679, "sim_compute_sim_state": 0.0234865402353221, "sim_compute_performance-ego": 0.03930405912728145, "sim_compute_robot_state-ego": 0.04110744903827536, "sim_compute_robot_state-npc0": 0.040615311984358166, "sim_compute_robot_state-npc1": 0.04017978701098212, "sim_compute_robot_state-npc2": 0.03986473741202519, "sim_compute_robot_state-npc3": 0.04044685692622744}}
set_robot_commands_max0.05638434966405233
set_robot_commands_mean0.05559441563132565
set_robot_commands_median0.0552641541770335
set_robot_commands_min0.054992256493403995
sim_compute_performance-ego_max0.03972575068473816
sim_compute_performance-ego_mean0.03947972163359016
sim_compute_performance-ego_median0.03954453414745545
sim_compute_performance-ego_min0.039226682980855306
sim_compute_robot_state-ego_max0.04264354705810547
sim_compute_robot_state-ego_mean0.04135467959478754
sim_compute_robot_state-ego_median0.041045053005218504
sim_compute_robot_state-ego_min0.04098522797059477
sim_compute_robot_state-npc0_max0.04092117641749007
sim_compute_robot_state-npc0_mean0.040688182248266175
sim_compute_robot_state-npc0_median0.040615311984358166
sim_compute_robot_state-npc0_min0.0404877503712972
sim_compute_robot_state-npc1_max0.040427969296773274
sim_compute_robot_state-npc1_mean0.04023434224973026
sim_compute_robot_state-npc1_median0.04024451971054077
sim_compute_robot_state-npc1_min0.03991045157114665
sim_compute_robot_state-npc2_max0.04041035811106364
sim_compute_robot_state-npc2_mean0.04012360651582676
sim_compute_robot_state-npc2_median0.04007203578948974
sim_compute_robot_state-npc2_min0.03986473741202519
sim_compute_robot_state-npc3_max0.040541038084565925
sim_compute_robot_state-npc3_mean0.04037733373619797
sim_compute_robot_state-npc3_median0.04037842988967896
sim_compute_robot_state-npc3_min0.04022255738576253
sim_compute_sim_state_max0.0234865402353221
sim_compute_sim_state_mean0.023296224367829483
sim_compute_sim_state_median0.023305619700571125
sim_compute_sim_state_min0.023089011510213215
sim_physics_max0.10517905155817668
sim_physics_mean0.0969987284732884
sim_physics_median0.09540316343307496
sim_physics_min0.09026474788271148
sim_render-ego_max0.03696027596791585
sim_render-ego_mean0.0365114576852277
sim_render-ego_median0.03643679618835449
sim_render-ego_min0.03609767120875669
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean4.710000000000013
survival_time_min1.2000000000000004
241193908kene4192CNN-Adam-More-Dataaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:14:18(hidden)
driven_lanedir_consec_median0.8936428657453378
survival_time_median8.09999999999998
deviation-center-line_median0.6533737097593046
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12001619467864164
agent_compute-ego_mean0.11834180474020237
agent_compute-ego_median0.11866332054138184
agent_compute-ego_min0.1160298390821977
deviation-center-line_max0.7065503092229627
deviation-center-line_mean0.4680173452714424
deviation-center-line_min0.1141606231065044
deviation-heading_max2.7568685844528136
deviation-heading_mean1.9286619884845393
deviation-heading_median1.940865311703626
deviation-heading_min0.9307058364726996
driven_any_max1.6124532443383175
driven_any_mean0.9429580794158662
driven_any_median0.9624279028242054
driven_any_min0.2108938186902563
driven_lanedir_consec_max1.5662383687505643
driven_lanedir_consec_mean0.8915256997446666
driven_lanedir_consec_min0.16843961896752346
driven_lanedir_max1.5662383687505643
driven_lanedir_mean0.8915256997446666
driven_lanedir_median0.8936428657453378
driven_lanedir_min0.16843961896752346
in-drivable-lane_max0.05000000000000071
in-drivable-lane_mean0.02000000000000015
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9624279028242054, "sim_physics": 0.09399969342314168, "survival_time": 8.09999999999998, "driven_lanedir": 0.8936428657453378, "sim_render-ego": 0.03701057257475676, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.11911249749454451, "deviation-heading": 1.940865311703626, "set_robot_commands": 0.06223123014709096, "deviation-center-line": 0.6533737097593046, "driven_lanedir_consec": 0.8936428657453378, "sim_compute_sim_state": 0.02318217724929621, "sim_compute_performance-ego": 0.039521508746676974, "sim_compute_robot_state-ego": 0.04120851151737166, "sim_compute_robot_state-npc0": 0.040861175384050534, "sim_compute_robot_state-npc1": 0.04031964143117269, "sim_compute_robot_state-npc2": 0.04014536333672794, "sim_compute_robot_state-npc3": 0.04034876381909406}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.31663853937234065, "sim_physics": 0.08897447152571245, "survival_time": 2.7499999999999982, "driven_lanedir": 0.26572808895546274, "sim_render-ego": 0.0357942667874423, "in-drivable-lane": 0, "agent_compute-ego": 0.1160298390821977, "deviation-heading": 1.4196186008322311, "set_robot_commands": 0.05467003475536, "deviation-center-line": 0.18844304457520145, "driven_lanedir_consec": 0.26572808895546274, "sim_compute_sim_state": 0.026607335697520863, "sim_compute_performance-ego": 0.03847584290937944, "sim_compute_robot_state-ego": 0.04049020247025923, "sim_compute_robot_state-npc0": 0.04006812355735085, "sim_compute_robot_state-npc1": 0.039248293096368965, "sim_compute_robot_state-npc2": 0.03922657533125444, "sim_compute_robot_state-npc3": 0.03938872597434304}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6123768918542107, "sim_physics": 0.08817929585774739, "survival_time": 14.950000000000076, "driven_lanedir": 1.563579556304444, "sim_render-ego": 0.036444456577301027, "in-drivable-lane": 0, "agent_compute-ego": 0.11866332054138184, "deviation-heading": 2.7568685844528136, "set_robot_commands": 0.05573586861292521, "deviation-center-line": 0.7065503092229627, "driven_lanedir_consec": 1.563579556304444, "sim_compute_sim_state": 0.02311342716217041, "sim_compute_performance-ego": 0.03933230320612589, "sim_compute_robot_state-ego": 0.041027147769927975, "sim_compute_robot_state-npc0": 0.04095956087112427, "sim_compute_robot_state-npc1": 0.04023998022079467, "sim_compute_robot_state-npc2": 0.040168048540751136, "sim_compute_robot_state-npc3": 0.040396267573038734}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6124532443383175, "sim_physics": 0.08901315689086914, "survival_time": 14.950000000000076, "driven_lanedir": 1.5662383687505643, "sim_render-ego": 0.036423585414886474, "in-drivable-lane": 0, "agent_compute-ego": 0.117887171904246, "deviation-heading": 2.595251608961326, "set_robot_commands": 0.05462333997090658, "deviation-center-line": 0.677559039693239, "driven_lanedir_consec": 1.5662383687505643, "sim_compute_sim_state": 0.0230680513381958, "sim_compute_performance-ego": 0.03966015338897705, "sim_compute_robot_state-ego": 0.04091893037160237, "sim_compute_robot_state-npc0": 0.04076119184494018, "sim_compute_robot_state-npc1": 0.0402402933438619, "sim_compute_robot_state-npc2": 0.039996399879455566, "sim_compute_robot_state-npc3": 0.04021590868631999}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2108938186902563, "sim_physics": 0.088890739389368, "survival_time": 1.850000000000001, "driven_lanedir": 0.16843961896752346, "sim_render-ego": 0.03676014977532464, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.12001619467864164, "deviation-heading": 0.9307058364726996, "set_robot_commands": 0.05456769144212877, "deviation-center-line": 0.1141606231065044, "driven_lanedir_consec": 0.16843961896752346, "sim_compute_sim_state": 0.023426629401542044, "sim_compute_performance-ego": 0.039576569119015255, "sim_compute_robot_state-ego": 0.04092759055060309, "sim_compute_robot_state-npc0": 0.04091717101432182, "sim_compute_robot_state-npc1": 0.04057875839439598, "sim_compute_robot_state-npc2": 0.040360180107322896, "sim_compute_robot_state-npc3": 0.04041783874099319}}
set_robot_commands_max0.06223123014709096
set_robot_commands_mean0.0563656329856823
set_robot_commands_median0.05467003475536
set_robot_commands_min0.05456769144212877
sim_compute_performance-ego_max0.03966015338897705
sim_compute_performance-ego_mean0.03931327547403492
sim_compute_performance-ego_median0.039521508746676974
sim_compute_performance-ego_min0.03847584290937944
sim_compute_robot_state-ego_max0.04120851151737166
sim_compute_robot_state-ego_mean0.04091447653595287
sim_compute_robot_state-ego_median0.04092759055060309
sim_compute_robot_state-ego_min0.04049020247025923
sim_compute_robot_state-npc0_max0.04095956087112427
sim_compute_robot_state-npc0_mean0.04071344453435753
sim_compute_robot_state-npc0_median0.040861175384050534
sim_compute_robot_state-npc0_min0.04006812355735085
sim_compute_robot_state-npc1_max0.04057875839439598
sim_compute_robot_state-npc1_mean0.04012539329731884
sim_compute_robot_state-npc1_median0.0402402933438619
sim_compute_robot_state-npc1_min0.039248293096368965
sim_compute_robot_state-npc2_max0.040360180107322896
sim_compute_robot_state-npc2_mean0.0399793134391024
sim_compute_robot_state-npc2_median0.04014536333672794
sim_compute_robot_state-npc2_min0.03922657533125444
sim_compute_robot_state-npc3_max0.04041783874099319
sim_compute_robot_state-npc3_mean0.04015350095875781
sim_compute_robot_state-npc3_median0.04034876381909406
sim_compute_robot_state-npc3_min0.03938872597434304
sim_compute_sim_state_max0.026607335697520863
sim_compute_sim_state_mean0.023879524169745064
sim_compute_sim_state_median0.02318217724929621
sim_compute_sim_state_min0.0230680513381958
sim_physics_max0.09399969342314168
sim_physics_mean0.08981147141736774
sim_physics_median0.08897447152571245
sim_physics_min0.08817929585774739
sim_render-ego_max0.03701057257475676
sim_render-ego_mean0.03648660622594224
sim_render-ego_median0.036444456577301027
sim_render-ego_min0.0357942667874423
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.520000000000026
survival_time_min1.850000000000001
241043900gadesechallenge-aido_LF-template-tensorflowaido2-LF-sim-testing-offseasonstep1-simulationerroryes12920:01:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241013906gadesechallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12920:03:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
241003898gadesePredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:28(hidden)
error_L10.11351778082302792
error_L20.01956142903332538


240993897kene4192ResNet-Adam-More-Data_Falseaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:09:58(hidden)
driven_lanedir_consec_median0.4438999586060821
survival_time_median5.14999999999999
deviation-center-line_median0.20275788369254177
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.14836933091282845
agent_compute-ego_mean0.13286050123339313
agent_compute-ego_median0.12917438316345214
agent_compute-ego_min0.12822555851291967
deviation-center-line_max0.2943546077145885
deviation-center-line_mean0.20839014196495764
deviation-center-line_min0.10366535944645584
deviation-heading_max2.5349941502063107
deviation-heading_mean1.3727143927298473
deviation-heading_median1.096166276274921
deviation-heading_min0.8056422156561436
driven_any_max1.1040790456463907
driven_any_mean0.7119005882503009
driven_any_median0.7818440434074347
driven_any_min0.24686111395257837
driven_lanedir_consec_max0.9152421510629468
driven_lanedir_consec_mean0.5442981068539632
driven_lanedir_consec_min0.2103504262366628
driven_lanedir_max0.9152421510629468
driven_lanedir_mean0.5442981068539632
driven_lanedir_median0.4438999586060821
driven_lanedir_min0.2103504262366628
in-drivable-lane_max3.049999999999989
in-drivable-lane_mean0.6499999999999977
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.46260415693224394, "sim_physics": 0.0969257727265358, "survival_time": 3.1999999999999966, "driven_lanedir": 0.41356332966372866, "sim_render-ego": 0.03636891394853592, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.14836933091282845, "deviation-heading": 1.0380189428218096, "set_robot_commands": 0.054949987679719925, "deviation-center-line": 0.20275788369254177, "driven_lanedir_consec": 0.41356332966372866, "sim_compute_sim_state": 0.02282505109906197, "sim_compute_performance-ego": 0.039131343364715576, "sim_compute_robot_state-ego": 0.041041433811187744, "sim_compute_robot_state-npc0": 0.040525369346141815, "sim_compute_robot_state-npc1": 0.04081733897328377, "sim_compute_robot_state-npc2": 0.03971102461218834, "sim_compute_robot_state-npc3": 0.03973708674311638}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9641145813128564, "sim_physics": 0.09606391906738282, "survival_time": 6.249999999999986, "driven_lanedir": 0.9152421510629468, "sim_render-ego": 0.035696306228637696, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12917438316345214, "deviation-heading": 1.388750378690051, "set_robot_commands": 0.05428948402404785, "deviation-center-line": 0.24684117904697375, "driven_lanedir_consec": 0.9152421510629468, "sim_compute_sim_state": 0.02280546760559082, "sim_compute_performance-ego": 0.03912789726257324, "sim_compute_robot_state-ego": 0.042385921478271485, "sim_compute_robot_state-npc0": 0.040370975494384766, "sim_compute_robot_state-npc1": 0.04011882781982422, "sim_compute_robot_state-npc2": 0.03961717414855957, "sim_compute_robot_state-npc3": 0.039715017318725586}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7818440434074347, "sim_physics": 0.09143761060770277, "survival_time": 5.14999999999999, "driven_lanedir": 0.7384346687003958, "sim_render-ego": 0.0360762100775265, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.12871205228046306, "deviation-heading": 1.096166276274921, "set_robot_commands": 0.05479214955302118, "deviation-center-line": 0.1943316799242284, "driven_lanedir_consec": 0.7384346687003958, "sim_compute_sim_state": 0.023121961112161284, "sim_compute_performance-ego": 0.0385117345643275, "sim_compute_robot_state-ego": 0.04088048333103217, "sim_compute_robot_state-npc0": 0.040387500837011245, "sim_compute_robot_state-npc1": 0.03981629621635363, "sim_compute_robot_state-npc2": 0.039463096451990816, "sim_compute_robot_state-npc3": 0.03955288998131613}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.1040790456463907, "sim_physics": 0.08822766659964978, "survival_time": 7.099999999999983, "driven_lanedir": 0.4438999586060821, "sim_render-ego": 0.03598020614033014, "in-drivable-lane": 3.049999999999989, "agent_compute-ego": 0.12982118129730225, "deviation-heading": 2.5349941502063107, "set_robot_commands": 0.05432315779403901, "deviation-center-line": 0.2943546077145885, "driven_lanedir_consec": 0.4438999586060821, "sim_compute_sim_state": 0.02260211655791377, "sim_compute_performance-ego": 0.038629149047421735, "sim_compute_robot_state-ego": 0.04075506203611133, "sim_compute_robot_state-npc0": 0.04023938279756358, "sim_compute_robot_state-npc1": 0.03957523090738646, "sim_compute_robot_state-npc2": 0.03931487278199531, "sim_compute_robot_state-npc3": 0.03946158919535892}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.24686111395257837, "sim_physics": 0.08660764307589144, "survival_time": 1.850000000000001, "driven_lanedir": 0.2103504262366628, "sim_render-ego": 0.03592326834395125, "in-drivable-lane": 0, "agent_compute-ego": 0.12822555851291967, "deviation-heading": 0.8056422156561436, "set_robot_commands": 0.053970556001405455, "deviation-center-line": 0.10366535944645584, "driven_lanedir_consec": 0.2103504262366628, "sim_compute_sim_state": 0.022591507112657703, "sim_compute_performance-ego": 0.03849753817996463, "sim_compute_robot_state-ego": 0.04063263454952755, "sim_compute_robot_state-npc0": 0.04006495346894135, "sim_compute_robot_state-npc1": 0.03942837586274018, "sim_compute_robot_state-npc2": 0.03932547569274902, "sim_compute_robot_state-npc3": 0.03921272947981551}}
set_robot_commands_max0.054949987679719925
set_robot_commands_mean0.05446506701044668
set_robot_commands_median0.05432315779403901
set_robot_commands_min0.053970556001405455
sim_compute_performance-ego_max0.039131343364715576
sim_compute_performance-ego_mean0.03877953248380053
sim_compute_performance-ego_median0.038629149047421735
sim_compute_performance-ego_min0.03849753817996463
sim_compute_robot_state-ego_max0.042385921478271485
sim_compute_robot_state-ego_mean0.04113910704122606
sim_compute_robot_state-ego_median0.04088048333103217
sim_compute_robot_state-ego_min0.04063263454952755
sim_compute_robot_state-npc0_max0.040525369346141815
sim_compute_robot_state-npc0_mean0.040317636388808545
sim_compute_robot_state-npc0_median0.040370975494384766
sim_compute_robot_state-npc0_min0.04006495346894135
sim_compute_robot_state-npc1_max0.04081733897328377
sim_compute_robot_state-npc1_mean0.03995121395591765
sim_compute_robot_state-npc1_median0.03981629621635363
sim_compute_robot_state-npc1_min0.03942837586274018
sim_compute_robot_state-npc2_max0.03971102461218834
sim_compute_robot_state-npc2_mean0.039486328737496613
sim_compute_robot_state-npc2_median0.039463096451990816
sim_compute_robot_state-npc2_min0.03931487278199531
sim_compute_robot_state-npc3_max0.03973708674311638
sim_compute_robot_state-npc3_mean0.03953586254366651
sim_compute_robot_state-npc3_median0.03955288998131613
sim_compute_robot_state-npc3_min0.03921272947981551
sim_compute_sim_state_max0.023121961112161284
sim_compute_sim_state_mean0.022789220697477103
sim_compute_sim_state_median0.02280546760559082
sim_compute_sim_state_min0.022591507112657703
sim_physics_max0.0969257727265358
sim_physics_mean0.09185252241543251
sim_physics_median0.09143761060770277
sim_physics_min0.08660764307589144
sim_render-ego_max0.03636891394853592
sim_render-ego_mean0.036008980947796296
sim_render-ego_median0.03598020614033014
sim_render-ego_min0.035696306228637696
simulation-passed1
survival_time_max7.099999999999983
survival_time_mean4.709999999999991
survival_time_min1.850000000000001
240983896kene4192ResNet-Adam-More-Data_Trueaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:10:17(hidden)
driven_lanedir_consec_median0.38181189179976505
survival_time_median2.9499999999999975
deviation-center-line_median0.17417353922182804
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.14555698330119504
agent_compute-ego_mean0.14336878999249192
agent_compute-ego_median0.14324696643932447
agent_compute-ego_min0.14156593322753908
deviation-center-line_max0.422746773420424
deviation-center-line_mean0.22684136827408272
deviation-center-line_min0.11029528813103152
deviation-heading_max1.3081583841821005
deviation-heading_mean1.1043020953521463
deviation-heading_median1.154748559143698
deviation-heading_min0.809955607284917
driven_any_max1.8871359605244824
driven_any_mean0.7687047249397547
driven_any_median0.4233267579654081
driven_any_min0.2459901159489359
driven_lanedir_consec_max0.8849934910987494
driven_lanedir_consec_mean0.48627374622512864
driven_lanedir_consec_min0.1970993379198025
driven_lanedir_max0.8849934910987494
driven_lanedir_mean0.48627374622512864
driven_lanedir_median0.38181189179976505
driven_lanedir_min0.1970993379198025
in-drivable-lane_max7.250000000000019
in-drivable-lane_mean1.4900000000000038
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.4233267579654081, "sim_physics": 0.09708991293179786, "survival_time": 2.9499999999999975, "driven_lanedir": 0.38181189179976505, "sim_render-ego": 0.03541027893454342, "in-drivable-lane": 0, "agent_compute-ego": 0.14555698330119504, "deviation-heading": 1.01327013926464, "set_robot_commands": 0.054100497294280486, "deviation-center-line": 0.17417353922182804, "driven_lanedir_consec": 0.38181189179976505, "sim_compute_sim_state": 0.022203506049463303, "sim_compute_performance-ego": 0.03783478575237727, "sim_compute_robot_state-ego": 0.04014983015545344, "sim_compute_robot_state-npc0": 0.03953614881483175, "sim_compute_robot_state-npc1": 0.03904293755353507, "sim_compute_robot_state-npc2": 0.04204815121020301, "sim_compute_robot_state-npc3": 0.03878827822410454}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.35109804124067595, "sim_physics": 0.09417648792266846, "survival_time": 2.499999999999999, "driven_lanedir": 0.297128895258691, "sim_render-ego": 0.03435197353363037, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14156593322753908, "deviation-heading": 1.154748559143698, "set_robot_commands": 0.05355273723602295, "deviation-center-line": 0.16534596861550704, "driven_lanedir_consec": 0.297128895258691, "sim_compute_sim_state": 0.022088284492492675, "sim_compute_performance-ego": 0.03851229667663574, "sim_compute_robot_state-ego": 0.039782719612121584, "sim_compute_robot_state-npc0": 0.03954390525817871, "sim_compute_robot_state-npc1": 0.03876924514770508, "sim_compute_robot_state-npc2": 0.038435420989990234, "sim_compute_robot_state-npc3": 0.0386226749420166}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.9359727490192716, "sim_physics": 0.097384403963558, "survival_time": 6.099999999999986, "driven_lanedir": 0.8849934910987494, "sim_render-ego": 0.03540008967040015, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14339753643411104, "deviation-heading": 1.3081583841821005, "set_robot_commands": 0.05382151095593562, "deviation-center-line": 0.2616452719816231, "driven_lanedir_consec": 0.8849934910987494, "sim_compute_sim_state": 0.02219590202706759, "sim_compute_performance-ego": 0.037790693220545034, "sim_compute_robot_state-ego": 0.04014691759328373, "sim_compute_robot_state-npc0": 0.039523390472912395, "sim_compute_robot_state-npc1": 0.038822451575857696, "sim_compute_robot_state-npc2": 0.038682765648013255, "sim_compute_robot_state-npc3": 0.0387901321786349}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.8871359605244824, "sim_physics": 0.08709247341714643, "survival_time": 11.950000000000037, "driven_lanedir": 0.6703351150486352, "sim_render-ego": 0.03493358500333012, "in-drivable-lane": 7.250000000000019, "agent_compute-ego": 0.14307653056028996, "deviation-heading": 1.2353777868853764, "set_robot_commands": 0.05398438166374941, "deviation-center-line": 0.422746773420424, "driven_lanedir_consec": 0.6703351150486352, "sim_compute_sim_state": 0.02216891364572437, "sim_compute_performance-ego": 0.03794004827363721, "sim_compute_robot_state-ego": 0.04024566267324791, "sim_compute_robot_state-npc0": 0.03957825026252779, "sim_compute_robot_state-npc1": 0.039710696272271445, "sim_compute_robot_state-npc2": 0.03872265975345627, "sim_compute_robot_state-npc3": 0.03893853331210723}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2459901159489359, "sim_physics": 0.08743840294915277, "survival_time": 1.850000000000001, "driven_lanedir": 0.1970993379198025, "sim_render-ego": 0.03504748602171202, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.14324696643932447, "deviation-heading": 0.809955607284917, "set_robot_commands": 0.06110590857428473, "deviation-center-line": 0.11029528813103152, "driven_lanedir_consec": 0.1970993379198025, "sim_compute_sim_state": 0.022229085097441804, "sim_compute_performance-ego": 0.037627349028716214, "sim_compute_robot_state-ego": 0.03999235823347762, "sim_compute_robot_state-npc0": 0.03971126272871688, "sim_compute_robot_state-npc1": 0.039163041759181665, "sim_compute_robot_state-npc2": 0.03869235193407213, "sim_compute_robot_state-npc3": 0.03985772261748443}}
set_robot_commands_max0.06110590857428473
set_robot_commands_mean0.05531300714485464
set_robot_commands_median0.05398438166374941
set_robot_commands_min0.05355273723602295
sim_compute_performance-ego_max0.03851229667663574
sim_compute_performance-ego_mean0.0379410345903823
sim_compute_performance-ego_median0.03783478575237727
sim_compute_performance-ego_min0.037627349028716214
sim_compute_robot_state-ego_max0.04024566267324791
sim_compute_robot_state-ego_mean0.040063497653516855
sim_compute_robot_state-ego_median0.04014691759328373
sim_compute_robot_state-ego_min0.039782719612121584
sim_compute_robot_state-npc0_max0.03971126272871688
sim_compute_robot_state-npc0_mean0.0395785915074335
sim_compute_robot_state-npc0_median0.03954390525817871
sim_compute_robot_state-npc0_min0.039523390472912395
sim_compute_robot_state-npc1_max0.039710696272271445
sim_compute_robot_state-npc1_mean0.039101674461710194
sim_compute_robot_state-npc1_median0.03904293755353507
sim_compute_robot_state-npc1_min0.03876924514770508
sim_compute_robot_state-npc2_max0.04204815121020301
sim_compute_robot_state-npc2_mean0.039316269907146977
sim_compute_robot_state-npc2_median0.03869235193407213
sim_compute_robot_state-npc2_min0.038435420989990234
sim_compute_robot_state-npc3_max0.03985772261748443
sim_compute_robot_state-npc3_mean0.03899946825486954
sim_compute_robot_state-npc3_median0.0387901321786349
sim_compute_robot_state-npc3_min0.0386226749420166
sim_compute_sim_state_max0.022229085097441804
sim_compute_sim_state_mean0.02217713826243795
sim_compute_sim_state_median0.02219590202706759
sim_compute_sim_state_min0.022088284492492675
sim_physics_max0.097384403963558
sim_physics_mean0.09263633623686472
sim_physics_median0.09417648792266846
sim_physics_min0.08709247341714643
sim_render-ego_max0.03541027893454342
sim_render-ego_mean0.03502868263272321
sim_render-ego_median0.03504748602171202
sim_render-ego_min0.03435197353363037
simulation-passed1
survival_time_max11.950000000000037
survival_time_mean5.070000000000004
survival_time_min1.850000000000001
240953893chuyjChuyj Submissionaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12920:02:26
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 296, in run_episode
    agent.write_topic_and_expect_zero('observations', recv.data.observations)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "observations".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 38, in on_received_observations
               ||     print(f"on_received_obs:{Duckiebot1Observations.shape}")
               || AttributeError: type object 'Duckiebot1Observations' has no attribute 'shape'
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240943892kene4192CNN-Float64-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:07:47(hidden)
driven_lanedir_consec_median0.46759642203499974
survival_time_median3.4999999999999956
deviation-center-line_median0.24216074504327992
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.11947724590562794
agent_compute-ego_mean0.11701455023234825
agent_compute-ego_median0.11677664379740872
agent_compute-ego_min0.11571027718338311
deviation-center-line_max0.2993156262582763
deviation-center-line_mean0.2317539738596809
deviation-center-line_min0.14875595276289963
deviation-heading_max1.2084736867160086
deviation-heading_mean0.8383957307171247
deviation-heading_median0.8359849514396611
deviation-heading_min0.5216047095947761
driven_any_max0.5245441269518737
driven_any_mean0.4290818302136724
driven_any_median0.5005268760341138
driven_any_min0.27839214141659074
driven_lanedir_consec_max0.5135606888508422
driven_lanedir_consec_mean0.3986890592612478
driven_lanedir_consec_min0.2458924450324338
driven_lanedir_max0.5135606888508422
driven_lanedir_mean0.3986890592612478
driven_lanedir_median0.46759642203499974
driven_lanedir_min0.2458924450324338
in-drivable-lane_max0.09999999999999964
in-drivable-lane_mean0.039999999999999855
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5067840441136184, "sim_physics": 0.09522117653938188, "survival_time": 3.649999999999995, "driven_lanedir": 0.46759642203499974, "sim_render-ego": 0.035920793063020054, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11947724590562794, "deviation-heading": 1.0865430356039325, "set_robot_commands": 0.05501680831386618, "deviation-center-line": 0.24216074504327992, "driven_lanedir_consec": 0.46759642203499974, "sim_compute_sim_state": 0.022497193454063105, "sim_compute_performance-ego": 0.03849287555642324, "sim_compute_robot_state-ego": 0.04469345693718897, "sim_compute_robot_state-npc0": 0.0402179090944055, "sim_compute_robot_state-npc1": 0.039437810035601054, "sim_compute_robot_state-npc2": 0.03917741122311109, "sim_compute_robot_state-npc3": 0.03917050361633301}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3351619625521655, "sim_physics": 0.0885168945088106, "survival_time": 2.549999999999999, "driven_lanedir": 0.2760347313070346, "sim_render-ego": 0.03469399377411487, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.11571027718338311, "deviation-heading": 1.2084736867160086, "set_robot_commands": 0.05702982696832395, "deviation-center-line": 0.17469061192042695, "driven_lanedir_consec": 0.2760347313070346, "sim_compute_sim_state": 0.02252648858463063, "sim_compute_performance-ego": 0.03892047732484107, "sim_compute_robot_state-ego": 0.04035591611675188, "sim_compute_robot_state-npc0": 0.03977589046253877, "sim_compute_robot_state-npc1": 0.039288595610973885, "sim_compute_robot_state-npc2": 0.03901246014763327, "sim_compute_robot_state-npc3": 0.03917564130296894}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5005268760341138, "sim_physics": 0.09422015462602888, "survival_time": 3.4999999999999956, "driven_lanedir": 0.49036100908092894, "sim_render-ego": 0.03550552640642438, "in-drivable-lane": 0, "agent_compute-ego": 0.11622908796582904, "deviation-heading": 0.5216047095947761, "set_robot_commands": 0.05437332221439906, "deviation-center-line": 0.2993156262582763, "driven_lanedir_consec": 0.49036100908092894, "sim_compute_sim_state": 0.024394815308707105, "sim_compute_performance-ego": 0.0382915735244751, "sim_compute_robot_state-ego": 0.040437449727739605, "sim_compute_robot_state-npc0": 0.04001073156084333, "sim_compute_robot_state-npc1": 0.039475532940455846, "sim_compute_robot_state-npc2": 0.039169417108808245, "sim_compute_robot_state-npc3": 0.03973229953220912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5245441269518737, "sim_physics": 0.09437227580282424, "survival_time": 3.599999999999995, "driven_lanedir": 0.5135606888508422, "sim_render-ego": 0.035799493392308555, "in-drivable-lane": 0, "agent_compute-ego": 0.11687949630949232, "deviation-heading": 0.5393722702312453, "set_robot_commands": 0.05485544270939297, "deviation-center-line": 0.2938469333135217, "driven_lanedir_consec": 0.5135606888508422, "sim_compute_sim_state": 0.02231586641735501, "sim_compute_performance-ego": 0.03821056087811788, "sim_compute_robot_state-ego": 0.043054540952046715, "sim_compute_robot_state-npc0": 0.040060589710871376, "sim_compute_robot_state-npc1": 0.039242681529786855, "sim_compute_robot_state-npc2": 0.03888603382640415, "sim_compute_robot_state-npc3": 0.03889295789930555}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.27839214141659074, "sim_physics": 0.087633726208709, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2458924450324338, "sim_render-ego": 0.03561627033144929, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.11677664379740872, "deviation-heading": 0.8359849514396611, "set_robot_commands": 0.05871545436770417, "deviation-center-line": 0.14875595276289963, "driven_lanedir_consec": 0.2458924450324338, "sim_compute_sim_state": 0.022278087083683455, "sim_compute_performance-ego": 0.03918466457100802, "sim_compute_robot_state-ego": 0.04045169852500738, "sim_compute_robot_state-npc0": 0.04010858092197152, "sim_compute_robot_state-npc1": 0.03916385561920876, "sim_compute_robot_state-npc2": 0.03883013059926588, "sim_compute_robot_state-npc3": 0.039002335348794624}}
set_robot_commands_max0.05871545436770417
set_robot_commands_mean0.055998170914737265
set_robot_commands_median0.05501680831386618
set_robot_commands_min0.05437332221439906
sim_compute_performance-ego_max0.03918466457100802
sim_compute_performance-ego_mean0.038620030370973064
sim_compute_performance-ego_median0.03849287555642324
sim_compute_performance-ego_min0.03821056087811788
sim_compute_robot_state-ego_max0.04469345693718897
sim_compute_robot_state-ego_mean0.04179861245174691
sim_compute_robot_state-ego_median0.04045169852500738
sim_compute_robot_state-ego_min0.04035591611675188
sim_compute_robot_state-npc0_max0.0402179090944055
sim_compute_robot_state-npc0_mean0.040034740350126094
sim_compute_robot_state-npc0_median0.040060589710871376
sim_compute_robot_state-npc0_min0.03977589046253877
sim_compute_robot_state-npc1_max0.039475532940455846
sim_compute_robot_state-npc1_mean0.03932169514720528
sim_compute_robot_state-npc1_median0.039288595610973885
sim_compute_robot_state-npc1_min0.03916385561920876
sim_compute_robot_state-npc2_max0.03917741122311109
sim_compute_robot_state-npc2_mean0.03901509058104453
sim_compute_robot_state-npc2_median0.03901246014763327
sim_compute_robot_state-npc2_min0.03883013059926588
sim_compute_robot_state-npc3_max0.03973229953220912
sim_compute_robot_state-npc3_mean0.039194747539922255
sim_compute_robot_state-npc3_median0.03917050361633301
sim_compute_robot_state-npc3_min0.03889295789930555
sim_compute_sim_state_max0.024394815308707105
sim_compute_sim_state_mean0.022802490169687856
sim_compute_sim_state_median0.022497193454063105
sim_compute_sim_state_min0.022278087083683455
sim_physics_max0.09522117653938188
sim_physics_mean0.09199284553715092
sim_physics_median0.09422015462602888
sim_physics_min0.087633726208709
sim_render-ego_max0.035920793063020054
sim_render-ego_mean0.03550721539346343
sim_render-ego_median0.03561627033144929
sim_render-ego_min0.03469399377411487
simulation-passed1
survival_time_max3.649999999999995
survival_time_mean3.0899999999999967
survival_time_min2.1500000000000004
240933891kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:08:31(hidden)
driven_lanedir_consec_median0.3991905460241121
survival_time_median4.94999999999999
deviation-center-line_median0.24229018356912108
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.10763954425203628
agent_compute-ego_mean0.10647327234782582
agent_compute-ego_median0.10632132220741929
agent_compute-ego_min0.1054262184515232
deviation-center-line_max0.4417072683654324
deviation-center-line_mean0.26457207338178734
deviation-center-line_min0.1397504796816527
deviation-heading_max2.4712644616211517
deviation-heading_mean1.378562703077527
deviation-heading_median1.0380357121602806
deviation-heading_min0.855530480882093
driven_any_max1.1209851258973405
driven_any_mean0.8048461705979761
driven_any_median0.700271710340483
driven_any_min0.585842624678965
driven_lanedir_consec_max0.6873661888879385
driven_lanedir_consec_mean0.4516522601491437
driven_lanedir_consec_min0.27147203845563306
driven_lanedir_max0.6904228304510398
driven_lanedir_mean0.45407004531749456
driven_lanedir_median0.3991905460241121
driven_lanedir_min0.27147203845563306
in-drivable-lane_max2.549999999999991
in-drivable-lane_mean1.8299999999999936
in-drivable-lane_min1.3499999999999952
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1209851258973405, "sim_physics": 0.08774823700355379, "survival_time": 7.549999999999981, "driven_lanedir": 0.6347563092369906, "sim_render-ego": 0.035323586684978564, "in-drivable-lane": 2.549999999999991, "agent_compute-ego": 0.10632132220741929, "deviation-heading": 1.525197595553191, "set_robot_commands": 0.05447855216777877, "deviation-center-line": 0.3534109672234653, "driven_lanedir_consec": 0.6257240249583376, "sim_compute_sim_state": 0.02266210751817716, "sim_compute_performance-ego": 0.03823572594598429, "sim_compute_robot_state-ego": 0.0401586081018511, "sim_compute_robot_state-npc0": 0.03975145706277809, "sim_compute_robot_state-npc1": 0.03907561460078157, "sim_compute_robot_state-npc2": 0.03882096145326728, "sim_compute_robot_state-npc3": 0.03894313123841949}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.700271710340483, "sim_physics": 0.09775730335351192, "survival_time": 4.94999999999999, "driven_lanedir": 0.3991905460241121, "sim_render-ego": 0.03534867065121429, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.10595181012394451, "deviation-heading": 0.855530480882093, "set_robot_commands": 0.05442011717594031, "deviation-center-line": 0.24229018356912108, "driven_lanedir_consec": 0.3991905460241121, "sim_compute_sim_state": 0.022363378544046426, "sim_compute_performance-ego": 0.038108204350327, "sim_compute_robot_state-ego": 0.04013008541531033, "sim_compute_robot_state-npc0": 0.040102850307117806, "sim_compute_robot_state-npc1": 0.03895624960311735, "sim_compute_robot_state-npc2": 0.03878874971409037, "sim_compute_robot_state-npc3": 0.038839130690603546}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5862873422480862, "sim_physics": 0.08646989740976473, "survival_time": 4.099999999999993, "driven_lanedir": 0.27147203845563306, "sim_render-ego": 0.03473831967609685, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.1054262184515232, "deviation-heading": 1.0380357121602806, "set_robot_commands": 0.054558140475575514, "deviation-center-line": 0.14570146806926526, "driven_lanedir_consec": 0.27147203845563306, "sim_compute_sim_state": 0.022234454387571753, "sim_compute_performance-ego": 0.038017866088122854, "sim_compute_robot_state-ego": 0.04012385228785073, "sim_compute_robot_state-npc0": 0.03964814034903922, "sim_compute_robot_state-npc1": 0.03892076306226777, "sim_compute_robot_state-npc2": 0.03907135347040688, "sim_compute_robot_state-npc3": 0.03892021062897473}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.585842624678965, "sim_physics": 0.0847932129371457, "survival_time": 4.099999999999993, "driven_lanedir": 0.2745085024196974, "sim_render-ego": 0.0348028293470057, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.10702746670420576, "deviation-heading": 1.0027852651709186, "set_robot_commands": 0.05691554197450963, "deviation-center-line": 0.1397504796816527, "driven_lanedir_consec": 0.2745085024196974, "sim_compute_sim_state": 0.02231046630115044, "sim_compute_performance-ego": 0.038753762477781714, "sim_compute_robot_state-ego": 0.040164729443992055, "sim_compute_robot_state-npc0": 0.03954717008078971, "sim_compute_robot_state-npc1": 0.03895781389096888, "sim_compute_robot_state-npc2": 0.038852671297585094, "sim_compute_robot_state-npc3": 0.03886998281246278}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.0308440498250055, "sim_physics": 0.08525754921678183, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6904228304510398, "sim_render-ego": 0.03557658541029778, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.10763954425203628, "deviation-heading": 2.4712644616211517, "set_robot_commands": 0.05473290319028108, "deviation-center-line": 0.4417072683654324, "driven_lanedir_consec": 0.6873661888879385, "sim_compute_sim_state": 0.02223445885423301, "sim_compute_performance-ego": 0.03810760594796443, "sim_compute_robot_state-ego": 0.04009898330854333, "sim_compute_robot_state-npc0": 0.039681139199630074, "sim_compute_robot_state-npc1": 0.038988802743994674, "sim_compute_robot_state-npc2": 0.03875795136327329, "sim_compute_robot_state-npc3": 0.039258758227030434}}
set_robot_commands_max0.05691554197450963
set_robot_commands_mean0.05502105099681707
set_robot_commands_median0.054558140475575514
set_robot_commands_min0.05442011717594031
sim_compute_performance-ego_max0.038753762477781714
sim_compute_performance-ego_mean0.03824463296203605
sim_compute_performance-ego_median0.038108204350327
sim_compute_performance-ego_min0.038017866088122854
sim_compute_robot_state-ego_max0.040164729443992055
sim_compute_robot_state-ego_mean0.040135251711509515
sim_compute_robot_state-ego_median0.04013008541531033
sim_compute_robot_state-ego_min0.04009898330854333
sim_compute_robot_state-npc0_max0.040102850307117806
sim_compute_robot_state-npc0_mean0.03974615139987098
sim_compute_robot_state-npc0_median0.039681139199630074
sim_compute_robot_state-npc0_min0.03954717008078971
sim_compute_robot_state-npc1_max0.03907561460078157
sim_compute_robot_state-npc1_mean0.038979848780226055
sim_compute_robot_state-npc1_median0.03895781389096888
sim_compute_robot_state-npc1_min0.03892076306226777
sim_compute_robot_state-npc2_max0.03907135347040688
sim_compute_robot_state-npc2_mean0.038858337459724585
sim_compute_robot_state-npc2_median0.03882096145326728
sim_compute_robot_state-npc2_min0.03875795136327329
sim_compute_robot_state-npc3_max0.039258758227030434
sim_compute_robot_state-npc3_mean0.038966242719498195
sim_compute_robot_state-npc3_median0.03892021062897473
sim_compute_robot_state-npc3_min0.038839130690603546
sim_compute_sim_state_max0.02266210751817716
sim_compute_sim_state_mean0.022360973121035754
sim_compute_sim_state_median0.02231046630115044
sim_compute_sim_state_min0.022234454387571753
sim_physics_max0.09775730335351192
sim_physics_mean0.08840523998415159
sim_physics_median0.08646989740976473
sim_physics_min0.0847932129371457
sim_render-ego_max0.03557658541029778
sim_render-ego_mean0.03515799835391864
sim_render-ego_median0.035323586684978564
sim_render-ego_min0.03473831967609685
simulation-passed1
survival_time_max7.549999999999981
survival_time_mean5.519999999999989
survival_time_min4.099999999999993
240923890kene4192ResNet-Dropout-GDSaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:05:03
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240883884chuyjBaseline solution using reinforcement learningaido2-LFV-sim-testing-offseasonstep1-simulationsuccessyes12920:15:26(hidden)
driven_lanedir_consec_median0.09464642109782218
survival_time_median1.2000000000000004
deviation-center-line_median0.08492785202182568
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.15396762745721
agent_compute-ego_mean0.11931572957186493
agent_compute-ego_median0.1203229029973348
agent_compute-ego_min0.09536440805955368
deviation-center-line_max0.5949931812686031
deviation-center-line_mean0.1086534447623132
deviation-center-line_min0.039850256773165914
deviation-heading_max4.999633616469041
deviation-heading_mean0.9768231104466104
deviation-heading_median0.713210573131171
deviation-heading_min0.5200301131468128
driven_any_max2.383651133034539
driven_any_mean0.3142300897889911
driven_any_median0.15315713481207294
driven_any_min0.09645557459617794
driven_lanedir_consec_max0.4282642183367859
driven_lanedir_consec_mean0.11890167803900162
driven_lanedir_consec_min0.054629316238435255
driven_lanedir_max0.4282642183367859
driven_lanedir_mean0.11890167803900162
driven_lanedir_median0.09464642109782218
driven_lanedir_min0.054629316238435255
in-drivable-lane_max9.600000000000062
in-drivable-lane_mean0.7600000000000041
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2169381569683068, "sim_physics": 0.19368364129747664, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1207617980224005, "sim_render-ego": 0.05642277002334595, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.15396762745721, "deviation-heading": 0.8348307021929493, "set_robot_commands": 0.09085551330021448, "deviation-center-line": 0.07926129411248894, "driven_lanedir_consec": 0.1207617980224005, "sim_compute_sim_state": 0.04276849542345319, "sim_compute_performance-ego": 0.06628356661115374, "sim_compute_robot_state-ego": 0.06638609511511666, "sim_compute_robot_state-npc0": 0.06818064621516637, "sim_compute_robot_state-npc1": 0.06418060404913765, "sim_compute_robot_state-npc2": 0.0648796728679112, "sim_compute_robot_state-npc3": 0.07045877831322807}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.383651133034539, "sim_physics": 0.13925752719243367, "survival_time": 14.950000000000076, "driven_lanedir": 0.4282642183367859, "sim_render-ego": 0.05234039386113485, "in-drivable-lane": 9.600000000000062, "agent_compute-ego": 0.14147676388422648, "deviation-heading": 4.999633616469041, "set_robot_commands": 0.07847106138865154, "deviation-center-line": 0.5949931812686031, "driven_lanedir_consec": 0.4282642183367859, "sim_compute_sim_state": 0.033446121215820315, "sim_compute_performance-ego": 0.05662838141123454, "sim_compute_robot_state-ego": 0.05939232110977173, "sim_compute_robot_state-npc0": 0.059979031880696615, "sim_compute_robot_state-npc1": 0.056641065279642744, "sim_compute_robot_state-npc2": 0.058220168749491374, "sim_compute_robot_state-npc3": 0.05739686886469523}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.12994206019093676, "sim_physics": 0.1312263011932373, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0952374949104553, "sim_render-ego": 0.04760041444197945, "in-drivable-lane": 0, "agent_compute-ego": 0.13711768647898798, "deviation-heading": 0.5385069644586731, "set_robot_commands": 0.0689934958582339, "deviation-center-line": 0.0994934994483332, "driven_lanedir_consec": 0.0952374949104553, "sim_compute_sim_state": 0.02905559539794922, "sim_compute_performance-ego": 0.05120415272920028, "sim_compute_robot_state-ego": 0.05330252647399902, "sim_compute_robot_state-npc0": 0.05147458159405252, "sim_compute_robot_state-npc1": 0.051004316495812455, "sim_compute_robot_state-npc2": 0.052701836046965225, "sim_compute_robot_state-npc3": 0.051170121068539826}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1471752446927979, "sim_physics": 0.13749612932619842, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10717368812276272, "sim_render-ego": 0.042471553968346634, "in-drivable-lane": 0, "agent_compute-ego": 0.11599596686985182, "deviation-heading": 0.5200301131468128, "set_robot_commands": 0.0675116310948911, "deviation-center-line": 0.09365497826042356, "driven_lanedir_consec": 0.10717368812276272, "sim_compute_sim_state": 0.027966177981832752, "sim_compute_performance-ego": 0.04762149893719217, "sim_compute_robot_state-ego": 0.049395944761193314, "sim_compute_robot_state-npc0": 0.05110902371613875, "sim_compute_robot_state-npc1": 0.050802811332370926, "sim_compute_robot_state-npc2": 0.04896519495093304, "sim_compute_robot_state-npc3": 0.04905642633852751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1510041372310482, "sim_physics": 0.11758848031361896, "survival_time": 1.2000000000000004, "driven_lanedir": 0.09464642109782218, "sim_render-ego": 0.05385173360506693, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.11435118317604064, "deviation-heading": 0.7667562947873823, "set_robot_commands": 0.06364004810651143, "deviation-center-line": 0.05743555216142518, "driven_lanedir_consec": 0.09464642109782218, "sim_compute_sim_state": 0.028602053721745808, "sim_compute_performance-ego": 0.04955236117045085, "sim_compute_robot_state-ego": 0.047390639781951904, "sim_compute_robot_state-npc0": 0.048745701710383095, "sim_compute_robot_state-npc1": 0.04914548993110657, "sim_compute_robot_state-npc2": 0.049005607763926186, "sim_compute_robot_state-npc3": 0.05067160725593567}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.2768066726686924, "sim_physics": 0.11809584341551128, "survival_time": 1.900000000000001, "driven_lanedir": 0.14095475221873377, "sim_render-ego": 0.044280202765213814, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.12081958118237948, "deviation-heading": 0.7871070322801896, "set_robot_commands": 0.06711953564694054, "deviation-center-line": 0.06691018742577635, "driven_lanedir_consec": 0.14095475221873377, "sim_compute_sim_state": 0.02756236101451673, "sim_compute_performance-ego": 0.05113836966062847, "sim_compute_robot_state-ego": 0.050507896824886926, "sim_compute_robot_state-npc0": 0.04977216218647204, "sim_compute_robot_state-npc1": 0.05012666551690353, "sim_compute_robot_state-npc2": 0.05182892397830361, "sim_compute_robot_state-npc3": 0.04791023856715152}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.13235082773159487, "sim_physics": 0.14058497677678647, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09202433632990736, "sim_render-ego": 0.04732066652049189, "in-drivable-lane": 0, "agent_compute-ego": 0.1451940743819527, "deviation-heading": 0.6354606059372034, "set_robot_commands": 0.07004475593566895, "deviation-center-line": 0.08564640653410699, "driven_lanedir_consec": 0.09202433632990736, "sim_compute_sim_state": 0.031027265216993248, "sim_compute_performance-ego": 0.05547931919927183, "sim_compute_robot_state-ego": 0.05476229087166165, "sim_compute_robot_state-npc0": 0.051355569258980126, "sim_compute_robot_state-npc1": 0.052590888479481575, "sim_compute_robot_state-npc2": 0.05145232573799465, "sim_compute_robot_state-npc3": 0.05143707731495733}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1343330226789773, "sim_physics": 0.13072068794913913, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09451693155127484, "sim_render-ego": 0.047941974971605385, "in-drivable-lane": 0, "agent_compute-ego": 0.11274652895720108, "deviation-heading": 0.5485659700079921, "set_robot_commands": 0.0626298655634341, "deviation-center-line": 0.08492785202182568, "driven_lanedir_consec": 0.09451693155127484, "sim_compute_sim_state": 0.02695191424825917, "sim_compute_performance-ego": 0.05464542430380116, "sim_compute_robot_state-ego": 0.05362454704616381, "sim_compute_robot_state-npc0": 0.051082123880800995, "sim_compute_robot_state-npc1": 0.04748973639115043, "sim_compute_robot_state-npc2": 0.04598322121993355, "sim_compute_robot_state-npc3": 0.04798801048942234}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.2125423320810019, "sim_physics": 0.12391820820895108, "survival_time": 1.6500000000000008, "driven_lanedir": 0.11227964866586726, "sim_render-ego": 0.04380813511935147, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.12153488216978132, "deviation-heading": 0.713210573131171, "set_robot_commands": 0.06634340864239317, "deviation-center-line": 0.039850256773165914, "driven_lanedir_consec": 0.11227964866586726, "sim_compute_sim_state": 0.034091039137406784, "sim_compute_performance-ego": 0.04841249639337713, "sim_compute_robot_state-ego": 0.05129738287492232, "sim_compute_robot_state-npc0": 0.050176259243127075, "sim_compute_robot_state-npc1": 0.04881585005557898, "sim_compute_robot_state-npc2": 0.0483325177972967, "sim_compute_robot_state-npc3": 0.05006989565762607}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.1705422482206573, "sim_physics": 0.12413460237008554, "survival_time": 1.3500000000000003, "driven_lanedir": 0.07147872369992792, "sim_render-ego": 0.045106455131813335, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.12272327034561722, "deviation-heading": 0.7924963042460201, "set_robot_commands": 0.07096343570285374, "deviation-center-line": 0.0408213194150243, "driven_lanedir_consec": 0.07147872369992792, "sim_compute_sim_state": 0.028765492969089083, "sim_compute_performance-ego": 0.051578380443431715, "sim_compute_robot_state-ego": 0.05085244885197392, "sim_compute_robot_state-npc0": 0.05169189417803729, "sim_compute_robot_state-npc1": 0.052217960357666016, "sim_compute_robot_state-npc2": 0.05016806390550402, "sim_compute_robot_state-npc3": 0.05072670512729221}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.15315713481207294, "sim_physics": 0.13392606377601624, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08614546493986364, "sim_render-ego": 0.04801710446675619, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1203229029973348, "deviation-heading": 0.8598516045028022, "set_robot_commands": 0.06506309906641643, "deviation-center-line": 0.05710949895002309, "driven_lanedir_consec": 0.08614546493986364, "sim_compute_sim_state": 0.02670477827390035, "sim_compute_performance-ego": 0.05047269662221273, "sim_compute_robot_state-ego": 0.05194553732872009, "sim_compute_robot_state-npc0": 0.05345850189526876, "sim_compute_robot_state-npc1": 0.0496842364470164, "sim_compute_robot_state-npc2": 0.05008699496587118, "sim_compute_robot_state-npc3": 0.05342152714729309}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.09645557459617794, "sim_physics": 0.09377309083938598, "survival_time": 1.0000000000000002, "driven_lanedir": 0.054629316238435255, "sim_render-ego": 0.03668016195297241, "in-drivable-lane": 0, "agent_compute-ego": 0.09657022953033448, "deviation-heading": 0.63772223540468, "set_robot_commands": 0.05552936792373657, "deviation-center-line": 0.08644813848361921, "driven_lanedir_consec": 0.054629316238435255, "sim_compute_sim_state": 0.02373499870300293, "sim_compute_performance-ego": 0.04021471738815307, "sim_compute_robot_state-ego": 0.04127472639083862, "sim_compute_robot_state-npc0": 0.04141225814819336, "sim_compute_robot_state-npc1": 0.04415287971496582, "sim_compute_robot_state-npc2": 0.040843427181243896, "sim_compute_robot_state-npc3": 0.041016900539398195}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.23017531496557964, "sim_physics": 0.0960474077023958, "survival_time": 1.900000000000001, "driven_lanedir": 0.09454393651016868, "sim_render-ego": 0.03652028661025198, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.09581414021943745, "deviation-heading": 0.7279772434349133, "set_robot_commands": 0.05465370730349892, "deviation-center-line": 0.06575066821449864, "driven_lanedir_consec": 0.09454393651016868, "sim_compute_sim_state": 0.022987265335886103, "sim_compute_performance-ego": 0.03908419609069824, "sim_compute_robot_state-ego": 0.04077482223510742, "sim_compute_robot_state-npc0": 0.040388766087983786, "sim_compute_robot_state-npc1": 0.03991152738270007, "sim_compute_robot_state-npc2": 0.03980066274341784, "sim_compute_robot_state-npc3": 0.039807840397483425}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.11655141042153444, "sim_physics": 0.10001468658447266, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07435551761806014, "sim_render-ego": 0.03607606887817383, "in-drivable-lane": 0, "agent_compute-ego": 0.09536440805955368, "deviation-heading": 0.6027586212287058, "set_robot_commands": 0.05394143407995051, "deviation-center-line": 0.087640768931293, "driven_lanedir_consec": 0.07435551761806014, "sim_compute_sim_state": 0.022705273194746536, "sim_compute_performance-ego": 0.03852435675534335, "sim_compute_robot_state-ego": 0.04066796736283736, "sim_compute_robot_state-npc0": 0.04663211649114435, "sim_compute_robot_state-npc1": 0.03968923742120916, "sim_compute_robot_state-npc2": 0.039297418160872025, "sim_compute_robot_state-npc3": 0.03940920396284624}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1618260765409495, "sim_physics": 0.09627190342655888, "survival_time": 1.3500000000000003, "driven_lanedir": 0.11651292232255894, "sim_render-ego": 0.03628029646696867, "in-drivable-lane": 0, "agent_compute-ego": 0.0957366978680646, "deviation-heading": 0.687438775470617, "set_robot_commands": 0.0552858864819562, "deviation-center-line": 0.08985806943409097, "driven_lanedir_consec": 0.11651292232255894, "sim_compute_sim_state": 0.023534474549470125, "sim_compute_performance-ego": 0.04113757168805158, "sim_compute_robot_state-ego": 0.04068303108215332, "sim_compute_robot_state-npc0": 0.04063289253800004, "sim_compute_robot_state-npc1": 0.04020673257333261, "sim_compute_robot_state-npc2": 0.040311062777483905, "sim_compute_robot_state-npc3": 0.04007356255142777}}
set_robot_commands_max0.09085551330021448
set_robot_commands_mean0.06606974973969011
set_robot_commands_median0.06634340864239317
set_robot_commands_min0.05394143407995051
sim_compute_performance-ego_max0.06628356661115374
sim_compute_performance-ego_mean0.04946516596028006
sim_compute_performance-ego_median0.05047269662221273
sim_compute_performance-ego_min0.03852435675534335
sim_compute_robot_state-ego_max0.06638609511511666
sim_compute_robot_state-ego_mean0.05015054520741987
sim_compute_robot_state-ego_median0.05085244885197392
sim_compute_robot_state-ego_min0.04066796736283736
sim_compute_robot_state-npc0_max0.06818064621516637
sim_compute_robot_state-npc0_mean0.05040610193496302
sim_compute_robot_state-npc0_median0.051082123880800995
sim_compute_robot_state-npc0_min0.040388766087983786
sim_compute_robot_state-npc1_max0.06418060404913765
sim_compute_robot_state-npc1_mean0.04911066676187166
sim_compute_robot_state-npc1_median0.0496842364470164
sim_compute_robot_state-npc1_min0.03968923742120916
sim_compute_robot_state-npc2_max0.0648796728679112
sim_compute_robot_state-npc2_mean0.048791806589809895
sim_compute_robot_state-npc2_median0.049005607763926186
sim_compute_robot_state-npc2_min0.039297418160872025
sim_compute_robot_state-npc3_max0.07045877831322807
sim_compute_robot_state-npc3_mean0.049374317573054965
sim_compute_robot_state-npc3_median0.05006989565762607
sim_compute_robot_state-npc3_min0.03940920396284624
sim_compute_sim_state_max0.04276849542345319
sim_compute_sim_state_mean0.028660220425604822
sim_compute_sim_state_median0.027966177981832752
sim_compute_sim_state_min0.022705273194746536
sim_physics_max0.19368364129747664
sim_physics_mean0.12511597002481786
sim_physics_median0.12413460237008554
sim_physics_min0.09377309083938598
sim_render-ego_max0.05642277002334595
sim_render-ego_mean0.04498121458556485
sim_render-ego_median0.045106455131813335
sim_render-ego_min0.03607606887817383
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean2.240000000000006
survival_time_min1.0000000000000002
240873887chuyjBaseline solution using reinforcement learningaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12920:01:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240803875kene4192Baseline-IL-logs-tensorflowaido2-LFV-sim-validation-offseasonstep1-simulationsuccessyes12920:09:58(hidden)
driven_lanedir_consec_median0.6541878729054376
survival_time_median6.499999999999985
deviation-center-line_median0.21285536434279484
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.13311968198636684
agent_compute-ego_mean0.12998987339837637
agent_compute-ego_median0.12897844951931792
agent_compute-ego_min0.12855414334189127
deviation-center-line_max0.2996643414830513
deviation-center-line_mean0.21741217969364596
deviation-center-line_min0.1469637483843213
deviation-heading_max1.2883364790119565
deviation-heading_mean1.0833946686631195
deviation-heading_median1.1537219833965882
deviation-heading_min0.733110378110384
driven_any_max1.5927816095366192
driven_any_mean0.971123632434774
driven_any_median1.0001875883999296
driven_any_min0.2784453903590132
driven_lanedir_consec_max1.2484562083427075
driven_lanedir_consec_mean0.7503156088781218
driven_lanedir_consec_min0.2588688143675444
driven_lanedir_max1.2484562083427075
driven_lanedir_mean0.7503156088781218
driven_lanedir_median0.6541878729054376
driven_lanedir_min0.2588688143675444
in-drivable-lane_max2.050000000000029
in-drivable-lane_mean1.14000000000001
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0001875883999296, "sim_physics": 0.09355184481694148, "survival_time": 6.499999999999985, "driven_lanedir": 0.6541878729054376, "sim_render-ego": 0.03620147705078125, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.13064285058241623, "deviation-heading": 1.2883364790119565, "set_robot_commands": 0.05423404436845046, "deviation-center-line": 0.21285536434279484, "driven_lanedir_consec": 0.6541878729054376, "sim_compute_sim_state": 0.02281950620504526, "sim_compute_performance-ego": 0.03882919825040377, "sim_compute_robot_state-ego": 0.041160944791940546, "sim_compute_robot_state-npc0": 0.040582746725815994, "sim_compute_robot_state-npc1": 0.03983729252448449, "sim_compute_robot_state-npc2": 0.03977323495424711, "sim_compute_robot_state-npc3": 0.0398505687713623}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4000494818438822, "sim_physics": 0.09699961117335729, "survival_time": 2.799999999999998, "driven_lanedir": 0.3704956406403946, "sim_render-ego": 0.03571613345827375, "in-drivable-lane": 0, "agent_compute-ego": 0.12865424156188965, "deviation-heading": 1.0579718738836832, "set_robot_commands": 0.05383766123226711, "deviation-center-line": 0.20804453979512696, "driven_lanedir_consec": 0.3704956406403946, "sim_compute_sim_state": 0.0229494571685791, "sim_compute_performance-ego": 0.039141676255634854, "sim_compute_robot_state-ego": 0.04119184187480381, "sim_compute_robot_state-npc0": 0.04081609419413975, "sim_compute_robot_state-npc1": 0.04085782170295715, "sim_compute_robot_state-npc2": 0.0398946361882346, "sim_compute_robot_state-npc3": 0.04005725468908038}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5841540920344257, "sim_physics": 0.09303592573298086, "survival_time": 10.100000000000009, "driven_lanedir": 1.2484562083427075, "sim_render-ego": 0.03602271622950488, "in-drivable-lane": 1.8500000000000263, "agent_compute-ego": 0.12897844951931792, "deviation-heading": 1.1838326289129877, "set_robot_commands": 0.05393652514655992, "deviation-center-line": 0.2996643414830513, "driven_lanedir_consec": 1.2484562083427075, "sim_compute_sim_state": 0.023954271089912643, "sim_compute_performance-ego": 0.038933945174264434, "sim_compute_robot_state-ego": 0.041364440823545554, "sim_compute_robot_state-npc0": 0.04088006397285083, "sim_compute_robot_state-npc1": 0.04013344675007433, "sim_compute_robot_state-npc2": 0.04015981088770498, "sim_compute_robot_state-npc3": 0.04011748922933446}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5927816095366192, "sim_physics": 0.09484373524858448, "survival_time": 10.15000000000001, "driven_lanedir": 1.219569508134525, "sim_render-ego": 0.03926158773488011, "in-drivable-lane": 2.050000000000029, "agent_compute-ego": 0.12855414334189127, "deviation-heading": 1.1537219833965882, "set_robot_commands": 0.05431305128952552, "deviation-center-line": 0.2195329044629353, "driven_lanedir_consec": 1.219569508134525, "sim_compute_sim_state": 0.02308144475438912, "sim_compute_performance-ego": 0.039383946968416864, "sim_compute_robot_state-ego": 0.04128232495538119, "sim_compute_robot_state-npc0": 0.040982439012950275, "sim_compute_robot_state-npc1": 0.040271773126912234, "sim_compute_robot_state-npc2": 0.04011071961501549, "sim_compute_robot_state-npc3": 0.04028053001817224}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2784453903590132, "sim_physics": 0.09054381091420244, "survival_time": 2.0500000000000007, "driven_lanedir": 0.2588688143675444, "sim_render-ego": 0.03630098482457603, "in-drivable-lane": 0, "agent_compute-ego": 0.13311968198636684, "deviation-heading": 0.733110378110384, "set_robot_commands": 0.053614790846661826, "deviation-center-line": 0.1469637483843213, "driven_lanedir_consec": 0.2588688143675444, "sim_compute_sim_state": 0.02286113762274021, "sim_compute_performance-ego": 0.038873620149565906, "sim_compute_robot_state-ego": 0.041360546902912416, "sim_compute_robot_state-npc0": 0.040987590464150035, "sim_compute_robot_state-npc1": 0.039886474609375, "sim_compute_robot_state-npc2": 0.039785047856772816, "sim_compute_robot_state-npc3": 0.03989816293483827}}
set_robot_commands_max0.05431305128952552
set_robot_commands_mean0.05398721457669296
set_robot_commands_median0.05393652514655992
set_robot_commands_min0.053614790846661826
sim_compute_performance-ego_max0.039383946968416864
sim_compute_performance-ego_mean0.03903247735965717
sim_compute_performance-ego_median0.038933945174264434
sim_compute_performance-ego_min0.03882919825040377
sim_compute_robot_state-ego_max0.041364440823545554
sim_compute_robot_state-ego_mean0.0412720198697167
sim_compute_robot_state-ego_median0.04128232495538119
sim_compute_robot_state-ego_min0.041160944791940546
sim_compute_robot_state-npc0_max0.040987590464150035
sim_compute_robot_state-npc0_mean0.04084978687398138
sim_compute_robot_state-npc0_median0.04088006397285083
sim_compute_robot_state-npc0_min0.040582746725815994
sim_compute_robot_state-npc1_max0.04085782170295715
sim_compute_robot_state-npc1_mean0.04019736174276064
sim_compute_robot_state-npc1_median0.04013344675007433
sim_compute_robot_state-npc1_min0.03983729252448449
sim_compute_robot_state-npc2_max0.04015981088770498
sim_compute_robot_state-npc2_mean0.039944689900395
sim_compute_robot_state-npc2_median0.0398946361882346
sim_compute_robot_state-npc2_min0.03977323495424711
sim_compute_robot_state-npc3_max0.04028053001817224
sim_compute_robot_state-npc3_mean0.04004080112855753
sim_compute_robot_state-npc3_median0.04005725468908038
sim_compute_robot_state-npc3_min0.0398505687713623
sim_compute_sim_state_max0.023954271089912643
sim_compute_sim_state_mean0.023133163368133265
sim_compute_sim_state_median0.0229494571685791
sim_compute_sim_state_min0.02281950620504526
sim_physics_max0.09699961117335729
sim_physics_mean0.0937949855772133
sim_physics_median0.09355184481694148
sim_physics_min0.09054381091420244
sim_render-ego_max0.03926158773488011
sim_render-ego_mean0.036700579859603205
sim_render-ego_median0.03620147705078125
sim_render-ego_min0.03571613345827375
simulation-passed1
survival_time_max10.15000000000001
survival_time_mean6.32
survival_time_min2.0500000000000007
240723867kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationerroryes12920:02:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240703859kene4192Baseline-IL-logs-tensorflow-keneaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12920:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240663862kene4192Baseline-IL-logs-tensorflow-keneaido2-LFV-sim-validation-offseasonstep1-simulationfailedyes12920:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 426, in import_graph_def
               ||     graph._c_graph, serialized, options)  # pylint: disable=protected-access
               || tensorflow.python.framework.errors_impl.InvalidArgumentError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||
               || During handling of the above exception, another exception occurred:
               ||
               || Traceback (most recent call last):
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/workspace/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "imitation_agent.py", line 69, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.config.current_image)
               ||   File "imitation_agent.py", line 41, in compute_action
               ||     graph = load_graph(frozen_model_filename)
               ||   File "/workspace/graph_utils.py", line 14, in load_graph
               ||     tf.import_graph_def(graph_def, name="prefix")
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/util/deprecation.py", line 507, in new_func
               ||     return func(*args, **kwargs)
               ||   File "/usr/local/lib/python3.7/dist-packages/tensorflow/python/framework/importer.py", line 430, in import_graph_def
               ||     raise ValueError(str(e))
               || ValueError: NodeDef mentions attr 'explicit_paddings' not in Op<name=Conv2D; signature=input:T, filter:T -> output:T; attr=T:type,allowed=[DT_HALF, DT_BFLOAT16, DT_FLOAT, DT_DOUBLE]; attr=strides:list(int); attr=use_cudnn_on_gpu:bool,default=true; attr=padding:string,allowed=["SAME", "VALID"]; attr=data_format:string,default="NHWC",allowed=["NHWC", "NCHW"]; attr=dilations:list(int),default=[1, 1, 1, 1]>; NodeDef: {{node prefix/ConvNet/conv_layer_1/Conv2D}}. (Check whether your GraphDef-interpreting binary is up to date with your GraphDef-generating binary.).
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240533854jagwarchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyes12920:16:25(hidden)
driven_lanedir_consec_median0.1371598542005299
survival_time_median1.3000000000000005
deviation-center-line_median0.09292786499235496
in-drivable-lane_median0


other stats
agent_compute-ego_max0.18579840660095215
agent_compute-ego_mean0.16500386581662657
agent_compute-ego_median0.16753902218558572
agent_compute-ego_min0.13757304711775345
deviation-center-line_max0.11261393365794942
deviation-center-line_mean0.08655641482136449
deviation-center-line_min0.05231169064260295
deviation-heading_max1.0309560039059604
deviation-heading_mean0.6975068417402392
deviation-heading_median0.6987638844609522
deviation-heading_min0.4373801024398298
driven_any_max0.28053613392423
driven_any_mean0.19278626560320836
driven_any_median0.1869157628808118
driven_any_min0.1449308162543998
driven_lanedir_consec_max0.2067562456801104
driven_lanedir_consec_mean0.13808585631987003
driven_lanedir_consec_min0.08270646924739555
driven_lanedir_max0.2067562456801104
driven_lanedir_mean0.13808585631987003
driven_lanedir_median0.1371598542005299
driven_lanedir_min0.08270646924739555
in-drivable-lane_max0.15000000000000013
in-drivable-lane_mean0.01666666666666668
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.22783281827078045, "sim_physics": 0.1872801701227824, "survival_time": 1.5000000000000009, "driven_lanedir": 0.14377534685426596, "sim_render-ego": 0.056652164459228514, "in-drivable-lane": 0, "agent_compute-ego": 0.16776099999745686, "deviation-heading": 0.9402545504069424, "set_robot_commands": 0.09128880500793456, "deviation-center-line": 0.098102811796838, "driven_lanedir_consec": 0.14377534685426596, "sim_compute_sim_state": 0.036708648999532065, "sim_compute_performance-ego": 0.06441977024078369, "sim_compute_robot_state-ego": 0.07285064856211344, "sim_compute_robot_state-npc0": 0.06928630669911702, "sim_compute_robot_state-npc1": 0.06723169485727946, "sim_compute_robot_state-npc2": 0.062271714210510254, "sim_compute_robot_state-npc3": 0.06117169857025147}, "udem1-1-0": {"driven_any": 0.1869157628808118, "sim_physics": 0.2689271890200101, "survival_time": 1.3000000000000005, "driven_lanedir": 0.08270646924739555, "sim_render-ego": 0.0625298756819505, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1669391210262592, "deviation-heading": 1.0309560039059604, "set_robot_commands": 0.08903074264526367, "deviation-center-line": 0.08286759334036747, "driven_lanedir_consec": 0.08270646924739555, "sim_compute_sim_state": 0.03923145624307486, "sim_compute_performance-ego": 0.06953957447638878, "sim_compute_robot_state-ego": 0.07070011358994704, "sim_compute_robot_state-npc0": 0.06470822370969333, "sim_compute_robot_state-npc1": 0.06569979741023137, "sim_compute_robot_state-npc2": 0.06478359149052547, "sim_compute_robot_state-npc3": 0.06502033196962796}, "udem1-2-0": {"driven_any": 0.19168168441627384, "sim_physics": 0.2365947818756103, "survival_time": 1.2500000000000004, "driven_lanedir": 0.16363354821873077, "sim_render-ego": 0.062076539993286134, "in-drivable-lane": 0, "agent_compute-ego": 0.16893345832824708, "deviation-heading": 0.4373801024398298, "set_robot_commands": 0.08716030120849609, "deviation-center-line": 0.11261393365794942, "driven_lanedir_consec": 0.16363354821873077, "sim_compute_sim_state": 0.038523015975952146, "sim_compute_performance-ego": 0.06781340599060058, "sim_compute_robot_state-ego": 0.07347149848937988, "sim_compute_robot_state-npc0": 0.06602313995361328, "sim_compute_robot_state-npc1": 0.06296246528625488, "sim_compute_robot_state-npc2": 0.0622218132019043, "sim_compute_robot_state-npc3": 0.06600969314575195}, "udem1-3-0": {"driven_any": 0.16642043959668368, "sim_physics": 0.21113449096679687, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13487665729593457, "sim_render-ego": 0.06617709159851075, "in-drivable-lane": 0, "agent_compute-ego": 0.16947630882263184, "deviation-heading": 0.5109010353914598, "set_robot_commands": 0.0897713565826416, "deviation-center-line": 0.10736284269551488, "driven_lanedir_consec": 0.13487665729593457, "sim_compute_sim_state": 0.037936191558837894, "sim_compute_performance-ego": 0.06672269821166993, "sim_compute_robot_state-ego": 0.08328328132629395, "sim_compute_robot_state-npc0": 0.06788670539855957, "sim_compute_robot_state-npc1": 0.0644350528717041, "sim_compute_robot_state-npc2": 0.06335843086242676, "sim_compute_robot_state-npc3": 0.062271137237548825}, "udem1-4-0": {"driven_any": 0.14991609321504437, "sim_physics": 0.2053361264142123, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1003252625085762, "sim_render-ego": 0.05950606953014027, "in-drivable-lane": 0, "agent_compute-ego": 0.15542833371595902, "deviation-heading": 0.6987638844609522, "set_robot_commands": 0.08553024855527011, "deviation-center-line": 0.05451821635175491, "driven_lanedir_consec": 0.1003252625085762, "sim_compute_sim_state": 0.0421573899009011, "sim_compute_performance-ego": 0.06838505918329413, "sim_compute_robot_state-ego": 0.06819997050545433, "sim_compute_robot_state-npc0": 0.0660637075250799, "sim_compute_robot_state-npc1": 0.06619884751059792, "sim_compute_robot_state-npc2": 0.07096363197673451, "sim_compute_robot_state-npc3": 0.07140315662730824}, "udem1-5-0": {"driven_any": 0.28007110621056813, "sim_physics": 0.13850387164524625, "survival_time": 1.7500000000000009, "driven_lanedir": 0.2067562456801104, "sim_render-ego": 0.04852980886186872, "in-drivable-lane": 0, "agent_compute-ego": 0.15310047013419015, "deviation-heading": 0.94791127198013, "set_robot_commands": 0.07475220135280064, "deviation-center-line": 0.09819857319933724, "driven_lanedir_consec": 0.2067562456801104, "sim_compute_sim_state": 0.03024789265223912, "sim_compute_performance-ego": 0.04943130356924874, "sim_compute_robot_state-ego": 0.05313466617039272, "sim_compute_robot_state-npc0": 0.05234537124633789, "sim_compute_robot_state-npc1": 0.053537818363734654, "sim_compute_robot_state-npc2": 0.05205169405255999, "sim_compute_robot_state-npc3": 0.05157243864876883}, "udem1-6-0": {"driven_any": 0.1449308162543998, "sim_physics": 0.2355520725250244, "survival_time": 1.1000000000000003, "driven_lanedir": 0.10785108907885776, "sim_render-ego": 0.06068704345009544, "in-drivable-lane": 0, "agent_compute-ego": 0.18579840660095215, "deviation-heading": 0.5276241181076088, "set_robot_commands": 0.08484922755848277, "deviation-center-line": 0.08360544191861158, "driven_lanedir_consec": 0.10785108907885776, "sim_compute_sim_state": 0.03598497130654075, "sim_compute_performance-ego": 0.08184806867079301, "sim_compute_robot_state-ego": 0.07781931486996738, "sim_compute_robot_state-npc0": 0.06035684455524792, "sim_compute_robot_state-npc1": 0.06451882015575063, "sim_compute_robot_state-npc2": 0.062589092688127, "sim_compute_robot_state-npc3": 0.09882928024638785}, "udem1-7-0": {"driven_any": 0.1881170879548005, "sim_physics": 0.21730143290299636, "survival_time": 1.3000000000000005, "driven_lanedir": 0.15205239869563014, "sim_render-ego": 0.06631347766289344, "in-drivable-lane": 0, "agent_compute-ego": 0.1787296166786781, "deviation-heading": 0.5528147265350744, "set_robot_commands": 0.10027300394498384, "deviation-center-line": 0.10117560760183122, "driven_lanedir_consec": 0.15205239869563014, "sim_compute_sim_state": 0.04124137071462778, "sim_compute_performance-ego": 0.07233170362619254, "sim_compute_robot_state-ego": 0.07881722083458534, "sim_compute_robot_state-npc0": 0.06970692597902738, "sim_compute_robot_state-npc1": 0.07159142310802753, "sim_compute_robot_state-npc2": 0.07072402880742, "sim_compute_robot_state-npc3": 0.06863686671623817}, "udem1-8-0": {"driven_any": 0.23920496220878856, "sim_physics": 0.20028194304435484, "survival_time": 1.5500000000000007, "driven_lanedir": 0.17655627353083947, "sim_render-ego": 0.06095598589989447, "in-drivable-lane": 0, "agent_compute-ego": 0.15968458114131803, "deviation-heading": 0.786157493154267, "set_robot_commands": 0.0933083257367534, "deviation-center-line": 0.06402934126263829, "driven_lanedir_consec": 0.17655627353083947, "sim_compute_sim_state": 0.04134562707716419, "sim_compute_performance-ego": 0.06520863502256331, "sim_compute_robot_state-ego": 0.07337607875947029, "sim_compute_robot_state-npc0": 0.06486282040995936, "sim_compute_robot_state-npc1": 0.06638474618234942, "sim_compute_robot_state-npc2": 0.06605490561454527, "sim_compute_robot_state-npc3": 0.06688547903491605}, "udem1-9-0": {"driven_any": 0.18024741724286616, "sim_physics": 0.20129212049337533, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1104881292730131, "sim_render-ego": 0.05873758976276104, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16785922417273888, "deviation-heading": 0.8473445623984381, "set_robot_commands": 0.09174740314483644, "deviation-center-line": 0.05826237887534931, "driven_lanedir_consec": 0.1104881292730131, "sim_compute_sim_state": 0.03584491289578951, "sim_compute_performance-ego": 0.06221193533677321, "sim_compute_robot_state-ego": 0.07036058719341572, "sim_compute_robot_state-npc0": 0.06262434445894681, "sim_compute_robot_state-npc1": 0.0606230038862962, "sim_compute_robot_state-npc2": 0.060671549576979414, "sim_compute_robot_state-npc3": 0.05996836148775541}, "udem1-10-0": {"driven_any": 0.15798818541595136, "sim_physics": 0.19105988199060617, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09933152372287311, "sim_render-ego": 0.06220794807780872, "in-drivable-lane": 0, "agent_compute-ego": 0.16753902218558572, "deviation-heading": 0.7602820761914708, "set_robot_commands": 0.0933679992502386, "deviation-center-line": 0.05231169064260295, "driven_lanedir_consec": 0.09933152372287311, "sim_compute_sim_state": 0.03549266945232044, "sim_compute_performance-ego": 0.06332627209750089, "sim_compute_robot_state-ego": 0.06802324815229936, "sim_compute_robot_state-npc0": 0.0679442665793679, "sim_compute_robot_state-npc1": 0.07029416344382546, "sim_compute_robot_state-npc2": 0.06319348378614946, "sim_compute_robot_state-npc3": 0.0638445182280107}, "udem1-11-0": {"driven_any": 0.16312973523126456, "sim_physics": 0.15451682697642932, "survival_time": 1.1000000000000003, "driven_lanedir": 0.1371598542005299, "sim_render-ego": 0.05602303418246182, "in-drivable-lane": 0, "agent_compute-ego": 0.13757304711775345, "deviation-heading": 0.4449012050557953, "set_robot_commands": 0.07747678323225542, "deviation-center-line": 0.09959085088620726, "driven_lanedir_consec": 0.1371598542005299, "sim_compute_sim_state": 0.02816571972586892, "sim_compute_performance-ego": 0.05658142133192583, "sim_compute_robot_state-ego": 0.06233693252910267, "sim_compute_robot_state-npc0": 0.05613564361225475, "sim_compute_robot_state-npc1": 0.05458421056920832, "sim_compute_robot_state-npc2": 0.053262309594587845, "sim_compute_robot_state-npc3": 0.05088052966377952}, "udem1-12-0": {"driven_any": 0.28053613392423, "sim_physics": 0.18895691633224487, "survival_time": 1.800000000000001, "driven_lanedir": 0.1888935037178869, "sim_render-ego": 0.05913208590613471, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.15931777821646798, "deviation-heading": 0.895955649658398, "set_robot_commands": 0.07940828800201416, "deviation-center-line": 0.10491426239839526, "driven_lanedir_consec": 0.1888935037178869, "sim_compute_sim_state": 0.03285072909461127, "sim_compute_performance-ego": 0.05963895055982801, "sim_compute_robot_state-ego": 0.06202723582585653, "sim_compute_robot_state-npc0": 0.055852923128339976, "sim_compute_robot_state-npc1": 0.058699230353037514, "sim_compute_robot_state-npc2": 0.056205418374803334, "sim_compute_robot_state-npc3": 0.05467958582772149}, "udem1-13-0": {"driven_any": 0.1464734232978125, "sim_physics": 0.19727246327833697, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11759590043772584, "sim_render-ego": 0.055433002385226166, "in-drivable-lane": 0, "agent_compute-ego": 0.17048739303242078, "deviation-heading": 0.459152378083727, "set_robot_commands": 0.09765049544247714, "deviation-center-line": 0.0878648127007144, "driven_lanedir_consec": 0.11759590043772584, "sim_compute_sim_state": 0.03930010578849099, "sim_compute_performance-ego": 0.06211214715784246, "sim_compute_robot_state-ego": 0.06721818447113037, "sim_compute_robot_state-npc0": 0.07040354338559238, "sim_compute_robot_state-npc1": 0.06630426103418524, "sim_compute_robot_state-npc2": 0.06684204665097324, "sim_compute_robot_state-npc3": 0.07060130075974898}, "udem1-14-0": {"driven_any": 0.18832831792784943, "sim_physics": 0.19635727670457628, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1492856423356812, "sim_render-ego": 0.060224727348045064, "in-drivable-lane": 0, "agent_compute-ego": 0.16643022607873986, "deviation-heading": 0.622203568333533, "set_robot_commands": 0.1020048635977286, "deviation-center-line": 0.09292786499235496, "driven_lanedir_consec": 0.1492856423356812, "sim_compute_sim_state": 0.03748536992956091, "sim_compute_performance-ego": 0.06627879319367586, "sim_compute_robot_state-ego": 0.07196825521963614, "sim_compute_robot_state-npc0": 0.07367396354675293, "sim_compute_robot_state-npc1": 0.06801936361524794, "sim_compute_robot_state-npc2": 0.06457308486655906, "sim_compute_robot_state-npc3": 0.06544495511938024}}
set_robot_commands_max0.1020048635977286
set_robot_commands_mean0.08917466968414513
set_robot_commands_median0.0897713565826416
set_robot_commands_min0.07475220135280064
sim_compute_performance-ego_max0.08184806867079301
sim_compute_performance-ego_mean0.0650566492446054
sim_compute_performance-ego_median0.06520863502256331
sim_compute_performance-ego_min0.04943130356924874
sim_compute_robot_state-ego_max0.08328328132629395
sim_compute_robot_state-ego_mean0.07023914909993634
sim_compute_robot_state-ego_median0.07070011358994704
sim_compute_robot_state-ego_min0.05313466617039272
sim_compute_robot_state-npc0_max0.07367396354675293
sim_compute_robot_state-npc0_mean0.06452498201252603
sim_compute_robot_state-npc0_median0.06602313995361328
sim_compute_robot_state-npc0_min0.05234537124633789
sim_compute_robot_state-npc1_max0.07159142310802753
sim_compute_robot_state-npc1_mean0.06407232657651536
sim_compute_robot_state-npc1_median0.06569979741023137
sim_compute_robot_state-npc1_min0.053537818363734654
sim_compute_robot_state-npc2_max0.07096363197673451
sim_compute_robot_state-npc2_mean0.06265111971698706
sim_compute_robot_state-npc2_median0.06319348378614946
sim_compute_robot_state-npc2_min0.05205169405255999
sim_compute_robot_state-npc3_max0.09882928024638785
sim_compute_robot_state-npc3_mean0.06514795555221305
sim_compute_robot_state-npc3_median0.06502033196962796
sim_compute_robot_state-npc3_min0.05088052966377952
sim_compute_sim_state_max0.0421573899009011
sim_compute_sim_state_mean0.03683440475436746
sim_compute_sim_state_median0.03748536992956091
sim_compute_sim_state_min0.02816571972586892
sim_physics_max0.2689271890200101
sim_physics_mean0.20202450428617352
sim_physics_median0.20028194304435484
sim_physics_min0.13850387164524625
sim_render-ego_max0.06631347766289344
sim_render-ego_mean0.05967909632002038
sim_render-ego_median0.060224727348045064
sim_render-ego_min0.04852980886186872
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.323333333333334
survival_time_min1.1000000000000003
240483845kene4192kene-template-randomaido2-LFVI-sim-testing-offseasonstep1-simulationerroryes12920:10:57
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240433836Philippe LaferrièrePredictorLastaido2-PREDstep1-simulationsuccessyes12920:00:28(hidden)
error_L10.1134056246363382
error_L20.020543502496268455


240413827movehoonchallenge-aido_LF-template-pytorchaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12920:07:52(hidden)
driven_lanedir_consec_median0.09853991077945869
survival_time_median1.3000000000000005
deviation-center-line_median0.07278338816431716
in-drivable-lane_median0.05000000000000005


other stats
agent_compute-ego_max0.13545525074005127
agent_compute-ego_mean0.1246676366144208
agent_compute-ego_median0.12817369699478148
agent_compute-ego_min0.10521774456418792
deviation-center-line_max0.11575411683258724
deviation-center-line_mean0.07287303182326406
deviation-center-line_min0.03477991694866784
deviation-heading_max0.9321483401134256
deviation-heading_mean0.6714893475414192
deviation-heading_median0.6793494373621005
deviation-heading_min0.392317376911526
driven_any_max0.21361167422931532
driven_any_mean0.1641776858945669
driven_any_median0.16475358325407058
driven_any_min0.1076250695166834
driven_lanedir_consec_max0.15446570437600782
driven_lanedir_consec_mean0.09964816406830242
driven_lanedir_consec_min0.06646211710974725
driven_lanedir_max0.15446570437600782
driven_lanedir_mean0.09964816406830242
driven_lanedir_median0.09853991077945869
driven_lanedir_min0.06646211710974725
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.10000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21361167422931532, "sim_physics": 0.08272887678707347, "survival_time": 1.7000000000000008, "driven_lanedir": 0.06646211710974725, "sim_render-ego": 0.04861913007848403, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.13545525074005127, "deviation-heading": 0.6752071176558541, "set_robot_commands": 0.07354937581455007, "deviation-center-line": 0.05856314138961787, "driven_lanedir_consec": 0.06646211710974725, "sim_compute_sim_state": 0.029696892289554373, "sim_compute_performance-ego": 0.0501942424213185, "sim_compute_robot_state-ego": 0.050756216049194336}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.168720742680579, "sim_physics": 0.0825040170124599, "survival_time": 1.4000000000000006, "driven_lanedir": 0.08211406685946765, "sim_render-ego": 0.04629279885973249, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.12997389691216604, "deviation-heading": 0.6795917279335619, "set_robot_commands": 0.08368198360715594, "deviation-center-line": 0.03477991694866784, "driven_lanedir_consec": 0.08211406685946765, "sim_compute_sim_state": 0.030511345182146345, "sim_compute_performance-ego": 0.05162380422864642, "sim_compute_robot_state-ego": 0.05539630992071969}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.13592775682666047, "sim_physics": 0.08166595697402954, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1071275341837774, "sim_render-ego": 0.04345148801803589, "in-drivable-lane": 0, "agent_compute-ego": 0.12817369699478148, "deviation-heading": 0.49705251497530345, "set_robot_commands": 0.07601308822631836, "deviation-center-line": 0.0936563504252406, "driven_lanedir_consec": 0.1071275341837774, "sim_compute_sim_state": 0.027845215797424317, "sim_compute_performance-ego": 0.0474449634552002, "sim_compute_robot_state-ego": 0.04770184755325317}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18584729875645828, "sim_physics": 0.08405514863821176, "survival_time": 1.3000000000000005, "driven_lanedir": 0.0993768499335741, "sim_render-ego": 0.04407639686877911, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12020298150869516, "deviation-heading": 0.8756731253994221, "set_robot_commands": 0.06453315111306998, "deviation-center-line": 0.0655501080445978, "driven_lanedir_consec": 0.0993768499335741, "sim_compute_sim_state": 0.02779349913963905, "sim_compute_performance-ego": 0.050340744165273815, "sim_compute_robot_state-ego": 0.052060301487262435}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1953388582881024, "sim_physics": 0.08071158672201223, "survival_time": 1.4500000000000006, "driven_lanedir": 0.11167554690566694, "sim_render-ego": 0.050895320958104624, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.12948978358301624, "deviation-heading": 0.7088073994112413, "set_robot_commands": 0.0754426018945102, "deviation-center-line": 0.05037038883056152, "driven_lanedir_consec": 0.11167554690566694, "sim_compute_sim_state": 0.030752650622663823, "sim_compute_performance-ego": 0.048421333576070855, "sim_compute_robot_state-ego": 0.052400778079855034}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.19133773776132343, "sim_physics": 0.08001810770768386, "survival_time": 1.3000000000000005, "driven_lanedir": 0.09619843846010134, "sim_render-ego": 0.04685034201695369, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12866279712090126, "deviation-heading": 0.9321483401134256, "set_robot_commands": 0.06835561532240647, "deviation-center-line": 0.07580912950287826, "driven_lanedir_consec": 0.09619843846010134, "sim_compute_sim_state": 0.03059562352987436, "sim_compute_performance-ego": 0.05482347194965069, "sim_compute_robot_state-ego": 0.05370264786940355}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.19713290317072696, "sim_physics": 0.0791018179484776, "survival_time": 1.4000000000000006, "driven_lanedir": 0.15446570437600782, "sim_render-ego": 0.04446329389299665, "in-drivable-lane": 0, "agent_compute-ego": 0.11633963244301931, "deviation-heading": 0.6742409540091541, "set_robot_commands": 0.0675654411315918, "deviation-center-line": 0.10088184901270492, "driven_lanedir_consec": 0.15446570437600782, "sim_compute_sim_state": 0.026526595864977156, "sim_compute_performance-ego": 0.047887367861611504, "sim_compute_robot_state-ego": 0.04885802098682949}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.1076250695166834, "sim_physics": 0.07416939735412598, "survival_time": 0.9500000000000004, "driven_lanedir": 0.07346733252519844, "sim_render-ego": 0.050861747641312446, "in-drivable-lane": 0, "agent_compute-ego": 0.12757224785654167, "deviation-heading": 0.5536005323435644, "set_robot_commands": 0.07286376702158075, "deviation-center-line": 0.08096847263704883, "driven_lanedir_consec": 0.07346733252519844, "sim_compute_sim_state": 0.03057149836891576, "sim_compute_performance-ego": 0.0535248831698769, "sim_compute_robot_state-ego": 0.05379227588051244}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.16475358325407058, "sim_physics": 0.07681849369635949, "survival_time": 1.3000000000000005, "driven_lanedir": 0.10477575797079997, "sim_render-ego": 0.04179925184983473, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.12691367589510405, "deviation-heading": 0.6925177095610329, "set_robot_commands": 0.0788108568925124, "deviation-center-line": 0.048603917916147925, "driven_lanedir_consec": 0.10477575797079997, "sim_compute_sim_state": 0.029417734879713792, "sim_compute_performance-ego": 0.046737762597891, "sim_compute_robot_state-ego": 0.04919348313258244}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11832924911584897, "sim_physics": 0.08576639838840651, "survival_time": 1.1500000000000004, "driven_lanedir": 0.07154564918534634, "sim_render-ego": 0.05020324043605639, "in-drivable-lane": 0, "agent_compute-ego": 0.13354703654413638, "deviation-heading": 0.6793494373621005, "set_robot_commands": 0.07725259532099185, "deviation-center-line": 0.08041326071935247, "driven_lanedir_consec": 0.07154564918534634, "sim_compute_sim_state": 0.03276867451875106, "sim_compute_performance-ego": 0.050776066987410835, "sim_compute_robot_state-ego": 0.05293385878853176}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.14285644881769605, "sim_physics": 0.07725795455600905, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11112680923832108, "sim_render-ego": 0.04266662183015243, "in-drivable-lane": 0, "agent_compute-ego": 0.11548063029413638, "deviation-heading": 0.5048470766573037, "set_robot_commands": 0.06669354438781738, "deviation-center-line": 0.10340747884493988, "driven_lanedir_consec": 0.11112680923832108, "sim_compute_sim_state": 0.02458144270855447, "sim_compute_performance-ego": 0.045714678971663765, "sim_compute_robot_state-ego": 0.04743417449619459}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.14104348546622464, "sim_physics": 0.09335608067719832, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09478783032320226, "sim_render-ego": 0.049534331197324005, "in-drivable-lane": 0, "agent_compute-ego": 0.13199357364488684, "deviation-heading": 0.6604787843909117, "set_robot_commands": 0.07430207211038341, "deviation-center-line": 0.07278338816431716, "driven_lanedir_consec": 0.09478783032320226, "sim_compute_sim_state": 0.03067615757817807, "sim_compute_performance-ego": 0.052826394205508026, "sim_compute_robot_state-ego": 0.05613565444946289}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.1905387201139992, "sim_physics": 0.07421320060203815, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09853991077945869, "sim_render-ego": 0.04072509962936927, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.10521774456418792, "deviation-heading": 0.7398436384456799, "set_robot_commands": 0.06369448530262914, "deviation-center-line": 0.056224096421286535, "driven_lanedir_consec": 0.09853991077945869, "sim_compute_sim_state": 0.02532313609945363, "sim_compute_performance-ego": 0.04485001235172666, "sim_compute_robot_state-ego": 0.04689782241295124}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.15087571537709227, "sim_physics": 0.08077092170715332, "survival_time": 1.2500000000000004, "driven_lanedir": 0.0880338508168923, "sim_render-ego": 0.04673678398132324, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1325953197479248, "deviation-heading": 0.8066644779512048, "set_robot_commands": 0.07094217300415039, "deviation-center-line": 0.05532986165901217, "driven_lanedir_consec": 0.0880338508168923, "sim_compute_sim_state": 0.03169510841369629, "sim_compute_performance-ego": 0.04797802925109863, "sim_compute_robot_state-ego": 0.05175393104553223}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.15872604504372284, "sim_physics": 0.07145138408826746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.13502506235697442, "sim_render-ego": 0.04221897539885148, "in-drivable-lane": 0, "agent_compute-ego": 0.10839628136676292, "deviation-heading": 0.392317376911526, "set_robot_commands": 0.060012921043064285, "deviation-center-line": 0.11575411683258724, "driven_lanedir_consec": 0.13502506235697442, "sim_compute_sim_state": 0.024806592775427776, "sim_compute_performance-ego": 0.047549019689145294, "sim_compute_robot_state-ego": 0.049333292505015496}}
set_robot_commands_max0.08368198360715594
set_robot_commands_mean0.07158091147951548
set_robot_commands_median0.07286376702158075
set_robot_commands_min0.060012921043064285
sim_compute_performance-ego_max0.05482347194965069
sim_compute_performance-ego_mean0.049379518325472875
sim_compute_performance-ego_median0.048421333576070855
sim_compute_performance-ego_min0.04485001235172666
sim_compute_robot_state-ego_max0.05613565444946289
sim_compute_robot_state-ego_mean0.05122337431048672
sim_compute_robot_state-ego_median0.05175393104553223
sim_compute_robot_state-ego_min0.04689782241295124
sim_compute_sim_state_max0.03276867451875106
sim_compute_sim_state_mean0.02890414451793135
sim_compute_sim_state_median0.029696892289554373
sim_compute_sim_state_min0.02458144270855447
sim_physics_max0.09335608067719832
sim_physics_mean0.08030595619063377
sim_physics_median0.08071158672201223
sim_physics_min0.07145138408826746
sim_render-ego_max0.050895320958104624
sim_render-ego_mean0.045959654843820696
sim_render-ego_median0.04629279885973249
sim_render-ego_min0.04072509962936927
simulation-passed1
survival_time_max1.7000000000000008
survival_time_mean1.273333333333334
survival_time_min0.9500000000000004
240393833movehoonchallenge-aido_LF-template-pytorchaido2-LFVI-sim-testing-offseasonstep1-simulationsuccessyes12920:14:46(hidden)
driven_lanedir_consec_median0.0875803973752296
survival_time_median1.2500000000000004
deviation-center-line_median0.0700468629145065
in-drivable-lane_median0.15000000000000013


other stats
agent_compute-ego_max0.18732131004333497
agent_compute-ego_mean0.15620000858285665
agent_compute-ego_median0.15278907255692917
agent_compute-ego_min0.12169053337790749
deviation-center-line_max0.09508646653274742
deviation-center-line_mean0.06894959871776825
deviation-center-line_min0.039189881310697346
deviation-heading_max0.820892512143236
deviation-heading_mean0.6714219507387233
deviation-heading_median0.6984518885029765
deviation-heading_min0.4866475290309002
driven_any_max0.26828136803138736
driven_any_mean0.16823814545126686
driven_any_median0.15228728099063116
driven_any_min0.1137382727048478
driven_lanedir_consec_max0.12236725100266543
driven_lanedir_consec_mean0.08829116530307837
driven_lanedir_consec_min0.06204846139059139
driven_lanedir_max0.12236725100266543
driven_lanedir_mean0.08829116530307837
driven_lanedir_median0.0875803973752296
driven_lanedir_min0.06204846139059139
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.21333333333333349
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.21964728004749645, "sim_physics": 0.1456470200509736, "survival_time": 1.6500000000000008, "driven_lanedir": 0.07292538366783252, "sim_render-ego": 0.05651362014539314, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.12169053337790749, "deviation-heading": 0.7410483135911415, "set_robot_commands": 0.06602720058325565, "deviation-center-line": 0.0618240182177843, "driven_lanedir_consec": 0.07292538366783252, "sim_compute_sim_state": 0.028396750941421047, "sim_compute_performance-ego": 0.05332561695214474, "sim_compute_robot_state-ego": 0.05436304121306448, "sim_compute_robot_state-npc0": 0.05066625999681877, "sim_compute_robot_state-npc1": 0.048656434723825165, "sim_compute_robot_state-npc2": 0.049198793642448654, "sim_compute_robot_state-npc3": 0.052028742703524505}, "udem1-1-0": {"driven_any": 0.2076793136258609, "sim_physics": 0.1615874543786049, "survival_time": 1.6000000000000008, "driven_lanedir": 0.06204846139059139, "sim_render-ego": 0.04926791042089462, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.135684996843338, "deviation-heading": 0.8023503534686567, "set_robot_commands": 0.09027715772390366, "deviation-center-line": 0.055804997410965826, "driven_lanedir_consec": 0.06204846139059139, "sim_compute_sim_state": 0.029538296163082123, "sim_compute_performance-ego": 0.051372647285461426, "sim_compute_robot_state-ego": 0.0529678538441658, "sim_compute_robot_state-npc0": 0.053115084767341614, "sim_compute_robot_state-npc1": 0.05123989284038544, "sim_compute_robot_state-npc2": 0.05194102227687836, "sim_compute_robot_state-npc3": 0.05168857425451279}, "udem1-2-0": {"driven_any": 0.12714798694228982, "sim_physics": 0.2329187826676802, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09701676997898724, "sim_render-ego": 0.06100183183496648, "in-drivable-lane": 0, "agent_compute-ego": 0.1668626286766746, "deviation-heading": 0.4866475290309002, "set_robot_commands": 0.09903443943370473, "deviation-center-line": 0.09467420699855696, "driven_lanedir_consec": 0.09701676997898724, "sim_compute_sim_state": 0.03814082795923406, "sim_compute_performance-ego": 0.06738100268624046, "sim_compute_robot_state-ego": 0.06784170324152167, "sim_compute_robot_state-npc0": 0.06590196219357577, "sim_compute_robot_state-npc1": 0.06168300455266779, "sim_compute_robot_state-npc2": 0.06296241283416748, "sim_compute_robot_state-npc3": 0.06366568261926825}, "udem1-3-0": {"driven_any": 0.13254063345252473, "sim_physics": 0.19889243789341135, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09377046023372282, "sim_render-ego": 0.061135903648708176, "in-drivable-lane": 0, "agent_compute-ego": 0.1651875350786292, "deviation-heading": 0.5530149740540866, "set_robot_commands": 0.08789715559586235, "deviation-center-line": 0.09383057539989138, "driven_lanedir_consec": 0.09377046023372282, "sim_compute_sim_state": 0.03422159733979598, "sim_compute_performance-ego": 0.06644332927206288, "sim_compute_robot_state-ego": 0.07071801890497623, "sim_compute_robot_state-npc0": 0.0577160586481509, "sim_compute_robot_state-npc1": 0.05770523651786472, "sim_compute_robot_state-npc2": 0.058158833047618035, "sim_compute_robot_state-npc3": 0.0626748333806577}, "udem1-4-0": {"driven_any": 0.14232408895994345, "sim_physics": 0.18279642860094705, "survival_time": 1.2000000000000004, "driven_lanedir": 0.07725314077315204, "sim_render-ego": 0.05389846364657084, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.1516252557436625, "deviation-heading": 0.6984518885029765, "set_robot_commands": 0.08974496523539226, "deviation-center-line": 0.043198665313520415, "driven_lanedir_consec": 0.07725314077315204, "sim_compute_sim_state": 0.044597903887430825, "sim_compute_performance-ego": 0.058204869429270424, "sim_compute_robot_state-ego": 0.06511951486269633, "sim_compute_robot_state-npc0": 0.0643464724222819, "sim_compute_robot_state-npc1": 0.06483180324236552, "sim_compute_robot_state-npc2": 0.06584805250167847, "sim_compute_robot_state-npc3": 0.06765297055244446}, "udem1-5-0": {"driven_any": 0.26828136803138736, "sim_physics": 0.1696488857269287, "survival_time": 1.900000000000001, "driven_lanedir": 0.12236725100266543, "sim_render-ego": 0.058410700998808206, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15802847084246183, "deviation-heading": 0.7656040145210071, "set_robot_commands": 0.08777858709034167, "deviation-center-line": 0.0618915661559995, "driven_lanedir_consec": 0.12236725100266543, "sim_compute_sim_state": 0.03586073925620631, "sim_compute_performance-ego": 0.06539743197591681, "sim_compute_robot_state-ego": 0.062855275053727, "sim_compute_robot_state-npc0": 0.06102002294440018, "sim_compute_robot_state-npc1": 0.06452130016527678, "sim_compute_robot_state-npc2": 0.06220970655742444, "sim_compute_robot_state-npc3": 0.06310228297584936}, "udem1-6-0": {"driven_any": 0.12107310443760257, "sim_physics": 0.2010809833353216, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07923656320654837, "sim_render-ego": 0.04924952983856201, "in-drivable-lane": 0, "agent_compute-ego": 0.15046154369007458, "deviation-heading": 0.6256036906134279, "set_robot_commands": 0.101183067668568, "deviation-center-line": 0.08215905224958883, "driven_lanedir_consec": 0.07923656320654837, "sim_compute_sim_state": 0.031745379621332344, "sim_compute_performance-ego": 0.06378112056038597, "sim_compute_robot_state-ego": 0.06399436430497603, "sim_compute_robot_state-npc0": 0.05780153924768621, "sim_compute_robot_state-npc1": 0.06073935465379195, "sim_compute_robot_state-npc2": 0.060646468942815605, "sim_compute_robot_state-npc3": 0.05845153331756592}, "udem1-7-0": {"driven_any": 0.14177101726346522, "sim_physics": 0.1957597827911377, "survival_time": 1.2500000000000004, "driven_lanedir": 0.09802409114952848, "sim_render-ego": 0.05447254180908203, "in-drivable-lane": 0, "agent_compute-ego": 0.15179090499877929, "deviation-heading": 0.6539091444323728, "set_robot_commands": 0.0767740821838379, "deviation-center-line": 0.09508646653274742, "driven_lanedir_consec": 0.09802409114952848, "sim_compute_sim_state": 0.03428807258605957, "sim_compute_performance-ego": 0.06560992240905762, "sim_compute_robot_state-ego": 0.06618973731994629, "sim_compute_robot_state-npc0": 0.06456689834594727, "sim_compute_robot_state-npc1": 0.06326815605163574, "sim_compute_robot_state-npc2": 0.060074567794799805, "sim_compute_robot_state-npc3": 0.06312380790710449}, "udem1-8-0": {"driven_any": 0.17726655883854228, "sim_physics": 0.2159534352166312, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09397084469055894, "sim_render-ego": 0.06370701960154943, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17165340696062362, "deviation-heading": 0.7156416320637832, "set_robot_commands": 0.09805214405059814, "deviation-center-line": 0.043432952085162374, "driven_lanedir_consec": 0.09397084469055894, "sim_compute_sim_state": 0.04001978465488979, "sim_compute_performance-ego": 0.06868041413170951, "sim_compute_robot_state-ego": 0.07522621325084142, "sim_compute_robot_state-npc0": 0.06805912937436785, "sim_compute_robot_state-npc1": 0.06568828650883266, "sim_compute_robot_state-npc2": 0.06505283287593297, "sim_compute_robot_state-npc3": 0.0676182849066598}, "udem1-9-0": {"driven_any": 0.18625075454587595, "sim_physics": 0.20379608677279565, "survival_time": 1.5500000000000007, "driven_lanedir": 0.07941037782272531, "sim_render-ego": 0.06616297075825353, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.16511444122560562, "deviation-heading": 0.7432629932199054, "set_robot_commands": 0.09057555660124748, "deviation-center-line": 0.039189881310697346, "driven_lanedir_consec": 0.07941037782272531, "sim_compute_sim_state": 0.03963921916100287, "sim_compute_performance-ego": 0.06713443417702952, "sim_compute_robot_state-ego": 0.07328319549560547, "sim_compute_robot_state-npc0": 0.06648247472701534, "sim_compute_robot_state-npc1": 0.06921885090489541, "sim_compute_robot_state-npc2": 0.06948541056725287, "sim_compute_robot_state-npc3": 0.06753320078695974}, "udem1-10-0": {"driven_any": 0.15228728099063116, "sim_physics": 0.2053448486328125, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07199054957869522, "sim_render-ego": 0.06352425575256347, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.18732131004333497, "deviation-heading": 0.820892512143236, "set_robot_commands": 0.09475714683532716, "deviation-center-line": 0.04363819196188982, "driven_lanedir_consec": 0.07199054957869522, "sim_compute_sim_state": 0.03637958526611328, "sim_compute_performance-ego": 0.06818182945251465, "sim_compute_robot_state-ego": 0.07114643096923828, "sim_compute_robot_state-npc0": 0.06919716835021973, "sim_compute_robot_state-npc1": 0.06429437637329101, "sim_compute_robot_state-npc2": 0.060930910110473635, "sim_compute_robot_state-npc3": 0.0658583927154541}, "udem1-11-0": {"driven_any": 0.11818738675429058, "sim_physics": 0.18143458366394044, "survival_time": 1.0000000000000002, "driven_lanedir": 0.0875803973752296, "sim_render-ego": 0.06034750938415527, "in-drivable-lane": 0, "agent_compute-ego": 0.14915773868560792, "deviation-heading": 0.501607121056961, "set_robot_commands": 0.08621410131454468, "deviation-center-line": 0.08760017941622678, "driven_lanedir_consec": 0.0875803973752296, "sim_compute_sim_state": 0.049074649810791016, "sim_compute_performance-ego": 0.058039617538452146, "sim_compute_robot_state-ego": 0.06144459247589111, "sim_compute_robot_state-npc0": 0.06478822231292725, "sim_compute_robot_state-npc1": 0.06416499614715576, "sim_compute_robot_state-npc2": 0.06150155067443848, "sim_compute_robot_state-npc3": 0.05852639675140381}, "udem1-12-0": {"driven_any": 0.2551390754805052, "sim_physics": 0.1872230554238344, "survival_time": 1.950000000000001, "driven_lanedir": 0.11422975411350644, "sim_render-ego": 0.05890489847232134, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.15213899734692696, "deviation-heading": 0.6336228034581314, "set_robot_commands": 0.0857234184558575, "deviation-center-line": 0.0700468629145065, "driven_lanedir_consec": 0.11422975411350644, "sim_compute_sim_state": 0.034622284082266, "sim_compute_performance-ego": 0.06533550604795799, "sim_compute_robot_state-ego": 0.0659014628483699, "sim_compute_robot_state-npc0": 0.06601332395504682, "sim_compute_robot_state-npc1": 0.06119062961676182, "sim_compute_robot_state-npc2": 0.06208405127892128, "sim_compute_robot_state-npc3": 0.06059981003785745}, "udem1-13-0": {"driven_any": 0.1137382727048478, "sim_physics": 0.18840281529860065, "survival_time": 1.1000000000000003, "driven_lanedir": 0.07295281791175068, "sim_render-ego": 0.05758299610831521, "in-drivable-lane": 0, "agent_compute-ego": 0.15278907255692917, "deviation-heading": 0.6268488568642862, "set_robot_commands": 0.09064511819319292, "deviation-center-line": 0.08787713103108766, "driven_lanedir_consec": 0.07295281791175068, "sim_compute_sim_state": 0.03610382296822288, "sim_compute_performance-ego": 0.06289913437583229, "sim_compute_robot_state-ego": 0.06486945802515204, "sim_compute_robot_state-npc0": 0.06250698999925093, "sim_compute_robot_state-npc1": 0.06442808021198619, "sim_compute_robot_state-npc2": 0.06497889215295966, "sim_compute_robot_state-npc3": 0.06519170240922408}, "udem1-14-0": {"driven_any": 0.16023805969373994, "sim_physics": 0.18541241543633596, "survival_time": 1.4000000000000006, "driven_lanedir": 0.10159061665068105, "sim_render-ego": 0.059354339327131, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16349329267229354, "deviation-heading": 0.7028234340599764, "set_robot_commands": 0.08147980485643659, "deviation-center-line": 0.07398923376789888, "driven_lanedir_consec": 0.10159061665068105, "sim_compute_sim_state": 0.03539666959217617, "sim_compute_performance-ego": 0.062476822308131626, "sim_compute_robot_state-ego": 0.06418132781982422, "sim_compute_robot_state-npc0": 0.059438935347965786, "sim_compute_robot_state-npc1": 0.0625983646937779, "sim_compute_robot_state-npc2": 0.060919804232461114, "sim_compute_robot_state-npc3": 0.06104418209620884}}
set_robot_commands_max0.101183067668568
set_robot_commands_mean0.0884109297214714
set_robot_commands_median0.08974496523539226
set_robot_commands_min0.06602720058325565
sim_compute_performance-ego_max0.06868041413170951
sim_compute_performance-ego_mean0.06295091324014454
sim_compute_performance-ego_median0.06533550604795799
sim_compute_performance-ego_min0.051372647285461426
sim_compute_robot_state-ego_max0.07522621325084142
sim_compute_robot_state-ego_mean0.06534014597533308
sim_compute_robot_state-ego_median0.06511951486269633
sim_compute_robot_state-ego_min0.0529678538441658
sim_compute_robot_state-npc0_max0.06919716835021973
sim_compute_robot_state-npc0_mean0.06210803617553308
sim_compute_robot_state-npc0_median0.0643464724222819
sim_compute_robot_state-npc0_min0.05066625999681877
sim_compute_robot_state-npc1_max0.06921885090489541
sim_compute_robot_state-npc1_mean0.061615251146967594
sim_compute_robot_state-npc1_median0.06326815605163574
sim_compute_robot_state-npc1_min0.048656434723825165
sim_compute_robot_state-npc2_max0.06948541056725287
sim_compute_robot_state-npc2_mean0.06106622063268473
sim_compute_robot_state-npc2_median0.06150155067443848
sim_compute_robot_state-npc2_min0.049198793642448654
sim_compute_robot_state-npc3_max0.06765297055244446
sim_compute_robot_state-npc3_mean0.06191735982764635
sim_compute_robot_state-npc3_median0.06310228297584936
sim_compute_robot_state-npc3_min0.05168857425451279
sim_compute_sim_state_max0.049074649810791016
sim_compute_sim_state_mean0.03653503888600162
sim_compute_sim_state_median0.03586073925620631
sim_compute_sim_state_min0.028396750941421047
sim_physics_max0.2329187826676802
sim_physics_mean0.19039326772599707
sim_physics_median0.18840281529860065
sim_physics_min0.1456470200509736
sim_render-ego_max0.06616297075825353
sim_render-ego_mean0.05823563278315165
sim_render-ego_median0.05890489847232134
sim_render-ego_min0.04924952983856201
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3733333333333342
survival_time_min1.0000000000000002
240363828movehoonchallenge-aido_LF-template-pytorchaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:04:49(hidden)
driven_lanedir_consec_median0.08515586115450846
survival_time_median1.6500000000000008
deviation-center-line_median0.051175840509904834
in-drivable-lane_median0.5000000000000004


other stats
agent_compute-ego_max0.1615884644644601
agent_compute-ego_mean0.15082187565890226
agent_compute-ego_median0.1534788247310754
agent_compute-ego_min0.13137833731515067
deviation-center-line_max0.0976586320939753
deviation-center-line_mean0.06095924754271091
deviation-center-line_min0.04308959071166261
deviation-heading_max0.8521299867591798
deviation-heading_mean0.7150531872317982
deviation-heading_median0.7183542298843986
deviation-heading_min0.6060281802559326
driven_any_max0.22131609545252057
driven_any_mean0.18801667374753145
driven_any_median0.20571004262912596
driven_any_min0.1165218747396892
driven_lanedir_consec_max0.10444782094824756
driven_lanedir_consec_mean0.08980237265683211
driven_lanedir_consec_min0.0771454998296095
driven_lanedir_max0.10444782094824756
driven_lanedir_mean0.08980237265683211
driven_lanedir_median0.08515586115450846
driven_lanedir_min0.0771454998296095
in-drivable-lane_max0.5500000000000005
in-drivable-lane_mean0.3300000000000003
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.22131609545252057, "sim_physics": 0.0871865885598319, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08515586115450846, "sim_render-ego": 0.047872373035975864, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.13137833731515067, "deviation-heading": 0.7183542298843986, "set_robot_commands": 0.0764068399156843, "deviation-center-line": 0.06391221603719843, "driven_lanedir_consec": 0.08515586115450846, "sim_compute_sim_state": 0.03191408429827009, "sim_compute_performance-ego": 0.06311344419206892, "sim_compute_robot_state-ego": 0.05610061373029437}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.17642557570413123, "sim_physics": 0.1006557856287275, "survival_time": 1.4000000000000006, "driven_lanedir": 0.0990252488306268, "sim_render-ego": 0.0610115613256182, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1615884644644601, "deviation-heading": 0.7573748235883266, "set_robot_commands": 0.09388384648731776, "deviation-center-line": 0.048959958360813405, "driven_lanedir_consec": 0.0990252488306268, "sim_compute_sim_state": 0.03874353000095913, "sim_compute_performance-ego": 0.06822669506072998, "sim_compute_robot_state-ego": 0.07111593655177526}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1165218747396892, "sim_physics": 0.1138369810013544, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08323743252116822, "sim_render-ego": 0.05746760822477795, "in-drivable-lane": 0, "agent_compute-ego": 0.15090776625133695, "deviation-heading": 0.6060281802559326, "set_robot_commands": 0.08897729147048224, "deviation-center-line": 0.0976586320939753, "driven_lanedir_consec": 0.08323743252116822, "sim_compute_sim_state": 0.03712907291594006, "sim_compute_performance-ego": 0.06295450528462727, "sim_compute_robot_state-ego": 0.06614392144339425}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20571004262912596, "sim_physics": 0.10576826153379498, "survival_time": 1.6500000000000008, "driven_lanedir": 0.0771454998296095, "sim_render-ego": 0.058250600641424, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1534788247310754, "deviation-heading": 0.8521299867591798, "set_robot_commands": 0.08496941219676625, "deviation-center-line": 0.051175840509904834, "driven_lanedir_consec": 0.0771454998296095, "sim_compute_sim_state": 0.03348750779123017, "sim_compute_performance-ego": 0.06173102060953776, "sim_compute_robot_state-ego": 0.06683459426417496}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22010978021219008, "sim_physics": 0.11613928249904087, "survival_time": 1.7500000000000009, "driven_lanedir": 0.10444782094824756, "sim_render-ego": 0.05866314343043736, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.15675598553248815, "deviation-heading": 0.6413787156711532, "set_robot_commands": 0.09011868749346053, "deviation-center-line": 0.04308959071166261, "driven_lanedir_consec": 0.10444782094824756, "sim_compute_sim_state": 0.03629251888820103, "sim_compute_performance-ego": 0.06420403889247349, "sim_compute_robot_state-ego": 0.06816906929016113}}
set_robot_commands_max0.09388384648731776
set_robot_commands_mean0.08687121551274221
set_robot_commands_median0.08897729147048224
set_robot_commands_min0.0764068399156843
sim_compute_performance-ego_max0.06822669506072998
sim_compute_performance-ego_mean0.06404594080788749
sim_compute_performance-ego_median0.06311344419206892
sim_compute_performance-ego_min0.06173102060953776
sim_compute_robot_state-ego_max0.07111593655177526
sim_compute_robot_state-ego_mean0.06567282705595999
sim_compute_robot_state-ego_median0.06683459426417496
sim_compute_robot_state-ego_min0.05610061373029437
sim_compute_sim_state_max0.03874353000095913
sim_compute_sim_state_mean0.0355133427789201
sim_compute_sim_state_median0.03629251888820103
sim_compute_sim_state_min0.03191408429827009
sim_physics_max0.11613928249904087
sim_physics_mean0.10471737984454994
sim_physics_median0.10576826153379498
sim_physics_min0.0871865885598319
sim_render-ego_max0.0610115613256182
sim_render-ego_mean0.05665305733164668
sim_render-ego_median0.058250600641424
sim_render-ego_min0.047872373035975864
simulation-passed1
survival_time_max1.7500000000000009
survival_time_mean1.5200000000000005
survival_time_min1.0500000000000005
240293823Eric LuStudent A043022aido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:12:52(hidden)
driven_lanedir_consec_median-0.7842447419938745
survival_time_median14.950000000000076
deviation-center-line_median0.7593448748215907
in-drivable-lane_median5.500000000000045


other stats
agent_compute-ego_max0.09677886247634888
agent_compute-ego_mean0.09544791491826374
agent_compute-ego_median0.0953039026260376
agent_compute-ego_min0.09455347696940104
deviation-center-line_max1.3912766006209938
deviation-center-line_mean0.8616512040234087
deviation-center-line_min0.26673270483572
deviation-heading_max8.114760811115872
deviation-heading_mean6.873101715551771
deviation-heading_median6.776226158971605
deviation-heading_min5.560369873334478
driven_any_max4.363759853514355
driven_any_mean4.2574798572627675
driven_any_median4.27452094923519
driven_any_min4.034987875731287
driven_lanedir_consec_max-0.4196664417961835
driven_lanedir_consec_mean-0.8736370279897091
driven_lanedir_consec_min-1.374969994699355
driven_lanedir_max-1.3162778246721856
driven_lanedir_mean-1.8953012556002768
driven_lanedir_median-1.7938652535876516
driven_lanedir_min-2.571057763916258
in-drivable-lane_max7.650000000000041
in-drivable-lane_mean5.090000000000034
in-drivable-lane_min2.5500000000000136
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.2638629791922575, "sim_physics": 0.05347385803858439, "survival_time": 14.950000000000076, "driven_lanedir": -1.771562388157243, "sim_render-ego": 0.035513214270273846, "in-drivable-lane": 5.550000000000043, "agent_compute-ego": 0.0952502417564392, "deviation-heading": 6.70577311747521, "set_robot_commands": 0.0546810245513916, "deviation-center-line": 0.702198093390439, "driven_lanedir_consec": -0.4196664417961835, "sim_compute_sim_state": 0.022544771830240885, "sim_compute_performance-ego": 0.03864837328592936, "sim_compute_robot_state-ego": 0.04001734733581543}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.350267628640751, "sim_physics": 0.05561238447825114, "survival_time": 14.950000000000076, "driven_lanedir": -2.571057763916258, "sim_render-ego": 0.035167405605316164, "in-drivable-lane": 2.5500000000000136, "agent_compute-ego": 0.09677886247634888, "deviation-heading": 8.114760811115872, "set_robot_commands": 0.05991046667098999, "deviation-center-line": 1.3912766006209938, "driven_lanedir_consec": -1.374969994699355, "sim_compute_sim_state": 0.022669231096903483, "sim_compute_performance-ego": 0.03878042538960775, "sim_compute_robot_state-ego": 0.04006999095280965}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.363759853514355, "sim_physics": 0.053241286277771, "survival_time": 14.950000000000076, "driven_lanedir": -1.3162778246721856, "sim_render-ego": 0.03493795315424601, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.09455347696940104, "deviation-heading": 5.560369873334478, "set_robot_commands": 0.05464803775151571, "deviation-center-line": 0.26673270483572, "driven_lanedir_consec": -1.3162778246721856, "sim_compute_sim_state": 0.022540887196858723, "sim_compute_performance-ego": 0.03840334256490072, "sim_compute_robot_state-ego": 0.03960770050684611}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.27452094923519, "sim_physics": 0.0550038997332255, "survival_time": 14.950000000000076, "driven_lanedir": -1.7938652535876516, "sim_render-ego": 0.03512762149175008, "in-drivable-lane": 5.500000000000045, "agent_compute-ego": 0.0953039026260376, "deviation-heading": 6.776226158971605, "set_robot_commands": 0.05604676723480224, "deviation-center-line": 0.7593448748215907, "driven_lanedir_consec": -0.4730261367869466, "sim_compute_sim_state": 0.022504760424296066, "sim_compute_performance-ego": 0.03803289572397868, "sim_compute_robot_state-ego": 0.04107101519902547}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.034987875731287, "sim_physics": 0.053964194456736246, "survival_time": 14.950000000000076, "driven_lanedir": -2.0237430476680456, "sim_render-ego": 0.03513992468516032, "in-drivable-lane": 4.200000000000029, "agent_compute-ego": 0.09535309076309204, "deviation-heading": 7.208378616861684, "set_robot_commands": 0.05523855845133464, "deviation-center-line": 1.1887037464483, "driven_lanedir_consec": -0.7842447419938745, "sim_compute_sim_state": 0.02243898868560791, "sim_compute_performance-ego": 0.03828523000081381, "sim_compute_robot_state-ego": 0.03980517307917277}}
set_robot_commands_max0.05991046667098999
set_robot_commands_mean0.05610497093200684
set_robot_commands_median0.05523855845133464
set_robot_commands_min0.05464803775151571
sim_compute_performance-ego_max0.03878042538960775
sim_compute_performance-ego_mean0.03843005339304606
sim_compute_performance-ego_median0.03840334256490072
sim_compute_performance-ego_min0.03803289572397868
sim_compute_robot_state-ego_max0.04107101519902547
sim_compute_robot_state-ego_mean0.04011424541473389
sim_compute_robot_state-ego_median0.04001734733581543
sim_compute_robot_state-ego_min0.03960770050684611
sim_compute_sim_state_max0.022669231096903483
sim_compute_sim_state_mean0.02253972784678141
sim_compute_sim_state_median0.022540887196858723
sim_compute_sim_state_min0.02243898868560791
sim_physics_max0.05561238447825114
sim_physics_mean0.054259124596913656
sim_physics_median0.053964194456736246
sim_physics_min0.053241286277771
sim_render-ego_max0.035513214270273846
sim_render-ego_mean0.03517722384134928
sim_render-ego_median0.03513992468516032
sim_render-ego_min0.03493795315424601
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
240283822Eric LuStudent 0756813aido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:14:29(hidden)
driven_lanedir_consec_median-1.339366254383536
survival_time_median14.950000000000076
deviation-center-line_median1.4012763877174277
in-drivable-lane_median2.500000000000013


other stats
agent_compute-ego_max0.09503714323043824
agent_compute-ego_mean0.0946847817103068
agent_compute-ego_median0.09491835673650106
agent_compute-ego_min0.09387556473414103
deviation-center-line_max1.5195321274571807
deviation-center-line_mean1.1744866247661871
deviation-center-line_min0.26894128230124625
deviation-heading_max8.502617994731205
deviation-heading_mean7.586929268377434
deviation-heading_median8.166880118443581
deviation-heading_min5.592005976497815
driven_any_max4.378506444052817
driven_any_mean4.378506444052766
driven_any_median4.378506444052808
driven_any_min4.378506444052668
driven_lanedir_consec_max-1.3108775667758272
driven_lanedir_consec_mean-1.343008792507249
driven_lanedir_consec_min-1.375791811242245
driven_lanedir_max-1.339366254383536
driven_lanedir_mean-2.354333468541115
driven_lanedir_median-2.597399307713328
driven_lanedir_min-2.7107548643591612
in-drivable-lane_max7.60000000000004
in-drivable-lane_mean3.5700000000000194
in-drivable-lane_min2.150000000000011
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 4.378506444052729, "sim_physics": 0.056204049587249755, "survival_time": 14.950000000000076, "driven_lanedir": -2.7107548643591612, "sim_render-ego": 0.034827849864959716, "in-drivable-lane": 2.150000000000011, "agent_compute-ego": 0.09503714323043824, "deviation-heading": 8.372894374860556, "set_robot_commands": 0.053768206437428794, "deviation-center-line": 1.5195321274571807, "driven_lanedir_consec": -1.3108775667758272, "sim_compute_sim_state": 0.022248427867889404, "sim_compute_performance-ego": 0.03763689041137695, "sim_compute_robot_state-ego": 0.03929269631703695}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.378506444052808, "sim_physics": 0.05273879130681356, "survival_time": 14.950000000000076, "driven_lanedir": -2.4475297684769592, "sim_render-ego": 0.03485749880472819, "in-drivable-lane": 3.400000000000018, "agent_compute-ego": 0.09491835673650106, "deviation-heading": 7.300247877354014, "set_robot_commands": 0.05284985303878784, "deviation-center-line": 1.1660826179431376, "driven_lanedir_consec": -1.375791811242245, "sim_compute_sim_state": 0.02264345089594523, "sim_compute_performance-ego": 0.0378560733795166, "sim_compute_robot_state-ego": 0.039517374833424886}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.37850644405281, "sim_physics": 0.05077322244644165, "survival_time": 14.950000000000076, "driven_lanedir": -1.339366254383536, "sim_render-ego": 0.034558211962382, "in-drivable-lane": 7.60000000000004, "agent_compute-ego": 0.09456005334854126, "deviation-heading": 5.592005976497815, "set_robot_commands": 0.053880064487457274, "deviation-center-line": 0.26894128230124625, "driven_lanedir_consec": -1.339366254383536, "sim_compute_sim_state": 0.022239251136779783, "sim_compute_performance-ego": 0.03765857458114624, "sim_compute_robot_state-ego": 0.039268980820973715}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 4.378506444052817, "sim_physics": 0.05390488227208456, "survival_time": 14.950000000000076, "driven_lanedir": -2.6766171477725886, "sim_render-ego": 0.03488411029179891, "in-drivable-lane": 2.2000000000000126, "agent_compute-ego": 0.09503279050191243, "deviation-heading": 8.502617994731205, "set_robot_commands": 0.05348504066467285, "deviation-center-line": 1.516600708411944, "driven_lanedir_consec": -1.3215500552073598, "sim_compute_sim_state": 0.02224846124649048, "sim_compute_performance-ego": 0.03753826856613159, "sim_compute_robot_state-ego": 0.03930157899856567}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 4.378506444052668, "sim_physics": 0.05428494691848755, "survival_time": 14.950000000000076, "driven_lanedir": -2.597399307713328, "sim_render-ego": 0.03485797961552938, "in-drivable-lane": 2.500000000000013, "agent_compute-ego": 0.09387556473414103, "deviation-heading": 8.166880118443581, "set_robot_commands": 0.05307129224141439, "deviation-center-line": 1.4012763877174277, "driven_lanedir_consec": -1.3674582749272766, "sim_compute_sim_state": 0.02230023701985677, "sim_compute_performance-ego": 0.037710952758789065, "sim_compute_robot_state-ego": 0.03905942042668661}}
set_robot_commands_max0.053880064487457274
set_robot_commands_mean0.05341089137395223
set_robot_commands_median0.05348504066467285
set_robot_commands_min0.05284985303878784
sim_compute_performance-ego_max0.0378560733795166
sim_compute_performance-ego_mean0.037680151939392094
sim_compute_performance-ego_median0.03765857458114624
sim_compute_performance-ego_min0.03753826856613159
sim_compute_robot_state-ego_max0.039517374833424886
sim_compute_robot_state-ego_mean0.039288010279337565
sim_compute_robot_state-ego_median0.03929269631703695
sim_compute_robot_state-ego_min0.03905942042668661
sim_compute_sim_state_max0.02264345089594523
sim_compute_sim_state_mean0.02233596563339233
sim_compute_sim_state_median0.02224846124649048
sim_compute_sim_state_min0.022239251136779783
sim_physics_max0.056204049587249755
sim_physics_mean0.05358117850621541
sim_physics_median0.05390488227208456
sim_physics_min0.05077322244644165
sim_render-ego_max0.03488411029179891
sim_render-ego_mean0.03479713010787964
sim_render-ego_median0.03485749880472819
sim_render-ego_min0.034558211962382
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
240233809AmaurXLet's do this one todayaido2-LF-sim-testing-offseasonstep1-simulationsuccessyes12920:14:23(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.15973213139702291
agent_compute-ego_mean0.14256934625898127
agent_compute-ego_median0.14659096049023912
agent_compute-ego_min0.11010756913353414
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10893855271516024, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06137797567579481, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.15177612834506565, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09485457561634204, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03729135901839645, "sim_compute_performance-ego": 0.07146651215023464, "sim_compute_robot_state-ego": 0.07694454546327945}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10506008653079764, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05545682065627154, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14757839838663736, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08927110597199085, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03574997303532619, "sim_compute_performance-ego": 0.06288462526658002, "sim_compute_robot_state-ego": 0.07639691876430138}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11035463389228373, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05436907095067641, "in-drivable-lane": 0, "agent_compute-ego": 0.12534006904153264, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08706801077898811, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.03861696579877068, "sim_compute_performance-ego": 0.06096469654756434, "sim_compute_robot_state-ego": 0.06949556575101964}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1242861557006836, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.057070980072021486, "in-drivable-lane": 0, "agent_compute-ego": 0.1547385597229004, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09685988426208496, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03717270851135254, "sim_compute_performance-ego": 0.0644914150238037, "sim_compute_robot_state-ego": 0.07243706703186036}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10729149323475512, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06036240541482273, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14088605627228942, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.08902493307862101, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.037447096426275715, "sim_compute_performance-ego": 0.0661162032356745, "sim_compute_robot_state-ego": 0.07223468490793736}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1029530836611378, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.057390358983253946, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.1494741829074159, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.08961862447310467, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.03818649175215741, "sim_compute_performance-ego": 0.06230932839062749, "sim_compute_robot_state-ego": 0.06906392622967156}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.09439063497952052, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.0550321170261928, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.1406604221888951, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.08586227893829346, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.037163998399462016, "sim_compute_performance-ego": 0.059965589216777256, "sim_compute_robot_state-ego": 0.06679316929408483}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.12735958326430546, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06079920132954915, "in-drivable-lane": 0, "agent_compute-ego": 0.15595132963997976, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.0925369489760626, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.03871964272998628, "sim_compute_performance-ego": 0.06798436528160459, "sim_compute_robot_state-ego": 0.07665900957016718}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.11566585201328083, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06178766185954466, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.15372520786220745, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.09942880323377706, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.04237668797121209, "sim_compute_performance-ego": 0.06640203928543349, "sim_compute_robot_state-ego": 0.07376243300357108}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.09775055105035955, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.05573388446461071, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.1344092152335427, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.08658397414467552, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03591122193769975, "sim_compute_performance-ego": 0.05993060198697177, "sim_compute_robot_state-ego": 0.06289222023703835}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.10811615299868892, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.05709393922384683, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.14659096049023912, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.0926281229242102, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.03617402175804237, "sim_compute_performance-ego": 0.06156461579459054, "sim_compute_robot_state-ego": 0.06666508587923917}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.1012524025780814, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.056510397366115024, "in-drivable-lane": 0, "agent_compute-ego": 0.14046270506722586, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.08964816161564418, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.034647626536233087, "sim_compute_performance-ego": 0.06202949796404157, "sim_compute_robot_state-ego": 0.0661494391305106}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.12207667967852424, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.0644844466564702, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.15973213139702291, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.106111302095301, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03919189116534065, "sim_compute_performance-ego": 0.07157088261024624, "sim_compute_robot_state-ego": 0.08035442408393412}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.0947235072100604, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.05293624489395707, "in-drivable-lane": 0, "agent_compute-ego": 0.12710725819623028, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.0789666529054995, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.03218934271070692, "sim_compute_performance-ego": 0.05675713221232096, "sim_compute_robot_state-ego": 0.06447430010195132}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.07137076761208329, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.04204324881235758, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.11010756913353414, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.06927337599735633, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.02842235798929252, "sim_compute_performance-ego": 0.04556251273435705, "sim_compute_robot_state-ego": 0.05009611447652181}}
set_robot_commands_max0.106111302095301
set_robot_commands_mean0.08984911700079676
set_robot_commands_median0.08961862447310467
set_robot_commands_min0.06927337599735633
sim_compute_performance-ego_max0.07157088261024624
sim_compute_performance-ego_mean0.06266666784672187
sim_compute_performance-ego_median0.06230932839062749
sim_compute_performance-ego_min0.04556251273435705
sim_compute_robot_state-ego_max0.08035442408393412
sim_compute_robot_state-ego_mean0.06962792692833922
sim_compute_robot_state-ego_median0.06949556575101964
sim_compute_robot_state-ego_min0.05009611447652181
sim_compute_sim_state_max0.04237668797121209
sim_compute_sim_state_mean0.03661742571601698
sim_compute_sim_state_median0.03717270851135254
sim_compute_sim_state_min0.02842235798929252
sim_physics_max0.12735958326430546
sim_physics_mean0.10610600914131486
sim_physics_median0.10729149323475512
sim_physics_min0.07137076761208329
sim_render-ego_max0.0644844466564702
sim_render-ego_mean0.05682991689236568
sim_render-ego_median0.057070980072021486
sim_render-ego_min0.04204324881235758
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
240223810AmaurXLet's do this one todayaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:26(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17656994819641114
agent_compute-ego_mean0.14602085561384906
agent_compute-ego_median0.1386466247064096
agent_compute-ego_min0.1348127617555506
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.0967915764561406, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.055392715666029185, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1386466247064096, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.08981648197880497, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03628019050315574, "sim_compute_performance-ego": 0.05971178743574354, "sim_compute_robot_state-ego": 0.0641973062797829}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.10455957113527783, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.05944370755962297, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1425000172035367, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.08898366666307636, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03941873943104463, "sim_compute_performance-ego": 0.06802739349066042, "sim_compute_robot_state-ego": 0.06849181885812797}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.11252929182613595, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05378038742963005, "in-drivable-lane": 0, "agent_compute-ego": 0.1348127617555506, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08620201840120204, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.037408127504236555, "sim_compute_performance-ego": 0.06086394366096048, "sim_compute_robot_state-ego": 0.07464780527002671}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13993474960327149, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06347359657287598, "in-drivable-lane": 0, "agent_compute-ego": 0.17656994819641114, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09627043724060058, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04014341354370117, "sim_compute_performance-ego": 0.07151741981506347, "sim_compute_robot_state-ego": 0.08114251136779785}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.1061452823349192, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.05846556530723089, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.1375749262073372, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0847887691063217, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.036324549324904816, "sim_compute_performance-ego": 0.0607283024848262, "sim_compute_robot_state-ego": 0.06613983081865914}}
set_robot_commands_max0.09627043724060058
set_robot_commands_mean0.08921227467800112
set_robot_commands_median0.08898366666307636
set_robot_commands_min0.0847887691063217
sim_compute_performance-ego_max0.07151741981506347
sim_compute_performance-ego_mean0.06416976937745082
sim_compute_performance-ego_median0.06086394366096048
sim_compute_performance-ego_min0.05971178743574354
sim_compute_robot_state-ego_max0.08114251136779785
sim_compute_robot_state-ego_mean0.07092385451887892
sim_compute_robot_state-ego_median0.06849181885812797
sim_compute_robot_state-ego_min0.0641973062797829
sim_compute_sim_state_max0.04014341354370117
sim_compute_sim_state_mean0.03791500406140859
sim_compute_sim_state_median0.037408127504236555
sim_compute_sim_state_min0.03628019050315574
sim_physics_max0.13993474960327149
sim_physics_mean0.11199209427114902
sim_physics_median0.1061452823349192
sim_physics_min0.0967915764561406
sim_render-ego_max0.06347359657287598
sim_render-ego_mean0.05811119450707782
sim_render-ego_median0.05846556530723089
sim_render-ego_min0.05378038742963005
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
240193814AmaurXLet's do this one todayaido2-LFVI-sim-validation-offseasonstep1-simulationsuccessyes12920:08:34(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15508319437503815
agent_compute-ego_mean0.14503994207004656
agent_compute-ego_median0.14705229710929002
agent_compute-ego_min0.1276782126653762
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.1946193598493745, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.05695091621785224, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14705229710929002, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.09414172172546388, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.03580845458598077, "sim_compute_performance-ego": 0.06354237206374543, "sim_compute_robot_state-ego": 0.06887081001378313, "sim_compute_robot_state-npc0": 0.06678372696985173, "sim_compute_robot_state-npc1": 0.06470878818367101, "sim_compute_robot_state-npc2": 0.06248279764682432, "sim_compute_robot_state-npc3": 0.060416450983361354}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2263670819146293, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06203487941196987, "in-drivable-lane": 0, "agent_compute-ego": 0.15401949201311385, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09765346561159406, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.034285153661455424, "sim_compute_performance-ego": 0.07362098353249687, "sim_compute_robot_state-ego": 0.07844580071313041, "sim_compute_robot_state-npc0": 0.07180358682359968, "sim_compute_robot_state-npc1": 0.06955058234078544, "sim_compute_robot_state-npc2": 0.06457031624657768, "sim_compute_robot_state-npc3": 0.06466995818274361}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18755376917644612, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05932720425059494, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1413665141874147, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0906167840494693, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.036485030813124576, "sim_compute_performance-ego": 0.06573676368565236, "sim_compute_robot_state-ego": 0.07048427479938396, "sim_compute_robot_state-npc0": 0.06744032693140715, "sim_compute_robot_state-npc1": 0.06362626159075395, "sim_compute_robot_state-npc2": 0.06319258513959866, "sim_compute_robot_state-npc3": 0.06347140756625573}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.23180940250555673, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06403110921382904, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.15508319437503815, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.096975843111674, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.03903831044832865, "sim_compute_performance-ego": 0.07578137516975403, "sim_compute_robot_state-ego": 0.07538750767707825, "sim_compute_robot_state-npc0": 0.07121410965919495, "sim_compute_robot_state-npc1": 0.07176051537195842, "sim_compute_robot_state-npc2": 0.07248426973819733, "sim_compute_robot_state-npc3": 0.07026684284210205}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.1474514575231643, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.04706534885224842, "in-drivable-lane": 0, "agent_compute-ego": 0.1276782126653762, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.0805580388932001, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.030593588238670713, "sim_compute_performance-ego": 0.05318304470607212, "sim_compute_robot_state-ego": 0.05449926285516648, "sim_compute_robot_state-npc0": 0.054117043813069664, "sim_compute_robot_state-npc1": 0.05551460811070034, "sim_compute_robot_state-npc2": 0.05257361275809152, "sim_compute_robot_state-npc3": 0.05339443115960984}}
set_robot_commands_max0.09765346561159406
set_robot_commands_mean0.09198917067828025
set_robot_commands_median0.09414172172546388
set_robot_commands_min0.0805580388932001
sim_compute_performance-ego_max0.07578137516975403
sim_compute_performance-ego_mean0.06637290783154416
sim_compute_performance-ego_median0.06573676368565236
sim_compute_performance-ego_min0.05318304470607212
sim_compute_robot_state-ego_max0.07844580071313041
sim_compute_robot_state-ego_mean0.06953753121170844
sim_compute_robot_state-ego_median0.07048427479938396
sim_compute_robot_state-ego_min0.05449926285516648
sim_compute_robot_state-npc0_max0.07180358682359968
sim_compute_robot_state-npc0_mean0.06627175883942463
sim_compute_robot_state-npc0_median0.06744032693140715
sim_compute_robot_state-npc0_min0.054117043813069664
sim_compute_robot_state-npc1_max0.07176051537195842
sim_compute_robot_state-npc1_mean0.06503215111957385
sim_compute_robot_state-npc1_median0.06470878818367101
sim_compute_robot_state-npc1_min0.05551460811070034
sim_compute_robot_state-npc2_max0.07248426973819733
sim_compute_robot_state-npc2_mean0.0630607163058579
sim_compute_robot_state-npc2_median0.06319258513959866
sim_compute_robot_state-npc2_min0.05257361275809152
sim_compute_robot_state-npc3_max0.07026684284210205
sim_compute_robot_state-npc3_mean0.06244381814681453
sim_compute_robot_state-npc3_median0.06347140756625573
sim_compute_robot_state-npc3_min0.05339443115960984
sim_compute_sim_state_max0.03903831044832865
sim_compute_sim_state_mean0.03524210754951203
sim_compute_sim_state_median0.03580845458598077
sim_compute_sim_state_min0.030593588238670713
sim_physics_max0.23180940250555673
sim_physics_mean0.19756021419383415
sim_physics_median0.1946193598493745
sim_physics_min0.1474514575231643
sim_render-ego_max0.06403110921382904
sim_render-ego_mean0.057881891589298906
sim_render-ego_median0.05932720425059494
sim_render-ego_min0.04706534885224842
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
240143805chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:06:57(hidden)
driven_lanedir_consec_median1.1588863253105712
survival_time_median3.349999999999996
deviation-center-line_median0.23152540164094593
in-drivable-lane_median0.7999999999999972


other stats
agent_compute-ego_max0.10013601673183156
agent_compute-ego_mean0.0983446488262993
agent_compute-ego_median0.09814946009562564
agent_compute-ego_min0.09710530704922146
deviation-center-line_max0.45726768098468296
deviation-center-line_mean0.25858627282798385
deviation-center-line_min0.1324028904613364
deviation-heading_max1.3097523026601403
deviation-heading_mean0.5699572942154596
deviation-heading_median0.5573952301476408
deviation-heading_min0.18048456555704137
driven_any_max3.3158982023624892
driven_any_mean1.7515242569446083
driven_any_median1.6055151883308336
driven_any_min1.0711135302286476
driven_lanedir_consec_max2.430472078042259
driven_lanedir_consec_mean1.2916303467209322
driven_lanedir_consec_min0.5411619350867007
driven_lanedir_max2.430472078042259
driven_lanedir_mean1.2916303467209322
driven_lanedir_median1.1588863253105712
driven_lanedir_min0.5411619350867007
in-drivable-lane_max2.749999999999994
in-drivable-lane_mean1.0599999999999974
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0817794093679205, "sim_physics": 0.06356657009858352, "survival_time": 2.5999999999999988, "driven_lanedir": 0.5411619350867007, "sim_render-ego": 0.03652138434923612, "in-drivable-lane": 1.149999999999998, "agent_compute-ego": 0.09814946009562564, "deviation-heading": 0.18048456555704137, "set_robot_commands": 0.056084197301131025, "deviation-center-line": 0.1324028904613364, "driven_lanedir_consec": 0.5411619350867007, "sim_compute_sim_state": 0.023369569044846755, "sim_compute_performance-ego": 0.039545233433063216, "sim_compute_robot_state-ego": 0.04112910765867967}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0711135302286476, "sim_physics": 0.05577190187242296, "survival_time": 2.25, "driven_lanedir": 1.0062892601892677, "sim_render-ego": 0.0358732541402181, "in-drivable-lane": 0, "agent_compute-ego": 0.09710530704922146, "deviation-heading": 0.5869229296649252, "set_robot_commands": 0.05487275653415256, "deviation-center-line": 0.17206865231850688, "driven_lanedir_consec": 1.0062892601892677, "sim_compute_sim_state": 0.023410632875230576, "sim_compute_performance-ego": 0.03876216676500109, "sim_compute_robot_state-ego": 0.0409334659576416}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.3158982023624892, "sim_physics": 0.05887285001350172, "survival_time": 8.249999999999982, "driven_lanedir": 2.430472078042259, "sim_render-ego": 0.036576912619850854, "in-drivable-lane": 2.749999999999994, "agent_compute-ego": 0.0983204278078946, "deviation-heading": 1.3097523026601403, "set_robot_commands": 0.05507134668754809, "deviation-center-line": 0.45726768098468296, "driven_lanedir_consec": 2.430472078042259, "sim_compute_sim_state": 0.023716678041400333, "sim_compute_performance-ego": 0.03972379077564586, "sim_compute_robot_state-ego": 0.04152763540094549}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6833149544331505, "sim_physics": 0.06141012055533273, "survival_time": 3.8499999999999943, "driven_lanedir": 1.3213421349758625, "sim_render-ego": 0.03690960809781954, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0980120324469232, "deviation-heading": 0.5573952301476408, "set_robot_commands": 0.055693044290914165, "deviation-center-line": 0.29966673873444727, "driven_lanedir_consec": 1.3213421349758625, "sim_compute_sim_state": 0.024277971936510753, "sim_compute_performance-ego": 0.040186916078839986, "sim_compute_robot_state-ego": 0.04162903575154094}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6055151883308336, "sim_physics": 0.058039181268037254, "survival_time": 3.349999999999996, "driven_lanedir": 1.1588863253105712, "sim_render-ego": 0.037069477252106166, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.10013601673183156, "deviation-heading": 0.2152314430475497, "set_robot_commands": 0.05480877677006508, "deviation-center-line": 0.23152540164094593, "driven_lanedir_consec": 1.1588863253105712, "sim_compute_sim_state": 0.023776549011913697, "sim_compute_performance-ego": 0.040182320039663745, "sim_compute_robot_state-ego": 0.04132951907257536}}
set_robot_commands_max0.056084197301131025
set_robot_commands_mean0.05530602431676218
set_robot_commands_median0.05507134668754809
set_robot_commands_min0.05480877677006508
sim_compute_performance-ego_max0.040186916078839986
sim_compute_performance-ego_mean0.03968008541844278
sim_compute_performance-ego_median0.03972379077564586
sim_compute_performance-ego_min0.03876216676500109
sim_compute_robot_state-ego_max0.04162903575154094
sim_compute_robot_state-ego_mean0.04130975276827661
sim_compute_robot_state-ego_median0.04132951907257536
sim_compute_robot_state-ego_min0.0409334659576416
sim_compute_sim_state_max0.024277971936510753
sim_compute_sim_state_mean0.023710280181980424
sim_compute_sim_state_median0.023716678041400333
sim_compute_sim_state_min0.023369569044846755
sim_physics_max0.06356657009858352
sim_physics_mean0.059532124761575635
sim_physics_median0.05887285001350172
sim_physics_min0.05577190187242296
sim_render-ego_max0.037069477252106166
sim_render-ego_mean0.03659012729184616
sim_render-ego_median0.036576912619850854
sim_render-ego_min0.0358732541402181
simulation-passed1
survival_time_max8.249999999999982
survival_time_mean4.059999999999993
survival_time_min2.25
240123803chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:06:42(hidden)
driven_lanedir_consec_median1.2972791937967472
survival_time_median3.399999999999996
deviation-center-line_median0.19992088041052256
in-drivable-lane_median0.6999999999999991


other stats
agent_compute-ego_max0.1138873981392902
agent_compute-ego_mean0.10610625305246849
agent_compute-ego_median0.10442959308624268
agent_compute-ego_min0.1035031325676862
deviation-center-line_max0.41180979962200315
deviation-center-line_mean0.21893197704697295
deviation-center-line_min0.1226676307821295
deviation-heading_max1.4221461625389653
deviation-heading_mean0.6666341281365264
deviation-heading_median0.5229383535739406
deviation-heading_min0.19718051848408008
driven_any_max3.343709174267414
driven_any_mean1.790626481260936
driven_any_median1.661049939038666
driven_any_min1.0422217679001116
driven_lanedir_consec_max2.22794375294721
driven_lanedir_consec_mean1.2313864230696403
driven_lanedir_consec_min0.6079868960781842
driven_lanedir_max2.229414328108656
driven_lanedir_mean1.2316805381019296
driven_lanedir_median1.2972791937967472
driven_lanedir_min0.6079868960781842
in-drivable-lane_max3.199999999999992
in-drivable-lane_mean1.1899999999999975
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0422217679001116, "sim_physics": 0.06210486266923987, "survival_time": 2.3, "driven_lanedir": 0.6888787772479481, "sim_render-ego": 0.03652795501377271, "in-drivable-lane": 0.6999999999999991, "agent_compute-ego": 0.1138873981392902, "deviation-heading": 0.19718051848408008, "set_robot_commands": 0.05825607154680335, "deviation-center-line": 0.1226676307821295, "driven_lanedir_consec": 0.6888787772479481, "sim_compute_sim_state": 0.023301850194516388, "sim_compute_performance-ego": 0.03872096538543701, "sim_compute_robot_state-ego": 0.04132158859916355}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.192373968565878, "sim_physics": 0.05981991767883301, "survival_time": 2.499999999999999, "driven_lanedir": 0.6079868960781842, "sim_render-ego": 0.03710982322692871, "in-drivable-lane": 0.8500000000000008, "agent_compute-ego": 0.10442959308624268, "deviation-heading": 0.7223919727599728, "set_robot_commands": 0.058016085624694826, "deviation-center-line": 0.13046840351765712, "driven_lanedir_consec": 0.6079868960781842, "sim_compute_sim_state": 0.023806591033935547, "sim_compute_performance-ego": 0.03961285591125488, "sim_compute_robot_state-ego": 0.04117805480957031}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.343709174267414, "sim_physics": 0.05631509549690015, "survival_time": 8.249999999999982, "driven_lanedir": 2.229414328108656, "sim_render-ego": 0.03639275666439172, "in-drivable-lane": 3.199999999999992, "agent_compute-ego": 0.10492087133003004, "deviation-heading": 1.4221461625389653, "set_robot_commands": 0.05376246192238548, "deviation-center-line": 0.41180979962200315, "driven_lanedir_consec": 2.22794375294721, "sim_compute_sim_state": 0.023225725058353307, "sim_compute_performance-ego": 0.03854154528993549, "sim_compute_robot_state-ego": 0.04109529003952489}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.661049939038666, "sim_physics": 0.05692572463048647, "survival_time": 3.649999999999995, "driven_lanedir": 1.2972791937967472, "sim_render-ego": 0.036360227898375626, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.10379027013909328, "deviation-heading": 0.5229383535739406, "set_robot_commands": 0.054191540365349754, "deviation-center-line": 0.19992088041052256, "driven_lanedir_consec": 1.2972791937967472, "sim_compute_sim_state": 0.023217139178759432, "sim_compute_performance-ego": 0.03876540432237599, "sim_compute_robot_state-ego": 0.04086693672284688}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.713777556532612, "sim_physics": 0.056592208497664505, "survival_time": 3.399999999999996, "driven_lanedir": 1.3348434952781132, "sim_render-ego": 0.03614077497931088, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1035031325676862, "deviation-heading": 0.4685136333256734, "set_robot_commands": 0.05406180900685927, "deviation-center-line": 0.2297931709025524, "driven_lanedir_consec": 1.3348434952781132, "sim_compute_sim_state": 0.023232028764836928, "sim_compute_performance-ego": 0.03854428669985603, "sim_compute_robot_state-ego": 0.041331252631019146}}
set_robot_commands_max0.05825607154680335
set_robot_commands_mean0.05565759369321853
set_robot_commands_median0.054191540365349754
set_robot_commands_min0.05376246192238548
sim_compute_performance-ego_max0.03961285591125488
sim_compute_performance-ego_mean0.03883701152177188
sim_compute_performance-ego_median0.03872096538543701
sim_compute_performance-ego_min0.03854154528993549
sim_compute_robot_state-ego_max0.041331252631019146
sim_compute_robot_state-ego_mean0.041158624560424954
sim_compute_robot_state-ego_median0.04117805480957031
sim_compute_robot_state-ego_min0.04086693672284688
sim_compute_sim_state_max0.023806591033935547
sim_compute_sim_state_mean0.02335666684608032
sim_compute_sim_state_median0.023232028764836928
sim_compute_sim_state_min0.023217139178759432
sim_physics_max0.06210486266923987
sim_physics_mean0.05835156179462481
sim_physics_median0.05692572463048647
sim_physics_min0.05631509549690015
sim_render-ego_max0.03710982322692871
sim_render-ego_mean0.03650630755655593
sim_render-ego_median0.03639275666439172
sim_render-ego_min0.03614077497931088
simulation-passed1
survival_time_max8.249999999999982
survival_time_mean4.019999999999994
survival_time_min2.3
240113802chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12920:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 81, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 50, in compute_action
               ||     print(observation.size())
               || TypeError: 'int' object is not callable
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7fe275072f28>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fe21f5407f0>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240103801chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12920:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 79, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 48, in compute_action
               ||     observation /= observation.max()
               || TypeError: No loop matching the specified signature and casting
               || was found for ufunc true_divide
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7f57915b1ef0>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f5751684be0>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240093800chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:06(hidden)
driven_lanedir_consec_median1.1779706500090832
survival_time_median3.2499999999999964
deviation-center-line_median0.25040531780111785
in-drivable-lane_median1.1999999999999993


other stats
agent_compute-ego_max0.09727288694942698
agent_compute-ego_mean0.09648970671542484
agent_compute-ego_median0.09629928320646286
agent_compute-ego_min0.09561865146343523
deviation-center-line_max0.3769150969088316
deviation-center-line_mean0.2417260446986368
deviation-center-line_min0.13863834695435018
deviation-heading_max1.171945720356933
deviation-heading_mean0.5893031392096364
deviation-heading_median0.5585268168063817
deviation-heading_min0.19881301562346537
driven_any_max3.344122066636058
driven_any_mean1.7981792738753897
driven_any_median1.6301783771744984
driven_any_min0.998586419751354
driven_lanedir_consec_max2.1924131524168704
driven_lanedir_consec_mean1.1796700160852456
driven_lanedir_consec_min0.5428774088437708
driven_lanedir_max2.1924131524168704
driven_lanedir_mean1.1796700160852456
driven_lanedir_median1.1779706500090832
driven_lanedir_min0.5428774088437708
in-drivable-lane_max3.2499999999999893
in-drivable-lane_mean1.5499999999999956
in-drivable-lane_min0.7999999999999972
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.998586419751354, "sim_physics": 0.0559585839509964, "survival_time": 3.1999999999999966, "driven_lanedir": 0.6787016403434145, "sim_render-ego": 0.03600187599658966, "in-drivable-lane": 1.4999999999999958, "agent_compute-ego": 0.09629928320646286, "deviation-heading": 0.2576716737575899, "set_robot_commands": 0.05541538819670677, "deviation-center-line": 0.13863834695435018, "driven_lanedir_consec": 0.6787016403434145, "sim_compute_sim_state": 0.023557480424642563, "sim_compute_performance-ego": 0.03918953612446785, "sim_compute_robot_state-ego": 0.04051482304930687}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.2862682888653014, "sim_physics": 0.056621271988441205, "survival_time": 2.8999999999999977, "driven_lanedir": 0.5428774088437708, "sim_render-ego": 0.036068706676877775, "in-drivable-lane": 1.1999999999999993, "agent_compute-ego": 0.09620387800808612, "deviation-heading": 0.759558469503812, "set_robot_commands": 0.05381471946321685, "deviation-center-line": 0.1411818998396067, "driven_lanedir_consec": 0.5428774088437708, "sim_compute_sim_state": 0.023319606123299433, "sim_compute_performance-ego": 0.039227091032883216, "sim_compute_robot_state-ego": 0.04106749337295006}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.344122066636058, "sim_physics": 0.05683745572596421, "survival_time": 8.09999999999998, "driven_lanedir": 2.1924131524168704, "sim_render-ego": 0.03605513513824086, "in-drivable-lane": 3.2499999999999893, "agent_compute-ego": 0.09705383394971306, "deviation-heading": 1.171945720356933, "set_robot_commands": 0.054757895293059175, "deviation-center-line": 0.3769150969088316, "driven_lanedir_consec": 2.1924131524168704, "sim_compute_sim_state": 0.023257011248741626, "sim_compute_performance-ego": 0.039390615475030595, "sim_compute_robot_state-ego": 0.04065277841356066}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7317412169497366, "sim_physics": 0.05570567074943991, "survival_time": 4.249999999999993, "driven_lanedir": 1.306387228813089, "sim_render-ego": 0.03631725591771743, "in-drivable-lane": 0.9999999999999964, "agent_compute-ego": 0.09727288694942698, "deviation-heading": 0.5585268168063817, "set_robot_commands": 0.053684719871072206, "deviation-center-line": 0.3014895619892776, "driven_lanedir_consec": 1.306387228813089, "sim_compute_sim_state": 0.02333668260013356, "sim_compute_performance-ego": 0.03897839153514189, "sim_compute_robot_state-ego": 0.04086967917049632}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6301783771744984, "sim_physics": 0.05581498879652757, "survival_time": 3.2499999999999964, "driven_lanedir": 1.1779706500090832, "sim_render-ego": 0.03547922647916354, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.09561865146343523, "deviation-heading": 0.19881301562346537, "set_robot_commands": 0.053747910719651446, "deviation-center-line": 0.25040531780111785, "driven_lanedir_consec": 1.1779706500090832, "sim_compute_sim_state": 0.023244557013878456, "sim_compute_performance-ego": 0.03954048890333909, "sim_compute_robot_state-ego": 0.04044064008272611}}
set_robot_commands_max0.05541538819670677
set_robot_commands_mean0.05428412670874129
set_robot_commands_median0.05381471946321685
set_robot_commands_min0.053684719871072206
sim_compute_performance-ego_max0.03954048890333909
sim_compute_performance-ego_mean0.03926522461417253
sim_compute_performance-ego_median0.039227091032883216
sim_compute_performance-ego_min0.03897839153514189
sim_compute_robot_state-ego_max0.04106749337295006
sim_compute_robot_state-ego_mean0.04070908281780801
sim_compute_robot_state-ego_median0.04065277841356066
sim_compute_robot_state-ego_min0.04044064008272611
sim_compute_sim_state_max0.023557480424642563
sim_compute_sim_state_mean0.02334306748213912
sim_compute_sim_state_median0.023319606123299433
sim_compute_sim_state_min0.023244557013878456
sim_physics_max0.05683745572596421
sim_physics_mean0.056187594242273854
sim_physics_median0.0559585839509964
sim_physics_min0.05570567074943991
sim_render-ego_max0.03631725591771743
sim_render-ego_mean0.03598444004171785
sim_render-ego_median0.03605513513824086
sim_render-ego_min0.03547922647916354
simulation-passed1
survival_time_max8.09999999999998
survival_time_mean4.339999999999993
survival_time_min2.8999999999999977
240083799chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationfailedyes12920:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 78, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 47, in compute_action
               ||     observation /= observation.max()
               || TypeError: No loop matching the specified signature and casting
               || was found for ufunc true_divide
               ||
               || The above exception was the direct cause of the following exception:
               ||
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 22, in call_if_fun_exists
               ||     raise TypeError(msg) from e
               || TypeError: Cannot call function <bound method PytorchRLBaseline.on_received_get_commands of <__main__.PytorchRLBaseline object at 0x7fd1cab3beb8>> with arguments {'context': <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fd175003cf8>}.
               ||
               || argspec: FullArgSpec(args=['self', 'context'], varargs=None, varkw=None, defaults=None, kwonlyargs=[], kwonlydefaults=None, annotations={'context': <class 'zuper_nodes_wrapper.interface.Context'>})
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
240073798chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:00:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
240063797chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:04:57(hidden)
driven_lanedir_consec_median1.244243767536708
survival_time_median3.4499999999999957
deviation-center-line_median0.19553582247490095
in-drivable-lane_median0.9500000000000008


other stats
agent_compute-ego_max0.0983372201452722
agent_compute-ego_mean0.09660479881067773
agent_compute-ego_median0.09621976769488792
agent_compute-ego_min0.09593208742813324
deviation-center-line_max0.40729481009657825
deviation-center-line_mean0.21381106061492244
deviation-center-line_min0.11899879724438864
deviation-heading_max1.296916504190604
deviation-heading_mean0.5872806340629769
deviation-heading_median0.4780604256375672
deviation-heading_min0.200086553631852
driven_any_max3.285179685806149
driven_any_mean1.7448977578831524
driven_any_median1.6049817588077175
driven_any_min0.9952880617019196
driven_lanedir_consec_max2.2943031225190547
driven_lanedir_consec_mean1.2081669127892485
driven_lanedir_consec_min0.5594381299717874
driven_lanedir_max2.2943031225190547
driven_lanedir_mean1.2081669127892485
driven_lanedir_median1.244243767536708
driven_lanedir_min0.5594381299717874
in-drivable-lane_max1.949999999999993
in-drivable-lane_mean1.149999999999997
in-drivable-lane_min0.5999999999999979
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9952880617019196, "sim_physics": 0.05957422653834025, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6585572753451054, "sim_render-ego": 0.03711240688959758, "in-drivable-lane": 1.3999999999999966, "agent_compute-ego": 0.0964160680770874, "deviation-heading": 0.200086553631852, "set_robot_commands": 0.05478712717692057, "deviation-center-line": 0.14129653149190685, "driven_lanedir_consec": 0.6585572753451054, "sim_compute_sim_state": 0.02346965471903483, "sim_compute_performance-ego": 0.03886263370513916, "sim_compute_robot_state-ego": 0.04088996648788453}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.199010320600831, "sim_physics": 0.05938982963562012, "survival_time": 2.499999999999999, "driven_lanedir": 0.5594381299717874, "sim_render-ego": 0.036587367057800295, "in-drivable-lane": 0.9500000000000008, "agent_compute-ego": 0.0961188507080078, "deviation-heading": 0.6991779986934736, "set_robot_commands": 0.05490993976593018, "deviation-center-line": 0.11899879724438864, "driven_lanedir_consec": 0.5594381299717874, "sim_compute_sim_state": 0.02339139461517334, "sim_compute_performance-ego": 0.038963394165039064, "sim_compute_robot_state-ego": 0.040863137245178226}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.285179685806149, "sim_physics": 0.05651483168968788, "survival_time": 7.149999999999983, "driven_lanedir": 2.2943031225190547, "sim_render-ego": 0.036980902398382864, "in-drivable-lane": 1.949999999999993, "agent_compute-ego": 0.0983372201452722, "deviation-heading": 1.296916504190604, "set_robot_commands": 0.05526719893608893, "deviation-center-line": 0.40729481009657825, "driven_lanedir_consec": 2.2943031225190547, "sim_compute_sim_state": 0.0237996161400855, "sim_compute_performance-ego": 0.03922575503796131, "sim_compute_robot_state-ego": 0.04082702089856555}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6400289624991455, "sim_physics": 0.05804591783335511, "survival_time": 3.5499999999999954, "driven_lanedir": 1.2842922685735867, "sim_render-ego": 0.036326448682328344, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.09593208742813324, "deviation-heading": 0.4780604256375672, "set_robot_commands": 0.05496461962310361, "deviation-center-line": 0.20592934176683733, "driven_lanedir_consec": 1.2842922685735867, "sim_compute_sim_state": 0.023348462413734113, "sim_compute_performance-ego": 0.03932432389595139, "sim_compute_robot_state-ego": 0.04074496282658107}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6049817588077175, "sim_physics": 0.06302127285280089, "survival_time": 3.4499999999999957, "driven_lanedir": 1.244243767536708, "sim_render-ego": 0.03620828752932341, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.09621976769488792, "deviation-heading": 0.2621616881613876, "set_robot_commands": 0.05736769800600798, "deviation-center-line": 0.19553582247490095, "driven_lanedir_consec": 1.244243767536708, "sim_compute_sim_state": 0.02339317833167919, "sim_compute_performance-ego": 0.04018942860589511, "sim_compute_robot_state-ego": 0.04069427130878835}}
set_robot_commands_max0.05736769800600798
set_robot_commands_mean0.055459316701610264
set_robot_commands_median0.05496461962310361
set_robot_commands_min0.05478712717692057
sim_compute_performance-ego_max0.04018942860589511
sim_compute_performance-ego_mean0.03931310708199721
sim_compute_performance-ego_median0.03922575503796131
sim_compute_performance-ego_min0.03886263370513916
sim_compute_robot_state-ego_max0.04088996648788453
sim_compute_robot_state-ego_mean0.04080387175339954
sim_compute_robot_state-ego_median0.04082702089856555
sim_compute_robot_state-ego_min0.04069427130878835
sim_compute_sim_state_max0.0237996161400855
sim_compute_sim_state_mean0.023480461243941396
sim_compute_sim_state_median0.02339317833167919
sim_compute_sim_state_min0.023348462413734113
sim_physics_max0.06302127285280089
sim_physics_mean0.05930921570996085
sim_physics_median0.05938982963562012
sim_physics_min0.05651483168968788
sim_render-ego_max0.03711240688959758
sim_render-ego_mean0.0366430825114865
sim_render-ego_median0.036587367057800295
sim_render-ego_min0.03620828752932341
simulation-passed1
survival_time_max7.149999999999983
survival_time_mean3.929999999999994
survival_time_min2.499999999999999
240033795chuyjBaseline solution using reinforcement learningaido2-LF-sim-validation-offseasonstep1-simulationerroryes12920:01:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
239853784felipecer13challenge-aido_LF-template-randomaido2-LF-sim-validation-offseasonstep1-simulationsuccessyes12920:05:33(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17988154411315918
agent_compute-ego_mean0.1536102693583829
agent_compute-ego_median0.15454616733625823
agent_compute-ego_min0.12836158976835363
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.09658401983755606, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05507183957982947, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1590509193914908, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.09531801718252676, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04628773530324301, "sim_compute_performance-ego": 0.06621753727948224, "sim_compute_robot_state-ego": 0.06305410685362639}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.11868873764486874, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.062057270723230695, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15454616733625823, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.09532534374910244, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04114621293311026, "sim_compute_performance-ego": 0.07199929274764716, "sim_compute_robot_state-ego": 0.07316795984903972}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.10587285546695484, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.05678265235003303, "in-drivable-lane": 0, "agent_compute-ego": 0.12836158976835363, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.08580136299133301, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.036262161591473746, "sim_compute_performance-ego": 0.06101731693043428, "sim_compute_robot_state-ego": 0.06205818232368021}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1425476551055908, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.07150968551635742, "in-drivable-lane": 0, "agent_compute-ego": 0.17988154411315918, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1110304069519043, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04363409042358399, "sim_compute_performance-ego": 0.07822474479675293, "sim_compute_robot_state-ego": 0.08693365097045898}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.10486400881900064, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.060106956506077246, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14621112618265272, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09362970726399482, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.03702580476108985, "sim_compute_performance-ego": 0.06756785247899309, "sim_compute_robot_state-ego": 0.07269380967828291}}
set_robot_commands_max0.1110304069519043
set_robot_commands_mean0.09622096762777228
set_robot_commands_median0.09531801718252676
set_robot_commands_min0.08580136299133301
sim_compute_performance-ego_max0.07822474479675293
sim_compute_performance-ego_mean0.06900534884666194
sim_compute_performance-ego_median0.06756785247899309
sim_compute_performance-ego_min0.06101731693043428
sim_compute_robot_state-ego_max0.08693365097045898
sim_compute_robot_state-ego_mean0.07158154193501765
sim_compute_robot_state-ego_median0.07269380967828291
sim_compute_robot_state-ego_min0.06205818232368021
sim_compute_sim_state_max0.04628773530324301
sim_compute_sim_state_mean0.04087120100250017
sim_compute_sim_state_median0.04114621293311026
sim_compute_sim_state_min0.036262161591473746
sim_physics_max0.1425476551055908
sim_physics_mean0.1137114553747942
sim_physics_median0.10587285546695484
sim_physics_min0.09658401983755606
sim_render-ego_max0.07150968551635742
sim_render-ego_mean0.06110568093510558
sim_render-ego_median0.060106956506077246
sim_render-ego_min0.05507183957982947
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
237483759Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes12920:39:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
237433749sebaido2-LFV-sim-testingstep1-simulationsuccessyes12920:12:51(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.11471105063403096
agent_compute-ego_mean0.09188274060224416
agent_compute-ego_median0.08652210235595703
agent_compute-ego_min0.08603063777641014
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.11240424933256926, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.04450094258343732, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.11471105063403096, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0727119313346015, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.028263679257145635, "sim_compute_performance-ego": 0.05029237711871112, "sim_compute_robot_state-ego": 0.052201284302605525, "sim_compute_robot_state-npc0": 0.05062058236863878, "sim_compute_robot_state-npc1": 0.05248792966206869, "sim_compute_robot_state-npc2": 0.05344392193688287, "sim_compute_robot_state-npc3": 0.05016410792315448}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.123404541015625, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.046174535751342775, "in-drivable-lane": 0, "agent_compute-ego": 0.10784406661987304, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.06869266510009765, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.027157115936279296, "sim_compute_performance-ego": 0.04855607986450195, "sim_compute_robot_state-ego": 0.05171023368835449, "sim_compute_robot_state-npc0": 0.0492319393157959, "sim_compute_robot_state-npc1": 0.04986615180969238, "sim_compute_robot_state-npc2": 0.04786275863647461, "sim_compute_robot_state-npc3": 0.04599470138549805}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.12088166726262946, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0420559613328231, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.11145182032334178, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.06872682508669402, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.027234889959034166, "sim_compute_performance-ego": 0.047592266609794216, "sim_compute_robot_state-ego": 0.04970563085455643, "sim_compute_robot_state-npc0": 0.05044773377870258, "sim_compute_robot_state-npc1": 0.04916344504607351, "sim_compute_robot_state-npc2": 0.04948840956938894, "sim_compute_robot_state-npc3": 0.05031911950362356}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.13537006136737292, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.03505245945121668, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.08614797531803951, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.05678679671468614, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.022272429888761495, "sim_compute_performance-ego": 0.038283779651303834, "sim_compute_robot_state-ego": 0.04023056694223911, "sim_compute_robot_state-npc0": 0.03992650478701048, "sim_compute_robot_state-npc1": 0.03897002678883227, "sim_compute_robot_state-npc2": 0.03887293912187408, "sim_compute_robot_state-npc3": 0.03881658179850518}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.09103688171931676, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.03561298336301531, "in-drivable-lane": 0, "agent_compute-ego": 0.08717866454805646, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.05519106558391026, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.022425762244633267, "sim_compute_performance-ego": 0.038574159145355225, "sim_compute_robot_state-ego": 0.04051596777779715, "sim_compute_robot_state-npc0": 0.03964836256844657, "sim_compute_robot_state-npc1": 0.03913944108145578, "sim_compute_robot_state-npc2": 0.03916803428104946, "sim_compute_robot_state-npc3": 0.03925152335848127}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.08492616812388103, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.035111166812755445, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.08603063777641014, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.054876614499975135, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.022144330872429743, "sim_compute_performance-ego": 0.03831842652073613, "sim_compute_robot_state-ego": 0.03998624836957013, "sim_compute_robot_state-npc0": 0.04191342548087791, "sim_compute_robot_state-npc1": 0.039616787875140155, "sim_compute_robot_state-npc2": 0.03876676824357775, "sim_compute_robot_state-npc3": 0.03869112332661947}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.0875048107571072, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.035238442597565825, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.08639093240102132, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.05483976999918619, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.022377398278978135, "sim_compute_performance-ego": 0.038319000491389525, "sim_compute_robot_state-ego": 0.04013890248757822, "sim_compute_robot_state-npc0": 0.03943702909681532, "sim_compute_robot_state-npc1": 0.03901992020783601, "sim_compute_robot_state-npc2": 0.03911685060571741, "sim_compute_robot_state-npc3": 0.03904143969217936}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.10398458374871147, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.0352417786916097, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.08676069577534994, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.05499156845940484, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.022236516740587024, "sim_compute_performance-ego": 0.03817938168843587, "sim_compute_robot_state-ego": 0.04123997688293457, "sim_compute_robot_state-npc0": 0.0393116103278266, "sim_compute_robot_state-npc1": 0.03913311428493923, "sim_compute_robot_state-npc2": 0.03889259762234158, "sim_compute_robot_state-npc3": 0.060362460878160266}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.08436141843381136, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.03515476247538691, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.08625316619873047, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.05494280483411706, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.022244183913521145, "sim_compute_performance-ego": 0.0382503893064416, "sim_compute_robot_state-ego": 0.04023222819618557, "sim_compute_robot_state-npc0": 0.039405656897503395, "sim_compute_robot_state-npc1": 0.03914682243181312, "sim_compute_robot_state-npc2": 0.038709531659665314, "sim_compute_robot_state-npc3": 0.03903104947960895}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.1155332899093628, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.034946351051330565, "in-drivable-lane": 0, "agent_compute-ego": 0.08613057136535644, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.05488933563232422, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.02506941795349121, "sim_compute_performance-ego": 0.03887814044952392, "sim_compute_robot_state-ego": 0.04042298793792724, "sim_compute_robot_state-npc0": 0.0394152307510376, "sim_compute_robot_state-npc1": 0.03900943279266358, "sim_compute_robot_state-npc2": 0.03886136531829834, "sim_compute_robot_state-npc3": 0.03890852451324463}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.10702074766159056, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.035391271114349365, "in-drivable-lane": 0, "agent_compute-ego": 0.08699120283126831, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.05529739856719971, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.02228999137878418, "sim_compute_performance-ego": 0.03840994834899902, "sim_compute_robot_state-ego": 0.04062608480453491, "sim_compute_robot_state-npc0": 0.03933863639831543, "sim_compute_robot_state-npc1": 0.03892912864685059, "sim_compute_robot_state-npc2": 0.03873568773269653, "sim_compute_robot_state-npc3": 0.03891223669052124}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.08695874716106214, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.035558688013177166, "in-drivable-lane": 0, "agent_compute-ego": 0.09319181191293816, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.05576434888337787, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.02263262397364566, "sim_compute_performance-ego": 0.03856623800177323, "sim_compute_robot_state-ego": 0.040993100718448035, "sim_compute_robot_state-npc0": 0.03971497636092337, "sim_compute_robot_state-npc1": 0.03945136070251465, "sim_compute_robot_state-npc2": 0.039058409239116465, "sim_compute_robot_state-npc3": 0.03923308221917403}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.08398649215698242, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.034802603721618655, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.08636300086975097, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.054903807640075686, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.02223757266998291, "sim_compute_performance-ego": 0.03818500518798828, "sim_compute_robot_state-ego": 0.04007328987121582, "sim_compute_robot_state-npc0": 0.03943102836608887, "sim_compute_robot_state-npc1": 0.0389306640625, "sim_compute_robot_state-npc2": 0.03975080966949463, "sim_compute_robot_state-npc3": 0.03895270824432373}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.1053216890855269, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.035432956435463646, "in-drivable-lane": 0, "agent_compute-ego": 0.08627341010353783, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.055165583437139336, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.02219245650551536, "sim_compute_performance-ego": 0.03815847093408758, "sim_compute_robot_state-ego": 0.04020809043537487, "sim_compute_robot_state-npc0": 0.039451674981550736, "sim_compute_robot_state-npc1": 0.03896654735911976, "sim_compute_robot_state-npc2": 0.038840651512146, "sim_compute_robot_state-npc3": 0.03888243978673762}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.10094436334103954, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.03557725341952577, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.08652210235595703, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.055469770820773374, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.02233609374688596, "sim_compute_performance-ego": 0.038225339383495094, "sim_compute_robot_state-ego": 0.04037859975075235, "sim_compute_robot_state-npc0": 0.039779205711520445, "sim_compute_robot_state-npc1": 0.039127291465292174, "sim_compute_robot_state-npc2": 0.03901326899625817, "sim_compute_robot_state-npc3": 0.0388533387865339}}
set_robot_commands_max0.0727119313346015
set_robot_commands_mean0.0582166857729042
set_robot_commands_median0.05519106558391026
set_robot_commands_min0.05483976999918619
sim_compute_performance-ego_max0.05029237711871112
sim_compute_performance-ego_mean0.04045260018016909
sim_compute_performance-ego_median0.038319000491389525
sim_compute_performance-ego_min0.03815847093408758
sim_compute_robot_state-ego_max0.052201284302605525
sim_compute_robot_state-ego_mean0.04257754620133829
sim_compute_robot_state-ego_median0.04042298793792724
sim_compute_robot_state-ego_min0.03998624836957013
sim_compute_robot_state-npc0_max0.05062058236863878
sim_compute_robot_state-npc0_mean0.04180490647940361
sim_compute_robot_state-npc0_median0.03964836256844657
sim_compute_robot_state-npc0_min0.0393116103278266
sim_compute_robot_state-npc1_max0.05248792966206869
sim_compute_robot_state-npc1_mean0.041397204281119454
sim_compute_robot_state-npc1_median0.03913311428493923
sim_compute_robot_state-npc1_min0.03892912864685059
sim_compute_robot_state-npc2_max0.05344392193688287
sim_compute_robot_state-npc2_mean0.04123880027633213
sim_compute_robot_state-npc2_median0.03901326899625817
sim_compute_robot_state-npc2_min0.038709531659665314
sim_compute_robot_state-npc3_max0.060362460878160266
sim_compute_robot_state-npc3_mean0.04236096250575771
sim_compute_robot_state-npc3_median0.03903104947960895
sim_compute_robot_state-npc3_min0.03869112332661947
sim_compute_sim_state_max0.028263679257145635
sim_compute_sim_state_mean0.02354096422131168
sim_compute_sim_state_median0.02233609374688596
sim_compute_sim_state_min0.022144330872429743
sim_physics_max0.13537006136737292
sim_physics_mean0.1029093140717726
sim_physics_median0.10398458374871147
sim_physics_min0.08398649215698242
sim_render-ego_max0.046174535751342775
sim_render-ego_mean0.037056810454307886
sim_render-ego_median0.035391271114349365
sim_render-ego_min0.034802603721618655
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
236663713jp18813100494final test - whaido2-LF-sim-validationstep1-simulationsuccessyes12920:15:42(hidden)
driven_lanedir_consec_median0.6739581230281155
survival_time_median14.950000000000076
deviation-center-line_median0.3941025175869708
in-drivable-lane_median0


other stats
agent_compute-ego_max0.13150811910629273
agent_compute-ego_mean0.10875458971659344
agent_compute-ego_median0.1030660343170166
agent_compute-ego_min0.10279983282089232
deviation-center-line_max0.9855884436071732
deviation-center-line_mean0.5476643542236538
deviation-center-line_min0.23333145765200997
deviation-heading_max2.1061508052597033
deviation-heading_mean1.6356790124350682
deviation-heading_median1.7956846372515745
deviation-heading_min1.1260002628763528
driven_any_max3.653830750759253
driven_any_mean1.472677231067218
driven_any_median0.6768233729223686
driven_any_min0.11389696543724508
driven_lanedir_consec_max3.400719543411479
driven_lanedir_consec_mean1.4113265755217477
driven_lanedir_consec_min0.11179182472364468
driven_lanedir_max3.400719543411479
driven_lanedir_mean1.4113265755217477
driven_lanedir_median0.6739581230281155
driven_lanedir_min0.11179182472364468
in-drivable-lane_max0.4499999999999984
in-drivable-lane_mean0.08999999999999968
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.11389696543724508, "sim_physics": 0.05695484479268392, "survival_time": 14.950000000000076, "driven_lanedir": 0.11179182472364468, "sim_render-ego": 0.03533862590789795, "in-drivable-lane": 0, "agent_compute-ego": 0.10301037470499674, "deviation-heading": 1.833621982041104, "set_robot_commands": 0.05600987911224365, "deviation-center-line": 0.7431676310222219, "driven_lanedir_consec": 0.11179182472364468, "sim_compute_sim_state": 0.022619492212931316, "sim_compute_performance-ego": 0.03855545441309611, "sim_compute_robot_state-ego": 0.04010685284932455}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.653830750759253, "sim_physics": 0.0694495924313863, "survival_time": 14.950000000000076, "driven_lanedir": 3.400719543411479, "sim_render-ego": 0.04206794500350952, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.13150811910629273, "deviation-heading": 1.7956846372515745, "set_robot_commands": 0.0658201297124227, "deviation-center-line": 0.9855884436071732, "driven_lanedir_consec": 3.400719543411479, "sim_compute_sim_state": 0.028022180398305258, "sim_compute_performance-ego": 0.050351463953653974, "sim_compute_robot_state-ego": 0.052902581691741946}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.456852320408123, "sim_physics": 0.0554482102394104, "survival_time": 14.950000000000076, "driven_lanedir": 2.4115549377940235, "sim_render-ego": 0.03509377717971802, "in-drivable-lane": 0, "agent_compute-ego": 0.10279983282089232, "deviation-heading": 2.1061508052597033, "set_robot_commands": 0.05487285137176514, "deviation-center-line": 0.3941025175869708, "driven_lanedir_consec": 2.4115549377940235, "sim_compute_sim_state": 0.02258399248123169, "sim_compute_performance-ego": 0.03828751643498739, "sim_compute_robot_state-ego": 0.040739080905914306}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6768233729223686, "sim_physics": 0.05502998113632202, "survival_time": 14.950000000000076, "driven_lanedir": 0.6739581230281155, "sim_render-ego": 0.034974555969238284, "in-drivable-lane": 0, "agent_compute-ego": 0.10338858763376872, "deviation-heading": 1.3169373747466062, "set_robot_commands": 0.05480600357055664, "deviation-center-line": 0.23333145765200997, "driven_lanedir_consec": 0.6739581230281155, "sim_compute_sim_state": 0.02244361400604248, "sim_compute_performance-ego": 0.03818320751190186, "sim_compute_robot_state-ego": 0.03969473361968994}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.4619827458091008, "sim_physics": 0.05393163998921712, "survival_time": 14.950000000000076, "driven_lanedir": 0.45860844865147543, "sim_render-ego": 0.03526963790257772, "in-drivable-lane": 0, "agent_compute-ego": 0.1030660343170166, "deviation-heading": 1.1260002628763528, "set_robot_commands": 0.054875619411468506, "deviation-center-line": 0.3821317212498929, "driven_lanedir_consec": 0.45860844865147543, "sim_compute_sim_state": 0.022913331985473632, "sim_compute_performance-ego": 0.03922961076100667, "sim_compute_robot_state-ego": 0.039781322479248045}}
set_robot_commands_max0.0658201297124227
set_robot_commands_mean0.057276896635691334
set_robot_commands_median0.054875619411468506
set_robot_commands_min0.05480600357055664
sim_compute_performance-ego_max0.050351463953653974
sim_compute_performance-ego_mean0.0409214506149292
sim_compute_performance-ego_median0.03855545441309611
sim_compute_performance-ego_min0.03818320751190186
sim_compute_robot_state-ego_max0.052902581691741946
sim_compute_robot_state-ego_mean0.042644914309183754
sim_compute_robot_state-ego_median0.04010685284932455
sim_compute_robot_state-ego_min0.03969473361968994
sim_compute_sim_state_max0.028022180398305258
sim_compute_sim_state_mean0.023716522216796876
sim_compute_sim_state_median0.022619492212931316
sim_compute_sim_state_min0.02244361400604248
sim_physics_max0.0694495924313863
sim_physics_mean0.05816285371780395
sim_physics_median0.0554482102394104
sim_physics_min0.05393163998921712
sim_render-ego_max0.04206794500350952
sim_render-ego_mean0.0365489083925883
sim_render-ego_median0.03526963790257772
sim_render-ego_min0.034974555969238284
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
236163704ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes12920:25:21(hidden)
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.44374302000365046
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.3197508462270101
agent_compute-ego_mean0.31775930325190227
agent_compute-ego_median0.3177070148785909
agent_compute-ego_min0.3161770526568095
deviation-center-line_max0.7337965812416224
deviation-center-line_mean0.4812214119502003
deviation-center-line_min0.29799505396684733
deviation-heading_max5.990117020581061
deviation-heading_mean5.864380088201328
deviation-heading_median5.951617305849203
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.185306548531142
driven_any_median2.1853065485311407
driven_any_min2.1853065485311367
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.6949286260456211
driven_lanedir_consec_min0.6933707706415575
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.6949286260456211
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6933707706415575
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.260000000000038
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.08476901213328043, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.047888081868489585, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.3177070148785909, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.07052671432495117, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.031415512561798094, "sim_compute_performance-ego": 0.0521331516901652, "sim_compute_robot_state-ego": 0.053901416460673014}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.08436025381088257, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.04933545430501302, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.3170484240849813, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.0720005170504252, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.03269251743952433, "sim_compute_performance-ego": 0.053415780067443845, "sim_compute_robot_state-ego": 0.05342173973719279}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.08236098368962606, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.04959067583084106, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.3161770526568095, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.07095826546351115, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.03348989486694336, "sim_compute_performance-ego": 0.05184664726257325, "sim_compute_robot_state-ego": 0.0534023912747701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.08569215377171835, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.04746804475784302, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.31811317841211956, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.0694225549697876, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.031480868657430015, "sim_compute_performance-ego": 0.054878294467926025, "sim_compute_robot_state-ego": 0.05296042521794637}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.08119772434234619, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.04788433233896891, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.3197508462270101, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.07357893943786621, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.031820533275604246, "sim_compute_performance-ego": 0.05165429512659709, "sim_compute_robot_state-ego": 0.057551425298055015}}
set_robot_commands_max0.07357893943786621
set_robot_commands_mean0.07129739824930827
set_robot_commands_median0.07095826546351115
set_robot_commands_min0.0694225549697876
sim_compute_performance-ego_max0.054878294467926025
sim_compute_performance-ego_mean0.05278563372294108
sim_compute_performance-ego_median0.0521331516901652
sim_compute_performance-ego_min0.05165429512659709
sim_compute_robot_state-ego_max0.057551425298055015
sim_compute_robot_state-ego_mean0.05424747959772745
sim_compute_robot_state-ego_median0.05342173973719279
sim_compute_robot_state-ego_min0.05296042521794637
sim_compute_sim_state_max0.03348989486694336
sim_compute_sim_state_mean0.032179865360260004
sim_compute_sim_state_median0.031820533275604246
sim_compute_sim_state_min0.031415512561798094
sim_physics_max0.08569215377171835
sim_physics_mean0.08367602554957072
sim_physics_median0.08436025381088257
sim_physics_min0.08119772434234619
sim_render-ego_max0.04959067583084106
sim_render-ego_mean0.04843331782023112
sim_render-ego_median0.047888081868489585
sim_render-ego_min0.04746804475784302
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
235953697Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes12920:15:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
235663686ierosodinBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes12920:16:19(hidden)
driven_lanedir_consec_median0.6950573847640089
survival_time_median14.950000000000076
deviation-center-line_median0.44374302000365046
in-drivable-lane_median7.200000000000037


other stats
agent_compute-ego_max0.22655071338017785
agent_compute-ego_mean0.2227938249905904
agent_compute-ego_median0.2221819519996643
agent_compute-ego_min0.22104305823644
deviation-center-line_max0.7337965812416224
deviation-center-line_mean0.4812214119502003
deviation-center-line_min0.29799505396684733
deviation-heading_max5.990117020581061
deviation-heading_mean5.864380088201328
deviation-heading_median5.951617305849203
deviation-heading_min5.613995197946513
driven_any_max2.1853065485311514
driven_any_mean2.185306548531142
driven_any_median2.1853065485311407
driven_any_min2.1853065485311367
driven_lanedir_consec_max0.6964859913423234
driven_lanedir_consec_mean0.6949286260456211
driven_lanedir_consec_min0.6933707706415575
driven_lanedir_max0.6964859913423234
driven_lanedir_mean0.6949286260456211
driven_lanedir_median0.6950573847640089
driven_lanedir_min0.6933707706415575
in-drivable-lane_max7.400000000000038
in-drivable-lane_mean7.260000000000038
in-drivable-lane_min7.200000000000037
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.1853065485311434, "sim_physics": 0.05647529363632202, "survival_time": 14.950000000000076, "driven_lanedir": 0.6964859913423234, "sim_render-ego": 0.035842928091684975, "in-drivable-lane": 7.400000000000038, "agent_compute-ego": 0.22107329527537029, "deviation-heading": 5.613995197946513, "set_robot_commands": 0.055648913383483885, "deviation-center-line": 0.7337965812416224, "driven_lanedir_consec": 0.6964859913423234, "sim_compute_sim_state": 0.022841852506001792, "sim_compute_performance-ego": 0.038620770772298176, "sim_compute_robot_state-ego": 0.04013902266820272}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.1853065485311514, "sim_physics": 0.0540275231997172, "survival_time": 14.950000000000076, "driven_lanedir": 0.694222936176982, "sim_render-ego": 0.03542458454767863, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.2221819519996643, "deviation-heading": 5.990117020581061, "set_robot_commands": 0.05392236471176148, "deviation-center-line": 0.29799505396684733, "driven_lanedir_consec": 0.694222936176982, "sim_compute_sim_state": 0.022667551040649415, "sim_compute_performance-ego": 0.039041029612223305, "sim_compute_robot_state-ego": 0.040305404663085936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.185306548531138, "sim_physics": 0.05784837007522583, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950573847640089, "sim_render-ego": 0.035155583222707114, "in-drivable-lane": 7.300000000000038, "agent_compute-ego": 0.22104305823644, "deviation-heading": 5.796667795845188, "set_robot_commands": 0.057120868364969886, "deviation-center-line": 0.307138938696771, "driven_lanedir_consec": 0.6950573847640089, "sim_compute_sim_state": 0.02274115244547526, "sim_compute_performance-ego": 0.038365705013275145, "sim_compute_robot_state-ego": 0.04011585791905721}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.1853065485311367, "sim_physics": 0.0542753012975057, "survival_time": 14.950000000000076, "driven_lanedir": 0.6955060473032337, "sim_render-ego": 0.035435707569122316, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.22312010606129964, "deviation-heading": 5.969503120784673, "set_robot_commands": 0.05438274939854939, "deviation-center-line": 0.6234334658421105, "driven_lanedir_consec": 0.6955060473032337, "sim_compute_sim_state": 0.02422943115234375, "sim_compute_performance-ego": 0.03845947583516439, "sim_compute_robot_state-ego": 0.041093522707621254}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.1853065485311407, "sim_physics": 0.05710412025451661, "survival_time": 14.950000000000076, "driven_lanedir": 0.6933707706415575, "sim_render-ego": 0.03501381953557332, "in-drivable-lane": 7.200000000000037, "agent_compute-ego": 0.22655071338017785, "deviation-heading": 5.951617305849203, "set_robot_commands": 0.055101755460103354, "deviation-center-line": 0.44374302000365046, "driven_lanedir_consec": 0.6933707706415575, "sim_compute_sim_state": 0.022825934886932377, "sim_compute_performance-ego": 0.038042199611663816, "sim_compute_robot_state-ego": 0.03996617952982585}}
set_robot_commands_max0.057120868364969886
set_robot_commands_mean0.0552353302637736
set_robot_commands_median0.055101755460103354
set_robot_commands_min0.05392236471176148
sim_compute_performance-ego_max0.039041029612223305
sim_compute_performance-ego_mean0.038505836168924966
sim_compute_performance-ego_median0.03845947583516439
sim_compute_performance-ego_min0.038042199611663816
sim_compute_robot_state-ego_max0.041093522707621254
sim_compute_robot_state-ego_mean0.04032399749755859
sim_compute_robot_state-ego_median0.04013902266820272
sim_compute_robot_state-ego_min0.03996617952982585
sim_compute_sim_state_max0.02422943115234375
sim_compute_sim_state_mean0.02306118440628052
sim_compute_sim_state_median0.022825934886932377
sim_compute_sim_state_min0.022667551040649415
sim_physics_max0.05784837007522583
sim_physics_mean0.05594612169265747
sim_physics_median0.05647529363632202
sim_physics_min0.0540275231997172
sim_render-ego_max0.035842928091684975
sim_render-ego_mean0.035374524593353274
sim_render-ego_median0.03542458454767863
sim_render-ego_min0.03501381953557332
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
235613687ierosodinBaseline solution using reinforcement learningaido2-LF-sim-testingstep1-simulationabortedyes12920:15:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
235563682JBRRussiaSubmission 01aido2-LF-sim-validationstep1-simulationsuccessyes12920:10:14(hidden)
driven_lanedir_consec_median1.422651809660398
survival_time_median8.199999999999982
deviation-center-line_median0.6257883809066043
in-drivable-lane_median0


other stats
agent_compute-ego_max0.05111038103336241
agent_compute-ego_mean0.04935077495265598
agent_compute-ego_median0.05020163249384406
agent_compute-ego_min0.04729539155960083
deviation-center-line_max0.9579801037902312
deviation-center-line_mean0.5872113106406243
deviation-center-line_min0.17622398297250572
deviation-heading_max4.840773403748196
deviation-heading_mean2.430266033265879
deviation-heading_median2.557372147856163
deviation-heading_min0.37041614299191894
driven_any_max2.7575506306596673
driven_any_mean1.5256560871497111
driven_any_median1.4840847449067072
driven_any_min0.2766208937559502
driven_lanedir_consec_max2.4514960053285946
driven_lanedir_consec_mean1.404307239382241
driven_lanedir_consec_min0.27059756039014715
driven_lanedir_max2.4514960053285946
driven_lanedir_mean1.404307239382241
driven_lanedir_median1.422651809660398
driven_lanedir_min0.27059756039014715
in-drivable-lane_max0.4999999999999982
in-drivable-lane_mean0.11999999999999993
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.6354483681962906, "sim_physics": 0.06224086139742182, "survival_time": 9.049999999999994, "driven_lanedir": 1.5226932805301854, "sim_render-ego": 0.03754823774264004, "in-drivable-lane": 0, "agent_compute-ego": 0.050769171003478664, "deviation-heading": 2.557372147856163, "set_robot_commands": 0.056602547840518845, "deviation-center-line": 0.7265710131946099, "driven_lanedir_consec": 1.5226932805301854, "sim_compute_sim_state": 0.024351941946461713, "sim_compute_performance-ego": 0.040723572778438334, "sim_compute_robot_state-ego": 0.04300519379462985}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.7575506306596673, "sim_physics": 0.05927839756011963, "survival_time": 14.950000000000076, "driven_lanedir": 2.4514960053285946, "sim_render-ego": 0.037482986450195314, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.04737729867299398, "deviation-heading": 4.840773403748196, "set_robot_commands": 0.05640496095021566, "deviation-center-line": 0.9579801037902312, "driven_lanedir_consec": 2.4514960053285946, "sim_compute_sim_state": 0.024302876790364584, "sim_compute_performance-ego": 0.040114956696828206, "sim_compute_robot_state-ego": 0.04265688180923462}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2766208937559502, "sim_physics": 0.06376591655943128, "survival_time": 1.800000000000001, "driven_lanedir": 0.27059756039014715, "sim_render-ego": 0.03669107622570462, "in-drivable-lane": 0, "agent_compute-ego": 0.04729539155960083, "deviation-heading": 0.37041614299191894, "set_robot_commands": 0.054660300413767494, "deviation-center-line": 0.17622398297250572, "driven_lanedir_consec": 0.27059756039014715, "sim_compute_sim_state": 0.02501495016945733, "sim_compute_performance-ego": 0.04053062862820096, "sim_compute_robot_state-ego": 0.05264225271013048}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.474575798229941, "sim_physics": 0.0694755849662734, "survival_time": 8.14999999999998, "driven_lanedir": 1.3540975410018796, "sim_render-ego": 0.03704758802074596, "in-drivable-lane": 0, "agent_compute-ego": 0.05020163249384406, "deviation-heading": 2.913686363408195, "set_robot_commands": 0.062292542194296245, "deviation-center-line": 0.4494930723391705, "driven_lanedir_consec": 1.3540975410018796, "sim_compute_sim_state": 0.027258314238004157, "sim_compute_performance-ego": 0.04351236922609294, "sim_compute_robot_state-ego": 0.04809297228152035}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.4840847449067072, "sim_physics": 0.07809049617953417, "survival_time": 8.199999999999982, "driven_lanedir": 1.422651809660398, "sim_render-ego": 0.037443646570531335, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.05111038103336241, "deviation-heading": 1.469082108324921, "set_robot_commands": 0.07012814283370972, "deviation-center-line": 0.6257883809066043, "driven_lanedir_consec": 1.422651809660398, "sim_compute_sim_state": 0.029531880122859303, "sim_compute_performance-ego": 0.04395823217019802, "sim_compute_robot_state-ego": 0.04874322181794702}}
set_robot_commands_max0.07012814283370972
set_robot_commands_mean0.060017698846501585
set_robot_commands_median0.056602547840518845
set_robot_commands_min0.054660300413767494
sim_compute_performance-ego_max0.04395823217019802
sim_compute_performance-ego_mean0.041767951899951694
sim_compute_performance-ego_median0.040723572778438334
sim_compute_performance-ego_min0.040114956696828206
sim_compute_robot_state-ego_max0.05264225271013048
sim_compute_robot_state-ego_mean0.047028104482692464
sim_compute_robot_state-ego_median0.04809297228152035
sim_compute_robot_state-ego_min0.04265688180923462
sim_compute_sim_state_max0.029531880122859303
sim_compute_sim_state_mean0.02609199265342942
sim_compute_sim_state_median0.02501495016945733
sim_compute_sim_state_min0.024302876790364584
sim_physics_max0.07809049617953417
sim_physics_mean0.06657025133255606
sim_physics_median0.06376591655943128
sim_physics_min0.05927839756011963
sim_render-ego_max0.03754823774264004
sim_render-ego_mean0.03724270700196346
sim_render-ego_median0.037443646570531335
sim_render-ego_min0.03669107622570462
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.430000000000007
survival_time_min1.800000000000001
233953627enickyaido2-LF-sim-validationstep1-simulationsuccessyes12920:07:00(hidden)
driven_lanedir_consec_median0.7844848176668209
survival_time_median2.25
deviation-center-line_median0.16432855023302684
in-drivable-lane_median0.6999999999999993


other stats
agent_compute-ego_max0.13314243880185214
agent_compute-ego_mean0.13008323805296065
agent_compute-ego_median0.12929619740748752
agent_compute-ego_min0.12720149471646264
deviation-center-line_max0.4637715822030247
deviation-center-line_mean0.1917409410379035
deviation-center-line_min0.07142240775654032
deviation-heading_max0.750213746231227
deviation-heading_mean0.43110988204604783
deviation-heading_median0.33936691829842386
deviation-heading_min0.19652940452560944
driven_any_max2.21670895586739
driven_any_mean1.2682400059863554
driven_any_median1.014439070190444
driven_any_min0.4560705346067614
driven_lanedir_consec_max2.000812679704868
driven_lanedir_consec_mean0.9553515859426176
driven_lanedir_consec_min0.4345453281728786
driven_lanedir_max2.000812679704868
driven_lanedir_mean0.9553515859426176
driven_lanedir_median0.7844848176668209
driven_lanedir_min0.4345453281728786
in-drivable-lane_max5.049999999999983
in-drivable-lane_mean1.8199999999999936
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0116875356397412, "sim_physics": 0.08910990291171604, "survival_time": 2.25, "driven_lanedir": 0.6697553564194623, "sim_render-ego": 0.0474338796403673, "in-drivable-lane": 0.6999999999999993, "agent_compute-ego": 0.132470703125, "deviation-heading": 0.25835188233260464, "set_robot_commands": 0.07464659478929307, "deviation-center-line": 0.09456974525815567, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.030844847361246742, "sim_compute_performance-ego": 0.05286883248223199, "sim_compute_robot_state-ego": 0.05559528668721517}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.014439070190444, "sim_physics": 0.06960235890888032, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8871597477490597, "sim_render-ego": 0.04712452774956113, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.12720149471646264, "deviation-heading": 0.611087458842374, "set_robot_commands": 0.06766458352406819, "deviation-center-line": 0.16432855023302684, "driven_lanedir_consec": 0.8871597477490597, "sim_compute_sim_state": 0.029162037940252395, "sim_compute_performance-ego": 0.048914489291963126, "sim_compute_robot_state-ego": 0.05125523748851958}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.21670895586739, "sim_physics": 0.07666321165242772, "survival_time": 7.84999999999998, "driven_lanedir": 2.000812679704868, "sim_render-ego": 0.045518721744513053, "in-drivable-lane": 3.2499999999999885, "agent_compute-ego": 0.1283053562140009, "deviation-heading": 0.750213746231227, "set_robot_commands": 0.07069820811034767, "deviation-center-line": 0.4637715822030247, "driven_lanedir_consec": 2.000812679704868, "sim_compute_sim_state": 0.030574570795533003, "sim_compute_performance-ego": 0.05062306762500933, "sim_compute_robot_state-ego": 0.051720122622836165}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4560705346067614, "sim_physics": 0.09416700493205678, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4345453281728786, "sim_render-ego": 0.04614145105535334, "in-drivable-lane": 0, "agent_compute-ego": 0.13314243880185214, "deviation-heading": 0.33936691829842386, "set_robot_commands": 0.07086128538305109, "deviation-center-line": 0.07142240775654032, "driven_lanedir_consec": 0.4345453281728786, "sim_compute_sim_state": 0.028569297357039017, "sim_compute_performance-ego": 0.05931391499259255, "sim_compute_robot_state-ego": 0.05185069821097634}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6422939336274407, "sim_physics": 0.0732127877249234, "survival_time": 6.8999999999999835, "driven_lanedir": 0.7844848176668209, "sim_render-ego": 0.04768277769503386, "in-drivable-lane": 5.049999999999983, "agent_compute-ego": 0.12929619740748752, "deviation-heading": 0.19652940452560944, "set_robot_commands": 0.07223768165146095, "deviation-center-line": 0.16461241973877003, "driven_lanedir_consec": 0.7844848176668209, "sim_compute_sim_state": 0.03128200510273809, "sim_compute_performance-ego": 0.05093463780223459, "sim_compute_robot_state-ego": 0.053306475929591965}}
set_robot_commands_max0.07464659478929307
set_robot_commands_mean0.07122167069164419
set_robot_commands_median0.07086128538305109
set_robot_commands_min0.06766458352406819
sim_compute_performance-ego_max0.05931391499259255
sim_compute_performance-ego_mean0.05253098843880631
sim_compute_performance-ego_median0.05093463780223459
sim_compute_performance-ego_min0.048914489291963126
sim_compute_robot_state-ego_max0.05559528668721517
sim_compute_robot_state-ego_mean0.052745564187827845
sim_compute_robot_state-ego_median0.05185069821097634
sim_compute_robot_state-ego_min0.05125523748851958
sim_compute_sim_state_max0.03128200510273809
sim_compute_sim_state_mean0.030086551711361847
sim_compute_sim_state_median0.030574570795533003
sim_compute_sim_state_min0.028569297357039017
sim_physics_max0.09416700493205678
sim_physics_mean0.08055105322600084
sim_physics_median0.07666321165242772
sim_physics_min0.06960235890888032
sim_render-ego_max0.04768277769503386
sim_render-ego_mean0.04678027157696574
sim_render-ego_median0.04712452774956113
sim_render-ego_min0.045518721744513053
simulation-passed1
survival_time_max7.84999999999998
survival_time_mean4.039999999999993
survival_time_min1.1000000000000003
233593606riza.veliogluaido2-LF-sim-testingstep1-simulationerroryes12920:05:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
232943509Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFV-sim-testingstep1-simulationerroryes12920:10:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)