AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1172

evaluator1172
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2062
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success21
# timeout
# failed2
# error33
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors92%
RAM total (MB)60.0 GB
RAM free (MB)56.0 GB
Disk (MB)96.9 GB
Disk available (MB)47.3 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230703550AmaurXRunning the real lane following -- without challenge containeraido2-LF-sim-testingstep1-simulationerroryes11720:07:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230272372Liam Paullminimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessyes11720:19:29(hidden)
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.1689305391243036
agent_compute-ego_mean0.16250644651149762
agent_compute-ego_median0.16508952776590982
agent_compute-ego_min0.15565031574618432
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.19601857233390535, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06871264787029019, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1689305391243036, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.10841763105323848, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04283925440671633, "sim_compute_performance-ego": 0.07552030446718065, "sim_compute_robot_state-ego": 0.08348383320321281, "sim_compute_robot_state-npc0": 0.07622255009712933, "sim_compute_robot_state-npc1": 0.07584858283722143, "sim_compute_robot_state-npc2": 0.0757525653290234, "sim_compute_robot_state-npc3": 0.07684820332973123}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.20653357959928967, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06566224779401507, "in-drivable-lane": 0, "agent_compute-ego": 0.1657295719025627, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.10316293958633664, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.042916002727690195, "sim_compute_performance-ego": 0.07298570587521508, "sim_compute_robot_state-ego": 0.08378475052969796, "sim_compute_robot_state-npc0": 0.07576147715250652, "sim_compute_robot_state-npc1": 0.07527384303864978, "sim_compute_robot_state-npc2": 0.07603121560717387, "sim_compute_robot_state-npc3": 0.0769811887589712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.16949225319756403, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06378594716389974, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.15713227801852755, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.09720882309807671, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.04019492785135905, "sim_compute_performance-ego": 0.06818971104092068, "sim_compute_robot_state-ego": 0.07333150333828396, "sim_compute_robot_state-npc0": 0.07031216197543674, "sim_compute_robot_state-npc1": 0.07005647235446506, "sim_compute_robot_state-npc2": 0.06988974253336588, "sim_compute_robot_state-npc3": 0.0697970920138889}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.1806282689494471, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06469992009176087, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.15565031574618432, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.09792508947135116, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.0395633844735985, "sim_compute_performance-ego": 0.06902746341195524, "sim_compute_robot_state-ego": 0.07589436236614455, "sim_compute_robot_state-npc0": 0.0710241882482432, "sim_compute_robot_state-npc1": 0.07027243469167964, "sim_compute_robot_state-npc2": 0.07040042701404765, "sim_compute_robot_state-npc3": 0.0693279784945299}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.19300367340208993, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.06810017616029769, "in-drivable-lane": 0, "agent_compute-ego": 0.16508952776590982, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.10836267849755664, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04485487181042868, "sim_compute_performance-ego": 0.0758292107355027, "sim_compute_robot_state-ego": 0.081641295599559, "sim_compute_robot_state-npc0": 0.07437694640386672, "sim_compute_robot_state-npc1": 0.07443979429820227, "sim_compute_robot_state-npc2": 0.0741158856285943, "sim_compute_robot_state-npc3": 0.07579637330675883}}
set_robot_commands_max0.10841763105323848
set_robot_commands_mean0.10301543234131194
set_robot_commands_median0.10316293958633664
set_robot_commands_min0.09720882309807671
sim_compute_performance-ego_max0.0758292107355027
sim_compute_performance-ego_mean0.07231047910615487
sim_compute_performance-ego_median0.07298570587521508
sim_compute_performance-ego_min0.06818971104092068
sim_compute_robot_state-ego_max0.08378475052969796
sim_compute_robot_state-ego_mean0.07962714900737966
sim_compute_robot_state-ego_median0.081641295599559
sim_compute_robot_state-ego_min0.07333150333828396
sim_compute_robot_state-npc0_max0.07622255009712933
sim_compute_robot_state-npc0_mean0.0735394647754365
sim_compute_robot_state-npc0_median0.07437694640386672
sim_compute_robot_state-npc0_min0.07031216197543674
sim_compute_robot_state-npc1_max0.07584858283722143
sim_compute_robot_state-npc1_mean0.07317822544404365
sim_compute_robot_state-npc1_median0.07443979429820227
sim_compute_robot_state-npc1_min0.07005647235446506
sim_compute_robot_state-npc2_max0.07603121560717387
sim_compute_robot_state-npc2_mean0.07323796722244101
sim_compute_robot_state-npc2_median0.0741158856285943
sim_compute_robot_state-npc2_min0.06988974253336588
sim_compute_robot_state-npc3_max0.0769811887589712
sim_compute_robot_state-npc3_mean0.07375016718077601
sim_compute_robot_state-npc3_median0.07579637330675883
sim_compute_robot_state-npc3_min0.0693279784945299
sim_compute_sim_state_max0.04485487181042868
sim_compute_sim_state_mean0.042073688253958554
sim_compute_sim_state_median0.04283925440671633
sim_compute_sim_state_min0.0395633844735985
sim_physics_max0.20653357959928967
sim_physics_mean0.18913526949645923
sim_physics_median0.19300367340208993
sim_physics_min0.16949225319756403
sim_render-ego_max0.06871264787029019
sim_render-ego_mean0.06619218781605271
sim_render-ego_median0.06566224779401507
sim_render-ego_min0.06378594716389974
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
230082395Liam Paullrandom_agentaido2-LFV-sim-testingstep1-simulationsuccessyes11720:21:57(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.1553578105153917
agent_compute-ego_mean0.14418558541921575
agent_compute-ego_median0.14990535804203578
agent_compute-ego_min0.10728226209941664
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17158069433989348, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06527552781281648, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1515495909584893, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10721093636971932, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04280280625378644, "sim_compute_performance-ego": 0.07248444910402652, "sim_compute_robot_state-ego": 0.0771334347901521, "sim_compute_robot_state-npc0": 0.07283435044465242, "sim_compute_robot_state-npc1": 0.07446714683815285, "sim_compute_robot_state-npc2": 0.07501930660671657, "sim_compute_robot_state-npc3": 0.07120426495869954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.22017813682556153, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06273139953613281, "in-drivable-lane": 0, "agent_compute-ego": 0.13891595840454102, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10408958435058592, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04080988883972168, "sim_compute_performance-ego": 0.07058736801147461, "sim_compute_robot_state-ego": 0.0802312183380127, "sim_compute_robot_state-npc0": 0.07548025131225586, "sim_compute_robot_state-npc1": 0.0736103343963623, "sim_compute_robot_state-npc2": 0.07572793960571289, "sim_compute_robot_state-npc3": 0.0727196216583252}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19707146130110087, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06712234647650468, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14408513119346217, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09891426876971596, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04257477584638094, "sim_compute_performance-ego": 0.07376511159696077, "sim_compute_robot_state-ego": 0.07860646436088964, "sim_compute_robot_state-npc0": 0.07210695429852135, "sim_compute_robot_state-npc1": 0.0743686462703504, "sim_compute_robot_state-npc2": 0.07105225324630737, "sim_compute_robot_state-npc3": 0.07284513586445858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.21014773996570443, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.07056374489506588, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1553578105153917, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10214860228043568, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04215022883837736, "sim_compute_performance-ego": 0.07549923884717724, "sim_compute_robot_state-ego": 0.08318395554264889, "sim_compute_robot_state-npc0": 0.07301198983494239, "sim_compute_robot_state-npc1": 0.07176041301292709, "sim_compute_robot_state-npc2": 0.07286113726941845, "sim_compute_robot_state-npc3": 0.07510513293592236}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.183304991040911, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06470528670719691, "in-drivable-lane": 0, "agent_compute-ego": 0.14990535804203578, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10141559158052715, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04392319066183908, "sim_compute_performance-ego": 0.06978901794978551, "sim_compute_robot_state-ego": 0.0754690340587071, "sim_compute_robot_state-npc0": 0.07782125473022461, "sim_compute_robot_state-npc1": 0.08016096694128853, "sim_compute_robot_state-npc2": 0.07398016963686262, "sim_compute_robot_state-npc3": 0.07511441196714129}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.15115302138858372, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05616774823930529, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.12165565843935366, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08430283157913773, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03652504196873418, "sim_compute_performance-ego": 0.06319224834442139, "sim_compute_robot_state-ego": 0.0672747117501718, "sim_compute_robot_state-npc0": 0.06206461235328957, "sim_compute_robot_state-npc1": 0.06426377649660464, "sim_compute_robot_state-npc2": 0.06161738325048376, "sim_compute_robot_state-npc3": 0.06172529414848045}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16672401516525834, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06240208943684896, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.14125484448892098, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.10261382438518384, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.04234545319168656, "sim_compute_performance-ego": 0.06893315580156115, "sim_compute_robot_state-ego": 0.07561107476552327, "sim_compute_robot_state-npc0": 0.07246674431694879, "sim_compute_robot_state-npc1": 0.07148873805999756, "sim_compute_robot_state-npc2": 0.07223911638613101, "sim_compute_robot_state-npc3": 0.07178357353916874}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.24017459551493328, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.07152847713894314, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.154296875, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10988669925265844, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04543991618686252, "sim_compute_performance-ego": 0.07850146823459202, "sim_compute_robot_state-ego": 0.08665118217468262, "sim_compute_robot_state-npc0": 0.07961153454250759, "sim_compute_robot_state-npc1": 0.07926014794243706, "sim_compute_robot_state-npc2": 0.07767641279432509, "sim_compute_robot_state-npc3": 0.07512300279405382}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.17945859743201217, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06612615481666896, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1495915184850278, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10747438928355342, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04356614921403968, "sim_compute_performance-ego": 0.07119040385536525, "sim_compute_robot_state-ego": 0.07845100630884586, "sim_compute_robot_state-npc0": 0.07727353987486466, "sim_compute_robot_state-npc1": 0.07615792751312256, "sim_compute_robot_state-npc2": 0.07430455477341362, "sim_compute_robot_state-npc3": 0.07317716142405635}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.20512887001037597, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06925641536712647, "in-drivable-lane": 0, "agent_compute-ego": 0.15192174911499023, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10543683528900148, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.0447259521484375, "sim_compute_performance-ego": 0.07887151718139648, "sim_compute_robot_state-ego": 0.08260430812835694, "sim_compute_robot_state-npc0": 0.07410776138305664, "sim_compute_robot_state-npc1": 0.07512409687042236, "sim_compute_robot_state-npc2": 0.07486736297607421, "sim_compute_robot_state-npc3": 0.07679613590240479}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.19287055730819705, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06123565435409546, "in-drivable-lane": 0, "agent_compute-ego": 0.13496770858764648, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.09661552906036378, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.037418174743652347, "sim_compute_performance-ego": 0.06983166933059692, "sim_compute_robot_state-ego": 0.07053611278533936, "sim_compute_robot_state-npc0": 0.07005132436752319, "sim_compute_robot_state-npc1": 0.06907548904418945, "sim_compute_robot_state-npc2": 0.07232738733291626, "sim_compute_robot_state-npc3": 0.07278404235839844}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1378201685453716, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.046443048276399314, "in-drivable-lane": 0, "agent_compute-ego": 0.10728226209941664, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.07120995772512335, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.03262174756903397, "sim_compute_performance-ego": 0.05622674289502596, "sim_compute_robot_state-ego": 0.05763012484500283, "sim_compute_robot_state-npc0": 0.05531329857675653, "sim_compute_robot_state-npc1": 0.05928441097861842, "sim_compute_robot_state-npc2": 0.06107844804462634, "sim_compute_robot_state-npc3": 0.06106162071228027}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1786053228378296, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06624415397644043, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15382811069488525, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10149191856384278, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04154759407043457, "sim_compute_performance-ego": 0.07546787738800048, "sim_compute_robot_state-ego": 0.08201432704925538, "sim_compute_robot_state-npc0": 0.07671097278594971, "sim_compute_robot_state-npc1": 0.07515477180480958, "sim_compute_robot_state-npc2": 0.07460204601287841, "sim_compute_robot_state-npc3": 0.08378151893615722}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2646293640136719, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.0693238756873391, "in-drivable-lane": 0, "agent_compute-ego": 0.15294242988933215, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.1026681119745428, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04340583627874201, "sim_compute_performance-ego": 0.07928321578285911, "sim_compute_robot_state-ego": 0.08591281283985484, "sim_compute_robot_state-npc0": 0.07504024288871071, "sim_compute_robot_state-npc1": 0.07605258984999223, "sim_compute_robot_state-npc2": 0.0739614421671087, "sim_compute_robot_state-npc3": 0.07161372358148749}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.22185018111248409, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.07310232337640256, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.15522877537474342, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10673820242589832, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04443809937457649, "sim_compute_performance-ego": 0.07915616522029954, "sim_compute_robot_state-ego": 0.0892901323279556, "sim_compute_robot_state-npc0": 0.0773710231391751, "sim_compute_robot_state-npc1": 0.07945268494742257, "sim_compute_robot_state-npc2": 0.07749847489960339, "sim_compute_robot_state-npc3": 0.07572469905931123}}
set_robot_commands_max0.10988669925265844
set_robot_commands_mean0.10014781885935266
set_robot_commands_median0.10261382438518384
set_robot_commands_min0.07120995772512335
sim_compute_performance-ego_max0.07928321578285911
sim_compute_performance-ego_mean0.07218530996956952
sim_compute_performance-ego_median0.07248444910402652
sim_compute_performance-ego_min0.05622674289502596
sim_compute_robot_state-ego_max0.0892901323279556
sim_compute_robot_state-ego_mean0.07803999333769325
sim_compute_robot_state-ego_median0.07860646436088964
sim_compute_robot_state-ego_min0.05763012484500283
sim_compute_robot_state-npc0_max0.07961153454250759
sim_compute_robot_state-npc0_mean0.0727510569899586
sim_compute_robot_state-npc0_median0.07410776138305664
sim_compute_robot_state-npc0_min0.05531329857675653
sim_compute_robot_state-npc1_max0.08016096694128853
sim_compute_robot_state-npc1_mean0.07331214273111318
sim_compute_robot_state-npc1_median0.07446714683815285
sim_compute_robot_state-npc1_min0.05928441097861842
sim_compute_robot_state-npc2_max0.07767641279432509
sim_compute_robot_state-npc2_mean0.07258756233350525
sim_compute_robot_state-npc2_median0.07398016963686262
sim_compute_robot_state-npc2_min0.06107844804462634
sim_compute_robot_state-npc3_max0.08378151893615722
sim_compute_robot_state-npc3_mean0.07270395598935638
sim_compute_robot_state-npc3_median0.07284513586445858
sim_compute_robot_state-npc3_min0.06106162071228027
sim_compute_sim_state_max0.04543991618686252
sim_compute_sim_state_mean0.04161965701242035
sim_compute_sim_state_median0.04257477584638094
sim_compute_sim_state_min0.03262174756903397
sim_physics_max0.2646293640136719
sim_physics_mean0.1947131811201259
sim_physics_median0.19287055730819705
sim_physics_min0.1378201685453716
sim_render-ego_max0.07310232337640256
sim_render-ego_mean0.06481521640648577
sim_render-ego_median0.06612615481666896
sim_render-ego_min0.046443048276399314
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
229902413jp18813100494Baseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerroryes11720:15:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229822425Andrea Censirandom_agentaido2-LFVI-sim-validationstep1-simulationsuccessyes11720:10:36(hidden)
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1513070736116576
agent_compute-ego_mean0.14321717316138177
agent_compute-ego_median0.14767409879950028
agent_compute-ego_min0.1202344780876523
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22881967508340184, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.07127259351030181, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14767409879950028, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10519555852382996, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.043533922750738606, "sim_compute_performance-ego": 0.07612518117397646, "sim_compute_robot_state-ego": 0.0811745939375479, "sim_compute_robot_state-npc0": 0.07491615754139574, "sim_compute_robot_state-npc1": 0.07198269457756719, "sim_compute_robot_state-npc2": 0.07262359993367255, "sim_compute_robot_state-npc3": 0.07348666311819342}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22755334206989833, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06434604951313563, "in-drivable-lane": 0, "agent_compute-ego": 0.15092618124825613, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0989066447530474, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04094005482537406, "sim_compute_performance-ego": 0.06930228642054967, "sim_compute_robot_state-ego": 0.07600527150290352, "sim_compute_robot_state-npc0": 0.07507887056895665, "sim_compute_robot_state-npc1": 0.07072934934071132, "sim_compute_robot_state-npc2": 0.07293916600091117, "sim_compute_robot_state-npc3": 0.07284464154924665}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.21312438400046335, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06855947994491429, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1513070736116576, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.1045813028094838, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.042409670005724265, "sim_compute_performance-ego": 0.07672920273345651, "sim_compute_robot_state-ego": 0.08200758869208179, "sim_compute_robot_state-npc0": 0.0750435602317736, "sim_compute_robot_state-npc1": 0.07487697045779923, "sim_compute_robot_state-npc2": 0.0758296841556586, "sim_compute_robot_state-npc3": 0.0748345574128975}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2467664877573649, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06726569930712382, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14594403405984244, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09989510973294576, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04306607445081075, "sim_compute_performance-ego": 0.08018941183884938, "sim_compute_robot_state-ego": 0.0819829950730006, "sim_compute_robot_state-npc0": 0.0728884885708491, "sim_compute_robot_state-npc1": 0.0729912519454956, "sim_compute_robot_state-npc2": 0.07377926011880238, "sim_compute_robot_state-npc3": 0.07320375740528107}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17774483135768346, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05446821167355492, "in-drivable-lane": 0, "agent_compute-ego": 0.1202344780876523, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08932248751322429, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03266568410964239, "sim_compute_performance-ego": 0.0640490282149542, "sim_compute_robot_state-ego": 0.06837354387555804, "sim_compute_robot_state-npc0": 0.06058557828267416, "sim_compute_robot_state-npc1": 0.062002159300304595, "sim_compute_robot_state-npc2": 0.0607147216796875, "sim_compute_robot_state-npc3": 0.0629684811546689}}
set_robot_commands_max0.10519555852382996
set_robot_commands_mean0.09958022066650624
set_robot_commands_median0.09989510973294576
set_robot_commands_min0.08932248751322429
sim_compute_performance-ego_max0.08018941183884938
sim_compute_performance-ego_mean0.07327902207635724
sim_compute_performance-ego_median0.07612518117397646
sim_compute_performance-ego_min0.0640490282149542
sim_compute_robot_state-ego_max0.08200758869208179
sim_compute_robot_state-ego_mean0.07790879861621838
sim_compute_robot_state-ego_median0.0811745939375479
sim_compute_robot_state-ego_min0.06837354387555804
sim_compute_robot_state-npc0_max0.07507887056895665
sim_compute_robot_state-npc0_mean0.07170253103912985
sim_compute_robot_state-npc0_median0.07491615754139574
sim_compute_robot_state-npc0_min0.06058557828267416
sim_compute_robot_state-npc1_max0.07487697045779923
sim_compute_robot_state-npc1_mean0.0705164851243756
sim_compute_robot_state-npc1_median0.07198269457756719
sim_compute_robot_state-npc1_min0.062002159300304595
sim_compute_robot_state-npc2_max0.0758296841556586
sim_compute_robot_state-npc2_mean0.07117728637774644
sim_compute_robot_state-npc2_median0.07293916600091117
sim_compute_robot_state-npc2_min0.0607147216796875
sim_compute_robot_state-npc3_max0.0748345574128975
sim_compute_robot_state-npc3_mean0.0714676201280575
sim_compute_robot_state-npc3_median0.07320375740528107
sim_compute_robot_state-npc3_min0.0629684811546689
sim_compute_sim_state_max0.043533922750738606
sim_compute_sim_state_mean0.04052308122845801
sim_compute_sim_state_median0.042409670005724265
sim_compute_sim_state_min0.03266568410964239
sim_physics_max0.2467664877573649
sim_physics_mean0.21880174405376235
sim_physics_median0.22755334206989833
sim_physics_min0.17774483135768346
sim_render-ego_max0.07127259351030181
sim_render-ego_mean0.06518240678980611
sim_render-ego_median0.06726569930712382
sim_render-ego_min0.05446821167355492
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
229732442Jacopo Tanirandom_agentaido2-LFV-sim-validationstep1-simulationsuccessyes11720:09:27(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.17204000980039186
agent_compute-ego_mean0.1653974694114921
agent_compute-ego_median0.16555091857910156
agent_compute-ego_min0.15911416496549333
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16396369315959788, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06835830653155292, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16719133765609176, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10391752808182328, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04211414301836932, "sim_compute_performance-ego": 0.07634818995440448, "sim_compute_robot_state-ego": 0.07777493971365469, "sim_compute_robot_state-npc0": 0.07280560334523518, "sim_compute_robot_state-npc1": 0.07203345828586155, "sim_compute_robot_state-npc2": 0.0808576919414379, "sim_compute_robot_state-npc3": 0.07573665512932672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21602338790893555, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06986265182495117, "in-drivable-lane": 0, "agent_compute-ego": 0.16555091857910156, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.108322172164917, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04456878662109375, "sim_compute_performance-ego": 0.079002046585083, "sim_compute_robot_state-ego": 0.0824167251586914, "sim_compute_robot_state-npc0": 0.07251471519470215, "sim_compute_robot_state-npc1": 0.0711040210723877, "sim_compute_robot_state-npc2": 0.07230816841125488, "sim_compute_robot_state-npc3": 0.07589304924011231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19753612970051013, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06623592502192448, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16309091605638204, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.1045794832079034, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03970939234683389, "sim_compute_performance-ego": 0.07422333642056114, "sim_compute_robot_state-ego": 0.08191611892298649, "sim_compute_robot_state-npc0": 0.07450389862060547, "sim_compute_robot_state-npc1": 0.07361858455758345, "sim_compute_robot_state-npc2": 0.07358205632159584, "sim_compute_robot_state-npc3": 0.07177740021755821}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2023926837534844, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06809459155118919, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.17204000980039186, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10913452619238743, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04256306117094016, "sim_compute_performance-ego": 0.07497951350634612, "sim_compute_robot_state-ego": 0.07805336276187172, "sim_compute_robot_state-npc0": 0.07547528230691258, "sim_compute_robot_state-npc1": 0.07327578339395643, "sim_compute_robot_state-npc2": 0.07600068744224837, "sim_compute_robot_state-npc3": 0.07444791250591036}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18318985189710343, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06438991853169032, "in-drivable-lane": 0, "agent_compute-ego": 0.15911416496549333, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09671167816434588, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.040085409368787496, "sim_compute_performance-ego": 0.06691393681934901, "sim_compute_robot_state-ego": 0.07915466172354561, "sim_compute_robot_state-npc0": 0.07084367104939052, "sim_compute_robot_state-npc1": 0.06905056749071393, "sim_compute_robot_state-npc2": 0.07288741213934762, "sim_compute_robot_state-npc3": 0.07163919721330915}}
set_robot_commands_max0.10913452619238743
set_robot_commands_mean0.1045330775622754
set_robot_commands_median0.1045794832079034
set_robot_commands_min0.09671167816434588
sim_compute_performance-ego_max0.079002046585083
sim_compute_performance-ego_mean0.07429340465714876
sim_compute_performance-ego_median0.07497951350634612
sim_compute_performance-ego_min0.06691393681934901
sim_compute_robot_state-ego_max0.0824167251586914
sim_compute_robot_state-ego_mean0.07986316165614998
sim_compute_robot_state-ego_median0.07915466172354561
sim_compute_robot_state-ego_min0.07777493971365469
sim_compute_robot_state-npc0_max0.07547528230691258
sim_compute_robot_state-npc0_mean0.07322863410336918
sim_compute_robot_state-npc0_median0.07280560334523518
sim_compute_robot_state-npc0_min0.07084367104939052
sim_compute_robot_state-npc1_max0.07361858455758345
sim_compute_robot_state-npc1_mean0.07181648296010061
sim_compute_robot_state-npc1_median0.07203345828586155
sim_compute_robot_state-npc1_min0.06905056749071393
sim_compute_robot_state-npc2_max0.0808576919414379
sim_compute_robot_state-npc2_mean0.07512720325117692
sim_compute_robot_state-npc2_median0.07358205632159584
sim_compute_robot_state-npc2_min0.07230816841125488
sim_compute_robot_state-npc3_max0.07589304924011231
sim_compute_robot_state-npc3_mean0.07389884286124335
sim_compute_robot_state-npc3_median0.07444791250591036
sim_compute_robot_state-npc3_min0.07163919721330915
sim_compute_sim_state_max0.04456878662109375
sim_compute_sim_state_mean0.041808158505204925
sim_compute_sim_state_median0.04211414301836932
sim_compute_sim_state_min0.03970939234683389
sim_physics_max0.21602338790893555
sim_physics_mean0.1926211492839263
sim_physics_median0.19753612970051013
sim_physics_min0.16396369315959788
sim_render-ego_max0.06986265182495117
sim_render-ego_mean0.06738827869226163
sim_render-ego_median0.06809459155118919
sim_render-ego_min0.06438991853169032
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
229422496Liam Paullchallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessyes11720:18:58(hidden)
driven_lanedir_consec_median0.08278118188177608
survival_time_median1.4000000000000006
deviation-center-line_median0.0891189905794223
in-drivable-lane_median0.5500000000000004


other stats
agent_compute-ego_max0.1975432691119966
agent_compute-ego_mean0.18634589247913153
agent_compute-ego_median0.18673363557228675
agent_compute-ego_min0.17621033390363058
deviation-center-line_max0.3160797831874244
deviation-center-line_mean0.13929092192316905
deviation-center-line_min0.015973128257746334
deviation-heading_max5.955097246085351
deviation-heading_mean2.5389602703729897
deviation-heading_median0.6041246682862939
deviation-heading_min0.4868278401353335
driven_any_max1.7638533736827344
driven_any_mean0.7134532991078512
driven_any_median0.12542848288208402
driven_any_min0.1160380996671193
driven_lanedir_consec_max0.5777702192944716
driven_lanedir_consec_mean0.24417695812278312
driven_lanedir_consec_min0.02699196025978712
driven_lanedir_max0.5777702192944716
driven_lanedir_mean0.24417695812278312
driven_lanedir_median0.08278118188177608
driven_lanedir_min0.02699196025978712
in-drivable-lane_max7.250000000000044
in-drivable-lane_mean2.8500000000000147
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.7638533736827344, "sim_physics": 0.18912181695302327, "survival_time": 14.950000000000076, "driven_lanedir": 0.5777702192944716, "sim_render-ego": 0.06791524410247803, "in-drivable-lane": 7.250000000000044, "agent_compute-ego": 0.18723393201828004, "deviation-heading": 5.955097246085351, "set_robot_commands": 0.1033493399620056, "deviation-center-line": 0.3160797831874244, "driven_lanedir_consec": 0.5777702192944716, "sim_compute_sim_state": 0.042635249296824135, "sim_compute_performance-ego": 0.07523764689763388, "sim_compute_robot_state-ego": 0.0799435544013977, "sim_compute_robot_state-npc0": 0.07550516923268637, "sim_compute_robot_state-npc1": 0.0734904670715332, "sim_compute_robot_state-npc2": 0.07435404380162557, "sim_compute_robot_state-npc3": 0.07428795814514161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4451861957012877, "sim_physics": 0.18612462190481333, "survival_time": 13.00000000000005, "driven_lanedir": 0.4654927550946315, "sim_render-ego": 0.0677170047393212, "in-drivable-lane": 6.300000000000028, "agent_compute-ego": 0.18673363557228675, "deviation-heading": 5.127888481583611, "set_robot_commands": 0.10520442724227903, "deviation-center-line": 0.19441458891663907, "driven_lanedir_consec": 0.4654927550946315, "sim_compute_sim_state": 0.04383310904869667, "sim_compute_performance-ego": 0.07729591773106502, "sim_compute_robot_state-ego": 0.08316834156329815, "sim_compute_robot_state-npc0": 0.07704217433929443, "sim_compute_robot_state-npc1": 0.0758605406834529, "sim_compute_robot_state-npc2": 0.07512778502244216, "sim_compute_robot_state-npc3": 0.07642465646450336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1167603436060304, "sim_physics": 0.2548132964542934, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08278118188177608, "sim_render-ego": 0.06899980136326381, "in-drivable-lane": 0, "agent_compute-ego": 0.1975432691119966, "deviation-heading": 0.4868278401353335, "set_robot_commands": 0.10608847935994466, "deviation-center-line": 0.0891189905794223, "driven_lanedir_consec": 0.08278118188177608, "sim_compute_sim_state": 0.04888554981776646, "sim_compute_performance-ego": 0.08462674277169364, "sim_compute_robot_state-ego": 0.1022579102289109, "sim_compute_robot_state-npc0": 0.08176141693478539, "sim_compute_robot_state-npc1": 0.08226010912940615, "sim_compute_robot_state-npc2": 0.08080657323201497, "sim_compute_robot_state-npc3": 0.08132363501049224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1160380996671193, "sim_physics": 0.206583966811498, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06784867408324935, "sim_render-ego": 0.06923463940620422, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17621033390363058, "deviation-heading": 0.5208631157743573, "set_robot_commands": 0.09943584601084392, "deviation-center-line": 0.08086811867461316, "driven_lanedir_consec": 0.06784867408324935, "sim_compute_sim_state": 0.03953632712364197, "sim_compute_performance-ego": 0.07714982827504475, "sim_compute_robot_state-ego": 0.07374896605809529, "sim_compute_robot_state-npc0": 0.07394877076148987, "sim_compute_robot_state-npc1": 0.07324243585268657, "sim_compute_robot_state-npc2": 0.07105984290440877, "sim_compute_robot_state-npc3": 0.06968148549397786}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.12542848288208402, "sim_physics": 0.1947121109281267, "survival_time": 1.4000000000000006, "driven_lanedir": 0.02699196025978712, "sim_render-ego": 0.0721098440034049, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.1840082917894636, "deviation-heading": 0.6041246682862939, "set_robot_commands": 0.10181240524564472, "deviation-center-line": 0.015973128257746334, "driven_lanedir_consec": 0.02699196025978712, "sim_compute_sim_state": 0.04330669130597796, "sim_compute_performance-ego": 0.08021514756338936, "sim_compute_robot_state-ego": 0.08230716841561454, "sim_compute_robot_state-npc0": 0.07906524624143328, "sim_compute_robot_state-npc1": 0.07780339888163976, "sim_compute_robot_state-npc2": 0.0725421564919608, "sim_compute_robot_state-npc3": 0.0783510719026838}}
set_robot_commands_max0.10608847935994466
set_robot_commands_mean0.1031780995641436
set_robot_commands_median0.1033493399620056
set_robot_commands_min0.09943584601084392
sim_compute_performance-ego_max0.08462674277169364
sim_compute_performance-ego_mean0.07890505664776533
sim_compute_performance-ego_median0.07729591773106502
sim_compute_performance-ego_min0.07523764689763388
sim_compute_robot_state-ego_max0.1022579102289109
sim_compute_robot_state-ego_mean0.0842851881334633
sim_compute_robot_state-ego_median0.08230716841561454
sim_compute_robot_state-ego_min0.07374896605809529
sim_compute_robot_state-npc0_max0.08176141693478539
sim_compute_robot_state-npc0_mean0.07746455550193787
sim_compute_robot_state-npc0_median0.07704217433929443
sim_compute_robot_state-npc0_min0.07394877076148987
sim_compute_robot_state-npc1_max0.08226010912940615
sim_compute_robot_state-npc1_mean0.07653139032374372
sim_compute_robot_state-npc1_median0.0758605406834529
sim_compute_robot_state-npc1_min0.07324243585268657
sim_compute_robot_state-npc2_max0.08080657323201497
sim_compute_robot_state-npc2_mean0.07477808029049045
sim_compute_robot_state-npc2_median0.07435404380162557
sim_compute_robot_state-npc2_min0.07105984290440877
sim_compute_robot_state-npc3_max0.08132363501049224
sim_compute_robot_state-npc3_mean0.07601376140335978
sim_compute_robot_state-npc3_median0.07642465646450336
sim_compute_robot_state-npc3_min0.06968148549397786
sim_compute_sim_state_max0.04888554981776646
sim_compute_sim_state_mean0.043639385318581435
sim_compute_sim_state_median0.04330669130597796
sim_compute_sim_state_min0.03953632712364197
sim_physics_max0.2548132964542934
sim_physics_mean0.20627116261035097
sim_physics_median0.1947121109281267
sim_physics_min0.18612462190481333
sim_render-ego_max0.0721098440034049
sim_render-ego_mean0.06919530672293443
sim_render-ego_median0.06899980136326381
sim_render-ego_min0.0677170047393212
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.320000000000026
survival_time_min1.0500000000000005
229282509RamiNaimchallenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerroryes11720:01:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229072536Liam Paullbaseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11720:04:16
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228782590Julian Zillybaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes11720:29:32
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228742596Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11720:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228732597Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11720:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228502644zamatorychallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessyes11720:27:10(hidden)
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.07913545199802943
agent_compute-ego_mean0.07449237095353241
agent_compute-ego_median0.07496196031570435
agent_compute-ego_min0.06973845572084994
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.18471095931362097, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0681402884738546, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07674082903794839, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10487196479045167, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04142232679984939, "sim_compute_performance-ego": 0.07401034865580813, "sim_compute_robot_state-ego": 0.07916034107476892, "sim_compute_robot_state-npc0": 0.07417391387509628, "sim_compute_robot_state-npc1": 0.0740076891133483, "sim_compute_robot_state-npc2": 0.07304646935261472, "sim_compute_robot_state-npc3": 0.07369482013541208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.21684011071920395, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06651924550533295, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07500080019235611, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.1003878191113472, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04406455159187317, "sim_compute_performance-ego": 0.07486630976200104, "sim_compute_robot_state-ego": 0.08481421321630478, "sim_compute_robot_state-npc0": 0.07373550534248352, "sim_compute_robot_state-npc1": 0.07279504090547562, "sim_compute_robot_state-npc2": 0.07589297741651535, "sim_compute_robot_state-npc3": 0.07735739648342133}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.2091369995704064, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.0667339563369751, "in-drivable-lane": 0, "agent_compute-ego": 0.07496196031570435, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.1038284393457266, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04033804398316603, "sim_compute_performance-ego": 0.07680705418953529, "sim_compute_robot_state-ego": 0.0942600598702064, "sim_compute_robot_state-npc0": 0.07307683504544772, "sim_compute_robot_state-npc1": 0.0745918475664579, "sim_compute_robot_state-npc2": 0.07353613926814152, "sim_compute_robot_state-npc3": 0.07172696865521945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.21459559727740543, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06811651619531775, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0763096809387207, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.10620016436423024, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04581197871956774, "sim_compute_performance-ego": 0.07600889154659804, "sim_compute_robot_state-ego": 0.08712012024335963, "sim_compute_robot_state-npc0": 0.07462663291603007, "sim_compute_robot_state-npc1": 0.0729456409331291, "sim_compute_robot_state-npc2": 0.0736506215987667, "sim_compute_robot_state-npc3": 0.07684189529829127}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.22047461782182967, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06980596269880023, "in-drivable-lane": 0, "agent_compute-ego": 0.07913545199802943, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.110781953448341, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04277202061244419, "sim_compute_performance-ego": 0.07605912571861631, "sim_compute_robot_state-ego": 0.09032387960524786, "sim_compute_robot_state-npc0": 0.07845115661621094, "sim_compute_robot_state-npc1": 0.07843859990437825, "sim_compute_robot_state-npc2": 0.07839478765215192, "sim_compute_robot_state-npc3": 0.07631297338576544}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.18660945734701867, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.06313815589778679, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.07163423743129761, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.09518232227356964, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.039934398714175895, "sim_compute_performance-ego": 0.06922459996436253, "sim_compute_robot_state-ego": 0.07652435617998612, "sim_compute_robot_state-npc0": 0.07374517779704953, "sim_compute_robot_state-npc1": 0.06864189116422795, "sim_compute_robot_state-npc2": 0.06964894562713371, "sim_compute_robot_state-npc3": 0.07039062444828759}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.18385265838532225, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.06321603059768677, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0700681209564209, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.10028538533619472, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.041574018342154365, "sim_compute_performance-ego": 0.07196937572388422, "sim_compute_robot_state-ego": 0.07807062637238275, "sim_compute_robot_state-npc0": 0.07139181806927636, "sim_compute_robot_state-npc1": 0.07443924177260626, "sim_compute_robot_state-npc2": 0.0732546675772894, "sim_compute_robot_state-npc3": 0.07280591556004115}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.2022600625012372, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06366954623041926, "in-drivable-lane": 0, "agent_compute-ego": 0.06973845572084994, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.09734498487936484, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.04205184691661113, "sim_compute_performance-ego": 0.0730354270419559, "sim_compute_robot_state-ego": 0.07726746314280741, "sim_compute_robot_state-npc0": 0.07229541121302424, "sim_compute_robot_state-npc1": 0.07130748838991732, "sim_compute_robot_state-npc2": 0.07191603892558329, "sim_compute_robot_state-npc3": 0.07142829250644993}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.1801835364765591, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06625636418660481, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07277243336041768, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.1004791027969784, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.04042817155520121, "sim_compute_performance-ego": 0.0732245213455624, "sim_compute_robot_state-ego": 0.0778932770093282, "sim_compute_robot_state-npc0": 0.07505567868550618, "sim_compute_robot_state-npc1": 0.07363707489437527, "sim_compute_robot_state-npc2": 0.07354340288374159, "sim_compute_robot_state-npc3": 0.07406127452850342}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.22600426406503837, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06761682590591574, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07438876472900961, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.10169498719901682, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.041966685624880214, "sim_compute_performance-ego": 0.07252001539569035, "sim_compute_robot_state-ego": 0.08037916967801959, "sim_compute_robot_state-npc0": 0.07218689562004303, "sim_compute_robot_state-npc1": 0.07675089568735283, "sim_compute_robot_state-npc2": 0.07254287015611881, "sim_compute_robot_state-npc3": 0.07131145156432535}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.23385113256948967, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.07031467225816515, "in-drivable-lane": 0, "agent_compute-ego": 0.07391037764372649, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.108041869269477, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.0427421905376293, "sim_compute_performance-ego": 0.07570041550530328, "sim_compute_robot_state-ego": 0.09127739623740869, "sim_compute_robot_state-npc0": 0.07642535810117368, "sim_compute_robot_state-npc1": 0.07611306508382161, "sim_compute_robot_state-npc2": 0.07740615915369105, "sim_compute_robot_state-npc3": 0.07607811468618887}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.1971131706237793, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06515002250671387, "in-drivable-lane": 0, "agent_compute-ego": 0.07639513015747071, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.10110649108886718, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.04204245567321777, "sim_compute_performance-ego": 0.07428007125854492, "sim_compute_robot_state-ego": 0.07887042999267578, "sim_compute_robot_state-npc0": 0.07755794525146484, "sim_compute_robot_state-npc1": 0.07687727928161621, "sim_compute_robot_state-npc2": 0.07934060096740722, "sim_compute_robot_state-npc3": 0.07701337814331055}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1835240508025547, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06478748681410304, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07591422098987508, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10481437647117758, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.042504504041851694, "sim_compute_performance-ego": 0.0747360553381578, "sim_compute_robot_state-ego": 0.08460343558833285, "sim_compute_robot_state-npc0": 0.07672204611436376, "sim_compute_robot_state-npc1": 0.07669226628429485, "sim_compute_robot_state-npc2": 0.07408729139363991, "sim_compute_robot_state-npc3": 0.07464614904151773}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.2183247612368676, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06563300471152028, "in-drivable-lane": 0, "agent_compute-ego": 0.07444872394684822, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.10492134863330473, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.04362577776755056, "sim_compute_performance-ego": 0.0727936452434909, "sim_compute_robot_state-ego": 0.0802373501562303, "sim_compute_robot_state-npc0": 0.07773786206399241, "sim_compute_robot_state-npc1": 0.07484193002024005, "sim_compute_robot_state-npc2": 0.07420422953944053, "sim_compute_robot_state-npc3": 0.07740851371519027}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.20378382065716913, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06450654478634105, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07596637688431085, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.10269753605711694, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.03965565270068599, "sim_compute_performance-ego": 0.06960250817093194, "sim_compute_robot_state-ego": 0.0733328286339255, "sim_compute_robot_state-npc0": 0.07260991077797085, "sim_compute_robot_state-npc1": 0.07433451390733906, "sim_compute_robot_state-npc2": 0.07219679215375115, "sim_compute_robot_state-npc3": 0.07202864160724715}}
set_robot_commands_max0.110781953448341
set_robot_commands_mean0.10284258300434428
set_robot_commands_median0.10269753605711694
set_robot_commands_min0.09518232227356964
sim_compute_performance-ego_max0.07680705418953529
sim_compute_performance-ego_mean0.0736558909906962
sim_compute_performance-ego_median0.07401034865580813
sim_compute_performance-ego_min0.06922459996436253
sim_compute_robot_state-ego_max0.0942600598702064
sim_compute_robot_state-ego_mean0.082275663133399
sim_compute_robot_state-ego_median0.0802373501562303
sim_compute_robot_state-ego_min0.0733328286339255
sim_compute_robot_state-npc0_max0.07845115661621094
sim_compute_robot_state-npc0_mean0.07465280983260889
sim_compute_robot_state-npc0_median0.07417391387509628
sim_compute_robot_state-npc0_min0.07139181806927636
sim_compute_robot_state-npc1_max0.07843859990437825
sim_compute_robot_state-npc1_mean0.07442763099390538
sim_compute_robot_state-npc1_median0.07443924177260626
sim_compute_robot_state-npc1_min0.06864189116422795
sim_compute_robot_state-npc2_max0.07934060096740722
sim_compute_robot_state-npc2_mean0.07417746624439912
sim_compute_robot_state-npc2_median0.07354340288374159
sim_compute_robot_state-npc2_min0.06964894562713371
sim_compute_robot_state-npc3_max0.07740851371519027
sim_compute_robot_state-npc3_mean0.07420709398394476
sim_compute_robot_state-npc3_median0.07406127452850342
sim_compute_robot_state-npc3_min0.07039062444828759
sim_compute_sim_state_max0.04581197871956774
sim_compute_sim_state_mean0.04206230823872391
sim_compute_sim_state_median0.04204245567321777
sim_compute_sim_state_min0.03965565270068599
sim_physics_max0.23385113256948967
sim_physics_mean0.20408434662450017
sim_physics_median0.20378382065716913
sim_physics_min0.1801835364765591
sim_render-ego_max0.07031467225816515
sim_render-ego_mean0.06624030820703583
sim_render-ego_median0.06625636418660481
sim_render-ego_min0.06313815589778679
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
228182707RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryes11720:52:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228102723jp18813100494test for ppoaido2-LFVI-sim-testingstep1-simulationerroryes11720:01:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227922755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyes11720:05:06(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.08273141149064185
agent_compute-ego_mean0.06993540601403041
agent_compute-ego_median0.07315284791200058
agent_compute-ego_min0.041421370072798294
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.14021191462664537, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0716863753090442, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.08273141149064185, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1146806730350978, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04296059004018005, "sim_compute_performance-ego": 0.07968432466748734, "sim_compute_robot_state-ego": 0.08409896702833579}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11658182541529336, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05966562032699585, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07276730140050253, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09113891919453938, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0372972051302592, "sim_compute_performance-ego": 0.0694952646891276, "sim_compute_robot_state-ego": 0.07119535207748413}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.06094437295740301, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.0376222242008556, "in-drivable-lane": 0, "agent_compute-ego": 0.041421370072798294, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.05676254359158603, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.02500285885550759, "sim_compute_performance-ego": 0.04019551927393133, "sim_compute_robot_state-ego": 0.04430969194932417}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.11035073300202689, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05923855801423391, "in-drivable-lane": 0, "agent_compute-ego": 0.07960409919420879, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09575653076171876, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03532904883225759, "sim_compute_performance-ego": 0.06756874918937683, "sim_compute_robot_state-ego": 0.07654832303524017}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.13512018970821216, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06212496757507324, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07315284791200058, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09656776552614958, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.037992549979168434, "sim_compute_performance-ego": 0.06954875717992368, "sim_compute_robot_state-ego": 0.08370755548062532}}
set_robot_commands_max0.1146806730350978
set_robot_commands_mean0.09098128642181832
set_robot_commands_median0.09575653076171876
set_robot_commands_min0.05676254359158603
sim_compute_performance-ego_max0.07968432466748734
sim_compute_performance-ego_mean0.06529852299996937
sim_compute_performance-ego_median0.0694952646891276
sim_compute_performance-ego_min0.04019551927393133
sim_compute_robot_state-ego_max0.08409896702833579
sim_compute_robot_state-ego_mean0.07197197791420192
sim_compute_robot_state-ego_median0.07654832303524017
sim_compute_robot_state-ego_min0.04430969194932417
sim_compute_sim_state_max0.04296059004018005
sim_compute_sim_state_mean0.03571645056747457
sim_compute_sim_state_median0.0372972051302592
sim_compute_sim_state_min0.02500285885550759
sim_physics_max0.14021191462664537
sim_physics_mean0.11264180714191614
sim_physics_median0.11658182541529336
sim_physics_min0.06094437295740301
sim_render-ego_max0.0716863753090442
sim_render-ego_mean0.05806754908524057
sim_render-ego_median0.05966562032699585
sim_render-ego_min0.0376222242008556
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
227822766Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11720:06:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227712791RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailedyes11720:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227652805Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LF-sim-validationstep1-simulationsuccessyes11720:06:40(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1735819313261244
agent_compute-ego_mean0.16666982257207394
agent_compute-ego_median0.16563194311117824
agent_compute-ego_min0.16061491012573242
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14322862801728423, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06927667723761664, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1735819313261244, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10541192249015524, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04473088847266303, "sim_compute_performance-ego": 0.08223026770132559, "sim_compute_robot_state-ego": 0.09008391698201496}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12650610886368097, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06613707542419434, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1628415023579317, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10750993560342229, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04234999768874224, "sim_compute_performance-ego": 0.07363441411186666, "sim_compute_robot_state-ego": 0.08312353433347215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14159626119277058, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07247404491200167, "in-drivable-lane": 0, "agent_compute-ego": 0.17067882593940287, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10843415821299832, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.046339049058801984, "sim_compute_performance-ego": 0.07461918101591222, "sim_compute_robot_state-ego": 0.09069912573870492}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1292263698577881, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0634012222290039, "in-drivable-lane": 0, "agent_compute-ego": 0.16061491012573242, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10146130561828612, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.040566415786743165, "sim_compute_performance-ego": 0.07411735534667968, "sim_compute_robot_state-ego": 0.07268118858337402}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12467878076094616, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0674747334250921, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16563194311117824, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.11635627625863763, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04223547404325461, "sim_compute_performance-ego": 0.07557153701782227, "sim_compute_robot_state-ego": 0.08073630815819849}}
set_robot_commands_max0.11635627625863763
set_robot_commands_mean0.10783471963669992
set_robot_commands_median0.10750993560342229
set_robot_commands_min0.10146130561828612
sim_compute_performance-ego_max0.08223026770132559
sim_compute_performance-ego_mean0.07603455103872128
sim_compute_performance-ego_median0.07461918101591222
sim_compute_performance-ego_min0.07363441411186666
sim_compute_robot_state-ego_max0.09069912573870492
sim_compute_robot_state-ego_mean0.0834648147591529
sim_compute_robot_state-ego_median0.08312353433347215
sim_compute_robot_state-ego_min0.07268118858337402
sim_compute_sim_state_max0.046339049058801984
sim_compute_sim_state_mean0.04324436501004101
sim_compute_sim_state_median0.04234999768874224
sim_compute_sim_state_min0.040566415786743165
sim_physics_max0.14322862801728423
sim_physics_mean0.133047229738494
sim_physics_median0.1292263698577881
sim_physics_min0.12467878076094616
sim_render-ego_max0.07247404491200167
sim_render-ego_mean0.06775275064558173
sim_render-ego_median0.0674747334250921
sim_render-ego_min0.0634012222290039
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
227262876Andrea Danieleminimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessyes11720:39:15(hidden)
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17951467054353343
agent_compute-ego_mean0.17523637157914354
agent_compute-ego_median0.1754371519569013
agent_compute-ego_min0.1709729512532552
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.13650447173084287, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.07181741007798009, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1754371519569013, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.11236827665095708, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04360895191165183, "sim_compute_performance-ego": 0.08044795338198435, "sim_compute_robot_state-ego": 0.08770399127932761}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.13196887459073747, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.07161608593804496, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.17664319106510706, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.11364908899579727, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.043769797257014686, "sim_compute_performance-ego": 0.08209801401410784, "sim_compute_robot_state-ego": 0.08811301674161638}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.1463927745819092, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.07111065652635362, "in-drivable-lane": 0, "agent_compute-ego": 0.1709729512532552, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.1112990591261122, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.044500838385687934, "sim_compute_performance-ego": 0.07822379006279839, "sim_compute_robot_state-ego": 0.08496520784166124}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.1440693710161292, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.0726075846215953, "in-drivable-lane": 0, "agent_compute-ego": 0.17623048761616583, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.113432923088903, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.04447536623996237, "sim_compute_performance-ego": 0.08176000221915868, "sim_compute_robot_state-ego": 0.09470012136127638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.1300266344253331, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.07000101538009296, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.1726576149735821, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.1118219258034066, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.04312937444747855, "sim_compute_performance-ego": 0.08103551385609527, "sim_compute_robot_state-ego": 0.08970087521696744}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.1470543418611799, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.07169316155569894, "in-drivable-lane": 0, "agent_compute-ego": 0.17481568881443568, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.1128300768988473, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.04552114009857178, "sim_compute_performance-ego": 0.07991392612457275, "sim_compute_robot_state-ego": 0.0901557275227138}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.14934488921098307, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.06900491680897458, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.17200321043041392, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.1103101179633342, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.0434120473727374, "sim_compute_performance-ego": 0.08120952693509384, "sim_compute_robot_state-ego": 0.08820957868871554}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.1353435568187548, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06870046387548032, "in-drivable-lane": 0, "agent_compute-ego": 0.17732009680374808, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.11016585515893024, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.046542058820309845, "sim_compute_performance-ego": 0.07893885736880095, "sim_compute_robot_state-ego": 0.0893018038376518}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1343188789155748, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.07169016732109917, "in-drivable-lane": 0, "agent_compute-ego": 0.1739970154232449, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.1117610428068373, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.04405180878109402, "sim_compute_performance-ego": 0.07946018642849392, "sim_compute_robot_state-ego": 0.08971006605360243}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.14295135891955832, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.07109204755313155, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1782268752222476, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.11043745538462764, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.04329431229743405, "sim_compute_performance-ego": 0.0818491310313128, "sim_compute_robot_state-ego": 0.09003292132115019}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.1411201275816751, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.07174633292976869, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.17749898805530792, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.11294995207305349, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.044044763670055144, "sim_compute_performance-ego": 0.08184697868627146, "sim_compute_robot_state-ego": 0.0873519477494266}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.14152860310342577, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.0729701386557685, "in-drivable-lane": 0, "agent_compute-ego": 0.17677511109246147, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.1138222184446123, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.0460200740231408, "sim_compute_performance-ego": 0.07947545581393772, "sim_compute_robot_state-ego": 0.0861211551560296}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.15669773980010326, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.07260146587015055, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.17951467054353343, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.11307434726962085, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.044994560077036026, "sim_compute_performance-ego": 0.08310384201488906, "sim_compute_robot_state-ego": 0.09469847884967172}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.1325865882938191, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.07944631980637372, "in-drivable-lane": 0, "agent_compute-ego": 0.1744601888171697, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.11294071957216424, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.0448162798154152, "sim_compute_performance-ego": 0.07812969563371044, "sim_compute_robot_state-ego": 0.08322379548670882}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.13521481351733702, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.07172126987663048, "in-drivable-lane": 0, "agent_compute-ego": 0.17199233161957928, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.1085341590074088, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.044225985578481584, "sim_compute_performance-ego": 0.07882340320413043, "sim_compute_robot_state-ego": 0.08771322970568392}}
set_robot_commands_max0.1138222184446123
set_robot_commands_mean0.11195981454964082
set_robot_commands_median0.11236827665095708
set_robot_commands_min0.1085341590074088
sim_compute_performance-ego_max0.08310384201488906
sim_compute_performance-ego_mean0.08042108511835719
sim_compute_performance-ego_median0.08044795338198435
sim_compute_performance-ego_min0.07812969563371044
sim_compute_robot_state-ego_max0.09470012136127638
sim_compute_robot_state-ego_mean0.08878012778748022
sim_compute_robot_state-ego_median0.08820957868871554
sim_compute_robot_state-ego_min0.08322379548670882
sim_compute_sim_state_max0.046542058820309845
sim_compute_sim_state_mean0.04442715725173809
sim_compute_sim_state_median0.044225985578481584
sim_compute_sim_state_min0.04312937444747855
sim_physics_max0.15669773980010326
sim_physics_mean0.1403415349578242
sim_physics_median0.1411201275816751
sim_physics_min0.1300266344253331
sim_render-ego_max0.07944631980637372
sim_render-ego_mean0.07185460245314292
sim_render-ego_median0.07169316155569894
sim_render-ego_min0.06870046387548032
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
226832981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryes11720:50:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226782985ioartchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11720:03:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
226712999Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerroryes11720:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226553019Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryes11720:01:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226423046Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryes11720:03:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225863132MYFtestaido2-LF-sim-testingstep1-simulationerroryes11721:00:41
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up. 
(hidden)
225263208MYFtestaido2-LF-sim-testingstep1-simulationerroryes11720:59:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225173225JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11720:08:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224983239ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11720:26:18(hidden)
driven_lanedir_consec_median2.8264440718167942
survival_time_median14.950000000000076
deviation-center-line_median1.2288752622084234
in-drivable-lane_median1.6500000000000234


other stats
agent_compute-ego_max0.1146519338929808
agent_compute-ego_mean0.10648408791444346
agent_compute-ego_median0.11037563721338908
agent_compute-ego_min0.09552896579106648
deviation-center-line_max1.288150935981922
deviation-center-line_mean1.1162549995297495
deviation-center-line_min0.6657239104862016
deviation-heading_max4.000826258659147
deviation-heading_mean2.8076446090415788
deviation-heading_median2.671692397172978
deviation-heading_min1.3478556925619825
driven_any_max3.574753865803741
driven_any_mean3.1908399992921734
driven_any_median3.563004235646124
driven_any_min1.80158596022716
driven_lanedir_consec_max3.039904408460916
driven_lanedir_consec_mean2.661846441322075
driven_lanedir_consec_min1.7642591819286302
driven_lanedir_max3.039904408460916
driven_lanedir_mean2.661846441322075
driven_lanedir_median2.8264440718167942
driven_lanedir_min1.7642591819286302
in-drivable-lane_max2.5500000000000007
in-drivable-lane_mean1.5900000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.563004235646124, "sim_physics": 0.1390376051266988, "survival_time": 14.950000000000076, "driven_lanedir": 2.789875564605869, "sim_render-ego": 0.07129025538762411, "in-drivable-lane": 2.4000000000000252, "agent_compute-ego": 0.11037563721338908, "deviation-heading": 3.4850900040333626, "set_robot_commands": 0.11236751476923625, "deviation-center-line": 1.1265497238004534, "driven_lanedir_consec": 2.789875564605869, "sim_compute_sim_state": 0.04525588989257812, "sim_compute_performance-ego": 0.08019597768783569, "sim_compute_robot_state-ego": 0.08493896802266439}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.80158596022716, "sim_physics": 0.14237159877628475, "survival_time": 7.699999999999981, "driven_lanedir": 1.7642591819286302, "sim_render-ego": 0.0713306897646421, "in-drivable-lane": 0, "agent_compute-ego": 0.1146519338929808, "deviation-heading": 1.3478556925619825, "set_robot_commands": 0.1132411306554621, "deviation-center-line": 0.6657239104862016, "driven_lanedir_consec": 1.7642591819286302, "sim_compute_sim_state": 0.04516302455555309, "sim_compute_performance-ego": 0.08074614444336334, "sim_compute_robot_state-ego": 0.08709442615509033}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.574753865803741, "sim_physics": 0.1383249314626058, "survival_time": 14.950000000000076, "driven_lanedir": 2.8264440718167942, "sim_render-ego": 0.06977668046951294, "in-drivable-lane": 2.5500000000000007, "agent_compute-ego": 0.11103918234507244, "deviation-heading": 2.532758692780422, "set_robot_commands": 0.11392177502314248, "deviation-center-line": 1.2288752622084234, "driven_lanedir_consec": 2.8264440718167942, "sim_compute_sim_state": 0.04437554200490316, "sim_compute_performance-ego": 0.07906827449798584, "sim_compute_robot_state-ego": 0.0901842745145162}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.440172037383701, "sim_physics": 0.10537252161237928, "survival_time": 14.40000000000007, "driven_lanedir": 2.8887489797981636, "sim_render-ego": 0.05589656035105387, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.10082472032970852, "deviation-heading": 4.000826258659147, "set_robot_commands": 0.08765975385904312, "deviation-center-line": 1.288150935981922, "driven_lanedir_consec": 2.8887489797981636, "sim_compute_sim_state": 0.035090934899118215, "sim_compute_performance-ego": 0.06893914772404565, "sim_compute_robot_state-ego": 0.06700826270712747}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5746838974001407, "sim_physics": 0.11826401154200236, "survival_time": 14.950000000000076, "driven_lanedir": 3.039904408460916, "sim_render-ego": 0.06132353146870931, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.09552896579106648, "deviation-heading": 2.671692397172978, "set_robot_commands": 0.09325436353683472, "deviation-center-line": 1.271975165171748, "driven_lanedir_consec": 3.039904408460916, "sim_compute_sim_state": 0.039101996421813966, "sim_compute_performance-ego": 0.0690955932935079, "sim_compute_robot_state-ego": 0.0741535758972168}}
set_robot_commands_max0.11392177502314248
set_robot_commands_mean0.10408890756874374
set_robot_commands_median0.11236751476923625
set_robot_commands_min0.08765975385904312
sim_compute_performance-ego_max0.08074614444336334
sim_compute_performance-ego_mean0.07560902752934769
sim_compute_performance-ego_median0.07906827449798584
sim_compute_performance-ego_min0.06893914772404565
sim_compute_robot_state-ego_max0.0901842745145162
sim_compute_robot_state-ego_mean0.08067590145932305
sim_compute_robot_state-ego_median0.08493896802266439
sim_compute_robot_state-ego_min0.06700826270712747
sim_compute_sim_state_max0.04525588989257812
sim_compute_sim_state_mean0.04179747755479331
sim_compute_sim_state_median0.04437554200490316
sim_compute_sim_state_min0.035090934899118215
sim_physics_max0.14237159877628475
sim_physics_mean0.12867413370399422
sim_physics_median0.1383249314626058
sim_physics_min0.10537252161237928
sim_render-ego_max0.0713306897646421
sim_render-ego_mean0.06592354348830846
sim_render-ego_median0.06977668046951294
sim_render-ego_min0.05589656035105387
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.390000000000056
survival_time_min7.699999999999981
224913249johnshen1009challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11720:05:49(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.16817073261036591
agent_compute-ego_mean0.14812514682865613
agent_compute-ego_median0.14383978937186448
agent_compute-ego_min0.12967443466186523
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10669519283153392, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05681080729873092, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14208395392806442, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0864405455412688, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03660220128518564, "sim_compute_performance-ego": 0.06497223730440493, "sim_compute_robot_state-ego": 0.069623037620827}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1087808094772638, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.057228897132125554, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14383978937186448, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0845492306877585, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03449464779274136, "sim_compute_performance-ego": 0.06262464149325501, "sim_compute_robot_state-ego": 0.06587063564973719}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13477378733017864, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06730151176452637, "in-drivable-lane": 0, "agent_compute-ego": 0.16817073261036591, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10440370615790873, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.041499600690953875, "sim_compute_performance-ego": 0.07438265576082118, "sim_compute_robot_state-ego": 0.08844904338612276}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.10266087532043457, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05063194274902344, "in-drivable-lane": 0, "agent_compute-ego": 0.12967443466186523, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09195549964904784, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03495442390441895, "sim_compute_performance-ego": 0.0540020751953125, "sim_compute_robot_state-ego": 0.0594426155090332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11692748794072792, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06773630576797679, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15685682357112063, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09988418711891656, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04114224639119981, "sim_compute_performance-ego": 0.07147882256326796, "sim_compute_robot_state-ego": 0.07337117195129395}}
set_robot_commands_max0.10440370615790873
set_robot_commands_mean0.09344663383098008
set_robot_commands_median0.09195549964904784
set_robot_commands_min0.0845492306877585
sim_compute_performance-ego_max0.07438265576082118
sim_compute_performance-ego_mean0.06549208646341231
sim_compute_performance-ego_median0.06497223730440493
sim_compute_performance-ego_min0.0540020751953125
sim_compute_robot_state-ego_max0.08844904338612276
sim_compute_robot_state-ego_mean0.07135130082340282
sim_compute_robot_state-ego_median0.069623037620827
sim_compute_robot_state-ego_min0.0594426155090332
sim_compute_sim_state_max0.041499600690953875
sim_compute_sim_state_mean0.03773862401289993
sim_compute_sim_state_median0.03660220128518564
sim_compute_sim_state_min0.03449464779274136
sim_physics_max0.13477378733017864
sim_physics_mean0.11396763058002776
sim_physics_median0.1087808094772638
sim_physics_min0.10266087532043457
sim_render-ego_max0.06773630576797679
sim_render-ego_mean0.059941892942476614
sim_render-ego_median0.057228897132125554
sim_render-ego_min0.05063194274902344
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
224903252Sean LuBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryes11720:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224803537enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11720:14:42(hidden)
driven_lanedir_consec_median0.489457179823658
survival_time_median2.3
deviation-center-line_median0.12939676917776077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19695577128180144
agent_compute-ego_mean0.186517702829951
agent_compute-ego_median0.18495014429092407
agent_compute-ego_min0.1824880371923032
deviation-center-line_max1.0352776076923969
deviation-center-line_mean0.4362931823235016
deviation-center-line_min0.07964509902467751
deviation-heading_max7.074474021264511
deviation-heading_mean2.5320727977503346
deviation-heading_median0.35410647893328134
deviation-heading_min0.23033609015594397
driven_any_max3.842097812790047
driven_any_mean1.3625335635981597
driven_any_median0.5774640096291888
driven_any_min0.45852865788211056
driven_lanedir_consec_max2.677812477472571
driven_lanedir_consec_mean0.9112526468110278
driven_lanedir_consec_min0.38646615371485155
driven_lanedir_max3.6692887229488527
driven_lanedir_mean1.233459320543054
driven_lanedir_median0.5655375084659671
driven_lanedir_min0.4369899145780911
in-drivable-lane_max5.70000000000003
in-drivable-lane_mean1.4400000000000053
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.842097812790047, "sim_physics": 0.126175217628479, "survival_time": 14.950000000000076, "driven_lanedir": 3.6692887229488527, "sim_render-ego": 0.06711105505625407, "in-drivable-lane": 1.4999999999999964, "agent_compute-ego": 0.18539010127385455, "deviation-heading": 4.695810766241539, "set_robot_commands": 0.10232186873753864, "deviation-center-line": 1.0352776076923969, "driven_lanedir_consec": 2.677812477472571, "sim_compute_sim_state": 0.041415009498596195, "sim_compute_performance-ego": 0.07434641361236573, "sim_compute_robot_state-ego": 0.07986259857813517}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4414718633767738, "sim_physics": 0.12870263894399006, "survival_time": 14.950000000000076, "driven_lanedir": 1.0060232768987012, "sim_render-ego": 0.0673921251296997, "in-drivable-lane": 5.70000000000003, "agent_compute-ego": 0.18495014429092407, "deviation-heading": 7.074474021264511, "set_robot_commands": 0.10953608910242715, "deviation-center-line": 0.8224859320262398, "driven_lanedir_consec": 0.38646615371485155, "sim_compute_sim_state": 0.042344146569569904, "sim_compute_performance-ego": 0.07567621310551961, "sim_compute_robot_state-ego": 0.07975295384724936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4931054743126759, "sim_physics": 0.14469456672668457, "survival_time": 1.4500000000000006, "driven_lanedir": 0.489457179823658, "sim_render-ego": 0.0691146603946028, "in-drivable-lane": 0, "agent_compute-ego": 0.19695577128180144, "deviation-heading": 0.23033609015594397, "set_robot_commands": 0.10333191937413708, "deviation-center-line": 0.12939676917776077, "driven_lanedir_consec": 0.489457179823658, "sim_compute_sim_state": 0.042785554096616545, "sim_compute_performance-ego": 0.07723449838572535, "sim_compute_robot_state-ego": 0.08124847247682769}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45852865788211056, "sim_physics": 0.13411631791487985, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4369899145780911, "sim_render-ego": 0.06874020203300145, "in-drivable-lane": 0, "agent_compute-ego": 0.18280446011087167, "deviation-heading": 0.35410647893328134, "set_robot_commands": 0.10610396965690282, "deviation-center-line": 0.07964509902467751, "driven_lanedir_consec": 0.4369899145780911, "sim_compute_sim_state": 0.044038212817648185, "sim_compute_performance-ego": 0.07413501324860947, "sim_compute_robot_state-ego": 0.07778803161952806}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5774640096291888, "sim_physics": 0.13896966498831043, "survival_time": 2.3, "driven_lanedir": 0.5655375084659671, "sim_render-ego": 0.06630325317382812, "in-drivable-lane": 0, "agent_compute-ego": 0.1824880371923032, "deviation-heading": 0.30563663215639647, "set_robot_commands": 0.10627623226331628, "deviation-center-line": 0.11466050369643324, "driven_lanedir_consec": 0.5655375084659671, "sim_compute_sim_state": 0.04241100083226743, "sim_compute_performance-ego": 0.07461693494216255, "sim_compute_robot_state-ego": 0.07795286178588867}}
set_robot_commands_max0.10953608910242715
set_robot_commands_mean0.1055140158268644
set_robot_commands_median0.10610396965690282
set_robot_commands_min0.10232186873753864
sim_compute_performance-ego_max0.07723449838572535
sim_compute_performance-ego_mean0.07520181465887654
sim_compute_performance-ego_median0.07461693494216255
sim_compute_performance-ego_min0.07413501324860947
sim_compute_robot_state-ego_max0.08124847247682769
sim_compute_robot_state-ego_mean0.07932098366152579
sim_compute_robot_state-ego_median0.07975295384724936
sim_compute_robot_state-ego_min0.07778803161952806
sim_compute_sim_state_max0.044038212817648185
sim_compute_sim_state_mean0.04259878476293965
sim_compute_sim_state_median0.04241100083226743
sim_compute_sim_state_min0.041415009498596195
sim_physics_max0.14469456672668457
sim_physics_mean0.1345316812404688
sim_physics_median0.13411631791487985
sim_physics_min0.126175217628479
sim_render-ego_max0.0691146603946028
sim_render-ego_mean0.06773225915747724
sim_render-ego_median0.0673921251296997
sim_render-ego_min0.06630325317382812
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.960000000000031
survival_time_min1.1500000000000004
224723275jp18813100494RL - TH -hhkaido2-LF-sim-validationstep1-simulationerroryes11720:07:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224593290ioartSSegmaido2-LF-sim-validationstep1-simulationsuccessyes11720:12:07(hidden)
driven_lanedir_consec_median0.7082710735778925
survival_time_median5.14999999999999
deviation-center-line_median0.3823015717068829
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1240258054825866
agent_compute-ego_mean0.10794518795247648
agent_compute-ego_median0.10788558449661524
agent_compute-ego_min0.09661726293892696
deviation-center-line_max0.879491353625135
deviation-center-line_mean0.43061003464649106
deviation-center-line_min0.1460774593203363
deviation-heading_max1.2011050161986383
deviation-heading_mean0.6300983821217437
deviation-heading_median0.6155988247515144
deviation-heading_min0.33260207171657985
driven_any_max2.7065408549292225
driven_any_mean1.2171854810295453
driven_any_median1.166278577421998
driven_any_min0.2730361651203064
driven_lanedir_consec_max1.559685572593514
driven_lanedir_consec_mean0.8848545212960737
driven_lanedir_consec_min0.26612128597713225
driven_lanedir_max1.559685572593514
driven_lanedir_mean0.8848545212960737
driven_lanedir_median0.7082710735778925
driven_lanedir_min0.26612128597713225
in-drivable-lane_max4.650000000000023
in-drivable-lane_mean1.3000000000000032
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.166278577421998, "sim_physics": 0.15923890095312618, "survival_time": 5.14999999999999, "driven_lanedir": 0.7082710735778925, "sim_render-ego": 0.07740504301867439, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.1240258054825866, "deviation-heading": 0.34812114948997325, "set_robot_commands": 0.11994296138726392, "deviation-center-line": 0.3823015717068829, "driven_lanedir_consec": 0.7082710735778925, "sim_compute_sim_state": 0.04643447885235536, "sim_compute_performance-ego": 0.08856344917445506, "sim_compute_robot_state-ego": 0.09968233571469204}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.483654879997451, "sim_physics": 0.13851333037018776, "survival_time": 6.399999999999985, "driven_lanedir": 1.4534870323393196, "sim_render-ego": 0.07284004054963589, "in-drivable-lane": 0, "agent_compute-ego": 0.11405298113822936, "deviation-heading": 1.2011050161986383, "set_robot_commands": 0.12294147163629532, "deviation-center-line": 0.5936076482966521, "driven_lanedir_consec": 1.4534870323393196, "sim_compute_sim_state": 0.044895244762301445, "sim_compute_performance-ego": 0.08212784677743912, "sim_compute_robot_state-ego": 0.09801490977406502}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2730361651203064, "sim_physics": 0.12392580920252308, "survival_time": 1.4500000000000006, "driven_lanedir": 0.26612128597713225, "sim_render-ego": 0.06701915017489729, "in-drivable-lane": 0, "agent_compute-ego": 0.09661726293892696, "deviation-heading": 0.33260207171657985, "set_robot_commands": 0.10044176825161638, "deviation-center-line": 0.1460774593203363, "driven_lanedir_consec": 0.26612128597713225, "sim_compute_sim_state": 0.0408997864558779, "sim_compute_performance-ego": 0.07509465875296757, "sim_compute_robot_state-ego": 0.0786621406160552}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4564169276787495, "sim_physics": 0.12004613876342772, "survival_time": 2.2, "driven_lanedir": 0.4367076419925104, "sim_render-ego": 0.06223892081867565, "in-drivable-lane": 0, "agent_compute-ego": 0.09714430570602416, "deviation-heading": 0.6530648484520125, "set_robot_commands": 0.09467188878492876, "deviation-center-line": 0.1515721402834494, "driven_lanedir_consec": 0.4367076419925104, "sim_compute_sim_state": 0.0415034835988825, "sim_compute_performance-ego": 0.06953729282725941, "sim_compute_robot_state-ego": 0.07714884389530528}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7065408549292225, "sim_physics": 0.12765915979418838, "survival_time": 11.400000000000029, "driven_lanedir": 1.559685572593514, "sim_render-ego": 0.0696495813235902, "in-drivable-lane": 4.650000000000023, "agent_compute-ego": 0.10788558449661524, "deviation-heading": 0.6155988247515144, "set_robot_commands": 0.10863241501021804, "deviation-center-line": 0.879491353625135, "driven_lanedir_consec": 1.559685572593514, "sim_compute_sim_state": 0.04416661095200924, "sim_compute_performance-ego": 0.07791596546507719, "sim_compute_robot_state-ego": 0.08466449850483944}}
set_robot_commands_max0.12294147163629532
set_robot_commands_mean0.10932610101406448
set_robot_commands_median0.10863241501021804
set_robot_commands_min0.09467188878492876
sim_compute_performance-ego_max0.08856344917445506
sim_compute_performance-ego_mean0.07864784259943966
sim_compute_performance-ego_median0.07791596546507719
sim_compute_performance-ego_min0.06953729282725941
sim_compute_robot_state-ego_max0.09968233571469204
sim_compute_robot_state-ego_mean0.0876345457009914
sim_compute_robot_state-ego_median0.08466449850483944
sim_compute_robot_state-ego_min0.07714884389530528
sim_compute_sim_state_max0.04643447885235536
sim_compute_sim_state_mean0.04357992092428529
sim_compute_sim_state_median0.04416661095200924
sim_compute_sim_state_min0.0408997864558779
sim_physics_max0.15923890095312618
sim_physics_mean0.13387666781669064
sim_physics_median0.12765915979418838
sim_physics_min0.12004613876342772
sim_render-ego_max0.07740504301867439
sim_render-ego_mean0.06983054717709469
sim_render-ego_median0.0696495813235902
sim_render-ego_min0.06223892081867565
simulation-passed1
survival_time_max11.400000000000029
survival_time_mean5.320000000000001
survival_time_min1.4500000000000006
224553530enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationfailedyes11720:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     action = self.model.select_action(observation)
               ||   File "/workspace/model.py", line 150, in select_action
               ||     return self.actor(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/workspace/model.py", line 45, in forward
               ||     x = self.bn1(self.lr(self.conv1(x)))
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 320, in forward
               ||     self.padding, self.dilation, self.groups)
               || RuntimeError: Given groups=1, weight of size [32, 3, 8, 8], expected input[1, 120, 160, 3] to have 3 channels, but got 120 channels instead
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
224233315jp18813100494RL - TH -hhkaido2-LFV-sim-validationstep1-simulationsuccessyes11720:36:11(hidden)
driven_lanedir_consec_median1.5517440458980518
survival_time_median14.200000000000069
deviation-center-line_median0.7272239486453499
in-drivable-lane_median5.750000000000046


other stats
agent_compute-ego_max0.2130505734798955
agent_compute-ego_mean0.20282127191560032
agent_compute-ego_median0.20635603745778405
agent_compute-ego_min0.18375860049691
deviation-center-line_max0.9279072479689552
deviation-center-line_mean0.6589507941348265
deviation-center-line_min0.31622589498973774
deviation-heading_max3.5700258663607576
deviation-heading_mean2.418449430899825
deviation-heading_median2.267214123131697
deviation-heading_min1.2784341577931226
driven_any_max3.328877265093844
driven_any_mean2.759198264229227
driven_any_median2.724544350470416
driven_any_min2.0766251404617697
driven_lanedir_consec_max2.0831169577925572
driven_lanedir_consec_mean1.7128994984836787
driven_lanedir_consec_min1.440631971837869
driven_lanedir_max2.0831169577925572
driven_lanedir_mean1.7128994984836787
driven_lanedir_median1.5517440458980518
driven_lanedir_min1.440631971837869
in-drivable-lane_max8.950000000000092
in-drivable-lane_mean5.390000000000032
in-drivable-lane_min0.7499999999999973
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6926861899110346, "sim_physics": 0.2033137329419454, "survival_time": 14.950000000000076, "driven_lanedir": 1.5517440458980518, "sim_render-ego": 0.06917388200759887, "in-drivable-lane": 5.750000000000046, "agent_compute-ego": 0.19902162631352743, "deviation-heading": 3.4726568066413894, "set_robot_commands": 0.10540439367294312, "deviation-center-line": 0.9279072479689552, "driven_lanedir_consec": 1.5517440458980518, "sim_compute_sim_state": 0.04283759991327921, "sim_compute_performance-ego": 0.07818885326385498, "sim_compute_robot_state-ego": 0.08327256043752035, "sim_compute_robot_state-npc0": 0.07620591163635254, "sim_compute_robot_state-npc1": 0.07596495151519775, "sim_compute_robot_state-npc2": 0.07498029867808025, "sim_compute_robot_state-npc3": 0.07610459963480631}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.973258375209071, "sim_physics": 0.1875648070389116, "survival_time": 14.200000000000069, "driven_lanedir": 1.948011841574245, "sim_render-ego": 0.06308083383130356, "in-drivable-lane": 5.850000000000038, "agent_compute-ego": 0.18375860049691, "deviation-heading": 3.5700258663607576, "set_robot_commands": 0.09931425141616608, "deviation-center-line": 0.8848890986540239, "driven_lanedir_consec": 1.948011841574245, "sim_compute_sim_state": 0.04078804523172513, "sim_compute_performance-ego": 0.07057923498288007, "sim_compute_robot_state-ego": 0.07727744713635512, "sim_compute_robot_state-npc0": 0.07271789581003324, "sim_compute_robot_state-npc1": 0.07098793899509269, "sim_compute_robot_state-npc2": 0.07135663485862839, "sim_compute_robot_state-npc3": 0.07126523071611432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.724544350470416, "sim_physics": 0.20781414765937656, "survival_time": 10.20000000000001, "driven_lanedir": 2.0831169577925572, "sim_render-ego": 0.07141176392050351, "in-drivable-lane": 5.64999999999999, "agent_compute-ego": 0.2130505734798955, "deviation-heading": 1.2784341577931226, "set_robot_commands": 0.114981868687798, "deviation-center-line": 0.31622589498973774, "driven_lanedir_consec": 2.0831169577925572, "sim_compute_sim_state": 0.04622797755634084, "sim_compute_performance-ego": 0.0805942462939842, "sim_compute_robot_state-ego": 0.08838611490586225, "sim_compute_robot_state-npc0": 0.07997561085457895, "sim_compute_robot_state-npc1": 0.08043069348615758, "sim_compute_robot_state-npc2": 0.08020630420423021, "sim_compute_robot_state-npc3": 0.07935584292692296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.328877265093844, "sim_physics": 0.20390507062276209, "survival_time": 14.950000000000076, "driven_lanedir": 1.440631971837869, "sim_render-ego": 0.06979416211446127, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.20635603745778405, "deviation-heading": 1.5039162005721562, "set_robot_commands": 0.1116332960128784, "deviation-center-line": 0.7272239486453499, "driven_lanedir_consec": 1.440631971837869, "sim_compute_sim_state": 0.04567816813786824, "sim_compute_performance-ego": 0.0799093516667684, "sim_compute_robot_state-ego": 0.08768229881922404, "sim_compute_robot_state-npc0": 0.0797870930035909, "sim_compute_robot_state-npc1": 0.08011466900507609, "sim_compute_robot_state-npc2": 0.07988088369369507, "sim_compute_robot_state-npc3": 0.07952544291814169}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0766251404617697, "sim_physics": 0.2007360883579133, "survival_time": 7.84999999999998, "driven_lanedir": 1.5409926753156715, "sim_render-ego": 0.07230483498542932, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.21191952182988452, "deviation-heading": 2.267214123131697, "set_robot_commands": 0.1125273051535248, "deviation-center-line": 0.43850778041606575, "driven_lanedir_consec": 1.5409926753156715, "sim_compute_sim_state": 0.045921090302194, "sim_compute_performance-ego": 0.07937100586617828, "sim_compute_robot_state-ego": 0.08857788249945185, "sim_compute_robot_state-npc0": 0.07907046482061884, "sim_compute_robot_state-npc1": 0.07797935358278311, "sim_compute_robot_state-npc2": 0.07934770310760304, "sim_compute_robot_state-npc3": 0.07918583815264854}}
set_robot_commands_max0.114981868687798
set_robot_commands_mean0.1087722229886621
set_robot_commands_median0.1116332960128784
set_robot_commands_min0.09931425141616608
sim_compute_performance-ego_max0.0805942462939842
sim_compute_performance-ego_mean0.07772853841473318
sim_compute_performance-ego_median0.07937100586617828
sim_compute_performance-ego_min0.07057923498288007
sim_compute_robot_state-ego_max0.08857788249945185
sim_compute_robot_state-ego_mean0.08503926075968274
sim_compute_robot_state-ego_median0.08768229881922404
sim_compute_robot_state-ego_min0.07727744713635512
sim_compute_robot_state-npc0_max0.07997561085457895
sim_compute_robot_state-npc0_mean0.07755139522503489
sim_compute_robot_state-npc0_median0.07907046482061884
sim_compute_robot_state-npc0_min0.07271789581003324
sim_compute_robot_state-npc1_max0.08043069348615758
sim_compute_robot_state-npc1_mean0.07709552131686145
sim_compute_robot_state-npc1_median0.07797935358278311
sim_compute_robot_state-npc1_min0.07098793899509269
sim_compute_robot_state-npc2_max0.08020630420423021
sim_compute_robot_state-npc2_mean0.07715436490844738
sim_compute_robot_state-npc2_median0.07934770310760304
sim_compute_robot_state-npc2_min0.07135663485862839
sim_compute_robot_state-npc3_max0.07952544291814169
sim_compute_robot_state-npc3_mean0.07708739086972675
sim_compute_robot_state-npc3_median0.07918583815264854
sim_compute_robot_state-npc3_min0.07126523071611432
sim_compute_sim_state_max0.04622797755634084
sim_compute_sim_state_mean0.04429057622828148
sim_compute_sim_state_median0.04567816813786824
sim_compute_sim_state_min0.04078804523172513
sim_physics_max0.20781414765937656
sim_physics_mean0.2006667693241818
sim_physics_median0.2033137329419454
sim_physics_min0.1875648070389116
sim_render-ego_max0.07230483498542932
sim_render-ego_mean0.0691530953718593
sim_render-ego_median0.06979416211446127
sim_render-ego_min0.06308083383130356
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.43000000000004
survival_time_min7.84999999999998
224203318jp18813100494RL - TH - shiaido2-LF-sim-validationstep1-simulationerroryes11720:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224133324jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryes11720:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223993334MYFtestaido2-LFVI-sim-validationstep1-simulationerroryes11720:27:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223843346JBRRussiaJetBrains Researchaido2-LFVI-sim-validationstep1-simulationsuccessyes11720:31:48(hidden)
driven_lanedir_consec_median1.2212724092692753
survival_time_median8.04999999999998
deviation-center-line_median0.5751850080662609
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14516848531262627
agent_compute-ego_mean0.12100714652603715
agent_compute-ego_median0.12144958843355594
agent_compute-ego_min0.09273682369126214
deviation-center-line_max1.3080756021175788
deviation-center-line_mean0.5939588800297929
deviation-center-line_min0.208564180438624
deviation-heading_max2.921567128325301
deviation-heading_mean1.721839859503752
deviation-heading_median1.7119748285646246
deviation-heading_min0.549147402377039
driven_any_max2.901127713204258
driven_any_mean1.2901607397496293
driven_any_median1.265812593699502
driven_any_min0.4607767819960878
driven_lanedir_consec_max2.6545548101656244
driven_lanedir_consec_mean1.19127017173932
driven_lanedir_consec_min0.3769531596616167
driven_lanedir_max2.6545548101656244
driven_lanedir_mean1.1917305681457298
driven_lanedir_median1.2212724092692753
driven_lanedir_min0.3769531596616167
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.3399999999999988
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.4607767819960878, "sim_physics": 0.19737310542000663, "survival_time": 3.599999999999995, "driven_lanedir": 0.3769531596616167, "sim_render-ego": 0.0628097587161594, "in-drivable-lane": 0, "agent_compute-ego": 0.09273682369126214, "deviation-heading": 1.6746913678877264, "set_robot_commands": 0.11173269152641296, "deviation-center-line": 0.21258867457836844, "driven_lanedir_consec": 0.3769531596616167, "sim_compute_sim_state": 0.03946675194634332, "sim_compute_performance-ego": 0.06972758968671162, "sim_compute_robot_state-ego": 0.07770977748764886, "sim_compute_robot_state-npc0": 0.07552058166927761, "sim_compute_robot_state-npc1": 0.07585479484664069, "sim_compute_robot_state-npc2": 0.07228695684009129, "sim_compute_robot_state-npc3": 0.06667009658283657}, "udem1-1-0": {"driven_any": 1.265812593699502, "sim_physics": 0.2580698691539883, "survival_time": 8.04999999999998, "driven_lanedir": 1.2212724092692753, "sim_render-ego": 0.07311879181713792, "in-drivable-lane": 0, "agent_compute-ego": 0.12012446000709295, "deviation-heading": 1.75181857036407, "set_robot_commands": 0.13765075191947984, "deviation-center-line": 0.5751850080662609, "driven_lanedir_consec": 1.2212724092692753, "sim_compute_sim_state": 0.04689747354258662, "sim_compute_performance-ego": 0.08131660733904157, "sim_compute_robot_state-ego": 0.09087430023998948, "sim_compute_robot_state-npc0": 0.08845030743142833, "sim_compute_robot_state-npc1": 0.08247834258938427, "sim_compute_robot_state-npc2": 0.0823426972264829, "sim_compute_robot_state-npc3": 0.08271729131663068}, "udem1-2-0": {"driven_any": 1.3334970009829048, "sim_physics": 0.33062495485596033, "survival_time": 9.199999999999996, "driven_lanedir": 1.24648963493867, "sim_render-ego": 0.0772629315438478, "in-drivable-lane": 0, "agent_compute-ego": 0.12144958843355594, "deviation-heading": 2.921567128325301, "set_robot_commands": 0.14860192848288495, "deviation-center-line": 0.6653809349481323, "driven_lanedir_consec": 1.2441876529066214, "sim_compute_sim_state": 0.04829497052275616, "sim_compute_performance-ego": 0.08992629595424818, "sim_compute_robot_state-ego": 0.1054839375226394, "sim_compute_robot_state-npc0": 0.09461571470550868, "sim_compute_robot_state-npc1": 0.09096078380294469, "sim_compute_robot_state-npc2": 0.08948867606080096, "sim_compute_robot_state-npc3": 0.08931718831476958}, "udem1-3-0": {"driven_any": 0.489589608865393, "sim_physics": 0.3748061040352131, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4593828266934623, "sim_render-ego": 0.09095288556197594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14516848531262627, "deviation-heading": 0.549147402377039, "set_robot_commands": 0.17351450180185252, "deviation-center-line": 0.208564180438624, "driven_lanedir_consec": 0.4593828266934623, "sim_compute_sim_state": 0.05583291629265095, "sim_compute_performance-ego": 0.10457800174581594, "sim_compute_robot_state-ego": 0.12686319186769682, "sim_compute_robot_state-npc0": 0.10876369887384876, "sim_compute_robot_state-npc1": 0.10226986737086854, "sim_compute_robot_state-npc2": 0.1050823474752492, "sim_compute_robot_state-npc3": 0.10281479769739613}, "udem1-4-0": {"driven_any": 2.901127713204258, "sim_physics": 0.3094626959164937, "survival_time": 14.950000000000076, "driven_lanedir": 2.6545548101656244, "sim_render-ego": 0.08154248555501302, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1255563751856486, "deviation-heading": 1.7119748285646246, "set_robot_commands": 0.15425367514292398, "deviation-center-line": 1.3080756021175788, "driven_lanedir_consec": 2.6545548101656244, "sim_compute_sim_state": 0.04970561901728312, "sim_compute_performance-ego": 0.09292558034261068, "sim_compute_robot_state-ego": 0.11241600592931111, "sim_compute_robot_state-npc0": 0.09564220348993938, "sim_compute_robot_state-npc1": 0.09219741980234782, "sim_compute_robot_state-npc2": 0.09229446967442832, "sim_compute_robot_state-npc3": 0.09163254499435423}}
set_robot_commands_max0.17351450180185252
set_robot_commands_mean0.14515070977471084
set_robot_commands_median0.14860192848288495
set_robot_commands_min0.11173269152641296
sim_compute_performance-ego_max0.10457800174581594
sim_compute_performance-ego_mean0.0876948150136856
sim_compute_performance-ego_median0.08992629595424818
sim_compute_performance-ego_min0.06972758968671162
sim_compute_robot_state-ego_max0.12686319186769682
sim_compute_robot_state-ego_mean0.10266944260945714
sim_compute_robot_state-ego_median0.1054839375226394
sim_compute_robot_state-ego_min0.07770977748764886
sim_compute_robot_state-npc0_max0.10876369887384876
sim_compute_robot_state-npc0_mean0.09259850123400055
sim_compute_robot_state-npc0_median0.09461571470550868
sim_compute_robot_state-npc0_min0.07552058166927761
sim_compute_robot_state-npc1_max0.10226986737086854
sim_compute_robot_state-npc1_mean0.0887522416824372
sim_compute_robot_state-npc1_median0.09096078380294469
sim_compute_robot_state-npc1_min0.07585479484664069
sim_compute_robot_state-npc2_max0.1050823474752492
sim_compute_robot_state-npc2_mean0.08829902945541053
sim_compute_robot_state-npc2_median0.08948867606080096
sim_compute_robot_state-npc2_min0.07228695684009129
sim_compute_robot_state-npc3_max0.10281479769739613
sim_compute_robot_state-npc3_mean0.08663038378119745
sim_compute_robot_state-npc3_median0.08931718831476958
sim_compute_robot_state-npc3_min0.06667009658283657
sim_compute_sim_state_max0.05583291629265095
sim_compute_sim_state_mean0.04803954626432404
sim_compute_sim_state_median0.04829497052275616
sim_compute_sim_state_min0.03946675194634332
sim_physics_max0.3748061040352131
sim_physics_mean0.29406734587633243
sim_physics_median0.3094626959164937
sim_physics_min0.19737310542000663
sim_render-ego_max0.09095288556197594
sim_render-ego_mean0.07713737063882682
sim_render-ego_median0.0772629315438478
sim_render-ego_min0.0628097587161594
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.740000000000009
survival_time_min2.8999999999999977
223803352madclamchallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerroryes11720:11:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223783354madclamchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11720:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
223733364AmaurXchallenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyes11720:06:09(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17571241325802273
agent_compute-ego_mean0.16476508489613342
agent_compute-ego_median0.16343823432922364
agent_compute-ego_min0.15922915234285245
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12251957699104592, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06780352415861907, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17571241325802273, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.11127140786912706, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04285561155389856, "sim_compute_performance-ego": 0.0788317256503635, "sim_compute_robot_state-ego": 0.08373436221369991}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1316817788516774, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06658576984031528, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16619538325889438, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10703422976475135, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0432742249731924, "sim_compute_performance-ego": 0.07590353722665824, "sim_compute_robot_state-ego": 0.08681215959436753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13407027020173914, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0642846752615536, "in-drivable-lane": 0, "agent_compute-ego": 0.15922915234285245, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.102585750467637, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0443722500520594, "sim_compute_performance-ego": 0.07103431926054113, "sim_compute_robot_state-ego": 0.0774073741015266}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1345204544067383, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06487367630004882, "in-drivable-lane": 0, "agent_compute-ego": 0.16343823432922364, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1102665615081787, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04419073104858398, "sim_compute_performance-ego": 0.07314756393432617, "sim_compute_robot_state-ego": 0.07602783203125}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12026638018934031, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06585901900182796, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15925024129167387, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0995858168300194, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.040728958347175694, "sim_compute_performance-ego": 0.07153616072256354, "sim_compute_robot_state-ego": 0.07636290260508091}}
set_robot_commands_max0.11127140786912706
set_robot_commands_mean0.10614875328794272
set_robot_commands_median0.10703422976475135
set_robot_commands_min0.0995858168300194
sim_compute_performance-ego_max0.0788317256503635
sim_compute_performance-ego_mean0.0740906613588905
sim_compute_performance-ego_median0.07314756393432617
sim_compute_performance-ego_min0.07103431926054113
sim_compute_robot_state-ego_max0.08681215959436753
sim_compute_robot_state-ego_mean0.08006892610918499
sim_compute_robot_state-ego_median0.0774073741015266
sim_compute_robot_state-ego_min0.07602783203125
sim_compute_sim_state_max0.0443722500520594
sim_compute_sim_state_mean0.04308435519498201
sim_compute_sim_state_median0.0432742249731924
sim_compute_sim_state_min0.040728958347175694
sim_physics_max0.1345204544067383
sim_physics_mean0.12861169212810822
sim_physics_median0.1316817788516774
sim_physics_min0.12026638018934031
sim_render-ego_max0.06780352415861907
sim_render-ego_mean0.06588133291247295
sim_render-ego_median0.06585901900182796
sim_render-ego_min0.0642846752615536
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
223673377awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyes11720:14:15(hidden)
driven_lanedir_consec_median0.3600832723053604
survival_time_median3.7499999999999942
deviation-center-line_median0.2370001128425238
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.2764461612701416
agent_compute-ego_mean0.2441114829381307
agent_compute-ego_median0.23250017245610555
agent_compute-ego_min0.22781463146209716
deviation-center-line_max0.46983978184464065
deviation-center-line_mean0.265422751447818
deviation-center-line_min0.17648732541296272
deviation-heading_max1.4220663005881111
deviation-heading_mean1.2300007442982823
deviation-heading_median1.2513842908170023
deviation-heading_min1.0249290935072062
driven_any_max1.261730942778066
driven_any_mean0.5665822191658659
driven_any_median0.40588022921270733
driven_any_min0.1911903707168364
driven_lanedir_consec_max1.253359937354204
driven_lanedir_consec_mean0.5192893500492889
driven_lanedir_consec_min0.16096578123108918
driven_lanedir_max1.253359937354204
driven_lanedir_mean0.5192893500492889
driven_lanedir_median0.3600832723053604
driven_lanedir_min0.16096578123108918
in-drivable-lane_max0.549999999999998
in-drivable-lane_mean0.1699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.261730942778066, "sim_physics": 0.1192740535736084, "survival_time": 14.950000000000076, "driven_lanedir": 1.253359937354204, "sim_render-ego": 0.06827484369277954, "in-drivable-lane": 0, "agent_compute-ego": 0.23250017245610555, "deviation-heading": 1.4220663005881111, "set_robot_commands": 0.10425901492436727, "deviation-center-line": 0.46983978184464065, "driven_lanedir_consec": 1.253359937354204, "sim_compute_sim_state": 0.0417912761370341, "sim_compute_performance-ego": 0.07488677183787028, "sim_compute_robot_state-ego": 0.08080487410227458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7125111159500466, "sim_physics": 0.1443380085627238, "survival_time": 7.499999999999981, "driven_lanedir": 0.6180765347196295, "sim_render-ego": 0.06874019304911295, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2764461612701416, "deviation-heading": 1.2513842908170023, "set_robot_commands": 0.113570818901062, "deviation-center-line": 0.2370001128425238, "driven_lanedir_consec": 0.6180765347196295, "sim_compute_sim_state": 0.04298814455668132, "sim_compute_performance-ego": 0.07970191319783529, "sim_compute_robot_state-ego": 0.09431117375691732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1911903707168364, "sim_physics": 0.11906254788239796, "survival_time": 2.3999999999999995, "driven_lanedir": 0.16096578123108918, "sim_render-ego": 0.062933549284935, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.22827829917271933, "deviation-heading": 1.034786009756154, "set_robot_commands": 0.10046255588531494, "deviation-center-line": 0.26457545795887066, "driven_lanedir_consec": 0.16096578123108918, "sim_compute_sim_state": 0.04016175369421641, "sim_compute_performance-ego": 0.07303314904371898, "sim_compute_robot_state-ego": 0.0793590098619461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2615984371716733, "sim_physics": 0.13067626953125, "survival_time": 2.499999999999999, "driven_lanedir": 0.2039612246361613, "sim_render-ego": 0.06580374717712402, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.22781463146209716, "deviation-heading": 1.41683802682294, "set_robot_commands": 0.10342989444732666, "deviation-center-line": 0.17648732541296272, "driven_lanedir_consec": 0.2039612246361613, "sim_compute_sim_state": 0.04257700920104981, "sim_compute_performance-ego": 0.07678280353546142, "sim_compute_robot_state-ego": 0.08091957092285157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.40588022921270733, "sim_physics": 0.126889435450236, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3600832723053604, "sim_render-ego": 0.06982618649800619, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25551815032958985, "deviation-heading": 1.0249290935072062, "set_robot_commands": 0.1120516840616862, "deviation-center-line": 0.1792110791800922, "driven_lanedir_consec": 0.3600832723053604, "sim_compute_sim_state": 0.04419377326965332, "sim_compute_performance-ego": 0.0808354918162028, "sim_compute_robot_state-ego": 0.08640523274739584}}
set_robot_commands_max0.113570818901062
set_robot_commands_mean0.10675479364395142
set_robot_commands_median0.10425901492436727
set_robot_commands_min0.10046255588531494
sim_compute_performance-ego_max0.0808354918162028
sim_compute_performance-ego_mean0.07704802588621776
sim_compute_performance-ego_median0.07678280353546142
sim_compute_performance-ego_min0.07303314904371898
sim_compute_robot_state-ego_max0.09431117375691732
sim_compute_robot_state-ego_mean0.08435997227827707
sim_compute_robot_state-ego_median0.08091957092285157
sim_compute_robot_state-ego_min0.0793590098619461
sim_compute_sim_state_max0.04419377326965332
sim_compute_sim_state_mean0.04234239137172699
sim_compute_sim_state_median0.04257700920104981
sim_compute_sim_state_min0.04016175369421641
sim_physics_max0.1443380085627238
sim_physics_mean0.12804806300004323
sim_physics_median0.126889435450236
sim_physics_min0.11906254788239796
sim_render-ego_max0.06982618649800619
sim_render-ego_mean0.06711570394039154
sim_render-ego_median0.06827484369277954
sim_render-ego_min0.062933549284935
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.22000000000001
survival_time_min2.3999999999999995
223563389jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11720:20:48(hidden)
driven_lanedir_consec_median1.3101192113142552
survival_time_median14.950000000000076
deviation-center-line_median0.24243863874496385
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.21871906406474564
agent_compute-ego_mean0.1966223645685818
agent_compute-ego_median0.19359436489286877
agent_compute-ego_min0.1749836492538452
deviation-center-line_max1.0434949873883317
deviation-center-line_mean0.4259194900659282
deviation-center-line_min0.1401830237429978
deviation-heading_max3.258302593425212
deviation-heading_mean1.6885883908401134
deviation-heading_median0.7515849483063952
deviation-heading_min0.6407369304334734
driven_any_max3.0039818546957533
driven_any_mean1.8331630654726871
driven_any_median1.454681517915794
driven_any_min0.5220382386221536
driven_lanedir_consec_max2.9239913863149116
driven_lanedir_consec_mean1.508249173433078
driven_lanedir_consec_min0.4982817657516895
driven_lanedir_max2.9239913863149116
driven_lanedir_mean1.720835785523868
driven_lanedir_median1.3101192113142552
driven_lanedir_min0.4982817657516895
in-drivable-lane_max10.750000000000083
in-drivable-lane_mean3.0400000000000142
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.878375035146398, "sim_physics": 0.11263713598251344, "survival_time": 14.950000000000076, "driven_lanedir": 2.6632423025599103, "sim_render-ego": 0.06187726736068726, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.1749836492538452, "deviation-heading": 3.135200716966442, "set_robot_commands": 0.09620190223058064, "deviation-center-line": 0.5503458169986458, "driven_lanedir_consec": 1.6003092421059613, "sim_compute_sim_state": 0.038529078960418704, "sim_compute_performance-ego": 0.06878667036692301, "sim_compute_robot_state-ego": 0.07465070327123006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5220382386221536, "sim_physics": 0.1445627122555139, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4982817657516895, "sim_render-ego": 0.06885628430348523, "in-drivable-lane": 0, "agent_compute-ego": 0.21871906406474564, "deviation-heading": 0.6407369304334734, "set_robot_commands": 0.11424758749188116, "deviation-center-line": 0.15313498345470178, "driven_lanedir_consec": 0.4982817657516895, "sim_compute_sim_state": 0.045748886072410726, "sim_compute_performance-ego": 0.0777261976925832, "sim_compute_robot_state-ego": 0.09126675353859956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3067386809833363, "sim_physics": 0.13906316246305192, "survival_time": 4.199999999999993, "driven_lanedir": 1.2085442616785729, "sim_render-ego": 0.06873538096745808, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.19359436489286877, "deviation-heading": 0.6571167650690457, "set_robot_commands": 0.1060973462604341, "deviation-center-line": 0.24243863874496385, "driven_lanedir_consec": 1.2085442616785729, "sim_compute_sim_state": 0.0434778786840893, "sim_compute_performance-ego": 0.07610999970209031, "sim_compute_robot_state-ego": 0.08468539374215263}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0039818546957533, "sim_physics": 0.12800871849060058, "survival_time": 14.950000000000076, "driven_lanedir": 2.9239913863149116, "sim_render-ego": 0.07116562128067017, "in-drivable-lane": 0, "agent_compute-ego": 0.20430974880854288, "deviation-heading": 3.258302593425212, "set_robot_commands": 0.10767183144887288, "deviation-center-line": 1.0434949873883317, "driven_lanedir_consec": 2.9239913863149116, "sim_compute_sim_state": 0.04324049870173136, "sim_compute_performance-ego": 0.07704393943150838, "sim_compute_robot_state-ego": 0.08723445574442545}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.454681517915794, "sim_physics": 0.1202328634262085, "survival_time": 14.950000000000076, "driven_lanedir": 1.3101192113142552, "sim_render-ego": 0.06755136887232463, "in-drivable-lane": 10.750000000000083, "agent_compute-ego": 0.1915049958229065, "deviation-heading": 0.7515849483063952, "set_robot_commands": 0.10575739781061808, "deviation-center-line": 0.1401830237429978, "driven_lanedir_consec": 1.3101192113142552, "sim_compute_sim_state": 0.04235537052154541, "sim_compute_performance-ego": 0.07545822223027547, "sim_compute_robot_state-ego": 0.08150821526845296}}
set_robot_commands_max0.11424758749188116
set_robot_commands_mean0.10599521304847737
set_robot_commands_median0.1060973462604341
set_robot_commands_min0.09620190223058064
sim_compute_performance-ego_max0.0777261976925832
sim_compute_performance-ego_mean0.07502500588467607
sim_compute_performance-ego_median0.07610999970209031
sim_compute_performance-ego_min0.06878667036692301
sim_compute_robot_state-ego_max0.09126675353859956
sim_compute_robot_state-ego_mean0.08386910431297213
sim_compute_robot_state-ego_median0.08468539374215263
sim_compute_robot_state-ego_min0.07465070327123006
sim_compute_sim_state_max0.045748886072410726
sim_compute_sim_state_mean0.042670342588039104
sim_compute_sim_state_median0.04324049870173136
sim_compute_sim_state_min0.038529078960418704
sim_physics_max0.1445627122555139
sim_physics_mean0.12890091852357768
sim_physics_median0.12800871849060058
sim_physics_min0.11263713598251344
sim_render-ego_max0.07116562128067017
sim_render-ego_mean0.06763718455692506
sim_render-ego_median0.06873538096745808
sim_render-ego_min0.06187726736068726
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.340000000000042
survival_time_min2.6499999999999986
223473393jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationerroryes11720:18:10
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223433398jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11720:36:58(hidden)
driven_lanedir_consec_median1.975330880415484
survival_time_median14.950000000000076
deviation-center-line_median0.8152060880479512
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.20326913913091024
agent_compute-ego_mean0.19453899039055003
agent_compute-ego_median0.1947681560727503
agent_compute-ego_min0.18446847796440125
deviation-center-line_max1.2439896860630633
deviation-center-line_mean0.7336670419879506
deviation-center-line_min0.19174177571362896
deviation-heading_max8.328715805744135
deviation-heading_mean3.925563463806928
deviation-heading_median2.100332901201745
deviation-heading_min1.3870670756587635
driven_any_max3.8256038488584583
driven_any_mean2.1896782591230353
driven_any_median2.009718876576007
driven_any_min0.7467103377245005
driven_lanedir_consec_max3.7660460672280416
driven_lanedir_consec_mean2.03846021981763
driven_lanedir_consec_min0.6950472409159887
driven_lanedir_max3.7660460672280416
driven_lanedir_mean2.0699085891611104
driven_lanedir_median1.975330880415484
driven_lanedir_min0.6950472409159887
in-drivable-lane_max11.45000000000008
in-drivable-lane_mean2.670000000000021
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7467103377245005, "sim_physics": 0.1803117815653483, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950472409159887, "sim_render-ego": 0.06881034851074219, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.20326913913091024, "deviation-heading": 1.4082215099017472, "set_robot_commands": 0.10494975725809733, "deviation-center-line": 0.2290947388457744, "driven_lanedir_consec": 0.6950472409159887, "sim_compute_sim_state": 0.04404317617416382, "sim_compute_performance-ego": 0.07779680887858073, "sim_compute_robot_state-ego": 0.0866978375116984, "sim_compute_robot_state-npc0": 0.07580942948659261, "sim_compute_robot_state-npc1": 0.07540695587793986, "sim_compute_robot_state-npc2": 0.07542869647343954, "sim_compute_robot_state-npc3": 0.07571980079015096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8256038488584583, "sim_physics": 0.20924810806910196, "survival_time": 14.950000000000076, "driven_lanedir": 3.7660460672280416, "sim_render-ego": 0.06768489917119344, "in-drivable-lane": 0, "agent_compute-ego": 0.193872762521108, "deviation-heading": 2.100332901201745, "set_robot_commands": 0.10421302159627278, "deviation-center-line": 1.2439896860630633, "driven_lanedir_consec": 3.7660460672280416, "sim_compute_sim_state": 0.04425558010737101, "sim_compute_performance-ego": 0.07431911071141561, "sim_compute_robot_state-ego": 0.08067410389582316, "sim_compute_robot_state-npc0": 0.0760317595799764, "sim_compute_robot_state-npc1": 0.07654194752375285, "sim_compute_robot_state-npc2": 0.0764156158765157, "sim_compute_robot_state-npc3": 0.07605855385462443}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.48025901410422, "sim_physics": 0.19501807153005, "survival_time": 13.550000000000058, "driven_lanedir": 2.177511542811998, "sim_render-ego": 0.06834905085968355, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.1947681560727503, "deviation-heading": 6.403480026528249, "set_robot_commands": 0.10479695682596016, "deviation-center-line": 0.8152060880479512, "driven_lanedir_consec": 2.0202696960945947, "sim_compute_sim_state": 0.04202929985919122, "sim_compute_performance-ego": 0.07532426967831996, "sim_compute_robot_state-ego": 0.08387716142013944, "sim_compute_robot_state-npc0": 0.07747483077524334, "sim_compute_robot_state-npc1": 0.07674055785710521, "sim_compute_robot_state-npc2": 0.0779617439776769, "sim_compute_robot_state-npc3": 0.07729974532039403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.009718876576007, "sim_physics": 0.1839338556925456, "survival_time": 14.950000000000076, "driven_lanedir": 1.975330880415484, "sim_render-ego": 0.069168381690979, "in-drivable-lane": 0, "agent_compute-ego": 0.19631641626358032, "deviation-heading": 8.328715805744135, "set_robot_commands": 0.10438000440597534, "deviation-center-line": 1.1883029212693352, "driven_lanedir_consec": 1.975330880415484, "sim_compute_sim_state": 0.043134349981943765, "sim_compute_performance-ego": 0.07530667781829833, "sim_compute_robot_state-ego": 0.08130394299825032, "sim_compute_robot_state-npc0": 0.07632042407989502, "sim_compute_robot_state-npc1": 0.07563967704772949, "sim_compute_robot_state-npc2": 0.07599569161732991, "sim_compute_robot_state-npc3": 0.07573440949122111}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.886099218351988, "sim_physics": 0.18042278760357908, "survival_time": 7.599999999999981, "driven_lanedir": 1.7356072144340409, "sim_render-ego": 0.06650007869067945, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.18446847796440125, "deviation-heading": 1.3870670756587635, "set_robot_commands": 0.09992631485587672, "deviation-center-line": 0.19174177571362896, "driven_lanedir_consec": 1.7356072144340409, "sim_compute_sim_state": 0.04185493996268824, "sim_compute_performance-ego": 0.07714120494691949, "sim_compute_robot_state-ego": 0.07764768757318195, "sim_compute_robot_state-npc0": 0.07516961034975554, "sim_compute_robot_state-npc1": 0.07589896415409289, "sim_compute_robot_state-npc2": 0.07382639928867943, "sim_compute_robot_state-npc3": 0.07568362982649553}}
set_robot_commands_max0.10494975725809733
set_robot_commands_mean0.10365321098843648
set_robot_commands_median0.10438000440597534
set_robot_commands_min0.09992631485587672
sim_compute_performance-ego_max0.07779680887858073
sim_compute_performance-ego_mean0.07597761440670683
sim_compute_performance-ego_median0.07532426967831996
sim_compute_performance-ego_min0.07431911071141561
sim_compute_robot_state-ego_max0.0866978375116984
sim_compute_robot_state-ego_mean0.08204014667981865
sim_compute_robot_state-ego_median0.08130394299825032
sim_compute_robot_state-ego_min0.07764768757318195
sim_compute_robot_state-npc0_max0.07747483077524334
sim_compute_robot_state-npc0_mean0.07616121085429259
sim_compute_robot_state-npc0_median0.0760317595799764
sim_compute_robot_state-npc0_min0.07516961034975554
sim_compute_robot_state-npc1_max0.07674055785710521
sim_compute_robot_state-npc1_mean0.07604562049212407
sim_compute_robot_state-npc1_median0.07589896415409289
sim_compute_robot_state-npc1_min0.07540695587793986
sim_compute_robot_state-npc2_max0.0779617439776769
sim_compute_robot_state-npc2_mean0.07592562944672829
sim_compute_robot_state-npc2_median0.07599569161732991
sim_compute_robot_state-npc2_min0.07382639928867943
sim_compute_robot_state-npc3_max0.07729974532039403
sim_compute_robot_state-npc3_mean0.07609922785657722
sim_compute_robot_state-npc3_median0.07573440949122111
sim_compute_robot_state-npc3_min0.07568362982649553
sim_compute_sim_state_max0.04425558010737101
sim_compute_sim_state_mean0.04306346921707161
sim_compute_sim_state_median0.043134349981943765
sim_compute_sim_state_min0.04185493996268824
sim_physics_max0.20924810806910196
sim_physics_mean0.189786920892125
sim_physics_median0.1839338556925456
sim_physics_min0.1803117815653483
sim_render-ego_max0.069168381690979
sim_render-ego_mean0.06810255178465552
sim_render-ego_median0.06834905085968355
sim_render-ego_min0.06650007869067945
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.200000000000054
survival_time_min7.599999999999981
223403400jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11720:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223373403jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11720:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223303432jp18813100494RL-TH-shiaido2-LFV-sim-testingstep1-simulationerroryes11720:14:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223283411jp18813100494RL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryes11720:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223163420jp18813100494RL-TH-shiaido2-LFVI-sim-validationstep1-simulationsuccessyes11720:40:56(hidden)
driven_lanedir_consec_median2.793613220206473
survival_time_median14.950000000000076
deviation-center-line_median0.831432818089618
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20119850397109984
agent_compute-ego_mean0.1985115806984179
agent_compute-ego_median0.19810761054356893
agent_compute-ego_min0.19637348810831703
deviation-center-line_max1.0703461526822913
deviation-center-line_mean0.7479476605143406
deviation-center-line_min0.2050644142697411
deviation-heading_max3.51411187445227
deviation-heading_mean2.5737518756634916
deviation-heading_median2.9902249016270286
deviation-heading_min0.6181915074137561
driven_any_max3.856107441478067
driven_any_mean2.8622537289075267
driven_any_median3.1858395652810274
driven_any_min1.0713096652020695
driven_lanedir_consec_max3.2003990522197725
driven_lanedir_consec_mean2.420404756000208
driven_lanedir_consec_min0.7236394526469256
driven_lanedir_max3.800844346863025
driven_lanedir_mean2.736629281581118
driven_lanedir_median3.094851952630199
driven_lanedir_min0.745114212487482
in-drivable-lane_max2.8999999999999897
in-drivable-lane_mean0.579999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.301458535689118, "sim_physics": 0.22278572082519532, "survival_time": 14.950000000000076, "driven_lanedir": 3.202275465924296, "sim_render-ego": 0.0688444701830546, "in-drivable-lane": 0, "agent_compute-ego": 0.1968394343058268, "deviation-heading": 3.4493324990088654, "set_robot_commands": 0.1068045210838318, "deviation-center-line": 0.831432818089618, "driven_lanedir_consec": 3.2003990522197725, "sim_compute_sim_state": 0.04390006303787231, "sim_compute_performance-ego": 0.0781190053621928, "sim_compute_robot_state-ego": 0.0835545555750529, "sim_compute_robot_state-npc0": 0.07605452140172322, "sim_compute_robot_state-npc1": 0.07762555996576945, "sim_compute_robot_state-npc2": 0.07612504720687867, "sim_compute_robot_state-npc3": 0.07785423358281453}, "udem1-1-0": {"driven_any": 2.896553436887352, "sim_physics": 0.22607219219207764, "survival_time": 14.950000000000076, "driven_lanedir": 2.8400604300005905, "sim_render-ego": 0.06972376585006713, "in-drivable-lane": 0, "agent_compute-ego": 0.19637348810831703, "deviation-heading": 2.9902249016270286, "set_robot_commands": 0.10612445910771688, "deviation-center-line": 0.9561452421303704, "driven_lanedir_consec": 2.416085405019757, "sim_compute_sim_state": 0.04358957370122274, "sim_compute_performance-ego": 0.07737599929173787, "sim_compute_robot_state-ego": 0.0841554061571757, "sim_compute_robot_state-npc0": 0.07579835255940755, "sim_compute_robot_state-npc1": 0.07738310654958089, "sim_compute_robot_state-npc2": 0.07673397541046142, "sim_compute_robot_state-npc3": 0.07744711875915528}, "udem1-2-0": {"driven_any": 3.856107441478067, "sim_physics": 0.2330665381749471, "survival_time": 14.950000000000076, "driven_lanedir": 3.800844346863025, "sim_render-ego": 0.06968851884206136, "in-drivable-lane": 0, "agent_compute-ego": 0.20119850397109984, "deviation-heading": 2.296898595815537, "set_robot_commands": 0.10643924315770469, "deviation-center-line": 0.6767496753996813, "driven_lanedir_consec": 2.9682866499081104, "sim_compute_sim_state": 0.04385519027709961, "sim_compute_performance-ego": 0.07678598165512085, "sim_compute_robot_state-ego": 0.08431519985198975, "sim_compute_robot_state-npc0": 0.07702276786168416, "sim_compute_robot_state-npc1": 0.07679777145385742, "sim_compute_robot_state-npc2": 0.075972052415212, "sim_compute_robot_state-npc3": 0.07677778959274292}, "udem1-3-0": {"driven_any": 1.0713096652020695, "sim_physics": 0.2454529025337913, "survival_time": 5.4999999999999885, "driven_lanedir": 0.745114212487482, "sim_render-ego": 0.06853847720406273, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.2000388665632768, "deviation-heading": 0.6181915074137561, "set_robot_commands": 0.1063176003369418, "deviation-center-line": 0.2050644142697411, "driven_lanedir_consec": 0.7236394526469256, "sim_compute_sim_state": 0.04370006647976962, "sim_compute_performance-ego": 0.07648711854761298, "sim_compute_robot_state-ego": 0.08439831083471125, "sim_compute_robot_state-npc0": 0.07572415308518843, "sim_compute_robot_state-npc1": 0.07616001042452726, "sim_compute_robot_state-npc2": 0.07601592107252642, "sim_compute_robot_state-npc3": 0.07658392949537797}, "udem1-4-0": {"driven_any": 3.1858395652810274, "sim_physics": 0.2288533107439677, "survival_time": 14.950000000000076, "driven_lanedir": 3.094851952630199, "sim_render-ego": 0.06916746457417806, "in-drivable-lane": 0, "agent_compute-ego": 0.19810761054356893, "deviation-heading": 3.51411187445227, "set_robot_commands": 0.10579914569854736, "deviation-center-line": 1.0703461526822913, "driven_lanedir_consec": 2.793613220206473, "sim_compute_sim_state": 0.04399078528086344, "sim_compute_performance-ego": 0.07718995173772177, "sim_compute_robot_state-ego": 0.08627924283345541, "sim_compute_robot_state-npc0": 0.0758350404103597, "sim_compute_robot_state-npc1": 0.0773648190498352, "sim_compute_robot_state-npc2": 0.075952840646108, "sim_compute_robot_state-npc3": 0.07894600629806518}}
set_robot_commands_max0.1068045210838318
set_robot_commands_mean0.1062969938769485
set_robot_commands_median0.1063176003369418
set_robot_commands_min0.10579914569854736
sim_compute_performance-ego_max0.0781190053621928
sim_compute_performance-ego_mean0.07719161131887725
sim_compute_performance-ego_median0.07718995173772177
sim_compute_performance-ego_min0.07648711854761298
sim_compute_robot_state-ego_max0.08627924283345541
sim_compute_robot_state-ego_mean0.084540543050477
sim_compute_robot_state-ego_median0.08431519985198975
sim_compute_robot_state-ego_min0.0835545555750529
sim_compute_robot_state-npc0_max0.07702276786168416
sim_compute_robot_state-npc0_mean0.07608696706367261
sim_compute_robot_state-npc0_median0.0758350404103597
sim_compute_robot_state-npc0_min0.07572415308518843
sim_compute_robot_state-npc1_max0.07762555996576945
sim_compute_robot_state-npc1_mean0.07706625348871404
sim_compute_robot_state-npc1_median0.0773648190498352
sim_compute_robot_state-npc1_min0.07616001042452726
sim_compute_robot_state-npc2_max0.07673397541046142
sim_compute_robot_state-npc2_mean0.07615996735023729
sim_compute_robot_state-npc2_median0.07601592107252642
sim_compute_robot_state-npc2_min0.075952840646108
sim_compute_robot_state-npc3_max0.07894600629806518
sim_compute_robot_state-npc3_mean0.07752181554563117
sim_compute_robot_state-npc3_median0.07744711875915528
sim_compute_robot_state-npc3_min0.07658392949537797
sim_compute_sim_state_max0.04399078528086344
sim_compute_sim_state_mean0.043807135755365545
sim_compute_sim_state_median0.04385519027709961
sim_compute_sim_state_min0.04358957370122274
sim_physics_max0.2454529025337913
sim_physics_mean0.2312461328939958
sim_physics_median0.2288533107439677
sim_physics_min0.22278572082519532
sim_render-ego_max0.06972376585006713
sim_render-ego_mean0.06919253933068478
sim_render-ego_median0.06916746457417806
sim_render-ego_min0.06853847720406273
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.06000000000006
survival_time_min5.4999999999999885
222793451JBRRussiaJetBrains Researchaido2-LFVI-sim-testingstep1-simulationsuccessyes11721 day, 3:19:42(hidden)
driven_lanedir_consec_median0.1317247195560296
survival_time_median1.2000000000000004
deviation-center-line_median0.08219741260720093
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19950543279233185
agent_compute-ego_mean0.1763837269267964
agent_compute-ego_median0.17473216678785242
agent_compute-ego_min0.155516117811203
deviation-center-line_max0.10874511587508642
deviation-center-line_mean0.08196673190175716
deviation-center-line_min0.05450527989714526
deviation-heading_max1.043446309902138
deviation-heading_mean0.6490692517310723
deviation-heading_median0.6207274979603687
deviation-heading_min0.3871094061896044
driven_any_max0.22513974380271376
driven_any_mean0.1832224902222035
driven_any_median0.18092412770527097
driven_any_min0.13785092191593512
driven_lanedir_consec_max0.1880336480956033
driven_lanedir_consec_mean0.13180919145897158
driven_lanedir_consec_min0.08709328988171317
driven_lanedir_max0.1880336480956033
driven_lanedir_mean0.13180919145897158
driven_lanedir_median0.1317247195560296
driven_lanedir_min0.08709328988171317
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21144547635499517, "sim_physics": 0.134416284232304, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1149933839599302, "sim_render-ego": 0.06498557123644598, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17311444775811555, "deviation-heading": 0.8455486636297789, "set_robot_commands": 0.10413991171738196, "deviation-center-line": 0.0795661226721915, "driven_lanedir_consec": 0.1149933839599302, "sim_compute_sim_state": 0.04205916667806691, "sim_compute_performance-ego": 0.07460678856948326, "sim_compute_robot_state-ego": 0.08146840950538373}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22513974380271376, "sim_physics": 0.11949340228376716, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16995810382023002, "sim_render-ego": 0.07015871179514918, "in-drivable-lane": 0, "agent_compute-ego": 0.16821896618810192, "deviation-heading": 0.6964549513411711, "set_robot_commands": 0.09858209511329388, "deviation-center-line": 0.060336190314394134, "driven_lanedir_consec": 0.16995810382023002, "sim_compute_sim_state": 0.04392915758593329, "sim_compute_performance-ego": 0.07463755278751769, "sim_compute_robot_state-ego": 0.0777187676265322}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14039173313718936, "sim_physics": 0.1276695489883423, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1147306251109037, "sim_render-ego": 0.0744513988494873, "in-drivable-lane": 0, "agent_compute-ego": 0.17244404554367063, "deviation-heading": 0.4682065072307927, "set_robot_commands": 0.0996333599090576, "deviation-center-line": 0.09309165757060582, "driven_lanedir_consec": 0.1147306251109037, "sim_compute_sim_state": 0.03888068199157715, "sim_compute_performance-ego": 0.07602386474609375, "sim_compute_robot_state-ego": 0.07344135046005248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19904184253842572, "sim_physics": 0.1474221394612239, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1215258592667543, "sim_render-ego": 0.0651017977641179, "in-drivable-lane": 0, "agent_compute-ego": 0.1866267461043138, "deviation-heading": 0.9365957134629656, "set_robot_commands": 0.10652822714585523, "deviation-center-line": 0.08219741260720093, "driven_lanedir_consec": 0.1215258592667543, "sim_compute_sim_state": 0.042626839417677656, "sim_compute_performance-ego": 0.07170677185058594, "sim_compute_robot_state-ego": 0.08216584645784818}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20236939074943683, "sim_physics": 0.13077763148716515, "survival_time": 1.4000000000000006, "driven_lanedir": 0.13332094890615176, "sim_render-ego": 0.06200741018567767, "in-drivable-lane": 0, "agent_compute-ego": 0.1754660521234785, "deviation-heading": 0.7791666213835622, "set_robot_commands": 0.0986676812171936, "deviation-center-line": 0.06774697377501501, "driven_lanedir_consec": 0.13332094890615176, "sim_compute_sim_state": 0.03976692472185407, "sim_compute_performance-ego": 0.07007219110216413, "sim_compute_robot_state-ego": 0.08717591421944755}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18558983928566128, "sim_physics": 0.13759985676518194, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08709328988171317, "sim_render-ego": 0.0650031566619873, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1882912141305429, "deviation-heading": 1.043446309902138, "set_robot_commands": 0.1043891465222394, "deviation-center-line": 0.0832105065294193, "driven_lanedir_consec": 0.08709328988171317, "sim_compute_sim_state": 0.042913631156638814, "sim_compute_performance-ego": 0.07328124399538394, "sim_compute_robot_state-ego": 0.09133773379855686}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.21979194466512147, "sim_physics": 0.12346588240729438, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1880336480956033, "sim_render-ego": 0.06104420732568811, "in-drivable-lane": 0, "agent_compute-ego": 0.16531780914024072, "deviation-heading": 0.5035295189025206, "set_robot_commands": 0.09853946721112286, "deviation-center-line": 0.09971525892844232, "driven_lanedir_consec": 0.1880336480956033, "sim_compute_sim_state": 0.04014846130653664, "sim_compute_performance-ego": 0.07165067284195512, "sim_compute_robot_state-ego": 0.07640705285248933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13785092191593512, "sim_physics": 0.1228772799173991, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10661007917337972, "sim_render-ego": 0.06552985736301967, "in-drivable-lane": 0, "agent_compute-ego": 0.1743201187678746, "deviation-heading": 0.537341426507484, "set_robot_commands": 0.09515164012000674, "deviation-center-line": 0.09497472892056848, "driven_lanedir_consec": 0.10661007917337972, "sim_compute_sim_state": 0.04209327697753906, "sim_compute_performance-ego": 0.07645890826270693, "sim_compute_robot_state-ego": 0.0766503129686628}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.18092412770527097, "sim_physics": 0.1102622350056966, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13435477171734345, "sim_render-ego": 0.07035765051841736, "in-drivable-lane": 0, "agent_compute-ego": 0.155516117811203, "deviation-heading": 0.6343910160964921, "set_robot_commands": 0.09647703170776369, "deviation-center-line": 0.058895015067796035, "driven_lanedir_consec": 0.13435477171734345, "sim_compute_sim_state": 0.035924394925435386, "sim_compute_performance-ego": 0.07409522930781047, "sim_compute_robot_state-ego": 0.07337417205174764}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.17829242430516715, "sim_physics": 0.14589247107505798, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14639798739221188, "sim_render-ego": 0.06629124283790588, "in-drivable-lane": 0, "agent_compute-ego": 0.1797172725200653, "deviation-heading": 0.48934239709722344, "set_robot_commands": 0.1006387968858083, "deviation-center-line": 0.0893602556794193, "driven_lanedir_consec": 0.14639798739221188, "sim_compute_sim_state": 0.04245083530743917, "sim_compute_performance-ego": 0.07598427931467693, "sim_compute_robot_state-ego": 0.08503056565920512}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16675531132819932, "sim_physics": 0.13131019343500552, "survival_time": 1.1500000000000004, "driven_lanedir": 0.14040102251373765, "sim_render-ego": 0.06817243410193402, "in-drivable-lane": 0, "agent_compute-ego": 0.17473216678785242, "deviation-heading": 0.4040006648846207, "set_robot_commands": 0.0962252720542576, "deviation-center-line": 0.10232664611229636, "driven_lanedir_consec": 0.14040102251373765, "sim_compute_sim_state": 0.03753533570662789, "sim_compute_performance-ego": 0.06960942434227985, "sim_compute_robot_state-ego": 0.07806934481081755}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1628716302324742, "sim_physics": 0.12985611955324808, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1234560399039184, "sim_render-ego": 0.06669386227925618, "in-drivable-lane": 0, "agent_compute-ego": 0.1806055506070455, "deviation-heading": 0.5999740450023605, "set_robot_commands": 0.1009304920832316, "deviation-center-line": 0.07592479116884888, "driven_lanedir_consec": 0.1234560399039184, "sim_compute_sim_state": 0.04205312331517538, "sim_compute_performance-ego": 0.07415571808815002, "sim_compute_robot_state-ego": 0.0743969480196635}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.21497161987450683, "sim_physics": 0.12993087938853673, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14501510747910262, "sim_render-ego": 0.06740431274686541, "in-drivable-lane": 0, "agent_compute-ego": 0.19121262005397252, "deviation-heading": 0.7902040363750013, "set_robot_commands": 0.10540298904691424, "deviation-center-line": 0.07890502340792738, "driven_lanedir_consec": 0.14501510747910262, "sim_compute_sim_state": 0.04113846165793283, "sim_compute_performance-ego": 0.07986786535808019, "sim_compute_robot_state-ego": 0.07997236933026995}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.17824839539338774, "sim_physics": 0.13125137660814368, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1317247195560296, "sim_render-ego": 0.06866917402847954, "in-drivable-lane": 0, "agent_compute-ego": 0.19950543279233185, "deviation-heading": 0.6207274979603687, "set_robot_commands": 0.11230751742487367, "deviation-center-line": 0.05450527989714526, "driven_lanedir_consec": 0.1317247195560296, "sim_compute_sim_state": 0.04549811197363812, "sim_compute_performance-ego": 0.08178650814553966, "sim_compute_robot_state-ego": 0.09314962055372156}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1446529520445679, "sim_physics": 0.12060046195983888, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11952228510756369, "sim_render-ego": 0.05993525548414751, "in-drivable-lane": 0, "agent_compute-ego": 0.16066734357313675, "deviation-heading": 0.3871094061896044, "set_robot_commands": 0.0966865908015858, "deviation-center-line": 0.10874511587508642, "driven_lanedir_consec": 0.11952228510756369, "sim_compute_sim_state": 0.04177707975560969, "sim_compute_performance-ego": 0.06442558765411377, "sim_compute_robot_state-ego": 0.07764403386549516}}
set_robot_commands_max0.11230751742487367
set_robot_commands_mean0.10095334793070572
set_robot_commands_median0.0996333599090576
set_robot_commands_min0.09515164012000674
sim_compute_performance-ego_max0.08178650814553966
sim_compute_performance-ego_mean0.0738908404244361
sim_compute_performance-ego_median0.07415571808815002
sim_compute_performance-ego_min0.06442558765411377
sim_compute_robot_state-ego_max0.09314962055372156
sim_compute_robot_state-ego_mean0.08053349614532625
sim_compute_robot_state-ego_median0.07806934481081755
sim_compute_robot_state-ego_min0.07337417205174764
sim_compute_sim_state_max0.04549811197363812
sim_compute_sim_state_mean0.0412530321651788
sim_compute_sim_state_median0.04205312331517538
sim_compute_sim_state_min0.035924394925435386
sim_physics_max0.1474221394612239
sim_physics_mean0.12952171750454702
sim_physics_median0.12993087938853673
sim_physics_min0.1102622350056966
sim_render-ego_max0.0744513988494873
sim_render-ego_mean0.06638706954523861
sim_render-ego_median0.06629124283790588
sim_render-ego_min0.05993525548414751
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.2500000000000009
survival_time_min1.0000000000000002
222452711RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11721:00:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222352865AlexKaravaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryes11720:09:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222313501JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11720:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)