Duckietown Challenges Home Challenges Submissions

Evaluator 1172

ID1172
evaluatorip-172-31-25-98-2062
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2062
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success21 22279
# timeout
# failed2 22455
# error33 22231
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230703550Amaury Camus 🇨🇭Running the real lane following -- without challenge containeraido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:07:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
230272372Liam Paull 🇨🇦minimal_agent (Python 3)aido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:19:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6591401084474304
survival_time_median6.949999999999983
deviation-center-line_median0.33899838427143014
in-drivable-lane_median1.999999999999993


other stats
agent_compute-ego_max0.1689305391243036
agent_compute-ego_mean0.16250644651149762
agent_compute-ego_median0.16508952776590982
agent_compute-ego_min0.15565031574618432
deviation-center-line_max0.4843179558881834
deviation-center-line_mean0.3389764450725529
deviation-center-line_min0.22729035014002288
deviation-heading_max1.1492236283129806
deviation-heading_mean0.9399487053044556
deviation-heading_median1.0007157377877205
deviation-heading_min0.7390440083021812
driven_any_max1.6381859911990262
driven_any_mean1.0096556470575024
driven_any_median0.9900915586687412
driven_any_min0.4167848967141688
driven_lanedir_consec_max1.2206700211390982
driven_lanedir_consec_mean0.7159598687953472
driven_lanedir_consec_min0.3888322247827789
driven_lanedir_max1.2206700211390982
driven_lanedir_mean0.7159598687953472
driven_lanedir_median0.6591401084474304
driven_lanedir_min0.3888322247827789
in-drivable-lane_max4.85000000000004
in-drivable-lane_mean1.8200000000000132
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.19601857233390535, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.06871264787029019, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1689305391243036, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.10841763105323848, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04283925440671633, "sim_compute_performance-ego": 0.07552030446718065, "sim_compute_robot_state-ego": 0.08348383320321281, "sim_compute_robot_state-npc0": 0.07622255009712933, "sim_compute_robot_state-npc1": 0.07584858283722143, "sim_compute_robot_state-npc2": 0.0757525653290234, "sim_compute_robot_state-npc3": 0.07684820332973123}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4167848967141688, "sim_physics": 0.20653357959928967, "survival_time": 3.149999999999997, "driven_lanedir": 0.3888322247827789, "sim_render-ego": 0.06566224779401507, "in-drivable-lane": 0, "agent_compute-ego": 0.1657295719025627, "deviation-heading": 1.1492236283129806, "set_robot_commands": 0.10316293958633664, "deviation-center-line": 0.22729035014002288, "driven_lanedir_consec": 0.3888322247827789, "sim_compute_sim_state": 0.042916002727690195, "sim_compute_performance-ego": 0.07298570587521508, "sim_compute_robot_state-ego": 0.08378475052969796, "sim_compute_robot_state-npc0": 0.07576147715250652, "sim_compute_robot_state-npc1": 0.07527384303864978, "sim_compute_robot_state-npc2": 0.07603121560717387, "sim_compute_robot_state-npc3": 0.0769811887589712}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.6381859911990262, "sim_physics": 0.16949225319756403, "survival_time": 11.250000000000025, "driven_lanedir": 0.8981740479582627, "sim_render-ego": 0.06378594716389974, "in-drivable-lane": 4.85000000000004, "agent_compute-ego": 0.15713227801852755, "deviation-heading": 1.0007157377877205, "set_robot_commands": 0.09720882309807671, "deviation-center-line": 0.4843179558881834, "driven_lanedir_consec": 0.8981740479582627, "sim_compute_sim_state": 0.04019492785135905, "sim_compute_performance-ego": 0.06818971104092068, "sim_compute_robot_state-ego": 0.07333150333828396, "sim_compute_robot_state-npc0": 0.07031216197543674, "sim_compute_robot_state-npc1": 0.07005647235446506, "sim_compute_robot_state-npc2": 0.06988974253336588, "sim_compute_robot_state-npc3": 0.0697970920138889}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.578827325923981, "sim_physics": 0.1806282689494471, "survival_time": 10.85000000000002, "driven_lanedir": 1.2206700211390982, "sim_render-ego": 0.06469992009176087, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.15565031574618432, "deviation-heading": 1.0094809624268894, "set_robot_commands": 0.09792508947135116, "deviation-center-line": 0.41569520444906216, "driven_lanedir_consec": 1.2206700211390982, "sim_compute_sim_state": 0.0395633844735985, "sim_compute_performance-ego": 0.06902746341195524, "sim_compute_robot_state-ego": 0.07589436236614455, "sim_compute_robot_state-npc0": 0.0710241882482432, "sim_compute_robot_state-npc1": 0.07027243469167964, "sim_compute_robot_state-npc2": 0.07040042701404765, "sim_compute_robot_state-npc3": 0.0693279784945299}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.42438846278159503, "sim_physics": 0.19300367340208993, "survival_time": 3.149999999999997, "driven_lanedir": 0.4129829416491664, "sim_render-ego": 0.06810017616029769, "in-drivable-lane": 0, "agent_compute-ego": 0.16508952776590982, "deviation-heading": 0.7390440083021812, "set_robot_commands": 0.10836267849755664, "deviation-center-line": 0.22858033061406635, "driven_lanedir_consec": 0.4129829416491664, "sim_compute_sim_state": 0.04485487181042868, "sim_compute_performance-ego": 0.0758292107355027, "sim_compute_robot_state-ego": 0.081641295599559, "sim_compute_robot_state-npc0": 0.07437694640386672, "sim_compute_robot_state-npc1": 0.07443979429820227, "sim_compute_robot_state-npc2": 0.0741158856285943, "sim_compute_robot_state-npc3": 0.07579637330675883}}
set_robot_commands_max0.10841763105323848
set_robot_commands_mean0.10301543234131194
set_robot_commands_median0.10316293958633664
set_robot_commands_min0.09720882309807671
sim_compute_performance-ego_max0.0758292107355027
sim_compute_performance-ego_mean0.07231047910615487
sim_compute_performance-ego_median0.07298570587521508
sim_compute_performance-ego_min0.06818971104092068
sim_compute_robot_state-ego_max0.08378475052969796
sim_compute_robot_state-ego_mean0.07962714900737966
sim_compute_robot_state-ego_median0.081641295599559
sim_compute_robot_state-ego_min0.07333150333828396
sim_compute_robot_state-npc0_max0.07622255009712933
sim_compute_robot_state-npc0_mean0.0735394647754365
sim_compute_robot_state-npc0_median0.07437694640386672
sim_compute_robot_state-npc0_min0.07031216197543674
sim_compute_robot_state-npc1_max0.07584858283722143
sim_compute_robot_state-npc1_mean0.07317822544404365
sim_compute_robot_state-npc1_median0.07443979429820227
sim_compute_robot_state-npc1_min0.07005647235446506
sim_compute_robot_state-npc2_max0.07603121560717387
sim_compute_robot_state-npc2_mean0.07323796722244101
sim_compute_robot_state-npc2_median0.0741158856285943
sim_compute_robot_state-npc2_min0.06988974253336588
sim_compute_robot_state-npc3_max0.0769811887589712
sim_compute_robot_state-npc3_mean0.07375016718077601
sim_compute_robot_state-npc3_median0.07579637330675883
sim_compute_robot_state-npc3_min0.0693279784945299
sim_compute_sim_state_max0.04485487181042868
sim_compute_sim_state_mean0.042073688253958554
sim_compute_sim_state_median0.04283925440671633
sim_compute_sim_state_min0.0395633844735985
sim_physics_max0.20653357959928967
sim_physics_mean0.18913526949645923
sim_physics_median0.19300367340208993
sim_physics_min0.16949225319756403
sim_render-ego_max0.06871264787029019
sim_render-ego_mean0.06619218781605271
sim_render-ego_median0.06566224779401507
sim_render-ego_min0.06378594716389974
simulation-passed1
survival_time_max11.250000000000025
survival_time_mean7.070000000000005
survival_time_min3.149999999999997
No reset possible
230082395Liam Paull 🇨🇦random_agentaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-25-98-20620:21:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.1553578105153917
agent_compute-ego_mean0.14418558541921575
agent_compute-ego_median0.14990535804203578
agent_compute-ego_min0.10728226209941664
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.17158069433989348, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06527552781281648, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1515495909584893, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10721093636971932, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04280280625378644, "sim_compute_performance-ego": 0.07248444910402652, "sim_compute_robot_state-ego": 0.0771334347901521, "sim_compute_robot_state-npc0": 0.07283435044465242, "sim_compute_robot_state-npc1": 0.07446714683815285, "sim_compute_robot_state-npc2": 0.07501930660671657, "sim_compute_robot_state-npc3": 0.07120426495869954}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.22017813682556153, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06273139953613281, "in-drivable-lane": 0, "agent_compute-ego": 0.13891595840454102, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10408958435058592, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04080988883972168, "sim_compute_performance-ego": 0.07058736801147461, "sim_compute_robot_state-ego": 0.0802312183380127, "sim_compute_robot_state-npc0": 0.07548025131225586, "sim_compute_robot_state-npc1": 0.0736103343963623, "sim_compute_robot_state-npc2": 0.07572793960571289, "sim_compute_robot_state-npc3": 0.0727196216583252}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19707146130110087, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06712234647650468, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.14408513119346217, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.09891426876971596, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04257477584638094, "sim_compute_performance-ego": 0.07376511159696077, "sim_compute_robot_state-ego": 0.07860646436088964, "sim_compute_robot_state-npc0": 0.07210695429852135, "sim_compute_robot_state-npc1": 0.0743686462703504, "sim_compute_robot_state-npc2": 0.07105225324630737, "sim_compute_robot_state-npc3": 0.07284513586445858}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.21014773996570443, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.07056374489506588, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.1553578105153917, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10214860228043568, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04215022883837736, "sim_compute_performance-ego": 0.07549923884717724, "sim_compute_robot_state-ego": 0.08318395554264889, "sim_compute_robot_state-npc0": 0.07301198983494239, "sim_compute_robot_state-npc1": 0.07176041301292709, "sim_compute_robot_state-npc2": 0.07286113726941845, "sim_compute_robot_state-npc3": 0.07510513293592236}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.183304991040911, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06470528670719691, "in-drivable-lane": 0, "agent_compute-ego": 0.14990535804203578, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10141559158052715, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04392319066183908, "sim_compute_performance-ego": 0.06978901794978551, "sim_compute_robot_state-ego": 0.0754690340587071, "sim_compute_robot_state-npc0": 0.07782125473022461, "sim_compute_robot_state-npc1": 0.08016096694128853, "sim_compute_robot_state-npc2": 0.07398016963686262, "sim_compute_robot_state-npc3": 0.07511441196714129}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.15115302138858372, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.05616774823930529, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.12165565843935366, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08430283157913773, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03652504196873418, "sim_compute_performance-ego": 0.06319224834442139, "sim_compute_robot_state-ego": 0.0672747117501718, "sim_compute_robot_state-npc0": 0.06206461235328957, "sim_compute_robot_state-npc1": 0.06426377649660464, "sim_compute_robot_state-npc2": 0.06161738325048376, "sim_compute_robot_state-npc3": 0.06172529414848045}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16672401516525834, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.06240208943684896, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.14125484448892098, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.10261382438518384, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.04234545319168656, "sim_compute_performance-ego": 0.06893315580156115, "sim_compute_robot_state-ego": 0.07561107476552327, "sim_compute_robot_state-npc0": 0.07246674431694879, "sim_compute_robot_state-npc1": 0.07148873805999756, "sim_compute_robot_state-npc2": 0.07223911638613101, "sim_compute_robot_state-npc3": 0.07178357353916874}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.24017459551493328, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.07152847713894314, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.154296875, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10988669925265844, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04543991618686252, "sim_compute_performance-ego": 0.07850146823459202, "sim_compute_robot_state-ego": 0.08665118217468262, "sim_compute_robot_state-npc0": 0.07961153454250759, "sim_compute_robot_state-npc1": 0.07926014794243706, "sim_compute_robot_state-npc2": 0.07767641279432509, "sim_compute_robot_state-npc3": 0.07512300279405382}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.17945859743201217, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06612615481666896, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1495915184850278, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10747438928355342, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04356614921403968, "sim_compute_performance-ego": 0.07119040385536525, "sim_compute_robot_state-ego": 0.07845100630884586, "sim_compute_robot_state-npc0": 0.07727353987486466, "sim_compute_robot_state-npc1": 0.07615792751312256, "sim_compute_robot_state-npc2": 0.07430455477341362, "sim_compute_robot_state-npc3": 0.07317716142405635}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.20512887001037597, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06925641536712647, "in-drivable-lane": 0, "agent_compute-ego": 0.15192174911499023, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10543683528900148, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.0447259521484375, "sim_compute_performance-ego": 0.07887151718139648, "sim_compute_robot_state-ego": 0.08260430812835694, "sim_compute_robot_state-npc0": 0.07410776138305664, "sim_compute_robot_state-npc1": 0.07512409687042236, "sim_compute_robot_state-npc2": 0.07486736297607421, "sim_compute_robot_state-npc3": 0.07679613590240479}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.19287055730819705, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.06123565435409546, "in-drivable-lane": 0, "agent_compute-ego": 0.13496770858764648, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.09661552906036378, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.037418174743652347, "sim_compute_performance-ego": 0.06983166933059692, "sim_compute_robot_state-ego": 0.07053611278533936, "sim_compute_robot_state-npc0": 0.07005132436752319, "sim_compute_robot_state-npc1": 0.06907548904418945, "sim_compute_robot_state-npc2": 0.07232738733291626, "sim_compute_robot_state-npc3": 0.07278404235839844}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.1378201685453716, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.046443048276399314, "in-drivable-lane": 0, "agent_compute-ego": 0.10728226209941664, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.07120995772512335, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.03262174756903397, "sim_compute_performance-ego": 0.05622674289502596, "sim_compute_robot_state-ego": 0.05763012484500283, "sim_compute_robot_state-npc0": 0.05531329857675653, "sim_compute_robot_state-npc1": 0.05928441097861842, "sim_compute_robot_state-npc2": 0.06107844804462634, "sim_compute_robot_state-npc3": 0.06106162071228027}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.1786053228378296, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06624415397644043, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.15382811069488525, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10149191856384278, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04154759407043457, "sim_compute_performance-ego": 0.07546787738800048, "sim_compute_robot_state-ego": 0.08201432704925538, "sim_compute_robot_state-npc0": 0.07671097278594971, "sim_compute_robot_state-npc1": 0.07515477180480958, "sim_compute_robot_state-npc2": 0.07460204601287841, "sim_compute_robot_state-npc3": 0.08378151893615722}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2646293640136719, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.0693238756873391, "in-drivable-lane": 0, "agent_compute-ego": 0.15294242988933215, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.1026681119745428, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.04340583627874201, "sim_compute_performance-ego": 0.07928321578285911, "sim_compute_robot_state-ego": 0.08591281283985484, "sim_compute_robot_state-npc0": 0.07504024288871071, "sim_compute_robot_state-npc1": 0.07605258984999223, "sim_compute_robot_state-npc2": 0.0739614421671087, "sim_compute_robot_state-npc3": 0.07161372358148749}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.22185018111248409, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.07310232337640256, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.15522877537474342, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10673820242589832, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04443809937457649, "sim_compute_performance-ego": 0.07915616522029954, "sim_compute_robot_state-ego": 0.0892901323279556, "sim_compute_robot_state-npc0": 0.0773710231391751, "sim_compute_robot_state-npc1": 0.07945268494742257, "sim_compute_robot_state-npc2": 0.07749847489960339, "sim_compute_robot_state-npc3": 0.07572469905931123}}
set_robot_commands_max0.10988669925265844
set_robot_commands_mean0.10014781885935266
set_robot_commands_median0.10261382438518384
set_robot_commands_min0.07120995772512335
sim_compute_performance-ego_max0.07928321578285911
sim_compute_performance-ego_mean0.07218530996956952
sim_compute_performance-ego_median0.07248444910402652
sim_compute_performance-ego_min0.05622674289502596
sim_compute_robot_state-ego_max0.0892901323279556
sim_compute_robot_state-ego_mean0.07803999333769325
sim_compute_robot_state-ego_median0.07860646436088964
sim_compute_robot_state-ego_min0.05763012484500283
sim_compute_robot_state-npc0_max0.07961153454250759
sim_compute_robot_state-npc0_mean0.0727510569899586
sim_compute_robot_state-npc0_median0.07410776138305664
sim_compute_robot_state-npc0_min0.05531329857675653
sim_compute_robot_state-npc1_max0.08016096694128853
sim_compute_robot_state-npc1_mean0.07331214273111318
sim_compute_robot_state-npc1_median0.07446714683815285
sim_compute_robot_state-npc1_min0.05928441097861842
sim_compute_robot_state-npc2_max0.07767641279432509
sim_compute_robot_state-npc2_mean0.07258756233350525
sim_compute_robot_state-npc2_median0.07398016963686262
sim_compute_robot_state-npc2_min0.06107844804462634
sim_compute_robot_state-npc3_max0.08378151893615722
sim_compute_robot_state-npc3_mean0.07270395598935638
sim_compute_robot_state-npc3_median0.07284513586445858
sim_compute_robot_state-npc3_min0.06106162071228027
sim_compute_sim_state_max0.04543991618686252
sim_compute_sim_state_mean0.04161965701242035
sim_compute_sim_state_median0.04257477584638094
sim_compute_sim_state_min0.03262174756903397
sim_physics_max0.2646293640136719
sim_physics_mean0.1947131811201259
sim_physics_median0.19287055730819705
sim_physics_min0.1378201685453716
sim_render-ego_max0.07310232337640256
sim_render-ego_mean0.06481521640648577
sim_render-ego_median0.06612615481666896
sim_render-ego_min0.046443048276399314
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
No reset possible
229902413jiang pengBaseline solution using reinforcement learningaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:15:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229822425Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:10:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.493517638549009
survival_time_median2.3999999999999995
deviation-center-line_median0.09791133281082
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.1513070736116576
agent_compute-ego_mean0.14321717316138177
agent_compute-ego_median0.14767409879950028
agent_compute-ego_min0.1202344780876523
deviation-center-line_max0.2348196785686717
deviation-center-line_mean0.13547481992266058
deviation-center-line_min0.06216029860587694
deviation-heading_max0.8115272458314897
deviation-heading_mean0.49959867397150787
deviation-heading_median0.46504862964833654
deviation-heading_min0.30044835691402494
driven_any_max2.1864003300000694
driven_any_mean1.1068208197848532
driven_any_median0.9410513078477724
driven_any_min0.34749292376309954
driven_lanedir_consec_max1.826231945363564
driven_lanedir_consec_mean0.804744013449103
driven_lanedir_consec_min0.3325249708009643
driven_lanedir_max1.826231945363564
driven_lanedir_mean0.804828147320482
driven_lanedir_median0.493517638549009
driven_lanedir_min0.3325249708009643
in-drivable-lane_max1.3499999999999952
in-drivable-lane_mean0.5599999999999984
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22881967508340184, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.07127259351030181, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14767409879950028, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10519555852382996, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.043533922750738606, "sim_compute_performance-ego": 0.07612518117397646, "sim_compute_robot_state-ego": 0.0811745939375479, "sim_compute_robot_state-npc0": 0.07491615754139574, "sim_compute_robot_state-npc1": 0.07198269457756719, "sim_compute_robot_state-npc2": 0.07262359993367255, "sim_compute_robot_state-npc3": 0.07348666311819342}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22755334206989833, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06434604951313563, "in-drivable-lane": 0, "agent_compute-ego": 0.15092618124825613, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.0989066447530474, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04094005482537406, "sim_compute_performance-ego": 0.06930228642054967, "sim_compute_robot_state-ego": 0.07600527150290352, "sim_compute_robot_state-npc0": 0.07507887056895665, "sim_compute_robot_state-npc1": 0.07072934934071132, "sim_compute_robot_state-npc2": 0.07293916600091117, "sim_compute_robot_state-npc3": 0.07284464154924665}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.21312438400046335, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06855947994491429, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1513070736116576, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.1045813028094838, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.042409670005724265, "sim_compute_performance-ego": 0.07672920273345651, "sim_compute_robot_state-ego": 0.08200758869208179, "sim_compute_robot_state-npc0": 0.0750435602317736, "sim_compute_robot_state-npc1": 0.07487697045779923, "sim_compute_robot_state-npc2": 0.0758296841556586, "sim_compute_robot_state-npc3": 0.0748345574128975}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2467664877573649, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06726569930712382, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14594403405984244, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.09989510973294576, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04306607445081075, "sim_compute_performance-ego": 0.08018941183884938, "sim_compute_robot_state-ego": 0.0819829950730006, "sim_compute_robot_state-npc0": 0.0728884885708491, "sim_compute_robot_state-npc1": 0.0729912519454956, "sim_compute_robot_state-npc2": 0.07377926011880238, "sim_compute_robot_state-npc3": 0.07320375740528107}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.17774483135768346, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.05446821167355492, "in-drivable-lane": 0, "agent_compute-ego": 0.1202344780876523, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.08932248751322429, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03266568410964239, "sim_compute_performance-ego": 0.0640490282149542, "sim_compute_robot_state-ego": 0.06837354387555804, "sim_compute_robot_state-npc0": 0.06058557828267416, "sim_compute_robot_state-npc1": 0.062002159300304595, "sim_compute_robot_state-npc2": 0.0607147216796875, "sim_compute_robot_state-npc3": 0.0629684811546689}}
set_robot_commands_max0.10519555852382996
set_robot_commands_mean0.09958022066650624
set_robot_commands_median0.09989510973294576
set_robot_commands_min0.08932248751322429
sim_compute_performance-ego_max0.08018941183884938
sim_compute_performance-ego_mean0.07327902207635724
sim_compute_performance-ego_median0.07612518117397646
sim_compute_performance-ego_min0.0640490282149542
sim_compute_robot_state-ego_max0.08200758869208179
sim_compute_robot_state-ego_mean0.07790879861621838
sim_compute_robot_state-ego_median0.0811745939375479
sim_compute_robot_state-ego_min0.06837354387555804
sim_compute_robot_state-npc0_max0.07507887056895665
sim_compute_robot_state-npc0_mean0.07170253103912985
sim_compute_robot_state-npc0_median0.07491615754139574
sim_compute_robot_state-npc0_min0.06058557828267416
sim_compute_robot_state-npc1_max0.07487697045779923
sim_compute_robot_state-npc1_mean0.0705164851243756
sim_compute_robot_state-npc1_median0.07198269457756719
sim_compute_robot_state-npc1_min0.062002159300304595
sim_compute_robot_state-npc2_max0.0758296841556586
sim_compute_robot_state-npc2_mean0.07117728637774644
sim_compute_robot_state-npc2_median0.07293916600091117
sim_compute_robot_state-npc2_min0.0607147216796875
sim_compute_robot_state-npc3_max0.0748345574128975
sim_compute_robot_state-npc3_mean0.0714676201280575
sim_compute_robot_state-npc3_median0.07320375740528107
sim_compute_robot_state-npc3_min0.0629684811546689
sim_compute_sim_state_max0.043533922750738606
sim_compute_sim_state_mean0.04052308122845801
sim_compute_sim_state_median0.042409670005724265
sim_compute_sim_state_min0.03266568410964239
sim_physics_max0.2467664877573649
sim_physics_mean0.21880174405376235
sim_physics_median0.22755334206989833
sim_physics_min0.17774483135768346
sim_render-ego_max0.07127259351030181
sim_render-ego_mean0.06518240678980611
sim_render-ego_median0.06726569930712382
sim_render-ego_min0.05446821167355492
simulation-passed1
survival_time_max5.14999999999999
survival_time_mean2.789999999999997
survival_time_min1.0500000000000005
No reset possible
229732442Jacopo Tanirandom_agentaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.6999999999999984
deviation-center-line_median0.11519544839797546
in-drivable-lane_median0.5999999999999979


other stats
agent_compute-ego_max0.17204000980039186
agent_compute-ego_mean0.1653974694114921
agent_compute-ego_median0.16555091857910156
agent_compute-ego_min0.15911416496549333
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.12651756552531995
deviation-center-line_min0.09047885846140293
deviation-heading_max0.5020407942599273
deviation-heading_mean0.3641979127291371
deviation-heading_median0.34764983431811214
deviation-heading_min0.19401296908406307
driven_any_max1.6169932854589035
driven_any_mean1.0272530755098266
driven_any_median1.0243289631429708
driven_any_min0.4119037580118998
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.7800316850006626
driven_lanedir_consec_min0.3792793194470208
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.7800316850006626
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.3792793194470208
in-drivable-lane_max0.9999999999999976
in-drivable-lane_mean0.4899999999999984
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.16396369315959788, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06835830653155292, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16719133765609176, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10391752808182328, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04211414301836932, "sim_compute_performance-ego": 0.07634818995440448, "sim_compute_robot_state-ego": 0.07777493971365469, "sim_compute_robot_state-npc0": 0.07280560334523518, "sim_compute_robot_state-npc1": 0.07203345828586155, "sim_compute_robot_state-npc2": 0.0808576919414379, "sim_compute_robot_state-npc3": 0.07573665512932672}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21602338790893555, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.06986265182495117, "in-drivable-lane": 0, "agent_compute-ego": 0.16555091857910156, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.108322172164917, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.04456878662109375, "sim_compute_performance-ego": 0.079002046585083, "sim_compute_robot_state-ego": 0.0824167251586914, "sim_compute_robot_state-npc0": 0.07251471519470215, "sim_compute_robot_state-npc1": 0.0711040210723877, "sim_compute_robot_state-npc2": 0.07230816841125488, "sim_compute_robot_state-npc3": 0.07589304924011231}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.19753612970051013, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.06623592502192448, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16309091605638204, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.1045794832079034, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.03970939234683389, "sim_compute_performance-ego": 0.07422333642056114, "sim_compute_robot_state-ego": 0.08191611892298649, "sim_compute_robot_state-npc0": 0.07450389862060547, "sim_compute_robot_state-npc1": 0.07361858455758345, "sim_compute_robot_state-npc2": 0.07358205632159584, "sim_compute_robot_state-npc3": 0.07177740021755821}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.2023926837534844, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06809459155118919, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.17204000980039186, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10913452619238743, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04256306117094016, "sim_compute_performance-ego": 0.07497951350634612, "sim_compute_robot_state-ego": 0.07805336276187172, "sim_compute_robot_state-npc0": 0.07547528230691258, "sim_compute_robot_state-npc1": 0.07327578339395643, "sim_compute_robot_state-npc2": 0.07600068744224837, "sim_compute_robot_state-npc3": 0.07444791250591036}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.18318985189710343, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06438991853169032, "in-drivable-lane": 0, "agent_compute-ego": 0.15911416496549333, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.09671167816434588, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.040085409368787496, "sim_compute_performance-ego": 0.06691393681934901, "sim_compute_robot_state-ego": 0.07915466172354561, "sim_compute_robot_state-npc0": 0.07084367104939052, "sim_compute_robot_state-npc1": 0.06905056749071393, "sim_compute_robot_state-npc2": 0.07288741213934762, "sim_compute_robot_state-npc3": 0.07163919721330915}}
set_robot_commands_max0.10913452619238743
set_robot_commands_mean0.1045330775622754
set_robot_commands_median0.1045794832079034
set_robot_commands_min0.09671167816434588
sim_compute_performance-ego_max0.079002046585083
sim_compute_performance-ego_mean0.07429340465714876
sim_compute_performance-ego_median0.07497951350634612
sim_compute_performance-ego_min0.06691393681934901
sim_compute_robot_state-ego_max0.0824167251586914
sim_compute_robot_state-ego_mean0.07986316165614998
sim_compute_robot_state-ego_median0.07915466172354561
sim_compute_robot_state-ego_min0.07777493971365469
sim_compute_robot_state-npc0_max0.07547528230691258
sim_compute_robot_state-npc0_mean0.07322863410336918
sim_compute_robot_state-npc0_median0.07280560334523518
sim_compute_robot_state-npc0_min0.07084367104939052
sim_compute_robot_state-npc1_max0.07361858455758345
sim_compute_robot_state-npc1_mean0.07181648296010061
sim_compute_robot_state-npc1_median0.07203345828586155
sim_compute_robot_state-npc1_min0.06905056749071393
sim_compute_robot_state-npc2_max0.0808576919414379
sim_compute_robot_state-npc2_mean0.07512720325117692
sim_compute_robot_state-npc2_median0.07358205632159584
sim_compute_robot_state-npc2_min0.07230816841125488
sim_compute_robot_state-npc3_max0.07589304924011231
sim_compute_robot_state-npc3_mean0.07389884286124335
sim_compute_robot_state-npc3_median0.07444791250591036
sim_compute_robot_state-npc3_min0.07163919721330915
sim_compute_sim_state_max0.04456878662109375
sim_compute_sim_state_mean0.041808158505204925
sim_compute_sim_state_median0.04211414301836932
sim_compute_sim_state_min0.03970939234683389
sim_physics_max0.21602338790893555
sim_physics_mean0.1926211492839263
sim_physics_median0.19753612970051013
sim_physics_min0.16396369315959788
sim_render-ego_max0.06986265182495117
sim_render-ego_mean0.06738827869226163
sim_render-ego_median0.06809459155118919
sim_render-ego_min0.06438991853169032
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.6199999999999974
survival_time_min1.2500000000000004
No reset possible
229422496Liam Paull 🇨🇦challenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:18:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.08278118188177608
survival_time_median1.4000000000000006
deviation-center-line_median0.0891189905794223
in-drivable-lane_median0.5500000000000004


other stats
agent_compute-ego_max0.1975432691119966
agent_compute-ego_mean0.18634589247913153
agent_compute-ego_median0.18673363557228675
agent_compute-ego_min0.17621033390363058
deviation-center-line_max0.3160797831874244
deviation-center-line_mean0.13929092192316905
deviation-center-line_min0.015973128257746334
deviation-heading_max5.955097246085351
deviation-heading_mean2.5389602703729897
deviation-heading_median0.6041246682862939
deviation-heading_min0.4868278401353335
driven_any_max1.7638533736827344
driven_any_mean0.7134532991078512
driven_any_median0.12542848288208402
driven_any_min0.1160380996671193
driven_lanedir_consec_max0.5777702192944716
driven_lanedir_consec_mean0.24417695812278312
driven_lanedir_consec_min0.02699196025978712
driven_lanedir_max0.5777702192944716
driven_lanedir_mean0.24417695812278312
driven_lanedir_median0.08278118188177608
driven_lanedir_min0.02699196025978712
in-drivable-lane_max7.250000000000044
in-drivable-lane_mean2.8500000000000147
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.7638533736827344, "sim_physics": 0.18912181695302327, "survival_time": 14.950000000000076, "driven_lanedir": 0.5777702192944716, "sim_render-ego": 0.06791524410247803, "in-drivable-lane": 7.250000000000044, "agent_compute-ego": 0.18723393201828004, "deviation-heading": 5.955097246085351, "set_robot_commands": 0.1033493399620056, "deviation-center-line": 0.3160797831874244, "driven_lanedir_consec": 0.5777702192944716, "sim_compute_sim_state": 0.042635249296824135, "sim_compute_performance-ego": 0.07523764689763388, "sim_compute_robot_state-ego": 0.0799435544013977, "sim_compute_robot_state-npc0": 0.07550516923268637, "sim_compute_robot_state-npc1": 0.0734904670715332, "sim_compute_robot_state-npc2": 0.07435404380162557, "sim_compute_robot_state-npc3": 0.07428795814514161}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4451861957012877, "sim_physics": 0.18612462190481333, "survival_time": 13.00000000000005, "driven_lanedir": 0.4654927550946315, "sim_render-ego": 0.0677170047393212, "in-drivable-lane": 6.300000000000028, "agent_compute-ego": 0.18673363557228675, "deviation-heading": 5.127888481583611, "set_robot_commands": 0.10520442724227903, "deviation-center-line": 0.19441458891663907, "driven_lanedir_consec": 0.4654927550946315, "sim_compute_sim_state": 0.04383310904869667, "sim_compute_performance-ego": 0.07729591773106502, "sim_compute_robot_state-ego": 0.08316834156329815, "sim_compute_robot_state-npc0": 0.07704217433929443, "sim_compute_robot_state-npc1": 0.0758605406834529, "sim_compute_robot_state-npc2": 0.07512778502244216, "sim_compute_robot_state-npc3": 0.07642465646450336}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1167603436060304, "sim_physics": 0.2548132964542934, "survival_time": 1.0500000000000005, "driven_lanedir": 0.08278118188177608, "sim_render-ego": 0.06899980136326381, "in-drivable-lane": 0, "agent_compute-ego": 0.1975432691119966, "deviation-heading": 0.4868278401353335, "set_robot_commands": 0.10608847935994466, "deviation-center-line": 0.0891189905794223, "driven_lanedir_consec": 0.08278118188177608, "sim_compute_sim_state": 0.04888554981776646, "sim_compute_performance-ego": 0.08462674277169364, "sim_compute_robot_state-ego": 0.1022579102289109, "sim_compute_robot_state-npc0": 0.08176141693478539, "sim_compute_robot_state-npc1": 0.08226010912940615, "sim_compute_robot_state-npc2": 0.08080657323201497, "sim_compute_robot_state-npc3": 0.08132363501049224}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1160380996671193, "sim_physics": 0.206583966811498, "survival_time": 1.2000000000000004, "driven_lanedir": 0.06784867408324935, "sim_render-ego": 0.06923463940620422, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.17621033390363058, "deviation-heading": 0.5208631157743573, "set_robot_commands": 0.09943584601084392, "deviation-center-line": 0.08086811867461316, "driven_lanedir_consec": 0.06784867408324935, "sim_compute_sim_state": 0.03953632712364197, "sim_compute_performance-ego": 0.07714982827504475, "sim_compute_robot_state-ego": 0.07374896605809529, "sim_compute_robot_state-npc0": 0.07394877076148987, "sim_compute_robot_state-npc1": 0.07324243585268657, "sim_compute_robot_state-npc2": 0.07105984290440877, "sim_compute_robot_state-npc3": 0.06968148549397786}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.12542848288208402, "sim_physics": 0.1947121109281267, "survival_time": 1.4000000000000006, "driven_lanedir": 0.02699196025978712, "sim_render-ego": 0.0721098440034049, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.1840082917894636, "deviation-heading": 0.6041246682862939, "set_robot_commands": 0.10181240524564472, "deviation-center-line": 0.015973128257746334, "driven_lanedir_consec": 0.02699196025978712, "sim_compute_sim_state": 0.04330669130597796, "sim_compute_performance-ego": 0.08021514756338936, "sim_compute_robot_state-ego": 0.08230716841561454, "sim_compute_robot_state-npc0": 0.07906524624143328, "sim_compute_robot_state-npc1": 0.07780339888163976, "sim_compute_robot_state-npc2": 0.0725421564919608, "sim_compute_robot_state-npc3": 0.0783510719026838}}
set_robot_commands_max0.10608847935994466
set_robot_commands_mean0.1031780995641436
set_robot_commands_median0.1033493399620056
set_robot_commands_min0.09943584601084392
sim_compute_performance-ego_max0.08462674277169364
sim_compute_performance-ego_mean0.07890505664776533
sim_compute_performance-ego_median0.07729591773106502
sim_compute_performance-ego_min0.07523764689763388
sim_compute_robot_state-ego_max0.1022579102289109
sim_compute_robot_state-ego_mean0.0842851881334633
sim_compute_robot_state-ego_median0.08230716841561454
sim_compute_robot_state-ego_min0.07374896605809529
sim_compute_robot_state-npc0_max0.08176141693478539
sim_compute_robot_state-npc0_mean0.07746455550193787
sim_compute_robot_state-npc0_median0.07704217433929443
sim_compute_robot_state-npc0_min0.07394877076148987
sim_compute_robot_state-npc1_max0.08226010912940615
sim_compute_robot_state-npc1_mean0.07653139032374372
sim_compute_robot_state-npc1_median0.0758605406834529
sim_compute_robot_state-npc1_min0.07324243585268657
sim_compute_robot_state-npc2_max0.08080657323201497
sim_compute_robot_state-npc2_mean0.07477808029049045
sim_compute_robot_state-npc2_median0.07435404380162557
sim_compute_robot_state-npc2_min0.07105984290440877
sim_compute_robot_state-npc3_max0.08132363501049224
sim_compute_robot_state-npc3_mean0.07601376140335978
sim_compute_robot_state-npc3_median0.07642465646450336
sim_compute_robot_state-npc3_min0.06968148549397786
sim_compute_sim_state_max0.04888554981776646
sim_compute_sim_state_mean0.043639385318581435
sim_compute_sim_state_median0.04330669130597796
sim_compute_sim_state_min0.03953632712364197
sim_physics_max0.2548132964542934
sim_physics_mean0.20627116261035097
sim_physics_median0.1947121109281267
sim_physics_min0.18612462190481333
sim_render-ego_max0.0721098440034049
sim_render-ego_mean0.06919530672293443
sim_render-ego_median0.06899980136326381
sim_render-ego_min0.0677170047393212
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.320000000000026
survival_time_min1.0500000000000005
No reset possible
229282509Rami Al-Naim 🇷🇺challenge-aido_LF-template-rosaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:01:27
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
229072536Liam Paull 🇨🇦baseline-IL-sim-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:04:16
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228782590Julian Zillybaseline-IL-logs-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:29:32
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228742596Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:00:49
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228732597Liam Paull 🇨🇦challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:00:52
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228502644Egor Zamotaevchallenge-aido_LF-template-ros - Template solution using ROSaido2-LFV-sim-testingstep1-simulationsuccessyesip-172-31-25-98-20620:27:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.30314311735235044
survival_time_median2.6499999999999986
deviation-center-line_median0.1192462800776758
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.07913545199802943
agent_compute-ego_mean0.07449237095353241
agent_compute-ego_median0.07496196031570435
agent_compute-ego_min0.06973845572084994
deviation-center-line_max0.2294363663374862
deviation-center-line_mean0.12653708755488874
deviation-center-line_min0.06426934298501713
deviation-heading_max0.6986268167330368
deviation-heading_mean0.44799520296706863
deviation-heading_median0.41847631252347706
deviation-heading_min0.2596285487829774
driven_any_max1.599733354117788
driven_any_mean0.8095342605803044
driven_any_median0.7336463183586153
driven_any_min0.26903550091980144
driven_lanedir_consec_max1.021002447119848
driven_lanedir_consec_mean0.448904809024379
driven_lanedir_consec_min0.2407721645627201
driven_lanedir_max1.021002447119848
driven_lanedir_mean0.448904809024379
driven_lanedir_median0.30314311735235044
driven_lanedir_min0.2407721645627201
in-drivable-lane_max4.799999999999986
in-drivable-lane_mean1.1466666666666634
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.18471095931362097, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0681402884738546, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07674082903794839, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.10487196479045167, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04142232679984939, "sim_compute_performance-ego": 0.07401034865580813, "sim_compute_robot_state-ego": 0.07916034107476892, "sim_compute_robot_state-npc0": 0.07417391387509628, "sim_compute_robot_state-npc1": 0.0740076891133483, "sim_compute_robot_state-npc2": 0.07304646935261472, "sim_compute_robot_state-npc3": 0.07369482013541208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.3642886245953926, "sim_physics": 0.21684011071920395, "survival_time": 1.6000000000000008, "driven_lanedir": 0.3026144243018116, "sim_render-ego": 0.06651924550533295, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07500080019235611, "deviation-heading": 0.6986268167330368, "set_robot_commands": 0.1003878191113472, "deviation-center-line": 0.10463456752710916, "driven_lanedir_consec": 0.3026144243018116, "sim_compute_sim_state": 0.04406455159187317, "sim_compute_performance-ego": 0.07486630976200104, "sim_compute_robot_state-ego": 0.08481421321630478, "sim_compute_robot_state-npc0": 0.07373550534248352, "sim_compute_robot_state-npc1": 0.07279504090547562, "sim_compute_robot_state-npc2": 0.07589297741651535, "sim_compute_robot_state-npc3": 0.07735739648342133}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.7336463183586153, "sim_physics": 0.2091369995704064, "survival_time": 2.5999999999999988, "driven_lanedir": 0.727268775640014, "sim_render-ego": 0.0667339563369751, "in-drivable-lane": 0, "agent_compute-ego": 0.07496196031570435, "deviation-heading": 0.2723076711805525, "set_robot_commands": 0.1038284393457266, "deviation-center-line": 0.2294363663374862, "driven_lanedir_consec": 0.727268775640014, "sim_compute_sim_state": 0.04033804398316603, "sim_compute_performance-ego": 0.07680705418953529, "sim_compute_robot_state-ego": 0.0942600598702064, "sim_compute_robot_state-npc0": 0.07307683504544772, "sim_compute_robot_state-npc1": 0.0745918475664579, "sim_compute_robot_state-npc2": 0.07353613926814152, "sim_compute_robot_state-npc3": 0.07172696865521945}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2972979671834337, "sim_physics": 0.21459559727740543, "survival_time": 4.6499999999999915, "driven_lanedir": 0.97716132702229, "sim_render-ego": 0.06811651619531775, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0763096809387207, "deviation-heading": 0.4911127339226078, "set_robot_commands": 0.10620016436423024, "deviation-center-line": 0.18038572117738352, "driven_lanedir_consec": 0.97716132702229, "sim_compute_sim_state": 0.04581197871956774, "sim_compute_performance-ego": 0.07600889154659804, "sim_compute_robot_state-ego": 0.08712012024335963, "sim_compute_robot_state-npc0": 0.07462663291603007, "sim_compute_robot_state-npc1": 0.0729456409331291, "sim_compute_robot_state-npc2": 0.0736506215987667, "sim_compute_robot_state-npc3": 0.07684189529829127}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.26903550091980144, "sim_physics": 0.22047461782182967, "survival_time": 1.0500000000000005, "driven_lanedir": 0.2407721645627201, "sim_render-ego": 0.06980596269880023, "in-drivable-lane": 0, "agent_compute-ego": 0.07913545199802943, "deviation-heading": 0.41847631252347706, "set_robot_commands": 0.110781953448341, "deviation-center-line": 0.06426934298501713, "driven_lanedir_consec": 0.2407721645627201, "sim_compute_sim_state": 0.04277202061244419, "sim_compute_performance-ego": 0.07605912571861631, "sim_compute_robot_state-ego": 0.09032387960524786, "sim_compute_robot_state-npc0": 0.07845115661621094, "sim_compute_robot_state-npc1": 0.07843859990437825, "sim_compute_robot_state-npc2": 0.07839478765215192, "sim_compute_robot_state-npc3": 0.07631297338576544}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.599733354117788, "sim_physics": 0.18660945734701867, "survival_time": 6.0499999999999865, "driven_lanedir": 0.26415979567759074, "sim_render-ego": 0.06313815589778679, "in-drivable-lane": 4.799999999999986, "agent_compute-ego": 0.07163423743129761, "deviation-heading": 0.39392468133084674, "set_robot_commands": 0.09518232227356964, "deviation-center-line": 0.1277842828221673, "driven_lanedir_consec": 0.26415979567759074, "sim_compute_sim_state": 0.039934398714175895, "sim_compute_performance-ego": 0.06922459996436253, "sim_compute_robot_state-ego": 0.07652435617998612, "sim_compute_robot_state-npc0": 0.07374517779704953, "sim_compute_robot_state-npc1": 0.06864189116422795, "sim_compute_robot_state-npc2": 0.06964894562713371, "sim_compute_robot_state-npc3": 0.07039062444828759}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0951392646085512, "sim_physics": 0.18385265838532225, "survival_time": 4.199999999999993, "driven_lanedir": 0.5659790827231905, "sim_render-ego": 0.06321603059768677, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.0700681209564209, "deviation-heading": 0.5971215168818823, "set_robot_commands": 0.10028538533619472, "deviation-center-line": 0.11288019725884578, "driven_lanedir_consec": 0.5659790827231905, "sim_compute_sim_state": 0.041574018342154365, "sim_compute_performance-ego": 0.07196937572388422, "sim_compute_robot_state-ego": 0.07807062637238275, "sim_compute_robot_state-npc0": 0.07139181806927636, "sim_compute_robot_state-npc1": 0.07443924177260626, "sim_compute_robot_state-npc2": 0.0732546675772894, "sim_compute_robot_state-npc3": 0.07280591556004115}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.0452441176451972, "sim_physics": 0.2022600625012372, "survival_time": 3.699999999999995, "driven_lanedir": 1.021002447119848, "sim_render-ego": 0.06366954623041926, "in-drivable-lane": 0, "agent_compute-ego": 0.06973845572084994, "deviation-heading": 0.6206310196168163, "set_robot_commands": 0.09734498487936484, "deviation-center-line": 0.14363020423695483, "driven_lanedir_consec": 1.021002447119848, "sim_compute_sim_state": 0.04205184691661113, "sim_compute_performance-ego": 0.0730354270419559, "sim_compute_robot_state-ego": 0.07726746314280741, "sim_compute_robot_state-npc0": 0.07229541121302424, "sim_compute_robot_state-npc1": 0.07130748838991732, "sim_compute_robot_state-npc2": 0.07191603892558329, "sim_compute_robot_state-npc3": 0.07142829250644993}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.0535850482576197, "sim_physics": 0.1801835364765591, "survival_time": 3.599999999999995, "driven_lanedir": 0.30314311735235044, "sim_render-ego": 0.06625636418660481, "in-drivable-lane": 2.2999999999999945, "agent_compute-ego": 0.07277243336041768, "deviation-heading": 0.40636604380954594, "set_robot_commands": 0.1004791027969784, "deviation-center-line": 0.10907487511555897, "driven_lanedir_consec": 0.30314311735235044, "sim_compute_sim_state": 0.04042817155520121, "sim_compute_performance-ego": 0.0732245213455624, "sim_compute_robot_state-ego": 0.0778932770093282, "sim_compute_robot_state-npc0": 0.07505567868550618, "sim_compute_robot_state-npc1": 0.07363707489437527, "sim_compute_robot_state-npc2": 0.07354340288374159, "sim_compute_robot_state-npc3": 0.07406127452850342}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4799799001882503, "sim_physics": 0.22600426406503837, "survival_time": 5.349999999999989, "driven_lanedir": 0.5481518397312493, "sim_render-ego": 0.06761682590591574, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.07438876472900961, "deviation-heading": 0.5514444521435958, "set_robot_commands": 0.10169498719901682, "deviation-center-line": 0.10072735470855042, "driven_lanedir_consec": 0.5481518397312493, "sim_compute_sim_state": 0.041966685624880214, "sim_compute_performance-ego": 0.07252001539569035, "sim_compute_robot_state-ego": 0.08037916967801959, "sim_compute_robot_state-npc0": 0.07218689562004303, "sim_compute_robot_state-npc1": 0.07675089568735283, "sim_compute_robot_state-npc2": 0.07254287015611881, "sim_compute_robot_state-npc3": 0.07131145156432535}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.29610946631760215, "sim_physics": 0.23385113256948967, "survival_time": 1.3500000000000003, "driven_lanedir": 0.27060744077321397, "sim_render-ego": 0.07031467225816515, "in-drivable-lane": 0, "agent_compute-ego": 0.07391037764372649, "deviation-heading": 0.5373504765871612, "set_robot_commands": 0.108041869269477, "deviation-center-line": 0.08269292286428997, "driven_lanedir_consec": 0.27060744077321397, "sim_compute_sim_state": 0.0427421905376293, "sim_compute_performance-ego": 0.07570041550530328, "sim_compute_robot_state-ego": 0.09127739623740869, "sim_compute_robot_state-npc0": 0.07642535810117368, "sim_compute_robot_state-npc1": 0.07611306508382161, "sim_compute_robot_state-npc2": 0.07740615915369105, "sim_compute_robot_state-npc3": 0.07607811468618887}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.27791471406425977, "sim_physics": 0.1971131706237793, "survival_time": 1.2500000000000004, "driven_lanedir": 0.2638710416011838, "sim_render-ego": 0.06515002250671387, "in-drivable-lane": 0, "agent_compute-ego": 0.07639513015747071, "deviation-heading": 0.3105689945980953, "set_robot_commands": 0.10110649108886718, "deviation-center-line": 0.1192462800776758, "driven_lanedir_consec": 0.2638710416011838, "sim_compute_sim_state": 0.04204245567321777, "sim_compute_performance-ego": 0.07428007125854492, "sim_compute_robot_state-ego": 0.07887042999267578, "sim_compute_robot_state-npc0": 0.07755794525146484, "sim_compute_robot_state-npc1": 0.07687727928161621, "sim_compute_robot_state-npc2": 0.07934060096740722, "sim_compute_robot_state-npc3": 0.07701337814331055}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7174039891727135, "sim_physics": 0.1835240508025547, "survival_time": 2.6499999999999986, "driven_lanedir": 0.29766819613667395, "sim_render-ego": 0.06478748681410304, "in-drivable-lane": 1.249999999999998, "agent_compute-ego": 0.07591422098987508, "deviation-heading": 0.3122593881578996, "set_robot_commands": 0.10481437647117758, "deviation-center-line": 0.14209620948179827, "driven_lanedir_consec": 0.29766819613667395, "sim_compute_sim_state": 0.042504504041851694, "sim_compute_performance-ego": 0.0747360553381578, "sim_compute_robot_state-ego": 0.08460343558833285, "sim_compute_robot_state-npc0": 0.07672204611436376, "sim_compute_robot_state-npc1": 0.07669226628429485, "sim_compute_robot_state-npc2": 0.07408729139363991, "sim_compute_robot_state-npc3": 0.07464614904151773}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3170173854101942, "sim_physics": 0.2183247612368676, "survival_time": 1.5500000000000007, "driven_lanedir": 0.30712670008511367, "sim_render-ego": 0.06563300471152028, "in-drivable-lane": 0, "agent_compute-ego": 0.07444872394684822, "deviation-heading": 0.2996283459319333, "set_robot_commands": 0.10492134863330473, "deviation-center-line": 0.13363659833059607, "driven_lanedir_consec": 0.30712670008511367, "sim_compute_sim_state": 0.04362577776755056, "sim_compute_performance-ego": 0.0727936452434909, "sim_compute_robot_state-ego": 0.0802373501562303, "sim_compute_robot_state-npc0": 0.07773786206399241, "sim_compute_robot_state-npc1": 0.07484193002024005, "sim_compute_robot_state-npc2": 0.07420422953944053, "sim_compute_robot_state-npc3": 0.07740851371519027}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.6739360049522848, "sim_physics": 0.20378382065716913, "survival_time": 2.549999999999999, "driven_lanedir": 0.27812483555624423, "sim_render-ego": 0.06450654478634105, "in-drivable-lane": 1.2499999999999984, "agent_compute-ego": 0.07596637688431085, "deviation-heading": 0.550481042305602, "set_robot_commands": 0.10269753605711694, "deviation-center-line": 0.07768321004180687, "driven_lanedir_consec": 0.27812483555624423, "sim_compute_sim_state": 0.03965565270068599, "sim_compute_performance-ego": 0.06960250817093194, "sim_compute_robot_state-ego": 0.0733328286339255, "sim_compute_robot_state-npc0": 0.07260991077797085, "sim_compute_robot_state-npc1": 0.07433451390733906, "sim_compute_robot_state-npc2": 0.07219679215375115, "sim_compute_robot_state-npc3": 0.07202864160724715}}
set_robot_commands_max0.110781953448341
set_robot_commands_mean0.10284258300434428
set_robot_commands_median0.10269753605711694
set_robot_commands_min0.09518232227356964
sim_compute_performance-ego_max0.07680705418953529
sim_compute_performance-ego_mean0.0736558909906962
sim_compute_performance-ego_median0.07401034865580813
sim_compute_performance-ego_min0.06922459996436253
sim_compute_robot_state-ego_max0.0942600598702064
sim_compute_robot_state-ego_mean0.082275663133399
sim_compute_robot_state-ego_median0.0802373501562303
sim_compute_robot_state-ego_min0.0733328286339255
sim_compute_robot_state-npc0_max0.07845115661621094
sim_compute_robot_state-npc0_mean0.07465280983260889
sim_compute_robot_state-npc0_median0.07417391387509628
sim_compute_robot_state-npc0_min0.07139181806927636
sim_compute_robot_state-npc1_max0.07843859990437825
sim_compute_robot_state-npc1_mean0.07442763099390538
sim_compute_robot_state-npc1_median0.07443924177260626
sim_compute_robot_state-npc1_min0.06864189116422795
sim_compute_robot_state-npc2_max0.07934060096740722
sim_compute_robot_state-npc2_mean0.07417746624439912
sim_compute_robot_state-npc2_median0.07354340288374159
sim_compute_robot_state-npc2_min0.06964894562713371
sim_compute_robot_state-npc3_max0.07740851371519027
sim_compute_robot_state-npc3_mean0.07420709398394476
sim_compute_robot_state-npc3_median0.07406127452850342
sim_compute_robot_state-npc3_min0.07039062444828759
sim_compute_sim_state_max0.04581197871956774
sim_compute_sim_state_mean0.04206230823872391
sim_compute_sim_state_median0.04204245567321777
sim_compute_sim_state_min0.03965565270068599
sim_physics_max0.23385113256948967
sim_physics_mean0.20408434662450017
sim_physics_median0.20378382065716913
sim_physics_min0.1801835364765591
sim_render-ego_max0.07031467225816515
sim_render-ego_mean0.06624030820703583
sim_render-ego_median0.06625636418660481
sim_render-ego_min0.06313815589778679
simulation-passed1
survival_time_max6.0499999999999865
survival_time_mean3.046666666666663
survival_time_min1.0500000000000005
No reset possible
228182707Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:52:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
228102723jiang pengtest for ppoaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:01:25
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227922755Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:05:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.08273141149064185
agent_compute-ego_mean0.06993540601403041
agent_compute-ego_median0.07315284791200058
agent_compute-ego_min0.041421370072798294
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.14021191462664537, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.0716863753090442, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.08273141149064185, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1146806730350978, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.04296059004018005, "sim_compute_performance-ego": 0.07968432466748734, "sim_compute_robot_state-ego": 0.08409896702833579}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.11658182541529336, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.05966562032699585, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07276730140050253, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.09113891919453938, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.0372972051302592, "sim_compute_performance-ego": 0.0694952646891276, "sim_compute_robot_state-ego": 0.07119535207748413}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.06094437295740301, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.0376222242008556, "in-drivable-lane": 0, "agent_compute-ego": 0.041421370072798294, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.05676254359158603, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.02500285885550759, "sim_compute_performance-ego": 0.04019551927393133, "sim_compute_robot_state-ego": 0.04430969194932417}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.11035073300202689, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.05923855801423391, "in-drivable-lane": 0, "agent_compute-ego": 0.07960409919420879, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09575653076171876, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.03532904883225759, "sim_compute_performance-ego": 0.06756874918937683, "sim_compute_robot_state-ego": 0.07654832303524017}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.13512018970821216, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06212496757507324, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07315284791200058, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.09656776552614958, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.037992549979168434, "sim_compute_performance-ego": 0.06954875717992368, "sim_compute_robot_state-ego": 0.08370755548062532}}
set_robot_commands_max0.1146806730350978
set_robot_commands_mean0.09098128642181832
set_robot_commands_median0.09575653076171876
set_robot_commands_min0.05676254359158603
sim_compute_performance-ego_max0.07968432466748734
sim_compute_performance-ego_mean0.06529852299996937
sim_compute_performance-ego_median0.0694952646891276
sim_compute_performance-ego_min0.04019551927393133
sim_compute_robot_state-ego_max0.08409896702833579
sim_compute_robot_state-ego_mean0.07197197791420192
sim_compute_robot_state-ego_median0.07654832303524017
sim_compute_robot_state-ego_min0.04430969194932417
sim_compute_sim_state_max0.04296059004018005
sim_compute_sim_state_mean0.03571645056747457
sim_compute_sim_state_median0.0372972051302592
sim_compute_sim_state_min0.02500285885550759
sim_physics_max0.14021191462664537
sim_physics_mean0.11264180714191614
sim_physics_median0.11658182541529336
sim_physics_min0.06094437295740301
sim_render-ego_max0.0716863753090442
sim_render-ego_mean0.05806754908524057
sim_render-ego_median0.05966562032699585
sim_render-ego_min0.0376222242008556
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
No reset possible
227822766Bhairav Mehtachallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:06:20
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227712791Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationfailedyesip-172-31-25-98-20620:01:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
227652805Andrea Censi 🇨🇭challenge-aido_LF-template-random - random_agentaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.1735819313261244
agent_compute-ego_mean0.16666982257207394
agent_compute-ego_median0.16563194311117824
agent_compute-ego_min0.16061491012573242
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.14322862801728423, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06927667723761664, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1735819313261244, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10541192249015524, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04473088847266303, "sim_compute_performance-ego": 0.08223026770132559, "sim_compute_robot_state-ego": 0.09008391698201496}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12650610886368097, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06613707542419434, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1628415023579317, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10750993560342229, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04234999768874224, "sim_compute_performance-ego": 0.07363441411186666, "sim_compute_robot_state-ego": 0.08312353433347215}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.14159626119277058, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.07247404491200167, "in-drivable-lane": 0, "agent_compute-ego": 0.17067882593940287, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10843415821299832, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.046339049058801984, "sim_compute_performance-ego": 0.07461918101591222, "sim_compute_robot_state-ego": 0.09069912573870492}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1292263698577881, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.0634012222290039, "in-drivable-lane": 0, "agent_compute-ego": 0.16061491012573242, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.10146130561828612, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.040566415786743165, "sim_compute_performance-ego": 0.07411735534667968, "sim_compute_robot_state-ego": 0.07268118858337402}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12467878076094616, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.0674747334250921, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16563194311117824, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.11635627625863763, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04223547404325461, "sim_compute_performance-ego": 0.07557153701782227, "sim_compute_robot_state-ego": 0.08073630815819849}}
set_robot_commands_max0.11635627625863763
set_robot_commands_mean0.10783471963669992
set_robot_commands_median0.10750993560342229
set_robot_commands_min0.10146130561828612
sim_compute_performance-ego_max0.08223026770132559
sim_compute_performance-ego_mean0.07603455103872128
sim_compute_performance-ego_median0.07461918101591222
sim_compute_performance-ego_min0.07363441411186666
sim_compute_robot_state-ego_max0.09069912573870492
sim_compute_robot_state-ego_mean0.0834648147591529
sim_compute_robot_state-ego_median0.08312353433347215
sim_compute_robot_state-ego_min0.07268118858337402
sim_compute_sim_state_max0.046339049058801984
sim_compute_sim_state_mean0.04324436501004101
sim_compute_sim_state_median0.04234999768874224
sim_compute_sim_state_min0.040566415786743165
sim_physics_max0.14322862801728423
sim_physics_mean0.133047229738494
sim_physics_median0.1292263698577881
sim_physics_min0.12467878076094616
sim_render-ego_max0.07247404491200167
sim_render-ego_mean0.06775275064558173
sim_render-ego_median0.0674747334250921
sim_render-ego_min0.0634012222290039
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
227262876Andrea Daniele 🇮🇹minimal_agent (Python 3)aido2-LF-sim-testingstep1-simulationsuccessyesip-172-31-25-98-20620:39:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6202968959903497
survival_time_median6.8999999999999835
deviation-center-line_median0.2968973039399582
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17951467054353343
agent_compute-ego_mean0.17523637157914354
agent_compute-ego_median0.1754371519569013
agent_compute-ego_min0.1709729512532552
deviation-center-line_max1.2578907011919125
deviation-center-line_mean0.392559795052945
deviation-center-line_min0.20837582250812192
deviation-heading_max1.7338651399303977
deviation-heading_mean0.922434565822337
deviation-heading_median0.801279189692507
deviation-heading_min0.48740885281046914
driven_any_max1.7560498171261352
driven_any_mean0.8746411422725543
driven_any_median0.9886852216355494
driven_any_min0.278862430643389
driven_lanedir_consec_max1.7523714592470048
driven_lanedir_consec_mean0.6813457664348396
driven_lanedir_consec_min0.2720172605900939
driven_lanedir_max1.7523714592470048
driven_lanedir_mean0.6813457664348396
driven_lanedir_median0.6202968959903497
driven_lanedir_min0.2720172605900939
in-drivable-lane_max6.400000000000029
in-drivable-lane_mean1.1100000000000017
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9900915586687412, "sim_physics": 0.13650447173084287, "survival_time": 6.949999999999983, "driven_lanedir": 0.6591401084474304, "sim_render-ego": 0.07181741007798009, "in-drivable-lane": 1.999999999999993, "agent_compute-ego": 0.1754371519569013, "deviation-heading": 0.801279189692507, "set_robot_commands": 0.11236827665095708, "deviation-center-line": 0.33899838427143014, "driven_lanedir_consec": 0.6591401084474304, "sim_compute_sim_state": 0.04360895191165183, "sim_compute_performance-ego": 0.08044795338198435, "sim_compute_robot_state-ego": 0.08770399127932761}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0058141307648691, "sim_physics": 0.13196887459073747, "survival_time": 6.999999999999983, "driven_lanedir": 0.8945129127998346, "sim_render-ego": 0.07161608593804496, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.17664319106510706, "deviation-heading": 1.7338651399303977, "set_robot_commands": 0.11364908899579727, "deviation-center-line": 0.49658151961950325, "driven_lanedir_consec": 0.8945129127998346, "sim_compute_sim_state": 0.043769797257014686, "sim_compute_performance-ego": 0.08209801401410784, "sim_compute_robot_state-ego": 0.08811301674161638}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.278862430643389, "sim_physics": 0.1463927745819092, "survival_time": 2.25, "driven_lanedir": 0.2720172605900939, "sim_render-ego": 0.07111065652635362, "in-drivable-lane": 0, "agent_compute-ego": 0.1709729512532552, "deviation-heading": 0.5056416838713088, "set_robot_commands": 0.1112990591261122, "deviation-center-line": 0.23430699853227116, "driven_lanedir_consec": 0.2720172605900939, "sim_compute_sim_state": 0.044500838385687934, "sim_compute_performance-ego": 0.07822379006279839, "sim_compute_robot_state-ego": 0.08496520784166124}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.6407319399837514, "sim_physics": 0.1440693710161292, "survival_time": 4.599999999999992, "driven_lanedir": 0.6257610897668884, "sim_render-ego": 0.0726075846215953, "in-drivable-lane": 0, "agent_compute-ego": 0.17623048761616583, "deviation-heading": 0.9772760265854514, "set_robot_commands": 0.113432923088903, "deviation-center-line": 0.36802347786147127, "driven_lanedir_consec": 0.6257610897668884, "sim_compute_sim_state": 0.04447536623996237, "sim_compute_performance-ego": 0.08176000221915868, "sim_compute_robot_state-ego": 0.09470012136127638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5927758413436612, "sim_physics": 0.1300266344253331, "survival_time": 10.95000000000002, "driven_lanedir": 0.6151282935769209, "sim_render-ego": 0.07000101538009296, "in-drivable-lane": 6.400000000000029, "agent_compute-ego": 0.1726576149735821, "deviation-heading": 0.638184343010141, "set_robot_commands": 0.1118219258034066, "deviation-center-line": 0.4584544318695165, "driven_lanedir_consec": 0.6151282935769209, "sim_compute_sim_state": 0.04312937444747855, "sim_compute_performance-ego": 0.08103551385609527, "sim_compute_robot_state-ego": 0.08970087521696744}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4747777342207285, "sim_physics": 0.1470543418611799, "survival_time": 3.4999999999999956, "driven_lanedir": 0.45069691160064007, "sim_render-ego": 0.07169316155569894, "in-drivable-lane": 0, "agent_compute-ego": 0.17481568881443568, "deviation-heading": 1.1234646030837343, "set_robot_commands": 0.1128300768988473, "deviation-center-line": 0.24614915791869676, "driven_lanedir_consec": 0.45069691160064007, "sim_compute_sim_state": 0.04552114009857178, "sim_compute_performance-ego": 0.07991392612457275, "sim_compute_robot_state-ego": 0.0901557275227138}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.019681949804902, "sim_physics": 0.14934488921098307, "survival_time": 7.099999999999983, "driven_lanedir": 0.5497294169147833, "sim_render-ego": 0.06900491680897458, "in-drivable-lane": 2.9999999999999893, "agent_compute-ego": 0.17200321043041392, "deviation-heading": 1.017147490050159, "set_robot_commands": 0.1103101179633342, "deviation-center-line": 0.2968973039399582, "driven_lanedir_consec": 0.5497294169147833, "sim_compute_sim_state": 0.0434120473727374, "sim_compute_performance-ego": 0.08120952693509384, "sim_compute_robot_state-ego": 0.08820957868871554}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.292561402657028, "sim_physics": 0.1353435568187548, "survival_time": 2.3, "driven_lanedir": 0.28556003912644146, "sim_render-ego": 0.06870046387548032, "in-drivable-lane": 0, "agent_compute-ego": 0.17732009680374808, "deviation-heading": 0.5055513317884642, "set_robot_commands": 0.11016585515893024, "deviation-center-line": 0.2291230953178777, "driven_lanedir_consec": 0.28556003912644146, "sim_compute_sim_state": 0.046542058820309845, "sim_compute_performance-ego": 0.07893885736880095, "sim_compute_robot_state-ego": 0.0893018038376518}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6284115088436346, "sim_physics": 0.1343188789155748, "survival_time": 4.499999999999992, "driven_lanedir": 0.6202968959903497, "sim_render-ego": 0.07169016732109917, "in-drivable-lane": 0, "agent_compute-ego": 0.1739970154232449, "deviation-heading": 0.6992938214416804, "set_robot_commands": 0.1117610428068373, "deviation-center-line": 0.292496185158671, "driven_lanedir_consec": 0.6202968959903497, "sim_compute_sim_state": 0.04405180878109402, "sim_compute_performance-ego": 0.07946018642849392, "sim_compute_robot_state-ego": 0.08971006605360243}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9886852216355494, "sim_physics": 0.14295135891955832, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6459976804857221, "sim_render-ego": 0.07109204755313155, "in-drivable-lane": 1.7499999999999938, "agent_compute-ego": 0.1782268752222476, "deviation-heading": 1.4412214371425691, "set_robot_commands": 0.11043745538462764, "deviation-center-line": 0.3337191779486854, "driven_lanedir_consec": 0.6459976804857221, "sim_compute_sim_state": 0.04329431229743405, "sim_compute_performance-ego": 0.0818491310313128, "sim_compute_robot_state-ego": 0.09003292132115019}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5766678237160747, "sim_physics": 0.1411201275816751, "survival_time": 10.90000000000002, "driven_lanedir": 1.2238020245203944, "sim_render-ego": 0.07174633292976869, "in-drivable-lane": 1.8000000000000256, "agent_compute-ego": 0.17749898805530792, "deviation-heading": 1.6250699730411842, "set_robot_commands": 0.11294995207305349, "deviation-center-line": 0.5732131458770182, "driven_lanedir_consec": 1.2238020245203944, "sim_compute_sim_state": 0.044044763670055144, "sim_compute_performance-ego": 0.08184697868627146, "sim_compute_robot_state-ego": 0.0873519477494266}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4896825830686729, "sim_physics": 0.14152860310342577, "survival_time": 3.599999999999995, "driven_lanedir": 0.4827572868140654, "sim_render-ego": 0.0729701386557685, "in-drivable-lane": 0, "agent_compute-ego": 0.17677511109246147, "deviation-heading": 0.5911477230687963, "set_robot_commands": 0.1138222184446123, "deviation-center-line": 0.29144378866191073, "driven_lanedir_consec": 0.4827572868140654, "sim_compute_sim_state": 0.0460200740231408, "sim_compute_performance-ego": 0.07947545581393772, "sim_compute_robot_state-ego": 0.0861211551560296}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9934601655841236, "sim_physics": 0.15669773980010326, "survival_time": 6.949999999999983, "driven_lanedir": 0.7638704215325345, "sim_render-ego": 0.07260146587015055, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.17951467054353343, "deviation-heading": 0.9502563901618318, "set_robot_commands": 0.11307434726962085, "deviation-center-line": 0.26272373511713126, "driven_lanedir_consec": 0.7638704215325345, "sim_compute_sim_state": 0.044994560077036026, "sim_compute_performance-ego": 0.08310384201488906, "sim_compute_robot_state-ego": 0.09469847884967172}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.3913630260270548, "sim_physics": 0.1325865882938191, "survival_time": 2.9499999999999975, "driven_lanedir": 0.378544695109488, "sim_render-ego": 0.07944631980637372, "in-drivable-lane": 0, "agent_compute-ego": 0.1744601888171697, "deviation-heading": 0.7397104816563612, "set_robot_commands": 0.11294071957216424, "deviation-center-line": 0.20837582250812192, "driven_lanedir_consec": 0.378544695109488, "sim_compute_sim_state": 0.0448162798154152, "sim_compute_performance-ego": 0.07812969563371044, "sim_compute_robot_state-ego": 0.08322379548670882}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.7560498171261352, "sim_physics": 0.13521481351733702, "survival_time": 12.050000000000036, "driven_lanedir": 1.7523714592470048, "sim_render-ego": 0.07172126987663048, "in-drivable-lane": 0, "agent_compute-ego": 0.17199233161957928, "deviation-heading": 0.48740885281046914, "set_robot_commands": 0.1085341590074088, "deviation-center-line": 1.2578907011919125, "driven_lanedir_consec": 1.7523714592470048, "sim_compute_sim_state": 0.044225985578481584, "sim_compute_performance-ego": 0.07882340320413043, "sim_compute_robot_state-ego": 0.08771322970568392}}
set_robot_commands_max0.1138222184446123
set_robot_commands_mean0.11195981454964082
set_robot_commands_median0.11236827665095708
set_robot_commands_min0.1085341590074088
sim_compute_performance-ego_max0.08310384201488906
sim_compute_performance-ego_mean0.08042108511835719
sim_compute_performance-ego_median0.08044795338198435
sim_compute_performance-ego_min0.07812969563371044
sim_compute_robot_state-ego_max0.09470012136127638
sim_compute_robot_state-ego_mean0.08878012778748022
sim_compute_robot_state-ego_median0.08820957868871554
sim_compute_robot_state-ego_min0.08322379548670882
sim_compute_sim_state_max0.046542058820309845
sim_compute_sim_state_mean0.04442715725173809
sim_compute_sim_state_median0.044225985578481584
sim_compute_sim_state_min0.04312937444747855
sim_physics_max0.15669773980010326
sim_physics_mean0.1403415349578242
sim_physics_median0.1411201275816751
sim_physics_min0.1300266344253331
sim_render-ego_max0.07944631980637372
sim_render-ego_mean0.07185460245314292
sim_render-ego_median0.07169316155569894
sim_render-ego_min0.06870046387548032
simulation-passed1
survival_time_max12.050000000000036
survival_time_mean6.166666666666666
survival_time_min2.25
No reset possible
226832981Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:50:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226782985Artem Ioselevskiichallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:03:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226712999Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:41
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226553019Manfred Diazchallenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:01:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
226423046Manfred Diazchallenge-aido_LF-template-tensorflowaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:03:15
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225863132FANG MEIYI 🇸🇬testaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20621:00:41
Waited 3602 seconds [...]
Waited 3602 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225263208FANG MEIYI 🇸🇬testaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:59:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
225173225Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:08:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224983239Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:26:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8264440718167942
survival_time_median14.950000000000076
deviation-center-line_median1.2288752622084234
in-drivable-lane_median1.6500000000000234


other stats
agent_compute-ego_max0.1146519338929808
agent_compute-ego_mean0.10648408791444346
agent_compute-ego_median0.11037563721338908
agent_compute-ego_min0.09552896579106648
deviation-center-line_max1.288150935981922
deviation-center-line_mean1.1162549995297495
deviation-center-line_min0.6657239104862016
deviation-heading_max4.000826258659147
deviation-heading_mean2.8076446090415788
deviation-heading_median2.671692397172978
deviation-heading_min1.3478556925619825
driven_any_max3.574753865803741
driven_any_mean3.1908399992921734
driven_any_median3.563004235646124
driven_any_min1.80158596022716
driven_lanedir_consec_max3.039904408460916
driven_lanedir_consec_mean2.661846441322075
driven_lanedir_consec_min1.7642591819286302
driven_lanedir_max3.039904408460916
driven_lanedir_mean2.661846441322075
driven_lanedir_median2.8264440718167942
driven_lanedir_min1.7642591819286302
in-drivable-lane_max2.5500000000000007
in-drivable-lane_mean1.5900000000000136
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.563004235646124, "sim_physics": 0.1390376051266988, "survival_time": 14.950000000000076, "driven_lanedir": 2.789875564605869, "sim_render-ego": 0.07129025538762411, "in-drivable-lane": 2.4000000000000252, "agent_compute-ego": 0.11037563721338908, "deviation-heading": 3.4850900040333626, "set_robot_commands": 0.11236751476923625, "deviation-center-line": 1.1265497238004534, "driven_lanedir_consec": 2.789875564605869, "sim_compute_sim_state": 0.04525588989257812, "sim_compute_performance-ego": 0.08019597768783569, "sim_compute_robot_state-ego": 0.08493896802266439}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.80158596022716, "sim_physics": 0.14237159877628475, "survival_time": 7.699999999999981, "driven_lanedir": 1.7642591819286302, "sim_render-ego": 0.0713306897646421, "in-drivable-lane": 0, "agent_compute-ego": 0.1146519338929808, "deviation-heading": 1.3478556925619825, "set_robot_commands": 0.1132411306554621, "deviation-center-line": 0.6657239104862016, "driven_lanedir_consec": 1.7642591819286302, "sim_compute_sim_state": 0.04516302455555309, "sim_compute_performance-ego": 0.08074614444336334, "sim_compute_robot_state-ego": 0.08709442615509033}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.574753865803741, "sim_physics": 0.1383249314626058, "survival_time": 14.950000000000076, "driven_lanedir": 2.8264440718167942, "sim_render-ego": 0.06977668046951294, "in-drivable-lane": 2.5500000000000007, "agent_compute-ego": 0.11103918234507244, "deviation-heading": 2.532758692780422, "set_robot_commands": 0.11392177502314248, "deviation-center-line": 1.2288752622084234, "driven_lanedir_consec": 2.8264440718167942, "sim_compute_sim_state": 0.04437554200490316, "sim_compute_performance-ego": 0.07906827449798584, "sim_compute_robot_state-ego": 0.0901842745145162}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.440172037383701, "sim_physics": 0.10537252161237928, "survival_time": 14.40000000000007, "driven_lanedir": 2.8887489797981636, "sim_render-ego": 0.05589656035105387, "in-drivable-lane": 1.3500000000000192, "agent_compute-ego": 0.10082472032970852, "deviation-heading": 4.000826258659147, "set_robot_commands": 0.08765975385904312, "deviation-center-line": 1.288150935981922, "driven_lanedir_consec": 2.8887489797981636, "sim_compute_sim_state": 0.035090934899118215, "sim_compute_performance-ego": 0.06893914772404565, "sim_compute_robot_state-ego": 0.06700826270712747}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.5746838974001407, "sim_physics": 0.11826401154200236, "survival_time": 14.950000000000076, "driven_lanedir": 3.039904408460916, "sim_render-ego": 0.06132353146870931, "in-drivable-lane": 1.6500000000000234, "agent_compute-ego": 0.09552896579106648, "deviation-heading": 2.671692397172978, "set_robot_commands": 0.09325436353683472, "deviation-center-line": 1.271975165171748, "driven_lanedir_consec": 3.039904408460916, "sim_compute_sim_state": 0.039101996421813966, "sim_compute_performance-ego": 0.0690955932935079, "sim_compute_robot_state-ego": 0.0741535758972168}}
set_robot_commands_max0.11392177502314248
set_robot_commands_mean0.10408890756874374
set_robot_commands_median0.11236751476923625
set_robot_commands_min0.08765975385904312
sim_compute_performance-ego_max0.08074614444336334
sim_compute_performance-ego_mean0.07560902752934769
sim_compute_performance-ego_median0.07906827449798584
sim_compute_performance-ego_min0.06893914772404565
sim_compute_robot_state-ego_max0.0901842745145162
sim_compute_robot_state-ego_mean0.08067590145932305
sim_compute_robot_state-ego_median0.08493896802266439
sim_compute_robot_state-ego_min0.06700826270712747
sim_compute_sim_state_max0.04525588989257812
sim_compute_sim_state_mean0.04179747755479331
sim_compute_sim_state_median0.04437554200490316
sim_compute_sim_state_min0.035090934899118215
sim_physics_max0.14237159877628475
sim_physics_mean0.12867413370399422
sim_physics_median0.1383249314626058
sim_physics_min0.10537252161237928
sim_render-ego_max0.0713306897646421
sim_render-ego_mean0.06592354348830846
sim_render-ego_median0.06977668046951294
sim_render-ego_min0.05589656035105387
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.390000000000056
survival_time_min7.699999999999981
No reset possible
224913249Shen Yu Chia 🇹🇼challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.16817073261036591
agent_compute-ego_mean0.14812514682865613
agent_compute-ego_median0.14383978937186448
agent_compute-ego_min0.12967443466186523
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.10669519283153392, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.05681080729873092, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.14208395392806442, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.0864405455412688, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.03660220128518564, "sim_compute_performance-ego": 0.06497223730440493, "sim_compute_robot_state-ego": 0.069623037620827}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1087808094772638, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.057228897132125554, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14383978937186448, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.0845492306877585, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.03449464779274136, "sim_compute_performance-ego": 0.06262464149325501, "sim_compute_robot_state-ego": 0.06587063564973719}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13477378733017864, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06730151176452637, "in-drivable-lane": 0, "agent_compute-ego": 0.16817073261036591, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10440370615790873, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.041499600690953875, "sim_compute_performance-ego": 0.07438265576082118, "sim_compute_robot_state-ego": 0.08844904338612276}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.10266087532043457, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.05063194274902344, "in-drivable-lane": 0, "agent_compute-ego": 0.12967443466186523, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09195549964904784, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03495442390441895, "sim_compute_performance-ego": 0.0540020751953125, "sim_compute_robot_state-ego": 0.0594426155090332}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.11692748794072792, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06773630576797679, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15685682357112063, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.09988418711891656, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04114224639119981, "sim_compute_performance-ego": 0.07147882256326796, "sim_compute_robot_state-ego": 0.07337117195129395}}
set_robot_commands_max0.10440370615790873
set_robot_commands_mean0.09344663383098008
set_robot_commands_median0.09195549964904784
set_robot_commands_min0.0845492306877585
sim_compute_performance-ego_max0.07438265576082118
sim_compute_performance-ego_mean0.06549208646341231
sim_compute_performance-ego_median0.06497223730440493
sim_compute_performance-ego_min0.0540020751953125
sim_compute_robot_state-ego_max0.08844904338612276
sim_compute_robot_state-ego_mean0.07135130082340282
sim_compute_robot_state-ego_median0.069623037620827
sim_compute_robot_state-ego_min0.0594426155090332
sim_compute_sim_state_max0.041499600690953875
sim_compute_sim_state_mean0.03773862401289993
sim_compute_sim_state_median0.03660220128518564
sim_compute_sim_state_min0.03449464779274136
sim_physics_max0.13477378733017864
sim_physics_mean0.11396763058002776
sim_physics_median0.1087808094772638
sim_physics_min0.10266087532043457
sim_render-ego_max0.06773630576797679
sim_render-ego_mean0.059941892942476614
sim_render-ego_median0.057228897132125554
sim_render-ego_min0.05063194274902344
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
224903252Sean LuBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224803537Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:14:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.489457179823658
survival_time_median2.3
deviation-center-line_median0.12939676917776077
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19695577128180144
agent_compute-ego_mean0.186517702829951
agent_compute-ego_median0.18495014429092407
agent_compute-ego_min0.1824880371923032
deviation-center-line_max1.0352776076923969
deviation-center-line_mean0.4362931823235016
deviation-center-line_min0.07964509902467751
deviation-heading_max7.074474021264511
deviation-heading_mean2.5320727977503346
deviation-heading_median0.35410647893328134
deviation-heading_min0.23033609015594397
driven_any_max3.842097812790047
driven_any_mean1.3625335635981597
driven_any_median0.5774640096291888
driven_any_min0.45852865788211056
driven_lanedir_consec_max2.677812477472571
driven_lanedir_consec_mean0.9112526468110278
driven_lanedir_consec_min0.38646615371485155
driven_lanedir_max3.6692887229488527
driven_lanedir_mean1.233459320543054
driven_lanedir_median0.5655375084659671
driven_lanedir_min0.4369899145780911
in-drivable-lane_max5.70000000000003
in-drivable-lane_mean1.4400000000000053
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.842097812790047, "sim_physics": 0.126175217628479, "survival_time": 14.950000000000076, "driven_lanedir": 3.6692887229488527, "sim_render-ego": 0.06711105505625407, "in-drivable-lane": 1.4999999999999964, "agent_compute-ego": 0.18539010127385455, "deviation-heading": 4.695810766241539, "set_robot_commands": 0.10232186873753864, "deviation-center-line": 1.0352776076923969, "driven_lanedir_consec": 2.677812477472571, "sim_compute_sim_state": 0.041415009498596195, "sim_compute_performance-ego": 0.07434641361236573, "sim_compute_robot_state-ego": 0.07986259857813517}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.4414718633767738, "sim_physics": 0.12870263894399006, "survival_time": 14.950000000000076, "driven_lanedir": 1.0060232768987012, "sim_render-ego": 0.0673921251296997, "in-drivable-lane": 5.70000000000003, "agent_compute-ego": 0.18495014429092407, "deviation-heading": 7.074474021264511, "set_robot_commands": 0.10953608910242715, "deviation-center-line": 0.8224859320262398, "driven_lanedir_consec": 0.38646615371485155, "sim_compute_sim_state": 0.042344146569569904, "sim_compute_performance-ego": 0.07567621310551961, "sim_compute_robot_state-ego": 0.07975295384724936}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4931054743126759, "sim_physics": 0.14469456672668457, "survival_time": 1.4500000000000006, "driven_lanedir": 0.489457179823658, "sim_render-ego": 0.0691146603946028, "in-drivable-lane": 0, "agent_compute-ego": 0.19695577128180144, "deviation-heading": 0.23033609015594397, "set_robot_commands": 0.10333191937413708, "deviation-center-line": 0.12939676917776077, "driven_lanedir_consec": 0.489457179823658, "sim_compute_sim_state": 0.042785554096616545, "sim_compute_performance-ego": 0.07723449838572535, "sim_compute_robot_state-ego": 0.08124847247682769}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45852865788211056, "sim_physics": 0.13411631791487985, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4369899145780911, "sim_render-ego": 0.06874020203300145, "in-drivable-lane": 0, "agent_compute-ego": 0.18280446011087167, "deviation-heading": 0.35410647893328134, "set_robot_commands": 0.10610396965690282, "deviation-center-line": 0.07964509902467751, "driven_lanedir_consec": 0.4369899145780911, "sim_compute_sim_state": 0.044038212817648185, "sim_compute_performance-ego": 0.07413501324860947, "sim_compute_robot_state-ego": 0.07778803161952806}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5774640096291888, "sim_physics": 0.13896966498831043, "survival_time": 2.3, "driven_lanedir": 0.5655375084659671, "sim_render-ego": 0.06630325317382812, "in-drivable-lane": 0, "agent_compute-ego": 0.1824880371923032, "deviation-heading": 0.30563663215639647, "set_robot_commands": 0.10627623226331628, "deviation-center-line": 0.11466050369643324, "driven_lanedir_consec": 0.5655375084659671, "sim_compute_sim_state": 0.04241100083226743, "sim_compute_performance-ego": 0.07461693494216255, "sim_compute_robot_state-ego": 0.07795286178588867}}
set_robot_commands_max0.10953608910242715
set_robot_commands_mean0.1055140158268644
set_robot_commands_median0.10610396965690282
set_robot_commands_min0.10232186873753864
sim_compute_performance-ego_max0.07723449838572535
sim_compute_performance-ego_mean0.07520181465887654
sim_compute_performance-ego_median0.07461693494216255
sim_compute_performance-ego_min0.07413501324860947
sim_compute_robot_state-ego_max0.08124847247682769
sim_compute_robot_state-ego_mean0.07932098366152579
sim_compute_robot_state-ego_median0.07975295384724936
sim_compute_robot_state-ego_min0.07778803161952806
sim_compute_sim_state_max0.044038212817648185
sim_compute_sim_state_mean0.04259878476293965
sim_compute_sim_state_median0.04241100083226743
sim_compute_sim_state_min0.041415009498596195
sim_physics_max0.14469456672668457
sim_physics_mean0.1345316812404688
sim_physics_median0.13411631791487985
sim_physics_min0.126175217628479
sim_render-ego_max0.0691146603946028
sim_render-ego_mean0.06773225915747724
sim_render-ego_median0.0673921251296997
sim_render-ego_min0.06630325317382812
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.960000000000031
survival_time_min1.1500000000000004
No reset possible
224723275jiang pengRL - TH -hhkaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:07:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224593290Artem IoselevskiiSSegmaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:12:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7082710735778925
survival_time_median5.14999999999999
deviation-center-line_median0.3823015717068829
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1240258054825866
agent_compute-ego_mean0.10794518795247648
agent_compute-ego_median0.10788558449661524
agent_compute-ego_min0.09661726293892696
deviation-center-line_max0.879491353625135
deviation-center-line_mean0.43061003464649106
deviation-center-line_min0.1460774593203363
deviation-heading_max1.2011050161986383
deviation-heading_mean0.6300983821217437
deviation-heading_median0.6155988247515144
deviation-heading_min0.33260207171657985
driven_any_max2.7065408549292225
driven_any_mean1.2171854810295453
driven_any_median1.166278577421998
driven_any_min0.2730361651203064
driven_lanedir_consec_max1.559685572593514
driven_lanedir_consec_mean0.8848545212960737
driven_lanedir_consec_min0.26612128597713225
driven_lanedir_max1.559685572593514
driven_lanedir_mean0.8848545212960737
driven_lanedir_median0.7082710735778925
driven_lanedir_min0.26612128597713225
in-drivable-lane_max4.650000000000023
in-drivable-lane_mean1.3000000000000032
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.166278577421998, "sim_physics": 0.15923890095312618, "survival_time": 5.14999999999999, "driven_lanedir": 0.7082710735778925, "sim_render-ego": 0.07740504301867439, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.1240258054825866, "deviation-heading": 0.34812114948997325, "set_robot_commands": 0.11994296138726392, "deviation-center-line": 0.3823015717068829, "driven_lanedir_consec": 0.7082710735778925, "sim_compute_sim_state": 0.04643447885235536, "sim_compute_performance-ego": 0.08856344917445506, "sim_compute_robot_state-ego": 0.09968233571469204}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.483654879997451, "sim_physics": 0.13851333037018776, "survival_time": 6.399999999999985, "driven_lanedir": 1.4534870323393196, "sim_render-ego": 0.07284004054963589, "in-drivable-lane": 0, "agent_compute-ego": 0.11405298113822936, "deviation-heading": 1.2011050161986383, "set_robot_commands": 0.12294147163629532, "deviation-center-line": 0.5936076482966521, "driven_lanedir_consec": 1.4534870323393196, "sim_compute_sim_state": 0.044895244762301445, "sim_compute_performance-ego": 0.08212784677743912, "sim_compute_robot_state-ego": 0.09801490977406502}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2730361651203064, "sim_physics": 0.12392580920252308, "survival_time": 1.4500000000000006, "driven_lanedir": 0.26612128597713225, "sim_render-ego": 0.06701915017489729, "in-drivable-lane": 0, "agent_compute-ego": 0.09661726293892696, "deviation-heading": 0.33260207171657985, "set_robot_commands": 0.10044176825161638, "deviation-center-line": 0.1460774593203363, "driven_lanedir_consec": 0.26612128597713225, "sim_compute_sim_state": 0.0408997864558779, "sim_compute_performance-ego": 0.07509465875296757, "sim_compute_robot_state-ego": 0.0786621406160552}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4564169276787495, "sim_physics": 0.12004613876342772, "survival_time": 2.2, "driven_lanedir": 0.4367076419925104, "sim_render-ego": 0.06223892081867565, "in-drivable-lane": 0, "agent_compute-ego": 0.09714430570602416, "deviation-heading": 0.6530648484520125, "set_robot_commands": 0.09467188878492876, "deviation-center-line": 0.1515721402834494, "driven_lanedir_consec": 0.4367076419925104, "sim_compute_sim_state": 0.0415034835988825, "sim_compute_performance-ego": 0.06953729282725941, "sim_compute_robot_state-ego": 0.07714884389530528}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.7065408549292225, "sim_physics": 0.12765915979418838, "survival_time": 11.400000000000029, "driven_lanedir": 1.559685572593514, "sim_render-ego": 0.0696495813235902, "in-drivable-lane": 4.650000000000023, "agent_compute-ego": 0.10788558449661524, "deviation-heading": 0.6155988247515144, "set_robot_commands": 0.10863241501021804, "deviation-center-line": 0.879491353625135, "driven_lanedir_consec": 1.559685572593514, "sim_compute_sim_state": 0.04416661095200924, "sim_compute_performance-ego": 0.07791596546507719, "sim_compute_robot_state-ego": 0.08466449850483944}}
set_robot_commands_max0.12294147163629532
set_robot_commands_mean0.10932610101406448
set_robot_commands_median0.10863241501021804
set_robot_commands_min0.09467188878492876
sim_compute_performance-ego_max0.08856344917445506
sim_compute_performance-ego_mean0.07864784259943966
sim_compute_performance-ego_median0.07791596546507719
sim_compute_performance-ego_min0.06953729282725941
sim_compute_robot_state-ego_max0.09968233571469204
sim_compute_robot_state-ego_mean0.0876345457009914
sim_compute_robot_state-ego_median0.08466449850483944
sim_compute_robot_state-ego_min0.07714884389530528
sim_compute_sim_state_max0.04643447885235536
sim_compute_sim_state_mean0.04357992092428529
sim_compute_sim_state_median0.04416661095200924
sim_compute_sim_state_min0.0408997864558779
sim_physics_max0.15923890095312618
sim_physics_mean0.13387666781669064
sim_physics_median0.12765915979418838
sim_physics_min0.12004613876342772
sim_render-ego_max0.07740504301867439
sim_render-ego_mean0.06983054717709469
sim_render-ego_median0.0696495813235902
sim_render-ego_min0.06223892081867565
simulation-passed1
survival_time_max11.400000000000029
survival_time_mean5.320000000000001
survival_time_min1.4500000000000006
No reset possible
224553530Nicky EichmannBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationfailedyesip-172-31-25-98-20620:01:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "agent" aborted:

error in agent |Exception while handling a message on topic "get_commands".
               |
               || Traceback (most recent call last):
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
               ||     handle_message_node(parsed, receiver0, context0)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
               ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
               ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
               ||     f(**kwargs)
               ||   File "solution.py", line 48, in on_received_get_commands
               ||     pwm_left, pwm_right = self.compute_action(self.current_image)
               ||   File "solution.py", line 43, in compute_action
               ||     action = self.model.select_action(observation)
               ||   File "/workspace/model.py", line 150, in select_action
               ||     return self.actor(state).cpu().data.numpy().flatten()
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/workspace/model.py", line 45, in forward
               ||     x = self.bn1(self.lr(self.conv1(x)))
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in __call__
               ||     result = self.forward(*input, **kwargs)
               ||   File "/usr/local/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 320, in forward
               ||     self.padding, self.dilation, self.groups)
               || RuntimeError: Given groups=1, weight of size [32, 3, 8, 8], expected input[1, 120, 160, 3] to have 3 channels, but got 120 channels instead
               ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224233315jiang pengRL - TH -hhkaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:36:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5517440458980518
survival_time_median14.200000000000069
deviation-center-line_median0.7272239486453499
in-drivable-lane_median5.750000000000046


other stats
agent_compute-ego_max0.2130505734798955
agent_compute-ego_mean0.20282127191560032
agent_compute-ego_median0.20635603745778405
agent_compute-ego_min0.18375860049691
deviation-center-line_max0.9279072479689552
deviation-center-line_mean0.6589507941348265
deviation-center-line_min0.31622589498973774
deviation-heading_max3.5700258663607576
deviation-heading_mean2.418449430899825
deviation-heading_median2.267214123131697
deviation-heading_min1.2784341577931226
driven_any_max3.328877265093844
driven_any_mean2.759198264229227
driven_any_median2.724544350470416
driven_any_min2.0766251404617697
driven_lanedir_consec_max2.0831169577925572
driven_lanedir_consec_mean1.7128994984836787
driven_lanedir_consec_min1.440631971837869
driven_lanedir_max2.0831169577925572
driven_lanedir_mean1.7128994984836787
driven_lanedir_median1.5517440458980518
driven_lanedir_min1.440631971837869
in-drivable-lane_max8.950000000000092
in-drivable-lane_mean5.390000000000032
in-drivable-lane_min0.7499999999999973
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.6926861899110346, "sim_physics": 0.2033137329419454, "survival_time": 14.950000000000076, "driven_lanedir": 1.5517440458980518, "sim_render-ego": 0.06917388200759887, "in-drivable-lane": 5.750000000000046, "agent_compute-ego": 0.19902162631352743, "deviation-heading": 3.4726568066413894, "set_robot_commands": 0.10540439367294312, "deviation-center-line": 0.9279072479689552, "driven_lanedir_consec": 1.5517440458980518, "sim_compute_sim_state": 0.04283759991327921, "sim_compute_performance-ego": 0.07818885326385498, "sim_compute_robot_state-ego": 0.08327256043752035, "sim_compute_robot_state-npc0": 0.07620591163635254, "sim_compute_robot_state-npc1": 0.07596495151519775, "sim_compute_robot_state-npc2": 0.07498029867808025, "sim_compute_robot_state-npc3": 0.07610459963480631}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.973258375209071, "sim_physics": 0.1875648070389116, "survival_time": 14.200000000000069, "driven_lanedir": 1.948011841574245, "sim_render-ego": 0.06308083383130356, "in-drivable-lane": 5.850000000000038, "agent_compute-ego": 0.18375860049691, "deviation-heading": 3.5700258663607576, "set_robot_commands": 0.09931425141616608, "deviation-center-line": 0.8848890986540239, "driven_lanedir_consec": 1.948011841574245, "sim_compute_sim_state": 0.04078804523172513, "sim_compute_performance-ego": 0.07057923498288007, "sim_compute_robot_state-ego": 0.07727744713635512, "sim_compute_robot_state-npc0": 0.07271789581003324, "sim_compute_robot_state-npc1": 0.07098793899509269, "sim_compute_robot_state-npc2": 0.07135663485862839, "sim_compute_robot_state-npc3": 0.07126523071611432}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.724544350470416, "sim_physics": 0.20781414765937656, "survival_time": 10.20000000000001, "driven_lanedir": 2.0831169577925572, "sim_render-ego": 0.07141176392050351, "in-drivable-lane": 5.64999999999999, "agent_compute-ego": 0.2130505734798955, "deviation-heading": 1.2784341577931226, "set_robot_commands": 0.114981868687798, "deviation-center-line": 0.31622589498973774, "driven_lanedir_consec": 2.0831169577925572, "sim_compute_sim_state": 0.04622797755634084, "sim_compute_performance-ego": 0.0805942462939842, "sim_compute_robot_state-ego": 0.08838611490586225, "sim_compute_robot_state-npc0": 0.07997561085457895, "sim_compute_robot_state-npc1": 0.08043069348615758, "sim_compute_robot_state-npc2": 0.08020630420423021, "sim_compute_robot_state-npc3": 0.07935584292692296}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.328877265093844, "sim_physics": 0.20390507062276209, "survival_time": 14.950000000000076, "driven_lanedir": 1.440631971837869, "sim_render-ego": 0.06979416211446127, "in-drivable-lane": 8.950000000000092, "agent_compute-ego": 0.20635603745778405, "deviation-heading": 1.5039162005721562, "set_robot_commands": 0.1116332960128784, "deviation-center-line": 0.7272239486453499, "driven_lanedir_consec": 1.440631971837869, "sim_compute_sim_state": 0.04567816813786824, "sim_compute_performance-ego": 0.0799093516667684, "sim_compute_robot_state-ego": 0.08768229881922404, "sim_compute_robot_state-npc0": 0.0797870930035909, "sim_compute_robot_state-npc1": 0.08011466900507609, "sim_compute_robot_state-npc2": 0.07988088369369507, "sim_compute_robot_state-npc3": 0.07952544291814169}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.0766251404617697, "sim_physics": 0.2007360883579133, "survival_time": 7.84999999999998, "driven_lanedir": 1.5409926753156715, "sim_render-ego": 0.07230483498542932, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.21191952182988452, "deviation-heading": 2.267214123131697, "set_robot_commands": 0.1125273051535248, "deviation-center-line": 0.43850778041606575, "driven_lanedir_consec": 1.5409926753156715, "sim_compute_sim_state": 0.045921090302194, "sim_compute_performance-ego": 0.07937100586617828, "sim_compute_robot_state-ego": 0.08857788249945185, "sim_compute_robot_state-npc0": 0.07907046482061884, "sim_compute_robot_state-npc1": 0.07797935358278311, "sim_compute_robot_state-npc2": 0.07934770310760304, "sim_compute_robot_state-npc3": 0.07918583815264854}}
set_robot_commands_max0.114981868687798
set_robot_commands_mean0.1087722229886621
set_robot_commands_median0.1116332960128784
set_robot_commands_min0.09931425141616608
sim_compute_performance-ego_max0.0805942462939842
sim_compute_performance-ego_mean0.07772853841473318
sim_compute_performance-ego_median0.07937100586617828
sim_compute_performance-ego_min0.07057923498288007
sim_compute_robot_state-ego_max0.08857788249945185
sim_compute_robot_state-ego_mean0.08503926075968274
sim_compute_robot_state-ego_median0.08768229881922404
sim_compute_robot_state-ego_min0.07727744713635512
sim_compute_robot_state-npc0_max0.07997561085457895
sim_compute_robot_state-npc0_mean0.07755139522503489
sim_compute_robot_state-npc0_median0.07907046482061884
sim_compute_robot_state-npc0_min0.07271789581003324
sim_compute_robot_state-npc1_max0.08043069348615758
sim_compute_robot_state-npc1_mean0.07709552131686145
sim_compute_robot_state-npc1_median0.07797935358278311
sim_compute_robot_state-npc1_min0.07098793899509269
sim_compute_robot_state-npc2_max0.08020630420423021
sim_compute_robot_state-npc2_mean0.07715436490844738
sim_compute_robot_state-npc2_median0.07934770310760304
sim_compute_robot_state-npc2_min0.07135663485862839
sim_compute_robot_state-npc3_max0.07952544291814169
sim_compute_robot_state-npc3_mean0.07708739086972675
sim_compute_robot_state-npc3_median0.07918583815264854
sim_compute_robot_state-npc3_min0.07126523071611432
sim_compute_sim_state_max0.04622797755634084
sim_compute_sim_state_mean0.04429057622828148
sim_compute_sim_state_median0.04567816813786824
sim_compute_sim_state_min0.04078804523172513
sim_physics_max0.20781414765937656
sim_physics_mean0.2006667693241818
sim_physics_median0.2033137329419454
sim_physics_min0.1875648070389116
sim_render-ego_max0.07230483498542932
sim_render-ego_mean0.0691530953718593
sim_render-ego_median0.06979416211446127
sim_render-ego_min0.06308083383130356
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean12.43000000000004
survival_time_min7.84999999999998
No reset possible
224203318jiang pengRL - TH - shiaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:44
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
224133324jiang pengRL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:01:48
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223993334FANG MEIYI 🇸🇬testaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:27:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223843346Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:31:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2212724092692753
survival_time_median8.04999999999998
deviation-center-line_median0.5751850080662609
in-drivable-lane_median0


other stats
agent_compute-ego_max0.14516848531262627
agent_compute-ego_mean0.12100714652603715
agent_compute-ego_median0.12144958843355594
agent_compute-ego_min0.09273682369126214
deviation-center-line_max1.3080756021175788
deviation-center-line_mean0.5939588800297929
deviation-center-line_min0.208564180438624
deviation-heading_max2.921567128325301
deviation-heading_mean1.721839859503752
deviation-heading_median1.7119748285646246
deviation-heading_min0.549147402377039
driven_any_max2.901127713204258
driven_any_mean1.2901607397496293
driven_any_median1.265812593699502
driven_any_min0.4607767819960878
driven_lanedir_consec_max2.6545548101656244
driven_lanedir_consec_mean1.19127017173932
driven_lanedir_consec_min0.3769531596616167
driven_lanedir_max2.6545548101656244
driven_lanedir_mean1.1917305681457298
driven_lanedir_median1.2212724092692753
driven_lanedir_min0.3769531596616167
in-drivable-lane_max1.649999999999994
in-drivable-lane_mean0.3399999999999988
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.4607767819960878, "sim_physics": 0.19737310542000663, "survival_time": 3.599999999999995, "driven_lanedir": 0.3769531596616167, "sim_render-ego": 0.0628097587161594, "in-drivable-lane": 0, "agent_compute-ego": 0.09273682369126214, "deviation-heading": 1.6746913678877264, "set_robot_commands": 0.11173269152641296, "deviation-center-line": 0.21258867457836844, "driven_lanedir_consec": 0.3769531596616167, "sim_compute_sim_state": 0.03946675194634332, "sim_compute_performance-ego": 0.06972758968671162, "sim_compute_robot_state-ego": 0.07770977748764886, "sim_compute_robot_state-npc0": 0.07552058166927761, "sim_compute_robot_state-npc1": 0.07585479484664069, "sim_compute_robot_state-npc2": 0.07228695684009129, "sim_compute_robot_state-npc3": 0.06667009658283657}, "udem1-1-0": {"driven_any": 1.265812593699502, "sim_physics": 0.2580698691539883, "survival_time": 8.04999999999998, "driven_lanedir": 1.2212724092692753, "sim_render-ego": 0.07311879181713792, "in-drivable-lane": 0, "agent_compute-ego": 0.12012446000709295, "deviation-heading": 1.75181857036407, "set_robot_commands": 0.13765075191947984, "deviation-center-line": 0.5751850080662609, "driven_lanedir_consec": 1.2212724092692753, "sim_compute_sim_state": 0.04689747354258662, "sim_compute_performance-ego": 0.08131660733904157, "sim_compute_robot_state-ego": 0.09087430023998948, "sim_compute_robot_state-npc0": 0.08845030743142833, "sim_compute_robot_state-npc1": 0.08247834258938427, "sim_compute_robot_state-npc2": 0.0823426972264829, "sim_compute_robot_state-npc3": 0.08271729131663068}, "udem1-2-0": {"driven_any": 1.3334970009829048, "sim_physics": 0.33062495485596033, "survival_time": 9.199999999999996, "driven_lanedir": 1.24648963493867, "sim_render-ego": 0.0772629315438478, "in-drivable-lane": 0, "agent_compute-ego": 0.12144958843355594, "deviation-heading": 2.921567128325301, "set_robot_commands": 0.14860192848288495, "deviation-center-line": 0.6653809349481323, "driven_lanedir_consec": 1.2441876529066214, "sim_compute_sim_state": 0.04829497052275616, "sim_compute_performance-ego": 0.08992629595424818, "sim_compute_robot_state-ego": 0.1054839375226394, "sim_compute_robot_state-npc0": 0.09461571470550868, "sim_compute_robot_state-npc1": 0.09096078380294469, "sim_compute_robot_state-npc2": 0.08948867606080096, "sim_compute_robot_state-npc3": 0.08931718831476958}, "udem1-3-0": {"driven_any": 0.489589608865393, "sim_physics": 0.3748061040352131, "survival_time": 2.8999999999999977, "driven_lanedir": 0.4593828266934623, "sim_render-ego": 0.09095288556197594, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.14516848531262627, "deviation-heading": 0.549147402377039, "set_robot_commands": 0.17351450180185252, "deviation-center-line": 0.208564180438624, "driven_lanedir_consec": 0.4593828266934623, "sim_compute_sim_state": 0.05583291629265095, "sim_compute_performance-ego": 0.10457800174581594, "sim_compute_robot_state-ego": 0.12686319186769682, "sim_compute_robot_state-npc0": 0.10876369887384876, "sim_compute_robot_state-npc1": 0.10226986737086854, "sim_compute_robot_state-npc2": 0.1050823474752492, "sim_compute_robot_state-npc3": 0.10281479769739613}, "udem1-4-0": {"driven_any": 2.901127713204258, "sim_physics": 0.3094626959164937, "survival_time": 14.950000000000076, "driven_lanedir": 2.6545548101656244, "sim_render-ego": 0.08154248555501302, "in-drivable-lane": 1.649999999999994, "agent_compute-ego": 0.1255563751856486, "deviation-heading": 1.7119748285646246, "set_robot_commands": 0.15425367514292398, "deviation-center-line": 1.3080756021175788, "driven_lanedir_consec": 2.6545548101656244, "sim_compute_sim_state": 0.04970561901728312, "sim_compute_performance-ego": 0.09292558034261068, "sim_compute_robot_state-ego": 0.11241600592931111, "sim_compute_robot_state-npc0": 0.09564220348993938, "sim_compute_robot_state-npc1": 0.09219741980234782, "sim_compute_robot_state-npc2": 0.09229446967442832, "sim_compute_robot_state-npc3": 0.09163254499435423}}
set_robot_commands_max0.17351450180185252
set_robot_commands_mean0.14515070977471084
set_robot_commands_median0.14860192848288495
set_robot_commands_min0.11173269152641296
sim_compute_performance-ego_max0.10457800174581594
sim_compute_performance-ego_mean0.0876948150136856
sim_compute_performance-ego_median0.08992629595424818
sim_compute_performance-ego_min0.06972758968671162
sim_compute_robot_state-ego_max0.12686319186769682
sim_compute_robot_state-ego_mean0.10266944260945714
sim_compute_robot_state-ego_median0.1054839375226394
sim_compute_robot_state-ego_min0.07770977748764886
sim_compute_robot_state-npc0_max0.10876369887384876
sim_compute_robot_state-npc0_mean0.09259850123400055
sim_compute_robot_state-npc0_median0.09461571470550868
sim_compute_robot_state-npc0_min0.07552058166927761
sim_compute_robot_state-npc1_max0.10226986737086854
sim_compute_robot_state-npc1_mean0.0887522416824372
sim_compute_robot_state-npc1_median0.09096078380294469
sim_compute_robot_state-npc1_min0.07585479484664069
sim_compute_robot_state-npc2_max0.1050823474752492
sim_compute_robot_state-npc2_mean0.08829902945541053
sim_compute_robot_state-npc2_median0.08948867606080096
sim_compute_robot_state-npc2_min0.07228695684009129
sim_compute_robot_state-npc3_max0.10281479769739613
sim_compute_robot_state-npc3_mean0.08663038378119745
sim_compute_robot_state-npc3_median0.08931718831476958
sim_compute_robot_state-npc3_min0.06667009658283657
sim_compute_sim_state_max0.05583291629265095
sim_compute_sim_state_mean0.04803954626432404
sim_compute_sim_state_median0.04829497052275616
sim_compute_sim_state_min0.03946675194634332
sim_physics_max0.3748061040352131
sim_physics_mean0.29406734587633243
sim_physics_median0.3094626959164937
sim_physics_min0.19737310542000663
sim_render-ego_max0.09095288556197594
sim_render-ego_mean0.07713737063882682
sim_render-ego_median0.0772629315438478
sim_render-ego_min0.0628097587161594
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.740000000000009
survival_time_min2.8999999999999977
No reset possible
223803352Isabelle Guyon 🇺🇸challenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:11:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223783354Isabelle Guyon 🇺🇸challenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223733364Amaury Camus 🇨🇭challenge-aido_LF-template-randomaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:06:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.13005513204193506
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.17571241325802273
agent_compute-ego_mean0.16476508489613342
agent_compute-ego_median0.16343823432922364
agent_compute-ego_min0.15922915234285245
deviation-center-line_max0.2072381278624381
deviation-center-line_mean0.13189395308989768
deviation-center-line_min0.0788839760023766
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3206717506075888
deviation-heading_median0.23606825392187256
deviation-heading_min0.19401296908406307
driven_any_max1.618214457700942
driven_any_mean0.8613785859332687
driven_any_median0.9933867744747804
driven_any_min0.23626560261560617
driven_lanedir_consec_max0.8010406009604816
driven_lanedir_consec_mean0.5597645764431625
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max0.8010406009604816
driven_lanedir_mean0.5597645764431625
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.619999999999998
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12251957699104592, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06780352415861907, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17571241325802273, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.11127140786912706, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04285561155389856, "sim_compute_performance-ego": 0.0788317256503635, "sim_compute_robot_state-ego": 0.08373436221369991}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1316817788516774, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06658576984031528, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16619538325889438, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10703422976475135, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.0432742249731924, "sim_compute_performance-ego": 0.07590353722665824, "sim_compute_robot_state-ego": 0.08681215959436753}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13407027020173914, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.0642846752615536, "in-drivable-lane": 0, "agent_compute-ego": 0.15922915234285245, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.102585750467637, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.0443722500520594, "sim_compute_performance-ego": 0.07103431926054113, "sim_compute_robot_state-ego": 0.0774073741015266}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1345204544067383, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.06487367630004882, "in-drivable-lane": 0, "agent_compute-ego": 0.16343823432922364, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.1102665615081787, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.04419073104858398, "sim_compute_performance-ego": 0.07314756393432617, "sim_compute_robot_state-ego": 0.07602783203125}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12026638018934031, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06585901900182796, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.15925024129167387, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.0995858168300194, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.040728958347175694, "sim_compute_performance-ego": 0.07153616072256354, "sim_compute_robot_state-ego": 0.07636290260508091}}
set_robot_commands_max0.11127140786912706
set_robot_commands_mean0.10614875328794272
set_robot_commands_median0.10703422976475135
set_robot_commands_min0.0995858168300194
sim_compute_performance-ego_max0.0788317256503635
sim_compute_performance-ego_mean0.0740906613588905
sim_compute_performance-ego_median0.07314756393432617
sim_compute_performance-ego_min0.07103431926054113
sim_compute_robot_state-ego_max0.08681215959436753
sim_compute_robot_state-ego_mean0.08006892610918499
sim_compute_robot_state-ego_median0.0774073741015266
sim_compute_robot_state-ego_min0.07602783203125
sim_compute_sim_state_max0.0443722500520594
sim_compute_sim_state_mean0.04308435519498201
sim_compute_sim_state_median0.0432742249731924
sim_compute_sim_state_min0.040728958347175694
sim_physics_max0.1345204544067383
sim_physics_mean0.12861169212810822
sim_physics_median0.1316817788516774
sim_physics_min0.12026638018934031
sim_render-ego_max0.06780352415861907
sim_render-ego_mean0.06588133291247295
sim_render-ego_median0.06585901900182796
sim_render-ego_min0.0642846752615536
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2599999999999985
survival_time_min0.8500000000000002
No reset possible
223673377Angel Woo 🇭🇰Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:14:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3600832723053604
survival_time_median3.7499999999999942
deviation-center-line_median0.2370001128425238
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.2764461612701416
agent_compute-ego_mean0.2441114829381307
agent_compute-ego_median0.23250017245610555
agent_compute-ego_min0.22781463146209716
deviation-center-line_max0.46983978184464065
deviation-center-line_mean0.265422751447818
deviation-center-line_min0.17648732541296272
deviation-heading_max1.4220663005881111
deviation-heading_mean1.2300007442982823
deviation-heading_median1.2513842908170023
deviation-heading_min1.0249290935072062
driven_any_max1.261730942778066
driven_any_mean0.5665822191658659
driven_any_median0.40588022921270733
driven_any_min0.1911903707168364
driven_lanedir_consec_max1.253359937354204
driven_lanedir_consec_mean0.5192893500492889
driven_lanedir_consec_min0.16096578123108918
driven_lanedir_max1.253359937354204
driven_lanedir_mean0.5192893500492889
driven_lanedir_median0.3600832723053604
driven_lanedir_min0.16096578123108918
in-drivable-lane_max0.549999999999998
in-drivable-lane_mean0.1699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.261730942778066, "sim_physics": 0.1192740535736084, "survival_time": 14.950000000000076, "driven_lanedir": 1.253359937354204, "sim_render-ego": 0.06827484369277954, "in-drivable-lane": 0, "agent_compute-ego": 0.23250017245610555, "deviation-heading": 1.4220663005881111, "set_robot_commands": 0.10425901492436727, "deviation-center-line": 0.46983978184464065, "driven_lanedir_consec": 1.253359937354204, "sim_compute_sim_state": 0.0417912761370341, "sim_compute_performance-ego": 0.07488677183787028, "sim_compute_robot_state-ego": 0.08080487410227458}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7125111159500466, "sim_physics": 0.1443380085627238, "survival_time": 7.499999999999981, "driven_lanedir": 0.6180765347196295, "sim_render-ego": 0.06874019304911295, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.2764461612701416, "deviation-heading": 1.2513842908170023, "set_robot_commands": 0.113570818901062, "deviation-center-line": 0.2370001128425238, "driven_lanedir_consec": 0.6180765347196295, "sim_compute_sim_state": 0.04298814455668132, "sim_compute_performance-ego": 0.07970191319783529, "sim_compute_robot_state-ego": 0.09431117375691732}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1911903707168364, "sim_physics": 0.11906254788239796, "survival_time": 2.3999999999999995, "driven_lanedir": 0.16096578123108918, "sim_render-ego": 0.062933549284935, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.22827829917271933, "deviation-heading": 1.034786009756154, "set_robot_commands": 0.10046255588531494, "deviation-center-line": 0.26457545795887066, "driven_lanedir_consec": 0.16096578123108918, "sim_compute_sim_state": 0.04016175369421641, "sim_compute_performance-ego": 0.07303314904371898, "sim_compute_robot_state-ego": 0.0793590098619461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2615984371716733, "sim_physics": 0.13067626953125, "survival_time": 2.499999999999999, "driven_lanedir": 0.2039612246361613, "sim_render-ego": 0.06580374717712402, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.22781463146209716, "deviation-heading": 1.41683802682294, "set_robot_commands": 0.10342989444732666, "deviation-center-line": 0.17648732541296272, "driven_lanedir_consec": 0.2039612246361613, "sim_compute_sim_state": 0.04257700920104981, "sim_compute_performance-ego": 0.07678280353546142, "sim_compute_robot_state-ego": 0.08091957092285157}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.40588022921270733, "sim_physics": 0.126889435450236, "survival_time": 3.7499999999999942, "driven_lanedir": 0.3600832723053604, "sim_render-ego": 0.06982618649800619, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.25551815032958985, "deviation-heading": 1.0249290935072062, "set_robot_commands": 0.1120516840616862, "deviation-center-line": 0.1792110791800922, "driven_lanedir_consec": 0.3600832723053604, "sim_compute_sim_state": 0.04419377326965332, "sim_compute_performance-ego": 0.0808354918162028, "sim_compute_robot_state-ego": 0.08640523274739584}}
set_robot_commands_max0.113570818901062
set_robot_commands_mean0.10675479364395142
set_robot_commands_median0.10425901492436727
set_robot_commands_min0.10046255588531494
sim_compute_performance-ego_max0.0808354918162028
sim_compute_performance-ego_mean0.07704802588621776
sim_compute_performance-ego_median0.07678280353546142
sim_compute_performance-ego_min0.07303314904371898
sim_compute_robot_state-ego_max0.09431117375691732
sim_compute_robot_state-ego_mean0.08435997227827707
sim_compute_robot_state-ego_median0.08091957092285157
sim_compute_robot_state-ego_min0.0793590098619461
sim_compute_sim_state_max0.04419377326965332
sim_compute_sim_state_mean0.04234239137172699
sim_compute_sim_state_median0.04257700920104981
sim_compute_sim_state_min0.04016175369421641
sim_physics_max0.1443380085627238
sim_physics_mean0.12804806300004323
sim_physics_median0.126889435450236
sim_physics_min0.11906254788239796
sim_render-ego_max0.06982618649800619
sim_render-ego_mean0.06711570394039154
sim_render-ego_median0.06827484369277954
sim_render-ego_min0.062933549284935
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.22000000000001
survival_time_min2.3999999999999995
No reset possible
223563389jiang pengRL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:20:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3101192113142552
survival_time_median14.950000000000076
deviation-center-line_median0.24243863874496385
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.21871906406474564
agent_compute-ego_mean0.1966223645685818
agent_compute-ego_median0.19359436489286877
agent_compute-ego_min0.1749836492538452
deviation-center-line_max1.0434949873883317
deviation-center-line_mean0.4259194900659282
deviation-center-line_min0.1401830237429978
deviation-heading_max3.258302593425212
deviation-heading_mean1.6885883908401134
deviation-heading_median0.7515849483063952
deviation-heading_min0.6407369304334734
driven_any_max3.0039818546957533
driven_any_mean1.8331630654726871
driven_any_median1.454681517915794
driven_any_min0.5220382386221536
driven_lanedir_consec_max2.9239913863149116
driven_lanedir_consec_mean1.508249173433078
driven_lanedir_consec_min0.4982817657516895
driven_lanedir_max2.9239913863149116
driven_lanedir_mean1.720835785523868
driven_lanedir_median1.3101192113142552
driven_lanedir_min0.4982817657516895
in-drivable-lane_max10.750000000000083
in-drivable-lane_mean3.0400000000000142
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.878375035146398, "sim_physics": 0.11263713598251344, "survival_time": 14.950000000000076, "driven_lanedir": 2.6632423025599103, "sim_render-ego": 0.06187726736068726, "in-drivable-lane": 4.149999999999985, "agent_compute-ego": 0.1749836492538452, "deviation-heading": 3.135200716966442, "set_robot_commands": 0.09620190223058064, "deviation-center-line": 0.5503458169986458, "driven_lanedir_consec": 1.6003092421059613, "sim_compute_sim_state": 0.038529078960418704, "sim_compute_performance-ego": 0.06878667036692301, "sim_compute_robot_state-ego": 0.07465070327123006}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5220382386221536, "sim_physics": 0.1445627122555139, "survival_time": 2.6499999999999986, "driven_lanedir": 0.4982817657516895, "sim_render-ego": 0.06885628430348523, "in-drivable-lane": 0, "agent_compute-ego": 0.21871906406474564, "deviation-heading": 0.6407369304334734, "set_robot_commands": 0.11424758749188116, "deviation-center-line": 0.15313498345470178, "driven_lanedir_consec": 0.4982817657516895, "sim_compute_sim_state": 0.045748886072410726, "sim_compute_performance-ego": 0.0777261976925832, "sim_compute_robot_state-ego": 0.09126675353859956}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3067386809833363, "sim_physics": 0.13906316246305192, "survival_time": 4.199999999999993, "driven_lanedir": 1.2085442616785729, "sim_render-ego": 0.06873538096745808, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.19359436489286877, "deviation-heading": 0.6571167650690457, "set_robot_commands": 0.1060973462604341, "deviation-center-line": 0.24243863874496385, "driven_lanedir_consec": 1.2085442616785729, "sim_compute_sim_state": 0.0434778786840893, "sim_compute_performance-ego": 0.07610999970209031, "sim_compute_robot_state-ego": 0.08468539374215263}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.0039818546957533, "sim_physics": 0.12800871849060058, "survival_time": 14.950000000000076, "driven_lanedir": 2.9239913863149116, "sim_render-ego": 0.07116562128067017, "in-drivable-lane": 0, "agent_compute-ego": 0.20430974880854288, "deviation-heading": 3.258302593425212, "set_robot_commands": 0.10767183144887288, "deviation-center-line": 1.0434949873883317, "driven_lanedir_consec": 2.9239913863149116, "sim_compute_sim_state": 0.04324049870173136, "sim_compute_performance-ego": 0.07704393943150838, "sim_compute_robot_state-ego": 0.08723445574442545}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.454681517915794, "sim_physics": 0.1202328634262085, "survival_time": 14.950000000000076, "driven_lanedir": 1.3101192113142552, "sim_render-ego": 0.06755136887232463, "in-drivable-lane": 10.750000000000083, "agent_compute-ego": 0.1915049958229065, "deviation-heading": 0.7515849483063952, "set_robot_commands": 0.10575739781061808, "deviation-center-line": 0.1401830237429978, "driven_lanedir_consec": 1.3101192113142552, "sim_compute_sim_state": 0.04235537052154541, "sim_compute_performance-ego": 0.07545822223027547, "sim_compute_robot_state-ego": 0.08150821526845296}}
set_robot_commands_max0.11424758749188116
set_robot_commands_mean0.10599521304847737
set_robot_commands_median0.1060973462604341
set_robot_commands_min0.09620190223058064
sim_compute_performance-ego_max0.0777261976925832
sim_compute_performance-ego_mean0.07502500588467607
sim_compute_performance-ego_median0.07610999970209031
sim_compute_performance-ego_min0.06878667036692301
sim_compute_robot_state-ego_max0.09126675353859956
sim_compute_robot_state-ego_mean0.08386910431297213
sim_compute_robot_state-ego_median0.08468539374215263
sim_compute_robot_state-ego_min0.07465070327123006
sim_compute_sim_state_max0.045748886072410726
sim_compute_sim_state_mean0.042670342588039104
sim_compute_sim_state_median0.04324049870173136
sim_compute_sim_state_min0.038529078960418704
sim_physics_max0.1445627122555139
sim_physics_mean0.12890091852357768
sim_physics_median0.12800871849060058
sim_physics_min0.11263713598251344
sim_render-ego_max0.07116562128067017
sim_render-ego_mean0.06763718455692506
sim_render-ego_median0.06873538096745808
sim_render-ego_min0.06187726736068726
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.340000000000042
survival_time_min2.6499999999999986
No reset possible
223473393jiang pengRL-TH-shiaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:18:10
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223433398jiang pengRL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:36:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.975330880415484
survival_time_median14.950000000000076
deviation-center-line_median0.8152060880479512
in-drivable-lane_median0.1999999999999993


other stats
agent_compute-ego_max0.20326913913091024
agent_compute-ego_mean0.19453899039055003
agent_compute-ego_median0.1947681560727503
agent_compute-ego_min0.18446847796440125
deviation-center-line_max1.2439896860630633
deviation-center-line_mean0.7336670419879506
deviation-center-line_min0.19174177571362896
deviation-heading_max8.328715805744135
deviation-heading_mean3.925563463806928
deviation-heading_median2.100332901201745
deviation-heading_min1.3870670756587635
driven_any_max3.8256038488584583
driven_any_mean2.1896782591230353
driven_any_median2.009718876576007
driven_any_min0.7467103377245005
driven_lanedir_consec_max3.7660460672280416
driven_lanedir_consec_mean2.03846021981763
driven_lanedir_consec_min0.6950472409159887
driven_lanedir_max3.7660460672280416
driven_lanedir_mean2.0699085891611104
driven_lanedir_median1.975330880415484
driven_lanedir_min0.6950472409159887
in-drivable-lane_max11.45000000000008
in-drivable-lane_mean2.670000000000021
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.7467103377245005, "sim_physics": 0.1803117815653483, "survival_time": 14.950000000000076, "driven_lanedir": 0.6950472409159887, "sim_render-ego": 0.06881034851074219, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.20326913913091024, "deviation-heading": 1.4082215099017472, "set_robot_commands": 0.10494975725809733, "deviation-center-line": 0.2290947388457744, "driven_lanedir_consec": 0.6950472409159887, "sim_compute_sim_state": 0.04404317617416382, "sim_compute_performance-ego": 0.07779680887858073, "sim_compute_robot_state-ego": 0.0866978375116984, "sim_compute_robot_state-npc0": 0.07580942948659261, "sim_compute_robot_state-npc1": 0.07540695587793986, "sim_compute_robot_state-npc2": 0.07542869647343954, "sim_compute_robot_state-npc3": 0.07571980079015096}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.8256038488584583, "sim_physics": 0.20924810806910196, "survival_time": 14.950000000000076, "driven_lanedir": 3.7660460672280416, "sim_render-ego": 0.06768489917119344, "in-drivable-lane": 0, "agent_compute-ego": 0.193872762521108, "deviation-heading": 2.100332901201745, "set_robot_commands": 0.10421302159627278, "deviation-center-line": 1.2439896860630633, "driven_lanedir_consec": 3.7660460672280416, "sim_compute_sim_state": 0.04425558010737101, "sim_compute_performance-ego": 0.07431911071141561, "sim_compute_robot_state-ego": 0.08067410389582316, "sim_compute_robot_state-npc0": 0.0760317595799764, "sim_compute_robot_state-npc1": 0.07654194752375285, "sim_compute_robot_state-npc2": 0.0764156158765157, "sim_compute_robot_state-npc3": 0.07605855385462443}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.48025901410422, "sim_physics": 0.19501807153005, "survival_time": 13.550000000000058, "driven_lanedir": 2.177511542811998, "sim_render-ego": 0.06834905085968355, "in-drivable-lane": 1.7000000000000242, "agent_compute-ego": 0.1947681560727503, "deviation-heading": 6.403480026528249, "set_robot_commands": 0.10479695682596016, "deviation-center-line": 0.8152060880479512, "driven_lanedir_consec": 2.0202696960945947, "sim_compute_sim_state": 0.04202929985919122, "sim_compute_performance-ego": 0.07532426967831996, "sim_compute_robot_state-ego": 0.08387716142013944, "sim_compute_robot_state-npc0": 0.07747483077524334, "sim_compute_robot_state-npc1": 0.07674055785710521, "sim_compute_robot_state-npc2": 0.0779617439776769, "sim_compute_robot_state-npc3": 0.07729974532039403}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.009718876576007, "sim_physics": 0.1839338556925456, "survival_time": 14.950000000000076, "driven_lanedir": 1.975330880415484, "sim_render-ego": 0.069168381690979, "in-drivable-lane": 0, "agent_compute-ego": 0.19631641626358032, "deviation-heading": 8.328715805744135, "set_robot_commands": 0.10438000440597534, "deviation-center-line": 1.1883029212693352, "driven_lanedir_consec": 1.975330880415484, "sim_compute_sim_state": 0.043134349981943765, "sim_compute_performance-ego": 0.07530667781829833, "sim_compute_robot_state-ego": 0.08130394299825032, "sim_compute_robot_state-npc0": 0.07632042407989502, "sim_compute_robot_state-npc1": 0.07563967704772949, "sim_compute_robot_state-npc2": 0.07599569161732991, "sim_compute_robot_state-npc3": 0.07573440949122111}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.886099218351988, "sim_physics": 0.18042278760357908, "survival_time": 7.599999999999981, "driven_lanedir": 1.7356072144340409, "sim_render-ego": 0.06650007869067945, "in-drivable-lane": 0.1999999999999993, "agent_compute-ego": 0.18446847796440125, "deviation-heading": 1.3870670756587635, "set_robot_commands": 0.09992631485587672, "deviation-center-line": 0.19174177571362896, "driven_lanedir_consec": 1.7356072144340409, "sim_compute_sim_state": 0.04185493996268824, "sim_compute_performance-ego": 0.07714120494691949, "sim_compute_robot_state-ego": 0.07764768757318195, "sim_compute_robot_state-npc0": 0.07516961034975554, "sim_compute_robot_state-npc1": 0.07589896415409289, "sim_compute_robot_state-npc2": 0.07382639928867943, "sim_compute_robot_state-npc3": 0.07568362982649553}}
set_robot_commands_max0.10494975725809733
set_robot_commands_mean0.10365321098843648
set_robot_commands_median0.10438000440597534
set_robot_commands_min0.09992631485587672
sim_compute_performance-ego_max0.07779680887858073
sim_compute_performance-ego_mean0.07597761440670683
sim_compute_performance-ego_median0.07532426967831996
sim_compute_performance-ego_min0.07431911071141561
sim_compute_robot_state-ego_max0.0866978375116984
sim_compute_robot_state-ego_mean0.08204014667981865
sim_compute_robot_state-ego_median0.08130394299825032
sim_compute_robot_state-ego_min0.07764768757318195
sim_compute_robot_state-npc0_max0.07747483077524334
sim_compute_robot_state-npc0_mean0.07616121085429259
sim_compute_robot_state-npc0_median0.0760317595799764
sim_compute_robot_state-npc0_min0.07516961034975554
sim_compute_robot_state-npc1_max0.07674055785710521
sim_compute_robot_state-npc1_mean0.07604562049212407
sim_compute_robot_state-npc1_median0.07589896415409289
sim_compute_robot_state-npc1_min0.07540695587793986
sim_compute_robot_state-npc2_max0.0779617439776769
sim_compute_robot_state-npc2_mean0.07592562944672829
sim_compute_robot_state-npc2_median0.07599569161732991
sim_compute_robot_state-npc2_min0.07382639928867943
sim_compute_robot_state-npc3_max0.07729974532039403
sim_compute_robot_state-npc3_mean0.07609922785657722
sim_compute_robot_state-npc3_median0.07573440949122111
sim_compute_robot_state-npc3_min0.07568362982649553
sim_compute_sim_state_max0.04425558010737101
sim_compute_sim_state_mean0.04306346921707161
sim_compute_sim_state_median0.043134349981943765
sim_compute_sim_state_min0.04185493996268824
sim_physics_max0.20924810806910196
sim_physics_mean0.189786920892125
sim_physics_median0.1839338556925456
sim_physics_min0.1803117815653483
sim_render-ego_max0.069168381690979
sim_render-ego_mean0.06810255178465552
sim_render-ego_median0.06834905085968355
sim_render-ego_min0.06650007869067945
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.200000000000054
survival_time_min7.599999999999981
No reset possible
223403400jiang pengRL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:36
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223373403jiang pengRL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:37
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223303432jiang pengRL-TH-shiaido2-LFV-sim-testingstep1-simulationerroryesip-172-31-25-98-20620:14:59
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223283411jiang pengRL - TH -xyzaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:00:45
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
223163420jiang pengRL-TH-shiaido2-LFVI-sim-validationstep1-simulationsuccessyesip-172-31-25-98-20620:40:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.793613220206473
survival_time_median14.950000000000076
deviation-center-line_median0.831432818089618
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20119850397109984
agent_compute-ego_mean0.1985115806984179
agent_compute-ego_median0.19810761054356893
agent_compute-ego_min0.19637348810831703
deviation-center-line_max1.0703461526822913
deviation-center-line_mean0.7479476605143406
deviation-center-line_min0.2050644142697411
deviation-heading_max3.51411187445227
deviation-heading_mean2.5737518756634916
deviation-heading_median2.9902249016270286
deviation-heading_min0.6181915074137561
driven_any_max3.856107441478067
driven_any_mean2.8622537289075267
driven_any_median3.1858395652810274
driven_any_min1.0713096652020695
driven_lanedir_consec_max3.2003990522197725
driven_lanedir_consec_mean2.420404756000208
driven_lanedir_consec_min0.7236394526469256
driven_lanedir_max3.800844346863025
driven_lanedir_mean2.736629281581118
driven_lanedir_median3.094851952630199
driven_lanedir_min0.745114212487482
in-drivable-lane_max2.8999999999999897
in-drivable-lane_mean0.579999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 3.301458535689118, "sim_physics": 0.22278572082519532, "survival_time": 14.950000000000076, "driven_lanedir": 3.202275465924296, "sim_render-ego": 0.0688444701830546, "in-drivable-lane": 0, "agent_compute-ego": 0.1968394343058268, "deviation-heading": 3.4493324990088654, "set_robot_commands": 0.1068045210838318, "deviation-center-line": 0.831432818089618, "driven_lanedir_consec": 3.2003990522197725, "sim_compute_sim_state": 0.04390006303787231, "sim_compute_performance-ego": 0.0781190053621928, "sim_compute_robot_state-ego": 0.0835545555750529, "sim_compute_robot_state-npc0": 0.07605452140172322, "sim_compute_robot_state-npc1": 0.07762555996576945, "sim_compute_robot_state-npc2": 0.07612504720687867, "sim_compute_robot_state-npc3": 0.07785423358281453}, "udem1-1-0": {"driven_any": 2.896553436887352, "sim_physics": 0.22607219219207764, "survival_time": 14.950000000000076, "driven_lanedir": 2.8400604300005905, "sim_render-ego": 0.06972376585006713, "in-drivable-lane": 0, "agent_compute-ego": 0.19637348810831703, "deviation-heading": 2.9902249016270286, "set_robot_commands": 0.10612445910771688, "deviation-center-line": 0.9561452421303704, "driven_lanedir_consec": 2.416085405019757, "sim_compute_sim_state": 0.04358957370122274, "sim_compute_performance-ego": 0.07737599929173787, "sim_compute_robot_state-ego": 0.0841554061571757, "sim_compute_robot_state-npc0": 0.07579835255940755, "sim_compute_robot_state-npc1": 0.07738310654958089, "sim_compute_robot_state-npc2": 0.07673397541046142, "sim_compute_robot_state-npc3": 0.07744711875915528}, "udem1-2-0": {"driven_any": 3.856107441478067, "sim_physics": 0.2330665381749471, "survival_time": 14.950000000000076, "driven_lanedir": 3.800844346863025, "sim_render-ego": 0.06968851884206136, "in-drivable-lane": 0, "agent_compute-ego": 0.20119850397109984, "deviation-heading": 2.296898595815537, "set_robot_commands": 0.10643924315770469, "deviation-center-line": 0.6767496753996813, "driven_lanedir_consec": 2.9682866499081104, "sim_compute_sim_state": 0.04385519027709961, "sim_compute_performance-ego": 0.07678598165512085, "sim_compute_robot_state-ego": 0.08431519985198975, "sim_compute_robot_state-npc0": 0.07702276786168416, "sim_compute_robot_state-npc1": 0.07679777145385742, "sim_compute_robot_state-npc2": 0.075972052415212, "sim_compute_robot_state-npc3": 0.07677778959274292}, "udem1-3-0": {"driven_any": 1.0713096652020695, "sim_physics": 0.2454529025337913, "survival_time": 5.4999999999999885, "driven_lanedir": 0.745114212487482, "sim_render-ego": 0.06853847720406273, "in-drivable-lane": 2.8999999999999897, "agent_compute-ego": 0.2000388665632768, "deviation-heading": 0.6181915074137561, "set_robot_commands": 0.1063176003369418, "deviation-center-line": 0.2050644142697411, "driven_lanedir_consec": 0.7236394526469256, "sim_compute_sim_state": 0.04370006647976962, "sim_compute_performance-ego": 0.07648711854761298, "sim_compute_robot_state-ego": 0.08439831083471125, "sim_compute_robot_state-npc0": 0.07572415308518843, "sim_compute_robot_state-npc1": 0.07616001042452726, "sim_compute_robot_state-npc2": 0.07601592107252642, "sim_compute_robot_state-npc3": 0.07658392949537797}, "udem1-4-0": {"driven_any": 3.1858395652810274, "sim_physics": 0.2288533107439677, "survival_time": 14.950000000000076, "driven_lanedir": 3.094851952630199, "sim_render-ego": 0.06916746457417806, "in-drivable-lane": 0, "agent_compute-ego": 0.19810761054356893, "deviation-heading": 3.51411187445227, "set_robot_commands": 0.10579914569854736, "deviation-center-line": 1.0703461526822913, "driven_lanedir_consec": 2.793613220206473, "sim_compute_sim_state": 0.04399078528086344, "sim_compute_performance-ego": 0.07718995173772177, "sim_compute_robot_state-ego": 0.08627924283345541, "sim_compute_robot_state-npc0": 0.0758350404103597, "sim_compute_robot_state-npc1": 0.0773648190498352, "sim_compute_robot_state-npc2": 0.075952840646108, "sim_compute_robot_state-npc3": 0.07894600629806518}}
set_robot_commands_max0.1068045210838318
set_robot_commands_mean0.1062969938769485
set_robot_commands_median0.1063176003369418
set_robot_commands_min0.10579914569854736
sim_compute_performance-ego_max0.0781190053621928
sim_compute_performance-ego_mean0.07719161131887725
sim_compute_performance-ego_median0.07718995173772177
sim_compute_performance-ego_min0.07648711854761298
sim_compute_robot_state-ego_max0.08627924283345541
sim_compute_robot_state-ego_mean0.084540543050477
sim_compute_robot_state-ego_median0.08431519985198975
sim_compute_robot_state-ego_min0.0835545555750529
sim_compute_robot_state-npc0_max0.07702276786168416
sim_compute_robot_state-npc0_mean0.07608696706367261
sim_compute_robot_state-npc0_median0.0758350404103597
sim_compute_robot_state-npc0_min0.07572415308518843
sim_compute_robot_state-npc1_max0.07762555996576945
sim_compute_robot_state-npc1_mean0.07706625348871404
sim_compute_robot_state-npc1_median0.0773648190498352
sim_compute_robot_state-npc1_min0.07616001042452726
sim_compute_robot_state-npc2_max0.07673397541046142
sim_compute_robot_state-npc2_mean0.07615996735023729
sim_compute_robot_state-npc2_median0.07601592107252642
sim_compute_robot_state-npc2_min0.075952840646108
sim_compute_robot_state-npc3_max0.07894600629806518
sim_compute_robot_state-npc3_mean0.07752181554563117
sim_compute_robot_state-npc3_median0.07744711875915528
sim_compute_robot_state-npc3_min0.07658392949537797
sim_compute_sim_state_max0.04399078528086344
sim_compute_sim_state_mean0.043807135755365545
sim_compute_sim_state_median0.04385519027709961
sim_compute_sim_state_min0.04358957370122274
sim_physics_max0.2454529025337913
sim_physics_mean0.2312461328939958
sim_physics_median0.2288533107439677
sim_physics_min0.22278572082519532
sim_render-ego_max0.06972376585006713
sim_render-ego_mean0.06919253933068478
sim_render-ego_median0.06916746457417806
sim_render-ego_min0.06853847720406273
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.06000000000006
survival_time_min5.4999999999999885
No reset possible
222793451Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LFVI-sim-testingstep1-simulationsuccessyesip-172-31-25-98-20621 day, 3:19:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1317247195560296
survival_time_median1.2000000000000004
deviation-center-line_median0.08219741260720093
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19950543279233185
agent_compute-ego_mean0.1763837269267964
agent_compute-ego_median0.17473216678785242
agent_compute-ego_min0.155516117811203
deviation-center-line_max0.10874511587508642
deviation-center-line_mean0.08196673190175716
deviation-center-line_min0.05450527989714526
deviation-heading_max1.043446309902138
deviation-heading_mean0.6490692517310723
deviation-heading_median0.6207274979603687
deviation-heading_min0.3871094061896044
driven_any_max0.22513974380271376
driven_any_mean0.1832224902222035
driven_any_median0.18092412770527097
driven_any_min0.13785092191593512
driven_lanedir_consec_max0.1880336480956033
driven_lanedir_consec_mean0.13180919145897158
driven_lanedir_consec_min0.08709328988171317
driven_lanedir_max0.1880336480956033
driven_lanedir_mean0.13180919145897158
driven_lanedir_median0.1317247195560296
driven_lanedir_min0.08709328988171317
in-drivable-lane_max0.10000000000000007
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21144547635499517, "sim_physics": 0.134416284232304, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1149933839599302, "sim_render-ego": 0.06498557123644598, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.17311444775811555, "deviation-heading": 0.8455486636297789, "set_robot_commands": 0.10413991171738196, "deviation-center-line": 0.0795661226721915, "driven_lanedir_consec": 0.1149933839599302, "sim_compute_sim_state": 0.04205916667806691, "sim_compute_performance-ego": 0.07460678856948326, "sim_compute_robot_state-ego": 0.08146840950538373}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.22513974380271376, "sim_physics": 0.11949340228376716, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16995810382023002, "sim_render-ego": 0.07015871179514918, "in-drivable-lane": 0, "agent_compute-ego": 0.16821896618810192, "deviation-heading": 0.6964549513411711, "set_robot_commands": 0.09858209511329388, "deviation-center-line": 0.060336190314394134, "driven_lanedir_consec": 0.16995810382023002, "sim_compute_sim_state": 0.04392915758593329, "sim_compute_performance-ego": 0.07463755278751769, "sim_compute_robot_state-ego": 0.0777187676265322}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.14039173313718936, "sim_physics": 0.1276695489883423, "survival_time": 1.0000000000000002, "driven_lanedir": 0.1147306251109037, "sim_render-ego": 0.0744513988494873, "in-drivable-lane": 0, "agent_compute-ego": 0.17244404554367063, "deviation-heading": 0.4682065072307927, "set_robot_commands": 0.0996333599090576, "deviation-center-line": 0.09309165757060582, "driven_lanedir_consec": 0.1147306251109037, "sim_compute_sim_state": 0.03888068199157715, "sim_compute_performance-ego": 0.07602386474609375, "sim_compute_robot_state-ego": 0.07344135046005248}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.19904184253842572, "sim_physics": 0.1474221394612239, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1215258592667543, "sim_render-ego": 0.0651017977641179, "in-drivable-lane": 0, "agent_compute-ego": 0.1866267461043138, "deviation-heading": 0.9365957134629656, "set_robot_commands": 0.10652822714585523, "deviation-center-line": 0.08219741260720093, "driven_lanedir_consec": 0.1215258592667543, "sim_compute_sim_state": 0.042626839417677656, "sim_compute_performance-ego": 0.07170677185058594, "sim_compute_robot_state-ego": 0.08216584645784818}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20236939074943683, "sim_physics": 0.13077763148716515, "survival_time": 1.4000000000000006, "driven_lanedir": 0.13332094890615176, "sim_render-ego": 0.06200741018567767, "in-drivable-lane": 0, "agent_compute-ego": 0.1754660521234785, "deviation-heading": 0.7791666213835622, "set_robot_commands": 0.0986676812171936, "deviation-center-line": 0.06774697377501501, "driven_lanedir_consec": 0.13332094890615176, "sim_compute_sim_state": 0.03976692472185407, "sim_compute_performance-ego": 0.07007219110216413, "sim_compute_robot_state-ego": 0.08717591421944755}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.18558983928566128, "sim_physics": 0.13759985676518194, "survival_time": 1.3500000000000003, "driven_lanedir": 0.08709328988171317, "sim_render-ego": 0.0650031566619873, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1882912141305429, "deviation-heading": 1.043446309902138, "set_robot_commands": 0.1043891465222394, "deviation-center-line": 0.0832105065294193, "driven_lanedir_consec": 0.08709328988171317, "sim_compute_sim_state": 0.042913631156638814, "sim_compute_performance-ego": 0.07328124399538394, "sim_compute_robot_state-ego": 0.09133773379855686}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.21979194466512147, "sim_physics": 0.12346588240729438, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1880336480956033, "sim_render-ego": 0.06104420732568811, "in-drivable-lane": 0, "agent_compute-ego": 0.16531780914024072, "deviation-heading": 0.5035295189025206, "set_robot_commands": 0.09853946721112286, "deviation-center-line": 0.09971525892844232, "driven_lanedir_consec": 0.1880336480956033, "sim_compute_sim_state": 0.04014846130653664, "sim_compute_performance-ego": 0.07165067284195512, "sim_compute_robot_state-ego": 0.07640705285248933}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.13785092191593512, "sim_physics": 0.1228772799173991, "survival_time": 1.0500000000000005, "driven_lanedir": 0.10661007917337972, "sim_render-ego": 0.06552985736301967, "in-drivable-lane": 0, "agent_compute-ego": 0.1743201187678746, "deviation-heading": 0.537341426507484, "set_robot_commands": 0.09515164012000674, "deviation-center-line": 0.09497472892056848, "driven_lanedir_consec": 0.10661007917337972, "sim_compute_sim_state": 0.04209327697753906, "sim_compute_performance-ego": 0.07645890826270693, "sim_compute_robot_state-ego": 0.0766503129686628}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.18092412770527097, "sim_physics": 0.1102622350056966, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13435477171734345, "sim_render-ego": 0.07035765051841736, "in-drivable-lane": 0, "agent_compute-ego": 0.155516117811203, "deviation-heading": 0.6343910160964921, "set_robot_commands": 0.09647703170776369, "deviation-center-line": 0.058895015067796035, "driven_lanedir_consec": 0.13435477171734345, "sim_compute_sim_state": 0.035924394925435386, "sim_compute_performance-ego": 0.07409522930781047, "sim_compute_robot_state-ego": 0.07337417205174764}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.17829242430516715, "sim_physics": 0.14589247107505798, "survival_time": 1.2000000000000004, "driven_lanedir": 0.14639798739221188, "sim_render-ego": 0.06629124283790588, "in-drivable-lane": 0, "agent_compute-ego": 0.1797172725200653, "deviation-heading": 0.48934239709722344, "set_robot_commands": 0.1006387968858083, "deviation-center-line": 0.0893602556794193, "driven_lanedir_consec": 0.14639798739221188, "sim_compute_sim_state": 0.04245083530743917, "sim_compute_performance-ego": 0.07598427931467693, "sim_compute_robot_state-ego": 0.08503056565920512}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.16675531132819932, "sim_physics": 0.13131019343500552, "survival_time": 1.1500000000000004, "driven_lanedir": 0.14040102251373765, "sim_render-ego": 0.06817243410193402, "in-drivable-lane": 0, "agent_compute-ego": 0.17473216678785242, "deviation-heading": 0.4040006648846207, "set_robot_commands": 0.0962252720542576, "deviation-center-line": 0.10232664611229636, "driven_lanedir_consec": 0.14040102251373765, "sim_compute_sim_state": 0.03753533570662789, "sim_compute_performance-ego": 0.06960942434227985, "sim_compute_robot_state-ego": 0.07806934481081755}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.1628716302324742, "sim_physics": 0.12985611955324808, "survival_time": 1.2000000000000004, "driven_lanedir": 0.1234560399039184, "sim_render-ego": 0.06669386227925618, "in-drivable-lane": 0, "agent_compute-ego": 0.1806055506070455, "deviation-heading": 0.5999740450023605, "set_robot_commands": 0.1009304920832316, "deviation-center-line": 0.07592479116884888, "driven_lanedir_consec": 0.1234560399039184, "sim_compute_sim_state": 0.04205312331517538, "sim_compute_performance-ego": 0.07415571808815002, "sim_compute_robot_state-ego": 0.0743969480196635}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.21497161987450683, "sim_physics": 0.12993087938853673, "survival_time": 1.4000000000000006, "driven_lanedir": 0.14501510747910262, "sim_render-ego": 0.06740431274686541, "in-drivable-lane": 0, "agent_compute-ego": 0.19121262005397252, "deviation-heading": 0.7902040363750013, "set_robot_commands": 0.10540298904691424, "deviation-center-line": 0.07890502340792738, "driven_lanedir_consec": 0.14501510747910262, "sim_compute_sim_state": 0.04113846165793283, "sim_compute_performance-ego": 0.07986786535808019, "sim_compute_robot_state-ego": 0.07997236933026995}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.17824839539338774, "sim_physics": 0.13125137660814368, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1317247195560296, "sim_render-ego": 0.06866917402847954, "in-drivable-lane": 0, "agent_compute-ego": 0.19950543279233185, "deviation-heading": 0.6207274979603687, "set_robot_commands": 0.11230751742487367, "deviation-center-line": 0.05450527989714526, "driven_lanedir_consec": 0.1317247195560296, "sim_compute_sim_state": 0.04549811197363812, "sim_compute_performance-ego": 0.08178650814553966, "sim_compute_robot_state-ego": 0.09314962055372156}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.1446529520445679, "sim_physics": 0.12060046195983888, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11952228510756369, "sim_render-ego": 0.05993525548414751, "in-drivable-lane": 0, "agent_compute-ego": 0.16066734357313675, "deviation-heading": 0.3871094061896044, "set_robot_commands": 0.0966865908015858, "deviation-center-line": 0.10874511587508642, "driven_lanedir_consec": 0.11952228510756369, "sim_compute_sim_state": 0.04177707975560969, "sim_compute_performance-ego": 0.06442558765411377, "sim_compute_robot_state-ego": 0.07764403386549516}}
set_robot_commands_max0.11230751742487367
set_robot_commands_mean0.10095334793070572
set_robot_commands_median0.0996333599090576
set_robot_commands_min0.09515164012000674
sim_compute_performance-ego_max0.08178650814553966
sim_compute_performance-ego_mean0.0738908404244361
sim_compute_performance-ego_median0.07415571808815002
sim_compute_performance-ego_min0.06442558765411377
sim_compute_robot_state-ego_max0.09314962055372156
sim_compute_robot_state-ego_mean0.08053349614532625
sim_compute_robot_state-ego_median0.07806934481081755
sim_compute_robot_state-ego_min0.07337417205174764
sim_compute_sim_state_max0.04549811197363812
sim_compute_sim_state_mean0.0412530321651788
sim_compute_sim_state_median0.04205312331517538
sim_compute_sim_state_min0.035924394925435386
sim_physics_max0.1474221394612239
sim_physics_mean0.12952171750454702
sim_physics_median0.12993087938853673
sim_physics_min0.1102622350056966
sim_render-ego_max0.0744513988494873
sim_render-ego_mean0.06638706954523861
sim_render-ego_median0.06629124283790588
sim_render-ego_min0.05993525548414751
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.2500000000000009
survival_time_min1.0000000000000002
No reset possible
222452711Rami Al-Naim 🇷🇺challenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryesip-172-31-25-98-20621:00:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222352865Alexander Karavaevchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:09:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222313501Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationerroryesip-172-31-25-98-20620:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible