AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1174

evaluator1174
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2348
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success20
# timeout
# failed2
# error25
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors90%
RAM total (MB)60.0 GB
RAM free (MB)56.2 GB
Disk (MB)96.9 GB
Disk available (MB)47.4 GB
Docker Hub
P11
P2
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230723554AmaurXRunning the real lane following -- without challenge containeraido2-LFV-sim-validationstep1-simulationerroryes11740:07:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
230523548enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11740:15:26(hidden)
driven_lanedir_consec_median0
survival_time_median14.950000000000076
deviation-center-line_median0.4944945349285404
in-drivable-lane_median7.050000000000072


other stats
agent_compute-ego_max0.10504728635152182
agent_compute-ego_mean0.103598064104716
agent_compute-ego_median0.103477942943573
agent_compute-ego_min0.10187084674835203
deviation-center-line_max0.8791250519425075
deviation-center-line_mean0.44763369492900534
deviation-center-line_min0.14582877424072369
deviation-heading_max17.22642654382171
deviation-heading_mean6.424253550835585
deviation-heading_median3.47447884068374
deviation-heading_min2.8124379744908925
driven_any_max0.940692055491246
driven_any_mean0.1995662017159223
driven_any_median5.796408514446573e-14
driven_any_min4.9480879556867655e-14
driven_lanedir_consec_max0.4343165155064953
driven_lanedir_consec_mean0.0979325807778696
driven_lanedir_consec_min0
driven_lanedir_max0.4651881591161454
driven_lanedir_mean0.10410690949979962
driven_lanedir_median0
driven_lanedir_min0
in-drivable-lane_max10.850000000000083
in-drivable-lane_mean6.780000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.05713895308820663, "sim_physics": 0.06469975471496582, "survival_time": 14.950000000000076, "driven_lanedir": 0.05534638838285266, "sim_render-ego": 0.039441780249277754, "in-drivable-lane": 6.450000000000092, "agent_compute-ego": 0.10504728635152182, "deviation-heading": 3.4463286844259757, "set_robot_commands": 0.05747942924499512, "deviation-center-line": 0.5669722123144191, "driven_lanedir_consec": 0.05534638838285266, "sim_compute_sim_state": 0.02531776348749797, "sim_compute_performance-ego": 0.04273385445276896, "sim_compute_robot_state-ego": 0.044273540178934735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.940692055491246, "sim_physics": 0.06229474385579427, "survival_time": 14.950000000000076, "driven_lanedir": 0.4651881591161454, "sim_render-ego": 0.038777933915456135, "in-drivable-lane": 9.550000000000068, "agent_compute-ego": 0.10447086731592814, "deviation-heading": 3.47447884068374, "set_robot_commands": 0.05682178815205892, "deviation-center-line": 0.15174790121883605, "driven_lanedir_consec": 0.4343165155064953, "sim_compute_sim_state": 0.025198742548624673, "sim_compute_performance-ego": 0.042150410016377766, "sim_compute_robot_state-ego": 0.04364627043406168}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9480879556867655e-14, "sim_physics": 0.05656328837076823, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03778050502141317, "in-drivable-lane": 0, "agent_compute-ego": 0.10187084674835203, "deviation-heading": 17.22642654382171, "set_robot_commands": 0.05742614189783732, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02503937562306722, "sim_compute_performance-ego": 0.0416910441716512, "sim_compute_robot_state-ego": 0.04357919216156006}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.1316294581885615e-14, "sim_physics": 0.06163030544916789, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03877824306488037, "in-drivable-lane": 7.050000000000072, "agent_compute-ego": 0.103477942943573, "deviation-heading": 5.161595710755609, "set_robot_commands": 0.05727466344833374, "deviation-center-line": 0.4944945349285404, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025107709566752116, "sim_compute_performance-ego": 0.04218491792678833, "sim_compute_robot_state-ego": 0.04373698393503825}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.796408514446573e-14, "sim_physics": 0.06360384464263916, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.0382793402671814, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.10312337716420492, "deviation-heading": 2.8124379744908925, "set_robot_commands": 0.05667584339777629, "deviation-center-line": 0.14582877424072369, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025067140261332194, "sim_compute_performance-ego": 0.04186038494110107, "sim_compute_robot_state-ego": 0.043358910083770755}}
set_robot_commands_max0.05747942924499512
set_robot_commands_mean0.05713557322820027
set_robot_commands_median0.05727466344833374
set_robot_commands_min0.05667584339777629
sim_compute_performance-ego_max0.04273385445276896
sim_compute_performance-ego_mean0.04212412230173747
sim_compute_performance-ego_median0.042150410016377766
sim_compute_performance-ego_min0.0416910441716512
sim_compute_robot_state-ego_max0.044273540178934735
sim_compute_robot_state-ego_mean0.043718979358673096
sim_compute_robot_state-ego_median0.04364627043406168
sim_compute_robot_state-ego_min0.043358910083770755
sim_compute_sim_state_max0.02531776348749797
sim_compute_sim_state_mean0.025146146297454836
sim_compute_sim_state_median0.025107709566752116
sim_compute_sim_state_min0.02503937562306722
sim_physics_max0.06469975471496582
sim_physics_mean0.06175838740666708
sim_physics_median0.06229474385579427
sim_physics_min0.05656328837076823
sim_render-ego_max0.039441780249277754
sim_render-ego_mean0.03861156050364176
sim_render-ego_median0.038777933915456135
sim_render-ego_min0.03778050502141317
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
230302366Andrea Censirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessyes11740:24:52(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16246684959956578
agent_compute-ego_mean0.1193457550406858
agent_compute-ego_median0.11584102023731578
agent_compute-ego_min0.0816840070944566
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.24855565119393264, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06925922104074986, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.155336527884761, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10752986352654952, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04359757749340202, "sim_compute_performance-ego": 0.07697745214534711, "sim_compute_robot_state-ego": 0.08291390274144426, "sim_compute_robot_state-npc0": 0.07685048670708379, "sim_compute_robot_state-npc1": 0.07677476617354381, "sim_compute_robot_state-npc2": 0.07438194600841667, "sim_compute_robot_state-npc3": 0.07647331455085851}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2497809018407549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.07189416885375977, "in-drivable-lane": 0, "agent_compute-ego": 0.16246684959956578, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10845349516187396, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04594646181379046, "sim_compute_performance-ego": 0.07773692267281669, "sim_compute_robot_state-ego": 0.0905194708279201, "sim_compute_robot_state-npc0": 0.07805607148579188, "sim_compute_robot_state-npc1": 0.08239365475518363, "sim_compute_robot_state-npc2": 0.07980709416525704, "sim_compute_robot_state-npc3": 0.07643545525414604}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18134581926956916, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05972729145901874, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.12698824891766297, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0858080988948785, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03874928974410863, "sim_compute_performance-ego": 0.06571476204881391, "sim_compute_robot_state-ego": 0.06663452305840058, "sim_compute_robot_state-npc0": 0.0656357228177265, "sim_compute_robot_state-npc1": 0.06356838605936291, "sim_compute_robot_state-npc2": 0.06600616742106317, "sim_compute_robot_state-npc3": 0.06525416744565501}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2482065757115682, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06695430974165599, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14053413271903992, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10042938093344372, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04281287888685862, "sim_compute_performance-ego": 0.0750250518321991, "sim_compute_robot_state-ego": 0.08010945717493693, "sim_compute_robot_state-npc0": 0.07606008152167003, "sim_compute_robot_state-npc1": 0.08567437529563904, "sim_compute_robot_state-npc2": 0.08693686624368031, "sim_compute_robot_state-npc3": 0.07538183530171712}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2506513936179025, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0698632626306443, "in-drivable-lane": 0, "agent_compute-ego": 0.15233826637268066, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10605581601460774, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04399532363528297, "sim_compute_performance-ego": 0.07691823868524461, "sim_compute_robot_state-ego": 0.08187186150323778, "sim_compute_robot_state-npc0": 0.07834412938072569, "sim_compute_robot_state-npc1": 0.0800840173448835, "sim_compute_robot_state-npc2": 0.07827677045549665, "sim_compute_robot_state-npc3": 0.07187821751549131}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.1636652675217497, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05409811642355548, "in-drivable-lane": 2, "agent_compute-ego": 0.11723034396143016, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.08138465310285191, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03422128511760049, "sim_compute_performance-ego": 0.0591054776471532, "sim_compute_robot_state-ego": 0.061902017650490034, "sim_compute_robot_state-npc0": 0.06106009169253047, "sim_compute_robot_state-npc1": 0.0603737174393888, "sim_compute_robot_state-npc2": 0.05882169386583888, "sim_compute_robot_state-npc3": 0.05787203126324865}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.17167812643699276, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05149866076349055, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.11002605864145223, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.07634600389350965, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03224121019678208, "sim_compute_performance-ego": 0.056757017246727805, "sim_compute_robot_state-ego": 0.05930232770234636, "sim_compute_robot_state-npc0": 0.0569587749184914, "sim_compute_robot_state-npc1": 0.0559333157770842, "sim_compute_robot_state-npc2": 0.055721366289749885, "sim_compute_robot_state-npc3": 0.05531118679972528}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.17299080848693849, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.051539006233215334, "in-drivable-lane": 0, "agent_compute-ego": 0.1100844383239746, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07611077308654784, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.031402487754821774, "sim_compute_performance-ego": 0.05753192901611328, "sim_compute_robot_state-ego": 0.06577604293823242, "sim_compute_robot_state-npc0": 0.05519410610198974, "sim_compute_robot_state-npc1": 0.05492759227752685, "sim_compute_robot_state-npc2": 0.05492892742156982, "sim_compute_robot_state-npc3": 0.055024819374084474}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1528076850450956, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05063549830363347, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1097752176798307, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.07505703889406644, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03255288876019991, "sim_compute_performance-ego": 0.05739063024520874, "sim_compute_robot_state-ego": 0.0626486402291518, "sim_compute_robot_state-npc0": 0.05478745240431566, "sim_compute_robot_state-npc1": 0.05652853617301354, "sim_compute_robot_state-npc2": 0.055612646616422214, "sim_compute_robot_state-npc3": 0.05676229641987728}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.1954207053551307, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.051992443891671986, "in-drivable-lane": 0, "agent_compute-ego": 0.1213149199118981, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07735528395726131, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0335764243052556, "sim_compute_performance-ego": 0.057682459171001725, "sim_compute_robot_state-ego": 0.06005234901721661, "sim_compute_robot_state-npc0": 0.05679120467259334, "sim_compute_robot_state-npc1": 0.059519327603853665, "sim_compute_robot_state-npc2": 0.056780035679156966, "sim_compute_robot_state-npc3": 0.05792041925283579}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.17329116301103073, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.051693081855773926, "in-drivable-lane": 0, "agent_compute-ego": 0.11584102023731578, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07827983119271019, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03320745988325639, "sim_compute_performance-ego": 0.06003393910147927, "sim_compute_robot_state-ego": 0.06028139591217041, "sim_compute_robot_state-npc0": 0.05778358199379661, "sim_compute_robot_state-npc1": 0.06072930856184526, "sim_compute_robot_state-npc2": 0.056870070370760833, "sim_compute_robot_state-npc3": 0.056995695287531074}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.14803444862365722, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05113977909088135, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10650689601898192, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.07351184844970703, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03309750556945801, "sim_compute_performance-ego": 0.05565319061279297, "sim_compute_robot_state-ego": 0.059306068420410155, "sim_compute_robot_state-npc0": 0.05434576988220215, "sim_compute_robot_state-npc1": 0.05825599670410156, "sim_compute_robot_state-npc2": 0.05735128402709961, "sim_compute_robot_state-npc3": 0.05626834392547608}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.13596351603244214, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.044710098428929104, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.09815599056000406, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.06760663428205124, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.02883693258813087, "sim_compute_performance-ego": 0.04965711147227186, "sim_compute_robot_state-ego": 0.050647598631838535, "sim_compute_robot_state-npc0": 0.049829566732366035, "sim_compute_robot_state-npc1": 0.04851810982886781, "sim_compute_robot_state-npc2": 0.04774807361846275, "sim_compute_robot_state-npc3": 0.04942530013145285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10993269773629996, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03860729015790499, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0816840070944566, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.057307926508096546, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.024158060550689697, "sim_compute_performance-ego": 0.04162236818900475, "sim_compute_robot_state-ego": 0.043001807652986966, "sim_compute_robot_state-npc0": 0.0423891544342041, "sim_compute_robot_state-npc1": 0.04213312039008507, "sim_compute_robot_state-npc2": 0.04177883038154015, "sim_compute_robot_state-npc3": 0.04189970860114464}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1073713189079648, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03809627578372047, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0819034076872326, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05665628569466727, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02411738123212542, "sim_compute_performance-ego": 0.04171615101042248, "sim_compute_robot_state-ego": 0.04335651851835705, "sim_compute_robot_state-npc0": 0.042714623042515346, "sim_compute_robot_state-npc1": 0.04189298493521554, "sim_compute_robot_state-npc2": 0.04327527227855864, "sim_compute_robot_state-npc3": 0.04199775060017904}}
set_robot_commands_max0.10845349516187396
set_robot_commands_mean0.08185952890618818
set_robot_commands_median0.07735528395726131
set_robot_commands_min0.05665628569466727
sim_compute_performance-ego_max0.07773692267281669
sim_compute_performance-ego_mean0.06063484673977316
sim_compute_performance-ego_median0.057682459171001725
sim_compute_performance-ego_min0.04162236818900475
sim_compute_robot_state-ego_max0.0905194708279201
sim_compute_robot_state-ego_mean0.06455493213194267
sim_compute_robot_state-ego_median0.061902017650490034
sim_compute_robot_state-ego_min0.043001807652986966
sim_compute_robot_state-npc0_max0.07834412938072569
sim_compute_robot_state-npc0_mean0.06045338785253353
sim_compute_robot_state-npc0_median0.0569587749184914
sim_compute_robot_state-npc0_min0.0423891544342041
sim_compute_robot_state-npc1_max0.08567437529563904
sim_compute_robot_state-npc1_mean0.06182048062130636
sim_compute_robot_state-npc1_median0.059519327603853665
sim_compute_robot_state-npc1_min0.04189298493521554
sim_compute_robot_state-npc2_max0.08693686624368031
sim_compute_robot_state-npc2_mean0.06095313632287159
sim_compute_robot_state-npc2_median0.056870070370760833
sim_compute_robot_state-npc2_min0.04177883038154015
sim_compute_robot_state-npc3_max0.07647331455085851
sim_compute_robot_state-npc3_mean0.059660036114894885
sim_compute_robot_state-npc3_median0.056995695287531074
sim_compute_robot_state-npc3_min0.04189970860114464
sim_compute_sim_state_max0.04594646181379046
sim_compute_sim_state_mean0.03483421116878419
sim_compute_sim_state_median0.03320745988325639
sim_compute_sim_state_min0.02411738123212542
sim_physics_max0.2506513936179025
sim_physics_mean0.1806464052527353
sim_physics_median0.17299080848693849
sim_physics_min0.1073713189079648
sim_render-ego_max0.07189416885375977
sim_render-ego_mean0.054780566977240354
sim_render-ego_median0.051693081855773926
sim_render-ego_min0.03809627578372047
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
230062399Liam Paullrandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessyes11740:31:35(hidden)
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15876758098602295
agent_compute-ego_mean0.14293282439578114
agent_compute-ego_median0.1440584109379695
agent_compute-ego_min0.1151271915435791
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20626541330844544, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06594670573367348, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14196757123440126, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0992590294608587, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.041479747506636605, "sim_compute_performance-ego": 0.0735602107229112, "sim_compute_robot_state-ego": 0.077212246158455, "sim_compute_robot_state-npc0": 0.07337225841570504, "sim_compute_robot_state-npc1": 0.07369668272477162, "sim_compute_robot_state-npc2": 0.07147967060909996, "sim_compute_robot_state-npc3": 0.07265432273285298}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22035236018044607, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06974882738930839, "in-drivable-lane": 0, "agent_compute-ego": 0.145516642502376, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10073697566986084, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04100521121706281, "sim_compute_performance-ego": 0.07501309258597237, "sim_compute_robot_state-ego": 0.08231098311288017, "sim_compute_robot_state-npc0": 0.0733947583607265, "sim_compute_robot_state-npc1": 0.07568772350038801, "sim_compute_robot_state-npc2": 0.07574936321803502, "sim_compute_robot_state-npc3": 0.07293503625052315}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20772280970823415, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0656303040032248, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14655368999370094, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10222257688207534, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04199059032699437, "sim_compute_performance-ego": 0.07207248974772333, "sim_compute_robot_state-ego": 0.07805474522044357, "sim_compute_robot_state-npc0": 0.07522412874166248, "sim_compute_robot_state-npc1": 0.07403288767175767, "sim_compute_robot_state-npc2": 0.07594718979400339, "sim_compute_robot_state-npc3": 0.07651922772231612}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22813271482785544, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06932537754376729, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14405137300491333, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.1019674688577652, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0439109206199646, "sim_compute_performance-ego": 0.07799484829107921, "sim_compute_robot_state-ego": 0.0845315009355545, "sim_compute_robot_state-npc0": 0.07607050736745198, "sim_compute_robot_state-npc1": 0.0799860308567683, "sim_compute_robot_state-npc2": 0.07520255446434021, "sim_compute_robot_state-npc3": 0.07673073808352153}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2287416003999256, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06448833147684734, "in-drivable-lane": 0, "agent_compute-ego": 0.14127262433369955, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09856789452689034, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03860307875133696, "sim_compute_performance-ego": 0.07259783290681385, "sim_compute_robot_state-ego": 0.07726267405918666, "sim_compute_robot_state-npc0": 0.06956986018589564, "sim_compute_robot_state-npc1": 0.06954545066470191, "sim_compute_robot_state-npc2": 0.06976372855050224, "sim_compute_robot_state-npc3": 0.07365500359308153}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18436753535698988, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05926522523343206, "in-drivable-lane": 2, "agent_compute-ego": 0.13025375326236566, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10806677726928346, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03711533118150905, "sim_compute_performance-ego": 0.06542824271196376, "sim_compute_robot_state-ego": 0.06983515316854694, "sim_compute_robot_state-npc0": 0.07241665246243963, "sim_compute_robot_state-npc1": 0.06629533967572059, "sim_compute_robot_state-npc2": 0.06493125561468616, "sim_compute_robot_state-npc3": 0.06582438017793758}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.23764921855000615, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06820001648467722, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14662952793454662, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10414145293745022, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.045311680117857106, "sim_compute_performance-ego": 0.07453934891710004, "sim_compute_robot_state-ego": 0.08282894532657364, "sim_compute_robot_state-npc0": 0.07616148874597642, "sim_compute_robot_state-npc1": 0.07561011916225396, "sim_compute_robot_state-npc2": 0.0754710285408983, "sim_compute_robot_state-npc3": 0.07262817169856099}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.179863600730896, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.05415925979614258, "in-drivable-lane": 0, "agent_compute-ego": 0.1151271915435791, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07557839870452882, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03163711547851562, "sim_compute_performance-ego": 0.05862809658050537, "sim_compute_robot_state-ego": 0.06090038776397705, "sim_compute_robot_state-npc0": 0.058478655815124514, "sim_compute_robot_state-npc1": 0.056223664283752445, "sim_compute_robot_state-npc2": 0.05600606918334961, "sim_compute_robot_state-npc3": 0.05435097694396973}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2190061578383813, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06777447920579177, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1440584109379695, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09895107837823722, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04265966782203087, "sim_compute_performance-ego": 0.06933384675246018, "sim_compute_robot_state-ego": 0.0777853222993704, "sim_compute_robot_state-npc0": 0.07461893558502197, "sim_compute_robot_state-npc1": 0.07395915343211247, "sim_compute_robot_state-npc2": 0.07393068533677322, "sim_compute_robot_state-npc3": 0.07510991279895489}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2494822465456449, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06347837814917931, "in-drivable-lane": 0, "agent_compute-ego": 0.13733465854938215, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09392273426055908, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0423206457724938, "sim_compute_performance-ego": 0.07274389266967773, "sim_compute_robot_state-ego": 0.07532570912287785, "sim_compute_robot_state-npc0": 0.07314827808967003, "sim_compute_robot_state-npc1": 0.0700080944941594, "sim_compute_robot_state-npc2": 0.07061399863316463, "sim_compute_robot_state-npc3": 0.07735259716327374}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2679245580326427, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06800353527069092, "in-drivable-lane": 0, "agent_compute-ego": 0.15876758098602295, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10603215477683328, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04313578388907693, "sim_compute_performance-ego": 0.07728669860146263, "sim_compute_robot_state-ego": 0.0904348763552579, "sim_compute_robot_state-npc0": 0.08036056431857022, "sim_compute_robot_state-npc1": 0.07386553287506104, "sim_compute_robot_state-npc2": 0.07739199291576039, "sim_compute_robot_state-npc3": 0.07732458548112349}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1980842113494873, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06905413150787354, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15138526916503903, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.1003742742538452, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04120028018951416, "sim_compute_performance-ego": 0.07182169437408448, "sim_compute_robot_state-ego": 0.07537510395050048, "sim_compute_robot_state-npc0": 0.0726310920715332, "sim_compute_robot_state-npc1": 0.0705941915512085, "sim_compute_robot_state-npc2": 0.07229021072387695, "sim_compute_robot_state-npc3": 0.07254035949707031}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2251405436941918, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06546889213805503, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1431552197070832, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.1028529684594337, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04235585699690149, "sim_compute_performance-ego": 0.07649892949043437, "sim_compute_robot_state-ego": 0.08129870891571045, "sim_compute_robot_state-npc0": 0.07577622444071669, "sim_compute_robot_state-npc1": 0.07417083547470417, "sim_compute_robot_state-npc2": 0.07365939718611697, "sim_compute_robot_state-npc3": 0.07655607385838285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.23385420670876136, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06769793308698215, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1496557639195369, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10504039434286264, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04383929417683528, "sim_compute_performance-ego": 0.07194500244580783, "sim_compute_robot_state-ego": 0.08143355296208309, "sim_compute_robot_state-npc0": 0.07207691210966843, "sim_compute_robot_state-npc1": 0.07369835560138409, "sim_compute_robot_state-npc2": 0.0762828909433805, "sim_compute_robot_state-npc3": 0.07908960030629085}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.2164903618040539, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06617939585731143, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.14826308886210124, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.099482942762829, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04352556637355259, "sim_compute_performance-ego": 0.07354088964916411, "sim_compute_robot_state-ego": 0.0787614073072161, "sim_compute_robot_state-npc0": 0.07414175215221587, "sim_compute_robot_state-npc1": 0.07405749502636137, "sim_compute_robot_state-npc2": 0.07363930883861723, "sim_compute_robot_state-npc3": 0.07504286538986933}}
set_robot_commands_max0.10806677726928346
set_robot_commands_mean0.09981314143622086
set_robot_commands_median0.10073697566986084
set_robot_commands_min0.07557839870452882
sim_compute_performance-ego_max0.07799484829107921
sim_compute_performance-ego_mean0.07220034109647736
sim_compute_performance-ego_median0.07274389266967773
sim_compute_performance-ego_min0.05862809658050537
sim_compute_robot_state-ego_max0.0904348763552579
sim_compute_robot_state-ego_mean0.07822342111057559
sim_compute_robot_state-ego_median0.07805474522044357
sim_compute_robot_state-ego_min0.06090038776397705
sim_compute_robot_state-npc0_max0.08036056431857022
sim_compute_robot_state-npc0_mean0.07316280459082525
sim_compute_robot_state-npc0_median0.0733947583607265
sim_compute_robot_state-npc0_min0.058478655815124514
sim_compute_robot_state-npc1_max0.0799860308567683
sim_compute_robot_state-npc1_mean0.07209543713300702
sim_compute_robot_state-npc1_median0.07386553287506104
sim_compute_robot_state-npc1_min0.056223664283752445
sim_compute_robot_state-npc2_max0.07739199291576039
sim_compute_robot_state-npc2_mean0.07215728963684032
sim_compute_robot_state-npc2_median0.07365939718611697
sim_compute_robot_state-npc2_min0.05600606918334961
sim_compute_robot_state-npc3_max0.07908960030629085
sim_compute_robot_state-npc3_mean0.07322092344651526
sim_compute_robot_state-npc3_median0.07504286538986933
sim_compute_robot_state-npc3_min0.05435097694396973
sim_compute_sim_state_max0.045311680117857106
sim_compute_sim_state_mean0.04133938469468548
sim_compute_sim_state_median0.0423206457724938
sim_compute_sim_state_min0.03163711547851562
sim_physics_max0.2679245580326427
sim_physics_mean0.2202051692690641
sim_physics_median0.22035236018044607
sim_physics_min0.179863600730896
sim_render-ego_max0.06974882738930839
sim_render-ego_mean0.06562805285846383
sim_render-ego_median0.06617939585731143
sim_render-ego_min0.05415925979614258
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
229922411jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerroryes11740:14:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
229762439Jacopo Tanirandom_agentaido2-LF-sim-testingstep1-simulationsuccessyes11740:17:57(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17153480093357926
agent_compute-ego_mean0.15994833883477627
agent_compute-ego_median0.16326524939718126
agent_compute-ego_min0.1384088611602783
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12631387180752224, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06712950159002233, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1644989252090454, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10631742300810636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04115618158269812, "sim_compute_performance-ego": 0.07472935870841697, "sim_compute_robot_state-ego": 0.08111846888506855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1221773671168907, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06768632402607039, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15916667265050552, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10033033875858084, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04103759690827014, "sim_compute_performance-ego": 0.07585726999769024, "sim_compute_robot_state-ego": 0.0785357063891841}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15712631449979894, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06914068670833812, "in-drivable-lane": 0, "agent_compute-ego": 0.1585093806771671, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10687453606549432, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04874777793884277, "sim_compute_performance-ego": 0.07619661443373736, "sim_compute_robot_state-ego": 0.08029092059415929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1259077262878418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.057783927917480465, "in-drivable-lane": 0, "agent_compute-ego": 0.1384088611602783, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0968119239807129, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03720549583435059, "sim_compute_performance-ego": 0.0656602954864502, "sim_compute_robot_state-ego": 0.07159162521362304}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12362095977686628, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06730681733240056, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16326524939718126, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.1031850983824911, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04188268094123164, "sim_compute_performance-ego": 0.07119408136681665, "sim_compute_robot_state-ego": 0.07969095435323595}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1052925829984704, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06068625255506866, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15405850507775132, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0952893471231266, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038762082858961454, "sim_compute_performance-ego": 0.06567595929515604, "sim_compute_robot_state-ego": 0.07297552848348812}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12076024498258318, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.07459964496748787, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16202457462038314, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10225885254996164, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.040928044489451816, "sim_compute_performance-ego": 0.07334030951772418, "sim_compute_robot_state-ego": 0.07944199017116002}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134246065503075, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06981333096822102, "in-drivable-lane": 0, "agent_compute-ego": 0.1636412370772589, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10733615784418016, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.044615132468087335, "sim_compute_performance-ego": 0.07604442323957171, "sim_compute_robot_state-ego": 0.07824739955720447}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.14561896000878286, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06788589590686862, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17153480093357926, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.11034656783281746, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.043216875043966, "sim_compute_performance-ego": 0.07680227796910173, "sim_compute_robot_state-ego": 0.09027546139086708}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.13125715255737305, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06738303357904607, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16493724909695712, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10854839411648835, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04230480194091797, "sim_compute_performance-ego": 0.07604419968344948, "sim_compute_robot_state-ego": 0.08202991485595704}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.14149155245198833, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06970769708806818, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17058033757395558, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10915143768508712, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04150768069477825, "sim_compute_performance-ego": 0.07655189254067161, "sim_compute_robot_state-ego": 0.08524645458568227}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.14199515751429967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06973529713494438, "in-drivable-lane": 0, "agent_compute-ego": 0.16832719530378068, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10476061276027136, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04012336901256016, "sim_compute_performance-ego": 0.07118044580732073, "sim_compute_robot_state-ego": 0.08004567452839442}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11394466138353536, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05977701205833286, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1530752462499282, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09862252777697993, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03950814639820772, "sim_compute_performance-ego": 0.06937506619621725, "sim_compute_robot_state-ego": 0.07226009929881376}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12980470833954988, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.060903858255456994, "in-drivable-lane": 0, "agent_compute-ego": 0.1653025326905427, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10874885982937282, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04760429594251844, "sim_compute_performance-ego": 0.06784022295916523, "sim_compute_robot_state-ego": 0.07418070016083894}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.0990832483067232, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.05873493353525797, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14189431480332915, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.08892759154824649, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.0367423506344066, "sim_compute_performance-ego": 0.06275517099043902, "sim_compute_robot_state-ego": 0.06561688815846163}}
set_robot_commands_max0.11034656783281746
set_robot_commands_mean0.10316731128412784
set_robot_commands_median0.10476061276027136
set_robot_commands_min0.08892759154824649
sim_compute_performance-ego_max0.07680227796910173
sim_compute_performance-ego_mean0.07194983921279523
sim_compute_performance-ego_median0.07334030951772418
sim_compute_performance-ego_min0.06275517099043902
sim_compute_robot_state-ego_max0.09027546139086708
sim_compute_robot_state-ego_mean0.0781031857750759
sim_compute_robot_state-ego_median0.07944199017116002
sim_compute_robot_state-ego_min0.06561688815846163
sim_compute_sim_state_max0.04874777793884277
sim_compute_sim_state_mean0.04168950084594993
sim_compute_sim_state_median0.04115618158269812
sim_compute_sim_state_min0.0367423506344066
sim_physics_max0.15712631449979894
sim_physics_mean0.12790937156902007
sim_physics_median0.12631387180752224
sim_physics_min0.0990832483067232
sim_render-ego_max0.07459964496748787
sim_render-ego_mean0.06588494757487098
sim_render-ego_median0.06738303357904607
sim_render-ego_min0.057783927917480465
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
229432500Liam Paullchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessyes11740:22:59(hidden)
driven_lanedir_consec_median0.16989098333932984
survival_time_median5.999999999999987
deviation-center-line_median0.09700516215369968
in-drivable-lane_median2.8499999999999948


other stats
agent_compute-ego_max0.19063714265823364
agent_compute-ego_mean0.17954617341359458
agent_compute-ego_median0.17926146189371744
agent_compute-ego_min0.1693095397949219
deviation-center-line_max0.5149326144164952
deviation-center-line_mean0.18875630734570936
deviation-center-line_min0.055176021990154915
deviation-heading_max6.03706759109609
deviation-heading_mean3.0367562823392857
deviation-heading_median2.337778188521578
deviation-heading_min0.4769187806207878
driven_any_max1.2763860438329668
driven_any_mean0.6447561517358648
driven_any_median0.5046802893128901
driven_any_min0.09611140033290728
driven_lanedir_consec_max0.46870127726085253
driven_lanedir_consec_mean0.2301678207304392
driven_lanedir_consec_min0.02938220295962002
driven_lanedir_max0.46870127726085253
driven_lanedir_mean0.2301678207304392
driven_lanedir_median0.16989098333932984
driven_lanedir_min0.02938220295962002
in-drivable-lane_max7.450000000000042
in-drivable-lane_mean3.5900000000000154
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 1.2763860438329668, "sim_physics": 0.20811249812444052, "survival_time": 14.950000000000076, "driven_lanedir": 0.46870127726085253, "sim_render-ego": 0.06639371554056804, "in-drivable-lane": 7.000000000000038, "agent_compute-ego": 0.178730898698171, "deviation-heading": 6.03706759109609, "set_robot_commands": 0.10293264150619506, "deviation-center-line": 0.2145522802595322, "driven_lanedir_consec": 0.46870127726085253, "sim_compute_sim_state": 0.043234986464182536, "sim_compute_performance-ego": 0.0734652026494344, "sim_compute_robot_state-ego": 0.07744264284769695, "sim_compute_robot_state-npc0": 0.07371064186096192, "sim_compute_robot_state-npc1": 0.0750965921084086, "sim_compute_robot_state-npc2": 0.07530850013097128, "sim_compute_robot_state-npc3": 0.07585594177246094}, "udem1-1-0": {"driven_any": 1.228587038018929, "sim_physics": 0.22931541681289672, "survival_time": 14.950000000000076, "driven_lanedir": 0.4085933010513707, "sim_render-ego": 0.06922561009724935, "in-drivable-lane": 7.450000000000042, "agent_compute-ego": 0.19063714265823364, "deviation-heading": 5.727632976660504, "set_robot_commands": 0.10236602306365966, "deviation-center-line": 0.5149326144164952, "driven_lanedir_consec": 0.4085933010513707, "sim_compute_sim_state": 0.04328161080678304, "sim_compute_performance-ego": 0.07494593540827434, "sim_compute_robot_state-ego": 0.0809173019727071, "sim_compute_robot_state-npc0": 0.0748743748664856, "sim_compute_robot_state-npc1": 0.0762978196144104, "sim_compute_robot_state-npc2": 0.07554871241251628, "sim_compute_robot_state-npc3": 0.07635698795318603}, "udem1-2-0": {"driven_any": 0.11801598718163096, "sim_physics": 0.25325515747070315, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07427133904102279, "sim_render-ego": 0.06702505111694336, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1693095397949219, "deviation-heading": 0.604383874797468, "set_robot_commands": 0.09785906791687012, "deviation-center-line": 0.09700516215369968, "driven_lanedir_consec": 0.07427133904102279, "sim_compute_sim_state": 0.04112253189086914, "sim_compute_performance-ego": 0.07145792007446289, "sim_compute_robot_state-ego": 0.0746457576751709, "sim_compute_robot_state-npc0": 0.07174093246459962, "sim_compute_robot_state-npc1": 0.07079922676086425, "sim_compute_robot_state-npc2": 0.07264791488647461, "sim_compute_robot_state-npc3": 0.0706085205078125}, "udem1-3-0": {"driven_any": 0.09611140033290728, "sim_physics": 0.23172694842020672, "survival_time": 1.5000000000000009, "driven_lanedir": 0.02938220295962002, "sim_render-ego": 0.06726459662119548, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.17979182402292887, "deviation-heading": 0.4769187806207878, "set_robot_commands": 0.09374038378397624, "deviation-center-line": 0.062115457908664795, "driven_lanedir_consec": 0.02938220295962002, "sim_compute_sim_state": 0.04054005146026611, "sim_compute_performance-ego": 0.07307710647583007, "sim_compute_robot_state-ego": 0.0797143538792928, "sim_compute_robot_state-npc0": 0.06493157545725504, "sim_compute_robot_state-npc1": 0.06878815491994222, "sim_compute_robot_state-npc2": 0.06922786235809326, "sim_compute_robot_state-npc3": 0.06872215270996093}, "udem1-4-0": {"driven_any": 0.5046802893128901, "sim_physics": 0.21552934845288593, "survival_time": 5.999999999999987, "driven_lanedir": 0.16989098333932984, "sim_render-ego": 0.06574769814809163, "in-drivable-lane": 2.8499999999999948, "agent_compute-ego": 0.17926146189371744, "deviation-heading": 2.337778188521578, "set_robot_commands": 0.10036178032557168, "deviation-center-line": 0.055176021990154915, "driven_lanedir_consec": 0.16989098333932984, "sim_compute_sim_state": 0.0414349635442098, "sim_compute_performance-ego": 0.07255013386408488, "sim_compute_robot_state-ego": 0.0783116598924001, "sim_compute_robot_state-npc0": 0.07724600632985433, "sim_compute_robot_state-npc1": 0.07342073917388917, "sim_compute_robot_state-npc2": 0.07277507781982422, "sim_compute_robot_state-npc3": 0.07234709461530049}}
set_robot_commands_max0.10293264150619506
set_robot_commands_mean0.09945197931925456
set_robot_commands_median0.10036178032557168
set_robot_commands_min0.09374038378397624
sim_compute_performance-ego_max0.07494593540827434
sim_compute_performance-ego_mean0.07309925969441732
sim_compute_performance-ego_median0.07307710647583007
sim_compute_performance-ego_min0.07145792007446289
sim_compute_robot_state-ego_max0.0809173019727071
sim_compute_robot_state-ego_mean0.07820634325345358
sim_compute_robot_state-ego_median0.0783116598924001
sim_compute_robot_state-ego_min0.0746457576751709
sim_compute_robot_state-npc0_max0.07724600632985433
sim_compute_robot_state-npc0_mean0.0725007061958313
sim_compute_robot_state-npc0_median0.07371064186096192
sim_compute_robot_state-npc0_min0.06493157545725504
sim_compute_robot_state-npc1_max0.0762978196144104
sim_compute_robot_state-npc1_mean0.07288050651550293
sim_compute_robot_state-npc1_median0.07342073917388917
sim_compute_robot_state-npc1_min0.06878815491994222
sim_compute_robot_state-npc2_max0.07554871241251628
sim_compute_robot_state-npc2_mean0.07310161352157593
sim_compute_robot_state-npc2_median0.07277507781982422
sim_compute_robot_state-npc2_min0.06922786235809326
sim_compute_robot_state-npc3_max0.07635698795318603
sim_compute_robot_state-npc3_mean0.07277813951174418
sim_compute_robot_state-npc3_median0.07234709461530049
sim_compute_robot_state-npc3_min0.06872215270996093
sim_compute_sim_state_max0.04328161080678304
sim_compute_sim_state_mean0.041922828833262135
sim_compute_sim_state_median0.0414349635442098
sim_compute_sim_state_min0.04054005146026611
sim_physics_max0.25325515747070315
sim_physics_mean0.2275878738562266
sim_physics_median0.22931541681289672
sim_physics_min0.20811249812444052
sim_render-ego_max0.06922561009724935
sim_render-ego_mean0.06713133430480958
sim_render-ego_median0.06702505111694336
sim_render-ego_min0.06574769814809163
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000028
survival_time_min1.2500000000000004
229172524Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11740:02:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228722598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11740:35:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228672605Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyes11740:06:07(hidden)
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07922933101654053
agent_compute-ego_mean0.07322033485702589
agent_compute-ego_median0.07351755760085414
agent_compute-ego_min0.06663360378958962
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.12479513128038865, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06361840140651649, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07351755760085414, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1005266182859179, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0392926511630206, "sim_compute_performance-ego": 0.0742083468907316, "sim_compute_robot_state-ego": 0.0779924191219706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.1250001867612203, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06719919840494791, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07922933101654053, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11114412546157836, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.043691182136535646, "sim_compute_performance-ego": 0.07635226249694824, "sim_compute_robot_state-ego": 0.08967557350794474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13287622278386896, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06317079067230225, "in-drivable-lane": 0, "agent_compute-ego": 0.06663360378958962, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.1001909537748857, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.04051881486719305, "sim_compute_performance-ego": 0.07297420501708984, "sim_compute_robot_state-ego": 0.07871494509957054}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.13793106377124786, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06511370340983073, "in-drivable-lane": 0, "agent_compute-ego": 0.06937586764494579, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09524545570214588, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04040399193763733, "sim_compute_performance-ego": 0.06803790231545766, "sim_compute_robot_state-ego": 0.07799123724301656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12471167937568996, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06803216623223346, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07734531423319942, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.10622351584227188, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.04242764348569124, "sim_compute_performance-ego": 0.07734831001447595, "sim_compute_robot_state-ego": 0.08291626494863759}}
set_robot_commands_max0.11114412546157836
set_robot_commands_mean0.10266613381335994
set_robot_commands_median0.1005266182859179
set_robot_commands_min0.09524545570214588
sim_compute_performance-ego_max0.07734831001447595
sim_compute_performance-ego_mean0.07378420534694066
sim_compute_performance-ego_median0.0742083468907316
sim_compute_performance-ego_min0.06803790231545766
sim_compute_robot_state-ego_max0.08967557350794474
sim_compute_robot_state-ego_mean0.081458087984228
sim_compute_robot_state-ego_median0.07871494509957054
sim_compute_robot_state-ego_min0.07799123724301656
sim_compute_sim_state_max0.043691182136535646
sim_compute_sim_state_mean0.041266856718015575
sim_compute_sim_state_median0.04051881486719305
sim_compute_sim_state_min0.0392926511630206
sim_physics_max0.13793106377124786
sim_physics_mean0.12906285679448315
sim_physics_median0.1250001867612203
sim_physics_min0.12471167937568996
sim_render-ego_max0.06803216623223346
sim_render-ego_mean0.06542685202516617
sim_render-ego_median0.06511370340983073
sim_render-ego_min0.06317079067230225
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
228542628Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11740:17:54(hidden)
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17225377647965043
agent_compute-ego_mean0.16102313739093518
agent_compute-ego_median0.16301769368788777
agent_compute-ego_min0.13763864161604542
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1498718129263984, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06974489600570113, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17225377647965043, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1115954319636027, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04417810175153944, "sim_compute_performance-ego": 0.08308891896848325, "sim_compute_robot_state-ego": 0.0953698643931636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12379118507983636, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06529650501176423, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16672329809151443, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10239255662057914, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.041261574801276714, "sim_compute_performance-ego": 0.07416825668484557, "sim_compute_robot_state-ego": 0.08294192949930827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13659073324764476, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06399203749263987, "in-drivable-lane": 0, "agent_compute-ego": 0.16301769368788777, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.13353894738590016, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.038338548996869254, "sim_compute_performance-ego": 0.0739599396200741, "sim_compute_robot_state-ego": 0.08196129518396714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13057538032531738, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.062299041748046874, "in-drivable-lane": 0, "agent_compute-ego": 0.15021183967590332, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09588328361511232, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0409451961517334, "sim_compute_performance-ego": 0.06807896614074707, "sim_compute_robot_state-ego": 0.06950505256652832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12776169897634773, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06806687765483614, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17186774785005593, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10863616194906114, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0435569889937775, "sim_compute_performance-ego": 0.07833936244626588, "sim_compute_robot_state-ego": 0.08386188820947575}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12098511871026486, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0648019654410226, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15882987878760513, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09976115032118194, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.039918962790041555, "sim_compute_performance-ego": 0.07399408184752172, "sim_compute_robot_state-ego": 0.08155087062290736}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12869137525558472, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06347479564802987, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16273278423718043, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10340808544840133, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.041867545672825406, "sim_compute_performance-ego": 0.07292242986815316, "sim_compute_robot_state-ego": 0.08045358317238945}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134451048714774, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05894431613740467, "in-drivable-lane": 0, "agent_compute-ego": 0.15699310529799687, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10819331804911296, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.040594634555635, "sim_compute_performance-ego": 0.0703417460123698, "sim_compute_robot_state-ego": 0.07577334131513323}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.101647049693738, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05613200543290478, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13763864161604542, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.0954720489049362, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03573831865342997, "sim_compute_performance-ego": 0.06335610858464645, "sim_compute_robot_state-ego": 0.07046964208958513}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11997684998945755, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0644646861336448, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15785719698125666, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10002633008089933, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03997471549294212, "sim_compute_performance-ego": 0.07411769953641024, "sim_compute_robot_state-ego": 0.07423527457497336}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13877824064973113, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06751295188804726, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16796347382780794, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.1078834564654858, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04310830227740399, "sim_compute_performance-ego": 0.07489075598778663, "sim_compute_robot_state-ego": 0.08594622859707127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.13372445106506348, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06547355651855469, "in-drivable-lane": 0, "agent_compute-ego": 0.1642141342163086, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10845414229801724, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04093139512198312, "sim_compute_performance-ego": 0.07280327592577253, "sim_compute_robot_state-ego": 0.07727540390832084}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.1300793956307804, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.0641325081095976, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1641879595962225, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10690711993797151, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.041558419956880456, "sim_compute_performance-ego": 0.07339564491720761, "sim_compute_robot_state-ego": 0.08054917933894139}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13842570340191876, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06478438553986726, "in-drivable-lane": 0, "agent_compute-ego": 0.15706675140946, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.1009773854856138, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04147273522836191, "sim_compute_performance-ego": 0.07139028443230523, "sim_compute_robot_state-ego": 0.07558347560741284}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12719276372124166, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06595975277470607, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16378877910913206, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10384636533026602, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040915274152568744, "sim_compute_performance-ego": 0.07444617093778123, "sim_compute_robot_state-ego": 0.07971664970996332}}
set_robot_commands_max0.13353894738590016
set_robot_commands_mean0.10579838559040942
set_robot_commands_median0.10384636533026602
set_robot_commands_min0.0954720489049362
sim_compute_performance-ego_max0.08308891896848325
sim_compute_performance-ego_mean0.0732862427940247
sim_compute_performance-ego_median0.0739599396200741
sim_compute_performance-ego_min0.06335610858464645
sim_compute_robot_state-ego_max0.0953698643931636
sim_compute_robot_state-ego_mean0.07967957858594274
sim_compute_robot_state-ego_median0.08045358317238945
sim_compute_robot_state-ego_min0.06950505256652832
sim_compute_sim_state_max0.04417810175153944
sim_compute_sim_state_mean0.04095738097315124
sim_compute_sim_state_median0.0409451961517334
sim_compute_sim_state_min0.03573831865342997
sim_physics_max0.1498718129263984
sim_physics_mean0.1295028538258733
sim_physics_median0.1300793956307804
sim_physics_min0.101647049693738
sim_render-ego_max0.06974489600570113
sim_render-ego_mean0.06433868543578453
sim_render-ego_median0.06478438553986726
sim_render-ego_min0.05613200543290478
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
228272684RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11740:33:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228172704RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:17(hidden)
driven_lanedir_consec_median0.4690786702157119
survival_time_median6.699999999999984
deviation-center-line_median0.43723008973912375
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.1124172169821603
agent_compute-ego_mean0.10786089040848408
agent_compute-ego_median0.10713587999343872
agent_compute-ego_min0.10383313162284984
deviation-center-line_max1.1001113356478638
deviation-center-line_mean0.5500121744977544
deviation-center-line_min0.22790491168772548
deviation-heading_max4.765786249064606
deviation-heading_mean2.47491997496173
deviation-heading_median2.30847155631943
deviation-heading_min0.4615150699879939
driven_any_max2.348942849935891
driven_any_mean1.1643384083031203
driven_any_median1.0230267571294585
driven_any_min0.40439861257061344
driven_lanedir_consec_max1.3229345330603266
driven_lanedir_consec_mean0.7484811054738307
driven_lanedir_consec_min0.3149562081743923
driven_lanedir_max2.063205888072332
driven_lanedir_mean0.9371390524751284
driven_lanedir_median0.5179745881688755
driven_lanedir_min0.3978460021441807
in-drivable-lane_max2.6499999999999906
in-drivable-lane_mean0.6999999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3356737866289494, "sim_physics": 0.17366333961486816, "survival_time": 8.74999999999999, "driven_lanedir": 1.237590113774542, "sim_render-ego": 0.08208147321428572, "in-drivable-lane": 0, "agent_compute-ego": 0.1124172169821603, "deviation-heading": 2.6693194626371435, "set_robot_commands": 0.14752900532313756, "deviation-center-line": 0.7028691875713812, "driven_lanedir_consec": 1.237590113774542, "sim_compute_sim_state": 0.05027055604117257, "sim_compute_performance-ego": 0.0932267393384661, "sim_compute_robot_state-ego": 0.10942725317818776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7096500352506895, "sim_physics": 0.1762840371382864, "survival_time": 4.749999999999991, "driven_lanedir": 0.5179745881688755, "sim_render-ego": 0.07936466618588096, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.10678895649157072, "deviation-heading": 2.30847155631943, "set_robot_commands": 0.1438944515429045, "deviation-center-line": 0.43723008973912375, "driven_lanedir_consec": 0.3149562081743923, "sim_compute_sim_state": 0.04925867381848787, "sim_compute_performance-ego": 0.09145562523289733, "sim_compute_robot_state-ego": 0.10659711235447934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.40439861257061344, "sim_physics": 0.15296790474339536, "survival_time": 2.849999999999998, "driven_lanedir": 0.3978460021441807, "sim_render-ego": 0.07481411883705541, "in-drivable-lane": 0, "agent_compute-ego": 0.10383313162284984, "deviation-heading": 0.4615150699879939, "set_robot_commands": 0.1307845157489442, "deviation-center-line": 0.28194534784267833, "driven_lanedir_consec": 0.3978460021441807, "sim_compute_sim_state": 0.0476942731623064, "sim_compute_performance-ego": 0.08369564173514382, "sim_compute_robot_state-ego": 0.09850845838847912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0230267571294585, "sim_physics": 0.17613901131188692, "survival_time": 6.699999999999984, "driven_lanedir": 0.4690786702157119, "sim_render-ego": 0.07964091692397844, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.10912926695240076, "deviation-heading": 2.1695075367994776, "set_robot_commands": 0.1397257811987578, "deviation-center-line": 0.22790491168772548, "driven_lanedir_consec": 0.4690786702157119, "sim_compute_sim_state": 0.04884407235615289, "sim_compute_performance-ego": 0.08942116552324438, "sim_compute_robot_state-ego": 0.1050582768312141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348942849935891, "sim_physics": 0.16706646998723348, "survival_time": 14.950000000000076, "driven_lanedir": 2.063205888072332, "sim_render-ego": 0.07924894253412883, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.10713587999343872, "deviation-heading": 4.765786249064606, "set_robot_commands": 0.14324581305185954, "deviation-center-line": 1.1001113356478638, "driven_lanedir_consec": 1.3229345330603266, "sim_compute_sim_state": 0.05035711685816447, "sim_compute_performance-ego": 0.09196914990743, "sim_compute_robot_state-ego": 0.10849599997202557}}
set_robot_commands_max0.14752900532313756
set_robot_commands_mean0.14103591337312074
set_robot_commands_median0.14324581305185954
set_robot_commands_min0.1307845157489442
sim_compute_performance-ego_max0.0932267393384661
sim_compute_performance-ego_mean0.08995366434743632
sim_compute_performance-ego_median0.09145562523289733
sim_compute_performance-ego_min0.08369564173514382
sim_compute_robot_state-ego_max0.10942725317818776
sim_compute_robot_state-ego_mean0.10561742014487718
sim_compute_robot_state-ego_median0.10659711235447934
sim_compute_robot_state-ego_min0.09850845838847912
sim_compute_sim_state_max0.05035711685816447
sim_compute_sim_state_mean0.04928493844725684
sim_compute_sim_state_median0.04925867381848787
sim_compute_sim_state_min0.0476942731623064
sim_physics_max0.1762840371382864
sim_physics_mean0.1692241525591341
sim_physics_median0.17366333961486816
sim_physics_min0.15296790474339536
sim_render-ego_max0.08208147321428572
sim_render-ego_mean0.07903002353906588
sim_render-ego_median0.07936466618588096
sim_render-ego_min0.07481411883705541
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.600000000000008
survival_time_min2.849999999999998
228092720jp18813100494test for ppoaido2-LFV-sim-validationstep1-simulationerroryes11740:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
228032738Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationfailedyes11740:01:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227962750RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailedyes11740:02:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
(hidden)
227642808Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFV-sim-testingstep1-simulationerroryes11740:16:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
227182912duckietown_mumchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessyes11740:42:42(hidden)
driven_lanedir_consec_median0.6837273236612166
survival_time_median4.94999999999999
deviation-center-line_median0.43975479509459126
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12002656748006632
agent_compute-ego_mean0.10914547419656552
agent_compute-ego_median0.10892419815063475
agent_compute-ego_min0.10202478322406744
deviation-center-line_max1.2721313178412608
deviation-center-line_mean0.5893348871327595
deviation-center-line_min0.24410092721481208
deviation-heading_max6.453263307977294
deviation-heading_mean2.1546432074673585
deviation-heading_median1.5129813241786394
deviation-heading_min0.4373212219820167
driven_any_max2.348558989556984
driven_any_mean1.1163339466932387
driven_any_median0.7418613949850633
driven_any_min0.4606555285961886
driven_lanedir_consec_max2.228533937766365
driven_lanedir_consec_mean0.8987143264747512
driven_lanedir_consec_min0.1861187831111168
driven_lanedir_max2.228533937766365
driven_lanedir_mean0.9622998423487278
driven_lanedir_median0.6837273236612166
driven_lanedir_min0.40384149041945183
in-drivable-lane_max3.3500000000000085
in-drivable-lane_mean0.35666666666666774
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8064532800860137, "sim_physics": 0.15523818024882563, "survival_time": 5.399999999999989, "driven_lanedir": 0.6729079920553045, "sim_render-ego": 0.07412992583380805, "in-drivable-lane": 0, "agent_compute-ego": 0.11500471830368042, "deviation-heading": 2.338287136023455, "set_robot_commands": 0.11571491206133808, "deviation-center-line": 0.43975479509459126, "driven_lanedir_consec": 0.6729079920553045, "sim_compute_sim_state": 0.045239258695531775, "sim_compute_performance-ego": 0.08333598022107724, "sim_compute_robot_state-ego": 0.11717633406321208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.341040829581571, "sim_physics": 0.12393541944106952, "survival_time": 14.900000000000077, "driven_lanedir": 2.228533937766365, "sim_render-ego": 0.0698603359644845, "in-drivable-lane": 0, "agent_compute-ego": 0.10202478322406744, "deviation-heading": 3.746017089387239, "set_robot_commands": 0.10757881282960008, "deviation-center-line": 1.2721313178412608, "driven_lanedir_consec": 2.228533937766365, "sim_compute_sim_state": 0.043052817351066024, "sim_compute_performance-ego": 0.07823440452550082, "sim_compute_robot_state-ego": 0.08373634607199855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4606555285961886, "sim_physics": 0.13677407056093216, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4557157778087744, "sim_render-ego": 0.06989434733986855, "in-drivable-lane": 0, "agent_compute-ego": 0.10652729496359824, "deviation-heading": 0.4373212219820167, "set_robot_commands": 0.10860570892691612, "deviation-center-line": 0.3530114034861149, "driven_lanedir_consec": 0.4557157778087744, "sim_compute_sim_state": 0.04484963417053223, "sim_compute_performance-ego": 0.07762512564659119, "sim_compute_robot_state-ego": 0.08664089441299438}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2963070546222222, "sim_physics": 0.1366801829565139, "survival_time": 8.399999999999984, "driven_lanedir": 1.1956055366213958, "sim_render-ego": 0.07053653257233757, "in-drivable-lane": 0, "agent_compute-ego": 0.10862772521518524, "deviation-heading": 2.4672483812519808, "set_robot_commands": 0.11170452549344018, "deviation-center-line": 0.6289473405344799, "driven_lanedir_consec": 1.1956055366213958, "sim_compute_sim_state": 0.04343199020340329, "sim_compute_performance-ego": 0.07942006417683192, "sim_compute_robot_state-ego": 0.08549261660802931}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9910417952728108, "sim_physics": 0.14006169759310208, "survival_time": 6.499999999999985, "driven_lanedir": 0.9707966108369646, "sim_render-ego": 0.07042123721196102, "in-drivable-lane": 0, "agent_compute-ego": 0.10745641268216646, "deviation-heading": 1.1334477131845269, "set_robot_commands": 0.10925493423755352, "deviation-center-line": 0.5089338340831535, "driven_lanedir_consec": 0.9707966108369646, "sim_compute_sim_state": 0.04365975489983192, "sim_compute_performance-ego": 0.07897150699908917, "sim_compute_robot_state-ego": 0.08964756635519175}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.115898799782459, "sim_physics": 0.1383212442751284, "survival_time": 13.500000000000057, "driven_lanedir": 1.6291695171631568, "sim_render-ego": 0.07210627131991916, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.10892419815063475, "deviation-heading": 5.369026592114659, "set_robot_commands": 0.11040590339236787, "deviation-center-line": 1.0229304977502416, "driven_lanedir_consec": 1.3534265780820034, "sim_compute_sim_state": 0.04480123696503816, "sim_compute_performance-ego": 0.08088708718617757, "sim_compute_robot_state-ego": 0.09078511220437507}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7418613949850633, "sim_physics": 0.1449461802087649, "survival_time": 4.94999999999999, "driven_lanedir": 0.6837273236612166, "sim_render-ego": 0.07139319121235549, "in-drivable-lane": 0, "agent_compute-ego": 0.10985164690499354, "deviation-heading": 1.5129813241786394, "set_robot_commands": 0.11173984498688667, "deviation-center-line": 0.24410092721481208, "driven_lanedir_consec": 0.6837273236612166, "sim_compute_sim_state": 0.04472651626124526, "sim_compute_performance-ego": 0.08129466663707387, "sim_compute_robot_state-ego": 0.09159465269608932}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6454834591129418, "sim_physics": 0.1336477405723484, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6112352152081411, "sim_render-ego": 0.07143242879845631, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10975946777168362, "deviation-heading": 0.6202910046485036, "set_robot_commands": 0.1085962454477946, "deviation-center-line": 0.4608594616969349, "driven_lanedir_consec": 0.6112352152081411, "sim_compute_sim_state": 0.04501669708339647, "sim_compute_performance-ego": 0.08070861334088204, "sim_compute_robot_state-ego": 0.0874576376772475}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.027646664152992, "sim_physics": 0.131923753782589, "survival_time": 12.950000000000047, "driven_lanedir": 1.9595513614967557, "sim_render-ego": 0.07270508935552766, "in-drivable-lane": 0, "agent_compute-ego": 0.1057048681620005, "deviation-heading": 2.9149126077859, "set_robot_commands": 0.109708799818768, "deviation-center-line": 1.038992644540054, "driven_lanedir_consec": 1.9595513614967557, "sim_compute_sim_state": 0.04395919140701589, "sim_compute_performance-ego": 0.07951601960023857, "sim_compute_robot_state-ego": 0.088360375879354}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5811742718269185, "sim_physics": 0.1388565347164492, "survival_time": 3.949999999999994, "driven_lanedir": 0.5637689913271047, "sim_render-ego": 0.07222413714927962, "in-drivable-lane": 0, "agent_compute-ego": 0.11086966719808458, "deviation-heading": 0.7612967014824786, "set_robot_commands": 0.10894898523258258, "deviation-center-line": 0.3910991881820957, "driven_lanedir_consec": 0.5637689913271047, "sim_compute_sim_state": 0.04309451429149772, "sim_compute_performance-ego": 0.07998615276964405, "sim_compute_robot_state-ego": 0.0890907698039767}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.348558989556984, "sim_physics": 0.1363701860109965, "survival_time": 14.950000000000076, "driven_lanedir": 1.4095235539750124, "sim_render-ego": 0.07097516059875489, "in-drivable-lane": 3.3500000000000085, "agent_compute-ego": 0.114320334593455, "deviation-heading": 6.453263307977294, "set_robot_commands": 0.1166515080134074, "deviation-center-line": 1.0002895414500463, "driven_lanedir_consec": 0.9492064622548524, "sim_compute_sim_state": 0.045437937577565514, "sim_compute_performance-ego": 0.07995086352030437, "sim_compute_robot_state-ego": 0.08945116837819417}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4847565051971733, "sim_physics": 0.1487763675291147, "survival_time": 3.349999999999996, "driven_lanedir": 0.44459564370011984, "sim_render-ego": 0.07107957797263985, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10895649710697916, "deviation-heading": 0.6586166088826472, "set_robot_commands": 0.11068138079856758, "deviation-center-line": 0.27386050672666606, "driven_lanedir_consec": 0.44459564370011984, "sim_compute_sim_state": 0.04941520406239068, "sim_compute_performance-ego": 0.10736167252953371, "sim_compute_robot_state-ego": 0.09011587811939752}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6774666548068774, "sim_physics": 0.14349046120276818, "survival_time": 4.549999999999992, "driven_lanedir": 0.40384149041945183, "sim_render-ego": 0.07384252548217773, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.12002656748006632, "deviation-heading": 2.565445460771033, "set_robot_commands": 0.11146619031717488, "deviation-center-line": 0.3832243427749023, "driven_lanedir_consec": 0.1861187831111168, "sim_compute_sim_state": 0.04383364876548013, "sim_compute_performance-ego": 0.08148563301170265, "sim_compute_robot_state-ego": 0.08755168547997108}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7097753079948844, "sim_physics": 0.14662983292027523, "survival_time": 4.749999999999991, "driven_lanedir": 0.6989490370993754, "sim_render-ego": 0.06919146086040297, "in-drivable-lane": 0, "agent_compute-ego": 0.10290822982788086, "deviation-heading": 0.7571929715418617, "set_robot_commands": 0.10792202196623148, "deviation-center-line": 0.4335018814922893, "driven_lanedir_consec": 0.6989490370993754, "sim_compute_sim_state": 0.04276863650271767, "sim_compute_performance-ego": 0.08115842216893246, "sim_compute_robot_state-ego": 0.0855759997116892}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5168886648234753, "sim_physics": 0.12977880491337307, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5065756460917794, "sim_render-ego": 0.0687989718477491, "in-drivable-lane": 0, "agent_compute-ego": 0.1062197013640068, "deviation-heading": 0.5842999907981381, "set_robot_commands": 0.10735787472254792, "deviation-center-line": 0.38838562412375144, "driven_lanedir_consec": 0.5065756460917794, "sim_compute_sim_state": 0.04344510024702045, "sim_compute_performance-ego": 0.07821351373699349, "sim_compute_robot_state-ego": 0.08741294833975778}}
set_robot_commands_max0.1166515080134074
set_robot_commands_mean0.11042250988301182
set_robot_commands_median0.109708799818768
set_robot_commands_min0.10735787472254792
sim_compute_performance-ego_max0.10736167252953371
sim_compute_performance-ego_mean0.08187664840470489
sim_compute_performance-ego_median0.07998615276964405
sim_compute_performance-ego_min0.07762512564659119
sim_compute_robot_state-ego_max0.11717633406321208
sim_compute_robot_state-ego_mean0.0900059990534319
sim_compute_robot_state-ego_median0.088360375879354
sim_compute_robot_state-ego_min0.08373634607199855
sim_compute_sim_state_max0.04941520406239068
sim_compute_sim_state_mean0.04444880923224888
sim_compute_sim_state_median0.04395919140701589
sim_compute_sim_state_min0.04276863650271767
sim_physics_max0.15523818024882563
sim_physics_mean0.13902871046215007
sim_physics_median0.1383212442751284
sim_physics_min0.12393541944106952
sim_render-ego_max0.07412992583380805
sim_render-ego_mean0.07123941290131483
sim_render-ego_median0.07107957797263985
sim_render-ego_min0.0687989718477491
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.283333333333344
survival_time_min3.1999999999999966
226383064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11740:59:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
226073112awoo424HKU Duckietown Projectaido2-LF-sim-validationstep1-simulationerroryes11740:31:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225843131MYFtestaido2-LF-sim-validationstep1-simulationsuccessyes11740:27:56(hidden)
driven_lanedir_consec_median3.617101099302686
survival_time_median14.950000000000076
deviation-center-line_median0.711561120073908
in-drivable-lane_median0.10000000000000142


other stats
agent_compute-ego_max0.19362216552098593
agent_compute-ego_mean0.1817063414365396
agent_compute-ego_median0.18054336865743
agent_compute-ego_min0.16634554386138917
deviation-center-line_max0.877374497707077
deviation-center-line_mean0.6431859473680189
deviation-center-line_min0.30949867095295225
deviation-heading_max3.373141059224481
deviation-heading_mean2.3371645655672615
deviation-heading_median2.534615641386155
deviation-heading_min1.2744894179398418
driven_any_max4.002414967673113
driven_any_mean3.389373687226191
driven_any_median3.749060757253467
driven_any_min1.7251577151264474
driven_lanedir_consec_max3.957438556809131
driven_lanedir_consec_mean3.10510675350678
driven_lanedir_consec_min1.279642849542992
driven_lanedir_max3.957438556809131
driven_lanedir_mean3.10510675350678
driven_lanedir_median3.617101099302686
driven_lanedir_min1.279642849542992
in-drivable-lane_max2.15000000000001
in-drivable-lane_mean0.7800000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7191142290033494, "sim_physics": 0.13416233777999878, "survival_time": 14.950000000000076, "driven_lanedir": 3.013606641518879, "sim_render-ego": 0.07150211572647094, "in-drivable-lane": 2.15000000000001, "agent_compute-ego": 0.18054336865743, "deviation-heading": 3.373141059224481, "set_robot_commands": 0.10753186623255412, "deviation-center-line": 0.7990775327760852, "driven_lanedir_consec": 3.013606641518879, "sim_compute_sim_state": 0.04459389607111613, "sim_compute_performance-ego": 0.07703720649083455, "sim_compute_robot_state-ego": 0.08650968790054321}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.002414967673113, "sim_physics": 0.13864112695058187, "survival_time": 14.950000000000076, "driven_lanedir": 3.957438556809131, "sim_render-ego": 0.07327325820922852, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1801846957206726, "deviation-heading": 1.2744894179398418, "set_robot_commands": 0.11062690496444702, "deviation-center-line": 0.5184179153300725, "driven_lanedir_consec": 3.957438556809131, "sim_compute_sim_state": 0.04555925210316976, "sim_compute_performance-ego": 0.08118326743443807, "sim_compute_robot_state-ego": 0.08778353929519653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.7511207670745783, "sim_physics": 0.11643500566482544, "survival_time": 14.950000000000076, "driven_lanedir": 3.657744620360214, "sim_render-ego": 0.06469310522079467, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.16634554386138917, "deviation-heading": 2.534615641386155, "set_robot_commands": 0.10245052337646483, "deviation-center-line": 0.711561120073908, "driven_lanedir_consec": 3.657744620360214, "sim_compute_sim_state": 0.04133769989013672, "sim_compute_performance-ego": 0.07612211386362712, "sim_compute_robot_state-ego": 0.07914251645406087}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7251577151264474, "sim_physics": 0.14646209190631734, "survival_time": 7.249999999999982, "driven_lanedir": 1.279642849542992, "sim_render-ego": 0.0745644684495597, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.18783593342222016, "deviation-heading": 1.441969918161954, "set_robot_commands": 0.11646610457321692, "deviation-center-line": 0.30949867095295225, "driven_lanedir_consec": 1.279642849542992, "sim_compute_sim_state": 0.05088451155300798, "sim_compute_performance-ego": 0.08829161874179182, "sim_compute_robot_state-ego": 0.09239204340967638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.749060757253467, "sim_physics": 0.14329859733581543, "survival_time": 14.950000000000076, "driven_lanedir": 3.617101099302686, "sim_render-ego": 0.07414053360621134, "in-drivable-lane": 0, "agent_compute-ego": 0.19362216552098593, "deviation-heading": 3.061606791123876, "set_robot_commands": 0.11704360326131184, "deviation-center-line": 0.877374497707077, "driven_lanedir_consec": 3.617101099302686, "sim_compute_sim_state": 0.04523700952529907, "sim_compute_performance-ego": 0.08213668902715048, "sim_compute_robot_state-ego": 0.09346072514851889}}
set_robot_commands_max0.11704360326131184
set_robot_commands_mean0.11082380048159894
set_robot_commands_median0.11062690496444702
set_robot_commands_min0.10245052337646483
sim_compute_performance-ego_max0.08829161874179182
sim_compute_performance-ego_mean0.08095417911156841
sim_compute_performance-ego_median0.08118326743443807
sim_compute_performance-ego_min0.07612211386362712
sim_compute_robot_state-ego_max0.09346072514851889
sim_compute_robot_state-ego_mean0.08785770244159917
sim_compute_robot_state-ego_median0.08778353929519653
sim_compute_robot_state-ego_min0.07914251645406087
sim_compute_sim_state_max0.05088451155300798
sim_compute_sim_state_mean0.04552247382854593
sim_compute_sim_state_median0.04523700952529907
sim_compute_sim_state_min0.04133769989013672
sim_physics_max0.14646209190631734
sim_physics_mean0.13579983192750775
sim_physics_median0.13864112695058187
sim_physics_min0.11643500566482544
sim_render-ego_max0.0745644684495597
sim_render-ego_mean0.07163469624245304
sim_render-ego_median0.07327325820922852
sim_render-ego_min0.06469310522079467
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.41000000000006
survival_time_min7.249999999999982
225783145AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationerroryes11740:02:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
225433194JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes11740:32:10(hidden)
driven_lanedir_consec_median2.629311701750337
survival_time_median14.950000000000076
deviation-center-line_median1.166749464384669
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.13429651625694766
agent_compute-ego_mean0.12206669491080828
agent_compute-ego_median0.1253884251912435
agent_compute-ego_min0.10367717146873474
deviation-center-line_max1.2708341676647292
deviation-center-line_mean1.1392588507889063
deviation-center-line_min0.9699150188727628
deviation-heading_max4.4159108724531695
deviation-heading_mean2.7139488184154765
deviation-heading_median2.552084092057888
deviation-heading_min1.663945038461588
driven_any_max3.166262129942749
driven_any_mean3.0125188841217483
driven_any_median3.166190784559404
driven_any_min2.6138117416841937
driven_lanedir_consec_max2.8343839617100715
driven_lanedir_consec_mean2.577536766844722
driven_lanedir_consec_min2.170684989044296
driven_lanedir_max2.8343839617100715
driven_lanedir_mean2.577536766844722
driven_lanedir_median2.629311701750337
driven_lanedir_min2.170684989044296
in-drivable-lane_max2.1999999999999993
in-drivable-lane_mean1.4800000000000069
in-drivable-lane_min0.5500000000000016
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9500988022453023, "sim_physics": 0.13704003691673278, "survival_time": 14.000000000000064, "driven_lanedir": 2.6171896015678646, "sim_render-ego": 0.06674133709498814, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.10367717146873474, "deviation-heading": 1.663945038461588, "set_robot_commands": 0.10603516612734114, "deviation-center-line": 1.2042202867491156, "driven_lanedir_consec": 2.6171896015678646, "sim_compute_sim_state": 0.041812052897044594, "sim_compute_performance-ego": 0.07505309666906085, "sim_compute_robot_state-ego": 0.08213000297546387}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1662309621770923, "sim_physics": 0.14776613791783652, "survival_time": 14.950000000000076, "driven_lanedir": 2.636113580151043, "sim_render-ego": 0.07414509455362955, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.12013557434082033, "deviation-heading": 3.009453511496972, "set_robot_commands": 0.1232406767209371, "deviation-center-line": 1.0845753162732552, "driven_lanedir_consec": 2.636113580151043, "sim_compute_sim_state": 0.04647897958755493, "sim_compute_performance-ego": 0.08452533880869548, "sim_compute_robot_state-ego": 0.09694170236587524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.166262129942749, "sim_physics": 0.15832056760787963, "survival_time": 14.950000000000076, "driven_lanedir": 2.629311701750337, "sim_render-ego": 0.07695900678634643, "in-drivable-lane": 2.1999999999999993, "agent_compute-ego": 0.12683578729629516, "deviation-heading": 1.9283505776077656, "set_robot_commands": 0.12569911321004232, "deviation-center-line": 1.166749464384669, "driven_lanedir_consec": 2.629311701750337, "sim_compute_sim_state": 0.04807735602060954, "sim_compute_performance-ego": 0.0904836098353068, "sim_compute_robot_state-ego": 0.0994762635231018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.166190784559404, "sim_physics": 0.14827953497568766, "survival_time": 14.950000000000076, "driven_lanedir": 2.8343839617100715, "sim_render-ego": 0.07495972474416097, "in-drivable-lane": 0.5500000000000016, "agent_compute-ego": 0.1253884251912435, "deviation-heading": 4.4159108724531695, "set_robot_commands": 0.1270972768465678, "deviation-center-line": 1.2708341676647292, "driven_lanedir_consec": 2.8343839617100715, "sim_compute_sim_state": 0.04742502450942993, "sim_compute_performance-ego": 0.08522181908289592, "sim_compute_robot_state-ego": 0.10302061716715497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6138117416841937, "sim_physics": 0.12135505195586913, "survival_time": 12.40000000000004, "driven_lanedir": 2.170684989044296, "sim_render-ego": 0.06664725272886214, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.13429651625694766, "deviation-heading": 2.552084092057888, "set_robot_commands": 0.10628740056868524, "deviation-center-line": 0.9699150188727628, "driven_lanedir_consec": 2.170684989044296, "sim_compute_sim_state": 0.04237213634675549, "sim_compute_performance-ego": 0.07479949535862092, "sim_compute_robot_state-ego": 0.08159278669664936}}
set_robot_commands_max0.1270972768465678
set_robot_commands_mean0.11767192669471473
set_robot_commands_median0.1232406767209371
set_robot_commands_min0.10603516612734114
sim_compute_performance-ego_max0.0904836098353068
sim_compute_performance-ego_mean0.08201667195091598
sim_compute_performance-ego_median0.08452533880869548
sim_compute_performance-ego_min0.07479949535862092
sim_compute_robot_state-ego_max0.10302061716715497
sim_compute_robot_state-ego_mean0.09263227454564904
sim_compute_robot_state-ego_median0.09694170236587524
sim_compute_robot_state-ego_min0.08159278669664936
sim_compute_sim_state_max0.04807735602060954
sim_compute_sim_state_mean0.045233109872278895
sim_compute_sim_state_median0.04647897958755493
sim_compute_sim_state_min0.041812052897044594
sim_physics_max0.15832056760787963
sim_physics_mean0.14255226587480113
sim_physics_median0.14776613791783652
sim_physics_min0.12135505195586913
sim_render-ego_max0.07695900678634643
sim_render-ego_mean0.07189048318159744
sim_render-ego_median0.07414509455362955
sim_render-ego_min0.06664725272886214
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.250000000000068
survival_time_min12.40000000000004
225283216AmaurXchallenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessyes11740:23:20(hidden)
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.18558798053047873
agent_compute-ego_mean0.16771302538803143
agent_compute-ego_median0.16839048597547743
agent_compute-ego_min0.14556263111255788
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1841918539117884, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06669935915205213, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16640047232309976, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10531156151383012, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.041582712420710814, "sim_compute_performance-ego": 0.07146479906859221, "sim_compute_robot_state-ego": 0.07916772365570068, "sim_compute_robot_state-npc0": 0.07364228478184452, "sim_compute_robot_state-npc1": 0.07344466668588144, "sim_compute_robot_state-npc2": 0.07316720927203144, "sim_compute_robot_state-npc3": 0.07280545322983353}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21964591026306152, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.07006390571594238, "in-drivable-lane": 0, "agent_compute-ego": 0.17868724822998047, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10256429672241212, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.042442426681518555, "sim_compute_performance-ego": 0.07575247764587402, "sim_compute_robot_state-ego": 0.08479806900024414, "sim_compute_robot_state-npc0": 0.07886828422546387, "sim_compute_robot_state-npc1": 0.0771558952331543, "sim_compute_robot_state-npc2": 0.07662708282470704, "sim_compute_robot_state-npc3": 0.0742447566986084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2059096662621749, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0669531037932948, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.173457638213509, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10395438420145137, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04330487627732126, "sim_compute_performance-ego": 0.07568341179897911, "sim_compute_robot_state-ego": 0.08218082628752056, "sim_compute_robot_state-npc0": 0.07374032233890734, "sim_compute_robot_state-npc1": 0.07363101369456242, "sim_compute_robot_state-npc2": 0.07787485812839709, "sim_compute_robot_state-npc3": 0.0791799551562259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.20940720884105823, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06664753563796418, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16548979735072655, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10545239871061302, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04409139669394192, "sim_compute_performance-ego": 0.0730357592618918, "sim_compute_robot_state-ego": 0.0792756442782245, "sim_compute_robot_state-npc0": 0.07651343526719492, "sim_compute_robot_state-npc1": 0.07490334933317161, "sim_compute_robot_state-npc2": 0.07388515713848645, "sim_compute_robot_state-npc3": 0.07342706752728813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19379250492368424, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06942329236439296, "in-drivable-lane": 0, "agent_compute-ego": 0.15940514632633754, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10563452754701888, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04263894047055926, "sim_compute_performance-ego": 0.07317190510886055, "sim_compute_robot_state-ego": 0.08617837088448661, "sim_compute_robot_state-npc0": 0.07463194642748151, "sim_compute_robot_state-npc1": 0.07769771984645299, "sim_compute_robot_state-npc2": 0.07616837535585676, "sim_compute_robot_state-npc3": 0.07736774001802717}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16098683410220677, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.0560035264050519, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14556263111255788, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08803979555765788, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03694372265427201, "sim_compute_performance-ego": 0.06427836859667743, "sim_compute_robot_state-ego": 0.06916160053677028, "sim_compute_robot_state-npc0": 0.06520439518822564, "sim_compute_robot_state-npc1": 0.06269454073022913, "sim_compute_robot_state-npc2": 0.06127713786231147, "sim_compute_robot_state-npc3": 0.06319104742120814}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16885932286580405, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0614050582603172, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16021750149903474, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0971367800677264, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.041023435416045015, "sim_compute_performance-ego": 0.06656101897910789, "sim_compute_robot_state-ego": 0.06920925776163737, "sim_compute_robot_state-npc0": 0.06679706220273618, "sim_compute_robot_state-npc1": 0.06641137599945068, "sim_compute_robot_state-npc2": 0.06835721157215259, "sim_compute_robot_state-npc3": 0.06923619464591697}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.2293098025851779, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06963152355617946, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16839048597547743, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10285886128743488, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04301788542005751, "sim_compute_performance-ego": 0.07284389601813422, "sim_compute_robot_state-ego": 0.09412121772766112, "sim_compute_robot_state-npc0": 0.07714955541822645, "sim_compute_robot_state-npc1": 0.07568264537387424, "sim_compute_robot_state-npc2": 0.07439694404602051, "sim_compute_robot_state-npc3": 0.07163724369472928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18127056308414624, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06602502905804178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1767899990081787, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10118246078491212, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04395038666932479, "sim_compute_performance-ego": 0.07453404820483664, "sim_compute_robot_state-ego": 0.07869316702303679, "sim_compute_robot_state-npc0": 0.07440162741619608, "sim_compute_robot_state-npc1": 0.07183959691420845, "sim_compute_robot_state-npc2": 0.07199816081834876, "sim_compute_robot_state-npc3": 0.07250842322473941}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.22980791568756104, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06464943885803223, "in-drivable-lane": 0, "agent_compute-ego": 0.16442211151123046, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10584687232971192, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04356727600097656, "sim_compute_performance-ego": 0.07479335308074951, "sim_compute_robot_state-ego": 0.08168753623962402, "sim_compute_robot_state-npc0": 0.07355381965637207, "sim_compute_robot_state-npc1": 0.07346429347991944, "sim_compute_robot_state-npc2": 0.0725813341140747, "sim_compute_robot_state-npc3": 0.07424563884735108}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22942489385604856, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.059107851982116696, "in-drivable-lane": 0, "agent_compute-ego": 0.15398484468460083, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.0966774582862854, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04213227033615112, "sim_compute_performance-ego": 0.06652286052703857, "sim_compute_robot_state-ego": 0.07736668586730958, "sim_compute_robot_state-npc0": 0.06710387468338012, "sim_compute_robot_state-npc1": 0.068203604221344, "sim_compute_robot_state-npc2": 0.06819850206375122, "sim_compute_robot_state-npc3": 0.07170964479446411}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.22171833640650696, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0748570718263325, "in-drivable-lane": 0, "agent_compute-ego": 0.17415590035287956, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10918997463427092, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04681139243276496, "sim_compute_performance-ego": 0.07869623836718108, "sim_compute_robot_state-ego": 0.0873847760652241, "sim_compute_robot_state-npc0": 0.08446591778805382, "sim_compute_robot_state-npc1": 0.08519035891482704, "sim_compute_robot_state-npc2": 0.07840618334318462, "sim_compute_robot_state-npc3": 0.07815299536052503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.18161917209625245, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06906653881072998, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17349743843078613, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10214418888092042, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04325260162353515, "sim_compute_performance-ego": 0.07658947467803955, "sim_compute_robot_state-ego": 0.07686699390411376, "sim_compute_robot_state-npc0": 0.0738038969039917, "sim_compute_robot_state-npc1": 0.07555490493774414, "sim_compute_robot_state-npc2": 0.07496204853057861, "sim_compute_robot_state-npc3": 0.07585082530975341}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2331175370649858, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.07461444898085161, "in-drivable-lane": 0, "agent_compute-ego": 0.18558798053047873, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.11516994779760188, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.043981042775240814, "sim_compute_performance-ego": 0.0835910818793557, "sim_compute_robot_state-ego": 0.0879405520179055, "sim_compute_robot_state-npc0": 0.07471727241169322, "sim_compute_robot_state-npc1": 0.07754746350375089, "sim_compute_robot_state-npc2": 0.07853617451407692, "sim_compute_robot_state-npc3": 0.07768203995444557}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2333805415095115, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0749469873856525, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.169646185271594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10251868014432948, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04430532455444336, "sim_compute_performance-ego": 0.07606752064763284, "sim_compute_robot_state-ego": 0.08100746115859674, "sim_compute_robot_state-npc0": 0.07646169467848174, "sim_compute_robot_state-npc1": 0.07699213222581514, "sim_compute_robot_state-npc2": 0.07642358176562251, "sim_compute_robot_state-npc3": 0.07561824759658502}}
set_robot_commands_max0.11516994779760188
set_robot_commands_mean0.10291214589774512
set_robot_commands_median0.10285886128743488
set_robot_commands_min0.08803979555765788
sim_compute_performance-ego_max0.0835910818793557
sim_compute_performance-ego_mean0.07357241425753007
sim_compute_performance-ego_median0.07453404820483664
sim_compute_performance-ego_min0.06427836859667743
sim_compute_robot_state-ego_max0.09412121772766112
sim_compute_robot_state-ego_mean0.08100265882720371
sim_compute_robot_state-ego_median0.08100746115859674
sim_compute_robot_state-ego_min0.06916160053677028
sim_compute_robot_state-npc0_max0.08446591778805382
sim_compute_robot_state-npc0_mean0.07407035929254994
sim_compute_robot_state-npc0_median0.07440162741619608
sim_compute_robot_state-npc0_min0.06520439518822564
sim_compute_robot_state-npc1_max0.08519035891482704
sim_compute_robot_state-npc1_mean0.07402757073962575
sim_compute_robot_state-npc1_median0.07490334933317161
sim_compute_robot_state-npc1_min0.06269454073022913
sim_compute_robot_state-npc2_max0.07853617451407692
sim_compute_robot_state-npc2_mean0.0735239974233067
sim_compute_robot_state-npc2_median0.07439694404602051
sim_compute_robot_state-npc2_min0.06127713786231147
sim_compute_robot_state-npc3_max0.0791799551562259
sim_compute_robot_state-npc3_mean0.07379048489864674
sim_compute_robot_state-npc3_median0.0742447566986084
sim_compute_robot_state-npc3_min0.06319104742120814
sim_compute_sim_state_max0.04681139243276496
sim_compute_sim_state_mean0.042869712695124206
sim_compute_sim_state_median0.04325260162353515
sim_compute_sim_state_min0.03694372265427201
sim_physics_max0.2333805415095115
sim_physics_mean0.20549613756399793
sim_physics_median0.20940720884105823
sim_physics_min0.16098683410220677
sim_render-ego_max0.0749469873856525
sim_render-ego_mean0.0673396447857968
sim_render-ego_median0.0669531037932948
sim_render-ego_min0.0560035264050519
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
225113229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:17:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224943247jp18813100494Second test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessyes11740:19:49(hidden)
driven_lanedir_consec_median0.5596565733719423
survival_time_median10.800000000000018
deviation-center-line_median0.5671600550797875
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.2261832314868306
agent_compute-ego_mean0.1962467015214669
agent_compute-ego_median0.1969100856781006
agent_compute-ego_min0.1756893131468031
deviation-center-line_max1.124938355788923
deviation-center-line_mean0.5812679504545528
deviation-center-line_min0.1261533445581102
deviation-heading_max4.3726995102305874
deviation-heading_mean2.3174008349246344
deviation-heading_median2.084871420130781
deviation-heading_min0.41315362683425194
driven_any_max1.6745437771728102
driven_any_mean0.8757069433090461
driven_any_median0.9660902294304492
driven_any_min0.19354399246117937
driven_lanedir_consec_max1.550772048477315
driven_lanedir_consec_mean0.6715841674259363
driven_lanedir_consec_min0.10417562562544712
driven_lanedir_max1.550772048477315
driven_lanedir_mean0.6715841674259363
driven_lanedir_median0.5596565733719423
driven_lanedir_min0.10417562562544712
in-drivable-lane_max4.000000000000057
in-drivable-lane_mean1.1600000000000164
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5327928850398237, "sim_physics": 0.12774700588650173, "survival_time": 1.800000000000001, "driven_lanedir": 0.511911966791792, "sim_render-ego": 0.06749047173394097, "in-drivable-lane": 0, "agent_compute-ego": 0.18078695403205025, "deviation-heading": 0.41315362683425194, "set_robot_commands": 0.10182412465413412, "deviation-center-line": 0.1261533445581102, "driven_lanedir_consec": 0.511911966791792, "sim_compute_sim_state": 0.042884502145979136, "sim_compute_performance-ego": 0.07693380779690212, "sim_compute_robot_state-ego": 0.08021222220526801}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6745437771728102, "sim_physics": 0.1064600701685305, "survival_time": 10.800000000000018, "driven_lanedir": 1.550772048477315, "sim_render-ego": 0.0610081034678, "in-drivable-lane": 0, "agent_compute-ego": 0.1756893131468031, "deviation-heading": 2.084871420130781, "set_robot_commands": 0.09681489180635525, "deviation-center-line": 0.5671600550797875, "driven_lanedir_consec": 1.550772048477315, "sim_compute_sim_state": 0.03879894371385927, "sim_compute_performance-ego": 0.06857669905379966, "sim_compute_robot_state-ego": 0.07377767342108267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19354399246117937, "sim_physics": 0.1568164437316185, "survival_time": 2.1500000000000004, "driven_lanedir": 0.10417562562544712, "sim_render-ego": 0.07087900472241779, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2261832314868306, "deviation-heading": 0.9850709572733976, "set_robot_commands": 0.13036001005838083, "deviation-center-line": 0.16507728968636384, "driven_lanedir_consec": 0.10417562562544712, "sim_compute_sim_state": 0.04499787508055221, "sim_compute_performance-ego": 0.07965923464575479, "sim_compute_robot_state-ego": 0.09796881121258404}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.011563832440968, "sim_physics": 0.13263903617858885, "survival_time": 14.950000000000076, "driven_lanedir": 0.5596565733719423, "sim_render-ego": 0.0721737813949585, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.1969100856781006, "deviation-heading": 4.3726995102305874, "set_robot_commands": 0.11288957277933756, "deviation-center-line": 0.9230107071595796, "driven_lanedir_consec": 0.5596565733719423, "sim_compute_sim_state": 0.044376219113667806, "sim_compute_performance-ego": 0.0810410475730896, "sim_compute_robot_state-ego": 0.08734339872996012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9660902294304492, "sim_physics": 0.14244970480600994, "survival_time": 14.950000000000076, "driven_lanedir": 0.6314046228631849, "sim_render-ego": 0.07209373950958252, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.20166392326354984, "deviation-heading": 3.7312086601541545, "set_robot_commands": 0.11270405371983848, "deviation-center-line": 1.124938355788923, "driven_lanedir_consec": 0.6314046228631849, "sim_compute_sim_state": 0.04430101156234741, "sim_compute_performance-ego": 0.07998756647109985, "sim_compute_robot_state-ego": 0.09116706848144532}}
set_robot_commands_max0.13036001005838083
set_robot_commands_mean0.11091853060360923
set_robot_commands_median0.11270405371983848
set_robot_commands_min0.09681489180635525
sim_compute_performance-ego_max0.0810410475730896
sim_compute_performance-ego_mean0.07723967110812921
sim_compute_performance-ego_median0.07965923464575479
sim_compute_performance-ego_min0.06857669905379966
sim_compute_robot_state-ego_max0.09796881121258404
sim_compute_robot_state-ego_mean0.08609383481006802
sim_compute_robot_state-ego_median0.08734339872996012
sim_compute_robot_state-ego_min0.07377767342108267
sim_compute_sim_state_max0.04499787508055221
sim_compute_sim_state_mean0.04307171032328117
sim_compute_sim_state_median0.04430101156234741
sim_compute_sim_state_min0.03879894371385927
sim_physics_max0.1568164437316185
sim_physics_mean0.1332224521542499
sim_physics_median0.13263903617858885
sim_physics_min0.1064600701685305
sim_render-ego_max0.0721737813949585
sim_render-ego_mean0.06872902016573997
sim_render-ego_median0.07087900472241779
sim_render-ego_min0.0610081034678
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.930000000000035
survival_time_min1.800000000000001
224733272jp18813100494First test - THaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:24(hidden)
driven_lanedir_consec_median2.8791878388178453
survival_time_median14.950000000000076
deviation-center-line_median1.0068115058068483
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.18681149085362753
agent_compute-ego_mean0.1811549825754886
agent_compute-ego_median0.1848308030764262
agent_compute-ego_min0.1680518193031425
deviation-center-line_max1.5255806720399998
deviation-center-line_mean0.8703745408820108
deviation-center-line_min0.12849809775768825
deviation-heading_max4.250901041621015
deviation-heading_mean2.3223253256878893
deviation-heading_median1.8479351494163512
deviation-heading_min1.0801363088124232
driven_any_max4.054488063422768
driven_any_mean2.637942178688946
driven_any_median3.4800977061194622
driven_any_min0.597729151470974
driven_lanedir_consec_max3.258990110186864
driven_lanedir_consec_mean2.190193506346677
driven_lanedir_consec_min0.5459665050925957
driven_lanedir_max3.258990110186864
driven_lanedir_mean2.190193506346677
driven_lanedir_median2.8791878388178453
driven_lanedir_min0.5459665050925957
in-drivable-lane_max2.7000000000000384
in-drivable-lane_mean1.1700000000000157
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.597729151470974, "sim_physics": 0.10814864955731292, "survival_time": 3.349999999999996, "driven_lanedir": 0.5459665050925957, "sim_render-ego": 0.057413766633218795, "in-drivable-lane": 0, "agent_compute-ego": 0.1680518193031425, "deviation-heading": 1.1365180804823618, "set_robot_commands": 0.0871708464266649, "deviation-center-line": 0.12849809775768825, "driven_lanedir_consec": 0.5459665050925957, "sim_compute_sim_state": 0.03431418048801707, "sim_compute_performance-ego": 0.06673348839603253, "sim_compute_robot_state-ego": 0.07223958755607035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.338343711483321, "sim_physics": 0.11697643667786986, "survival_time": 4.549999999999992, "driven_lanedir": 1.0966422494166566, "sim_render-ego": 0.061543524920285406, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1805249203692426, "deviation-heading": 1.0801363088124232, "set_robot_commands": 0.11026072240137792, "deviation-center-line": 0.46095925594665565, "driven_lanedir_consec": 1.0966422494166566, "sim_compute_sim_state": 0.03784464741801168, "sim_compute_performance-ego": 0.06911724216335423, "sim_compute_robot_state-ego": 0.07369974157312414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.054488063422768, "sim_physics": 0.1198508318265279, "survival_time": 14.950000000000076, "driven_lanedir": 3.258990110186864, "sim_render-ego": 0.06628111600875855, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.18555587927500408, "deviation-heading": 1.8479351494163512, "set_robot_commands": 0.09945698579152425, "deviation-center-line": 1.0068115058068483, "driven_lanedir_consec": 3.258990110186864, "sim_compute_sim_state": 0.04144477605819702, "sim_compute_performance-ego": 0.07345944166183471, "sim_compute_robot_state-ego": 0.07734322468439737}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4800977061194622, "sim_physics": 0.1276892097791036, "survival_time": 14.950000000000076, "driven_lanedir": 2.8791878388178453, "sim_render-ego": 0.0666818110148112, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18681149085362753, "deviation-heading": 3.296136048107295, "set_robot_commands": 0.10389151255289714, "deviation-center-line": 1.230023172858862, "driven_lanedir_consec": 2.8791878388178453, "sim_compute_sim_state": 0.04632260799407959, "sim_compute_performance-ego": 0.07539227406183878, "sim_compute_robot_state-ego": 0.07836830139160156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.719052260948207, "sim_physics": 0.120950022538503, "survival_time": 14.950000000000076, "driven_lanedir": 3.1701808282194235, "sim_render-ego": 0.06414840857187908, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.1848308030764262, "deviation-heading": 4.250901041621015, "set_robot_commands": 0.1014625120162964, "deviation-center-line": 1.5255806720399998, "driven_lanedir_consec": 3.1701808282194235, "sim_compute_sim_state": 0.04029717524846395, "sim_compute_performance-ego": 0.07169120868047078, "sim_compute_robot_state-ego": 0.07759965419769287}}
set_robot_commands_max0.11026072240137792
set_robot_commands_mean0.10044851583775212
set_robot_commands_median0.1014625120162964
set_robot_commands_min0.0871708464266649
sim_compute_performance-ego_max0.07539227406183878
sim_compute_performance-ego_mean0.07127873099270621
sim_compute_performance-ego_median0.07169120868047078
sim_compute_performance-ego_min0.06673348839603253
sim_compute_robot_state-ego_max0.07836830139160156
sim_compute_robot_state-ego_mean0.07585010188057725
sim_compute_robot_state-ego_median0.07734322468439737
sim_compute_robot_state-ego_min0.07223958755607035
sim_compute_sim_state_max0.04632260799407959
sim_compute_sim_state_mean0.04004467744135386
sim_compute_sim_state_median0.04029717524846395
sim_compute_sim_state_min0.03431418048801707
sim_physics_max0.1276892097791036
sim_physics_mean0.11872303007586343
sim_physics_median0.1198508318265279
sim_physics_min0.10814864955731292
sim_render-ego_max0.0666818110148112
sim_render-ego_mean0.06321372542979062
sim_render-ego_median0.06414840857187908
sim_render-ego_min0.057413766633218795
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.550000000000043
survival_time_min3.349999999999996
224223314almasipBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes11740:56:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224183317jp18813100494RL - TH - shiaido2-LF-sim-validationstep1-simulationerroryes11740:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
224123325jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryes11740:02:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223923341JBRRussiaJetBrains Researchaido2-LF-sim-testingstep1-simulationerroryes11740:49:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223913342JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
223793353MYFtestaido2-LFV-sim-testingstep1-simulationerroryes11740:14:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223773354madclamchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11740:02:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
(hidden)
223653380jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:22:14(hidden)
driven_lanedir_consec_median1.1772717143394795
survival_time_median14.950000000000076
deviation-center-line_median1.2564295049159275
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19863288402557372
agent_compute-ego_mean0.18471929108568347
agent_compute-ego_median0.18619311629951776
agent_compute-ego_min0.16333019971847534
deviation-center-line_max2.0019356226664935
deviation-center-line_mean1.0952890666399673
deviation-center-line_min0.2699252143008969
deviation-heading_max6.71936138569765
deviation-heading_mean3.9818839211695254
deviation-heading_median3.7722030112939686
deviation-heading_min0.2173190230207393
driven_any_max3.5879048762039325
driven_any_mean2.064125396045019
driven_any_median1.6013626928780311
driven_any_min0.7632258218945824
driven_lanedir_consec_max3.4834192055946542
driven_lanedir_consec_mean1.8326804979201436
driven_lanedir_consec_min0.6575718006884617
driven_lanedir_max3.4834192055946542
driven_lanedir_mean1.8433737181711691
driven_lanedir_median1.1772717143394795
driven_lanedir_min0.7110379019435897
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.5199999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1655340476183824, "sim_physics": 0.1233928155579023, "survival_time": 7.449999999999981, "driven_lanedir": 0.7110379019435897, "sim_render-ego": 0.06600435148149529, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.18213265854240265, "deviation-heading": 5.481102649418371, "set_robot_commands": 0.10262255060592754, "deviation-center-line": 0.4795141049335174, "driven_lanedir_consec": 0.6575718006884617, "sim_compute_sim_state": 0.042591920635044175, "sim_compute_performance-ego": 0.07438869284303397, "sim_compute_robot_state-ego": 0.07957712755907302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7632258218945824, "sim_physics": 0.12152437369028728, "survival_time": 14.950000000000076, "driven_lanedir": 0.7441062907362871, "sim_render-ego": 0.06889763752619425, "in-drivable-lane": 0, "agent_compute-ego": 0.19863288402557372, "deviation-heading": 6.71936138569765, "set_robot_commands": 0.10695130109786988, "deviation-center-line": 2.0019356226664935, "driven_lanedir_consec": 0.7441062907362871, "sim_compute_sim_state": 0.0426119867960612, "sim_compute_performance-ego": 0.07616418997446696, "sim_compute_robot_state-ego": 0.08516286691029866}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5879048762039325, "sim_physics": 0.1210021432240804, "survival_time": 14.950000000000076, "driven_lanedir": 3.4834192055946542, "sim_render-ego": 0.06671646912892659, "in-drivable-lane": 0, "agent_compute-ego": 0.19330759684244792, "deviation-heading": 3.7194335364169007, "set_robot_commands": 0.10445328791936238, "deviation-center-line": 1.468640886383001, "driven_lanedir_consec": 3.4834192055946542, "sim_compute_sim_state": 0.04174598693847656, "sim_compute_performance-ego": 0.07566229581832885, "sim_compute_robot_state-ego": 0.08143550316492716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.202599541630169, "sim_physics": 0.10921306371688842, "survival_time": 14.950000000000076, "driven_lanedir": 3.101033478241836, "sim_render-ego": 0.0589895232518514, "in-drivable-lane": 0, "agent_compute-ego": 0.16333019971847534, "deviation-heading": 3.7722030112939686, "set_robot_commands": 0.09119765202204388, "deviation-center-line": 1.2564295049159275, "driven_lanedir_consec": 3.101033478241836, "sim_compute_sim_state": 0.03809929609298706, "sim_compute_performance-ego": 0.06604786316553751, "sim_compute_robot_state-ego": 0.06953583796819052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6013626928780311, "sim_physics": 0.12090641492372985, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1772717143394795, "sim_render-ego": 0.06654594470928242, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.18619311629951776, "deviation-heading": 0.2173190230207393, "set_robot_commands": 0.10175684829810996, "deviation-center-line": 0.2699252143008969, "driven_lanedir_consec": 1.1772717143394795, "sim_compute_sim_state": 0.0428149142822662, "sim_compute_performance-ego": 0.07696378076231325, "sim_compute_robot_state-ego": 0.07879082877914627}}
set_robot_commands_max0.10695130109786988
set_robot_commands_mean0.10139632798866274
set_robot_commands_median0.10262255060592754
set_robot_commands_min0.09119765202204388
sim_compute_performance-ego_max0.07696378076231325
sim_compute_performance-ego_mean0.07384536451273611
sim_compute_performance-ego_median0.07566229581832885
sim_compute_performance-ego_min0.06604786316553751
sim_compute_robot_state-ego_max0.08516286691029866
sim_compute_robot_state-ego_mean0.07890043287632713
sim_compute_robot_state-ego_median0.07957712755907302
sim_compute_robot_state-ego_min0.06953583796819052
sim_compute_sim_state_max0.0428149142822662
sim_compute_sim_state_mean0.04157282094896704
sim_compute_sim_state_median0.042591920635044175
sim_compute_sim_state_min0.03809929609298706
sim_physics_max0.1233928155579023
sim_physics_mean0.11920776222257765
sim_physics_median0.1210021432240804
sim_physics_min0.10921306371688842
sim_render-ego_max0.06889763752619425
sim_render-ego_mean0.06543078521955
sim_render-ego_median0.06654594470928242
sim_render-ego_min0.0589895232518514
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.23000000000004
survival_time_min3.8499999999999943
223543390jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:14(hidden)
driven_lanedir_consec_median1.2663594888259806
survival_time_median13.600000000000058
deviation-center-line_median0.2558550476326924
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.20091874020941117
agent_compute-ego_mean0.18503262758432665
agent_compute-ego_median0.191954897797626
agent_compute-ego_min0.14915824540053743
deviation-center-line_max1.024837191238153
deviation-center-line_mean0.43232954566270426
deviation-center-line_min0.07903363477032634
deviation-heading_max3.5512068851908096
deviation-heading_mean1.497279003685015
deviation-heading_median0.32478405898263474
deviation-heading_min0.2962092362398807
driven_any_max3.8252935150994105
driven_any_mean1.8633884027698728
driven_any_median1.3260904013381674
driven_any_min0.8256891231340653
driven_lanedir_consec_max3.4687845804772035
driven_lanedir_consec_mean1.6317391305632731
driven_lanedir_consec_min0.653967327249565
driven_lanedir_max3.4687845804772035
driven_lanedir_mean1.6375038471830188
driven_lanedir_median1.2663594888259806
driven_lanedir_min0.653967327249565
in-drivable-lane_max11.95000000000008
in-drivable-lane_mean4.060000000000032
in-drivable-lane_min0.4500000000000064
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.007053009188332, "sim_physics": 0.136798532112785, "survival_time": 2.3, "driven_lanedir": 0.6797680779697997, "sim_render-ego": 0.06514136169267737, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.191954897797626, "deviation-heading": 0.3165400741408718, "set_robot_commands": 0.10386075662529988, "deviation-center-line": 0.07903363477032634, "driven_lanedir_consec": 0.6797680779697997, "sim_compute_sim_state": 0.042364861654198685, "sim_compute_performance-ego": 0.07485959322556206, "sim_compute_robot_state-ego": 0.08359664937724239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8256891231340653, "sim_physics": 0.09390064734446853, "survival_time": 3.949999999999994, "driven_lanedir": 0.653967327249565, "sim_render-ego": 0.05726454831376861, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14915824540053743, "deviation-heading": 0.32478405898263474, "set_robot_commands": 0.08320965042597131, "deviation-center-line": 0.08906968027377606, "driven_lanedir_consec": 0.653967327249565, "sim_compute_sim_state": 0.03657919545716877, "sim_compute_performance-ego": 0.06109830699389494, "sim_compute_robot_state-ego": 0.06293335443810572}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8252935150994105, "sim_physics": 0.13152050884330974, "survival_time": 13.600000000000058, "driven_lanedir": 3.4687845804772035, "sim_render-ego": 0.07016973460421842, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.20091874020941117, "deviation-heading": 2.997654763870878, "set_robot_commands": 0.10487585295649136, "deviation-center-line": 1.024837191238153, "driven_lanedir_consec": 3.4687845804772035, "sim_compute_sim_state": 0.04277363682494444, "sim_compute_performance-ego": 0.0774717760436675, "sim_compute_robot_state-ego": 0.08624983272131752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.332815965089388, "sim_physics": 0.13374587376912436, "survival_time": 14.950000000000076, "driven_lanedir": 2.1186397613925454, "sim_render-ego": 0.06743734836578369, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.1969960347811381, "deviation-heading": 3.5512068851908096, "set_robot_commands": 0.10675578514734904, "deviation-center-line": 0.7128521743985732, "driven_lanedir_consec": 2.089816178293817, "sim_compute_sim_state": 0.0434832493464152, "sim_compute_performance-ego": 0.07748412768046062, "sim_compute_robot_state-ego": 0.08686600049336751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3260904013381674, "sim_physics": 0.11966050465901693, "survival_time": 14.950000000000076, "driven_lanedir": 1.2663594888259806, "sim_render-ego": 0.06703290462493897, "in-drivable-lane": 11.95000000000008, "agent_compute-ego": 0.18613521973292033, "deviation-heading": 0.2962092362398807, "set_robot_commands": 0.10647339979807537, "deviation-center-line": 0.2558550476326924, "driven_lanedir_consec": 1.2663594888259806, "sim_compute_sim_state": 0.04268266757329305, "sim_compute_performance-ego": 0.07425361315409343, "sim_compute_robot_state-ego": 0.07928731282552083}}
set_robot_commands_max0.10675578514734904
set_robot_commands_mean0.10103508899063736
set_robot_commands_median0.10487585295649136
set_robot_commands_min0.08320965042597131
sim_compute_performance-ego_max0.07748412768046062
sim_compute_performance-ego_mean0.07303348341953571
sim_compute_performance-ego_median0.07485959322556206
sim_compute_performance-ego_min0.06109830699389494
sim_compute_robot_state-ego_max0.08686600049336751
sim_compute_robot_state-ego_mean0.07978662997111079
sim_compute_robot_state-ego_median0.08359664937724239
sim_compute_robot_state-ego_min0.06293335443810572
sim_compute_sim_state_max0.0434832493464152
sim_compute_sim_state_mean0.041576722171204034
sim_compute_sim_state_median0.04268266757329305
sim_compute_sim_state_min0.03657919545716877
sim_physics_max0.136798532112785
sim_physics_mean0.12312521334574092
sim_physics_median0.13152050884330974
sim_physics_min0.09390064734446853
sim_render-ego_max0.07016973460421842
sim_render-ego_mean0.0654091795202774
sim_render-ego_median0.06703290462493897
sim_render-ego_min0.05726454831376861
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.95000000000004
survival_time_min2.3
223493391jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationerroryes11740:08:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
223453395jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:15:35(hidden)
driven_lanedir_consec_median1.238302411107852
survival_time_median5.849999999999987
deviation-center-line_median0.21149840683507448
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.20465378761291503
agent_compute-ego_mean0.17871988862600083
agent_compute-ego_median0.18538142124811807
agent_compute-ego_min0.15567503372828165
deviation-center-line_max0.919770137458658
deviation-center-line_mean0.3711700371111867
deviation-center-line_min0.06863286644076615
deviation-heading_max13.132193694897174
deviation-heading_mean4.305736427741708
deviation-heading_median0.6372176004493483
deviation-heading_min0.20186117886824836
driven_any_max2.05349843568627
driven_any_mean1.194331915677766
driven_any_median1.3933977016697776
driven_any_min0.24239375290646284
driven_lanedir_consec_max1.2738878038303634
driven_lanedir_consec_mean0.915120334104461
driven_lanedir_consec_min0.23220163175763808
driven_lanedir_max1.3085355972599426
driven_lanedir_mean0.9291643878842472
driven_lanedir_median1.2412946104643634
driven_lanedir_min0.23220163175763808
in-drivable-lane_max6.500000000000011
in-drivable-lane_mean2.119999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.05349843568627, "sim_physics": 0.12721878290176392, "survival_time": 14.950000000000076, "driven_lanedir": 1.3085355972599426, "sim_render-ego": 0.06775298039118449, "in-drivable-lane": 6.500000000000011, "agent_compute-ego": 0.1900022308031718, "deviation-heading": 7.149133618364634, "set_robot_commands": 0.10350248257319132, "deviation-center-line": 0.5468771866658134, "driven_lanedir_consec": 1.238302411107852, "sim_compute_sim_state": 0.042261435985565185, "sim_compute_performance-ego": 0.07558494091033935, "sim_compute_robot_state-ego": 0.08145787556966146}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6057614772444198, "sim_physics": 0.10834892094135284, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5899022961089285, "sim_render-ego": 0.0564596156279246, "in-drivable-lane": 0, "agent_compute-ego": 0.15567503372828165, "deviation-heading": 0.4082760461291373, "set_robot_commands": 0.08831760783990224, "deviation-center-line": 0.10907158815562126, "driven_lanedir_consec": 0.5899022961089285, "sim_compute_sim_state": 0.036664595206578575, "sim_compute_performance-ego": 0.06245121856530507, "sim_compute_robot_state-ego": 0.0678942898909251}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24239375290646284, "sim_physics": 0.14771248499552408, "survival_time": 0.7500000000000001, "driven_lanedir": 0.23220163175763808, "sim_render-ego": 0.06729014714558919, "in-drivable-lane": 0, "agent_compute-ego": 0.20465378761291503, "deviation-heading": 0.20186117886824836, "set_robot_commands": 0.11288224856058755, "deviation-center-line": 0.06863286644076615, "driven_lanedir_consec": 0.23220163175763808, "sim_compute_sim_state": 0.0451024850209554, "sim_compute_performance-ego": 0.07675590515136718, "sim_compute_robot_state-ego": 0.08487915992736816}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6766082108818998, "sim_physics": 0.1009691739693666, "survival_time": 5.849999999999987, "driven_lanedir": 1.2738878038303634, "sim_render-ego": 0.05599241582756369, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.15788696973751754, "deviation-heading": 0.6372176004493483, "set_robot_commands": 0.08592563001518576, "deviation-center-line": 0.21149840683507448, "driven_lanedir_consec": 1.2738878038303634, "sim_compute_sim_state": 0.03592325683332916, "sim_compute_performance-ego": 0.06345468301039475, "sim_compute_robot_state-ego": 0.06479272068056285}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3933977016697776, "sim_physics": 0.12259340445200602, "survival_time": 14.950000000000076, "driven_lanedir": 1.2412946104643634, "sim_render-ego": 0.06472945769627889, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.18538142124811807, "deviation-heading": 13.132193694897174, "set_robot_commands": 0.10260731935501098, "deviation-center-line": 0.919770137458658, "driven_lanedir_consec": 1.2413075277175225, "sim_compute_sim_state": 0.04148445208867391, "sim_compute_performance-ego": 0.07448733409245809, "sim_compute_robot_state-ego": 0.08014459530512492}}
set_robot_commands_max0.11288224856058755
set_robot_commands_mean0.0986470576687756
set_robot_commands_median0.10260731935501098
set_robot_commands_min0.08592563001518576
sim_compute_performance-ego_max0.07675590515136718
sim_compute_performance-ego_mean0.07054681634597289
sim_compute_performance-ego_median0.07448733409245809
sim_compute_performance-ego_min0.06245121856530507
sim_compute_robot_state-ego_max0.08487915992736816
sim_compute_robot_state-ego_mean0.07583372827472849
sim_compute_robot_state-ego_median0.08014459530512492
sim_compute_robot_state-ego_min0.06479272068056285
sim_compute_sim_state_max0.0451024850209554
sim_compute_sim_state_mean0.04028724502702045
sim_compute_sim_state_median0.04148445208867391
sim_compute_sim_state_min0.03592325683332916
sim_physics_max0.14771248499552408
sim_physics_mean0.1213685534520027
sim_physics_median0.12259340445200602
sim_physics_min0.1009691739693666
sim_render-ego_max0.06775298039118449
sim_render-ego_mean0.062444923337708166
sim_render-ego_median0.06472945769627889
sim_render-ego_min0.05599241582756369
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.780000000000028
survival_time_min0.7500000000000001
223353404jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11740:33:16(hidden)
driven_lanedir_consec_median1.9002780320318644
survival_time_median14.950000000000076
deviation-center-line_median0.743188259604236
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20229021072387696
agent_compute-ego_mean0.1964731882344705
agent_compute-ego_median0.1999456971605247
agent_compute-ego_min0.18741837163125316
deviation-center-line_max1.1249348935824215
deviation-center-line_mean0.6203931540971046
deviation-center-line_min0.19718191547758884
deviation-heading_max8.298668567535927
deviation-heading_mean3.7806627796964953
deviation-heading_median3.7389490064723434
deviation-heading_min1.088630966570972
driven_any_max2.504622820944334
driven_any_mean2.048264710330718
driven_any_median1.9359410953534688
driven_any_min1.586999038625302
driven_lanedir_consec_max2.423406705376293
driven_lanedir_consec_mean1.9148741951610155
driven_lanedir_consec_min1.5622532782287046
driven_lanedir_max2.423406705376293
driven_lanedir_mean1.933629009416214
driven_lanedir_median1.9002780320318644
driven_lanedir_min1.5622532782287046
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean0.8100000000000105
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.504622820944334, "sim_physics": 0.19197086016337075, "survival_time": 14.950000000000076, "driven_lanedir": 2.423406705376293, "sim_render-ego": 0.06467749993006389, "in-drivable-lane": 0, "agent_compute-ego": 0.1922320548693339, "deviation-heading": 3.7389490064723434, "set_robot_commands": 0.10410301287968954, "deviation-center-line": 0.7610064452900737, "driven_lanedir_consec": 2.423406705376293, "sim_compute_sim_state": 0.04158165693283081, "sim_compute_performance-ego": 0.07209020932515463, "sim_compute_robot_state-ego": 0.07985193729400634, "sim_compute_robot_state-npc0": 0.07254498322804769, "sim_compute_robot_state-npc1": 0.073370627562205, "sim_compute_robot_state-npc2": 0.07202160994211833, "sim_compute_robot_state-npc3": 0.07336174885431926}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.586999038625302, "sim_physics": 0.23114733606855445, "survival_time": 5.349999999999989, "driven_lanedir": 1.5622532782287046, "sim_render-ego": 0.06841710126288583, "in-drivable-lane": 0, "agent_compute-ego": 0.1999456971605247, "deviation-heading": 1.088630966570972, "set_robot_commands": 0.10544839083591354, "deviation-center-line": 0.2756542565312034, "driven_lanedir_consec": 1.5622532782287046, "sim_compute_sim_state": 0.045055137616451656, "sim_compute_performance-ego": 0.0750174143604029, "sim_compute_robot_state-ego": 0.08683875119574716, "sim_compute_robot_state-npc0": 0.07969745742940457, "sim_compute_robot_state-npc1": 0.07330409834318072, "sim_compute_robot_state-npc2": 0.07569368754591897, "sim_compute_robot_state-npc3": 0.07737388789096725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.342916809379382, "sim_physics": 0.19272905747095745, "survival_time": 14.950000000000076, "driven_lanedir": 2.1077808384280985, "sim_render-ego": 0.06749974886576335, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.20047960678736368, "deviation-heading": 4.3897622456235545, "set_robot_commands": 0.10573049704233806, "deviation-center-line": 0.743188259604236, "driven_lanedir_consec": 2.0140067671521087, "sim_compute_sim_state": 0.04313803911209106, "sim_compute_performance-ego": 0.07586146513621013, "sim_compute_robot_state-ego": 0.08431521972020467, "sim_compute_robot_state-npc0": 0.0746781587600708, "sim_compute_robot_state-npc1": 0.07475382884343465, "sim_compute_robot_state-npc2": 0.07563069105148315, "sim_compute_robot_state-npc3": 0.07585959752400716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9359410953534688, "sim_physics": 0.1905341498057047, "survival_time": 14.950000000000076, "driven_lanedir": 1.9002780320318644, "sim_render-ego": 0.07069112380345663, "in-drivable-lane": 0, "agent_compute-ego": 0.20229021072387696, "deviation-heading": 8.298668567535927, "set_robot_commands": 0.10615331331888836, "deviation-center-line": 1.1249348935824215, "driven_lanedir_consec": 1.9002780320318644, "sim_compute_sim_state": 0.04493663708368937, "sim_compute_performance-ego": 0.07630658149719238, "sim_compute_robot_state-ego": 0.08451057036717732, "sim_compute_robot_state-npc0": 0.07681315819422405, "sim_compute_robot_state-npc1": 0.07687550147374471, "sim_compute_robot_state-npc2": 0.07525029261906942, "sim_compute_robot_state-npc3": 0.07598870833714803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8708437873511017, "sim_physics": 0.16684447873023248, "survival_time": 7.7499999999999805, "driven_lanedir": 1.6744261930161075, "sim_render-ego": 0.0673941227697557, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.18741837163125316, "deviation-heading": 1.387303112279679, "set_robot_commands": 0.1015854835510254, "deviation-center-line": 0.19718191547758884, "driven_lanedir_consec": 1.6744261930161075, "sim_compute_sim_state": 0.041204269470707065, "sim_compute_performance-ego": 0.07398849302722561, "sim_compute_robot_state-ego": 0.07668310134641586, "sim_compute_robot_state-npc0": 0.07363253255044261, "sim_compute_robot_state-npc1": 0.07509246949226625, "sim_compute_robot_state-npc2": 0.07455550163022934, "sim_compute_robot_state-npc3": 0.0771674879135624}}
set_robot_commands_max0.10615331331888836
set_robot_commands_mean0.10460413952557096
set_robot_commands_median0.10544839083591354
set_robot_commands_min0.1015854835510254
sim_compute_performance-ego_max0.07630658149719238
sim_compute_performance-ego_mean0.07465283266923713
sim_compute_performance-ego_median0.0750174143604029
sim_compute_performance-ego_min0.07209020932515463
sim_compute_robot_state-ego_max0.08683875119574716
sim_compute_robot_state-ego_mean0.08243991598471027
sim_compute_robot_state-ego_median0.08431521972020467
sim_compute_robot_state-ego_min0.07668310134641586
sim_compute_robot_state-npc0_max0.07969745742940457
sim_compute_robot_state-npc0_mean0.07547325803243794
sim_compute_robot_state-npc0_median0.0746781587600708
sim_compute_robot_state-npc0_min0.07254498322804769
sim_compute_robot_state-npc1_max0.07687550147374471
sim_compute_robot_state-npc1_mean0.07467930514296625
sim_compute_robot_state-npc1_median0.07475382884343465
sim_compute_robot_state-npc1_min0.07330409834318072
sim_compute_robot_state-npc2_max0.07569368754591897
sim_compute_robot_state-npc2_mean0.07463035655776384
sim_compute_robot_state-npc2_median0.07525029261906942
sim_compute_robot_state-npc2_min0.07202160994211833
sim_compute_robot_state-npc3_max0.07737388789096725
sim_compute_robot_state-npc3_mean0.07595028610400083
sim_compute_robot_state-npc3_median0.07598870833714803
sim_compute_robot_state-npc3_min0.07336174885431926
sim_compute_sim_state_max0.045055137616451656
sim_compute_sim_state_mean0.043183148043154
sim_compute_sim_state_median0.04313803911209106
sim_compute_sim_state_min0.041204269470707065
sim_physics_max0.23114733606855445
sim_physics_mean0.19464517644776397
sim_physics_median0.19197086016337075
sim_physics_min0.16684447873023248
sim_render-ego_max0.07069112380345663
sim_render-ego_mean0.06773591932638509
sim_render-ego_median0.06749974886576335
sim_render-ego_min0.06467749993006389
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.59000000000004
survival_time_min5.349999999999989
223073489MYFtestaido2-LF-sim-testingstep1-simulationerroryes11741:00:29
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up. 
(hidden)
223023441jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11740:13:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222863446JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:03:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
(hidden)
222773485Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationerroryes11741 day, 4:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
driven_lanedir_consec_median0.1027402350404727
survival_time_median1.2500000000000004
deviation-center-line_median0.06544296847794585
in-drivable-lane_median0


other stats
agent_compute-ego_max0.3303907513618469
agent_compute-ego_mean0.23320438574409927
agent_compute-ego_median0.2372153323629628
agent_compute-ego_min0.10612981849246556
deviation-center-line_max0.11471293380088246
deviation-center-line_mean0.07366551010264304
deviation-center-line_min0.04330768303221607
deviation-heading_max0.8861256465852722
deviation-heading_mean0.6834126603743021
deviation-heading_median0.6864892933609761
deviation-heading_min0.4720613862039766
driven_any_max0.2265401530165733
driven_any_mean0.16478792760870897
driven_any_median0.1728980368258645
driven_any_min0.10010313722642758
driven_lanedir_consec_max0.13687376786535357
driven_lanedir_consec_mean0.09539888466179688
driven_lanedir_consec_min0.04996517884078999
driven_lanedir_max0.13687376786535357
driven_lanedir_mean0.09539888466179688
driven_lanedir_median0.1027402350404727
driven_lanedir_min0.04996517884078999
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.1466666666666668
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2265401530165733, "sim_physics": 0.06642655531565349, "survival_time": 1.800000000000001, "driven_lanedir": 0.09521422466206753, "sim_render-ego": 0.03892297214931912, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.10612981849246556, "deviation-heading": 0.7470428132965999, "set_robot_commands": 0.05895649724536472, "deviation-center-line": 0.06544296847794585, "driven_lanedir_consec": 0.09521422466206753, "sim_compute_sim_state": 0.024946179654863145, "sim_compute_performance-ego": 0.04227668046951294, "sim_compute_robot_state-ego": 0.04366138908598158}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19316793578971944, "sim_physics": 0.10786941051483154, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12131465088002968, "sim_render-ego": 0.06030042966206869, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1593100070953369, "deviation-heading": 0.8224102854377632, "set_robot_commands": 0.08303285439809163, "deviation-center-line": 0.058056730149118635, "driven_lanedir_consec": 0.12131465088002968, "sim_compute_sim_state": 0.03621445496877034, "sim_compute_performance-ego": 0.06491014162699381, "sim_compute_robot_state-ego": 0.06612792015075683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1015179112504599, "sim_physics": 0.08228073622051038, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06196415421569856, "sim_render-ego": 0.04702903095044588, "in-drivable-lane": 0, "agent_compute-ego": 0.14648733640971937, "deviation-heading": 0.5999894422828354, "set_robot_commands": 0.0718722845378675, "deviation-center-line": 0.08456689293596335, "driven_lanedir_consec": 0.06196415421569856, "sim_compute_sim_state": 0.030151643251117907, "sim_compute_performance-ego": 0.050949774290386, "sim_compute_robot_state-ego": 0.05556708888003701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18283329632114723, "sim_physics": 0.08912430703639984, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04996517884078999, "sim_render-ego": 0.03903450816869736, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22703376412391665, "deviation-heading": 0.7436804773248575, "set_robot_commands": 0.06333378702402115, "deviation-center-line": 0.04330768303221607, "driven_lanedir_consec": 0.04996517884078999, "sim_compute_sim_state": 0.025022469460964203, "sim_compute_performance-ego": 0.04279417544603348, "sim_compute_robot_state-ego": 0.04440531134605408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1918647106083934, "sim_physics": 0.1081997348416236, "survival_time": 1.5500000000000007, "driven_lanedir": 0.10493690957645718, "sim_render-ego": 0.05696830441874842, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.15363098729041316, "deviation-heading": 0.7516929596928439, "set_robot_commands": 0.08768313930880639, "deviation-center-line": 0.05545280126641955, "driven_lanedir_consec": 0.10493690957645718, "sim_compute_sim_state": 0.035244534092564735, "sim_compute_performance-ego": 0.0617682856898154, "sim_compute_robot_state-ego": 0.06316518783569336}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1903282355579837, "sim_physics": 0.108311940883768, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0757479515148698, "sim_render-ego": 0.04162390478726091, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.23201981906233163, "deviation-heading": 0.8861256465852722, "set_robot_commands": 0.05833511516965669, "deviation-center-line": 0.06272845686281664, "driven_lanedir_consec": 0.0757479515148698, "sim_compute_sim_state": 0.02535616940465467, "sim_compute_performance-ego": 0.045579786958365606, "sim_compute_robot_state-ego": 0.04575495884336274}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1728980368258645, "sim_physics": 0.1894012348992484, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1335663905008393, "sim_render-ego": 0.08008298703602382, "in-drivable-lane": 0, "agent_compute-ego": 0.28085423367364065, "deviation-heading": 0.63592727960516, "set_robot_commands": 0.14533470358167375, "deviation-center-line": 0.10213005266155176, "driven_lanedir_consec": 0.1335663905008393, "sim_compute_sim_state": 0.050410338810512, "sim_compute_performance-ego": 0.08703265871320452, "sim_compute_robot_state-ego": 0.0986560923712594}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10010313722642758, "sim_physics": 0.1760117249055342, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05089607795873663, "sim_render-ego": 0.08263158798217773, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.28046156059611926, "deviation-heading": 0.6864892933609761, "set_robot_commands": 0.14960771257227118, "deviation-center-line": 0.08332989335475907, "driven_lanedir_consec": 0.05089607795873663, "sim_compute_sim_state": 0.05180644989013672, "sim_compute_performance-ego": 0.0961452614177357, "sim_compute_robot_state-ego": 0.1178700490431352}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14731186490608625, "sim_physics": 0.2130121191342672, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08202374429416315, "sim_render-ego": 0.0850486159324646, "in-drivable-lane": 0, "agent_compute-ego": 0.28470683097839355, "deviation-heading": 0.8193322172113917, "set_robot_commands": 0.1552390257517497, "deviation-center-line": 0.05773114260703888, "driven_lanedir_consec": 0.08202374429416315, "sim_compute_sim_state": 0.05712380011876424, "sim_compute_performance-ego": 0.09874682625134786, "sim_compute_robot_state-ego": 0.12776180108388266}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.15681013082487064, "sim_physics": 0.20726929540219513, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11981060103974794, "sim_render-ego": 0.08722704389820927, "in-drivable-lane": 0, "agent_compute-ego": 0.27838124399599823, "deviation-heading": 0.5288675084697441, "set_robot_commands": 0.16448858509893002, "deviation-center-line": 0.08248149370961552, "driven_lanedir_consec": 0.11981060103974794, "sim_compute_sim_state": 0.056405129639998726, "sim_compute_performance-ego": 0.0983529920163362, "sim_compute_robot_state-ego": 0.1227933116581129}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1500108148449771, "sim_physics": 0.190940390030543, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11835141989328768, "sim_render-ego": 0.08592845002810161, "in-drivable-lane": 0, "agent_compute-ego": 0.3303907513618469, "deviation-heading": 0.4890783507159989, "set_robot_commands": 0.16216623783111572, "deviation-center-line": 0.10543160956415112, "driven_lanedir_consec": 0.11835141989328768, "sim_compute_sim_state": 0.052918861309687294, "sim_compute_performance-ego": 0.09761301676432292, "sim_compute_robot_state-ego": 0.11569082736968994}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.17622232829816695, "sim_physics": 0.214052209854126, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13687376786535357, "sim_render-ego": 0.08648799896240235, "in-drivable-lane": 0, "agent_compute-ego": 0.2838736057281494, "deviation-heading": 0.6039984947155881, "set_robot_commands": 0.1471957778930664, "deviation-center-line": 0.08197719365174672, "driven_lanedir_consec": 0.13687376786535357, "sim_compute_sim_state": 0.0573793888092041, "sim_compute_performance-ego": 0.09733539581298828, "sim_compute_robot_state-ego": 0.12041623115539551}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18595057423191488, "sim_physics": 0.18133905626112415, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06950526434219195, "sim_render-ego": 0.07948507801178963, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2619244283245456, "deviation-heading": 0.6496423902376691, "set_robot_commands": 0.1387332793205015, "deviation-center-line": 0.043484578697307624, "driven_lanedir_consec": 0.06950526434219195, "sim_compute_sim_state": 0.04954409599304199, "sim_compute_performance-ego": 0.0916402647572179, "sim_compute_robot_state-ego": 0.1123963709800474}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16642722501959417, "sim_physics": 0.16152474403381348, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1080726993022476, "sim_render-ego": 0.07580058097839355, "in-drivable-lane": 0, "agent_compute-ego": 0.2356460666656494, "deviation-heading": 0.8148513604738566, "set_robot_commands": 0.1346339225769043, "deviation-center-line": 0.06414822076811216, "driven_lanedir_consec": 0.1080726993022476, "sim_compute_sim_state": 0.05385343551635742, "sim_compute_performance-ego": 0.08914102554321289, "sim_compute_robot_state-ego": 0.1060425281524658}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12983255940845506, "sim_physics": 0.17124386455701746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1027402350404727, "sim_render-ego": 0.07535830787990404, "in-drivable-lane": 0, "agent_compute-ego": 0.2372153323629628, "deviation-heading": 0.4720613862039766, "set_robot_commands": 0.1201479020326034, "deviation-center-line": 0.11471293380088246, "driven_lanedir_consec": 0.1027402350404727, "sim_compute_sim_state": 0.05077134007992952, "sim_compute_performance-ego": 0.08671092987060547, "sim_compute_robot_state-ego": 0.10011877184328824}}
set_robot_commands_max0.16448858509893002
set_robot_commands_mean0.1160507216228416
set_robot_commands_median0.1346339225769043
set_robot_commands_min0.05833511516965669
sim_compute_performance-ego_max0.09874682625134786
sim_compute_performance-ego_mean0.07673314770853859
sim_compute_performance-ego_median0.08703265871320452
sim_compute_performance-ego_min0.04227668046951294
sim_compute_robot_state-ego_max0.12776180108388266
sim_compute_robot_state-ego_mean0.08936185598661087
sim_compute_robot_state-ego_median0.10011877184328824
sim_compute_robot_state-ego_min0.04366138908598158
sim_compute_sim_state_max0.0573793888092041
sim_compute_sim_state_mean0.04380988606670447
sim_compute_sim_state_median0.050410338810512
sim_compute_sim_state_min0.024946179654863145
sim_physics_max0.214052209854126
sim_physics_mean0.1511338215927104
sim_physics_median0.17124386455701746
sim_physics_min0.06642655531565349
sim_render-ego_max0.08722704389820927
sim_render-ego_mean0.0681286533897338
sim_render-ego_median0.07580058097839355
sim_render-ego_min0.03892297214931912
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.3400000000000003
survival_time_min0.9500000000000004
222563504jp18813100494Fourth test - THaido2-LF-sim-testingstep1-simulationerroryes11740:46:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222533510Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessyes11740:08:24(hidden)
driven_lanedir_consec_median0.14449336881715436
survival_time_median1.3000000000000005
deviation-center-line_median0.09692797217487278
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24199397223336355
agent_compute-ego_mean0.22067797751653764
agent_compute-ego_median0.21551789687230036
agent_compute-ego_min0.20644450187683103
deviation-center-line_max0.11104770451998182
deviation-center-line_mean0.08794426518358177
deviation-center-line_min0.04815316715156456
deviation-heading_max0.9024980218381614
deviation-heading_mean0.6381249578526246
deviation-heading_median0.6457764228839468
deviation-heading_min0.41997040481206144
driven_any_max0.26810030027425963
driven_any_mean0.2009290456612464
driven_any_median0.20216789494432427
driven_any_min0.14748206803011835
driven_lanedir_consec_max0.2000270771392767
driven_lanedir_consec_mean0.1514391866653772
driven_lanedir_consec_min0.09895180144674298
driven_lanedir_max0.2000270771392767
driven_lanedir_mean0.1514391866653772
driven_lanedir_median0.14449336881715436
driven_lanedir_min0.09895180144674298
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26810030027425963, "sim_physics": 0.23849571162256705, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2000270771392767, "sim_render-ego": 0.07294155811441355, "in-drivable-lane": 0, "agent_compute-ego": 0.20644450187683103, "deviation-heading": 0.7670068087522814, "set_robot_commands": 0.1100846241260397, "deviation-center-line": 0.0975736392287397, "driven_lanedir_consec": 0.2000270771392767, "sim_compute_sim_state": 0.04592177785676101, "sim_compute_performance-ego": 0.08205426972487877, "sim_compute_robot_state-ego": 0.09105286104925749, "sim_compute_robot_state-npc0": 0.0836728441304174, "sim_compute_robot_state-npc1": 0.08282772425947518, "sim_compute_robot_state-npc2": 0.08155160936815985, "sim_compute_robot_state-npc3": 0.08095921319106529}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21706885968484976, "sim_physics": 0.22032915628873384, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14449336881715436, "sim_render-ego": 0.07493189664987418, "in-drivable-lane": 0, "agent_compute-ego": 0.2255542094890888, "deviation-heading": 0.9024980218381614, "set_robot_commands": 0.11991558625147893, "deviation-center-line": 0.08601884284275, "driven_lanedir_consec": 0.14449336881715436, "sim_compute_sim_state": 0.04743526532099797, "sim_compute_performance-ego": 0.0857617213175847, "sim_compute_robot_state-ego": 0.08530643353095421, "sim_compute_robot_state-npc0": 0.07982167830834022, "sim_compute_robot_state-npc1": 0.08191629556509164, "sim_compute_robot_state-npc2": 0.07916885155897874, "sim_compute_robot_state-npc3": 0.08520510563483605}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20216789494432427, "sim_physics": 0.2349537886106051, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1752273778592457, "sim_render-ego": 0.0728517954166119, "in-drivable-lane": 0, "agent_compute-ego": 0.21551789687230036, "deviation-heading": 0.41997040481206144, "set_robot_commands": 0.10570810391352728, "deviation-center-line": 0.11104770451998182, "driven_lanedir_consec": 0.1752273778592457, "sim_compute_sim_state": 0.04701740008134108, "sim_compute_performance-ego": 0.08230995214902438, "sim_compute_robot_state-ego": 0.08810701737037072, "sim_compute_robot_state-npc0": 0.07973776413844182, "sim_compute_robot_state-npc1": 0.08169281482696533, "sim_compute_robot_state-npc2": 0.08579043241647574, "sim_compute_robot_state-npc3": 0.08427881277524508}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16982610537268006, "sim_physics": 0.23896516362826029, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13849630806446633, "sim_render-ego": 0.07381993532180786, "in-drivable-lane": 0, "agent_compute-ego": 0.2138793071111043, "deviation-heading": 0.4553731309766719, "set_robot_commands": 0.11104507247606914, "deviation-center-line": 0.09692797217487278, "driven_lanedir_consec": 0.13849630806446633, "sim_compute_sim_state": 0.04780049125353495, "sim_compute_performance-ego": 0.08528150121370952, "sim_compute_robot_state-ego": 0.08880794048309326, "sim_compute_robot_state-npc0": 0.07798965771993001, "sim_compute_robot_state-npc1": 0.08028829097747803, "sim_compute_robot_state-npc2": 0.08020408948262532, "sim_compute_robot_state-npc3": 0.08251932263374329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14748206803011835, "sim_physics": 0.21761671702067056, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09895180144674298, "sim_render-ego": 0.07630040532066709, "in-drivable-lane": 0, "agent_compute-ego": 0.24199397223336355, "deviation-heading": 0.6457764228839468, "set_robot_commands": 0.10169896625337146, "deviation-center-line": 0.04815316715156456, "driven_lanedir_consec": 0.09895180144674298, "sim_compute_sim_state": 0.04268463452657064, "sim_compute_performance-ego": 0.07963779994419642, "sim_compute_robot_state-ego": 0.08148591859000069, "sim_compute_robot_state-npc0": 0.0787941955384754, "sim_compute_robot_state-npc1": 0.0750620478675479, "sim_compute_robot_state-npc2": 0.07223776408604213, "sim_compute_robot_state-npc3": 0.07575121380033947}}
set_robot_commands_max0.11991558625147893
set_robot_commands_mean0.10969047060409728
set_robot_commands_median0.1100846241260397
set_robot_commands_min0.10169896625337146
sim_compute_performance-ego_max0.0857617213175847
sim_compute_performance-ego_mean0.08300904886987877
sim_compute_performance-ego_median0.08230995214902438
sim_compute_performance-ego_min0.07963779994419642
sim_compute_robot_state-ego_max0.09105286104925749
sim_compute_robot_state-ego_mean0.08695203420473527
sim_compute_robot_state-ego_median0.08810701737037072
sim_compute_robot_state-ego_min0.08148591859000069
sim_compute_robot_state-npc0_max0.0836728441304174
sim_compute_robot_state-npc0_mean0.08000322796712096
sim_compute_robot_state-npc0_median0.07973776413844182
sim_compute_robot_state-npc0_min0.07798965771993001
sim_compute_robot_state-npc1_max0.08282772425947518
sim_compute_robot_state-npc1_mean0.08035743469931161
sim_compute_robot_state-npc1_median0.08169281482696533
sim_compute_robot_state-npc1_min0.0750620478675479
sim_compute_robot_state-npc2_max0.08579043241647574
sim_compute_robot_state-npc2_mean0.07979054938245636
sim_compute_robot_state-npc2_median0.08020408948262532
sim_compute_robot_state-npc2_min0.07223776408604213
sim_compute_robot_state-npc3_max0.08520510563483605
sim_compute_robot_state-npc3_mean0.08174273360704583
sim_compute_robot_state-npc3_median0.08251932263374329
sim_compute_robot_state-npc3_min0.07575121380033947
sim_compute_sim_state_max0.04780049125353495
sim_compute_sim_state_mean0.04617191380784113
sim_compute_sim_state_median0.04701740008134108
sim_compute_sim_state_min0.04268463452657064
sim_physics_max0.23896516362826029
sim_physics_mean0.23007210743416737
sim_physics_median0.2349537886106051
sim_physics_min0.21761671702067056
sim_render-ego_max0.07630040532066709
sim_render-ego_mean0.0741691181646749
sim_render-ego_median0.07381993532180786
sim_render-ego_min0.0728517954166119
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.2600000000000005
survival_time_min1.0500000000000005
222373062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerroryes11740:06:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
(hidden)
222303487Eric LuTesting the RL solutionaido2-LF-sim-validationstep1-simulationsuccessyes11740:07:43(hidden)
driven_lanedir_consec_median0.07702513005734302
survival_time_median1.5000000000000009
deviation-center-line_median0.06322780922240491
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.24281456663801865
agent_compute-ego_mean0.20590024768045376
agent_compute-ego_median0.20336381594340008
agent_compute-ego_min0.18731257833283524
deviation-center-line_max0.09228994787587767
deviation-center-line_mean0.06739387946171664
deviation-center-line_min0.05817012970604847
deviation-heading_max0.9069588715653688
deviation-heading_mean0.8172719243811251
deviation-heading_median0.7893877642710926
deviation-heading_min0.7755511975131113
driven_any_max0.21622709010408736
driven_any_mean0.17471026618198365
driven_any_median0.19511268671405285
driven_any_min0.08616675328102295
driven_lanedir_consec_max0.13911461535210312
driven_lanedir_consec_mean0.08986567256199576
driven_lanedir_consec_min0.03996051540502421
driven_lanedir_max0.13911461535210312
driven_lanedir_mean0.08986567256199576
driven_lanedir_median0.07702513005734302
driven_lanedir_min0.03996051540502421
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.2200000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19511268671405285, "sim_physics": 0.1594842124629665, "survival_time": 1.850000000000001, "driven_lanedir": 0.06252938188255053, "sim_render-ego": 0.06855236517416465, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.24281456663801865, "deviation-heading": 0.7893877642710926, "set_robot_commands": 0.11038223472801414, "deviation-center-line": 0.06322780922240491, "driven_lanedir_consec": 0.06252938188255053, "sim_compute_sim_state": 0.04487558957692739, "sim_compute_performance-ego": 0.0765572689674996, "sim_compute_robot_state-ego": 0.08888108665878708}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1983187050797964, "sim_physics": 0.15384631156921386, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13911461535210312, "sim_render-ego": 0.07084733645121256, "in-drivable-lane": 0, "agent_compute-ego": 0.20805320739746097, "deviation-heading": 0.8269869757353062, "set_robot_commands": 0.11699755191802978, "deviation-center-line": 0.06480953977680456, "driven_lanedir_consec": 0.13911461535210312, "sim_compute_sim_state": 0.046765772501627605, "sim_compute_performance-ego": 0.08351763089497884, "sim_compute_robot_state-ego": 0.08953993320465088}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08616675328102295, "sim_physics": 0.13779963765825545, "survival_time": 1.0500000000000005, "driven_lanedir": 0.03996051540502421, "sim_render-ego": 0.06658320199875604, "in-drivable-lane": 0, "agent_compute-ego": 0.20336381594340008, "deviation-heading": 0.7755511975131113, "set_robot_commands": 0.1160060451144264, "deviation-center-line": 0.09228994787587767, "driven_lanedir_consec": 0.03996051540502421, "sim_compute_sim_state": 0.042987675893874394, "sim_compute_performance-ego": 0.07805758430844262, "sim_compute_robot_state-ego": 0.0802128655569894}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1777260957309586, "sim_physics": 0.149964085940657, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07702513005734302, "sim_render-ego": 0.06992267740183863, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.18731257833283524, "deviation-heading": 0.9069588715653688, "set_robot_commands": 0.11041571354043894, "deviation-center-line": 0.05817012970604847, "driven_lanedir_consec": 0.07702513005734302, "sim_compute_sim_state": 0.04356162301425276, "sim_compute_performance-ego": 0.07931496357095652, "sim_compute_robot_state-ego": 0.08931944288056472}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21622709010408736, "sim_physics": 0.1415658069379402, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1306987201129579, "sim_render-ego": 0.06759853074044893, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.187957070090554, "deviation-heading": 0.787474812820747, "set_robot_commands": 0.10506774439956204, "deviation-center-line": 0.058471970727447566, "driven_lanedir_consec": 0.1306987201129579, "sim_compute_sim_state": 0.043017943700154625, "sim_compute_performance-ego": 0.07692229386531946, "sim_compute_robot_state-ego": 0.07888812007326068}}
set_robot_commands_max0.11699755191802978
set_robot_commands_mean0.11177385794009428
set_robot_commands_median0.11041571354043894
set_robot_commands_min0.10506774439956204
sim_compute_performance-ego_max0.08351763089497884
sim_compute_performance-ego_mean0.07887394832143942
sim_compute_performance-ego_median0.07805758430844262
sim_compute_performance-ego_min0.0765572689674996
sim_compute_robot_state-ego_max0.08953993320465088
sim_compute_robot_state-ego_mean0.08536828967485054
sim_compute_robot_state-ego_median0.08888108665878708
sim_compute_robot_state-ego_min0.07888812007326068
sim_compute_sim_state_max0.046765772501627605
sim_compute_sim_state_mean0.04424172093736736
sim_compute_sim_state_median0.04356162301425276
sim_compute_sim_state_min0.042987675893874394
sim_physics_max0.1594842124629665
sim_physics_mean0.1485320109138066
sim_physics_median0.149964085940657
sim_physics_min0.13779963765825545
sim_render-ego_max0.07084733645121256
sim_render-ego_mean0.06870082235328415
sim_render-ego_median0.06855236517416465
sim_render-ego_min0.06658320199875604
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5000000000000009
survival_time_min1.0500000000000005