AI Driving Olympics Home Challenges Submissions Jobs

Evaluator 1174

evaluator1174
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2348
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success20
# timeout
# failed2
# error25
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors4
Processor frequency (MHz)2.9 GHz
Free % of processors90%
RAM total (MB)60.0 GB
RAM free (MB)56.2 GB
Disk (MB)96.9 GB
Disk available (MB)47.4 GB
Docker Hub
P11
P2
Cloud simulations
PI Camera0
# Duckiebots0
Map 3x3 avaiable
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
230723554AmaurXRunning the real lane following -- without challenge containeraido2-LFV-sim-validationstep1-simulationerroryes11740:07:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
230523548enickyBaseline solution using reinforcement learningaido2-LF-sim-validationstep1-simulationsuccessyes11740:15:26Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0
survival_time_median14.950000000000076
deviation-center-line_median0.4944945349285404
in-drivable-lane_median7.050000000000072


other stats
agent_compute-ego_max0.10504728635152182
agent_compute-ego_mean0.103598064104716
agent_compute-ego_median0.103477942943573
agent_compute-ego_min0.10187084674835203
deviation-center-line_max0.8791250519425075
deviation-center-line_mean0.44763369492900534
deviation-center-line_min0.14582877424072369
deviation-heading_max17.22642654382171
deviation-heading_mean6.424253550835585
deviation-heading_median3.47447884068374
deviation-heading_min2.8124379744908925
driven_any_max0.940692055491246
driven_any_mean0.1995662017159223
driven_any_median5.796408514446573e-14
driven_any_min4.9480879556867655e-14
driven_lanedir_consec_max0.4343165155064953
driven_lanedir_consec_mean0.0979325807778696
driven_lanedir_consec_min0
driven_lanedir_max0.4651881591161454
driven_lanedir_mean0.10410690949979962
driven_lanedir_median0
driven_lanedir_min0
in-drivable-lane_max10.850000000000083
in-drivable-lane_mean6.780000000000063
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.05713895308820663, "sim_physics": 0.06469975471496582, "survival_time": 14.950000000000076, "driven_lanedir": 0.05534638838285266, "sim_render-ego": 0.039441780249277754, "in-drivable-lane": 6.450000000000092, "agent_compute-ego": 0.10504728635152182, "deviation-heading": 3.4463286844259757, "set_robot_commands": 0.05747942924499512, "deviation-center-line": 0.5669722123144191, "driven_lanedir_consec": 0.05534638838285266, "sim_compute_sim_state": 0.02531776348749797, "sim_compute_performance-ego": 0.04273385445276896, "sim_compute_robot_state-ego": 0.044273540178934735}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.940692055491246, "sim_physics": 0.06229474385579427, "survival_time": 14.950000000000076, "driven_lanedir": 0.4651881591161454, "sim_render-ego": 0.038777933915456135, "in-drivable-lane": 9.550000000000068, "agent_compute-ego": 0.10447086731592814, "deviation-heading": 3.47447884068374, "set_robot_commands": 0.05682178815205892, "deviation-center-line": 0.15174790121883605, "driven_lanedir_consec": 0.4343165155064953, "sim_compute_sim_state": 0.025198742548624673, "sim_compute_performance-ego": 0.042150410016377766, "sim_compute_robot_state-ego": 0.04364627043406168}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.9480879556867655e-14, "sim_physics": 0.05656328837076823, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03778050502141317, "in-drivable-lane": 0, "agent_compute-ego": 0.10187084674835203, "deviation-heading": 17.22642654382171, "set_robot_commands": 0.05742614189783732, "deviation-center-line": 0.8791250519425075, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.02503937562306722, "sim_compute_performance-ego": 0.0416910441716512, "sim_compute_robot_state-ego": 0.04357919216156006}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 5.1316294581885615e-14, "sim_physics": 0.06163030544916789, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.03877824306488037, "in-drivable-lane": 7.050000000000072, "agent_compute-ego": 0.103477942943573, "deviation-heading": 5.161595710755609, "set_robot_commands": 0.05727466344833374, "deviation-center-line": 0.4944945349285404, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025107709566752116, "sim_compute_performance-ego": 0.04218491792678833, "sim_compute_robot_state-ego": 0.04373698393503825}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 5.796408514446573e-14, "sim_physics": 0.06360384464263916, "survival_time": 14.950000000000076, "driven_lanedir": 0, "sim_render-ego": 0.0382793402671814, "in-drivable-lane": 10.850000000000083, "agent_compute-ego": 0.10312337716420492, "deviation-heading": 2.8124379744908925, "set_robot_commands": 0.05667584339777629, "deviation-center-line": 0.14582877424072369, "driven_lanedir_consec": 0, "sim_compute_sim_state": 0.025067140261332194, "sim_compute_performance-ego": 0.04186038494110107, "sim_compute_robot_state-ego": 0.043358910083770755}}
set_robot_commands_max0.05747942924499512
set_robot_commands_mean0.05713557322820027
set_robot_commands_median0.05727466344833374
set_robot_commands_min0.05667584339777629
sim_compute_performance-ego_max0.04273385445276896
sim_compute_performance-ego_mean0.04212412230173747
sim_compute_performance-ego_median0.042150410016377766
sim_compute_performance-ego_min0.0416910441716512
sim_compute_robot_state-ego_max0.044273540178934735
sim_compute_robot_state-ego_mean0.043718979358673096
sim_compute_robot_state-ego_median0.04364627043406168
sim_compute_robot_state-ego_min0.043358910083770755
sim_compute_sim_state_max0.02531776348749797
sim_compute_sim_state_mean0.025146146297454836
sim_compute_sim_state_median0.025107709566752116
sim_compute_sim_state_min0.02503937562306722
sim_physics_max0.06469975471496582
sim_physics_mean0.06175838740666708
sim_physics_median0.06229474385579427
sim_physics_min0.05656328837076823
sim_render-ego_max0.039441780249277754
sim_render-ego_mean0.03861156050364176
sim_render-ego_median0.038777933915456135
sim_render-ego_min0.03778050502141317
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
230302366Andrea Censirandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessyes11740:24:52Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16246684959956578
agent_compute-ego_mean0.1193457550406858
agent_compute-ego_median0.11584102023731578
agent_compute-ego_min0.0816840070944566
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.24855565119393264, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06925922104074986, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.155336527884761, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.10752986352654952, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04359757749340202, "sim_compute_performance-ego": 0.07697745214534711, "sim_compute_robot_state-ego": 0.08291390274144426, "sim_compute_robot_state-npc0": 0.07685048670708379, "sim_compute_robot_state-npc1": 0.07677476617354381, "sim_compute_robot_state-npc2": 0.07438194600841667, "sim_compute_robot_state-npc3": 0.07647331455085851}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2497809018407549, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.07189416885375977, "in-drivable-lane": 0, "agent_compute-ego": 0.16246684959956578, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10845349516187396, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04594646181379046, "sim_compute_performance-ego": 0.07773692267281669, "sim_compute_robot_state-ego": 0.0905194708279201, "sim_compute_robot_state-npc0": 0.07805607148579188, "sim_compute_robot_state-npc1": 0.08239365475518363, "sim_compute_robot_state-npc2": 0.07980709416525704, "sim_compute_robot_state-npc3": 0.07643545525414604}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.18134581926956916, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.05972729145901874, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.12698824891766297, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.0858080988948785, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.03874928974410863, "sim_compute_performance-ego": 0.06571476204881391, "sim_compute_robot_state-ego": 0.06663452305840058, "sim_compute_robot_state-npc0": 0.0656357228177265, "sim_compute_robot_state-npc1": 0.06356838605936291, "sim_compute_robot_state-npc2": 0.06600616742106317, "sim_compute_robot_state-npc3": 0.06525416744565501}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.2482065757115682, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06695430974165599, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14053413271903992, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.10042938093344372, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04281287888685862, "sim_compute_performance-ego": 0.0750250518321991, "sim_compute_robot_state-ego": 0.08010945717493693, "sim_compute_robot_state-npc0": 0.07606008152167003, "sim_compute_robot_state-npc1": 0.08567437529563904, "sim_compute_robot_state-npc2": 0.08693686624368031, "sim_compute_robot_state-npc3": 0.07538183530171712}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2506513936179025, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.0698632626306443, "in-drivable-lane": 0, "agent_compute-ego": 0.15233826637268066, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.10605581601460774, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.04399532363528297, "sim_compute_performance-ego": 0.07691823868524461, "sim_compute_robot_state-ego": 0.08187186150323778, "sim_compute_robot_state-npc0": 0.07834412938072569, "sim_compute_robot_state-npc1": 0.0800840173448835, "sim_compute_robot_state-npc2": 0.07827677045549665, "sim_compute_robot_state-npc3": 0.07187821751549131}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.1636652675217497, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05409811642355548, "in-drivable-lane": 2, "agent_compute-ego": 0.11723034396143016, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.08138465310285191, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03422128511760049, "sim_compute_performance-ego": 0.0591054776471532, "sim_compute_robot_state-ego": 0.061902017650490034, "sim_compute_robot_state-npc0": 0.06106009169253047, "sim_compute_robot_state-npc1": 0.0603737174393888, "sim_compute_robot_state-npc2": 0.05882169386583888, "sim_compute_robot_state-npc3": 0.05787203126324865}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.17167812643699276, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.05149866076349055, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.11002605864145223, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.07634600389350965, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.03224121019678208, "sim_compute_performance-ego": 0.056757017246727805, "sim_compute_robot_state-ego": 0.05930232770234636, "sim_compute_robot_state-npc0": 0.0569587749184914, "sim_compute_robot_state-npc1": 0.0559333157770842, "sim_compute_robot_state-npc2": 0.055721366289749885, "sim_compute_robot_state-npc3": 0.05531118679972528}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.17299080848693849, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.051539006233215334, "in-drivable-lane": 0, "agent_compute-ego": 0.1100844383239746, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07611077308654784, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.031402487754821774, "sim_compute_performance-ego": 0.05753192901611328, "sim_compute_robot_state-ego": 0.06577604293823242, "sim_compute_robot_state-npc0": 0.05519410610198974, "sim_compute_robot_state-npc1": 0.05492759227752685, "sim_compute_robot_state-npc2": 0.05492892742156982, "sim_compute_robot_state-npc3": 0.055024819374084474}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.1528076850450956, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.05063549830363347, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1097752176798307, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.07505703889406644, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.03255288876019991, "sim_compute_performance-ego": 0.05739063024520874, "sim_compute_robot_state-ego": 0.0626486402291518, "sim_compute_robot_state-npc0": 0.05478745240431566, "sim_compute_robot_state-npc1": 0.05652853617301354, "sim_compute_robot_state-npc2": 0.055612646616422214, "sim_compute_robot_state-npc3": 0.05676229641987728}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.1954207053551307, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.051992443891671986, "in-drivable-lane": 0, "agent_compute-ego": 0.1213149199118981, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.07735528395726131, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0335764243052556, "sim_compute_performance-ego": 0.057682459171001725, "sim_compute_robot_state-ego": 0.06005234901721661, "sim_compute_robot_state-npc0": 0.05679120467259334, "sim_compute_robot_state-npc1": 0.059519327603853665, "sim_compute_robot_state-npc2": 0.056780035679156966, "sim_compute_robot_state-npc3": 0.05792041925283579}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.17329116301103073, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.051693081855773926, "in-drivable-lane": 0, "agent_compute-ego": 0.11584102023731578, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.07827983119271019, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03320745988325639, "sim_compute_performance-ego": 0.06003393910147927, "sim_compute_robot_state-ego": 0.06028139591217041, "sim_compute_robot_state-npc0": 0.05778358199379661, "sim_compute_robot_state-npc1": 0.06072930856184526, "sim_compute_robot_state-npc2": 0.056870070370760833, "sim_compute_robot_state-npc3": 0.056995695287531074}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.14803444862365722, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.05113977909088135, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.10650689601898192, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.07351184844970703, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.03309750556945801, "sim_compute_performance-ego": 0.05565319061279297, "sim_compute_robot_state-ego": 0.059306068420410155, "sim_compute_robot_state-npc0": 0.05434576988220215, "sim_compute_robot_state-npc1": 0.05825599670410156, "sim_compute_robot_state-npc2": 0.05735128402709961, "sim_compute_robot_state-npc3": 0.05626834392547608}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.13596351603244214, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.044710098428929104, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.09815599056000406, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.06760663428205124, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.02883693258813087, "sim_compute_performance-ego": 0.04965711147227186, "sim_compute_robot_state-ego": 0.050647598631838535, "sim_compute_robot_state-npc0": 0.049829566732366035, "sim_compute_robot_state-npc1": 0.04851810982886781, "sim_compute_robot_state-npc2": 0.04774807361846275, "sim_compute_robot_state-npc3": 0.04942530013145285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.10993269773629996, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.03860729015790499, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.0816840070944566, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.057307926508096546, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.024158060550689697, "sim_compute_performance-ego": 0.04162236818900475, "sim_compute_robot_state-ego": 0.043001807652986966, "sim_compute_robot_state-npc0": 0.0423891544342041, "sim_compute_robot_state-npc1": 0.04213312039008507, "sim_compute_robot_state-npc2": 0.04177883038154015, "sim_compute_robot_state-npc3": 0.04189970860114464}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.1073713189079648, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.03809627578372047, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.0819034076872326, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.05665628569466727, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.02411738123212542, "sim_compute_performance-ego": 0.04171615101042248, "sim_compute_robot_state-ego": 0.04335651851835705, "sim_compute_robot_state-npc0": 0.042714623042515346, "sim_compute_robot_state-npc1": 0.04189298493521554, "sim_compute_robot_state-npc2": 0.04327527227855864, "sim_compute_robot_state-npc3": 0.04199775060017904}}
set_robot_commands_max0.10845349516187396
set_robot_commands_mean0.08185952890618818
set_robot_commands_median0.07735528395726131
set_robot_commands_min0.05665628569466727
sim_compute_performance-ego_max0.07773692267281669
sim_compute_performance-ego_mean0.06063484673977316
sim_compute_performance-ego_median0.057682459171001725
sim_compute_performance-ego_min0.04162236818900475
sim_compute_robot_state-ego_max0.0905194708279201
sim_compute_robot_state-ego_mean0.06455493213194267
sim_compute_robot_state-ego_median0.061902017650490034
sim_compute_robot_state-ego_min0.043001807652986966
sim_compute_robot_state-npc0_max0.07834412938072569
sim_compute_robot_state-npc0_mean0.06045338785253353
sim_compute_robot_state-npc0_median0.0569587749184914
sim_compute_robot_state-npc0_min0.0423891544342041
sim_compute_robot_state-npc1_max0.08567437529563904
sim_compute_robot_state-npc1_mean0.06182048062130636
sim_compute_robot_state-npc1_median0.059519327603853665
sim_compute_robot_state-npc1_min0.04189298493521554
sim_compute_robot_state-npc2_max0.08693686624368031
sim_compute_robot_state-npc2_mean0.06095313632287159
sim_compute_robot_state-npc2_median0.056870070370760833
sim_compute_robot_state-npc2_min0.04177883038154015
sim_compute_robot_state-npc3_max0.07647331455085851
sim_compute_robot_state-npc3_mean0.059660036114894885
sim_compute_robot_state-npc3_median0.056995695287531074
sim_compute_robot_state-npc3_min0.04189970860114464
sim_compute_sim_state_max0.04594646181379046
sim_compute_sim_state_mean0.03483421116878419
sim_compute_sim_state_median0.03320745988325639
sim_compute_sim_state_min0.02411738123212542
sim_physics_max0.2506513936179025
sim_physics_mean0.1806464052527353
sim_physics_median0.17299080848693849
sim_physics_min0.1073713189079648
sim_render-ego_max0.07189416885375977
sim_render-ego_mean0.054780566977240354
sim_render-ego_median0.051693081855773926
sim_render-ego_min0.03809627578372047
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
230062399Liam Paullrandom_agentaido2-LFVI-sim-testingstep1-simulationsuccessyes11740:31:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.15876758098602295
agent_compute-ego_mean0.14293282439578114
agent_compute-ego_median0.1440584109379695
agent_compute-ego_min0.1151271915435791
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.20626541330844544, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06594670573367348, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.14196757123440126, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.0992590294608587, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.041479747506636605, "sim_compute_performance-ego": 0.0735602107229112, "sim_compute_robot_state-ego": 0.077212246158455, "sim_compute_robot_state-npc0": 0.07337225841570504, "sim_compute_robot_state-npc1": 0.07369668272477162, "sim_compute_robot_state-npc2": 0.07147967060909996, "sim_compute_robot_state-npc3": 0.07265432273285298}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.22035236018044607, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06974882738930839, "in-drivable-lane": 0, "agent_compute-ego": 0.145516642502376, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.10073697566986084, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.04100521121706281, "sim_compute_performance-ego": 0.07501309258597237, "sim_compute_robot_state-ego": 0.08231098311288017, "sim_compute_robot_state-npc0": 0.0733947583607265, "sim_compute_robot_state-npc1": 0.07568772350038801, "sim_compute_robot_state-npc2": 0.07574936321803502, "sim_compute_robot_state-npc3": 0.07293503625052315}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20772280970823415, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.0656303040032248, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.14655368999370094, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.10222257688207534, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.04199059032699437, "sim_compute_performance-ego": 0.07207248974772333, "sim_compute_robot_state-ego": 0.07805474522044357, "sim_compute_robot_state-npc0": 0.07522412874166248, "sim_compute_robot_state-npc1": 0.07403288767175767, "sim_compute_robot_state-npc2": 0.07594718979400339, "sim_compute_robot_state-npc3": 0.07651922772231612}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22813271482785544, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06932537754376729, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.14405137300491333, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.1019674688577652, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.0439109206199646, "sim_compute_performance-ego": 0.07799484829107921, "sim_compute_robot_state-ego": 0.0845315009355545, "sim_compute_robot_state-npc0": 0.07607050736745198, "sim_compute_robot_state-npc1": 0.0799860308567683, "sim_compute_robot_state-npc2": 0.07520255446434021, "sim_compute_robot_state-npc3": 0.07673073808352153}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2287416003999256, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06448833147684734, "in-drivable-lane": 0, "agent_compute-ego": 0.14127262433369955, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09856789452689034, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03860307875133696, "sim_compute_performance-ego": 0.07259783290681385, "sim_compute_robot_state-ego": 0.07726267405918666, "sim_compute_robot_state-npc0": 0.06956986018589564, "sim_compute_robot_state-npc1": 0.06954545066470191, "sim_compute_robot_state-npc2": 0.06976372855050224, "sim_compute_robot_state-npc3": 0.07365500359308153}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.18436753535698988, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.05926522523343206, "in-drivable-lane": 2, "agent_compute-ego": 0.13025375326236566, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10806677726928346, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.03711533118150905, "sim_compute_performance-ego": 0.06542824271196376, "sim_compute_robot_state-ego": 0.06983515316854694, "sim_compute_robot_state-npc0": 0.07241665246243963, "sim_compute_robot_state-npc1": 0.06629533967572059, "sim_compute_robot_state-npc2": 0.06493125561468616, "sim_compute_robot_state-npc3": 0.06582438017793758}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.23764921855000615, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06820001648467722, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.14662952793454662, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.10414145293745022, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.045311680117857106, "sim_compute_performance-ego": 0.07453934891710004, "sim_compute_robot_state-ego": 0.08282894532657364, "sim_compute_robot_state-npc0": 0.07616148874597642, "sim_compute_robot_state-npc1": 0.07561011916225396, "sim_compute_robot_state-npc2": 0.0754710285408983, "sim_compute_robot_state-npc3": 0.07262817169856099}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.179863600730896, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.05415925979614258, "in-drivable-lane": 0, "agent_compute-ego": 0.1151271915435791, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.07557839870452882, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03163711547851562, "sim_compute_performance-ego": 0.05862809658050537, "sim_compute_robot_state-ego": 0.06090038776397705, "sim_compute_robot_state-npc0": 0.058478655815124514, "sim_compute_robot_state-npc1": 0.056223664283752445, "sim_compute_robot_state-npc2": 0.05600606918334961, "sim_compute_robot_state-npc3": 0.05435097694396973}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2190061578383813, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06777447920579177, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1440584109379695, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.09895107837823722, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.04265966782203087, "sim_compute_performance-ego": 0.06933384675246018, "sim_compute_robot_state-ego": 0.0777853222993704, "sim_compute_robot_state-npc0": 0.07461893558502197, "sim_compute_robot_state-npc1": 0.07395915343211247, "sim_compute_robot_state-npc2": 0.07393068533677322, "sim_compute_robot_state-npc3": 0.07510991279895489}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2494822465456449, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.06347837814917931, "in-drivable-lane": 0, "agent_compute-ego": 0.13733465854938215, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.09392273426055908, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.0423206457724938, "sim_compute_performance-ego": 0.07274389266967773, "sim_compute_robot_state-ego": 0.07532570912287785, "sim_compute_robot_state-npc0": 0.07314827808967003, "sim_compute_robot_state-npc1": 0.0700080944941594, "sim_compute_robot_state-npc2": 0.07061399863316463, "sim_compute_robot_state-npc3": 0.07735259716327374}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2679245580326427, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06800353527069092, "in-drivable-lane": 0, "agent_compute-ego": 0.15876758098602295, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.10603215477683328, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.04313578388907693, "sim_compute_performance-ego": 0.07728669860146263, "sim_compute_robot_state-ego": 0.0904348763552579, "sim_compute_robot_state-npc0": 0.08036056431857022, "sim_compute_robot_state-npc1": 0.07386553287506104, "sim_compute_robot_state-npc2": 0.07739199291576039, "sim_compute_robot_state-npc3": 0.07732458548112349}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.1980842113494873, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.06905413150787354, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.15138526916503903, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.1003742742538452, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04120028018951416, "sim_compute_performance-ego": 0.07182169437408448, "sim_compute_robot_state-ego": 0.07537510395050048, "sim_compute_robot_state-npc0": 0.0726310920715332, "sim_compute_robot_state-npc1": 0.0705941915512085, "sim_compute_robot_state-npc2": 0.07229021072387695, "sim_compute_robot_state-npc3": 0.07254035949707031}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2251405436941918, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06546889213805503, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.1431552197070832, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.1028529684594337, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.04235585699690149, "sim_compute_performance-ego": 0.07649892949043437, "sim_compute_robot_state-ego": 0.08129870891571045, "sim_compute_robot_state-npc0": 0.07577622444071669, "sim_compute_robot_state-npc1": 0.07417083547470417, "sim_compute_robot_state-npc2": 0.07365939718611697, "sim_compute_robot_state-npc3": 0.07655607385838285}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.23385420670876136, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06769793308698215, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.1496557639195369, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10504039434286264, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.04383929417683528, "sim_compute_performance-ego": 0.07194500244580783, "sim_compute_robot_state-ego": 0.08143355296208309, "sim_compute_robot_state-npc0": 0.07207691210966843, "sim_compute_robot_state-npc1": 0.07369835560138409, "sim_compute_robot_state-npc2": 0.0762828909433805, "sim_compute_robot_state-npc3": 0.07908960030629085}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.2164903618040539, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.06617939585731143, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.14826308886210124, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.099482942762829, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.04352556637355259, "sim_compute_performance-ego": 0.07354088964916411, "sim_compute_robot_state-ego": 0.0787614073072161, "sim_compute_robot_state-npc0": 0.07414175215221587, "sim_compute_robot_state-npc1": 0.07405749502636137, "sim_compute_robot_state-npc2": 0.07363930883861723, "sim_compute_robot_state-npc3": 0.07504286538986933}}
set_robot_commands_max0.10806677726928346
set_robot_commands_mean0.09981314143622086
set_robot_commands_median0.10073697566986084
set_robot_commands_min0.07557839870452882
sim_compute_performance-ego_max0.07799484829107921
sim_compute_performance-ego_mean0.07220034109647736
sim_compute_performance-ego_median0.07274389266967773
sim_compute_performance-ego_min0.05862809658050537
sim_compute_robot_state-ego_max0.0904348763552579
sim_compute_robot_state-ego_mean0.07822342111057559
sim_compute_robot_state-ego_median0.07805474522044357
sim_compute_robot_state-ego_min0.06090038776397705
sim_compute_robot_state-npc0_max0.08036056431857022
sim_compute_robot_state-npc0_mean0.07316280459082525
sim_compute_robot_state-npc0_median0.0733947583607265
sim_compute_robot_state-npc0_min0.058478655815124514
sim_compute_robot_state-npc1_max0.0799860308567683
sim_compute_robot_state-npc1_mean0.07209543713300702
sim_compute_robot_state-npc1_median0.07386553287506104
sim_compute_robot_state-npc1_min0.056223664283752445
sim_compute_robot_state-npc2_max0.07739199291576039
sim_compute_robot_state-npc2_mean0.07215728963684032
sim_compute_robot_state-npc2_median0.07365939718611697
sim_compute_robot_state-npc2_min0.05600606918334961
sim_compute_robot_state-npc3_max0.07908960030629085
sim_compute_robot_state-npc3_mean0.07322092344651526
sim_compute_robot_state-npc3_median0.07504286538986933
sim_compute_robot_state-npc3_min0.05435097694396973
sim_compute_sim_state_max0.045311680117857106
sim_compute_sim_state_mean0.04133938469468548
sim_compute_sim_state_median0.0423206457724938
sim_compute_sim_state_min0.03163711547851562
sim_physics_max0.2679245580326427
sim_physics_mean0.2202051692690641
sim_physics_median0.22035236018044607
sim_physics_min0.179863600730896
sim_render-ego_max0.06974882738930839
sim_render-ego_mean0.06562805285846383
sim_render-ego_median0.06617939585731143
sim_render-ego_min0.05415925979614258
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
229922411jp18813100494Baseline solution using reinforcement learningaido2-LFV-sim-validationstep1-simulationerroryes11740:14:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
229762439Jacopo Tanirandom_agentaido2-LF-sim-testingstep1-simulationsuccessyes11740:17:57Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17153480093357926
agent_compute-ego_mean0.15994833883477627
agent_compute-ego_median0.16326524939718126
agent_compute-ego_min0.1384088611602783
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.12631387180752224, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06712950159002233, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.1644989252090454, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10631742300810636, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04115618158269812, "sim_compute_performance-ego": 0.07472935870841697, "sim_compute_robot_state-ego": 0.08111846888506855}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.1221773671168907, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06768632402607039, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15916667265050552, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10033033875858084, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.04103759690827014, "sim_compute_performance-ego": 0.07585726999769024, "sim_compute_robot_state-ego": 0.0785357063891841}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.15712631449979894, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06914068670833812, "in-drivable-lane": 0, "agent_compute-ego": 0.1585093806771671, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.10687453606549432, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.04874777793884277, "sim_compute_performance-ego": 0.07619661443373736, "sim_compute_robot_state-ego": 0.08029092059415929}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.1259077262878418, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.057783927917480465, "in-drivable-lane": 0, "agent_compute-ego": 0.1384088611602783, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.0968119239807129, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.03720549583435059, "sim_compute_performance-ego": 0.0656602954864502, "sim_compute_robot_state-ego": 0.07159162521362304}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12362095977686628, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06730681733240056, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.16326524939718126, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.1031850983824911, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.04188268094123164, "sim_compute_performance-ego": 0.07119408136681665, "sim_compute_robot_state-ego": 0.07969095435323595}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.1052925829984704, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.06068625255506866, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15405850507775132, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.0952893471231266, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.038762082858961454, "sim_compute_performance-ego": 0.06567595929515604, "sim_compute_robot_state-ego": 0.07297552848348812}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12076024498258318, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.07459964496748787, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16202457462038314, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10225885254996164, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.040928044489451816, "sim_compute_performance-ego": 0.07334030951772418, "sim_compute_robot_state-ego": 0.07944199017116002}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134246065503075, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.06981333096822102, "in-drivable-lane": 0, "agent_compute-ego": 0.1636412370772589, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10733615784418016, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.044615132468087335, "sim_compute_performance-ego": 0.07604442323957171, "sim_compute_robot_state-ego": 0.07824739955720447}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.14561896000878286, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.06788589590686862, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17153480093357926, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.11034656783281746, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.043216875043966, "sim_compute_performance-ego": 0.07680227796910173, "sim_compute_robot_state-ego": 0.09027546139086708}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.13125715255737305, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.06738303357904607, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.16493724909695712, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10854839411648835, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.04230480194091797, "sim_compute_performance-ego": 0.07604419968344948, "sim_compute_robot_state-ego": 0.08202991485595704}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.14149155245198833, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06970769708806818, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.17058033757395558, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.10915143768508712, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04150768069477825, "sim_compute_performance-ego": 0.07655189254067161, "sim_compute_robot_state-ego": 0.08524645458568227}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.14199515751429967, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06973529713494438, "in-drivable-lane": 0, "agent_compute-ego": 0.16832719530378068, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10476061276027136, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04012336901256016, "sim_compute_performance-ego": 0.07118044580732073, "sim_compute_robot_state-ego": 0.08004567452839442}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.11394466138353536, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.05977701205833286, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1530752462499282, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.09862252777697993, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.03950814639820772, "sim_compute_performance-ego": 0.06937506619621725, "sim_compute_robot_state-ego": 0.07226009929881376}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.12980470833954988, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.060903858255456994, "in-drivable-lane": 0, "agent_compute-ego": 0.1653025326905427, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.10874885982937282, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04760429594251844, "sim_compute_performance-ego": 0.06784022295916523, "sim_compute_robot_state-ego": 0.07418070016083894}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.0990832483067232, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.05873493353525797, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.14189431480332915, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.08892759154824649, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.0367423506344066, "sim_compute_performance-ego": 0.06275517099043902, "sim_compute_robot_state-ego": 0.06561688815846163}}
set_robot_commands_max0.11034656783281746
set_robot_commands_mean0.10316731128412784
set_robot_commands_median0.10476061276027136
set_robot_commands_min0.08892759154824649
sim_compute_performance-ego_max0.07680227796910173
sim_compute_performance-ego_mean0.07194983921279523
sim_compute_performance-ego_median0.07334030951772418
sim_compute_performance-ego_min0.06275517099043902
sim_compute_robot_state-ego_max0.09027546139086708
sim_compute_robot_state-ego_mean0.0781031857750759
sim_compute_robot_state-ego_median0.07944199017116002
sim_compute_robot_state-ego_min0.06561688815846163
sim_compute_sim_state_max0.04874777793884277
sim_compute_sim_state_mean0.04168950084594993
sim_compute_sim_state_median0.04115618158269812
sim_compute_sim_state_min0.0367423506344066
sim_physics_max0.15712631449979894
sim_physics_mean0.12790937156902007
sim_physics_median0.12631387180752224
sim_physics_min0.0990832483067232
sim_render-ego_max0.07459964496748787
sim_render-ego_mean0.06588494757487098
sim_render-ego_median0.06738303357904607
sim_render-ego_min0.057783927917480465
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
229432500Liam Paullchallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationsuccessyes11740:22:59Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.16989098333932984
survival_time_median5.999999999999987
deviation-center-line_median0.09700516215369968
in-drivable-lane_median2.8499999999999948


other stats
agent_compute-ego_max0.19063714265823364
agent_compute-ego_mean0.17954617341359458
agent_compute-ego_median0.17926146189371744
agent_compute-ego_min0.1693095397949219
deviation-center-line_max0.5149326144164952
deviation-center-line_mean0.18875630734570936
deviation-center-line_min0.055176021990154915
deviation-heading_max6.03706759109609
deviation-heading_mean3.0367562823392857
deviation-heading_median2.337778188521578
deviation-heading_min0.4769187806207878
driven_any_max1.2763860438329668
driven_any_mean0.6447561517358648
driven_any_median0.5046802893128901
driven_any_min0.09611140033290728
driven_lanedir_consec_max0.46870127726085253
driven_lanedir_consec_mean0.2301678207304392
driven_lanedir_consec_min0.02938220295962002
driven_lanedir_max0.46870127726085253
driven_lanedir_mean0.2301678207304392
driven_lanedir_median0.16989098333932984
driven_lanedir_min0.02938220295962002
in-drivable-lane_max7.450000000000042
in-drivable-lane_mean3.5900000000000154
in-drivable-lane_min0.10000000000000007
per-episodes
details{"udem1-0-0": {"driven_any": 1.2763860438329668, "sim_physics": 0.20811249812444052, "survival_time": 14.950000000000076, "driven_lanedir": 0.46870127726085253, "sim_render-ego": 0.06639371554056804, "in-drivable-lane": 7.000000000000038, "agent_compute-ego": 0.178730898698171, "deviation-heading": 6.03706759109609, "set_robot_commands": 0.10293264150619506, "deviation-center-line": 0.2145522802595322, "driven_lanedir_consec": 0.46870127726085253, "sim_compute_sim_state": 0.043234986464182536, "sim_compute_performance-ego": 0.0734652026494344, "sim_compute_robot_state-ego": 0.07744264284769695, "sim_compute_robot_state-npc0": 0.07371064186096192, "sim_compute_robot_state-npc1": 0.0750965921084086, "sim_compute_robot_state-npc2": 0.07530850013097128, "sim_compute_robot_state-npc3": 0.07585594177246094}, "udem1-1-0": {"driven_any": 1.228587038018929, "sim_physics": 0.22931541681289672, "survival_time": 14.950000000000076, "driven_lanedir": 0.4085933010513707, "sim_render-ego": 0.06922561009724935, "in-drivable-lane": 7.450000000000042, "agent_compute-ego": 0.19063714265823364, "deviation-heading": 5.727632976660504, "set_robot_commands": 0.10236602306365966, "deviation-center-line": 0.5149326144164952, "driven_lanedir_consec": 0.4085933010513707, "sim_compute_sim_state": 0.04328161080678304, "sim_compute_performance-ego": 0.07494593540827434, "sim_compute_robot_state-ego": 0.0809173019727071, "sim_compute_robot_state-npc0": 0.0748743748664856, "sim_compute_robot_state-npc1": 0.0762978196144104, "sim_compute_robot_state-npc2": 0.07554871241251628, "sim_compute_robot_state-npc3": 0.07635698795318603}, "udem1-2-0": {"driven_any": 0.11801598718163096, "sim_physics": 0.25325515747070315, "survival_time": 1.2500000000000004, "driven_lanedir": 0.07427133904102279, "sim_render-ego": 0.06702505111694336, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1693095397949219, "deviation-heading": 0.604383874797468, "set_robot_commands": 0.09785906791687012, "deviation-center-line": 0.09700516215369968, "driven_lanedir_consec": 0.07427133904102279, "sim_compute_sim_state": 0.04112253189086914, "sim_compute_performance-ego": 0.07145792007446289, "sim_compute_robot_state-ego": 0.0746457576751709, "sim_compute_robot_state-npc0": 0.07174093246459962, "sim_compute_robot_state-npc1": 0.07079922676086425, "sim_compute_robot_state-npc2": 0.07264791488647461, "sim_compute_robot_state-npc3": 0.0706085205078125}, "udem1-3-0": {"driven_any": 0.09611140033290728, "sim_physics": 0.23172694842020672, "survival_time": 1.5000000000000009, "driven_lanedir": 0.02938220295962002, "sim_render-ego": 0.06726459662119548, "in-drivable-lane": 0.5500000000000004, "agent_compute-ego": 0.17979182402292887, "deviation-heading": 0.4769187806207878, "set_robot_commands": 0.09374038378397624, "deviation-center-line": 0.062115457908664795, "driven_lanedir_consec": 0.02938220295962002, "sim_compute_sim_state": 0.04054005146026611, "sim_compute_performance-ego": 0.07307710647583007, "sim_compute_robot_state-ego": 0.0797143538792928, "sim_compute_robot_state-npc0": 0.06493157545725504, "sim_compute_robot_state-npc1": 0.06878815491994222, "sim_compute_robot_state-npc2": 0.06922786235809326, "sim_compute_robot_state-npc3": 0.06872215270996093}, "udem1-4-0": {"driven_any": 0.5046802893128901, "sim_physics": 0.21552934845288593, "survival_time": 5.999999999999987, "driven_lanedir": 0.16989098333932984, "sim_render-ego": 0.06574769814809163, "in-drivable-lane": 2.8499999999999948, "agent_compute-ego": 0.17926146189371744, "deviation-heading": 2.337778188521578, "set_robot_commands": 0.10036178032557168, "deviation-center-line": 0.055176021990154915, "driven_lanedir_consec": 0.16989098333932984, "sim_compute_sim_state": 0.0414349635442098, "sim_compute_performance-ego": 0.07255013386408488, "sim_compute_robot_state-ego": 0.0783116598924001, "sim_compute_robot_state-npc0": 0.07724600632985433, "sim_compute_robot_state-npc1": 0.07342073917388917, "sim_compute_robot_state-npc2": 0.07277507781982422, "sim_compute_robot_state-npc3": 0.07234709461530049}}
set_robot_commands_max0.10293264150619506
set_robot_commands_mean0.09945197931925456
set_robot_commands_median0.10036178032557168
set_robot_commands_min0.09374038378397624
sim_compute_performance-ego_max0.07494593540827434
sim_compute_performance-ego_mean0.07309925969441732
sim_compute_performance-ego_median0.07307710647583007
sim_compute_performance-ego_min0.07145792007446289
sim_compute_robot_state-ego_max0.0809173019727071
sim_compute_robot_state-ego_mean0.07820634325345358
sim_compute_robot_state-ego_median0.0783116598924001
sim_compute_robot_state-ego_min0.0746457576751709
sim_compute_robot_state-npc0_max0.07724600632985433
sim_compute_robot_state-npc0_mean0.0725007061958313
sim_compute_robot_state-npc0_median0.07371064186096192
sim_compute_robot_state-npc0_min0.06493157545725504
sim_compute_robot_state-npc1_max0.0762978196144104
sim_compute_robot_state-npc1_mean0.07288050651550293
sim_compute_robot_state-npc1_median0.07342073917388917
sim_compute_robot_state-npc1_min0.06878815491994222
sim_compute_robot_state-npc2_max0.07554871241251628
sim_compute_robot_state-npc2_mean0.07310161352157593
sim_compute_robot_state-npc2_median0.07277507781982422
sim_compute_robot_state-npc2_min0.06922786235809326
sim_compute_robot_state-npc3_max0.07635698795318603
sim_compute_robot_state-npc3_mean0.07277813951174418
sim_compute_robot_state-npc3_median0.07234709461530049
sim_compute_robot_state-npc3_min0.06872215270996093
sim_compute_sim_state_max0.04328161080678304
sim_compute_sim_state_mean0.041922828833262135
sim_compute_sim_state_median0.0414349635442098
sim_compute_sim_state_min0.04054005146026611
sim_physics_max0.25325515747070315
sim_physics_mean0.2275878738562266
sim_physics_median0.22931541681289672
sim_physics_min0.20811249812444052
sim_render-ego_max0.06922561009724935
sim_render-ego_mean0.06713133430480958
sim_render-ego_median0.06702505111694336
sim_render-ego_min0.06574769814809163
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.730000000000028
survival_time_min1.2500000000000004
229172524Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11740:02:51
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228722598Liam Paullchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationerroryes11740:35:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228672605Konstantin Chaykachallenge-aido_LF-template-ros - Template solution using ROSaido2-LF-sim-validationstep1-simulationsuccessyes11740:06:07Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36592094708219225
survival_time_median2.3999999999999995
deviation-center-line_median0.1166759393545397
in-drivable-lane_median0.29999999999999893


other stats
agent_compute-ego_max0.07922933101654053
agent_compute-ego_mean0.07322033485702589
agent_compute-ego_median0.07351755760085414
agent_compute-ego_min0.06663360378958962
deviation-center-line_max0.16987818035809085
deviation-center-line_mean0.13199870851217008
deviation-center-line_min0.1011892720306074
deviation-heading_max0.5809378480871981
deviation-heading_mean0.4194004386292103
deviation-heading_median0.34882560565471876
deviation-heading_min0.2596285487829774
driven_any_max0.922682252912863
driven_any_mean0.6324710235085378
driven_any_median0.609146202404747
driven_any_min0.2364518949491652
driven_lanedir_consec_max0.6632135184572027
driven_lanedir_consec_mean0.4245071231796042
driven_lanedir_consec_min0.2221238695940002
driven_lanedir_max0.6632135184572027
driven_lanedir_mean0.4245071231796042
driven_lanedir_median0.36592094708219225
driven_lanedir_min0.2221238695940002
in-drivable-lane_max1.8999999999999944
in-drivable-lane_mean0.6299999999999986
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.922682252912863, "sim_physics": 0.12479513128038865, "survival_time": 3.5499999999999954, "driven_lanedir": 0.36592094708219225, "sim_render-ego": 0.06361840140651649, "in-drivable-lane": 1.8999999999999944, "agent_compute-ego": 0.07351755760085414, "deviation-heading": 0.2596285487829774, "set_robot_commands": 0.1005266182859179, "deviation-center-line": 0.16987818035809085, "driven_lanedir_consec": 0.36592094708219225, "sim_compute_sim_state": 0.0392926511630206, "sim_compute_performance-ego": 0.0742083468907316, "sim_compute_robot_state-ego": 0.0779924191219706}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7993934895811189, "sim_physics": 0.1250001867612203, "survival_time": 2.9999999999999973, "driven_lanedir": 0.6632135184572027, "sim_render-ego": 0.06719919840494791, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.07922933101654053, "deviation-heading": 0.5809378480871981, "set_robot_commands": 0.11114412546157836, "deviation-center-line": 0.1166759393545397, "driven_lanedir_consec": 0.6632135184572027, "sim_compute_sim_state": 0.043691182136535646, "sim_compute_performance-ego": 0.07635226249694824, "sim_compute_robot_state-ego": 0.08967557350794474}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2364518949491652, "sim_physics": 0.13287622278386896, "survival_time": 1.1000000000000003, "driven_lanedir": 0.2221238695940002, "sim_render-ego": 0.06317079067230225, "in-drivable-lane": 0, "agent_compute-ego": 0.06663360378958962, "deviation-heading": 0.34882560565471876, "set_robot_commands": 0.1001909537748857, "deviation-center-line": 0.11316665887359229, "driven_lanedir_consec": 0.2221238695940002, "sim_compute_sim_state": 0.04051881486719305, "sim_compute_performance-ego": 0.07297420501708984, "sim_compute_robot_state-ego": 0.07871494509957054}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.5946812776947944, "sim_physics": 0.13793106377124786, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5792955579972934, "sim_render-ego": 0.06511370340983073, "in-drivable-lane": 0, "agent_compute-ego": 0.06937586764494579, "deviation-heading": 0.5685240160177978, "set_robot_commands": 0.09524545570214588, "deviation-center-line": 0.15908349194402024, "driven_lanedir_consec": 0.5792955579972934, "sim_compute_sim_state": 0.04040399193763733, "sim_compute_performance-ego": 0.06803790231545766, "sim_compute_robot_state-ego": 0.07799123724301656}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.609146202404747, "sim_physics": 0.12471167937568996, "survival_time": 2.3, "driven_lanedir": 0.2919817227673325, "sim_render-ego": 0.06803216623223346, "in-drivable-lane": 0.9499999999999992, "agent_compute-ego": 0.07734531423319942, "deviation-heading": 0.3390861746033595, "set_robot_commands": 0.10622351584227188, "deviation-center-line": 0.1011892720306074, "driven_lanedir_consec": 0.2919817227673325, "sim_compute_sim_state": 0.04242764348569124, "sim_compute_performance-ego": 0.07734831001447595, "sim_compute_robot_state-ego": 0.08291626494863759}}
set_robot_commands_max0.11114412546157836
set_robot_commands_mean0.10266613381335994
set_robot_commands_median0.1005266182859179
set_robot_commands_min0.09524545570214588
sim_compute_performance-ego_max0.07734831001447595
sim_compute_performance-ego_mean0.07378420534694066
sim_compute_performance-ego_median0.0742083468907316
sim_compute_performance-ego_min0.06803790231545766
sim_compute_robot_state-ego_max0.08967557350794474
sim_compute_robot_state-ego_mean0.081458087984228
sim_compute_robot_state-ego_median0.07871494509957054
sim_compute_robot_state-ego_min0.07799123724301656
sim_compute_sim_state_max0.043691182136535646
sim_compute_sim_state_mean0.041266856718015575
sim_compute_sim_state_median0.04051881486719305
sim_compute_sim_state_min0.0392926511630206
sim_physics_max0.13793106377124786
sim_physics_mean0.12906285679448315
sim_physics_median0.1250001867612203
sim_physics_min0.12471167937568996
sim_render-ego_max0.06803216623223346
sim_render-ego_mean0.06542685202516617
sim_render-ego_median0.06511370340983073
sim_render-ego_min0.06317079067230225
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean2.469999999999999
survival_time_min1.1000000000000003
228542628Andrea Censichallenge-aido_LF-template-randomaido2-LF-sim-testingstep1-simulationsuccessyes11740:17:54Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5723310224856362
survival_time_median2.549999999999999
deviation-center-line_median0.10099507669212504
in-drivable-lane_median0.4499999999999984


other stats
agent_compute-ego_max0.17225377647965043
agent_compute-ego_mean0.16102313739093518
agent_compute-ego_median0.16301769368788777
agent_compute-ego_min0.13763864161604542
deviation-center-line_max0.2838635700333795
deviation-center-line_mean0.12786165368054708
deviation-center-line_min0.07112529346797256
deviation-heading_max0.5289022616823588
deviation-heading_mean0.3391682685652287
deviation-heading_median0.32928385103533875
deviation-heading_min0.19401296908406307
driven_any_max2.1706243860917107
driven_any_mean0.9759490378276146
driven_any_median1.0117660515775693
driven_any_min0.23626560261560617
driven_lanedir_consec_max1.919400421063832
driven_lanedir_consec_mean0.6896171461819246
driven_lanedir_consec_min0.2264965947033466
driven_lanedir_max1.919400421063832
driven_lanedir_mean0.6896171461819246
driven_lanedir_median0.5723310224856362
driven_lanedir_min0.2264965947033466
in-drivable-lane_max1.7999999999999936
in-drivable-lane_mean0.5899999999999982
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1498718129263984, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06974489600570113, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.17225377647965043, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.1115954319636027, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.04417810175153944, "sim_compute_performance-ego": 0.08308891896848325, "sim_compute_robot_state-ego": 0.0953698643931636}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9933867744747804, "sim_physics": 0.12379118507983636, "survival_time": 2.549999999999999, "driven_lanedir": 0.8010406009604816, "sim_render-ego": 0.06529650501176423, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16672329809151443, "deviation-heading": 0.5289022616823588, "set_robot_commands": 0.10239255662057914, "deviation-center-line": 0.13005513204193506, "driven_lanedir_consec": 0.8010406009604816, "sim_compute_sim_state": 0.041261574801276714, "sim_compute_performance-ego": 0.07416825668484557, "sim_compute_robot_state-ego": 0.08294192949930827}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.23626560261560617, "sim_physics": 0.13659073324764476, "survival_time": 0.8500000000000002, "driven_lanedir": 0.2264965947033466, "sim_render-ego": 0.06399203749263987, "in-drivable-lane": 0, "agent_compute-ego": 0.16301769368788777, "deviation-heading": 0.23048898560984332, "set_robot_commands": 0.13353894738590016, "deviation-center-line": 0.0788839760023766, "driven_lanedir_consec": 0.2264965947033466, "sim_compute_sim_state": 0.038338548996869254, "sim_compute_performance-ego": 0.0739599396200741, "sim_compute_robot_state-ego": 0.08196129518396714}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4346971317320432, "sim_physics": 0.13057538032531738, "survival_time": 1.2500000000000004, "driven_lanedir": 0.40985475638935265, "sim_render-ego": 0.062299041748046874, "in-drivable-lane": 0, "agent_compute-ego": 0.15021183967590332, "deviation-heading": 0.4138862827398061, "set_robot_commands": 0.09588328361511232, "deviation-center-line": 0.08421324241865966, "driven_lanedir_consec": 0.40985475638935265, "sim_compute_sim_state": 0.0409451961517334, "sim_compute_performance-ego": 0.06807896614074707, "sim_compute_robot_state-ego": 0.06950505256652832}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.618214457700942, "sim_physics": 0.12776169897634773, "survival_time": 3.949999999999994, "driven_lanedir": 0.7890999076769956, "sim_render-ego": 0.06806687765483614, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.17186774785005593, "deviation-heading": 0.23606825392187256, "set_robot_commands": 0.10863616194906114, "deviation-center-line": 0.2072381278624381, "driven_lanedir_consec": 0.7890999076769956, "sim_compute_sim_state": 0.0435569889937775, "sim_compute_performance-ego": 0.07833936244626588, "sim_compute_robot_state-ego": 0.08386188820947575}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0038514956833002, "sim_physics": 0.12098511871026486, "survival_time": 2.4499999999999993, "driven_lanedir": 0.7531703123735944, "sim_render-ego": 0.0648019654410226, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.15882987878760513, "deviation-heading": 0.4596437246381204, "set_robot_commands": 0.09976115032118194, "deviation-center-line": 0.08968283443958727, "driven_lanedir_consec": 0.7531703123735944, "sim_compute_sim_state": 0.039918962790041555, "sim_compute_performance-ego": 0.07399408184752172, "sim_compute_robot_state-ego": 0.08155087062290736}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0542898001504375, "sim_physics": 0.12869137525558472, "survival_time": 2.799999999999998, "driven_lanedir": 0.5389398655375865, "sim_render-ego": 0.06347479564802987, "in-drivable-lane": 1.1499999999999972, "agent_compute-ego": 0.16273278423718043, "deviation-heading": 0.4109275195546752, "set_robot_commands": 0.10340808544840133, "deviation-center-line": 0.10786249131209884, "driven_lanedir_consec": 0.5389398655375865, "sim_compute_sim_state": 0.041867545672825406, "sim_compute_performance-ego": 0.07292242986815316, "sim_compute_robot_state-ego": 0.08045358317238945}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.3164475681403097, "sim_physics": 0.134451048714774, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3093025166124813, "sim_render-ego": 0.05894431613740467, "in-drivable-lane": 0, "agent_compute-ego": 0.15699310529799687, "deviation-heading": 0.2242052814634115, "set_robot_commands": 0.10819331804911296, "deviation-center-line": 0.09758615464743424, "driven_lanedir_consec": 0.3093025166124813, "sim_compute_sim_state": 0.040594634555635, "sim_compute_performance-ego": 0.0703417460123698, "sim_compute_robot_state-ego": 0.07577334131513323}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 1.2018528489510765, "sim_physics": 0.101647049693738, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6922532395203, "sim_render-ego": 0.05613200543290478, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.13763864161604542, "deviation-heading": 0.32928385103533875, "set_robot_commands": 0.0954720489049362, "deviation-center-line": 0.07112529346797256, "driven_lanedir_consec": 0.6922532395203, "sim_compute_sim_state": 0.03573831865342997, "sim_compute_performance-ego": 0.06335610858464645, "sim_compute_robot_state-ego": 0.07046964208958513}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.0435481553257333, "sim_physics": 0.11997684998945755, "survival_time": 2.7499999999999982, "driven_lanedir": 0.5204405548974873, "sim_render-ego": 0.0644646861336448, "in-drivable-lane": 1.1499999999999977, "agent_compute-ego": 0.15785719698125666, "deviation-heading": 0.33296447766287096, "set_robot_commands": 0.10002633008089933, "deviation-center-line": 0.0950267943453044, "driven_lanedir_consec": 0.5204405548974873, "sim_compute_sim_state": 0.03997471549294212, "sim_compute_performance-ego": 0.07411769953641024, "sim_compute_robot_state-ego": 0.07423527457497336}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.5954548672193265, "sim_physics": 0.13877824064973113, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1042463557848754, "sim_render-ego": 0.06751295188804726, "in-drivable-lane": 1.0499999999999965, "agent_compute-ego": 0.16796347382780794, "deviation-heading": 0.3566810710676767, "set_robot_commands": 0.1078834564654858, "deviation-center-line": 0.22513914436082189, "driven_lanedir_consec": 1.1042463557848754, "sim_compute_sim_state": 0.04310830227740399, "sim_compute_performance-ego": 0.07489075598778663, "sim_compute_robot_state-ego": 0.08594622859707127}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.49030923107489305, "sim_physics": 0.13372445106506348, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4826393189617785, "sim_render-ego": 0.06547355651855469, "in-drivable-lane": 0, "agent_compute-ego": 0.1642141342163086, "deviation-heading": 0.23322336656472228, "set_robot_commands": 0.10845414229801724, "deviation-center-line": 0.10099507669212504, "driven_lanedir_consec": 0.4826393189617785, "sim_compute_sim_state": 0.04093139512198312, "sim_compute_performance-ego": 0.07280327592577253, "sim_compute_robot_state-ego": 0.07727540390832084}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0117660515775693, "sim_physics": 0.1300793956307804, "survival_time": 2.549999999999999, "driven_lanedir": 0.791717039833255, "sim_render-ego": 0.0641325081095976, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.1641879595962225, "deviation-heading": 0.320449356593834, "set_robot_commands": 0.10690711993797151, "deviation-center-line": 0.1017166571540705, "driven_lanedir_consec": 0.791717039833255, "sim_compute_sim_state": 0.041558419956880456, "sim_compute_performance-ego": 0.07339564491720761, "sim_compute_robot_state-ego": 0.08054917933894139}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.44419823353351984, "sim_physics": 0.13842570340191876, "survival_time": 1.3500000000000003, "driven_lanedir": 0.4333246859278659, "sim_render-ego": 0.06478438553986726, "in-drivable-lane": 0, "agent_compute-ego": 0.15706675140946, "deviation-heading": 0.2988926743481924, "set_robot_commands": 0.1009773854856138, "deviation-center-line": 0.08545702330592322, "driven_lanedir_consec": 0.4333246859278659, "sim_compute_sim_state": 0.04147273522836191, "sim_compute_performance-ego": 0.07139028443230523, "sim_compute_robot_state-ego": 0.07558347560741284}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 2.1706243860917107, "sim_physics": 0.12719276372124166, "survival_time": 5.09999999999999, "driven_lanedir": 1.919400421063832, "sim_render-ego": 0.06595975277470607, "in-drivable-lane": 0.4999999999999982, "agent_compute-ego": 0.16378877910913206, "deviation-heading": 0.5178939525116442, "set_robot_commands": 0.10384636533026602, "deviation-center-line": 0.2838635700333795, "driven_lanedir_consec": 1.919400421063832, "sim_compute_sim_state": 0.040915274152568744, "sim_compute_performance-ego": 0.07444617093778123, "sim_compute_robot_state-ego": 0.07971664970996332}}
set_robot_commands_max0.13353894738590016
set_robot_commands_mean0.10579838559040942
set_robot_commands_median0.10384636533026602
set_robot_commands_min0.0954720489049362
sim_compute_performance-ego_max0.08308891896848325
sim_compute_performance-ego_mean0.0732862427940247
sim_compute_performance-ego_median0.0739599396200741
sim_compute_performance-ego_min0.06335610858464645
sim_compute_robot_state-ego_max0.0953698643931636
sim_compute_robot_state-ego_mean0.07967957858594274
sim_compute_robot_state-ego_median0.08045358317238945
sim_compute_robot_state-ego_min0.06950505256652832
sim_compute_sim_state_max0.04417810175153944
sim_compute_sim_state_mean0.04095738097315124
sim_compute_sim_state_median0.0409451961517334
sim_compute_sim_state_min0.03573831865342997
sim_physics_max0.1498718129263984
sim_physics_mean0.1295028538258733
sim_physics_median0.1300793956307804
sim_physics_min0.101647049693738
sim_render-ego_max0.06974489600570113
sim_render-ego_mean0.06433868543578453
sim_render-ego_median0.06478438553986726
sim_render-ego_min0.05613200543290478
simulation-passed1
survival_time_max5.09999999999999
survival_time_mean2.503333333333331
survival_time_min0.8500000000000002
228272684RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationerroryes11740:33:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228172704RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:17Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4690786702157119
survival_time_median6.699999999999984
deviation-center-line_median0.43723008973912375
in-drivable-lane_median0.30000000000000027


other stats
agent_compute-ego_max0.1124172169821603
agent_compute-ego_mean0.10786089040848408
agent_compute-ego_median0.10713587999343872
agent_compute-ego_min0.10383313162284984
deviation-center-line_max1.1001113356478638
deviation-center-line_mean0.5500121744977544
deviation-center-line_min0.22790491168772548
deviation-heading_max4.765786249064606
deviation-heading_mean2.47491997496173
deviation-heading_median2.30847155631943
deviation-heading_min0.4615150699879939
driven_any_max2.348942849935891
driven_any_mean1.1643384083031203
driven_any_median1.0230267571294585
driven_any_min0.40439861257061344
driven_lanedir_consec_max1.3229345330603266
driven_lanedir_consec_mean0.7484811054738307
driven_lanedir_consec_min0.3149562081743923
driven_lanedir_max2.063205888072332
driven_lanedir_mean0.9371390524751284
driven_lanedir_median0.5179745881688755
driven_lanedir_min0.3978460021441807
in-drivable-lane_max2.6499999999999906
in-drivable-lane_mean0.6999999999999997
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.3356737866289494, "sim_physics": 0.17366333961486816, "survival_time": 8.74999999999999, "driven_lanedir": 1.237590113774542, "sim_render-ego": 0.08208147321428572, "in-drivable-lane": 0, "agent_compute-ego": 0.1124172169821603, "deviation-heading": 2.6693194626371435, "set_robot_commands": 0.14752900532313756, "deviation-center-line": 0.7028691875713812, "driven_lanedir_consec": 1.237590113774542, "sim_compute_sim_state": 0.05027055604117257, "sim_compute_performance-ego": 0.0932267393384661, "sim_compute_robot_state-ego": 0.10942725317818776}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7096500352506895, "sim_physics": 0.1762840371382864, "survival_time": 4.749999999999991, "driven_lanedir": 0.5179745881688755, "sim_render-ego": 0.07936466618588096, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.10678895649157072, "deviation-heading": 2.30847155631943, "set_robot_commands": 0.1438944515429045, "deviation-center-line": 0.43723008973912375, "driven_lanedir_consec": 0.3149562081743923, "sim_compute_sim_state": 0.04925867381848787, "sim_compute_performance-ego": 0.09145562523289733, "sim_compute_robot_state-ego": 0.10659711235447934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.40439861257061344, "sim_physics": 0.15296790474339536, "survival_time": 2.849999999999998, "driven_lanedir": 0.3978460021441807, "sim_render-ego": 0.07481411883705541, "in-drivable-lane": 0, "agent_compute-ego": 0.10383313162284984, "deviation-heading": 0.4615150699879939, "set_robot_commands": 0.1307845157489442, "deviation-center-line": 0.28194534784267833, "driven_lanedir_consec": 0.3978460021441807, "sim_compute_sim_state": 0.0476942731623064, "sim_compute_performance-ego": 0.08369564173514382, "sim_compute_robot_state-ego": 0.09850845838847912}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.0230267571294585, "sim_physics": 0.17613901131188692, "survival_time": 6.699999999999984, "driven_lanedir": 0.4690786702157119, "sim_render-ego": 0.07964091692397844, "in-drivable-lane": 2.6499999999999906, "agent_compute-ego": 0.10912926695240076, "deviation-heading": 2.1695075367994776, "set_robot_commands": 0.1397257811987578, "deviation-center-line": 0.22790491168772548, "driven_lanedir_consec": 0.4690786702157119, "sim_compute_sim_state": 0.04884407235615289, "sim_compute_performance-ego": 0.08942116552324438, "sim_compute_robot_state-ego": 0.1050582768312141}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.348942849935891, "sim_physics": 0.16706646998723348, "survival_time": 14.950000000000076, "driven_lanedir": 2.063205888072332, "sim_render-ego": 0.07924894253412883, "in-drivable-lane": 0.5500000000000078, "agent_compute-ego": 0.10713587999343872, "deviation-heading": 4.765786249064606, "set_robot_commands": 0.14324581305185954, "deviation-center-line": 1.1001113356478638, "driven_lanedir_consec": 1.3229345330603266, "sim_compute_sim_state": 0.05035711685816447, "sim_compute_performance-ego": 0.09196914990743, "sim_compute_robot_state-ego": 0.10849599997202557}}
set_robot_commands_max0.14752900532313756
set_robot_commands_mean0.14103591337312074
set_robot_commands_median0.14324581305185954
set_robot_commands_min0.1307845157489442
sim_compute_performance-ego_max0.0932267393384661
sim_compute_performance-ego_mean0.08995366434743632
sim_compute_performance-ego_median0.09145562523289733
sim_compute_performance-ego_min0.08369564173514382
sim_compute_robot_state-ego_max0.10942725317818776
sim_compute_robot_state-ego_mean0.10561742014487718
sim_compute_robot_state-ego_median0.10659711235447934
sim_compute_robot_state-ego_min0.09850845838847912
sim_compute_sim_state_max0.05035711685816447
sim_compute_sim_state_mean0.04928493844725684
sim_compute_sim_state_median0.04925867381848787
sim_compute_sim_state_min0.0476942731623064
sim_physics_max0.1762840371382864
sim_physics_mean0.1692241525591341
sim_physics_median0.17366333961486816
sim_physics_min0.15296790474339536
sim_render-ego_max0.08208147321428572
sim_render-ego_mean0.07903002353906588
sim_render-ego_median0.07936466618588096
sim_render-ego_min0.07481411883705541
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.600000000000008
survival_time_min2.849999999999998
228092720jp18813100494test for ppoaido2-LFV-sim-validationstep1-simulationerroryes11740:01:26
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
228032738Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationfailedyes11740:01:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227962750RamiNaimchallenge-aido_LF-baseline-duckietownaido2-LFVI-sim-testingstep1-simulationfailedyes11740:02:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 174, in read_one
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 293, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "agent".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "experiment_manager.py", line 297, in run_episode
    r: MsgReceived = agent.write_topic_and_expect('get_commands', expect='commands')
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 93, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 236, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/agent-out after 1 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 301, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227642808Andrea Censichallenge-aido_LF-template-random - random_agentaido2-LFV-sim-testingstep1-simulationerroryes11740:16:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
227182912duckietown_mumchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessyes11740:42:42Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6837273236612166
survival_time_median4.94999999999999
deviation-center-line_median0.43975479509459126
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12002656748006632
agent_compute-ego_mean0.10914547419656552
agent_compute-ego_median0.10892419815063475
agent_compute-ego_min0.10202478322406744
deviation-center-line_max1.2721313178412608
deviation-center-line_mean0.5893348871327595
deviation-center-line_min0.24410092721481208
deviation-heading_max6.453263307977294
deviation-heading_mean2.1546432074673585
deviation-heading_median1.5129813241786394
deviation-heading_min0.4373212219820167
driven_any_max2.348558989556984
driven_any_mean1.1163339466932387
driven_any_median0.7418613949850633
driven_any_min0.4606555285961886
driven_lanedir_consec_max2.228533937766365
driven_lanedir_consec_mean0.8987143264747512
driven_lanedir_consec_min0.1861187831111168
driven_lanedir_max2.228533937766365
driven_lanedir_mean0.9622998423487278
driven_lanedir_median0.6837273236612166
driven_lanedir_min0.40384149041945183
in-drivable-lane_max3.3500000000000085
in-drivable-lane_mean0.35666666666666774
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8064532800860137, "sim_physics": 0.15523818024882563, "survival_time": 5.399999999999989, "driven_lanedir": 0.6729079920553045, "sim_render-ego": 0.07412992583380805, "in-drivable-lane": 0, "agent_compute-ego": 0.11500471830368042, "deviation-heading": 2.338287136023455, "set_robot_commands": 0.11571491206133808, "deviation-center-line": 0.43975479509459126, "driven_lanedir_consec": 0.6729079920553045, "sim_compute_sim_state": 0.045239258695531775, "sim_compute_performance-ego": 0.08333598022107724, "sim_compute_robot_state-ego": 0.11717633406321208}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.341040829581571, "sim_physics": 0.12393541944106952, "survival_time": 14.900000000000077, "driven_lanedir": 2.228533937766365, "sim_render-ego": 0.0698603359644845, "in-drivable-lane": 0, "agent_compute-ego": 0.10202478322406744, "deviation-heading": 3.746017089387239, "set_robot_commands": 0.10757881282960008, "deviation-center-line": 1.2721313178412608, "driven_lanedir_consec": 2.228533937766365, "sim_compute_sim_state": 0.043052817351066024, "sim_compute_performance-ego": 0.07823440452550082, "sim_compute_robot_state-ego": 0.08373634607199855}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.4606555285961886, "sim_physics": 0.13677407056093216, "survival_time": 3.1999999999999966, "driven_lanedir": 0.4557157778087744, "sim_render-ego": 0.06989434733986855, "in-drivable-lane": 0, "agent_compute-ego": 0.10652729496359824, "deviation-heading": 0.4373212219820167, "set_robot_commands": 0.10860570892691612, "deviation-center-line": 0.3530114034861149, "driven_lanedir_consec": 0.4557157778087744, "sim_compute_sim_state": 0.04484963417053223, "sim_compute_performance-ego": 0.07762512564659119, "sim_compute_robot_state-ego": 0.08664089441299438}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.2963070546222222, "sim_physics": 0.1366801829565139, "survival_time": 8.399999999999984, "driven_lanedir": 1.1956055366213958, "sim_render-ego": 0.07053653257233757, "in-drivable-lane": 0, "agent_compute-ego": 0.10862772521518524, "deviation-heading": 2.4672483812519808, "set_robot_commands": 0.11170452549344018, "deviation-center-line": 0.6289473405344799, "driven_lanedir_consec": 1.1956055366213958, "sim_compute_sim_state": 0.04343199020340329, "sim_compute_performance-ego": 0.07942006417683192, "sim_compute_robot_state-ego": 0.08549261660802931}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9910417952728108, "sim_physics": 0.14006169759310208, "survival_time": 6.499999999999985, "driven_lanedir": 0.9707966108369646, "sim_render-ego": 0.07042123721196102, "in-drivable-lane": 0, "agent_compute-ego": 0.10745641268216646, "deviation-heading": 1.1334477131845269, "set_robot_commands": 0.10925493423755352, "deviation-center-line": 0.5089338340831535, "driven_lanedir_consec": 0.9707966108369646, "sim_compute_sim_state": 0.04365975489983192, "sim_compute_performance-ego": 0.07897150699908917, "sim_compute_robot_state-ego": 0.08964756635519175}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.115898799782459, "sim_physics": 0.1383212442751284, "survival_time": 13.500000000000057, "driven_lanedir": 1.6291695171631568, "sim_render-ego": 0.07210627131991916, "in-drivable-lane": 1.20000000000001, "agent_compute-ego": 0.10892419815063475, "deviation-heading": 5.369026592114659, "set_robot_commands": 0.11040590339236787, "deviation-center-line": 1.0229304977502416, "driven_lanedir_consec": 1.3534265780820034, "sim_compute_sim_state": 0.04480123696503816, "sim_compute_performance-ego": 0.08088708718617757, "sim_compute_robot_state-ego": 0.09078511220437507}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7418613949850633, "sim_physics": 0.1449461802087649, "survival_time": 4.94999999999999, "driven_lanedir": 0.6837273236612166, "sim_render-ego": 0.07139319121235549, "in-drivable-lane": 0, "agent_compute-ego": 0.10985164690499354, "deviation-heading": 1.5129813241786394, "set_robot_commands": 0.11173984498688667, "deviation-center-line": 0.24410092721481208, "driven_lanedir_consec": 0.6837273236612166, "sim_compute_sim_state": 0.04472651626124526, "sim_compute_performance-ego": 0.08129466663707387, "sim_compute_robot_state-ego": 0.09159465269608932}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6454834591129418, "sim_physics": 0.1336477405723484, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6112352152081411, "sim_render-ego": 0.07143242879845631, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10975946777168362, "deviation-heading": 0.6202910046485036, "set_robot_commands": 0.1085962454477946, "deviation-center-line": 0.4608594616969349, "driven_lanedir_consec": 0.6112352152081411, "sim_compute_sim_state": 0.04501669708339647, "sim_compute_performance-ego": 0.08070861334088204, "sim_compute_robot_state-ego": 0.0874576376772475}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.027646664152992, "sim_physics": 0.131923753782589, "survival_time": 12.950000000000047, "driven_lanedir": 1.9595513614967557, "sim_render-ego": 0.07270508935552766, "in-drivable-lane": 0, "agent_compute-ego": 0.1057048681620005, "deviation-heading": 2.9149126077859, "set_robot_commands": 0.109708799818768, "deviation-center-line": 1.038992644540054, "driven_lanedir_consec": 1.9595513614967557, "sim_compute_sim_state": 0.04395919140701589, "sim_compute_performance-ego": 0.07951601960023857, "sim_compute_robot_state-ego": 0.088360375879354}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.5811742718269185, "sim_physics": 0.1388565347164492, "survival_time": 3.949999999999994, "driven_lanedir": 0.5637689913271047, "sim_render-ego": 0.07222413714927962, "in-drivable-lane": 0, "agent_compute-ego": 0.11086966719808458, "deviation-heading": 0.7612967014824786, "set_robot_commands": 0.10894898523258258, "deviation-center-line": 0.3910991881820957, "driven_lanedir_consec": 0.5637689913271047, "sim_compute_sim_state": 0.04309451429149772, "sim_compute_performance-ego": 0.07998615276964405, "sim_compute_robot_state-ego": 0.0890907698039767}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 2.348558989556984, "sim_physics": 0.1363701860109965, "survival_time": 14.950000000000076, "driven_lanedir": 1.4095235539750124, "sim_render-ego": 0.07097516059875489, "in-drivable-lane": 3.3500000000000085, "agent_compute-ego": 0.114320334593455, "deviation-heading": 6.453263307977294, "set_robot_commands": 0.1166515080134074, "deviation-center-line": 1.0002895414500463, "driven_lanedir_consec": 0.9492064622548524, "sim_compute_sim_state": 0.045437937577565514, "sim_compute_performance-ego": 0.07995086352030437, "sim_compute_robot_state-ego": 0.08945116837819417}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4847565051971733, "sim_physics": 0.1487763675291147, "survival_time": 3.349999999999996, "driven_lanedir": 0.44459564370011984, "sim_render-ego": 0.07107957797263985, "in-drivable-lane": 0.14999999999999947, "agent_compute-ego": 0.10895649710697916, "deviation-heading": 0.6586166088826472, "set_robot_commands": 0.11068138079856758, "deviation-center-line": 0.27386050672666606, "driven_lanedir_consec": 0.44459564370011984, "sim_compute_sim_state": 0.04941520406239068, "sim_compute_performance-ego": 0.10736167252953371, "sim_compute_robot_state-ego": 0.09011587811939752}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.6774666548068774, "sim_physics": 0.14349046120276818, "survival_time": 4.549999999999992, "driven_lanedir": 0.40384149041945183, "sim_render-ego": 0.07384252548217773, "in-drivable-lane": 0.49999999999999933, "agent_compute-ego": 0.12002656748006632, "deviation-heading": 2.565445460771033, "set_robot_commands": 0.11146619031717488, "deviation-center-line": 0.3832243427749023, "driven_lanedir_consec": 0.1861187831111168, "sim_compute_sim_state": 0.04383364876548013, "sim_compute_performance-ego": 0.08148563301170265, "sim_compute_robot_state-ego": 0.08755168547997108}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.7097753079948844, "sim_physics": 0.14662983292027523, "survival_time": 4.749999999999991, "driven_lanedir": 0.6989490370993754, "sim_render-ego": 0.06919146086040297, "in-drivable-lane": 0, "agent_compute-ego": 0.10290822982788086, "deviation-heading": 0.7571929715418617, "set_robot_commands": 0.10792202196623148, "deviation-center-line": 0.4335018814922893, "driven_lanedir_consec": 0.6989490370993754, "sim_compute_sim_state": 0.04276863650271767, "sim_compute_performance-ego": 0.08115842216893246, "sim_compute_robot_state-ego": 0.0855759997116892}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.5168886648234753, "sim_physics": 0.12977880491337307, "survival_time": 3.5499999999999954, "driven_lanedir": 0.5065756460917794, "sim_render-ego": 0.0687989718477491, "in-drivable-lane": 0, "agent_compute-ego": 0.1062197013640068, "deviation-heading": 0.5842999907981381, "set_robot_commands": 0.10735787472254792, "deviation-center-line": 0.38838562412375144, "driven_lanedir_consec": 0.5065756460917794, "sim_compute_sim_state": 0.04344510024702045, "sim_compute_performance-ego": 0.07821351373699349, "sim_compute_robot_state-ego": 0.08741294833975778}}
set_robot_commands_max0.1166515080134074
set_robot_commands_mean0.11042250988301182
set_robot_commands_median0.109708799818768
set_robot_commands_min0.10735787472254792
sim_compute_performance-ego_max0.10736167252953371
sim_compute_performance-ego_mean0.08187664840470489
sim_compute_performance-ego_median0.07998615276964405
sim_compute_performance-ego_min0.07762512564659119
sim_compute_robot_state-ego_max0.11717633406321208
sim_compute_robot_state-ego_mean0.0900059990534319
sim_compute_robot_state-ego_median0.088360375879354
sim_compute_robot_state-ego_min0.08373634607199855
sim_compute_sim_state_max0.04941520406239068
sim_compute_sim_state_mean0.04444880923224888
sim_compute_sim_state_median0.04395919140701589
sim_compute_sim_state_min0.04276863650271767
sim_physics_max0.15523818024882563
sim_physics_mean0.13902871046215007
sim_physics_median0.1383212442751284
sim_physics_min0.12393541944106952
sim_render-ego_max0.07412992583380805
sim_render-ego_mean0.07123941290131483
sim_render-ego_median0.07107957797263985
sim_render-ego_min0.0687989718477491
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.283333333333344
survival_time_min3.1999999999999966
226383064awoo424Baseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11740:59:44
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
226073112awoo424HKU Duckietown Projectaido2-LF-sim-validationstep1-simulationerroryes11740:31:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225843131MYFtestaido2-LF-sim-validationstep1-simulationsuccessyes11740:27:56Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.617101099302686
survival_time_median14.950000000000076
deviation-center-line_median0.711561120073908
in-drivable-lane_median0.10000000000000142


other stats
agent_compute-ego_max0.19362216552098593
agent_compute-ego_mean0.1817063414365396
agent_compute-ego_median0.18054336865743
agent_compute-ego_min0.16634554386138917
deviation-center-line_max0.877374497707077
deviation-center-line_mean0.6431859473680189
deviation-center-line_min0.30949867095295225
deviation-heading_max3.373141059224481
deviation-heading_mean2.3371645655672615
deviation-heading_median2.534615641386155
deviation-heading_min1.2744894179398418
driven_any_max4.002414967673113
driven_any_mean3.389373687226191
driven_any_median3.749060757253467
driven_any_min1.7251577151264474
driven_lanedir_consec_max3.957438556809131
driven_lanedir_consec_mean3.10510675350678
driven_lanedir_consec_min1.279642849542992
driven_lanedir_max3.957438556809131
driven_lanedir_mean3.10510675350678
driven_lanedir_median3.617101099302686
driven_lanedir_min1.279642849542992
in-drivable-lane_max2.15000000000001
in-drivable-lane_mean0.7800000000000014
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 3.7191142290033494, "sim_physics": 0.13416233777999878, "survival_time": 14.950000000000076, "driven_lanedir": 3.013606641518879, "sim_render-ego": 0.07150211572647094, "in-drivable-lane": 2.15000000000001, "agent_compute-ego": 0.18054336865743, "deviation-heading": 3.373141059224481, "set_robot_commands": 0.10753186623255412, "deviation-center-line": 0.7990775327760852, "driven_lanedir_consec": 3.013606641518879, "sim_compute_sim_state": 0.04459389607111613, "sim_compute_performance-ego": 0.07703720649083455, "sim_compute_robot_state-ego": 0.08650968790054321}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.002414967673113, "sim_physics": 0.13864112695058187, "survival_time": 14.950000000000076, "driven_lanedir": 3.957438556809131, "sim_render-ego": 0.07327325820922852, "in-drivable-lane": 0.10000000000000142, "agent_compute-ego": 0.1801846957206726, "deviation-heading": 1.2744894179398418, "set_robot_commands": 0.11062690496444702, "deviation-center-line": 0.5184179153300725, "driven_lanedir_consec": 3.957438556809131, "sim_compute_sim_state": 0.04555925210316976, "sim_compute_performance-ego": 0.08118326743443807, "sim_compute_robot_state-ego": 0.08778353929519653}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.7511207670745783, "sim_physics": 0.11643500566482544, "survival_time": 14.950000000000076, "driven_lanedir": 3.657744620360214, "sim_render-ego": 0.06469310522079467, "in-drivable-lane": 0.05000000000000071, "agent_compute-ego": 0.16634554386138917, "deviation-heading": 2.534615641386155, "set_robot_commands": 0.10245052337646483, "deviation-center-line": 0.711561120073908, "driven_lanedir_consec": 3.657744620360214, "sim_compute_sim_state": 0.04133769989013672, "sim_compute_performance-ego": 0.07612211386362712, "sim_compute_robot_state-ego": 0.07914251645406087}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.7251577151264474, "sim_physics": 0.14646209190631734, "survival_time": 7.249999999999982, "driven_lanedir": 1.279642849542992, "sim_render-ego": 0.0745644684495597, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.18783593342222016, "deviation-heading": 1.441969918161954, "set_robot_commands": 0.11646610457321692, "deviation-center-line": 0.30949867095295225, "driven_lanedir_consec": 1.279642849542992, "sim_compute_sim_state": 0.05088451155300798, "sim_compute_performance-ego": 0.08829161874179182, "sim_compute_robot_state-ego": 0.09239204340967638}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.749060757253467, "sim_physics": 0.14329859733581543, "survival_time": 14.950000000000076, "driven_lanedir": 3.617101099302686, "sim_render-ego": 0.07414053360621134, "in-drivable-lane": 0, "agent_compute-ego": 0.19362216552098593, "deviation-heading": 3.061606791123876, "set_robot_commands": 0.11704360326131184, "deviation-center-line": 0.877374497707077, "driven_lanedir_consec": 3.617101099302686, "sim_compute_sim_state": 0.04523700952529907, "sim_compute_performance-ego": 0.08213668902715048, "sim_compute_robot_state-ego": 0.09346072514851889}}
set_robot_commands_max0.11704360326131184
set_robot_commands_mean0.11082380048159894
set_robot_commands_median0.11062690496444702
set_robot_commands_min0.10245052337646483
sim_compute_performance-ego_max0.08829161874179182
sim_compute_performance-ego_mean0.08095417911156841
sim_compute_performance-ego_median0.08118326743443807
sim_compute_performance-ego_min0.07612211386362712
sim_compute_robot_state-ego_max0.09346072514851889
sim_compute_robot_state-ego_mean0.08785770244159917
sim_compute_robot_state-ego_median0.08778353929519653
sim_compute_robot_state-ego_min0.07914251645406087
sim_compute_sim_state_max0.05088451155300798
sim_compute_sim_state_mean0.04552247382854593
sim_compute_sim_state_median0.04523700952529907
sim_compute_sim_state_min0.04133769989013672
sim_physics_max0.14646209190631734
sim_physics_mean0.13579983192750775
sim_physics_median0.13864112695058187
sim_physics_min0.11643500566482544
sim_render-ego_max0.0745644684495597
sim_render-ego_mean0.07163469624245304
sim_render-ego_median0.07327325820922852
sim_render-ego_min0.06469310522079467
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.41000000000006
survival_time_min7.249999999999982
225783145AmaurXchallenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationerroryes11740:02:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
225433194JBRRussiaNN Solutionaido2-LF-sim-validationstep1-simulationsuccessyes11740:32:10Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.629311701750337
survival_time_median14.950000000000076
deviation-center-line_median1.166749464384669
in-drivable-lane_median1.500000000000021


other stats
agent_compute-ego_max0.13429651625694766
agent_compute-ego_mean0.12206669491080828
agent_compute-ego_median0.1253884251912435
agent_compute-ego_min0.10367717146873474
deviation-center-line_max1.2708341676647292
deviation-center-line_mean1.1392588507889063
deviation-center-line_min0.9699150188727628
deviation-heading_max4.4159108724531695
deviation-heading_mean2.7139488184154765
deviation-heading_median2.552084092057888
deviation-heading_min1.663945038461588
driven_any_max3.166262129942749
driven_any_mean3.0125188841217483
driven_any_median3.166190784559404
driven_any_min2.6138117416841937
driven_lanedir_consec_max2.8343839617100715
driven_lanedir_consec_mean2.577536766844722
driven_lanedir_consec_min2.170684989044296
driven_lanedir_max2.8343839617100715
driven_lanedir_mean2.577536766844722
driven_lanedir_median2.629311701750337
driven_lanedir_min2.170684989044296
in-drivable-lane_max2.1999999999999993
in-drivable-lane_mean1.4800000000000069
in-drivable-lane_min0.5500000000000016
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.9500988022453023, "sim_physics": 0.13704003691673278, "survival_time": 14.000000000000064, "driven_lanedir": 2.6171896015678646, "sim_render-ego": 0.06674133709498814, "in-drivable-lane": 1.3000000000000185, "agent_compute-ego": 0.10367717146873474, "deviation-heading": 1.663945038461588, "set_robot_commands": 0.10603516612734114, "deviation-center-line": 1.2042202867491156, "driven_lanedir_consec": 2.6171896015678646, "sim_compute_sim_state": 0.041812052897044594, "sim_compute_performance-ego": 0.07505309666906085, "sim_compute_robot_state-ego": 0.08213000297546387}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.1662309621770923, "sim_physics": 0.14776613791783652, "survival_time": 14.950000000000076, "driven_lanedir": 2.636113580151043, "sim_render-ego": 0.07414509455362955, "in-drivable-lane": 1.8499999999999936, "agent_compute-ego": 0.12013557434082033, "deviation-heading": 3.009453511496972, "set_robot_commands": 0.1232406767209371, "deviation-center-line": 1.0845753162732552, "driven_lanedir_consec": 2.636113580151043, "sim_compute_sim_state": 0.04647897958755493, "sim_compute_performance-ego": 0.08452533880869548, "sim_compute_robot_state-ego": 0.09694170236587524}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.166262129942749, "sim_physics": 0.15832056760787963, "survival_time": 14.950000000000076, "driven_lanedir": 2.629311701750337, "sim_render-ego": 0.07695900678634643, "in-drivable-lane": 2.1999999999999993, "agent_compute-ego": 0.12683578729629516, "deviation-heading": 1.9283505776077656, "set_robot_commands": 0.12569911321004232, "deviation-center-line": 1.166749464384669, "driven_lanedir_consec": 2.629311701750337, "sim_compute_sim_state": 0.04807735602060954, "sim_compute_performance-ego": 0.0904836098353068, "sim_compute_robot_state-ego": 0.0994762635231018}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.166190784559404, "sim_physics": 0.14827953497568766, "survival_time": 14.950000000000076, "driven_lanedir": 2.8343839617100715, "sim_render-ego": 0.07495972474416097, "in-drivable-lane": 0.5500000000000016, "agent_compute-ego": 0.1253884251912435, "deviation-heading": 4.4159108724531695, "set_robot_commands": 0.1270972768465678, "deviation-center-line": 1.2708341676647292, "driven_lanedir_consec": 2.8343839617100715, "sim_compute_sim_state": 0.04742502450942993, "sim_compute_performance-ego": 0.08522181908289592, "sim_compute_robot_state-ego": 0.10302061716715497}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.6138117416841937, "sim_physics": 0.12135505195586913, "survival_time": 12.40000000000004, "driven_lanedir": 2.170684989044296, "sim_render-ego": 0.06664725272886214, "in-drivable-lane": 1.500000000000021, "agent_compute-ego": 0.13429651625694766, "deviation-heading": 2.552084092057888, "set_robot_commands": 0.10628740056868524, "deviation-center-line": 0.9699150188727628, "driven_lanedir_consec": 2.170684989044296, "sim_compute_sim_state": 0.04237213634675549, "sim_compute_performance-ego": 0.07479949535862092, "sim_compute_robot_state-ego": 0.08159278669664936}}
set_robot_commands_max0.1270972768465678
set_robot_commands_mean0.11767192669471473
set_robot_commands_median0.1232406767209371
set_robot_commands_min0.10603516612734114
sim_compute_performance-ego_max0.0904836098353068
sim_compute_performance-ego_mean0.08201667195091598
sim_compute_performance-ego_median0.08452533880869548
sim_compute_performance-ego_min0.07479949535862092
sim_compute_robot_state-ego_max0.10302061716715497
sim_compute_robot_state-ego_mean0.09263227454564904
sim_compute_robot_state-ego_median0.09694170236587524
sim_compute_robot_state-ego_min0.08159278669664936
sim_compute_sim_state_max0.04807735602060954
sim_compute_sim_state_mean0.045233109872278895
sim_compute_sim_state_median0.04647897958755493
sim_compute_sim_state_min0.041812052897044594
sim_physics_max0.15832056760787963
sim_physics_mean0.14255226587480113
sim_physics_median0.14776613791783652
sim_physics_min0.12135505195586913
sim_render-ego_max0.07695900678634643
sim_render-ego_mean0.07189048318159744
sim_render-ego_median0.07414509455362955
sim_render-ego_min0.06664725272886214
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.250000000000068
survival_time_min12.40000000000004
225283216AmaurXchallenge-aido_LF-template-randomaido2-LFV-sim-testingstep1-simulationsuccessyes11740:23:20Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47061816984274774
survival_time_median2.4499999999999993
deviation-center-line_median0.09047885846140293
in-drivable-lane_median0.7999999999999974


other stats
agent_compute-ego_max0.18558798053047873
agent_compute-ego_mean0.16771302538803143
agent_compute-ego_median0.16839048597547743
agent_compute-ego_min0.14556263111255788
deviation-center-line_max0.1743913456502906
deviation-center-line_mean0.11122054568266285
deviation-center-line_min0.05649185041622204
deviation-heading_max0.8583234710357402
deviation-heading_mean0.371509805944231
deviation-heading_median0.3477435217829391
deviation-heading_min0.1892537419842091
driven_any_max1.6169932854589035
driven_any_mean0.8549136794030617
driven_any_median0.9441796518284096
driven_any_min0.28668385087664994
driven_lanedir_consec_max1.2433038249708377
driven_lanedir_consec_mean0.5622432991481365
driven_lanedir_consec_min0.24216121529728207
driven_lanedir_max1.2433038249708377
driven_lanedir_mean0.5622432991481365
driven_lanedir_median0.47061816984274774
driven_lanedir_min0.24216121529728207
in-drivable-lane_max1.3499999999999996
in-drivable-lane_mean0.5899999999999992
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0243289631429708, "sim_physics": 0.1841918539117884, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5723310224856362, "sim_render-ego": 0.06669935915205213, "in-drivable-lane": 0.9999999999999976, "agent_compute-ego": 0.16640047232309976, "deviation-heading": 0.19401296908406307, "set_robot_commands": 0.10531156151383012, "deviation-center-line": 0.15907928712407893, "driven_lanedir_consec": 0.5723310224856362, "sim_compute_sim_state": 0.041582712420710814, "sim_compute_performance-ego": 0.07146479906859221, "sim_compute_robot_state-ego": 0.07916772365570068, "sim_compute_robot_state-npc0": 0.07364228478184452, "sim_compute_robot_state-npc1": 0.07344466668588144, "sim_compute_robot_state-npc2": 0.07316720927203144, "sim_compute_robot_state-npc3": 0.07280545322983353}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4119037580118998, "sim_physics": 0.21964591026306152, "survival_time": 1.2500000000000004, "driven_lanedir": 0.3792793194470208, "sim_render-ego": 0.07006390571594238, "in-drivable-lane": 0, "agent_compute-ego": 0.17868724822998047, "deviation-heading": 0.47860435001913393, "set_robot_commands": 0.10256429672241212, "deviation-center-line": 0.09344288799285194, "driven_lanedir_consec": 0.3792793194470208, "sim_compute_sim_state": 0.042442426681518555, "sim_compute_performance-ego": 0.07575247764587402, "sim_compute_robot_state-ego": 0.08479806900024414, "sim_compute_robot_state-npc0": 0.07886828422546387, "sim_compute_robot_state-npc1": 0.0771558952331543, "sim_compute_robot_state-npc2": 0.07662708282470704, "sim_compute_robot_state-npc3": 0.0742447566986084}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.579862082650716, "sim_physics": 0.2059096662621749, "survival_time": 3.7999999999999945, "driven_lanedir": 1.2433038249708377, "sim_render-ego": 0.0669531037932948, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.173457638213509, "deviation-heading": 0.5020407942599273, "set_robot_commands": 0.10395438420145137, "deviation-center-line": 0.1743913456502906, "driven_lanedir_consec": 1.2433038249708377, "sim_compute_sim_state": 0.04330487627732126, "sim_compute_performance-ego": 0.07568341179897911, "sim_compute_robot_state-ego": 0.08218082628752056, "sim_compute_robot_state-npc0": 0.07374032233890734, "sim_compute_robot_state-npc1": 0.07363101369456242, "sim_compute_robot_state-npc2": 0.07787485812839709, "sim_compute_robot_state-npc3": 0.0791799551562259}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6169932854589035, "sim_physics": 0.20940720884105823, "survival_time": 3.949999999999994, "driven_lanedir": 1.2126117310470583, "sim_render-ego": 0.06664753563796418, "in-drivable-lane": 0.849999999999997, "agent_compute-ego": 0.16548979735072655, "deviation-heading": 0.34764983431811214, "set_robot_commands": 0.10545239871061302, "deviation-center-line": 0.11519544839797546, "driven_lanedir_consec": 1.2126117310470583, "sim_compute_sim_state": 0.04409139669394192, "sim_compute_performance-ego": 0.0730357592618918, "sim_compute_robot_state-ego": 0.0792756442782245, "sim_compute_robot_state-npc0": 0.07651343526719492, "sim_compute_robot_state-npc1": 0.07490334933317161, "sim_compute_robot_state-npc2": 0.07388515713848645, "sim_compute_robot_state-npc3": 0.07342706752728813}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5031772882846431, "sim_physics": 0.19379250492368424, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4926325270527603, "sim_render-ego": 0.06942329236439296, "in-drivable-lane": 0, "agent_compute-ego": 0.15940514632633754, "deviation-heading": 0.29868161596444953, "set_robot_commands": 0.10563452754701888, "deviation-center-line": 0.09047885846140293, "driven_lanedir_consec": 0.4926325270527603, "sim_compute_sim_state": 0.04263894047055926, "sim_compute_performance-ego": 0.07317190510886055, "sim_compute_robot_state-ego": 0.08617837088448661, "sim_compute_robot_state-npc0": 0.07463194642748151, "sim_compute_robot_state-npc1": 0.07769771984645299, "sim_compute_robot_state-npc2": 0.07616837535585676, "sim_compute_robot_state-npc3": 0.07736774001802717}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 1.0440585337030532, "sim_physics": 0.16098683410220677, "survival_time": 2.6999999999999984, "driven_lanedir": 0.5009536316076031, "sim_render-ego": 0.0560035264050519, "in-drivable-lane": 1.0000000000000009, "agent_compute-ego": 0.14556263111255788, "deviation-heading": 0.8583234710357402, "set_robot_commands": 0.08803979555765788, "deviation-center-line": 0.1636702708892767, "driven_lanedir_consec": 0.5009536316076031, "sim_compute_sim_state": 0.03694372265427201, "sim_compute_performance-ego": 0.06427836859667743, "sim_compute_robot_state-ego": 0.06916160053677028, "sim_compute_robot_state-npc0": 0.06520439518822564, "sim_compute_robot_state-npc1": 0.06269454073022913, "sim_compute_robot_state-npc2": 0.06127713786231147, "sim_compute_robot_state-npc3": 0.06319104742120814}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.045672984989961, "sim_physics": 0.16885932286580405, "survival_time": 2.6999999999999984, "driven_lanedir": 0.636422849544542, "sim_render-ego": 0.0614050582603172, "in-drivable-lane": 0.7999999999999974, "agent_compute-ego": 0.16021750149903474, "deviation-heading": 0.39273667682101354, "set_robot_commands": 0.0971367800677264, "deviation-center-line": 0.08970073753261001, "driven_lanedir_consec": 0.636422849544542, "sim_compute_sim_state": 0.041023435416045015, "sim_compute_performance-ego": 0.06656101897910789, "sim_compute_robot_state-ego": 0.06920925776163737, "sim_compute_robot_state-npc0": 0.06679706220273618, "sim_compute_robot_state-npc1": 0.06641137599945068, "sim_compute_robot_state-npc2": 0.06835721157215259, "sim_compute_robot_state-npc3": 0.06923619464591697}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.877256228857091, "sim_physics": 0.2293098025851779, "survival_time": 2.25, "driven_lanedir": 0.38713958773684665, "sim_render-ego": 0.06963152355617946, "in-drivable-lane": 0.9999999999999996, "agent_compute-ego": 0.16839048597547743, "deviation-heading": 0.384474040685185, "set_robot_commands": 0.10285886128743488, "deviation-center-line": 0.07500609722918031, "driven_lanedir_consec": 0.38713958773684665, "sim_compute_sim_state": 0.04301788542005751, "sim_compute_performance-ego": 0.07284389601813422, "sim_compute_robot_state-ego": 0.09412121772766112, "sim_compute_robot_state-npc0": 0.07714955541822645, "sim_compute_robot_state-npc1": 0.07568264537387424, "sim_compute_robot_state-npc2": 0.07439694404602051, "sim_compute_robot_state-npc3": 0.07163724369472928}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.8433010974171573, "sim_physics": 0.18127056308414624, "survival_time": 2.3, "driven_lanedir": 0.24216121529728207, "sim_render-ego": 0.06602502905804178, "in-drivable-lane": 1.3499999999999996, "agent_compute-ego": 0.1767899990081787, "deviation-heading": 0.34566993689777425, "set_robot_commands": 0.10118246078491212, "deviation-center-line": 0.07136114712800473, "driven_lanedir_consec": 0.24216121529728207, "sim_compute_sim_state": 0.04395038666932479, "sim_compute_performance-ego": 0.07453404820483664, "sim_compute_robot_state-ego": 0.07869316702303679, "sim_compute_robot_state-npc0": 0.07440162741619608, "sim_compute_robot_state-npc1": 0.07183959691420845, "sim_compute_robot_state-npc2": 0.07199816081834876, "sim_compute_robot_state-npc3": 0.07250842322473941}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.9785013113851152, "sim_physics": 0.22980791568756104, "survival_time": 2.499999999999999, "driven_lanedir": 0.9700080716683566, "sim_render-ego": 0.06464943885803223, "in-drivable-lane": 0, "agent_compute-ego": 0.16442211151123046, "deviation-heading": 0.3477435217829391, "set_robot_commands": 0.10584687232971192, "deviation-center-line": 0.15723242276422936, "driven_lanedir_consec": 0.9700080716683566, "sim_compute_sim_state": 0.04356727600097656, "sim_compute_performance-ego": 0.07479335308074951, "sim_compute_robot_state-ego": 0.08168753623962402, "sim_compute_robot_state-npc0": 0.07355381965637207, "sim_compute_robot_state-npc1": 0.07346429347991944, "sim_compute_robot_state-npc2": 0.0725813341140747, "sim_compute_robot_state-npc3": 0.07424563884735108}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.3129292149411446, "sim_physics": 0.22942489385604856, "survival_time": 1.0000000000000002, "driven_lanedir": 0.2864579763812336, "sim_render-ego": 0.059107851982116696, "in-drivable-lane": 0, "agent_compute-ego": 0.15398484468460083, "deviation-heading": 0.38016104491567027, "set_robot_commands": 0.0966774582862854, "deviation-center-line": 0.05649185041622204, "driven_lanedir_consec": 0.2864579763812336, "sim_compute_sim_state": 0.04213227033615112, "sim_compute_performance-ego": 0.06652286052703857, "sim_compute_robot_state-ego": 0.07736668586730958, "sim_compute_robot_state-npc0": 0.06710387468338012, "sim_compute_robot_state-npc1": 0.068203604221344, "sim_compute_robot_state-npc2": 0.06819850206375122, "sim_compute_robot_state-npc3": 0.07170964479446411}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.28668385087664994, "sim_physics": 0.22171833640650696, "survival_time": 0.9500000000000004, "driven_lanedir": 0.278237107094367, "sim_render-ego": 0.0748570718263325, "in-drivable-lane": 0, "agent_compute-ego": 0.17415590035287956, "deviation-heading": 0.19732996798555608, "set_robot_commands": 0.10918997463427092, "deviation-center-line": 0.08671144489080887, "driven_lanedir_consec": 0.278237107094367, "sim_compute_sim_state": 0.04681139243276496, "sim_compute_performance-ego": 0.07869623836718108, "sim_compute_robot_state-ego": 0.0873847760652241, "sim_compute_robot_state-npc0": 0.08446591778805382, "sim_compute_robot_state-npc1": 0.08519035891482704, "sim_compute_robot_state-npc2": 0.07840618334318462, "sim_compute_robot_state-npc3": 0.07815299536052503}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0034139953700494, "sim_physics": 0.18161917209625245, "survival_time": 2.499999999999999, "driven_lanedir": 0.47061816984274774, "sim_render-ego": 0.06906653881072998, "in-drivable-lane": 1.1499999999999986, "agent_compute-ego": 0.17349743843078613, "deviation-heading": 0.2263485117662671, "set_robot_commands": 0.10214418888092042, "deviation-center-line": 0.1594122934983136, "driven_lanedir_consec": 0.47061816984274774, "sim_compute_sim_state": 0.04325260162353515, "sim_compute_performance-ego": 0.07658947467803955, "sim_compute_robot_state-ego": 0.07686699390411376, "sim_compute_robot_state-npc0": 0.0738038969039917, "sim_compute_robot_state-npc1": 0.07555490493774414, "sim_compute_robot_state-npc2": 0.07496204853057861, "sim_compute_robot_state-npc3": 0.07585082530975341}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.351442944128162, "sim_physics": 0.2331175370649858, "survival_time": 1.1000000000000003, "driven_lanedir": 0.34114611245347204, "sim_render-ego": 0.07461444898085161, "in-drivable-lane": 0, "agent_compute-ego": 0.18558798053047873, "deviation-heading": 0.1892537419842091, "set_robot_commands": 0.11516994779760188, "deviation-center-line": 0.08918370733714856, "driven_lanedir_consec": 0.34114611245347204, "sim_compute_sim_state": 0.043981042775240814, "sim_compute_performance-ego": 0.0835910818793557, "sim_compute_robot_state-ego": 0.0879405520179055, "sim_compute_robot_state-npc0": 0.07471727241169322, "sim_compute_robot_state-npc1": 0.07754746350375089, "sim_compute_robot_state-npc2": 0.07853617451407692, "sim_compute_robot_state-npc3": 0.07768203995444557}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9441796518284096, "sim_physics": 0.2333805415095115, "survival_time": 2.4499999999999993, "driven_lanedir": 0.4203463405922858, "sim_render-ego": 0.0749469873856525, "in-drivable-lane": 1.0999999999999988, "agent_compute-ego": 0.169646185271594, "deviation-heading": 0.4296166116434236, "set_robot_commands": 0.10251868014432948, "deviation-center-line": 0.08695038592754878, "driven_lanedir_consec": 0.4203463405922858, "sim_compute_sim_state": 0.04430532455444336, "sim_compute_performance-ego": 0.07606752064763284, "sim_compute_robot_state-ego": 0.08100746115859674, "sim_compute_robot_state-npc0": 0.07646169467848174, "sim_compute_robot_state-npc1": 0.07699213222581514, "sim_compute_robot_state-npc2": 0.07642358176562251, "sim_compute_robot_state-npc3": 0.07561824759658502}}
set_robot_commands_max0.11516994779760188
set_robot_commands_mean0.10291214589774512
set_robot_commands_median0.10285886128743488
set_robot_commands_min0.08803979555765788
sim_compute_performance-ego_max0.0835910818793557
sim_compute_performance-ego_mean0.07357241425753007
sim_compute_performance-ego_median0.07453404820483664
sim_compute_performance-ego_min0.06427836859667743
sim_compute_robot_state-ego_max0.09412121772766112
sim_compute_robot_state-ego_mean0.08100265882720371
sim_compute_robot_state-ego_median0.08100746115859674
sim_compute_robot_state-ego_min0.06916160053677028
sim_compute_robot_state-npc0_max0.08446591778805382
sim_compute_robot_state-npc0_mean0.07407035929254994
sim_compute_robot_state-npc0_median0.07440162741619608
sim_compute_robot_state-npc0_min0.06520439518822564
sim_compute_robot_state-npc1_max0.08519035891482704
sim_compute_robot_state-npc1_mean0.07402757073962575
sim_compute_robot_state-npc1_median0.07490334933317161
sim_compute_robot_state-npc1_min0.06269454073022913
sim_compute_robot_state-npc2_max0.07853617451407692
sim_compute_robot_state-npc2_mean0.0735239974233067
sim_compute_robot_state-npc2_median0.07439694404602051
sim_compute_robot_state-npc2_min0.06127713786231147
sim_compute_robot_state-npc3_max0.0791799551562259
sim_compute_robot_state-npc3_mean0.07379048489864674
sim_compute_robot_state-npc3_median0.0742447566986084
sim_compute_robot_state-npc3_min0.06319104742120814
sim_compute_sim_state_max0.04681139243276496
sim_compute_sim_state_mean0.042869712695124206
sim_compute_sim_state_median0.04325260162353515
sim_compute_sim_state_min0.03694372265427201
sim_physics_max0.2333805415095115
sim_physics_mean0.20549613756399793
sim_physics_median0.20940720884105823
sim_physics_min0.16098683410220677
sim_render-ego_max0.0749469873856525
sim_render-ego_mean0.0673396447857968
sim_render-ego_median0.0669531037932948
sim_render-ego_min0.0560035264050519
simulation-passed1
survival_time_max3.949999999999994
survival_time_mean2.2366666666666655
survival_time_min0.9500000000000004
225113229JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:17:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224943247jp18813100494Second test - TH-jpaido2-LF-sim-validationstep1-simulationsuccessyes11740:19:49Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5596565733719423
survival_time_median10.800000000000018
deviation-center-line_median0.5671600550797875
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.2261832314868306
agent_compute-ego_mean0.1962467015214669
agent_compute-ego_median0.1969100856781006
agent_compute-ego_min0.1756893131468031
deviation-center-line_max1.124938355788923
deviation-center-line_mean0.5812679504545528
deviation-center-line_min0.1261533445581102
deviation-heading_max4.3726995102305874
deviation-heading_mean2.3174008349246344
deviation-heading_median2.084871420130781
deviation-heading_min0.41315362683425194
driven_any_max1.6745437771728102
driven_any_mean0.8757069433090461
driven_any_median0.9660902294304492
driven_any_min0.19354399246117937
driven_lanedir_consec_max1.550772048477315
driven_lanedir_consec_mean0.6715841674259363
driven_lanedir_consec_min0.10417562562544712
driven_lanedir_max1.550772048477315
driven_lanedir_mean0.6715841674259363
driven_lanedir_median0.5596565733719423
driven_lanedir_min0.10417562562544712
in-drivable-lane_max4.000000000000057
in-drivable-lane_mean1.1600000000000164
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5327928850398237, "sim_physics": 0.12774700588650173, "survival_time": 1.800000000000001, "driven_lanedir": 0.511911966791792, "sim_render-ego": 0.06749047173394097, "in-drivable-lane": 0, "agent_compute-ego": 0.18078695403205025, "deviation-heading": 0.41315362683425194, "set_robot_commands": 0.10182412465413412, "deviation-center-line": 0.1261533445581102, "driven_lanedir_consec": 0.511911966791792, "sim_compute_sim_state": 0.042884502145979136, "sim_compute_performance-ego": 0.07693380779690212, "sim_compute_robot_state-ego": 0.08021222220526801}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.6745437771728102, "sim_physics": 0.1064600701685305, "survival_time": 10.800000000000018, "driven_lanedir": 1.550772048477315, "sim_render-ego": 0.0610081034678, "in-drivable-lane": 0, "agent_compute-ego": 0.1756893131468031, "deviation-heading": 2.084871420130781, "set_robot_commands": 0.09681489180635525, "deviation-center-line": 0.5671600550797875, "driven_lanedir_consec": 1.550772048477315, "sim_compute_sim_state": 0.03879894371385927, "sim_compute_performance-ego": 0.06857669905379966, "sim_compute_robot_state-ego": 0.07377767342108267}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.19354399246117937, "sim_physics": 0.1568164437316185, "survival_time": 2.1500000000000004, "driven_lanedir": 0.10417562562544712, "sim_render-ego": 0.07087900472241779, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.2261832314868306, "deviation-heading": 0.9850709572733976, "set_robot_commands": 0.13036001005838083, "deviation-center-line": 0.16507728968636384, "driven_lanedir_consec": 0.10417562562544712, "sim_compute_sim_state": 0.04499787508055221, "sim_compute_performance-ego": 0.07965923464575479, "sim_compute_robot_state-ego": 0.09796881121258404}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.011563832440968, "sim_physics": 0.13263903617858885, "survival_time": 14.950000000000076, "driven_lanedir": 0.5596565733719423, "sim_render-ego": 0.0721737813949585, "in-drivable-lane": 4.000000000000057, "agent_compute-ego": 0.1969100856781006, "deviation-heading": 4.3726995102305874, "set_robot_commands": 0.11288957277933756, "deviation-center-line": 0.9230107071595796, "driven_lanedir_consec": 0.5596565733719423, "sim_compute_sim_state": 0.044376219113667806, "sim_compute_performance-ego": 0.0810410475730896, "sim_compute_robot_state-ego": 0.08734339872996012}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.9660902294304492, "sim_physics": 0.14244970480600994, "survival_time": 14.950000000000076, "driven_lanedir": 0.6314046228631849, "sim_render-ego": 0.07209373950958252, "in-drivable-lane": 1.7500000000000249, "agent_compute-ego": 0.20166392326354984, "deviation-heading": 3.7312086601541545, "set_robot_commands": 0.11270405371983848, "deviation-center-line": 1.124938355788923, "driven_lanedir_consec": 0.6314046228631849, "sim_compute_sim_state": 0.04430101156234741, "sim_compute_performance-ego": 0.07998756647109985, "sim_compute_robot_state-ego": 0.09116706848144532}}
set_robot_commands_max0.13036001005838083
set_robot_commands_mean0.11091853060360923
set_robot_commands_median0.11270405371983848
set_robot_commands_min0.09681489180635525
sim_compute_performance-ego_max0.0810410475730896
sim_compute_performance-ego_mean0.07723967110812921
sim_compute_performance-ego_median0.07965923464575479
sim_compute_performance-ego_min0.06857669905379966
sim_compute_robot_state-ego_max0.09796881121258404
sim_compute_robot_state-ego_mean0.08609383481006802
sim_compute_robot_state-ego_median0.08734339872996012
sim_compute_robot_state-ego_min0.07377767342108267
sim_compute_sim_state_max0.04499787508055221
sim_compute_sim_state_mean0.04307171032328117
sim_compute_sim_state_median0.04430101156234741
sim_compute_sim_state_min0.03879894371385927
sim_physics_max0.1568164437316185
sim_physics_mean0.1332224521542499
sim_physics_median0.13263903617858885
sim_physics_min0.1064600701685305
sim_render-ego_max0.0721737813949585
sim_render-ego_mean0.06872902016573997
sim_render-ego_median0.07087900472241779
sim_render-ego_min0.0610081034678
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.930000000000035
survival_time_min1.800000000000001
224733272jp18813100494First test - THaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8791878388178453
survival_time_median14.950000000000076
deviation-center-line_median1.0068115058068483
in-drivable-lane_median0.70000000000001


other stats
agent_compute-ego_max0.18681149085362753
agent_compute-ego_mean0.1811549825754886
agent_compute-ego_median0.1848308030764262
agent_compute-ego_min0.1680518193031425
deviation-center-line_max1.5255806720399998
deviation-center-line_mean0.8703745408820108
deviation-center-line_min0.12849809775768825
deviation-heading_max4.250901041621015
deviation-heading_mean2.3223253256878893
deviation-heading_median1.8479351494163512
deviation-heading_min1.0801363088124232
driven_any_max4.054488063422768
driven_any_mean2.637942178688946
driven_any_median3.4800977061194622
driven_any_min0.597729151470974
driven_lanedir_consec_max3.258990110186864
driven_lanedir_consec_mean2.190193506346677
driven_lanedir_consec_min0.5459665050925957
driven_lanedir_max3.258990110186864
driven_lanedir_mean2.190193506346677
driven_lanedir_median2.8791878388178453
driven_lanedir_min0.5459665050925957
in-drivable-lane_max2.7000000000000384
in-drivable-lane_mean1.1700000000000157
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.597729151470974, "sim_physics": 0.10814864955731292, "survival_time": 3.349999999999996, "driven_lanedir": 0.5459665050925957, "sim_render-ego": 0.057413766633218795, "in-drivable-lane": 0, "agent_compute-ego": 0.1680518193031425, "deviation-heading": 1.1365180804823618, "set_robot_commands": 0.0871708464266649, "deviation-center-line": 0.12849809775768825, "driven_lanedir_consec": 0.5459665050925957, "sim_compute_sim_state": 0.03431418048801707, "sim_compute_performance-ego": 0.06673348839603253, "sim_compute_robot_state-ego": 0.07223958755607035}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.338343711483321, "sim_physics": 0.11697643667786986, "survival_time": 4.549999999999992, "driven_lanedir": 1.0966422494166566, "sim_render-ego": 0.061543524920285406, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.1805249203692426, "deviation-heading": 1.0801363088124232, "set_robot_commands": 0.11026072240137792, "deviation-center-line": 0.46095925594665565, "driven_lanedir_consec": 1.0966422494166566, "sim_compute_sim_state": 0.03784464741801168, "sim_compute_performance-ego": 0.06911724216335423, "sim_compute_robot_state-ego": 0.07369974157312414}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 4.054488063422768, "sim_physics": 0.1198508318265279, "survival_time": 14.950000000000076, "driven_lanedir": 3.258990110186864, "sim_render-ego": 0.06628111600875855, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.18555587927500408, "deviation-heading": 1.8479351494163512, "set_robot_commands": 0.09945698579152425, "deviation-center-line": 1.0068115058068483, "driven_lanedir_consec": 3.258990110186864, "sim_compute_sim_state": 0.04144477605819702, "sim_compute_performance-ego": 0.07345944166183471, "sim_compute_robot_state-ego": 0.07734322468439737}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.4800977061194622, "sim_physics": 0.1276892097791036, "survival_time": 14.950000000000076, "driven_lanedir": 2.8791878388178453, "sim_render-ego": 0.0666818110148112, "in-drivable-lane": 2.1500000000000306, "agent_compute-ego": 0.18681149085362753, "deviation-heading": 3.296136048107295, "set_robot_commands": 0.10389151255289714, "deviation-center-line": 1.230023172858862, "driven_lanedir_consec": 2.8791878388178453, "sim_compute_sim_state": 0.04632260799407959, "sim_compute_performance-ego": 0.07539227406183878, "sim_compute_robot_state-ego": 0.07836830139160156}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 3.719052260948207, "sim_physics": 0.120950022538503, "survival_time": 14.950000000000076, "driven_lanedir": 3.1701808282194235, "sim_render-ego": 0.06414840857187908, "in-drivable-lane": 0.70000000000001, "agent_compute-ego": 0.1848308030764262, "deviation-heading": 4.250901041621015, "set_robot_commands": 0.1014625120162964, "deviation-center-line": 1.5255806720399998, "driven_lanedir_consec": 3.1701808282194235, "sim_compute_sim_state": 0.04029717524846395, "sim_compute_performance-ego": 0.07169120868047078, "sim_compute_robot_state-ego": 0.07759965419769287}}
set_robot_commands_max0.11026072240137792
set_robot_commands_mean0.10044851583775212
set_robot_commands_median0.1014625120162964
set_robot_commands_min0.0871708464266649
sim_compute_performance-ego_max0.07539227406183878
sim_compute_performance-ego_mean0.07127873099270621
sim_compute_performance-ego_median0.07169120868047078
sim_compute_performance-ego_min0.06673348839603253
sim_compute_robot_state-ego_max0.07836830139160156
sim_compute_robot_state-ego_mean0.07585010188057725
sim_compute_robot_state-ego_median0.07734322468439737
sim_compute_robot_state-ego_min0.07223958755607035
sim_compute_sim_state_max0.04632260799407959
sim_compute_sim_state_mean0.04004467744135386
sim_compute_sim_state_median0.04029717524846395
sim_compute_sim_state_min0.03431418048801707
sim_physics_max0.1276892097791036
sim_physics_mean0.11872303007586343
sim_physics_median0.1198508318265279
sim_physics_min0.10814864955731292
sim_render-ego_max0.0666818110148112
sim_render-ego_mean0.06321372542979062
sim_render-ego_median0.06414840857187908
sim_render-ego_min0.057413766633218795
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.550000000000043
survival_time_min3.349999999999996
224223314almasipBaseline solution using reinforcement learningaido2-LFVI-sim-testingstep1-simulationerroryes11740:56:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224183317jp18813100494RL - TH - shiaido2-LF-sim-validationstep1-simulationerroryes11740:00:42
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
224123325jp18813100494RL - TH -xyzaido2-LFV-sim-validationstep1-simulationerroryes11740:02:03
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223923341JBRRussiaJetBrains Researchaido2-LF-sim-testingstep1-simulationerroryes11740:49:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223913342JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223793353MYFtestaido2-LFV-sim-testingstep1-simulationerroryes11740:14:26
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223773354madclamchallenge-aido_LF-template-tensorflowaido2-LF-sim-testingstep1-simulationerroryes11740:02:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 135, in main
    physics_dt=config.physics_dt)
  File "experiment_manager.py", line 305, in run_episode
    sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "set_robot_commands".
                   |
                   || Traceback (most recent call last):
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
                   ||     raise Exception(msg)
                   || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 135, in main
 >     physics_dt=config.physics_dt)
 >   File "experiment_manager.py", line 305, in run_episode
 >     sim_ci.write_topic_and_expect_zero('set_robot_commands', commands)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
 >     others = read_until_over(fpout, timeout=timeout, nickname=nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
 >     raise RemoteNodeAborted(m)
 > zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
 > 
 > error in simulator |Exception while handling a message on topic "set_robot_commands".
 >                    |
 >                    || Traceback (most recent call last):
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
 >                    ||     handle_message_node(parsed, receiver0, context0)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
 >                    ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
 >                    ||   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
 >                    ||     f(**kwargs)
 >                    ||   File "gym_bridge.py", line 301, in on_received_set_robot_commands
 >                    ||     raise Exception(msg)
 >                    || Exception: Received invalid PWM commands. They should be between -1 and +1. Received left = {l}, right = {r}.
 >                    ||
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223653380jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:22:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1772717143394795
survival_time_median14.950000000000076
deviation-center-line_median1.2564295049159275
in-drivable-lane_median0


other stats
agent_compute-ego_max0.19863288402557372
agent_compute-ego_mean0.18471929108568347
agent_compute-ego_median0.18619311629951776
agent_compute-ego_min0.16333019971847534
deviation-center-line_max2.0019356226664935
deviation-center-line_mean1.0952890666399673
deviation-center-line_min0.2699252143008969
deviation-heading_max6.71936138569765
deviation-heading_mean3.9818839211695254
deviation-heading_median3.7722030112939686
deviation-heading_min0.2173190230207393
driven_any_max3.5879048762039325
driven_any_mean2.064125396045019
driven_any_median1.6013626928780311
driven_any_min0.7632258218945824
driven_lanedir_consec_max3.4834192055946542
driven_lanedir_consec_mean1.8326804979201436
driven_lanedir_consec_min0.6575718006884617
driven_lanedir_max3.4834192055946542
driven_lanedir_mean1.8433737181711691
driven_lanedir_median1.1772717143394795
driven_lanedir_min0.7110379019435897
in-drivable-lane_max1.399999999999995
in-drivable-lane_mean0.5199999999999981
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1655340476183824, "sim_physics": 0.1233928155579023, "survival_time": 7.449999999999981, "driven_lanedir": 0.7110379019435897, "sim_render-ego": 0.06600435148149529, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.18213265854240265, "deviation-heading": 5.481102649418371, "set_robot_commands": 0.10262255060592754, "deviation-center-line": 0.4795141049335174, "driven_lanedir_consec": 0.6575718006884617, "sim_compute_sim_state": 0.042591920635044175, "sim_compute_performance-ego": 0.07438869284303397, "sim_compute_robot_state-ego": 0.07957712755907302}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7632258218945824, "sim_physics": 0.12152437369028728, "survival_time": 14.950000000000076, "driven_lanedir": 0.7441062907362871, "sim_render-ego": 0.06889763752619425, "in-drivable-lane": 0, "agent_compute-ego": 0.19863288402557372, "deviation-heading": 6.71936138569765, "set_robot_commands": 0.10695130109786988, "deviation-center-line": 2.0019356226664935, "driven_lanedir_consec": 0.7441062907362871, "sim_compute_sim_state": 0.0426119867960612, "sim_compute_performance-ego": 0.07616418997446696, "sim_compute_robot_state-ego": 0.08516286691029866}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.5879048762039325, "sim_physics": 0.1210021432240804, "survival_time": 14.950000000000076, "driven_lanedir": 3.4834192055946542, "sim_render-ego": 0.06671646912892659, "in-drivable-lane": 0, "agent_compute-ego": 0.19330759684244792, "deviation-heading": 3.7194335364169007, "set_robot_commands": 0.10445328791936238, "deviation-center-line": 1.468640886383001, "driven_lanedir_consec": 3.4834192055946542, "sim_compute_sim_state": 0.04174598693847656, "sim_compute_performance-ego": 0.07566229581832885, "sim_compute_robot_state-ego": 0.08143550316492716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.202599541630169, "sim_physics": 0.10921306371688842, "survival_time": 14.950000000000076, "driven_lanedir": 3.101033478241836, "sim_render-ego": 0.0589895232518514, "in-drivable-lane": 0, "agent_compute-ego": 0.16333019971847534, "deviation-heading": 3.7722030112939686, "set_robot_commands": 0.09119765202204388, "deviation-center-line": 1.2564295049159275, "driven_lanedir_consec": 3.101033478241836, "sim_compute_sim_state": 0.03809929609298706, "sim_compute_performance-ego": 0.06604786316553751, "sim_compute_robot_state-ego": 0.06953583796819052}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.6013626928780311, "sim_physics": 0.12090641492372985, "survival_time": 3.8499999999999943, "driven_lanedir": 1.1772717143394795, "sim_render-ego": 0.06654594470928242, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.18619311629951776, "deviation-heading": 0.2173190230207393, "set_robot_commands": 0.10175684829810996, "deviation-center-line": 0.2699252143008969, "driven_lanedir_consec": 1.1772717143394795, "sim_compute_sim_state": 0.0428149142822662, "sim_compute_performance-ego": 0.07696378076231325, "sim_compute_robot_state-ego": 0.07879082877914627}}
set_robot_commands_max0.10695130109786988
set_robot_commands_mean0.10139632798866274
set_robot_commands_median0.10262255060592754
set_robot_commands_min0.09119765202204388
sim_compute_performance-ego_max0.07696378076231325
sim_compute_performance-ego_mean0.07384536451273611
sim_compute_performance-ego_median0.07566229581832885
sim_compute_performance-ego_min0.06604786316553751
sim_compute_robot_state-ego_max0.08516286691029866
sim_compute_robot_state-ego_mean0.07890043287632713
sim_compute_robot_state-ego_median0.07957712755907302
sim_compute_robot_state-ego_min0.06953583796819052
sim_compute_sim_state_max0.0428149142822662
sim_compute_sim_state_mean0.04157282094896704
sim_compute_sim_state_median0.042591920635044175
sim_compute_sim_state_min0.03809929609298706
sim_physics_max0.1233928155579023
sim_physics_mean0.11920776222257765
sim_physics_median0.1210021432240804
sim_physics_min0.10921306371688842
sim_render-ego_max0.06889763752619425
sim_render-ego_mean0.06543078521955
sim_render-ego_median0.06654594470928242
sim_render-ego_min0.0589895232518514
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.23000000000004
survival_time_min3.8499999999999943
223543390jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:20:14Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2663594888259806
survival_time_median13.600000000000058
deviation-center-line_median0.2558550476326924
in-drivable-lane_median1.7999999999999936


other stats
agent_compute-ego_max0.20091874020941117
agent_compute-ego_mean0.18503262758432665
agent_compute-ego_median0.191954897797626
agent_compute-ego_min0.14915824540053743
deviation-center-line_max1.024837191238153
deviation-center-line_mean0.43232954566270426
deviation-center-line_min0.07903363477032634
deviation-heading_max3.5512068851908096
deviation-heading_mean1.497279003685015
deviation-heading_median0.32478405898263474
deviation-heading_min0.2962092362398807
driven_any_max3.8252935150994105
driven_any_mean1.8633884027698728
driven_any_median1.3260904013381674
driven_any_min0.8256891231340653
driven_lanedir_consec_max3.4687845804772035
driven_lanedir_consec_mean1.6317391305632731
driven_lanedir_consec_min0.653967327249565
driven_lanedir_max3.4687845804772035
driven_lanedir_mean1.6375038471830188
driven_lanedir_median1.2663594888259806
driven_lanedir_min0.653967327249565
in-drivable-lane_max11.95000000000008
in-drivable-lane_mean4.060000000000032
in-drivable-lane_min0.4500000000000064
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.007053009188332, "sim_physics": 0.136798532112785, "survival_time": 2.3, "driven_lanedir": 0.6797680779697997, "sim_render-ego": 0.06514136169267737, "in-drivable-lane": 0.7499999999999991, "agent_compute-ego": 0.191954897797626, "deviation-heading": 0.3165400741408718, "set_robot_commands": 0.10386075662529988, "deviation-center-line": 0.07903363477032634, "driven_lanedir_consec": 0.6797680779697997, "sim_compute_sim_state": 0.042364861654198685, "sim_compute_performance-ego": 0.07485959322556206, "sim_compute_robot_state-ego": 0.08359664937724239}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.8256891231340653, "sim_physics": 0.09390064734446853, "survival_time": 3.949999999999994, "driven_lanedir": 0.653967327249565, "sim_render-ego": 0.05726454831376861, "in-drivable-lane": 1.7999999999999936, "agent_compute-ego": 0.14915824540053743, "deviation-heading": 0.32478405898263474, "set_robot_commands": 0.08320965042597131, "deviation-center-line": 0.08906968027377606, "driven_lanedir_consec": 0.653967327249565, "sim_compute_sim_state": 0.03657919545716877, "sim_compute_performance-ego": 0.06109830699389494, "sim_compute_robot_state-ego": 0.06293335443810572}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.8252935150994105, "sim_physics": 0.13152050884330974, "survival_time": 13.600000000000058, "driven_lanedir": 3.4687845804772035, "sim_render-ego": 0.07016973460421842, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.20091874020941117, "deviation-heading": 2.997654763870878, "set_robot_commands": 0.10487585295649136, "deviation-center-line": 1.024837191238153, "driven_lanedir_consec": 3.4687845804772035, "sim_compute_sim_state": 0.04277363682494444, "sim_compute_performance-ego": 0.0774717760436675, "sim_compute_robot_state-ego": 0.08624983272131752}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 2.332815965089388, "sim_physics": 0.13374587376912436, "survival_time": 14.950000000000076, "driven_lanedir": 2.1186397613925454, "sim_render-ego": 0.06743734836578369, "in-drivable-lane": 5.350000000000076, "agent_compute-ego": 0.1969960347811381, "deviation-heading": 3.5512068851908096, "set_robot_commands": 0.10675578514734904, "deviation-center-line": 0.7128521743985732, "driven_lanedir_consec": 2.089816178293817, "sim_compute_sim_state": 0.0434832493464152, "sim_compute_performance-ego": 0.07748412768046062, "sim_compute_robot_state-ego": 0.08686600049336751}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3260904013381674, "sim_physics": 0.11966050465901693, "survival_time": 14.950000000000076, "driven_lanedir": 1.2663594888259806, "sim_render-ego": 0.06703290462493897, "in-drivable-lane": 11.95000000000008, "agent_compute-ego": 0.18613521973292033, "deviation-heading": 0.2962092362398807, "set_robot_commands": 0.10647339979807537, "deviation-center-line": 0.2558550476326924, "driven_lanedir_consec": 1.2663594888259806, "sim_compute_sim_state": 0.04268266757329305, "sim_compute_performance-ego": 0.07425361315409343, "sim_compute_robot_state-ego": 0.07928731282552083}}
set_robot_commands_max0.10675578514734904
set_robot_commands_mean0.10103508899063736
set_robot_commands_median0.10487585295649136
set_robot_commands_min0.08320965042597131
sim_compute_performance-ego_max0.07748412768046062
sim_compute_performance-ego_mean0.07303348341953571
sim_compute_performance-ego_median0.07485959322556206
sim_compute_performance-ego_min0.06109830699389494
sim_compute_robot_state-ego_max0.08686600049336751
sim_compute_robot_state-ego_mean0.07978662997111079
sim_compute_robot_state-ego_median0.08359664937724239
sim_compute_robot_state-ego_min0.06293335443810572
sim_compute_sim_state_max0.0434832493464152
sim_compute_sim_state_mean0.041576722171204034
sim_compute_sim_state_median0.04268266757329305
sim_compute_sim_state_min0.03657919545716877
sim_physics_max0.136798532112785
sim_physics_mean0.12312521334574092
sim_physics_median0.13152050884330974
sim_physics_min0.09390064734446853
sim_render-ego_max0.07016973460421842
sim_render-ego_mean0.0654091795202774
sim_render-ego_median0.06703290462493897
sim_render-ego_min0.05726454831376861
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.95000000000004
survival_time_min2.3
223493391jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationerroryes11740:08:34
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223453395jp18813100494RL-TH-shiaido2-LF-sim-validationstep1-simulationsuccessyes11740:15:35Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.238302411107852
survival_time_median5.849999999999987
deviation-center-line_median0.21149840683507448
in-drivable-lane_median1.699999999999994


other stats
agent_compute-ego_max0.20465378761291503
agent_compute-ego_mean0.17871988862600083
agent_compute-ego_median0.18538142124811807
agent_compute-ego_min0.15567503372828165
deviation-center-line_max0.919770137458658
deviation-center-line_mean0.3711700371111867
deviation-center-line_min0.06863286644076615
deviation-heading_max13.132193694897174
deviation-heading_mean4.305736427741708
deviation-heading_median0.6372176004493483
deviation-heading_min0.20186117886824836
driven_any_max2.05349843568627
driven_any_mean1.194331915677766
driven_any_median1.3933977016697776
driven_any_min0.24239375290646284
driven_lanedir_consec_max1.2738878038303634
driven_lanedir_consec_mean0.915120334104461
driven_lanedir_consec_min0.23220163175763808
driven_lanedir_max1.3085355972599426
driven_lanedir_mean0.9291643878842472
driven_lanedir_median1.2412946104643634
driven_lanedir_min0.23220163175763808
in-drivable-lane_max6.500000000000011
in-drivable-lane_mean2.119999999999999
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.05349843568627, "sim_physics": 0.12721878290176392, "survival_time": 14.950000000000076, "driven_lanedir": 1.3085355972599426, "sim_render-ego": 0.06775298039118449, "in-drivable-lane": 6.500000000000011, "agent_compute-ego": 0.1900022308031718, "deviation-heading": 7.149133618364634, "set_robot_commands": 0.10350248257319132, "deviation-center-line": 0.5468771866658134, "driven_lanedir_consec": 1.238302411107852, "sim_compute_sim_state": 0.042261435985565185, "sim_compute_performance-ego": 0.07558494091033935, "sim_compute_robot_state-ego": 0.08145787556966146}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6057614772444198, "sim_physics": 0.10834892094135284, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5899022961089285, "sim_render-ego": 0.0564596156279246, "in-drivable-lane": 0, "agent_compute-ego": 0.15567503372828165, "deviation-heading": 0.4082760461291373, "set_robot_commands": 0.08831760783990224, "deviation-center-line": 0.10907158815562126, "driven_lanedir_consec": 0.5899022961089285, "sim_compute_sim_state": 0.036664595206578575, "sim_compute_performance-ego": 0.06245121856530507, "sim_compute_robot_state-ego": 0.0678942898909251}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.24239375290646284, "sim_physics": 0.14771248499552408, "survival_time": 0.7500000000000001, "driven_lanedir": 0.23220163175763808, "sim_render-ego": 0.06729014714558919, "in-drivable-lane": 0, "agent_compute-ego": 0.20465378761291503, "deviation-heading": 0.20186117886824836, "set_robot_commands": 0.11288224856058755, "deviation-center-line": 0.06863286644076615, "driven_lanedir_consec": 0.23220163175763808, "sim_compute_sim_state": 0.0451024850209554, "sim_compute_performance-ego": 0.07675590515136718, "sim_compute_robot_state-ego": 0.08487915992736816}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.6766082108818998, "sim_physics": 0.1009691739693666, "survival_time": 5.849999999999987, "driven_lanedir": 1.2738878038303634, "sim_render-ego": 0.05599241582756369, "in-drivable-lane": 2.3999999999999915, "agent_compute-ego": 0.15788696973751754, "deviation-heading": 0.6372176004493483, "set_robot_commands": 0.08592563001518576, "deviation-center-line": 0.21149840683507448, "driven_lanedir_consec": 1.2738878038303634, "sim_compute_sim_state": 0.03592325683332916, "sim_compute_performance-ego": 0.06345468301039475, "sim_compute_robot_state-ego": 0.06479272068056285}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.3933977016697776, "sim_physics": 0.12259340445200602, "survival_time": 14.950000000000076, "driven_lanedir": 1.2412946104643634, "sim_render-ego": 0.06472945769627889, "in-drivable-lane": 1.699999999999994, "agent_compute-ego": 0.18538142124811807, "deviation-heading": 13.132193694897174, "set_robot_commands": 0.10260731935501098, "deviation-center-line": 0.919770137458658, "driven_lanedir_consec": 1.2413075277175225, "sim_compute_sim_state": 0.04148445208867391, "sim_compute_performance-ego": 0.07448733409245809, "sim_compute_robot_state-ego": 0.08014459530512492}}
set_robot_commands_max0.11288224856058755
set_robot_commands_mean0.0986470576687756
set_robot_commands_median0.10260731935501098
set_robot_commands_min0.08592563001518576
sim_compute_performance-ego_max0.07675590515136718
sim_compute_performance-ego_mean0.07054681634597289
sim_compute_performance-ego_median0.07448733409245809
sim_compute_performance-ego_min0.06245121856530507
sim_compute_robot_state-ego_max0.08487915992736816
sim_compute_robot_state-ego_mean0.07583372827472849
sim_compute_robot_state-ego_median0.08014459530512492
sim_compute_robot_state-ego_min0.06479272068056285
sim_compute_sim_state_max0.0451024850209554
sim_compute_sim_state_mean0.04028724502702045
sim_compute_sim_state_median0.04148445208867391
sim_compute_sim_state_min0.03592325683332916
sim_physics_max0.14771248499552408
sim_physics_mean0.1213685534520027
sim_physics_median0.12259340445200602
sim_physics_min0.1009691739693666
sim_render-ego_max0.06775298039118449
sim_render-ego_mean0.062444923337708166
sim_render-ego_median0.06472945769627889
sim_render-ego_min0.05599241582756369
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean7.780000000000028
survival_time_min0.7500000000000001
223353404jp18813100494RL-TH-shiaido2-LFV-sim-validationstep1-simulationsuccessyes11740:33:16Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9002780320318644
survival_time_median14.950000000000076
deviation-center-line_median0.743188259604236
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20229021072387696
agent_compute-ego_mean0.1964731882344705
agent_compute-ego_median0.1999456971605247
agent_compute-ego_min0.18741837163125316
deviation-center-line_max1.1249348935824215
deviation-center-line_mean0.6203931540971046
deviation-center-line_min0.19718191547758884
deviation-heading_max8.298668567535927
deviation-heading_mean3.7806627796964953
deviation-heading_median3.7389490064723434
deviation-heading_min1.088630966570972
driven_any_max2.504622820944334
driven_any_mean2.048264710330718
driven_any_median1.9359410953534688
driven_any_min1.586999038625302
driven_lanedir_consec_max2.423406705376293
driven_lanedir_consec_mean1.9148741951610155
driven_lanedir_consec_min1.5622532782287046
driven_lanedir_max2.423406705376293
driven_lanedir_mean1.933629009416214
driven_lanedir_median1.9002780320318644
driven_lanedir_min1.5622532782287046
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean0.8100000000000105
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.504622820944334, "sim_physics": 0.19197086016337075, "survival_time": 14.950000000000076, "driven_lanedir": 2.423406705376293, "sim_render-ego": 0.06467749993006389, "in-drivable-lane": 0, "agent_compute-ego": 0.1922320548693339, "deviation-heading": 3.7389490064723434, "set_robot_commands": 0.10410301287968954, "deviation-center-line": 0.7610064452900737, "driven_lanedir_consec": 2.423406705376293, "sim_compute_sim_state": 0.04158165693283081, "sim_compute_performance-ego": 0.07209020932515463, "sim_compute_robot_state-ego": 0.07985193729400634, "sim_compute_robot_state-npc0": 0.07254498322804769, "sim_compute_robot_state-npc1": 0.073370627562205, "sim_compute_robot_state-npc2": 0.07202160994211833, "sim_compute_robot_state-npc3": 0.07336174885431926}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.586999038625302, "sim_physics": 0.23114733606855445, "survival_time": 5.349999999999989, "driven_lanedir": 1.5622532782287046, "sim_render-ego": 0.06841710126288583, "in-drivable-lane": 0, "agent_compute-ego": 0.1999456971605247, "deviation-heading": 1.088630966570972, "set_robot_commands": 0.10544839083591354, "deviation-center-line": 0.2756542565312034, "driven_lanedir_consec": 1.5622532782287046, "sim_compute_sim_state": 0.045055137616451656, "sim_compute_performance-ego": 0.0750174143604029, "sim_compute_robot_state-ego": 0.08683875119574716, "sim_compute_robot_state-npc0": 0.07969745742940457, "sim_compute_robot_state-npc1": 0.07330409834318072, "sim_compute_robot_state-npc2": 0.07569368754591897, "sim_compute_robot_state-npc3": 0.07737388789096725}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.342916809379382, "sim_physics": 0.19272905747095745, "survival_time": 14.950000000000076, "driven_lanedir": 2.1077808384280985, "sim_render-ego": 0.06749974886576335, "in-drivable-lane": 3.7500000000000537, "agent_compute-ego": 0.20047960678736368, "deviation-heading": 4.3897622456235545, "set_robot_commands": 0.10573049704233806, "deviation-center-line": 0.743188259604236, "driven_lanedir_consec": 2.0140067671521087, "sim_compute_sim_state": 0.04313803911209106, "sim_compute_performance-ego": 0.07586146513621013, "sim_compute_robot_state-ego": 0.08431521972020467, "sim_compute_robot_state-npc0": 0.0746781587600708, "sim_compute_robot_state-npc1": 0.07475382884343465, "sim_compute_robot_state-npc2": 0.07563069105148315, "sim_compute_robot_state-npc3": 0.07585959752400716}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9359410953534688, "sim_physics": 0.1905341498057047, "survival_time": 14.950000000000076, "driven_lanedir": 1.9002780320318644, "sim_render-ego": 0.07069112380345663, "in-drivable-lane": 0, "agent_compute-ego": 0.20229021072387696, "deviation-heading": 8.298668567535927, "set_robot_commands": 0.10615331331888836, "deviation-center-line": 1.1249348935824215, "driven_lanedir_consec": 1.9002780320318644, "sim_compute_sim_state": 0.04493663708368937, "sim_compute_performance-ego": 0.07630658149719238, "sim_compute_robot_state-ego": 0.08451057036717732, "sim_compute_robot_state-npc0": 0.07681315819422405, "sim_compute_robot_state-npc1": 0.07687550147374471, "sim_compute_robot_state-npc2": 0.07525029261906942, "sim_compute_robot_state-npc3": 0.07598870833714803}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.8708437873511017, "sim_physics": 0.16684447873023248, "survival_time": 7.7499999999999805, "driven_lanedir": 1.6744261930161075, "sim_render-ego": 0.0673941227697557, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.18741837163125316, "deviation-heading": 1.387303112279679, "set_robot_commands": 0.1015854835510254, "deviation-center-line": 0.19718191547758884, "driven_lanedir_consec": 1.6744261930161075, "sim_compute_sim_state": 0.041204269470707065, "sim_compute_performance-ego": 0.07398849302722561, "sim_compute_robot_state-ego": 0.07668310134641586, "sim_compute_robot_state-npc0": 0.07363253255044261, "sim_compute_robot_state-npc1": 0.07509246949226625, "sim_compute_robot_state-npc2": 0.07455550163022934, "sim_compute_robot_state-npc3": 0.0771674879135624}}
set_robot_commands_max0.10615331331888836
set_robot_commands_mean0.10460413952557096
set_robot_commands_median0.10544839083591354
set_robot_commands_min0.1015854835510254
sim_compute_performance-ego_max0.07630658149719238
sim_compute_performance-ego_mean0.07465283266923713
sim_compute_performance-ego_median0.0750174143604029
sim_compute_performance-ego_min0.07209020932515463
sim_compute_robot_state-ego_max0.08683875119574716
sim_compute_robot_state-ego_mean0.08243991598471027
sim_compute_robot_state-ego_median0.08431521972020467
sim_compute_robot_state-ego_min0.07668310134641586
sim_compute_robot_state-npc0_max0.07969745742940457
sim_compute_robot_state-npc0_mean0.07547325803243794
sim_compute_robot_state-npc0_median0.0746781587600708
sim_compute_robot_state-npc0_min0.07254498322804769
sim_compute_robot_state-npc1_max0.07687550147374471
sim_compute_robot_state-npc1_mean0.07467930514296625
sim_compute_robot_state-npc1_median0.07475382884343465
sim_compute_robot_state-npc1_min0.07330409834318072
sim_compute_robot_state-npc2_max0.07569368754591897
sim_compute_robot_state-npc2_mean0.07463035655776384
sim_compute_robot_state-npc2_median0.07525029261906942
sim_compute_robot_state-npc2_min0.07202160994211833
sim_compute_robot_state-npc3_max0.07737388789096725
sim_compute_robot_state-npc3_mean0.07595028610400083
sim_compute_robot_state-npc3_median0.07598870833714803
sim_compute_robot_state-npc3_min0.07336174885431926
sim_compute_sim_state_max0.045055137616451656
sim_compute_sim_state_mean0.043183148043154
sim_compute_sim_state_median0.04313803911209106
sim_compute_sim_state_min0.041204269470707065
sim_physics_max0.23114733606855445
sim_physics_mean0.19464517644776397
sim_physics_median0.19197086016337075
sim_physics_min0.16684447873023248
sim_render-ego_max0.07069112380345663
sim_render-ego_mean0.06773591932638509
sim_render-ego_median0.06749974886576335
sim_render-ego_min0.06467749993006389
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean11.59000000000004
survival_time_min5.349999999999989
223073489MYFtestaido2-LF-sim-testingstep1-simulationerroryes11741:00:29
Waited 3600 seconds [...]
Waited 3600 seconds for container to finish. Giving up. 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
223023441jp18813100494RL-TH-shiaido2-LF-sim-testingstep1-simulationerroryes11740:13:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222863446JBRRussiaJetBrains Researchaido2-LF-sim-validationstep1-simulationerroryes11740:03:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 441, in <module>
    wrap(cie)
  File "experiment_manager.py", line 429, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 > 
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222773485Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationerroryes11741 day, 4:00:51
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.1027402350404727
survival_time_median1.2500000000000004
deviation-center-line_median0.06544296847794585
in-drivable-lane_median0


other stats
agent_compute-ego_max0.3303907513618469
agent_compute-ego_mean0.23320438574409927
agent_compute-ego_median0.2372153323629628
agent_compute-ego_min0.10612981849246556
deviation-center-line_max0.11471293380088246
deviation-center-line_mean0.07366551010264304
deviation-center-line_min0.04330768303221607
deviation-heading_max0.8861256465852722
deviation-heading_mean0.6834126603743021
deviation-heading_median0.6864892933609761
deviation-heading_min0.4720613862039766
driven_any_max0.2265401530165733
driven_any_mean0.16478792760870897
driven_any_median0.1728980368258645
driven_any_min0.10010313722642758
driven_lanedir_consec_max0.13687376786535357
driven_lanedir_consec_mean0.09539888466179688
driven_lanedir_consec_min0.04996517884078999
driven_lanedir_max0.13687376786535357
driven_lanedir_mean0.09539888466179688
driven_lanedir_median0.1027402350404727
driven_lanedir_min0.04996517884078999
in-drivable-lane_max0.6000000000000005
in-drivable-lane_mean0.1466666666666668
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.2265401530165733, "sim_physics": 0.06642655531565349, "survival_time": 1.800000000000001, "driven_lanedir": 0.09521422466206753, "sim_render-ego": 0.03892297214931912, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.10612981849246556, "deviation-heading": 0.7470428132965999, "set_robot_commands": 0.05895649724536472, "deviation-center-line": 0.06544296847794585, "driven_lanedir_consec": 0.09521422466206753, "sim_compute_sim_state": 0.024946179654863145, "sim_compute_performance-ego": 0.04227668046951294, "sim_compute_robot_state-ego": 0.04366138908598158}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.19316793578971944, "sim_physics": 0.10786941051483154, "survival_time": 1.5000000000000009, "driven_lanedir": 0.12131465088002968, "sim_render-ego": 0.06030042966206869, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1593100070953369, "deviation-heading": 0.8224102854377632, "set_robot_commands": 0.08303285439809163, "deviation-center-line": 0.058056730149118635, "driven_lanedir_consec": 0.12131465088002968, "sim_compute_sim_state": 0.03621445496877034, "sim_compute_performance-ego": 0.06491014162699381, "sim_compute_robot_state-ego": 0.06612792015075683}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.1015179112504599, "sim_physics": 0.08228073622051038, "survival_time": 0.9500000000000004, "driven_lanedir": 0.06196415421569856, "sim_render-ego": 0.04702903095044588, "in-drivable-lane": 0, "agent_compute-ego": 0.14648733640971937, "deviation-heading": 0.5999894422828354, "set_robot_commands": 0.0718722845378675, "deviation-center-line": 0.08456689293596335, "driven_lanedir_consec": 0.06196415421569856, "sim_compute_sim_state": 0.030151643251117907, "sim_compute_performance-ego": 0.050949774290386, "sim_compute_robot_state-ego": 0.05556708888003701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18283329632114723, "sim_physics": 0.08912430703639984, "survival_time": 1.6000000000000008, "driven_lanedir": 0.04996517884078999, "sim_render-ego": 0.03903450816869736, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.22703376412391665, "deviation-heading": 0.7436804773248575, "set_robot_commands": 0.06333378702402115, "deviation-center-line": 0.04330768303221607, "driven_lanedir_consec": 0.04996517884078999, "sim_compute_sim_state": 0.025022469460964203, "sim_compute_performance-ego": 0.04279417544603348, "sim_compute_robot_state-ego": 0.04440531134605408}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.1918647106083934, "sim_physics": 0.1081997348416236, "survival_time": 1.5500000000000007, "driven_lanedir": 0.10493690957645718, "sim_render-ego": 0.05696830441874842, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.15363098729041316, "deviation-heading": 0.7516929596928439, "set_robot_commands": 0.08768313930880639, "deviation-center-line": 0.05545280126641955, "driven_lanedir_consec": 0.10493690957645718, "sim_compute_sim_state": 0.035244534092564735, "sim_compute_performance-ego": 0.0617682856898154, "sim_compute_robot_state-ego": 0.06316518783569336}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.1903282355579837, "sim_physics": 0.108311940883768, "survival_time": 1.4500000000000006, "driven_lanedir": 0.0757479515148698, "sim_render-ego": 0.04162390478726091, "in-drivable-lane": 0.30000000000000027, "agent_compute-ego": 0.23201981906233163, "deviation-heading": 0.8861256465852722, "set_robot_commands": 0.05833511516965669, "deviation-center-line": 0.06272845686281664, "driven_lanedir_consec": 0.0757479515148698, "sim_compute_sim_state": 0.02535616940465467, "sim_compute_performance-ego": 0.045579786958365606, "sim_compute_robot_state-ego": 0.04575495884336274}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.1728980368258645, "sim_physics": 0.1894012348992484, "survival_time": 1.4000000000000006, "driven_lanedir": 0.1335663905008393, "sim_render-ego": 0.08008298703602382, "in-drivable-lane": 0, "agent_compute-ego": 0.28085423367364065, "deviation-heading": 0.63592727960516, "set_robot_commands": 0.14533470358167375, "deviation-center-line": 0.10213005266155176, "driven_lanedir_consec": 0.1335663905008393, "sim_compute_sim_state": 0.050410338810512, "sim_compute_performance-ego": 0.08703265871320452, "sim_compute_robot_state-ego": 0.0986560923712594}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.10010313722642758, "sim_physics": 0.1760117249055342, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05089607795873663, "sim_render-ego": 0.08263158798217773, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.28046156059611926, "deviation-heading": 0.6864892933609761, "set_robot_commands": 0.14960771257227118, "deviation-center-line": 0.08332989335475907, "driven_lanedir_consec": 0.05089607795873663, "sim_compute_sim_state": 0.05180644989013672, "sim_compute_performance-ego": 0.0961452614177357, "sim_compute_robot_state-ego": 0.1178700490431352}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14731186490608625, "sim_physics": 0.2130121191342672, "survival_time": 1.2000000000000004, "driven_lanedir": 0.08202374429416315, "sim_render-ego": 0.0850486159324646, "in-drivable-lane": 0, "agent_compute-ego": 0.28470683097839355, "deviation-heading": 0.8193322172113917, "set_robot_commands": 0.1552390257517497, "deviation-center-line": 0.05773114260703888, "driven_lanedir_consec": 0.08202374429416315, "sim_compute_sim_state": 0.05712380011876424, "sim_compute_performance-ego": 0.09874682625134786, "sim_compute_robot_state-ego": 0.12776180108388266}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.15681013082487064, "sim_physics": 0.20726929540219513, "survival_time": 1.1500000000000004, "driven_lanedir": 0.11981060103974794, "sim_render-ego": 0.08722704389820927, "in-drivable-lane": 0, "agent_compute-ego": 0.27838124399599823, "deviation-heading": 0.5288675084697441, "set_robot_commands": 0.16448858509893002, "deviation-center-line": 0.08248149370961552, "driven_lanedir_consec": 0.11981060103974794, "sim_compute_sim_state": 0.056405129639998726, "sim_compute_performance-ego": 0.0983529920163362, "sim_compute_robot_state-ego": 0.1227933116581129}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.1500108148449771, "sim_physics": 0.190940390030543, "survival_time": 1.2000000000000004, "driven_lanedir": 0.11835141989328768, "sim_render-ego": 0.08592845002810161, "in-drivable-lane": 0, "agent_compute-ego": 0.3303907513618469, "deviation-heading": 0.4890783507159989, "set_robot_commands": 0.16216623783111572, "deviation-center-line": 0.10543160956415112, "driven_lanedir_consec": 0.11835141989328768, "sim_compute_sim_state": 0.052918861309687294, "sim_compute_performance-ego": 0.09761301676432292, "sim_compute_robot_state-ego": 0.11569082736968994}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.17622232829816695, "sim_physics": 0.214052209854126, "survival_time": 1.2500000000000004, "driven_lanedir": 0.13687376786535357, "sim_render-ego": 0.08648799896240235, "in-drivable-lane": 0, "agent_compute-ego": 0.2838736057281494, "deviation-heading": 0.6039984947155881, "set_robot_commands": 0.1471957778930664, "deviation-center-line": 0.08197719365174672, "driven_lanedir_consec": 0.13687376786535357, "sim_compute_sim_state": 0.0573793888092041, "sim_compute_performance-ego": 0.09733539581298828, "sim_compute_robot_state-ego": 0.12041623115539551}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.18595057423191488, "sim_physics": 0.18133905626112415, "survival_time": 1.5500000000000007, "driven_lanedir": 0.06950526434219195, "sim_render-ego": 0.07948507801178963, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.2619244283245456, "deviation-heading": 0.6496423902376691, "set_robot_commands": 0.1387332793205015, "deviation-center-line": 0.043484578697307624, "driven_lanedir_consec": 0.06950526434219195, "sim_compute_sim_state": 0.04954409599304199, "sim_compute_performance-ego": 0.0916402647572179, "sim_compute_robot_state-ego": 0.1123963709800474}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.16642722501959417, "sim_physics": 0.16152474403381348, "survival_time": 1.2500000000000004, "driven_lanedir": 0.1080726993022476, "sim_render-ego": 0.07580058097839355, "in-drivable-lane": 0, "agent_compute-ego": 0.2356460666656494, "deviation-heading": 0.8148513604738566, "set_robot_commands": 0.1346339225769043, "deviation-center-line": 0.06414822076811216, "driven_lanedir_consec": 0.1080726993022476, "sim_compute_sim_state": 0.05385343551635742, "sim_compute_performance-ego": 0.08914102554321289, "sim_compute_robot_state-ego": 0.1060425281524658}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.12983255940845506, "sim_physics": 0.17124386455701746, "survival_time": 1.1500000000000004, "driven_lanedir": 0.1027402350404727, "sim_render-ego": 0.07535830787990404, "in-drivable-lane": 0, "agent_compute-ego": 0.2372153323629628, "deviation-heading": 0.4720613862039766, "set_robot_commands": 0.1201479020326034, "deviation-center-line": 0.11471293380088246, "driven_lanedir_consec": 0.1027402350404727, "sim_compute_sim_state": 0.05077134007992952, "sim_compute_performance-ego": 0.08671092987060547, "sim_compute_robot_state-ego": 0.10011877184328824}}
set_robot_commands_max0.16448858509893002
set_robot_commands_mean0.1160507216228416
set_robot_commands_median0.1346339225769043
set_robot_commands_min0.05833511516965669
sim_compute_performance-ego_max0.09874682625134786
sim_compute_performance-ego_mean0.07673314770853859
sim_compute_performance-ego_median0.08703265871320452
sim_compute_performance-ego_min0.04227668046951294
sim_compute_robot_state-ego_max0.12776180108388266
sim_compute_robot_state-ego_mean0.08936185598661087
sim_compute_robot_state-ego_median0.10011877184328824
sim_compute_robot_state-ego_min0.04366138908598158
sim_compute_sim_state_max0.0573793888092041
sim_compute_sim_state_mean0.04380988606670447
sim_compute_sim_state_median0.050410338810512
sim_compute_sim_state_min0.024946179654863145
sim_physics_max0.214052209854126
sim_physics_mean0.1511338215927104
sim_physics_median0.17124386455701746
sim_physics_min0.06642655531565349
sim_render-ego_max0.08722704389820927
sim_render-ego_mean0.0681286533897338
sim_render-ego_median0.07580058097839355
sim_render-ego_min0.03892297214931912
simulation-passed1
survival_time_max1.800000000000001
survival_time_mean1.3400000000000003
survival_time_min0.9500000000000004
222563504jp18813100494Fourth test - THaido2-LF-sim-testingstep1-simulationerroryes11740:46:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222533510Bea Baselineschallenge-aido_LF-template-pytorchaido2-LFV-sim-validationstep1-simulationsuccessyes11740:08:24Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.14449336881715436
survival_time_median1.3000000000000005
deviation-center-line_median0.09692797217487278
in-drivable-lane_median0


other stats
agent_compute-ego_max0.24199397223336355
agent_compute-ego_mean0.22067797751653764
agent_compute-ego_median0.21551789687230036
agent_compute-ego_min0.20644450187683103
deviation-center-line_max0.11104770451998182
deviation-center-line_mean0.08794426518358177
deviation-center-line_min0.04815316715156456
deviation-heading_max0.9024980218381614
deviation-heading_mean0.6381249578526246
deviation-heading_median0.6457764228839468
deviation-heading_min0.41997040481206144
driven_any_max0.26810030027425963
driven_any_mean0.2009290456612464
driven_any_median0.20216789494432427
driven_any_min0.14748206803011835
driven_lanedir_consec_max0.2000270771392767
driven_lanedir_consec_mean0.1514391866653772
driven_lanedir_consec_min0.09895180144674298
driven_lanedir_max0.2000270771392767
driven_lanedir_mean0.1514391866653772
driven_lanedir_median0.14449336881715436
driven_lanedir_min0.09895180144674298
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26810030027425963, "sim_physics": 0.23849571162256705, "survival_time": 1.4500000000000006, "driven_lanedir": 0.2000270771392767, "sim_render-ego": 0.07294155811441355, "in-drivable-lane": 0, "agent_compute-ego": 0.20644450187683103, "deviation-heading": 0.7670068087522814, "set_robot_commands": 0.1100846241260397, "deviation-center-line": 0.0975736392287397, "driven_lanedir_consec": 0.2000270771392767, "sim_compute_sim_state": 0.04592177785676101, "sim_compute_performance-ego": 0.08205426972487877, "sim_compute_robot_state-ego": 0.09105286104925749, "sim_compute_robot_state-npc0": 0.0836728441304174, "sim_compute_robot_state-npc1": 0.08282772425947518, "sim_compute_robot_state-npc2": 0.08155160936815985, "sim_compute_robot_state-npc3": 0.08095921319106529}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.21706885968484976, "sim_physics": 0.22032915628873384, "survival_time": 1.3000000000000005, "driven_lanedir": 0.14449336881715436, "sim_render-ego": 0.07493189664987418, "in-drivable-lane": 0, "agent_compute-ego": 0.2255542094890888, "deviation-heading": 0.9024980218381614, "set_robot_commands": 0.11991558625147893, "deviation-center-line": 0.08601884284275, "driven_lanedir_consec": 0.14449336881715436, "sim_compute_sim_state": 0.04743526532099797, "sim_compute_performance-ego": 0.0857617213175847, "sim_compute_robot_state-ego": 0.08530643353095421, "sim_compute_robot_state-npc0": 0.07982167830834022, "sim_compute_robot_state-npc1": 0.08191629556509164, "sim_compute_robot_state-npc2": 0.07916885155897874, "sim_compute_robot_state-npc3": 0.08520510563483605}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.20216789494432427, "sim_physics": 0.2349537886106051, "survival_time": 1.3000000000000005, "driven_lanedir": 0.1752273778592457, "sim_render-ego": 0.0728517954166119, "in-drivable-lane": 0, "agent_compute-ego": 0.21551789687230036, "deviation-heading": 0.41997040481206144, "set_robot_commands": 0.10570810391352728, "deviation-center-line": 0.11104770451998182, "driven_lanedir_consec": 0.1752273778592457, "sim_compute_sim_state": 0.04701740008134108, "sim_compute_performance-ego": 0.08230995214902438, "sim_compute_robot_state-ego": 0.08810701737037072, "sim_compute_robot_state-npc0": 0.07973776413844182, "sim_compute_robot_state-npc1": 0.08169281482696533, "sim_compute_robot_state-npc2": 0.08579043241647574, "sim_compute_robot_state-npc3": 0.08427881277524508}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.16982610537268006, "sim_physics": 0.23896516362826029, "survival_time": 1.2000000000000004, "driven_lanedir": 0.13849630806446633, "sim_render-ego": 0.07381993532180786, "in-drivable-lane": 0, "agent_compute-ego": 0.2138793071111043, "deviation-heading": 0.4553731309766719, "set_robot_commands": 0.11104507247606914, "deviation-center-line": 0.09692797217487278, "driven_lanedir_consec": 0.13849630806446633, "sim_compute_sim_state": 0.04780049125353495, "sim_compute_performance-ego": 0.08528150121370952, "sim_compute_robot_state-ego": 0.08880794048309326, "sim_compute_robot_state-npc0": 0.07798965771993001, "sim_compute_robot_state-npc1": 0.08028829097747803, "sim_compute_robot_state-npc2": 0.08020408948262532, "sim_compute_robot_state-npc3": 0.08251932263374329}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.14748206803011835, "sim_physics": 0.21761671702067056, "survival_time": 1.0500000000000005, "driven_lanedir": 0.09895180144674298, "sim_render-ego": 0.07630040532066709, "in-drivable-lane": 0, "agent_compute-ego": 0.24199397223336355, "deviation-heading": 0.6457764228839468, "set_robot_commands": 0.10169896625337146, "deviation-center-line": 0.04815316715156456, "driven_lanedir_consec": 0.09895180144674298, "sim_compute_sim_state": 0.04268463452657064, "sim_compute_performance-ego": 0.07963779994419642, "sim_compute_robot_state-ego": 0.08148591859000069, "sim_compute_robot_state-npc0": 0.0787941955384754, "sim_compute_robot_state-npc1": 0.0750620478675479, "sim_compute_robot_state-npc2": 0.07223776408604213, "sim_compute_robot_state-npc3": 0.07575121380033947}}
set_robot_commands_max0.11991558625147893
set_robot_commands_mean0.10969047060409728
set_robot_commands_median0.1100846241260397
set_robot_commands_min0.10169896625337146
sim_compute_performance-ego_max0.0857617213175847
sim_compute_performance-ego_mean0.08300904886987877
sim_compute_performance-ego_median0.08230995214902438
sim_compute_performance-ego_min0.07963779994419642
sim_compute_robot_state-ego_max0.09105286104925749
sim_compute_robot_state-ego_mean0.08695203420473527
sim_compute_robot_state-ego_median0.08810701737037072
sim_compute_robot_state-ego_min0.08148591859000069
sim_compute_robot_state-npc0_max0.0836728441304174
sim_compute_robot_state-npc0_mean0.08000322796712096
sim_compute_robot_state-npc0_median0.07973776413844182
sim_compute_robot_state-npc0_min0.07798965771993001
sim_compute_robot_state-npc1_max0.08282772425947518
sim_compute_robot_state-npc1_mean0.08035743469931161
sim_compute_robot_state-npc1_median0.08169281482696533
sim_compute_robot_state-npc1_min0.0750620478675479
sim_compute_robot_state-npc2_max0.08579043241647574
sim_compute_robot_state-npc2_mean0.07979054938245636
sim_compute_robot_state-npc2_median0.08020408948262532
sim_compute_robot_state-npc2_min0.07223776408604213
sim_compute_robot_state-npc3_max0.08520510563483605
sim_compute_robot_state-npc3_mean0.08174273360704583
sim_compute_robot_state-npc3_median0.08251932263374329
sim_compute_robot_state-npc3_min0.07575121380033947
sim_compute_sim_state_max0.04780049125353495
sim_compute_sim_state_mean0.04617191380784113
sim_compute_sim_state_median0.04701740008134108
sim_compute_sim_state_min0.04268463452657064
sim_physics_max0.23896516362826029
sim_physics_mean0.23007210743416737
sim_physics_median0.2349537886106051
sim_physics_min0.21761671702067056
sim_render-ego_max0.07630040532066709
sim_render-ego_mean0.0741691181646749
sim_render-ego_median0.07381993532180786
sim_render-ego_min0.0728517954166119
simulation-passed1
survival_time_max1.4500000000000006
survival_time_mean1.2600000000000005
survival_time_min1.0500000000000005
222373062Andrea Censirotationaido2-LFVI-sim-testingstep1-simulationerroryes11740:06:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Hidden. If you are the author, please login using the top-right link or use the dashboard.
222303487Eric LuTesting the RL solutionaido2-LF-sim-validationstep1-simulationsuccessyes11740:07:43Hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07702513005734302
survival_time_median1.5000000000000009
deviation-center-line_median0.06322780922240491
in-drivable-lane_median0.20000000000000015


other stats
agent_compute-ego_max0.24281456663801865
agent_compute-ego_mean0.20590024768045376
agent_compute-ego_median0.20336381594340008
agent_compute-ego_min0.18731257833283524
deviation-center-line_max0.09228994787587767
deviation-center-line_mean0.06739387946171664
deviation-center-line_min0.05817012970604847
deviation-heading_max0.9069588715653688
deviation-heading_mean0.8172719243811251
deviation-heading_median0.7893877642710926
deviation-heading_min0.7755511975131113
driven_any_max0.21622709010408736
driven_any_mean0.17471026618198365
driven_any_median0.19511268671405285
driven_any_min0.08616675328102295
driven_lanedir_consec_max0.13911461535210312
driven_lanedir_consec_mean0.08986567256199576
driven_lanedir_consec_min0.03996051540502421
driven_lanedir_max0.13911461535210312
driven_lanedir_mean0.08986567256199576
driven_lanedir_median0.07702513005734302
driven_lanedir_min0.03996051540502421
in-drivable-lane_max0.6500000000000006
in-drivable-lane_mean0.2200000000000002
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19511268671405285, "sim_physics": 0.1594842124629665, "survival_time": 1.850000000000001, "driven_lanedir": 0.06252938188255053, "sim_render-ego": 0.06855236517416465, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.24281456663801865, "deviation-heading": 0.7893877642710926, "set_robot_commands": 0.11038223472801414, "deviation-center-line": 0.06322780922240491, "driven_lanedir_consec": 0.06252938188255053, "sim_compute_sim_state": 0.04487558957692739, "sim_compute_performance-ego": 0.0765572689674996, "sim_compute_robot_state-ego": 0.08888108665878708}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.1983187050797964, "sim_physics": 0.15384631156921386, "survival_time": 1.5000000000000009, "driven_lanedir": 0.13911461535210312, "sim_render-ego": 0.07084733645121256, "in-drivable-lane": 0, "agent_compute-ego": 0.20805320739746097, "deviation-heading": 0.8269869757353062, "set_robot_commands": 0.11699755191802978, "deviation-center-line": 0.06480953977680456, "driven_lanedir_consec": 0.13911461535210312, "sim_compute_sim_state": 0.046765772501627605, "sim_compute_performance-ego": 0.08351763089497884, "sim_compute_robot_state-ego": 0.08953993320465088}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.08616675328102295, "sim_physics": 0.13779963765825545, "survival_time": 1.0500000000000005, "driven_lanedir": 0.03996051540502421, "sim_render-ego": 0.06658320199875604, "in-drivable-lane": 0, "agent_compute-ego": 0.20336381594340008, "deviation-heading": 0.7755511975131113, "set_robot_commands": 0.1160060451144264, "deviation-center-line": 0.09228994787587767, "driven_lanedir_consec": 0.03996051540502421, "sim_compute_sim_state": 0.042987675893874394, "sim_compute_performance-ego": 0.07805758430844262, "sim_compute_robot_state-ego": 0.0802128655569894}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.1777260957309586, "sim_physics": 0.149964085940657, "survival_time": 1.4500000000000006, "driven_lanedir": 0.07702513005734302, "sim_render-ego": 0.06992267740183863, "in-drivable-lane": 0.2500000000000002, "agent_compute-ego": 0.18731257833283524, "deviation-heading": 0.9069588715653688, "set_robot_commands": 0.11041571354043894, "deviation-center-line": 0.05817012970604847, "driven_lanedir_consec": 0.07702513005734302, "sim_compute_sim_state": 0.04356162301425276, "sim_compute_performance-ego": 0.07931496357095652, "sim_compute_robot_state-ego": 0.08931944288056472}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.21622709010408736, "sim_physics": 0.1415658069379402, "survival_time": 1.6500000000000008, "driven_lanedir": 0.1306987201129579, "sim_render-ego": 0.06759853074044893, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.187957070090554, "deviation-heading": 0.787474812820747, "set_robot_commands": 0.10506774439956204, "deviation-center-line": 0.058471970727447566, "driven_lanedir_consec": 0.1306987201129579, "sim_compute_sim_state": 0.043017943700154625, "sim_compute_performance-ego": 0.07692229386531946, "sim_compute_robot_state-ego": 0.07888812007326068}}
set_robot_commands_max0.11699755191802978
set_robot_commands_mean0.11177385794009428
set_robot_commands_median0.11041571354043894
set_robot_commands_min0.10506774439956204
sim_compute_performance-ego_max0.08351763089497884
sim_compute_performance-ego_mean0.07887394832143942
sim_compute_performance-ego_median0.07805758430844262
sim_compute_performance-ego_min0.0765572689674996
sim_compute_robot_state-ego_max0.08953993320465088
sim_compute_robot_state-ego_mean0.08536828967485054
sim_compute_robot_state-ego_median0.08888108665878708
sim_compute_robot_state-ego_min0.07888812007326068
sim_compute_sim_state_max0.046765772501627605
sim_compute_sim_state_mean0.04424172093736736
sim_compute_sim_state_median0.04356162301425276
sim_compute_sim_state_min0.042987675893874394
sim_physics_max0.1594842124629665
sim_physics_mean0.1485320109138066
sim_physics_median0.149964085940657
sim_physics_min0.13779963765825545
sim_render-ego_max0.07084733645121256
sim_render-ego_mean0.06870082235328415
sim_render-ego_median0.06855236517416465
sim_render-ego_min0.06658320199875604
simulation-passed1
survival_time_max1.850000000000001
survival_time_mean1.5000000000000009
survival_time_min1.0500000000000005