Duckietown Challenges Home Challenges Submissions

Evaluator 920

ID920
evaluatorip-172-31-25-98-2348
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2348
versiond-c:4.0.25;d-c-r:4.0.32;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success3 21718
# timeout
# failed
# error1 21704
# aborted
# host-error2 21710
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
217643266Artem IoselevskiiSSegmaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-23480:26:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6348341183076425
survival_time_median4.449999999999992
deviation-center-line_median0.2340870108936746
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12014363209406537
agent_compute-ego_mean0.1070493695663506
agent_compute-ego_median0.10612450065193596
agent_compute-ego_min0.10178471406300862
deviation-center-line_max0.5646425298342752
deviation-center-line_mean0.2752795679414526
deviation-center-line_min0.13683058104420856
deviation-heading_max2.1914469599189275
deviation-heading_mean0.6438115706825877
deviation-heading_median0.4622479326185923
deviation-heading_min0.25044828113936424
driven_any_max1.630412423595113
driven_any_mean0.825775509327184
driven_any_median1.006730470334403
driven_any_min0.3952743776495573
driven_lanedir_consec_max1.2537075592547935
driven_lanedir_consec_mean0.6842368658747172
driven_lanedir_consec_min0.39063416021357655
driven_lanedir_max1.2537075592547935
driven_lanedir_mean0.6842368658747172
driven_lanedir_median0.6348341183076425
driven_lanedir_min0.39063416021357655
in-drivable-lane_max1.5999999999999943
in-drivable-lane_mean0.4599999999999983
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0195505807422467, "sim_physics": 0.1408791044256189, "survival_time": 4.549999999999992, "driven_lanedir": 0.6622330189623038, "sim_render-ego": 0.06934967669811877, "in-drivable-lane": 1.399999999999995, "agent_compute-ego": 0.10872106237725895, "deviation-heading": 0.3974070854360516, "set_robot_commands": 0.11657914224561754, "deviation-center-line": 0.24928997991065507, "driven_lanedir_consec": 0.6622330189623038, "sim_compute_sim_state": 0.04285706792558942, "sim_compute_performance-ego": 0.07982398389459966, "sim_compute_robot_state-ego": 0.09295015806680196}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0189533144942928, "sim_physics": 0.13135813607109917, "survival_time": 4.499999999999992, "driven_lanedir": 0.8460233923263447, "sim_render-ego": 0.06930126084221734, "in-drivable-lane": 0.4499999999999984, "agent_compute-ego": 0.10178471406300862, "deviation-heading": 1.2057817512860405, "set_robot_commands": 0.10773593054877388, "deviation-center-line": 0.34643235285820484, "driven_lanedir_consec": 0.8460233923263447, "sim_compute_sim_state": 0.041902894443935815, "sim_compute_performance-ego": 0.07841333283318414, "sim_compute_robot_state-ego": 0.08600791030459934}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.3952743776495573, "sim_physics": 0.1221290490566156, "survival_time": 1.950000000000001, "driven_lanedir": 0.39063416021357655, "sim_render-ego": 0.07089392344156902, "in-drivable-lane": 0, "agent_compute-ego": 0.10832107984102687, "deviation-heading": 0.31537236176087596, "set_robot_commands": 0.10297185335403834, "deviation-center-line": 0.20861736150387503, "driven_lanedir_consec": 0.39063416021357655, "sim_compute_sim_state": 0.04289551881643442, "sim_compute_performance-ego": 0.07801932554978591, "sim_compute_robot_state-ego": 0.08459317989838429}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4319590112535412, "sim_physics": 0.1419694083077567, "survival_time": 2.1000000000000005, "driven_lanedir": 0.41103666516483495, "sim_render-ego": 0.06750422999972389, "in-drivable-lane": 0, "agent_compute-ego": 0.1030066694532122, "deviation-heading": 0.6543248025327552, "set_robot_commands": 0.10162074792952765, "deviation-center-line": 0.14523021597749736, "driven_lanedir_consec": 0.41103666516483495, "sim_compute_sim_state": 0.04188140233357747, "sim_compute_performance-ego": 0.07347198327382405, "sim_compute_robot_state-ego": 0.08131248610360282}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.630412423595113, "sim_physics": 0.1234148859977722, "survival_time": 6.999999999999983, "driven_lanedir": 1.2537075592547935, "sim_render-ego": 0.06835226842335292, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.106872706753867, "deviation-heading": 0.4863728480407106, "set_robot_commands": 0.10551435266222273, "deviation-center-line": 0.5646425298342752, "driven_lanedir_consec": 1.2537075592547935, "sim_compute_sim_state": 0.04128285305840629, "sim_compute_performance-ego": 0.07700911249433245, "sim_compute_robot_state-ego": 0.08093926055090768}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.4197305046510951, "sim_physics": 0.14896717885645425, "survival_time": 2.0500000000000007, "driven_lanedir": 0.3925755223009615, "sim_render-ego": 0.0687668032762481, "in-drivable-lane": 0, "agent_compute-ego": 0.1126253721190662, "deviation-heading": 0.7336376052316261, "set_robot_commands": 0.125644829215073, "deviation-center-line": 0.1499101254090846, "driven_lanedir_consec": 0.3925755223009615, "sim_compute_sim_state": 0.04400038137668517, "sim_compute_performance-ego": 0.0808991106545053, "sim_compute_robot_state-ego": 0.09867383212578006}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.0311799755323885, "sim_physics": 0.1172798230097844, "survival_time": 4.549999999999992, "driven_lanedir": 0.6348341183076425, "sim_render-ego": 0.06952713610051753, "in-drivable-lane": 1.5499999999999945, "agent_compute-ego": 0.10440769824352893, "deviation-heading": 0.6696747591623915, "set_robot_commands": 0.10814343703972114, "deviation-center-line": 0.2340870108936746, "driven_lanedir_consec": 0.6348341183076425, "sim_compute_sim_state": 0.044429786912687536, "sim_compute_performance-ego": 0.07692091281597431, "sim_compute_robot_state-ego": 0.0840431884094909}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.40750230095268825, "sim_physics": 0.13640456795692443, "survival_time": 2.000000000000001, "driven_lanedir": 0.4024655572412795, "sim_render-ego": 0.06877986192703248, "in-drivable-lane": 0, "agent_compute-ego": 0.10512746572494508, "deviation-heading": 0.31690554787662356, "set_robot_commands": 0.1098111927509308, "deviation-center-line": 0.2115466679803573, "driven_lanedir_consec": 0.4024655572412795, "sim_compute_sim_state": 0.04650521874427795, "sim_compute_performance-ego": 0.07134816646575928, "sim_compute_robot_state-ego": 0.07988585829734803}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.6153957472941777, "sim_physics": 0.12386489751046165, "survival_time": 2.849999999999998, "driven_lanedir": 0.6079501019189868, "sim_render-ego": 0.06420379354242693, "in-drivable-lane": 0, "agent_compute-ego": 0.10191908217312996, "deviation-heading": 0.4311223446061367, "set_robot_commands": 0.10730132303739848, "deviation-center-line": 0.1914177375172585, "driven_lanedir_consec": 0.6079501019189868, "sim_compute_sim_state": 0.04343584964149877, "sim_compute_performance-ego": 0.07629234748974181, "sim_compute_robot_state-ego": 0.07992445376881382}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 1.4347369156758183, "sim_physics": 0.13198562591306626, "survival_time": 6.199999999999986, "driven_lanedir": 0.8432327336830724, "sim_render-ego": 0.06804768693062567, "in-drivable-lane": 1.5999999999999943, "agent_compute-ego": 0.10849764462440244, "deviation-heading": 2.1914469599189275, "set_robot_commands": 0.10595332422564106, "deviation-center-line": 0.3778087094388965, "driven_lanedir_consec": 0.8432327336830724, "sim_compute_sim_state": 0.03889782582559893, "sim_compute_performance-ego": 0.07521985615453412, "sim_compute_robot_state-ego": 0.0809864132635055}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.0189596156181688, "sim_physics": 0.12944273153940836, "survival_time": 4.499999999999992, "driven_lanedir": 1.015992999734752, "sim_render-ego": 0.06902847554948595, "in-drivable-lane": 0, "agent_compute-ego": 0.10978477266099718, "deviation-heading": 0.3169929293009114, "set_robot_commands": 0.10978369447920056, "deviation-center-line": 0.3849838911519968, "driven_lanedir_consec": 1.015992999734752, "sim_compute_sim_state": 0.042776526345147024, "sim_compute_performance-ego": 0.07811537053849962, "sim_compute_robot_state-ego": 0.08560616970062256}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5053336621018303, "sim_physics": 0.159454474846522, "survival_time": 2.3999999999999995, "driven_lanedir": 0.4991012531702276, "sim_render-ego": 0.06948535641034444, "in-drivable-lane": 0, "agent_compute-ego": 0.12014363209406537, "deviation-heading": 0.37161977192669055, "set_robot_commands": 0.1164013644059499, "deviation-center-line": 0.1939285370201503, "driven_lanedir_consec": 0.4991012531702276, "sim_compute_sim_state": 0.04343064626057943, "sim_compute_performance-ego": 0.08374443153540294, "sim_compute_robot_state-ego": 0.09444471697012584}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.0311829313299097, "sim_physics": 0.12304999016143464, "survival_time": 4.549999999999992, "driven_lanedir": 0.8901821336000294, "sim_render-ego": 0.07119439722417475, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.10612450065193596, "deviation-heading": 0.8538185794011174, "set_robot_commands": 0.11440922139765142, "deviation-center-line": 0.28983144054201093, "driven_lanedir_consec": 0.8901821336000294, "sim_compute_sim_state": 0.043388227840046305, "sim_compute_performance-ego": 0.07869745610834478, "sim_compute_robot_state-ego": 0.08806308023222201}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.4197308086825328, "sim_physics": 0.13322504555306783, "survival_time": 2.0500000000000007, "driven_lanedir": 0.40877690422948687, "sim_render-ego": 0.0678408087753668, "in-drivable-lane": 0, "agent_compute-ego": 0.10243961869216547, "deviation-heading": 0.4622479326185923, "set_robot_commands": 0.10478536094107278, "deviation-center-line": 0.13683058104420856, "driven_lanedir_consec": 0.40877690422948687, "sim_compute_sim_state": 0.040442152721125904, "sim_compute_performance-ego": 0.07310423618409692, "sim_compute_robot_state-ego": 0.08491361431959199}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 1.006730470334403, "sim_physics": 0.12897300720214844, "survival_time": 4.449999999999992, "driven_lanedir": 1.0048068680124644, "sim_render-ego": 0.06714749336242676, "in-drivable-lane": 0, "agent_compute-ego": 0.10596452402264885, "deviation-heading": 0.25044828113936424, "set_robot_commands": 0.1032872682207086, "deviation-center-line": 0.44463637803964445, "driven_lanedir_consec": 1.0048068680124644, "sim_compute_sim_state": 0.0415667389216048, "sim_compute_performance-ego": 0.07516310991865865, "sim_compute_robot_state-ego": 0.08122830444507384}}
set_robot_commands_max0.125644829215073
set_robot_commands_mean0.1093295361635685
set_robot_commands_median0.10773593054877388
set_robot_commands_min0.10162074792952765
sim_compute_performance-ego_max0.08374443153540294
sim_compute_performance-ego_mean0.0770828490607496
sim_compute_performance-ego_median0.07700911249433245
sim_compute_performance-ego_min0.07134816646575928
sim_compute_robot_state-ego_max0.09867383212578006
sim_compute_robot_state-ego_mean0.08557150843045805
sim_compute_robot_state-ego_median0.08459317989838429
sim_compute_robot_state-ego_min0.07988585829734803
sim_compute_sim_state_max0.04650521874427795
sim_compute_sim_state_mean0.04264620607781301
sim_compute_sim_state_median0.04285706792558942
sim_compute_sim_state_min0.03889782582559893
sim_physics_max0.159454474846522
sim_physics_mean0.13282652842720902
sim_physics_median0.13135813607109917
sim_physics_min0.1172798230097844
sim_render-ego_max0.07119439722417475
sim_render-ego_mean0.06862821150024209
sim_render-ego_median0.06877986192703248
sim_render-ego_min0.06420379354242693
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.713333333333328
survival_time_min1.950000000000001
No reset possible
217542762Bhairav Mehtachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-25-98-23480:29:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.08959183973424575
agent_compute-ego_mean0.07763396333034031
agent_compute-ego_median0.07642218896320888
agent_compute-ego_min0.07323421478271484
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.21333837221903973, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0698129383914442, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07741377439843602, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.10757723199315818, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.04089270442365164, "sim_compute_performance-ego": 0.07676117678722703, "sim_compute_robot_state-ego": 0.08648155970745776, "sim_compute_robot_state-npc0": 0.07445949818714555, "sim_compute_robot_state-npc1": 0.1009422583752368, "sim_compute_robot_state-npc2": 0.07188803316598916, "sim_compute_robot_state-npc3": 0.07539020676210702}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.19824566664519133, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06682462162441677, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07565025047019676, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09716116940533671, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03922555181715223, "sim_compute_performance-ego": 0.06933038323013871, "sim_compute_robot_state-ego": 0.07066242783157914, "sim_compute_robot_state-npc0": 0.0694382455613878, "sim_compute_robot_state-npc1": 0.07227094085128219, "sim_compute_robot_state-npc2": 0.06753078213444462, "sim_compute_robot_state-npc3": 0.06926212487397371}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.2181963309263572, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.0749737024307251, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07427985545916435, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.09999987406608386, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04035461865938627, "sim_compute_performance-ego": 0.07123058881515111, "sim_compute_robot_state-ego": 0.07484035919874142, "sim_compute_robot_state-npc0": 0.07227577612950252, "sim_compute_robot_state-npc1": 0.07135729911999825, "sim_compute_robot_state-npc2": 0.07465996803381504, "sim_compute_robot_state-npc3": 0.07263215994223571}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.21610072621128015, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06729085403576232, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.07357625375714219, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.10366170448169372, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.040047624654937206, "sim_compute_performance-ego": 0.06899230940300122, "sim_compute_robot_state-ego": 0.07642903662564461, "sim_compute_robot_state-npc0": 0.07085929837143212, "sim_compute_robot_state-npc1": 0.0704262842211807, "sim_compute_robot_state-npc2": 0.07170875867207845, "sim_compute_robot_state-npc3": 0.07285962188453005}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.2569649945134702, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.0699441847593888, "in-drivable-lane": 0, "agent_compute-ego": 0.08179508084836214, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.1168828943501348, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04429987202519956, "sim_compute_performance-ego": 0.08125134136365808, "sim_compute_robot_state-ego": 0.08672549413598102, "sim_compute_robot_state-npc0": 0.0765953374945599, "sim_compute_robot_state-npc1": 0.07935873321864916, "sim_compute_robot_state-npc2": 0.0779129111248514, "sim_compute_robot_state-npc3": 0.07698647872261379}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.20696496262269864, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06754868872025434, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.08959183973424575, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10717427263072891, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04026557417476878, "sim_compute_performance-ego": 0.07408307346643186, "sim_compute_robot_state-ego": 0.07804706751131545, "sim_compute_robot_state-npc0": 0.07286140264249315, "sim_compute_robot_state-npc1": 0.07550493408651913, "sim_compute_robot_state-npc2": 0.07251103485331815, "sim_compute_robot_state-npc3": 0.0735711139791152}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.22692302465438843, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06732455321720668, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.0757730347769601, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.1049614259174892, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.04632181780678885, "sim_compute_performance-ego": 0.07540546485355921, "sim_compute_robot_state-ego": 0.08256627832140241, "sim_compute_robot_state-npc0": 0.0725879328591483, "sim_compute_robot_state-npc1": 0.07323632240295411, "sim_compute_robot_state-npc2": 0.07409851551055908, "sim_compute_robot_state-npc3": 0.07673009634017944}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.22472717010811585, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06547936348065939, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07727941748214094, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10410696839633052, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.042267165771902426, "sim_compute_performance-ego": 0.07304799720032575, "sim_compute_robot_state-ego": 0.07839933813434757, "sim_compute_robot_state-npc0": 0.07495498004024975, "sim_compute_robot_state-npc1": 0.07297320235265445, "sim_compute_robot_state-npc2": 0.07374847098572614, "sim_compute_robot_state-npc3": 0.0737939664762314}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.2224443236062693, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06402207807052968, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07622104744578517, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.103693449219992, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.04014740433803825, "sim_compute_performance-ego": 0.07281361069790153, "sim_compute_robot_state-ego": 0.08838322550751442, "sim_compute_robot_state-npc0": 0.07698290569837703, "sim_compute_robot_state-npc1": 0.07444504527158516, "sim_compute_robot_state-npc2": 0.07432896591896235, "sim_compute_robot_state-npc3": 0.07281635805617931}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.252311660693242, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06750788138462947, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07836073178511399, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.10247790813446044, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.042850109247060925, "sim_compute_performance-ego": 0.08316570061903733, "sim_compute_robot_state-ego": 0.07790497633127066, "sim_compute_robot_state-npc0": 0.07380644174722525, "sim_compute_robot_state-npc1": 0.07223205383007343, "sim_compute_robot_state-npc2": 0.07413471662081204, "sim_compute_robot_state-npc3": 0.07370431606586163}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2053914483388265, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.0647849178314209, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.07323421478271484, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.0993956724802653, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.040994634628295896, "sim_compute_performance-ego": 0.06927428563435872, "sim_compute_robot_state-ego": 0.0762678559621175, "sim_compute_robot_state-npc0": 0.07123943964640299, "sim_compute_robot_state-npc1": 0.07105056762695312, "sim_compute_robot_state-npc2": 0.07195704460144042, "sim_compute_robot_state-npc3": 0.07354556719462077}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.20733640307471865, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06275397255307152, "in-drivable-lane": 0, "agent_compute-ego": 0.07426678566705613, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.09387343270438056, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.03915431385948544, "sim_compute_performance-ego": 0.0703152474902925, "sim_compute_robot_state-ego": 0.07193924131847564, "sim_compute_robot_state-npc0": 0.07754158973693848, "sim_compute_robot_state-npc1": 0.07089739754086449, "sim_compute_robot_state-npc2": 0.07083784966241746, "sim_compute_robot_state-npc3": 0.06876330148606073}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.1982302998387536, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06350373667339947, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07845338555269463, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.0954894409623257, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.03855172977891079, "sim_compute_performance-ego": 0.06682869445445926, "sim_compute_robot_state-ego": 0.07270241338153217, "sim_compute_robot_state-npc0": 0.0730439729468767, "sim_compute_robot_state-npc1": 0.06736363366592762, "sim_compute_robot_state-npc2": 0.06665972221729367, "sim_compute_robot_state-npc3": 0.06795642542284588}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.21452511208398, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06904617377689906, "in-drivable-lane": 0, "agent_compute-ego": 0.07642218896320888, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.10335831982748848, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04375799213136945, "sim_compute_performance-ego": 0.07459201983043126, "sim_compute_robot_state-ego": 0.07997763156890869, "sim_compute_robot_state-npc0": 0.07582961661475045, "sim_compute_robot_state-npc1": 0.0751151272228786, "sim_compute_robot_state-npc2": 0.07711912052971977, "sim_compute_robot_state-npc3": 0.07626725946153913}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2638050387887394, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06994512501884909, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.08219158883188285, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.11486027287501915, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.04282546510883406, "sim_compute_performance-ego": 0.07600508484185911, "sim_compute_robot_state-ego": 0.08557364987392052, "sim_compute_robot_state-npc0": 0.09411251778696098, "sim_compute_robot_state-npc1": 0.07601740780998678, "sim_compute_robot_state-npc2": 0.07646491480808632, "sim_compute_robot_state-npc3": 0.07731982305938122}}
set_robot_commands_max0.1168828943501348
set_robot_commands_mean0.1036449358296592
set_robot_commands_median0.10366170448169372
set_robot_commands_min0.09387343270438056
sim_compute_performance-ego_max0.08316570061903733
sim_compute_performance-ego_mean0.07353979857918884
sim_compute_performance-ego_median0.07304799720032575
sim_compute_performance-ego_min0.06682869445445926
sim_compute_robot_state-ego_max0.08838322550751442
sim_compute_robot_state-ego_mean0.07912670369401395
sim_compute_robot_state-ego_median0.07804706751131545
sim_compute_robot_state-ego_min0.07066242783157914
sim_compute_robot_state-npc0_max0.09411251778696098
sim_compute_robot_state-npc0_mean0.07510593036423008
sim_compute_robot_state-npc0_median0.07380644174722525
sim_compute_robot_state-npc0_min0.0694382455613878
sim_compute_robot_state-npc1_max0.1009422583752368
sim_compute_robot_state-npc1_mean0.07487941383978294
sim_compute_robot_state-npc1_median0.07297320235265445
sim_compute_robot_state-npc1_min0.06736363366592762
sim_compute_robot_state-npc2_max0.0779129111248514
sim_compute_robot_state-npc2_mean0.07303738725596759
sim_compute_robot_state-npc2_median0.07374847098572614
sim_compute_robot_state-npc2_min0.06665972221729367
sim_compute_robot_state-npc3_max0.07731982305938122
sim_compute_robot_state-npc3_mean0.07343992131516501
sim_compute_robot_state-npc3_median0.0735711139791152
sim_compute_robot_state-npc3_min0.06795642542284588
sim_compute_sim_state_max0.04632181780678885
sim_compute_sim_state_mean0.04146377189505211
sim_compute_sim_state_median0.04089270442365164
sim_compute_sim_state_min0.03855172977891079
sim_physics_max0.2638050387887394
sim_physics_mean0.22170036895500472
sim_physics_median0.21610072621128015
sim_physics_min0.1982302998387536
sim_render-ego_max0.0749737024307251
sim_render-ego_mean0.0673841861312438
sim_render-ego_median0.06732455321720668
sim_render-ego_min0.06275397255307152
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible
217392826Liam Paull 🇨🇦challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-25-98-23480:27:21
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2826/step1-simulation-ip-172-31-25-98-2348-job21739/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217182636Andrea Censi 🇨🇭challenge-aido_LF-template-randomaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-25-98-23480:32:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6537162971975778
survival_time_median2.5999999999999988
deviation-center-line_median0.14884708769804722
in-drivable-lane_median0.549999999999998


other stats
agent_compute-ego_max0.16922785341739657
agent_compute-ego_mean0.16002697267858115
agent_compute-ego_median0.1612071990966797
agent_compute-ego_min0.14753039316697555
deviation-center-line_max0.5141120095458062
deviation-center-line_mean0.1769000227005324
deviation-center-line_min0.06216029860587694
deviation-heading_max1.9929437250081896
deviation-heading_mean0.692977823395608
deviation-heading_median0.4928440244444201
deviation-heading_min0.24234723632033853
driven_any_max3.5343244022418343
driven_any_mean1.3470385992234175
driven_any_median1.001633421251194
driven_any_min0.3412551960104244
driven_lanedir_consec_max2.494308053441959
driven_lanedir_consec_mean0.881391085527715
driven_lanedir_consec_min0.3199180625488627
driven_lanedir_max2.494308053441959
driven_lanedir_mean0.8962528018383226
driven_lanedir_median0.7206363324756615
driven_lanedir_min0.3199180625488627
in-drivable-lane_max3.549999999999991
in-drivable-lane_mean0.839999999999998
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.5811782993597916, "sim_physics": 0.22145050990430615, "survival_time": 3.949999999999994, "driven_lanedir": 0.9217908232230632, "sim_render-ego": 0.06480857993983015, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.16139281852335868, "deviation-heading": 0.5694288623982039, "set_robot_commands": 0.1015689825709862, "deviation-center-line": 0.2348196785686717, "driven_lanedir_consec": 0.9213701538661684, "sim_compute_sim_state": 0.04180425330053402, "sim_compute_performance-ego": 0.07121789304515984, "sim_compute_robot_state-ego": 0.07596382913710195, "sim_compute_robot_state-npc0": 0.07217452797708632, "sim_compute_robot_state-npc1": 0.0724297445031661, "sim_compute_robot_state-npc2": 0.07371911217894735, "sim_compute_robot_state-npc3": 0.07301240933092334}, "udem1-1-0": {"driven_any": 0.47798123795353353, "sim_physics": 0.2049611040524074, "survival_time": 1.4000000000000006, "driven_lanedir": 0.4500753586658095, "sim_render-ego": 0.06230678728648594, "in-drivable-lane": 0, "agent_compute-ego": 0.1612071990966797, "deviation-heading": 0.46504862964833654, "set_robot_commands": 0.09677979775837488, "deviation-center-line": 0.09791133281082, "driven_lanedir_consec": 0.4500753586658095, "sim_compute_sim_state": 0.03909456729888916, "sim_compute_performance-ego": 0.06708533423287528, "sim_compute_robot_state-ego": 0.07780144044331141, "sim_compute_robot_state-npc0": 0.06996663979121617, "sim_compute_robot_state-npc1": 0.07344956908907209, "sim_compute_robot_state-npc2": 0.07659986189433507, "sim_compute_robot_state-npc3": 0.06966185569763184}, "udem1-2-0": {"driven_any": 2.1864003300000694, "sim_physics": 0.20122178086956727, "survival_time": 5.14999999999999, "driven_lanedir": 1.826231945363564, "sim_render-ego": 0.06520806701437941, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.1646417738164513, "deviation-heading": 0.8115272458314897, "set_robot_commands": 0.1055208849675447, "deviation-center-line": 0.1927316041609401, "driven_lanedir_consec": 1.826231945363564, "sim_compute_sim_state": 0.039994304619946526, "sim_compute_performance-ego": 0.07285845395430778, "sim_compute_robot_state-ego": 0.07956720787344627, "sim_compute_robot_state-npc0": 0.07403945691377214, "sim_compute_robot_state-npc1": 0.07196513425956652, "sim_compute_robot_state-npc2": 0.07103903548231402, "sim_compute_robot_state-npc3": 0.07274032333522167}, "udem1-3-0": {"driven_any": 0.9410513078477724, "sim_physics": 0.22698932389418283, "survival_time": 2.3999999999999995, "driven_lanedir": 0.493517638549009, "sim_render-ego": 0.06449323892593384, "in-drivable-lane": 0.8999999999999988, "agent_compute-ego": 0.16922785341739657, "deviation-heading": 0.35154027506548424, "set_robot_commands": 0.1032644013563792, "deviation-center-line": 0.08975118546699407, "driven_lanedir_consec": 0.493517638549009, "sim_compute_sim_state": 0.04171361029148102, "sim_compute_performance-ego": 0.07475889225800832, "sim_compute_robot_state-ego": 0.08275824785232544, "sim_compute_robot_state-npc0": 0.07455855111281078, "sim_compute_robot_state-npc1": 0.07263006766637166, "sim_compute_robot_state-npc2": 0.07657873133818309, "sim_compute_robot_state-npc3": 0.07235633830229442}, "udem1-4-0": {"driven_any": 0.34749292376309954, "sim_physics": 0.2070900939759754, "survival_time": 1.0500000000000005, "driven_lanedir": 0.3325249708009643, "sim_render-ego": 0.06405992734999884, "in-drivable-lane": 0, "agent_compute-ego": 0.1536697887239002, "deviation-heading": 0.30044835691402494, "set_robot_commands": 0.09637309256054108, "deviation-center-line": 0.06216029860587694, "driven_lanedir_consec": 0.3325249708009643, "sim_compute_sim_state": 0.03887611343747094, "sim_compute_performance-ego": 0.06625113033113025, "sim_compute_robot_state-ego": 0.07399890536353701, "sim_compute_robot_state-npc0": 0.06852257819402785, "sim_compute_robot_state-npc1": 0.07202739942641485, "sim_compute_robot_state-npc2": 0.07713884399050758, "sim_compute_robot_state-npc3": 0.07193651653471447}, "udem1-5-0": {"driven_any": 3.5343244022418343, "sim_physics": 0.20853233337402344, "survival_time": 8.349999999999984, "driven_lanedir": 2.494308053441959, "sim_render-ego": 0.06298578285171601, "in-drivable-lane": 2, "agent_compute-ego": 0.16075156691545495, "deviation-heading": 1.9929437250081896, "set_robot_commands": 0.10147679066229724, "deviation-center-line": 0.5141120095458062, "driven_lanedir_consec": 2.494308053441959, "sim_compute_sim_state": 0.04148528961364381, "sim_compute_performance-ego": 0.07003175712631134, "sim_compute_robot_state-ego": 0.07668627093652051, "sim_compute_robot_state-npc0": 0.07285621637355781, "sim_compute_robot_state-npc1": 0.07256649782557688, "sim_compute_robot_state-npc2": 0.07273639604716958, "sim_compute_robot_state-npc3": 0.0725618293899262}, "udem1-6-0": {"driven_any": 2.176040550989443, "sim_physics": 0.2288055882870572, "survival_time": 5.14999999999999, "driven_lanedir": 1.9748003483573369, "sim_render-ego": 0.06655566437730512, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.16755361232942748, "deviation-heading": 0.7877172510198454, "set_robot_commands": 0.1064014295929844, "deviation-center-line": 0.30661477465861414, "driven_lanedir_consec": 1.9748003483573369, "sim_compute_sim_state": 0.04074084411547022, "sim_compute_performance-ego": 0.07294594199912062, "sim_compute_robot_state-ego": 0.07968479684255655, "sim_compute_robot_state-npc0": 0.0733976225251133, "sim_compute_robot_state-npc1": 0.0727431496370186, "sim_compute_robot_state-npc2": 0.07269344283539114, "sim_compute_robot_state-npc3": 0.07285733593320384}, "udem1-7-0": {"driven_any": 1.0050236108346422, "sim_physics": 0.2307201385498047, "survival_time": 2.499999999999999, "driven_lanedir": 0.8701796426684156, "sim_render-ego": 0.06627543449401856, "in-drivable-lane": 0, "agent_compute-ego": 0.1638109302520752, "deviation-heading": 0.9227446658975216, "set_robot_commands": 0.10349681377410888, "deviation-center-line": 0.14884708769804722, "driven_lanedir_consec": 0.8546116490381102, "sim_compute_sim_state": 0.03896227359771728, "sim_compute_performance-ego": 0.06812188625335694, "sim_compute_robot_state-ego": 0.07788260936737061, "sim_compute_robot_state-npc0": 0.06971373081207276, "sim_compute_robot_state-npc1": 0.0706102705001831, "sim_compute_robot_state-npc2": 0.0688011646270752, "sim_compute_robot_state-npc3": 0.07068071365356446}, "udem1-8-0": {"driven_any": 0.9970416603019576, "sim_physics": 0.2058996053842398, "survival_time": 2.5999999999999988, "driven_lanedir": 0.8041152574540316, "sim_render-ego": 0.06292463265932523, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.15703749656677246, "deviation-heading": 0.6817155913229235, "set_robot_commands": 0.1049344723041241, "deviation-center-line": 0.1898768080806288, "driven_lanedir_consec": 0.8041152574540316, "sim_compute_sim_state": 0.039221034600184515, "sim_compute_performance-ego": 0.0708569334103511, "sim_compute_robot_state-ego": 0.07541334629058838, "sim_compute_robot_state-npc0": 0.07147351136574379, "sim_compute_robot_state-npc1": 0.07222198523007907, "sim_compute_robot_state-npc2": 0.06981861591339111, "sim_compute_robot_state-npc3": 0.07156156576596774}, "udem1-9-0": {"driven_any": 0.4374998710472299, "sim_physics": 0.2346578286244319, "survival_time": 1.3000000000000005, "driven_lanedir": 0.4177527119659043, "sim_render-ego": 0.0650171683384822, "in-drivable-lane": 0, "agent_compute-ego": 0.15764164924621582, "deviation-heading": 0.3796137446285097, "set_robot_commands": 0.0996522353245662, "deviation-center-line": 0.08207813392324871, "driven_lanedir_consec": 0.4177527119659043, "sim_compute_sim_state": 0.037839724467350885, "sim_compute_performance-ego": 0.06704094776740441, "sim_compute_robot_state-ego": 0.07634298618023212, "sim_compute_robot_state-npc0": 0.06829995375413161, "sim_compute_robot_state-npc1": 0.06750624913435715, "sim_compute_robot_state-npc2": 0.06581799800579365, "sim_compute_robot_state-npc3": 0.06843144160050613}, "udem1-10-0": {"driven_any": 0.3412551960104244, "sim_physics": 0.2373000275004994, "survival_time": 1.1000000000000003, "driven_lanedir": 0.3199180625488627, "sim_render-ego": 0.06634000214663419, "in-drivable-lane": 0, "agent_compute-ego": 0.14753039316697555, "deviation-heading": 0.3796986873122644, "set_robot_commands": 0.09877383708953856, "deviation-center-line": 0.06276575300040536, "driven_lanedir_consec": 0.3199180625488627, "sim_compute_sim_state": 0.03876991705460982, "sim_compute_performance-ego": 0.07451960173520175, "sim_compute_robot_state-ego": 0.0777091004631736, "sim_compute_robot_state-npc0": 0.0721123218536377, "sim_compute_robot_state-npc1": 0.07147357680580833, "sim_compute_robot_state-npc2": 0.07181205532767555, "sim_compute_robot_state-npc3": 0.06771359660408714}, "udem1-11-0": {"driven_any": 0.9951985237696338, "sim_physics": 0.2129552698135376, "survival_time": 2.499999999999999, "driven_lanedir": 0.7206363324756615, "sim_render-ego": 0.0648118782043457, "in-drivable-lane": 0.549999999999998, "agent_compute-ego": 0.16410726070404053, "deviation-heading": 0.30074636349085415, "set_robot_commands": 0.0993587303161621, "deviation-center-line": 0.16567670185555422, "driven_lanedir_consec": 0.7185075497455284, "sim_compute_sim_state": 0.04151664257049561, "sim_compute_performance-ego": 0.07515807628631592, "sim_compute_robot_state-ego": 0.0818988561630249, "sim_compute_robot_state-npc0": 0.07054418563842774, "sim_compute_robot_state-npc1": 0.07182856559753419, "sim_compute_robot_state-npc2": 0.07367422103881836, "sim_compute_robot_state-npc3": 0.07519673347473145}, "udem1-12-0": {"driven_any": 1.964687870253437, "sim_physics": 0.2067983505573679, "survival_time": 4.699999999999991, "driven_lanedir": 0.35162821871931205, "sim_render-ego": 0.06190007037304817, "in-drivable-lane": 3.549999999999991, "agent_compute-ego": 0.15845732232357593, "deviation-heading": 0.24234723632033853, "set_robot_commands": 0.09889869740668764, "deviation-center-line": 0.13126670634798973, "driven_lanedir_consec": 0.35162821871931205, "sim_compute_sim_state": 0.03936692247999475, "sim_compute_performance-ego": 0.07157210086254363, "sim_compute_robot_state-ego": 0.07393259190498515, "sim_compute_robot_state-npc0": 0.0691847471480674, "sim_compute_robot_state-npc1": 0.06984498653006047, "sim_compute_robot_state-npc2": 0.0711194302173371, "sim_compute_robot_state-npc3": 0.0711729957702312}, "udem1-13-0": {"driven_any": 1.001633421251194, "sim_physics": 0.20374648846112764, "survival_time": 2.5999999999999988, "driven_lanedir": 0.6537162971975778, "sim_render-ego": 0.06421030943210308, "in-drivable-lane": 0.5999999999999979, "agent_compute-ego": 0.16434733684246355, "deviation-heading": 0.4928440244444201, "set_robot_commands": 0.10460341435212356, "deviation-center-line": 0.13361893417935136, "driven_lanedir_consec": 0.6537162971975778, "sim_compute_sim_state": 0.05541522686298077, "sim_compute_performance-ego": 0.07138473253983718, "sim_compute_robot_state-ego": 0.08053161547734188, "sim_compute_robot_state-npc0": 0.07413440942764282, "sim_compute_robot_state-npc1": 0.0751403936972985, "sim_compute_robot_state-npc2": 0.0745642689558176, "sim_compute_robot_state-npc3": 0.07393685212502113}, "udem1-14-0": {"driven_any": 2.218769782727203, "sim_physics": 0.19133779434930712, "survival_time": 5.249999999999989, "driven_lanedir": 0.8125963661433656, "sim_render-ego": 0.0647676876613072, "in-drivable-lane": 2.499999999999993, "agent_compute-ego": 0.1490275882539295, "deviation-heading": 1.7163026916317128, "set_robot_commands": 0.09755256062462216, "deviation-center-line": 0.24126933160503777, "driven_lanedir_consec": 0.6077880672015845, "sim_compute_sim_state": 0.03896413303556896, "sim_compute_performance-ego": 0.06781161399114699, "sim_compute_robot_state-ego": 0.07269526436215355, "sim_compute_robot_state-npc0": 0.06711572919573103, "sim_compute_robot_state-npc1": 0.07450566291809083, "sim_compute_robot_state-npc2": 0.06913643564496721, "sim_compute_robot_state-npc3": 0.06896225611368816}}
set_robot_commands_max0.1064014295929844
set_robot_commands_mean0.10124374271073604
set_robot_commands_median0.10147679066229724
set_robot_commands_min0.09637309256054108
sim_compute_performance-ego_max0.07515807628631592
sim_compute_performance-ego_mean0.07077435305287144
sim_compute_performance-ego_median0.07121789304515984
sim_compute_performance-ego_min0.06625113033113025
sim_compute_robot_state-ego_max0.08275824785232544
sim_compute_robot_state-ego_mean0.07752447124384462
sim_compute_robot_state-ego_median0.0777091004631736
sim_compute_robot_state-ego_min0.07269526436215355
sim_compute_robot_state-npc0_max0.07455855111281078
sim_compute_robot_state-npc0_mean0.07120627880553593
sim_compute_robot_state-npc0_median0.07147351136574379
sim_compute_robot_state-npc0_min0.06711572919573103
sim_compute_robot_state-npc1_max0.0751403936972985
sim_compute_robot_state-npc1_mean0.07206288352137322
sim_compute_robot_state-npc1_median0.07222198523007907
sim_compute_robot_state-npc1_min0.06750624913435715
sim_compute_robot_state-npc2_max0.07713884399050758
sim_compute_robot_state-npc2_mean0.0723499742331816
sim_compute_robot_state-npc2_median0.07269344283539114
sim_compute_robot_state-npc2_min0.06581799800579365
sim_compute_robot_state-npc3_max0.07519673347473145
sim_compute_robot_state-npc3_mean0.07151885090878089
sim_compute_robot_state-npc3_median0.07193651653471447
sim_compute_robot_state-npc3_min0.06771359660408714
sim_compute_sim_state_max0.05541522686298077
sim_compute_sim_state_mean0.04091765715642255
sim_compute_sim_state_median0.03936692247999475
sim_compute_sim_state_min0.037839724467350885
sim_physics_max0.2373000275004994
sim_physics_mean0.2148310825065224
sim_physics_median0.20853233337402344
sim_physics_min0.19133779434930712
sim_render-ego_max0.06655566437730512
sim_render-ego_mean0.06444434873699424
sim_render-ego_median0.0647676876613072
sim_render-ego_min0.06190007037304817
simulation-passed1
survival_time_max8.349999999999984
survival_time_mean3.3333333333333286
survival_time_min1.0500000000000005
No reset possible
217102555Andrea Censi 🇨🇭challenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationhost-errornoip-172-31-25-98-23480:25:10
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 488, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 347, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in convert
    with open(fn, 'w') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFVI-sim-testing/submission2555/step1-simulation-ip-172-31-25-98-2348-job21710/logs/challenges-runner/stdout.html'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
217042612Konstantin Chaikachallenge-aido_LF-template-ros - Template solution using ROSaido2-LFVI-sim-testingstep1-simulationerrornoip-172-31-25-98-23480:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "experiment_manager.py", line 87, in main
    sim_ci.write_topic_and_expect_zero('seed', config.seed)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
    nickname=self.nickname)
  File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
    wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
    wait_for_data(f, timeout, waiting_for)
  File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
    raise TimeoutError(msg)
TimeoutError: Timeout after 30.0 s.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
    yield cie
  File "experiment_manager.py", line 439, in <module>
    wrap(cie)
  File "experiment_manager.py", line 427, in wrap
    main(cie, logdir, attempts)
  File "experiment_manager.py", line 186, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:

 > Traceback (most recent call last):
 >   File "experiment_manager.py", line 87, in main
 >     sim_ci.write_topic_and_expect_zero('seed', config.seed)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
 >     nickname=self.nickname)
 >   File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 247, in read_reply
 >     wm: WireMessage = read_next_cbor(fpout, timeout=timeout, waiting_for=waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 161, in read_next_cbor
 >     wait_for_data(f, timeout, waiting_for)
 >   File "/project/src/zuper-utils/src/zuper_json/json2cbor.py", line 146, in wait_for_data
 >     raise TimeoutError(msg)
 > TimeoutError: Timeout after 30.0 s.
 >
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible