AI Driving Olympics Home Challenges Submissions Jobs

Submission 3154

Submission3154
Competingyes
Challengeaido2-LF-sim-testing
UserAndy Ser
Date submitted
Completecomplete
Resultsuccess
Jobsstep1-simulation: 22569
Next
User labelchallenge-aido_LF-baseline-duckietown
Admin priority50
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
225693154Andy Serchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessyes-0:26:35(hidden)
driven_lanedir_consec_median0.7558089837379898
survival_time_median5.14999999999999
deviation-center-line_median0.5972575558212546
in-drivable-lane_median0.04999999999999982


other stats
agent_compute-ego_max0.0861385049699228
agent_compute-ego_mean0.08146238425108848
agent_compute-ego_median0.08122026786375582
agent_compute-ego_min0.07658008416493733
deviation-center-line_max1.4566361413176834
deviation-center-line_mean0.6238616045607289
deviation-center-line_min0.24963414325507
deviation-heading_max5.94797529118521
deviation-heading_mean2.407699167833836
deviation-heading_median2.047535135021629
deviation-heading_min0.4602317948329937
driven_any_max2.3491133524134176
driven_any_mean1.2373991597843033
driven_any_median0.7740457812561404
driven_any_min0.4606439371512595
driven_lanedir_consec_max2.3012911307811823
driven_lanedir_consec_mean0.9862002430872264
driven_lanedir_consec_min0.1738893588728288
driven_lanedir_max2.3012911307811823
driven_lanedir_mean1.0437492464709874
driven_lanedir_median0.7558089837379898
driven_lanedir_min0.42183610269126326
in-drivable-lane_max4.300000000000016
in-drivable-lane_mean0.5366666666666682
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.5735412552946656, "sim_physics": 0.05918171435971803, "survival_time": 3.949999999999994, "driven_lanedir": 0.5281709398115586, "sim_render-ego": 0.0563344864905635, "in-drivable-lane": 0, "agent_compute-ego": 0.0861385049699228, "deviation-heading": 1.2451342719334284, "set_robot_commands": 0.07655122913891756, "deviation-center-line": 0.32304288361721556, "driven_lanedir_consec": 0.5281709398115586, "sim_compute_sim_state": 0.038776856434496146, "sim_compute_performance-ego": 0.05892335915867286, "sim_compute_robot_state-ego": 0.058960253679299655}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.7658462355851402, "sim_physics": 0.056859741023942534, "survival_time": 5.09999999999999, "driven_lanedir": 0.42183610269126326, "sim_render-ego": 0.0564731990589815, "in-drivable-lane": 0.8499999999999992, "agent_compute-ego": 0.08475769734850117, "deviation-heading": 2.9219200466819424, "set_robot_commands": 0.07305249045876895, "deviation-center-line": 0.24963414325507, "driven_lanedir_consec": 0.1738893588728288, "sim_compute_sim_state": 0.037685116132100425, "sim_compute_performance-ego": 0.05899385143728817, "sim_compute_robot_state-ego": 0.060456766801721906}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.5731633803295738, "sim_physics": 0.05636792916517992, "survival_time": 3.899999999999994, "driven_lanedir": 0.5687174100806671, "sim_render-ego": 0.0551453553713285, "in-drivable-lane": 0, "agent_compute-ego": 0.08283510269262852, "deviation-heading": 0.4602317948329937, "set_robot_commands": 0.07341514183924748, "deviation-center-line": 0.4374329792570928, "driven_lanedir_consec": 0.5687174100806671, "sim_compute_sim_state": 0.037655011201516174, "sim_compute_performance-ego": 0.06095285904713166, "sim_compute_robot_state-ego": 0.061146133985274874}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.352576060075401, "sim_physics": 0.05519396781921387, "survival_time": 8.74999999999999, "driven_lanedir": 1.2349491669099812, "sim_render-ego": 0.05285736356462751, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.08142209734235491, "deviation-heading": 2.3395259241983215, "set_robot_commands": 0.07115920339311872, "deviation-center-line": 0.6576651552935265, "driven_lanedir_consec": 1.2349491669099812, "sim_compute_sim_state": 0.03558862549918038, "sim_compute_performance-ego": 0.05727039473397391, "sim_compute_robot_state-ego": 0.057643158776419505}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.34848595396039, "sim_physics": 0.05374588410059611, "survival_time": 14.950000000000076, "driven_lanedir": 1.280815783498297, "sim_render-ego": 0.05148905913035075, "in-drivable-lane": 4.300000000000016, "agent_compute-ego": 0.08022499243418375, "deviation-heading": 5.94797529118521, "set_robot_commands": 0.07138798395792643, "deviation-center-line": 0.7403537888559721, "driven_lanedir_consec": 1.0300928423474272, "sim_compute_sim_state": 0.035241355101267496, "sim_compute_performance-ego": 0.05525538444519043, "sim_compute_robot_state-ego": 0.05677066485087077}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3490811945936496, "sim_physics": 0.05131618420283, "survival_time": 14.950000000000076, "driven_lanedir": 2.166241246449922, "sim_render-ego": 0.05037335634231568, "in-drivable-lane": 0.34999999999999876, "agent_compute-ego": 0.07658008416493733, "deviation-heading": 3.9042739923367296, "set_robot_commands": 0.07171250263849895, "deviation-center-line": 1.31784884302188, "driven_lanedir_consec": 2.166241246449922, "sim_compute_sim_state": 0.03447954734166463, "sim_compute_performance-ego": 0.05468621412913005, "sim_compute_robot_state-ego": 0.055509246190388994}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 1.5694491907367352, "sim_physics": 0.05232413334421592, "survival_time": 10.100000000000009, "driven_lanedir": 1.2706591409544572, "sim_render-ego": 0.051982537354573165, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.08021297903344182, "deviation-heading": 4.881121538815666, "set_robot_commands": 0.07153334830066946, "deviation-center-line": 0.6078289682461113, "driven_lanedir_consec": 1.2706591409544572, "sim_compute_sim_state": 0.03531741623831267, "sim_compute_performance-ego": 0.05652418703135877, "sim_compute_robot_state-ego": 0.057281222673926026}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.6213811511641038, "sim_physics": 0.05474425497509185, "survival_time": 4.199999999999993, "driven_lanedir": 0.6047993715497519, "sim_render-ego": 0.05611259029025123, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.08127611591702416, "deviation-heading": 0.5565426505184625, "set_robot_commands": 0.07379644541513353, "deviation-center-line": 0.42365781877343106, "driven_lanedir_consec": 0.6047993715497519, "sim_compute_sim_state": 0.03777603592191424, "sim_compute_performance-ego": 0.06119229963847569, "sim_compute_robot_state-ego": 0.06007050900232224}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.7740457812561404, "sim_physics": 0.05420535976446948, "survival_time": 5.14999999999999, "driven_lanedir": 0.7558089837379898, "sim_render-ego": 0.05352549182558523, "in-drivable-lane": 0, "agent_compute-ego": 0.07869374636307504, "deviation-heading": 0.9568341719053772, "set_robot_commands": 0.07312975346463398, "deviation-center-line": 0.44579789799199143, "driven_lanedir_consec": 0.7558089837379898, "sim_compute_sim_state": 0.03789884604296638, "sim_compute_performance-ego": 0.05742642023030994, "sim_compute_robot_state-ego": 0.058636947742943625}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7257851864040474, "sim_physics": 0.05421742704725757, "survival_time": 4.849999999999991, "driven_lanedir": 0.6575700984553992, "sim_render-ego": 0.05451119068971614, "in-drivable-lane": 0.04999999999999982, "agent_compute-ego": 0.07934218829440087, "deviation-heading": 1.5605097714950278, "set_robot_commands": 0.07143034885839089, "deviation-center-line": 0.33405986360550305, "driven_lanedir_consec": 0.6575700984553992, "sim_compute_sim_state": 0.0354699228227753, "sim_compute_performance-ego": 0.05940426747823499, "sim_compute_robot_state-ego": 0.05776060979390882}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.376696898699096, "sim_physics": 0.0544883119926024, "survival_time": 8.899999999999991, "driven_lanedir": 1.3224750944254289, "sim_render-ego": 0.05468379513601239, "in-drivable-lane": 0, "agent_compute-ego": 0.08122026786375582, "deviation-heading": 2.047535135021629, "set_robot_commands": 0.07375274883227402, "deviation-center-line": 0.6395801728881447, "driven_lanedir_consec": 1.3224750944254289, "sim_compute_sim_state": 0.037352557932392935, "sim_compute_performance-ego": 0.05755777707260646, "sim_compute_robot_state-ego": 0.058596347155195946}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.4606439371512595, "sim_physics": 0.05551881343126297, "survival_time": 3.1999999999999966, "driven_lanedir": 0.44135607998331694, "sim_render-ego": 0.05299586430191994, "in-drivable-lane": 0, "agent_compute-ego": 0.08027100190520287, "deviation-heading": 0.7546602813577944, "set_robot_commands": 0.072764091193676, "deviation-center-line": 0.29017778662164223, "driven_lanedir_consec": 0.44135607998331694, "sim_compute_sim_state": 0.03606844320893288, "sim_compute_performance-ego": 0.05991605296730995, "sim_compute_robot_state-ego": 0.05831873044371605}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 1.9792683281876855, "sim_physics": 0.0548680243284806, "survival_time": 12.650000000000045, "driven_lanedir": 1.369346289826605, "sim_render-ego": 0.05819957246893479, "in-drivable-lane": 1.900000000000002, "agent_compute-ego": 0.08480174550897047, "deviation-heading": 5.23392703930455, "set_robot_commands": 0.07540158791975542, "deviation-center-line": 0.8369500698444151, "driven_lanedir_consec": 1.0047809240394934, "sim_compute_sim_state": 0.039325928028393166, "sim_compute_performance-ego": 0.06070183482565899, "sim_compute_robot_state-ego": 0.06077959414998533}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.3491133524134176, "sim_physics": 0.05460955301920573, "survival_time": 14.950000000000076, "driven_lanedir": 2.3012911307811823, "sim_render-ego": 0.05660493771235149, "in-drivable-lane": 0, "agent_compute-ego": 0.08357137600580851, "deviation-heading": 2.6344475243728036, "set_robot_commands": 0.07522379398345948, "deviation-center-line": 1.4566361413176834, "driven_lanedir_consec": 2.3012911307811823, "sim_compute_sim_state": 0.03891982396443685, "sim_compute_performance-ego": 0.061382737159729, "sim_compute_robot_state-ego": 0.06104830344518026}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.741909490913244, "sim_physics": 0.054115936009570806, "survival_time": 4.94999999999999, "driven_lanedir": 0.7322018579089957, "sim_render-ego": 0.053041270284941704, "in-drivable-lane": 0, "agent_compute-ego": 0.08058786392211914, "deviation-heading": 0.6708480835476137, "set_robot_commands": 0.07251739261126278, "deviation-center-line": 0.5972575558212546, "driven_lanedir_consec": 0.7322018579089957, "sim_compute_sim_state": 0.03697039864280007, "sim_compute_performance-ego": 0.058370881610446505, "sim_compute_robot_state-ego": 0.05865450098056986}}
set_robot_commands_max0.07655122913891756
set_robot_commands_mean0.07312187080038224
set_robot_commands_median0.07305249045876895
set_robot_commands_min0.07115920339311872
sim_compute_performance-ego_max0.061382737159729
sim_compute_performance-ego_mean0.05857056806436781
sim_compute_performance-ego_median0.05892335915867286
sim_compute_performance-ego_min0.05468621412913005
sim_compute_robot_state-ego_max0.061146133985274874
sim_compute_robot_state-ego_mean0.0587755326447816
sim_compute_robot_state-ego_median0.058636947742943625
sim_compute_robot_state-ego_min0.055509246190388994
sim_compute_sim_state_max0.039325928028393166
sim_compute_sim_state_mean0.03696839230087665
sim_compute_sim_state_median0.037352557932392935
sim_compute_sim_state_min0.03447954734166463
sim_physics_max0.05918171435971803
sim_physics_mean0.05478381563890918
sim_physics_median0.05460955301920573
sim_physics_min0.05131618420283
sim_render-ego_max0.05819957246893479
sim_render-ego_mean0.05428867133483024
sim_render-ego_median0.05451119068971614
sim_render-ego_min0.05037335634231568
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean8.036666666666681
survival_time_min3.1999999999999966
214543154Andy Serchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:31:23(hidden)
driven_lanedir_consec_median1.1681828443544942
survival_time_median8.09999999999998
deviation-center-line_median0.641868336896187
in-drivable-lane_median0.3999999999999986


other stats
agent_compute-ego_max0.08081629135052086
agent_compute-ego_mean0.0758504651263721
agent_compute-ego_median0.0758597191174825
agent_compute-ego_min0.06777509053548177
deviation-center-line_max1.411503075853738
deviation-center-line_mean0.7227683439967684
deviation-center-line_min0.1753766769376633
deviation-heading_max5.6833505267072555
deviation-heading_mean3.1211627381518716
deviation-heading_median2.7394242588176985
deviation-heading_min0.4821196658240049
driven_any_max2.3490597868651646
driven_any_mean1.4939953835474284
driven_any_median1.2481587179199851
driven_any_min0.4767145005896276
driven_lanedir_consec_max2.006840017935674
driven_lanedir_consec_mean1.0500561815787652
driven_lanedir_consec_min0.192902075279733
driven_lanedir_max2.006840017935674
driven_lanedir_mean1.2074605484291516
driven_lanedir_median1.190478054598796
driven_lanedir_min0.41161959022463823
in-drivable-lane_max2.9500000000000153
in-drivable-lane_mean0.8700000000000067
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.2448101607680497, "sim_physics": 0.05627720613512843, "survival_time": 14.350000000000067, "driven_lanedir": 1.7033450714962943, "sim_render-ego": 0.0541962181649557, "in-drivable-lane": 1.5000000000000029, "agent_compute-ego": 0.08081629135052086, "deviation-heading": 5.6833505267072555, "set_robot_commands": 0.07625410116508032, "deviation-center-line": 1.0924286006495068, "driven_lanedir_consec": 1.059750658137141, "sim_compute_sim_state": 0.03644808991860845, "sim_compute_performance-ego": 0.057365066083050774, "sim_compute_robot_state-ego": 0.05887026321597216}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.6935616688428333, "sim_physics": 0.06175135027977728, "survival_time": 4.6499999999999915, "driven_lanedir": 0.41161959022463823, "sim_render-ego": 0.05348186851829611, "in-drivable-lane": 0.5499999999999992, "agent_compute-ego": 0.07953099281557145, "deviation-heading": 2.7394242588176985, "set_robot_commands": 0.07765928904215495, "deviation-center-line": 0.39078547671147473, "driven_lanedir_consec": 0.192902075279733, "sim_compute_sim_state": 0.034313412122828985, "sim_compute_performance-ego": 0.05809649344413511, "sim_compute_robot_state-ego": 0.05899504179595619}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 2.348969417197375, "sim_physics": 0.05339666366577149, "survival_time": 14.950000000000076, "driven_lanedir": 2.004349480376715, "sim_render-ego": 0.051573035717010496, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.07738951126734415, "deviation-heading": 5.255165781273086, "set_robot_commands": 0.07492353200912476, "deviation-center-line": 1.411503075853738, "driven_lanedir_consec": 1.7797618542560325, "sim_compute_sim_state": 0.03347948551177979, "sim_compute_performance-ego": 0.05663783311843872, "sim_compute_robot_state-ego": 0.05791318416595459}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.7338882213519305, "sim_physics": 0.05768324890915228, "survival_time": 4.899999999999991, "driven_lanedir": 0.7178950434323648, "sim_render-ego": 0.04954999806929608, "in-drivable-lane": 0, "agent_compute-ego": 0.07696835118897107, "deviation-heading": 0.9219082524659225, "set_robot_commands": 0.07408210452722043, "deviation-center-line": 0.406179796218106, "driven_lanedir_consec": 0.7178950434323648, "sim_compute_sim_state": 0.033119418183151554, "sim_compute_performance-ego": 0.055488262857709615, "sim_compute_robot_state-ego": 0.057096279397302746}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2481587179199851, "sim_physics": 0.056086041309215406, "survival_time": 8.09999999999998, "driven_lanedir": 1.183287154464706, "sim_render-ego": 0.05098154368223967, "in-drivable-lane": 0, "agent_compute-ego": 0.0786844300635067, "deviation-heading": 2.078977465585478, "set_robot_commands": 0.07548679834530678, "deviation-center-line": 0.5060133686183282, "driven_lanedir_consec": 1.183287154464706, "sim_compute_sim_state": 0.03283235173166534, "sim_compute_performance-ego": 0.05505787884747541, "sim_compute_robot_state-ego": 0.056886659728156194}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.0837494463048767, "sim_physics": 0.05470426279799383, "survival_time": 13.300000000000054, "driven_lanedir": 1.8104041636523875, "sim_render-ego": 0.050621522100348225, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.07991379723513037, "deviation-heading": 5.198675210721483, "set_robot_commands": 0.07340680208421291, "deviation-center-line": 0.8436479753812198, "driven_lanedir_consec": 1.3853980923032647, "sim_compute_sim_state": 0.03390588616966305, "sim_compute_performance-ego": 0.05488550125208116, "sim_compute_robot_state-ego": 0.05707442043419171}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.7418359567892455, "sim_physics": 0.05201006417322641, "survival_time": 4.94999999999999, "driven_lanedir": 0.626211104990466, "sim_render-ego": 0.04909858318290325, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.0755753613481618, "deviation-heading": 1.5152383964666507, "set_robot_commands": 0.0723133400233105, "deviation-center-line": 0.1753766769376633, "driven_lanedir_consec": 0.626211104990466, "sim_compute_sim_state": 0.03112965641599713, "sim_compute_performance-ego": 0.05427252885067102, "sim_compute_robot_state-ego": 0.05595096193178736}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.3490597868651646, "sim_physics": 0.05277139186859131, "survival_time": 14.950000000000076, "driven_lanedir": 2.006840017935674, "sim_render-ego": 0.04921578645706177, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07885501384735108, "deviation-heading": 4.402346643250868, "set_robot_commands": 0.07273061196009319, "deviation-center-line": 1.2640133198924268, "driven_lanedir_consec": 2.006840017935674, "sim_compute_sim_state": 0.031705545584360756, "sim_compute_performance-ego": 0.0541706665356954, "sim_compute_robot_state-ego": 0.05505820433298747}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3486884774201613, "sim_physics": 0.05212640285491944, "survival_time": 14.950000000000076, "driven_lanedir": 1.553456648923691, "sim_render-ego": 0.04999038298924764, "in-drivable-lane": 2.9500000000000153, "agent_compute-ego": 0.07400344848632813, "deviation-heading": 5.5286070887814125, "set_robot_commands": 0.07326331774393717, "deviation-center-line": 0.9608176426710368, "driven_lanedir_consec": 1.1681828443544942, "sim_compute_sim_state": 0.032632838090260824, "sim_compute_performance-ego": 0.0546146289507548, "sim_compute_robot_state-ego": 0.055694701671600344}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7096832745453853, "sim_physics": 0.05145490295008609, "survival_time": 4.749999999999991, "driven_lanedir": 0.5105672997582311, "sim_render-ego": 0.04766436878003572, "in-drivable-lane": 0.3999999999999986, "agent_compute-ego": 0.07264187210484555, "deviation-heading": 2.1763192913419003, "set_robot_commands": 0.06976647878948011, "deviation-center-line": 0.29538319218399817, "driven_lanedir_consec": 0.5105672997582311, "sim_compute_sim_state": 0.0317134279953806, "sim_compute_performance-ego": 0.05261807441711426, "sim_compute_robot_state-ego": 0.05336154887550756}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.248156330994187, "sim_physics": 0.05166707804173599, "survival_time": 8.09999999999998, "driven_lanedir": 1.190478054598796, "sim_render-ego": 0.0475873844123181, "in-drivable-lane": 0, "agent_compute-ego": 0.07261815777531376, "deviation-heading": 2.027110739662194, "set_robot_commands": 0.07064928243189682, "deviation-center-line": 0.641868336896187, "driven_lanedir_consec": 1.190478054598796, "sim_compute_sim_state": 0.03113568564991892, "sim_compute_performance-ego": 0.0542556400652285, "sim_compute_robot_state-ego": 0.054028313836933656}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.48475443041301286, "sim_physics": 0.05303553680875408, "survival_time": 3.349999999999996, "driven_lanedir": 0.4703144514303399, "sim_render-ego": 0.04758823095862545, "in-drivable-lane": 0, "agent_compute-ego": 0.07488512992858887, "deviation-heading": 0.708032878297449, "set_robot_commands": 0.07366582173020092, "deviation-center-line": 0.304901387480791, "driven_lanedir_consec": 0.4703144514303399, "sim_compute_sim_state": 0.030502845991903275, "sim_compute_performance-ego": 0.05217711249394203, "sim_compute_robot_state-ego": 0.05365016211324664}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 2.34891269015118, "sim_physics": 0.05059509515762329, "survival_time": 14.950000000000076, "driven_lanedir": 1.7152349207547593, "sim_render-ego": 0.047836177349090576, "in-drivable-lane": 2.7000000000000384, "agent_compute-ego": 0.07223980983098348, "deviation-heading": 4.124491012912269, "set_robot_commands": 0.06999699274698894, "deviation-center-line": 1.1573132845470508, "driven_lanedir_consec": 1.564467876048917, "sim_compute_sim_state": 0.031086421012878417, "sim_compute_performance-ego": 0.05292886098225912, "sim_compute_robot_state-ego": 0.05326310396194458}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 2.348987673058413, "sim_physics": 0.0548307983080546, "survival_time": 14.950000000000076, "driven_lanedir": 1.73871075565615, "sim_render-ego": 0.05097858826319376, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.0758597191174825, "deviation-heading": 3.9756738601703967, "set_robot_commands": 0.07512881676355998, "deviation-center-line": 1.0283890415648862, "driven_lanedir_consec": 1.425591727949258, "sim_compute_sim_state": 0.03328559557596843, "sim_compute_performance-ego": 0.055613276958465574, "sim_compute_robot_state-ego": 0.05704081694285075}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.4767145005896276, "sim_physics": 0.05420064203666918, "survival_time": 3.2999999999999963, "driven_lanedir": 0.46919446874206416, "sim_render-ego": 0.04907716765548244, "in-drivable-lane": 0, "agent_compute-ego": 0.06777509053548177, "deviation-heading": 0.4821196658240049, "set_robot_commands": 0.07236398711349025, "deviation-center-line": 0.3629039843451119, "driven_lanedir_consec": 0.46919446874206416, "sim_compute_sim_state": 0.03241188598401619, "sim_compute_performance-ego": 0.05467761646617542, "sim_compute_robot_state-ego": 0.05611654122670492}}
set_robot_commands_max0.07765928904215495
set_robot_commands_mean0.07344608509840388
set_robot_commands_median0.07340680208421291
set_robot_commands_min0.06976647878948011
sim_compute_performance-ego_max0.05809649344413511
sim_compute_performance-ego_mean0.05485729608821313
sim_compute_performance-ego_median0.05467761646617542
sim_compute_performance-ego_min0.05217711249394203
sim_compute_robot_state-ego_max0.05899504179595619
sim_compute_robot_state-ego_mean0.05606668024207313
sim_compute_robot_state-ego_median0.05611654122670492
sim_compute_robot_state-ego_min0.05326310396194458
sim_compute_sim_state_max0.03644808991860845
sim_compute_sim_state_mean0.032646836395892116
sim_compute_sim_state_median0.032632838090260824
sim_compute_sim_state_min0.030502845991903275
sim_physics_max0.06175135027977728
sim_physics_mean0.05417271235311327
sim_physics_median0.05339666366577149
sim_physics_min0.05059509515762329
sim_render-ego_max0.0541962181649557
sim_render-ego_mean0.049962723753340335
sim_render-ego_median0.04954999806929608
sim_render-ego_min0.0475873844123181
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.63333333333336
survival_time_min3.2999999999999963
214533154Andy Serchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationsuccessno-0:24:25(hidden)
driven_lanedir_consec_median1.0874953498285516
survival_time_median8.499999999999986
deviation-center-line_median0.6775754948603098
in-drivable-lane_median0.20000000000000284


other stats
agent_compute-ego_max0.057246366580883105
agent_compute-ego_mean0.05534856336121719
agent_compute-ego_median0.055441413262877805
agent_compute-ego_min0.05272213901792254
deviation-center-line_max1.266408456034012
deviation-center-line_mean0.7077970918660087
deviation-center-line_min0.24427614770312625
deviation-heading_max7.40659085341576
deviation-heading_mean3.1116263949539156
deviation-heading_median2.4018441978321103
deviation-heading_min0.5069530932734827
driven_any_max2.3489816433576283
driven_any_mean1.4505546079737195
driven_any_median1.3123926255128189
driven_any_min0.6213783024269937
driven_lanedir_consec_max2.1380026680989213
driven_lanedir_consec_mean1.0944021024294337
driven_lanedir_consec_min0.2449162184624352
driven_lanedir_max2.1380026680989213
driven_lanedir_mean1.2099805152350385
driven_lanedir_median1.1907266169321975
driven_lanedir_min0.4300493442755444
in-drivable-lane_max4.3000000000000185
in-drivable-lane_mean0.5966666666666695
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.1440240549282847, "sim_physics": 0.06295570214589437, "survival_time": 7.499999999999981, "driven_lanedir": 1.0874953498285516, "sim_render-ego": 0.03720317363739014, "in-drivable-lane": 0, "agent_compute-ego": 0.056913326581319174, "deviation-heading": 1.8393813469594888, "set_robot_commands": 0.05649649461110433, "deviation-center-line": 0.6267187335496259, "driven_lanedir_consec": 1.0874953498285516, "sim_compute_sim_state": 0.023709295590718587, "sim_compute_performance-ego": 0.040954570770263675, "sim_compute_robot_state-ego": 0.04184265613555909}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 2.348885405536934, "sim_physics": 0.05870802323023478, "survival_time": 14.950000000000076, "driven_lanedir": 2.0692528475941536, "sim_render-ego": 0.036731416384379066, "in-drivable-lane": 0.25000000000000355, "agent_compute-ego": 0.05400358756383261, "deviation-heading": 5.659075809672068, "set_robot_commands": 0.055883492628733315, "deviation-center-line": 0.9391176579801188, "driven_lanedir_consec": 1.9476837878031423, "sim_compute_sim_state": 0.02382442792256673, "sim_compute_performance-ego": 0.039949816862742106, "sim_compute_robot_state-ego": 0.0421230959892273}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.6213783024269937, "sim_physics": 0.0583705050604684, "survival_time": 4.199999999999993, "driven_lanedir": 0.6158276455273297, "sim_render-ego": 0.036041024185362314, "in-drivable-lane": 0, "agent_compute-ego": 0.05272213901792254, "deviation-heading": 0.5069530932734827, "set_robot_commands": 0.05594920544397263, "deviation-center-line": 0.46902546598113687, "driven_lanedir_consec": 0.6158276455273297, "sim_compute_sim_state": 0.023370104176657545, "sim_compute_performance-ego": 0.04039773486909412, "sim_compute_robot_state-ego": 0.04475206704366775}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3847080672211938, "sim_physics": 0.06189421168918716, "survival_time": 8.949999999999992, "driven_lanedir": 1.2890073965245503, "sim_render-ego": 0.03652374970846336, "in-drivable-lane": 0, "agent_compute-ego": 0.05414756050322975, "deviation-heading": 2.6462792292335124, "set_robot_commands": 0.05570773705423877, "deviation-center-line": 0.6775754948603098, "driven_lanedir_consec": 1.2890073965245503, "sim_compute_sim_state": 0.023576216990721297, "sim_compute_performance-ego": 0.04011655519794485, "sim_compute_robot_state-ego": 0.04282639146517109}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 2.3484981342040667, "sim_physics": 0.05825595458348592, "survival_time": 14.950000000000076, "driven_lanedir": 1.2911757326352429, "sim_render-ego": 0.03678280353546143, "in-drivable-lane": 4.3000000000000185, "agent_compute-ego": 0.05525623401006063, "deviation-heading": 5.899318609324921, "set_robot_commands": 0.056374477545420326, "deviation-center-line": 0.7866822994150611, "driven_lanedir_consec": 1.0101278760749826, "sim_compute_sim_state": 0.023307785987854004, "sim_compute_performance-ego": 0.04044756174087524, "sim_compute_robot_state-ego": 0.04203380505243937}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 2.3489816433576283, "sim_physics": 0.05889836708704631, "survival_time": 14.950000000000076, "driven_lanedir": 2.033451582994377, "sim_render-ego": 0.03737505833307902, "in-drivable-lane": 0.7000000000000055, "agent_compute-ego": 0.05560791174570719, "deviation-heading": 4.9423531913952266, "set_robot_commands": 0.05575815200805664, "deviation-center-line": 1.1099127006867926, "driven_lanedir_consec": 1.4051020800978162, "sim_compute_sim_state": 0.02396272341410319, "sim_compute_performance-ego": 0.04086394786834717, "sim_compute_robot_state-ego": 0.04225742101669312}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.741861318691023, "sim_physics": 0.06248454373292248, "survival_time": 4.94999999999999, "driven_lanedir": 0.683600090781124, "sim_render-ego": 0.037005277595134695, "in-drivable-lane": 0, "agent_compute-ego": 0.055441413262877805, "deviation-heading": 1.5178163897506032, "set_robot_commands": 0.055486667035806056, "deviation-center-line": 0.24427614770312625, "driven_lanedir_consec": 0.683600090781124, "sim_compute_sim_state": 0.024087602441961117, "sim_compute_performance-ego": 0.04050922152971981, "sim_compute_robot_state-ego": 0.04245277607079708}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 1.4972223680494146, "sim_physics": 0.060573850888662385, "survival_time": 9.650000000000002, "driven_lanedir": 1.2309685631219234, "sim_render-ego": 0.036968701861682954, "in-drivable-lane": 1.0000000000000018, "agent_compute-ego": 0.05582151017658451, "deviation-heading": 2.5384304430789513, "set_robot_commands": 0.0552073735647251, "deviation-center-line": 0.8109250205915368, "driven_lanedir_consec": 1.2309685631219234, "sim_compute_sim_state": 0.0239287386286444, "sim_compute_performance-ego": 0.04036676945463981, "sim_compute_robot_state-ego": 0.04228809089858297}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 2.3486146329737956, "sim_physics": 0.05619236946105957, "survival_time": 14.950000000000076, "driven_lanedir": 1.645386548604022, "sim_render-ego": 0.036539475917816165, "in-drivable-lane": 1.5500000000000125, "agent_compute-ego": 0.05461994647979736, "deviation-heading": 7.40659085341576, "set_robot_commands": 0.05494614998499552, "deviation-center-line": 1.266408456034012, "driven_lanedir_consec": 1.1278099015808911, "sim_compute_sim_state": 0.02324203570683797, "sim_compute_performance-ego": 0.039912397861480715, "sim_compute_robot_state-ego": 0.04246810674667358}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.7337864345275469, "sim_physics": 0.06046248942005391, "survival_time": 4.899999999999991, "driven_lanedir": 0.6102226220340236, "sim_render-ego": 0.036997799970665754, "in-drivable-lane": 0.29999999999999893, "agent_compute-ego": 0.055716621632478674, "deviation-heading": 1.5788649343419348, "set_robot_commands": 0.05523376562157456, "deviation-center-line": 0.2952268737321295, "driven_lanedir_consec": 0.6102226220340236, "sim_compute_sim_state": 0.02332658427102225, "sim_compute_performance-ego": 0.039761251332808514, "sim_compute_robot_state-ego": 0.04148218583087532}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 1.3123926255128189, "sim_physics": 0.06219642162322998, "survival_time": 8.499999999999986, "driven_lanedir": 1.1907266169321975, "sim_render-ego": 0.036538166158339554, "in-drivable-lane": 0.20000000000000284, "agent_compute-ego": 0.055199715670417336, "deviation-heading": 2.3011508201113937, "set_robot_commands": 0.05446390544666963, "deviation-center-line": 0.8182674622917375, "driven_lanedir_consec": 1.1907266169321975, "sim_compute_sim_state": 0.02301335615270278, "sim_compute_performance-ego": 0.04011042959549848, "sim_compute_robot_state-ego": 0.04183565448312199}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.34888915445369, "sim_physics": 0.059219666322072345, "survival_time": 14.950000000000076, "driven_lanedir": 2.1380026680989213, "sim_render-ego": 0.03672391891479492, "in-drivable-lane": 0, "agent_compute-ego": 0.05717218160629273, "deviation-heading": 5.123113633223664, "set_robot_commands": 0.05543702522913615, "deviation-center-line": 0.8306701260167592, "driven_lanedir_consec": 2.1380026680989213, "sim_compute_sim_state": 0.023354233105977375, "sim_compute_performance-ego": 0.03973984400431315, "sim_compute_robot_state-ego": 0.0414612889289856}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.7015197241630409, "sim_physics": 0.05620940695417688, "survival_time": 4.699999999999991, "driven_lanedir": 0.4300493442755444, "sim_render-ego": 0.03630495578684705, "in-drivable-lane": 0.6499999999999988, "agent_compute-ego": 0.056645236116774536, "deviation-heading": 2.4018441978321103, "set_robot_commands": 0.05504875487469612, "deviation-center-line": 0.4856084601721544, "driven_lanedir_consec": 0.2449162184624352, "sim_compute_sim_state": 0.02315648819537873, "sim_compute_performance-ego": 0.039600818715196974, "sim_compute_robot_state-ego": 0.04130571446520217}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 1.095477001090349, "sim_physics": 0.05410313272809649, "survival_time": 7.149999999999983, "driven_lanedir": 1.0664382913801704, "sim_render-ego": 0.03561048407654662, "in-drivable-lane": 0, "agent_compute-ego": 0.057246366580883105, "deviation-heading": 1.4744502406469315, "set_robot_commands": 0.0546482593029529, "deviation-center-line": 0.6599442508477962, "driven_lanedir_consec": 1.0664382913801704, "sim_compute_sim_state": 0.023035728014432467, "sim_compute_performance-ego": 0.04007242109392073, "sim_compute_robot_state-ego": 0.04137058358092408}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.7820802524690168, "sim_physics": 0.05469017533155588, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7681024281934423, "sim_render-ego": 0.03619584211936363, "in-drivable-lane": 0, "agent_compute-ego": 0.05371469947007986, "deviation-heading": 0.8387731320486855, "set_robot_commands": 0.055514005514291614, "deviation-center-line": 0.5965972281278327, "driven_lanedir_consec": 0.7681024281934423, "sim_compute_sim_state": 0.02247648284985469, "sim_compute_performance-ego": 0.039209918333933905, "sim_compute_robot_state-ego": 0.04091624800975506}}
set_robot_commands_max0.05649649461110433
set_robot_commands_mean0.055477031057758246
set_robot_commands_median0.055486667035806056
set_robot_commands_min0.05446390544666963
sim_compute_performance-ego_max0.040954570770263675
sim_compute_performance-ego_mean0.04013421728205195
sim_compute_performance-ego_median0.04011042959549848
sim_compute_performance-ego_min0.039209918333933905
sim_compute_robot_state-ego_max0.04475206704366775
sim_compute_robot_state-ego_mean0.0420944057145117
sim_compute_robot_state-ego_median0.04203380505243937
sim_compute_robot_state-ego_min0.04091624800975506
sim_compute_sim_state_max0.024087602441961117
sim_compute_sim_state_mean0.02342478689662888
sim_compute_sim_state_median0.023354233105977375
sim_compute_sim_state_min0.02247648284985469
sim_physics_max0.06295570214589437
sim_physics_mean0.05901432135054312
sim_physics_median0.05889836708704631
sim_physics_min0.05410313272809649
sim_render-ego_max0.03737505833307902
sim_render-ego_mean0.03663612321235511
sim_render-ego_median0.03672391891479492
sim_render-ego_min0.03561048407654662
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean9.363333333333353
survival_time_min4.199999999999993
214523154Andy Serchallenge-aido_LF-baseline-duckietownaido2-LF-sim-testingstep1-simulationhost-errorno-0:07:04
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
    submission_id=submission_id, timeout_sec=timeout_sec)
  File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
    next(self.gen)
  File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
    convert(f_stdout)
  File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
    data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-testing/submission3154/step1-simulation-ip-172-31-38-104-5317-job21452/logs/challenges-runner/stdout.log'
(hidden)