Duckietown Challenges Home Challenges Submissions

Submission 2648

Submission2648
Competingyes
Challengeaido2-LFVI-sim-testing
UserEgor Zamotaev
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22851
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22851step1-simulationsuccessyes0:27:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.08632995771325153
agent_compute-ego_mean0.07258555104347192
agent_compute-ego_median0.07364971497479607
agent_compute-ego_min0.05682149268033212
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.2208167673593544, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.06268394711505935, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.07430597672979515, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.09781136282955308, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.03910027354596609, "sim_compute_performance-ego": 0.07030214459063058, "sim_compute_robot_state-ego": 0.07872608483555806, "sim_compute_robot_state-npc0": 0.07072179863251836, "sim_compute_robot_state-npc1": 0.07518886945333826, "sim_compute_robot_state-npc2": 0.06789047746773226, "sim_compute_robot_state-npc3": 0.06894940066050334}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.19459955780594437, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06086780406810619, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.0828678254727964, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.09315087177135328, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.03666593410350658, "sim_compute_performance-ego": 0.06677443892867477, "sim_compute_robot_state-ego": 0.07142140247203686, "sim_compute_robot_state-npc0": 0.06709367257577402, "sim_compute_robot_state-npc1": 0.06923399148163972, "sim_compute_robot_state-npc2": 0.06727996578922978, "sim_compute_robot_state-npc3": 0.0709986686706543}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.21615739663441977, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06561717314597888, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.07435044875511757, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.10027464230855306, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.04094785910386305, "sim_compute_performance-ego": 0.07206605642269819, "sim_compute_robot_state-ego": 0.07668853111756153, "sim_compute_robot_state-npc0": 0.07139811454675137, "sim_compute_robot_state-npc1": 0.07054560612409543, "sim_compute_robot_state-npc2": 0.06968988516391852, "sim_compute_robot_state-npc3": 0.0709447524486444}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.16530179140860574, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.05005222036127459, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.05682149268033212, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.07452575365702312, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.03095547776473196, "sim_compute_performance-ego": 0.05155316570348907, "sim_compute_robot_state-ego": 0.05490991525482713, "sim_compute_robot_state-npc0": 0.05414606813798871, "sim_compute_robot_state-npc1": 0.052671875870018675, "sim_compute_robot_state-npc2": 0.05361538602594744, "sim_compute_robot_state-npc3": 0.052708458482173454}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.26057151089543884, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.07012398346610692, "in-drivable-lane": 0, "agent_compute-ego": 0.08632995771325153, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.11307873933211617, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.04470136891240659, "sim_compute_performance-ego": 0.08233482941337254, "sim_compute_robot_state-ego": 0.09955243442369544, "sim_compute_robot_state-npc0": 0.07949352264404297, "sim_compute_robot_state-npc1": 0.0775585589201554, "sim_compute_robot_state-npc2": 0.0762957179028055, "sim_compute_robot_state-npc3": 0.07926375969596532}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.21686979602364936, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.06413366981581145, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.07361782064624861, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.10138054688771564, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.04110824360566981, "sim_compute_performance-ego": 0.0718316540998571, "sim_compute_robot_state-ego": 0.07901183062908697, "sim_compute_robot_state-npc0": 0.07137980180628159, "sim_compute_robot_state-npc1": 0.07280653598261815, "sim_compute_robot_state-npc2": 0.07223974255954518, "sim_compute_robot_state-npc3": 0.0718833184709736}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.20806645495550977, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.06182538781847272, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.07366857528686524, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.09940426009041922, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03839561939239502, "sim_compute_performance-ego": 0.06624725546155658, "sim_compute_robot_state-ego": 0.07188105583190918, "sim_compute_robot_state-npc0": 0.07021537167685372, "sim_compute_robot_state-npc1": 0.06950015681130546, "sim_compute_robot_state-npc2": 0.07012502806527274, "sim_compute_robot_state-npc3": 0.06942883389336722}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20894192342888815, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.06547255058811136, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.07543560250164712, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.10080540996708282, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.03899189217449867, "sim_compute_performance-ego": 0.07018102685066119, "sim_compute_robot_state-ego": 0.07711496745070366, "sim_compute_robot_state-npc0": 0.07080989667814072, "sim_compute_robot_state-npc1": 0.07297921507325891, "sim_compute_robot_state-npc2": 0.06947513149209218, "sim_compute_robot_state-npc3": 0.07072316783748261}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.20094177889269452, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06345253766969193, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.07120721839195074, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.09992891134217728, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.03913887156996616, "sim_compute_performance-ego": 0.0688749912173249, "sim_compute_robot_state-ego": 0.07422647365303926, "sim_compute_robot_state-npc0": 0.07162331425866415, "sim_compute_robot_state-npc1": 0.07215206013169399, "sim_compute_robot_state-npc2": 0.07188758461974389, "sim_compute_robot_state-npc3": 0.07284548393515654}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.18085241317749023, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.049974294809194714, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.05692987258617695, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.07175432718717135, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.029191081340496357, "sim_compute_performance-ego": 0.051044161503131576, "sim_compute_robot_state-ego": 0.056077269407419056, "sim_compute_robot_state-npc0": 0.05365423972790058, "sim_compute_robot_state-npc1": 0.05320336268498348, "sim_compute_robot_state-npc2": 0.05419428531940167, "sim_compute_robot_state-npc3": 0.05005870415614201}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.2004930019378662, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.06235786437988281, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0715472380320231, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09738000869750976, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.03913875579833984, "sim_compute_performance-ego": 0.06630342483520507, "sim_compute_robot_state-ego": 0.0718217118581136, "sim_compute_robot_state-npc0": 0.06972095171610514, "sim_compute_robot_state-npc1": 0.06911776224772136, "sim_compute_robot_state-npc2": 0.07022971153259278, "sim_compute_robot_state-npc3": 0.07081513086954752}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.2173393340337844, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.06691268512180873, "in-drivable-lane": 0, "agent_compute-ego": 0.07051161357334682, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.0989178702944801, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.039454108192807154, "sim_compute_performance-ego": 0.06593296641395205, "sim_compute_robot_state-ego": 0.06990030833653041, "sim_compute_robot_state-npc0": 0.07706495693751744, "sim_compute_robot_state-npc1": 0.0714270727975028, "sim_compute_robot_state-npc2": 0.0713616893405006, "sim_compute_robot_state-npc3": 0.07125240280514672}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.24641562617102333, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.06505821471990542, "in-drivable-lane": 1.15, "agent_compute-ego": 0.07174383207809093, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.10319226287132086, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.04028874219850053, "sim_compute_performance-ego": 0.07326821948206702, "sim_compute_robot_state-ego": 0.08584097374317258, "sim_compute_robot_state-npc0": 0.0761379086694052, "sim_compute_robot_state-npc1": 0.07427073079486225, "sim_compute_robot_state-npc2": 0.0721655058306317, "sim_compute_robot_state-npc3": 0.07203166429386583}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.23354137795312063, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.06516517911638532, "in-drivable-lane": 0, "agent_compute-ego": 0.07579607622964042, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.10159674712589808, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04076665639877319, "sim_compute_performance-ego": 0.0705450006893703, "sim_compute_robot_state-ego": 0.0794705833707537, "sim_compute_robot_state-npc0": 0.07439419201442174, "sim_compute_robot_state-npc1": 0.07362354653222221, "sim_compute_robot_state-npc2": 0.07857108967644828, "sim_compute_robot_state-npc3": 0.07626925195966448}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.2203141988492479, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.06269790612015069, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.07364971497479607, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.09741551735821892, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.042307619955025466, "sim_compute_performance-ego": 0.07099174050723805, "sim_compute_robot_state-ego": 0.06981645378411985, "sim_compute_robot_state-npc0": 0.07214664945415422, "sim_compute_robot_state-npc1": 0.07022865145814185, "sim_compute_robot_state-npc2": 0.0721892001582127, "sim_compute_robot_state-npc3": 0.07289977634654325}}
set_robot_commands_max0.11307873933211617
set_robot_commands_mean0.09670781544803952
set_robot_commands_median0.09940426009041922
set_robot_commands_min0.07175432718717135
sim_compute_performance-ego_max0.08233482941337254
sim_compute_performance-ego_mean0.06788340507461528
sim_compute_performance-ego_median0.07018102685066119
sim_compute_performance-ego_min0.051044161503131576
sim_compute_robot_state-ego_max0.09955243442369544
sim_compute_robot_state-ego_mean0.07443066641123515
sim_compute_robot_state-ego_median0.07422647365303926
sim_compute_robot_state-ego_min0.05490991525482713
sim_compute_robot_state-npc0_max0.07949352264404297
sim_compute_robot_state-npc0_mean0.07000003063176802
sim_compute_robot_state-npc0_median0.07137980180628159
sim_compute_robot_state-npc0_min0.05365423972790058
sim_compute_robot_state-npc1_max0.0775585589201554
sim_compute_robot_state-npc1_mean0.0696338664242372
sim_compute_robot_state-npc1_median0.0714270727975028
sim_compute_robot_state-npc1_min0.052671875870018675
sim_compute_robot_state-npc2_max0.07857108967644828
sim_compute_robot_state-npc2_mean0.06914736006293834
sim_compute_robot_state-npc2_median0.07022971153259278
sim_compute_robot_state-npc2_min0.05361538602594744
sim_compute_robot_state-npc3_max0.07926375969596532
sim_compute_robot_state-npc3_mean0.06940485163505537
sim_compute_robot_state-npc3_median0.0709986686706543
sim_compute_robot_state-npc3_min0.05005870415614201
sim_compute_sim_state_max0.04470136891240659
sim_compute_sim_state_mean0.0387435002704631
sim_compute_sim_state_median0.03913887156996616
sim_compute_sim_state_min0.029191081340496357
sim_physics_max0.26057151089543884
sim_physics_mean0.21274819530180253
sim_physics_median0.21615739663441977
sim_physics_min0.16530179140860574
sim_render-ego_max0.07012398346610692
sim_render-ego_mean0.06242636122106273
sim_render-ego_median0.06345253766969193
sim_render-ego_min0.049974294809194714
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible