Duckietown Challenges Home Challenges Submissions

Submission 2612

Submission2612
Competingyes
Challengeaido2-LFVI-sim-testing
UserKonstantin Chaika
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
Jobsstep1-simulation: 22864
Next
User labelchallenge-aido_LF-template-ros - Template solution using ROS
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
22864step1-simulationsuccessyes0:24:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2875407694053156
survival_time_median2.849999999999998
deviation-center-line_median0.11031194850197353
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.1182025764502731
agent_compute-ego_mean0.07218527742849506
agent_compute-ego_median0.06858522464067508
agent_compute-ego_min0.055423399981330425
deviation-center-line_max0.2701922695523504
deviation-center-line_mean0.13746050030700233
deviation-center-line_min0.07113819587235681
deviation-heading_max1.4854398920276677
deviation-heading_mean0.7236995121312619
deviation-heading_median0.6953408166028192
deviation-heading_min0.3118646573709166
driven_any_max1.934434121703833
driven_any_mean0.806757806634148
driven_any_median0.8072381933001392
driven_any_min0.20912585880423715
driven_lanedir_consec_max0.7222251056746308
driven_lanedir_consec_mean0.3962831867516217
driven_lanedir_consec_min0.1917983424483971
driven_lanedir_max0.7287863177121016
driven_lanedir_mean0.3975640776898326
driven_lanedir_median0.2875407694053156
driven_lanedir_min0.1917983424483971
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean1.2133333333333305
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.093753441791869, "sim_physics": 0.17883500133652286, "survival_time": 4.149999999999993, "driven_lanedir": 0.4702323960536803, "sim_render-ego": 0.0584233381662024, "in-drivable-lane": 1.6499999999999957, "agent_compute-ego": 0.06463591449231987, "deviation-heading": 1.2111022380750738, "set_robot_commands": 0.08577713334416769, "deviation-center-line": 0.2487133429854821, "driven_lanedir_consec": 0.4702323960536803, "sim_compute_sim_state": 0.037531683243900896, "sim_compute_performance-ego": 0.06391948389719768, "sim_compute_robot_state-ego": 0.07123779676046717, "sim_compute_robot_state-npc0": 0.06489387764988175, "sim_compute_robot_state-npc1": 0.06331586550517254, "sim_compute_robot_state-npc2": 0.06257144514336643, "sim_compute_robot_state-npc3": 0.06279304515884583}, "udem1-1-0": {"driven_any": 0.29795781475632777, "sim_physics": 0.23798551382841887, "survival_time": 1.3500000000000003, "driven_lanedir": 0.2312609677194346, "sim_render-ego": 0.06869525379604763, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07832737322206851, "deviation-heading": 0.6953408166028192, "set_robot_commands": 0.1071468989054362, "deviation-center-line": 0.10073232857747254, "driven_lanedir_consec": 0.2312609677194346, "sim_compute_sim_state": 0.04101046809443721, "sim_compute_performance-ego": 0.07112035044917354, "sim_compute_robot_state-ego": 0.07480189535352919, "sim_compute_robot_state-npc0": 0.07268694595054344, "sim_compute_robot_state-npc1": 0.07303886943393284, "sim_compute_robot_state-npc2": 0.07496632470024957, "sim_compute_robot_state-npc3": 0.07361095039932816}, "udem1-2-0": {"driven_any": 1.080947789080493, "sim_physics": 0.1974443105550913, "survival_time": 3.899999999999994, "driven_lanedir": 0.6758329617605024, "sim_render-ego": 0.06241538891425499, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.06858522464067508, "deviation-heading": 1.0268575719271242, "set_robot_commands": 0.08893310718047313, "deviation-center-line": 0.2701922695523504, "driven_lanedir_consec": 0.6735785385729686, "sim_compute_sim_state": 0.037116472537700944, "sim_compute_performance-ego": 0.06509231604062594, "sim_compute_robot_state-ego": 0.07130264318906344, "sim_compute_robot_state-npc0": 0.06616582931616367, "sim_compute_robot_state-npc1": 0.06552791901123829, "sim_compute_robot_state-npc2": 0.06631394227345784, "sim_compute_robot_state-npc3": 0.065575394874964}, "udem1-3-0": {"driven_any": 0.8072381933001392, "sim_physics": 0.20377247375354432, "survival_time": 2.849999999999998, "driven_lanedir": 0.47292588175405326, "sim_render-ego": 0.06002271802801835, "in-drivable-lane": 0.7999999999999976, "agent_compute-ego": 0.06670985723796644, "deviation-heading": 0.7978002362162198, "set_robot_commands": 0.08838319778442383, "deviation-center-line": 0.13623952041905, "driven_lanedir_consec": 0.47292588175405326, "sim_compute_sim_state": 0.036127918644955286, "sim_compute_performance-ego": 0.06419750263816432, "sim_compute_robot_state-ego": 0.06676478971514785, "sim_compute_robot_state-npc0": 0.06667746159068325, "sim_compute_robot_state-npc1": 0.06615903503016422, "sim_compute_robot_state-npc2": 0.06477302417420504, "sim_compute_robot_state-npc3": 0.06414328541672021}, "udem1-4-0": {"driven_any": 0.31118732113900155, "sim_physics": 0.1984773718792459, "survival_time": 1.1500000000000004, "driven_lanedir": 0.2875407694053156, "sim_render-ego": 0.05932931278062904, "in-drivable-lane": 0, "agent_compute-ego": 0.07181513827780019, "deviation-heading": 0.39989969254594865, "set_robot_commands": 0.09556900936624278, "deviation-center-line": 0.07144385614371519, "driven_lanedir_consec": 0.2875407694053156, "sim_compute_sim_state": 0.0350753639055335, "sim_compute_performance-ego": 0.06727783576301906, "sim_compute_robot_state-ego": 0.07390937597855278, "sim_compute_robot_state-npc0": 0.06843996047973633, "sim_compute_robot_state-npc1": 0.06818456235139267, "sim_compute_robot_state-npc2": 0.18459471412326975, "sim_compute_robot_state-npc3": 0.06369316059610118}, "udem1-5-0": {"driven_any": 1.3021233152606932, "sim_physics": 0.16499077806285783, "survival_time": 5.09999999999999, "driven_lanedir": 0.20473092327823528, "sim_render-ego": 0.05248020677005544, "in-drivable-lane": 4.04999999999999, "agent_compute-ego": 0.1182025764502731, "deviation-heading": 0.394574000309935, "set_robot_commands": 0.08117310439839083, "deviation-center-line": 0.10111471927467218, "driven_lanedir_consec": 0.20473092327823528, "sim_compute_sim_state": 0.033624880454119516, "sim_compute_performance-ego": 0.05637503839006611, "sim_compute_robot_state-ego": 0.060294730990540744, "sim_compute_robot_state-npc0": 0.060158736565533805, "sim_compute_robot_state-npc1": 0.05897352742213829, "sim_compute_robot_state-npc2": 0.05925734837849935, "sim_compute_robot_state-npc3": 0.060294177017959895}, "udem1-6-0": {"driven_any": 1.934434121703833, "sim_physics": 0.16780497006007605, "survival_time": 6.999999999999983, "driven_lanedir": 0.6746993221948967, "sim_render-ego": 0.05462495258876256, "in-drivable-lane": 3.899999999999988, "agent_compute-ego": 0.06246045657566616, "deviation-heading": 1.4854398920276677, "set_robot_commands": 0.0823299561228071, "deviation-center-line": 0.2528639324079792, "driven_lanedir_consec": 0.6740101897237831, "sim_compute_sim_state": 0.03312497309276036, "sim_compute_performance-ego": 0.0610404542514256, "sim_compute_robot_state-ego": 0.06297503198896136, "sim_compute_robot_state-npc0": 0.059922095707484656, "sim_compute_robot_state-npc1": 0.06074068716594151, "sim_compute_robot_state-npc2": 0.05891319683619907, "sim_compute_robot_state-npc3": 0.05983597721372332}, "udem1-7-0": {"driven_any": 1.062597738241834, "sim_physics": 0.20091888675950975, "survival_time": 3.649999999999995, "driven_lanedir": 0.7287863177121016, "sim_render-ego": 0.05903211358475358, "in-drivable-lane": 0.7999999999999972, "agent_compute-ego": 0.06831390890356613, "deviation-heading": 0.7849150213204695, "set_robot_commands": 0.09137611519800472, "deviation-center-line": 0.1387309750370881, "driven_lanedir_consec": 0.7222251056746308, "sim_compute_sim_state": 0.036463574187396326, "sim_compute_performance-ego": 0.06679608070687072, "sim_compute_robot_state-ego": 0.07907395166893529, "sim_compute_robot_state-npc0": 0.07055724810247552, "sim_compute_robot_state-npc1": 0.06620511943346834, "sim_compute_robot_state-npc2": 0.06762623460325476, "sim_compute_robot_state-npc3": 0.06700992910829309}, "udem1-8-0": {"driven_any": 1.1602870725462493, "sim_physics": 0.19624717291011368, "survival_time": 4.299999999999993, "driven_lanedir": 0.35913090517817636, "sim_render-ego": 0.06219665948734727, "in-drivable-lane": 2.399999999999996, "agent_compute-ego": 0.0715740530989891, "deviation-heading": 1.2197696860883536, "set_robot_commands": 0.0979364555935527, "deviation-center-line": 0.15216623639979054, "driven_lanedir_consec": 0.35913090517817636, "sim_compute_sim_state": 0.039325689160546594, "sim_compute_performance-ego": 0.06728293452151986, "sim_compute_robot_state-ego": 0.07608327754708223, "sim_compute_robot_state-npc0": 0.07211226917976557, "sim_compute_robot_state-npc1": 0.07026178060575973, "sim_compute_robot_state-npc2": 0.06738817414572072, "sim_compute_robot_state-npc3": 0.06714277489240779}, "udem1-9-0": {"driven_any": 0.2911508182793437, "sim_physics": 0.21634794198549712, "survival_time": 1.3000000000000005, "driven_lanedir": 0.2409218388122456, "sim_render-ego": 0.06582980889540452, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.07020743993612436, "deviation-heading": 0.5613432181706876, "set_robot_commands": 0.09335700365213248, "deviation-center-line": 0.0760477654868993, "driven_lanedir_consec": 0.2409218388122456, "sim_compute_sim_state": 0.03265473475823036, "sim_compute_performance-ego": 0.06209869568164532, "sim_compute_robot_state-ego": 0.06267233078296368, "sim_compute_robot_state-npc0": 0.06574597725501427, "sim_compute_robot_state-npc1": 0.06554730121905987, "sim_compute_robot_state-npc2": 0.06354972032400277, "sim_compute_robot_state-npc3": 0.06097202117626484}, "udem1-10-0": {"driven_any": 1.021491996160475, "sim_physics": 0.17440004666646322, "survival_time": 3.7499999999999942, "driven_lanedir": 0.7026537170655107, "sim_render-ego": 0.05832966486612956, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.06714889526367188, "deviation-heading": 0.7506445024068277, "set_robot_commands": 0.09157020568847656, "deviation-center-line": 0.11031194850197353, "driven_lanedir_consec": 0.6929451206884647, "sim_compute_sim_state": 0.037905941009521486, "sim_compute_performance-ego": 0.06643189748128255, "sim_compute_robot_state-ego": 0.06670793533325195, "sim_compute_robot_state-npc0": 0.06693431536356607, "sim_compute_robot_state-npc1": 0.06619016647338867, "sim_compute_robot_state-npc2": 0.06830972989400227, "sim_compute_robot_state-npc3": 0.06821299235026042}, "udem1-11-0": {"driven_any": 0.20912585880423715, "sim_physics": 0.16676324889773414, "survival_time": 1.0500000000000005, "driven_lanedir": 0.1917983424483971, "sim_render-ego": 0.05391951969691685, "in-drivable-lane": 0, "agent_compute-ego": 0.06054502441769555, "deviation-heading": 0.3455718910535376, "set_robot_commands": 0.08312990551903135, "deviation-center-line": 0.10333747877015344, "driven_lanedir_consec": 0.1917983424483971, "sim_compute_sim_state": 0.031479869570050924, "sim_compute_performance-ego": 0.05435985610598609, "sim_compute_robot_state-ego": 0.05537143207731701, "sim_compute_robot_state-npc0": 0.05798929078238351, "sim_compute_robot_state-npc1": 0.056662616275605704, "sim_compute_robot_state-npc2": 0.0566919417608352, "sim_compute_robot_state-npc3": 0.058520566849481495}, "udem1-12-0": {"driven_any": 0.5918906368569831, "sim_physics": 0.19464606462522996, "survival_time": 2.1500000000000004, "driven_lanedir": 0.19652140216443992, "sim_render-ego": 0.05476085529770962, "in-drivable-lane": 1.15, "agent_compute-ego": 0.08149958211322163, "deviation-heading": 0.32606788824321575, "set_robot_commands": 0.08734471298927485, "deviation-center-line": 0.10664063848740413, "driven_lanedir_consec": 0.19652140216443992, "sim_compute_sim_state": 0.031736872916997866, "sim_compute_performance-ego": 0.05632791408272677, "sim_compute_robot_state-ego": 0.0803770242735397, "sim_compute_robot_state-npc0": 0.06277882775595021, "sim_compute_robot_state-npc1": 0.07397959398668866, "sim_compute_robot_state-npc2": 0.06278911856717842, "sim_compute_robot_state-npc3": 0.05542041534601256}, "udem1-13-0": {"driven_any": 0.2815655086390766, "sim_physics": 0.1639129945210048, "survival_time": 1.4000000000000006, "driven_lanedir": 0.27004610417980546, "sim_render-ego": 0.04902153355734689, "in-drivable-lane": 0, "agent_compute-ego": 0.07733031681605748, "deviation-heading": 0.3118646573709166, "set_robot_commands": 0.07930760724203927, "deviation-center-line": 0.12223429668864684, "driven_lanedir_consec": 0.27004610417980546, "sim_compute_sim_state": 0.04580478157315936, "sim_compute_performance-ego": 0.05222690956933158, "sim_compute_robot_state-ego": 0.05570435523986816, "sim_compute_robot_state-npc0": 0.053854167461395264, "sim_compute_robot_state-npc1": 0.05543012278420584, "sim_compute_robot_state-npc2": 0.0686456561088562, "sim_compute_robot_state-npc3": 0.08756314856665474}, "udem1-14-0": {"driven_any": 0.655615472951668, "sim_physics": 0.1665807705299527, "survival_time": 2.549999999999999, "driven_lanedir": 0.25637931562069505, "sim_render-ego": 0.047918268278533335, "in-drivable-lane": 1.2999999999999985, "agent_compute-ego": 0.055423399981330425, "deviation-heading": 0.5443013696101298, "set_robot_commands": 0.0752409112219717, "deviation-center-line": 0.07113819587235681, "driven_lanedir_consec": 0.25637931562069505, "sim_compute_sim_state": 0.029193798700968426, "sim_compute_performance-ego": 0.05081833577623554, "sim_compute_robot_state-ego": 0.053795333002127854, "sim_compute_robot_state-npc0": 0.05575078608942967, "sim_compute_robot_state-npc1": 0.05264792722814223, "sim_compute_robot_state-npc2": 0.05182823012856876, "sim_compute_robot_state-npc3": 0.05162605117349064}}
set_robot_commands_max0.1071468989054362
set_robot_commands_mean0.08857168828042836
set_robot_commands_median0.08838319778442383
set_robot_commands_min0.0752409112219717
sim_compute_performance-ego_max0.07112035044917354
sim_compute_performance-ego_mean0.06169104035701805
sim_compute_performance-ego_median0.06391948389719768
sim_compute_performance-ego_min0.05081833577623554
sim_compute_robot_state-ego_max0.0803770242735397
sim_compute_robot_state-ego_mean0.06740479359342322
sim_compute_robot_state-ego_median0.06676478971514785
sim_compute_robot_state-ego_min0.053795333002127854
sim_compute_robot_state-npc0_max0.07268694595054344
sim_compute_robot_state-npc0_mean0.06431118595000046
sim_compute_robot_state-npc0_median0.06574597725501427
sim_compute_robot_state-npc0_min0.053854167461395264
sim_compute_robot_state-npc1_max0.07397959398668866
sim_compute_robot_state-npc1_mean0.0641910062617533
sim_compute_robot_state-npc1_median0.06554730121905987
sim_compute_robot_state-npc1_min0.05264792722814223
sim_compute_robot_state-npc2_max0.18459471412326975
sim_compute_robot_state-npc2_mean0.07188125341077775
sim_compute_robot_state-npc2_median0.06477302417420504
sim_compute_robot_state-npc2_min0.05182823012856876
sim_compute_robot_state-npc3_max0.08756314856665474
sim_compute_robot_state-npc3_mean0.06442759267603389
sim_compute_robot_state-npc3_median0.06369316059610118
sim_compute_robot_state-npc3_min0.05162605117349064
sim_compute_sim_state_max0.04580478157315936
sim_compute_sim_state_mean0.03587846812335193
sim_compute_sim_state_median0.036127918644955286
sim_compute_sim_state_min0.029193798700968426
sim_physics_max0.23798551382841887
sim_physics_mean0.1886085030914175
sim_physics_median0.19464606462522996
sim_physics_min0.1639129945210048
sim_render-ego_max0.06869525379604763
sim_render-ego_mean0.0577999729805408
sim_render-ego_median0.0584233381662024
sim_render-ego_min0.047918268278533335
simulation-passed1
survival_time_max6.999999999999983
survival_time_mean3.043333333333329
survival_time_min1.0500000000000005
No reset possible