Duckietown Challenges Home Challenges Submissions

Submission 12806

Submission12806
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserYishu Malhotra 🇨🇦
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 59042
Next
User labelexercise_state_estimation
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
59042LFVmultibodyv-simsuccessyes0:55:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5084838441570838
survival_time_median21.800000000000175
deviation-center-line_median1.2710970493463924
in-drivable-lane_median3.824999999999991


other stats
agent_compute-ego0_max0.013344642126335288
agent_compute-ego0_mean0.012635413948309474
agent_compute-ego0_median0.012588976128783748
agent_compute-ego0_min0.011835391788788192
agent_compute-ego1_max0.01324947313828902
agent_compute-ego1_mean0.012945847260571058
agent_compute-ego1_median0.012857615315872033
agent_compute-ego1_min0.012729663325119892
complete-iteration_max1.284680648743053
complete-iteration_mean1.0389465658538215
complete-iteration_median1.236206903210226
complete-iteration_min0.40150934291052653
deviation-center-line_max2.421882040545748
deviation-center-line_mean1.2787541563928515
deviation-center-line_min0.14838083384301978
deviation-heading_max13.7052251082897
deviation-heading_mean6.030426668860836
deviation-heading_median5.172551537136917
deviation-heading_min2.058733078090023
driven_any_max5.456927279279734
driven_any_mean3.0868713583176084
driven_any_median2.963504128837745
driven_any_min0.6128588800870656
driven_lanedir_consec_max4.8038757696390135
driven_lanedir_consec_mean1.960731648147889
driven_lanedir_consec_min0.1285661418938557
driven_lanedir_max4.8038757696390135
driven_lanedir_mean2.0337744836978535
driven_lanedir_median1.8452301892762584
driven_lanedir_min0.17756259747807523
get_duckie_state_max1.6374408074145048e-06
get_duckie_state_mean1.5317169709435185e-06
get_duckie_state_median1.5036192311302202e-06
get_duckie_state_min1.4617726519391253e-06
get_robot_state_max0.01657354325618384
get_robot_state_mean0.014269102602559092
get_robot_state_median0.014673409950606814
get_robot_state_min0.008349751259063507
get_state_dump_max0.010744894450565552
get_state_dump_mean0.00960743678826588
get_state_dump_median0.009724837731135609
get_state_dump_min0.00707233493978327
get_ui_image_max0.05150970342723725
get_ui_image_mean0.04781793958479881
get_ui_image_median0.050413284099326945
get_ui_image_min0.03743535613680219
in-drivable-lane_max26.05000000000027
in-drivable-lane_mean8.039285714285798
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1243037957907809, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 1.081660993845488, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.996207693079557, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 2.0143820992067414, "driven_lanedir_consec": 1.081660993845488, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.8408227491222977, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 3.5308316706101386, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 6.8933337507334205, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 1.5373697034973262, "driven_lanedir_consec": 3.5308316706101386, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.0998400612425856, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 2.856030957082494, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.292112498046781, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 1.183320624589836, "driven_lanedir_consec": 2.856030957082494, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9882531904762024, "get_ui_image": 0.050413284099326945, "step_physics": 1.0485418169003613, "survival_time": 21.15000000000017, "driven_lanedir": 0.9350585358583664, "get_state_dump": 0.010744894450565552, "get_robot_state": 0.01657354325618384, "sim_render-ego0": 0.004518132727101164, "sim_render-ego1": 0.0045055881986078225, "sim_render-ego2": 0.004465857766709238, "sim_render-ego3": 0.004457032905434663, "get_duckie_state": 1.6374408074145048e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.164222931351451, "agent_compute-ego0": 0.013344642126335288, "agent_compute-ego1": 0.013098450201862264, "agent_compute-ego2": 0.013109307244138895, "agent_compute-ego3": 0.013036009275688315, "complete-iteration": 1.236206903210226, "set_robot_commands": 0.0028116382517904604, "deviation-center-line": 2.0989994855604155, "driven_lanedir_consec": 0.9350585358583664, "sim_compute_sim_state": 0.01877370589184311, "sim_compute_performance-ego0": 0.0024297023719211793, "sim_compute_performance-ego1": 0.002365599825697125, "sim_compute_performance-ego2": 0.0023391972172935056, "sim_compute_performance-ego3": 0.0023232248594176096}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.384973723496649, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.6244060285224133, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 23.600000000000275, "deviation-heading": 2.440485261112225, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 0.34213408335642825, "driven_lanedir_consec": 0.6010602947416137, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 2.415531517680019, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.5318655681230391, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 9.000000000000025, "deviation-heading": 12.519849142300531, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 1.9335977564362208, "driven_lanedir_consec": 0.5015745274607548, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.6128588800870656, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 0.17756259747807523, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 26.05000000000027, "deviation-heading": 2.058733078090023, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 0.14838083384301978, "driven_lanedir_consec": 0.1285661418938557, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7175352958788572, "get_ui_image": 0.05150970342723725, "step_physics": 1.098352138229478, "survival_time": 28.250000000000263, "driven_lanedir": 2.156927407027989, "get_state_dump": 0.009724837731135609, "get_robot_state": 0.014673409950606814, "sim_render-ego0": 0.004018446581944981, "sim_render-ego1": 0.004147914610144948, "sim_render-ego2": 0.004337714333416295, "sim_render-ego3": 0.004140167691261103, "get_duckie_state": 1.4890630337880273e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 13.7052251082897, "agent_compute-ego0": 0.012588976128783748, "agent_compute-ego1": 0.012857615315872033, "agent_compute-ego2": 0.012924776060421138, "agent_compute-ego3": 0.012316033191478715, "complete-iteration": 1.284680648743053, "set_robot_commands": 0.0023797464033740146, "deviation-center-line": 2.421882040545748, "driven_lanedir_consec": 1.236960939355791, "sim_compute_sim_state": 0.025062694566409915, "sim_compute_performance-ego0": 0.0021586852023121324, "sim_compute_performance-ego1": 0.0020211012540352217, "sim_compute_performance-ego2": 0.002043235428341707, "sim_compute_performance-ego3": 0.002101246122757875}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 4.676864111478588, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 4.477832723411174, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.348895381194277, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 1.1228981736012638, "driven_lanedir_consec": 4.477832723411174, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.827168196432904, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 1.0791313596694372, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 15.05000000000019, "deviation-heading": 3.1169705399694263, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 0.4830178090352112, "driven_lanedir_consec": 1.0791313596694372, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.657162908727112, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 2.527198781949801, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 5.799999999999988, "deviation-heading": 4.878830640086125, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 1.358873474102949, "driven_lanedir_consec": 2.527198781949801, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.7784672919695086, "get_ui_image": 0.04672212295183055, "step_physics": 0.7284501357264049, "survival_time": 21.800000000000175, "driven_lanedir": 1.7800067489583768, "get_state_dump": 0.009620129107337796, "get_robot_state": 0.014520030272634406, "sim_render-ego0": 0.003932136147191377, "sim_render-ego1": 0.004143800015307673, "sim_render-ego2": 0.004141460567099006, "sim_render-ego3": 0.0041253752239236025, "get_duckie_state": 1.5036192311302202e-06, "in-drivable-lane": 12.60000000000018, "deviation-heading": 2.650837517707333, "agent_compute-ego0": 0.011835391788788192, "agent_compute-ego1": 0.012729663325119892, "agent_compute-ego2": 0.012491724311077895, "agent_compute-ego3": 0.011544678249402775, "complete-iteration": 0.9146707570798336, "set_robot_commands": 0.0023536927640028893, "deviation-center-line": 0.52595822033825, "driven_lanedir_consec": 1.7800067489583768, "sim_compute_sim_state": 0.03274885795209173, "sim_compute_performance-ego0": 0.002155378153995191, "sim_compute_performance-ego1": 0.001997574515964674, "sim_compute_performance-ego2": 0.0020669745089533127, "sim_compute_performance-ego3": 0.0020167472979024017}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.456927279279734, "get_ui_image": 0.03743535613680219, "step_physics": 0.29188143290006197, "survival_time": 28.55000000000027, "driven_lanedir": 4.8038757696390135, "get_state_dump": 0.00707233493978327, "get_robot_state": 0.008349751259063507, "sim_render-ego0": 0.004404397277565269, "sim_render-ego1": 0.004600667453312374, "get_duckie_state": 1.4617726519391253e-06, "in-drivable-lane": 1.4500000000000206, "deviation-heading": 8.71724594062464, "agent_compute-ego0": 0.01290987755035187, "agent_compute-ego1": 0.01324947313828902, "complete-iteration": 0.40150934291052653, "set_robot_commands": 0.0026478263048025277, "deviation-center-line": 1.8679021115491312, "driven_lanedir_consec": 4.8038757696390135, "sim_compute_sim_state": 0.011529435644616616, "sim_compute_performance-ego0": 0.002366334825128942, "sim_compute_performance-ego1": 0.0023559044291089465}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 4.635490014784218, "get_ui_image": 0.03743535613680219, "step_physics": 0.29188143290006197, "survival_time": 28.55000000000027, "driven_lanedir": 1.9104536295941408, "get_state_dump": 0.00707233493978327, "get_robot_state": 0.008349751259063507, "sim_render-ego0": 0.004404397277565269, "sim_render-ego1": 0.004600667453312374, "get_duckie_state": 1.4617726519391253e-06, "in-drivable-lane": 16.90000000000024, "deviation-heading": 3.643023881466235, "agent_compute-ego0": 0.01290987755035187, "agent_compute-ego1": 0.01324947313828902, "complete-iteration": 0.40150934291052653, "set_robot_commands": 0.0026478263048025277, "deviation-center-line": 0.8638417738373809, "driven_lanedir_consec": 1.9104536295941408, "sim_compute_sim_state": 0.011529435644616616, "sim_compute_performance-ego0": 0.002366334825128942, "sim_compute_performance-ego1": 0.0023559044291089465}}
set_robot_commands_max0.0028116382517904604
set_robot_commands_mean0.0025339973061624657
set_robot_commands_median0.0023797464033740146
set_robot_commands_min0.0023536927640028893
sim_compute_performance-ego0_max0.0024297023719211793
sim_compute_performance-ego0_mean0.002264838040226564
sim_compute_performance-ego0_median0.0021586852023121324
sim_compute_performance-ego0_min0.002155378153995191
sim_compute_performance-ego1_max0.002365599825697125
sim_compute_performance-ego1_mean0.002160636517214712
sim_compute_performance-ego1_median0.0020211012540352217
sim_compute_performance-ego1_min0.001997574515964674
sim_compute_sim_state_max0.03274885795209173
sim_compute_sim_state_mean0.02352856463790088
sim_compute_sim_state_median0.025062694566409915
sim_compute_sim_state_min0.011529435644616616
sim_render-ego0_max0.004518132727101164
sim_render-ego0_mean0.004191689741434331
sim_render-ego0_median0.004018446581944981
sim_render-ego0_min0.003932136147191377
sim_render-ego1_max0.004600667453312374
sim_render-ego1_mean0.004313610443061895
sim_render-ego1_median0.004147914610144948
sim_render-ego1_min0.004143800015307673
simulation-passed1
step_physics_max1.098352138229478
step_physics_mean0.8632242306589356
step_physics_median1.0485418169003613
step_physics_min0.29188143290006197
survival_time_max28.55000000000027
survival_time_mean24.421428571428784
survival_time_min21.15000000000017
No reset possible