Duckietown Challenges Home Challenges Submissions

Submission 13106

Submission13106
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserMikita Sazanovich 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60416
Next
User label2dil
Admin priority50
Blessingn/a
User priority50

60416

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60416LFVmultibodyv-simsuccessyes1:27:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.351189175947917
survival_time_median46.04999999999952
deviation-center-line_median3.395636231135896
in-drivable-lane_median1.000000000000003


other stats
agent_compute-ego0_max0.012101913222521866
agent_compute-ego0_mean0.012023438498557963
agent_compute-ego0_median0.012100803827703122
agent_compute-ego0_min0.0118718093678318
agent_compute-ego1_max0.012040473633888228
agent_compute-ego1_mean0.011805888695236829
agent_compute-ego1_median0.01177822153992448
agent_compute-ego1_min0.011622964492149892
agent_compute-ego2_max0.012064411596286516
agent_compute-ego2_mean0.011842206291924742
agent_compute-ego2_median0.011813359693325528
agent_compute-ego2_min0.011648847586162178
agent_compute-ego3_max0.011959747740606942
agent_compute-ego3_mean0.011726237693183173
agent_compute-ego3_median0.011904412252039998
agent_compute-ego3_min0.011314553086902575
complete-iteration_max1.064712982236242
complete-iteration_mean0.9494833164989877
complete-iteration_median1.0500704146344697
complete-iteration_min0.3189036374977926
deviation-center-line_max5.8386607436589015
deviation-center-line_mean3.0705737927795895
deviation-center-line_min0.8801042742152121
deviation-heading_max20.74925207444973
deviation-heading_mean12.71819732897953
deviation-heading_median14.18350649235378
deviation-heading_min2.926581157685326
driven_any_max17.228485895572753
driven_any_mean8.088577442400569
driven_any_median7.152689833394232
driven_any_min1.0250732014666133
driven_lanedir_consec_max15.118910767105891
driven_lanedir_consec_mean7.227909665208235
driven_lanedir_consec_min0.977794678679928
driven_lanedir_max15.118910767105891
driven_lanedir_mean7.227909665208235
driven_lanedir_median6.351189175947917
driven_lanedir_min0.977794678679928
get_duckie_state_max1.5846302090394525e-06
get_duckie_state_mean1.4452563574240905e-06
get_duckie_state_median1.4665911777862985e-06
get_duckie_state_min1.328672397940681e-06
get_robot_state_max0.01428298370957116
get_robot_state_mean0.013008522737337573
get_robot_state_median0.013969742203538893
get_robot_state_min0.007082652668707927
get_state_dump_max0.009754911162072303
get_state_dump_mean0.009028470250124545
get_state_dump_median0.009526559911622592
get_state_dump_min0.006259214265544424
get_ui_image_max0.04910144123010691
get_ui_image_mean0.04405354657594857
get_ui_image_median0.04720490563200249
get_ui_image_min0.02958076179263149
in-drivable-lane_max12.599999999999396
in-drivable-lane_mean2.0035714285713846
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.0250732014666133, "get_ui_image": 0.043090685257394866, "step_physics": 0.9031936576273788, "survival_time": 24.40000000000021, "driven_lanedir": 0.977794678679928, "get_state_dump": 0.009526559911622592, "get_robot_state": 0.013969742203538893, "sim_render-ego0": 0.003744597815297133, "sim_render-ego1": 0.0036628299939364256, "sim_render-ego2": 0.0036623390174350856, "sim_render-ego3": 0.003657473620705322, "get_duckie_state": 1.4665911777862985e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.824521092501897, "agent_compute-ego0": 0.012100803827703122, "agent_compute-ego1": 0.01177822153992448, "agent_compute-ego2": 0.012064411596286516, "agent_compute-ego3": 0.011904412252039998, "complete-iteration": 1.064712982236242, "set_robot_commands": 0.0021383416189494067, "deviation-center-line": 2.6271072488729375, "driven_lanedir_consec": 0.977794678679928, "sim_compute_sim_state": 0.015735844161612857, "sim_compute_performance-ego0": 0.0019520967284594576, "sim_compute_performance-ego1": 0.0019251910211606016, "sim_compute_performance-ego2": 0.00189976311900133, "sim_compute_performance-ego3": 0.0019310022911898685}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.45254184883656, "get_ui_image": 0.043090685257394866, "step_physics": 0.9031936576273788, "survival_time": 24.40000000000021, "driven_lanedir": 3.178985131260222, "get_state_dump": 0.009526559911622592, "get_robot_state": 0.013969742203538893, "sim_render-ego0": 0.003744597815297133, "sim_render-ego1": 0.0036628299939364256, "sim_render-ego2": 0.0036623390174350856, "sim_render-ego3": 0.003657473620705322, "get_duckie_state": 1.4665911777862985e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 8.003434964240972, "agent_compute-ego0": 0.012100803827703122, "agent_compute-ego1": 0.01177822153992448, "agent_compute-ego2": 0.012064411596286516, "agent_compute-ego3": 0.011904412252039998, "complete-iteration": 1.064712982236242, "set_robot_commands": 0.0021383416189494067, "deviation-center-line": 1.0562642147842196, "driven_lanedir_consec": 3.178985131260222, "sim_compute_sim_state": 0.015735844161612857, "sim_compute_performance-ego0": 0.0019520967284594576, "sim_compute_performance-ego1": 0.0019251910211606016, "sim_compute_performance-ego2": 0.00189976311900133, "sim_compute_performance-ego3": 0.0019310022911898685}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1117133380328914, "get_ui_image": 0.043090685257394866, "step_physics": 0.9031936576273788, "survival_time": 24.40000000000021, "driven_lanedir": 1.0959995900296269, "get_state_dump": 0.009526559911622592, "get_robot_state": 0.013969742203538893, "sim_render-ego0": 0.003744597815297133, "sim_render-ego1": 0.0036628299939364256, "sim_render-ego2": 0.0036623390174350856, "sim_render-ego3": 0.003657473620705322, "get_duckie_state": 1.4665911777862985e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.382804761478171, "agent_compute-ego0": 0.012100803827703122, "agent_compute-ego1": 0.01177822153992448, "agent_compute-ego2": 0.012064411596286516, "agent_compute-ego3": 0.011904412252039998, "complete-iteration": 1.064712982236242, "set_robot_commands": 0.0021383416189494067, "deviation-center-line": 2.084233798662773, "driven_lanedir_consec": 1.0959995900296269, "sim_compute_sim_state": 0.015735844161612857, "sim_compute_performance-ego0": 0.0019520967284594576, "sim_compute_performance-ego1": 0.0019251910211606016, "sim_compute_performance-ego2": 0.00189976311900133, "sim_compute_performance-ego3": 0.0019310022911898685}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 7.126085168631686, "get_ui_image": 0.043090685257394866, "step_physics": 0.9031936576273788, "survival_time": 24.40000000000021, "driven_lanedir": 6.126118150004513, "get_state_dump": 0.009526559911622592, "get_robot_state": 0.013969742203538893, "sim_render-ego0": 0.003744597815297133, "sim_render-ego1": 0.0036628299939364256, "sim_render-ego2": 0.0036623390174350856, "sim_render-ego3": 0.003657473620705322, "get_duckie_state": 1.4665911777862985e-06, "in-drivable-lane": 2.1000000000000183, "deviation-heading": 7.305722988888769, "agent_compute-ego0": 0.012100803827703122, "agent_compute-ego1": 0.01177822153992448, "agent_compute-ego2": 0.012064411596286516, "agent_compute-ego3": 0.011904412252039998, "complete-iteration": 1.064712982236242, "set_robot_commands": 0.0021383416189494067, "deviation-center-line": 1.619138982579143, "driven_lanedir_consec": 6.126118150004513, "sim_compute_sim_state": 0.015735844161612857, "sim_compute_performance-ego0": 0.0019520967284594576, "sim_compute_performance-ego1": 0.0019251910211606016, "sim_compute_performance-ego2": 0.00189976311900133, "sim_compute_performance-ego3": 0.0019310022911898685}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 17.228485895572753, "get_ui_image": 0.04910144123010691, "step_physics": 0.8608508854484082, "survival_time": 59.99999999999873, "driven_lanedir": 15.118910767105891, "get_state_dump": 0.009188567668968792, "get_robot_state": 0.013735777333217496, "sim_render-ego0": 0.0037651959307287057, "sim_render-ego1": 0.0037316726109665895, "sim_render-ego2": 0.003693304292169042, "sim_render-ego3": 0.003683648041940351, "get_duckie_state": 1.328672397940681e-06, "in-drivable-lane": 2.599999999999895, "deviation-heading": 20.74925207444973, "agent_compute-ego0": 0.0118718093678318, "agent_compute-ego1": 0.011622964492149892, "agent_compute-ego2": 0.011813359693325528, "agent_compute-ego3": 0.011314553086902575, "complete-iteration": 1.0500704146344697, "set_robot_commands": 0.002240417601166915, "deviation-center-line": 4.533791383927922, "driven_lanedir_consec": 15.118910767105891, "sim_compute_sim_state": 0.038870446191640026, "sim_compute_performance-ego0": 0.00195773892557492, "sim_compute_performance-ego1": 0.001914387440105759, "sim_compute_performance-ego2": 0.001917196848708128, "sim_compute_performance-ego3": 0.001914396571874817}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.96168546359764, "get_ui_image": 0.04910144123010691, "step_physics": 0.8608508854484082, "survival_time": 59.99999999999873, "driven_lanedir": 10.928919870648924, "get_state_dump": 0.009188567668968792, "get_robot_state": 0.013735777333217496, "sim_render-ego0": 0.0037651959307287057, "sim_render-ego1": 0.0037316726109665895, "sim_render-ego2": 0.003693304292169042, "sim_render-ego3": 0.003683648041940351, "get_duckie_state": 1.328672397940681e-06, "in-drivable-lane": 0.9500000000000028, "deviation-heading": 15.910127143119514, "agent_compute-ego0": 0.0118718093678318, "agent_compute-ego1": 0.011622964492149892, "agent_compute-ego2": 0.011813359693325528, "agent_compute-ego3": 0.011314553086902575, "complete-iteration": 1.0500704146344697, "set_robot_commands": 0.002240417601166915, "deviation-center-line": 5.8386607436589015, "driven_lanedir_consec": 10.928919870648924, "sim_compute_sim_state": 0.038870446191640026, "sim_compute_performance-ego0": 0.00195773892557492, "sim_compute_performance-ego1": 0.001914387440105759, "sim_compute_performance-ego2": 0.001917196848708128, "sim_compute_performance-ego3": 0.001914396571874817}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 15.23289937441411, "get_ui_image": 0.04910144123010691, "step_physics": 0.8608508854484082, "survival_time": 59.99999999999873, "driven_lanedir": 13.327024693137462, "get_state_dump": 0.009188567668968792, "get_robot_state": 0.013735777333217496, "sim_render-ego0": 0.0037651959307287057, "sim_render-ego1": 0.0037316726109665895, "sim_render-ego2": 0.003693304292169042, "sim_render-ego3": 0.003683648041940351, "get_duckie_state": 1.328672397940681e-06, "in-drivable-lane": 12.599999999999396, "deviation-heading": 14.630904092181774, "agent_compute-ego0": 0.0118718093678318, "agent_compute-ego1": 0.011622964492149892, "agent_compute-ego2": 0.011813359693325528, "agent_compute-ego3": 0.011314553086902575, "complete-iteration": 1.0500704146344697, "set_robot_commands": 0.002240417601166915, "deviation-center-line": 3.799851775082617, "driven_lanedir_consec": 13.327024693137462, "sim_compute_sim_state": 0.038870446191640026, "sim_compute_performance-ego0": 0.00195773892557492, "sim_compute_performance-ego1": 0.001914387440105759, "sim_compute_performance-ego2": 0.001917196848708128, "sim_compute_performance-ego3": 0.001914396571874817}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.675062960091614, "get_ui_image": 0.04910144123010691, "step_physics": 0.8608508854484082, "survival_time": 59.99999999999873, "driven_lanedir": 10.460868795212305, "get_state_dump": 0.009188567668968792, "get_robot_state": 0.013735777333217496, "sim_render-ego0": 0.0037651959307287057, "sim_render-ego1": 0.0037316726109665895, "sim_render-ego2": 0.003693304292169042, "sim_render-ego3": 0.003683648041940351, "get_duckie_state": 1.328672397940681e-06, "in-drivable-lane": 0.8499999999999925, "deviation-heading": 17.111617720351614, "agent_compute-ego0": 0.0118718093678318, "agent_compute-ego1": 0.011622964492149892, "agent_compute-ego2": 0.011813359693325528, "agent_compute-ego3": 0.011314553086902575, "complete-iteration": 1.0500704146344697, "set_robot_commands": 0.002240417601166915, "deviation-center-line": 3.953967103248125, "driven_lanedir_consec": 10.460868795212305, "sim_compute_sim_state": 0.038870446191640026, "sim_compute_performance-ego0": 0.00195773892557492, "sim_compute_performance-ego1": 0.001914387440105759, "sim_compute_performance-ego2": 0.001917196848708128, "sim_compute_performance-ego3": 0.001914396571874817}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.0283081709980255, "get_ui_image": 0.04720490563200249, "step_physics": 0.866019627535938, "survival_time": 46.04999999999952, "driven_lanedir": 6.085996744268788, "get_state_dump": 0.009754911162072303, "get_robot_state": 0.01428298370957116, "sim_render-ego0": 0.003914666279277677, "sim_render-ego1": 0.003811123314234802, "sim_render-ego2": 0.00378042006958074, "sim_render-ego3": 0.003801401421718639, "get_duckie_state": 1.5846302090394525e-06, "in-drivable-lane": 2.10000000000002, "deviation-heading": 15.861298782461036, "agent_compute-ego0": 0.012101913222521866, "agent_compute-ego1": 0.012040473633888228, "agent_compute-ego2": 0.011648847586162178, "agent_compute-ego3": 0.011959747740606942, "complete-iteration": 1.0489563921268488, "set_robot_commands": 0.0022716584278032214, "deviation-center-line": 4.53691776531934, "driven_lanedir_consec": 6.085996744268788, "sim_compute_sim_state": 0.031397409139124276, "sim_compute_performance-ego0": 0.002030210743240058, "sim_compute_performance-ego1": 0.001988242608606169, "sim_compute_performance-ego2": 0.0019538045705269837, "sim_compute_performance-ego3": 0.0019973958650535205}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 13.372055456907088, "get_ui_image": 0.04720490563200249, "step_physics": 0.866019627535938, "survival_time": 46.04999999999952, "driven_lanedir": 11.74395818049318, "get_state_dump": 0.009754911162072303, "get_robot_state": 0.01428298370957116, "sim_render-ego0": 0.003914666279277677, "sim_render-ego1": 0.003811123314234802, "sim_render-ego2": 0.00378042006958074, "sim_render-ego3": 0.003801401421718639, "get_duckie_state": 1.5846302090394525e-06, "in-drivable-lane": 2.750000000000031, "deviation-heading": 14.542491892205664, "agent_compute-ego0": 0.012101913222521866, "agent_compute-ego1": 0.012040473633888228, "agent_compute-ego2": 0.011648847586162178, "agent_compute-ego3": 0.011959747740606942, "complete-iteration": 1.0489563921268488, "set_robot_commands": 0.0022716584278032214, "deviation-center-line": 3.0674634747560767, "driven_lanedir_consec": 11.74395818049318, "sim_compute_sim_state": 0.031397409139124276, "sim_compute_performance-ego0": 0.002030210743240058, "sim_compute_performance-ego1": 0.001988242608606169, "sim_compute_performance-ego2": 0.0019538045705269837, "sim_compute_performance-ego3": 0.0019973958650535205}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 7.179294498156778, "get_ui_image": 0.04720490563200249, "step_physics": 0.866019627535938, "survival_time": 46.04999999999952, "driven_lanedir": 6.576260201891321, "get_state_dump": 0.009754911162072303, "get_robot_state": 0.01428298370957116, "sim_render-ego0": 0.003914666279277677, "sim_render-ego1": 0.003811123314234802, "sim_render-ego2": 0.00378042006958074, "sim_render-ego3": 0.003801401421718639, "get_duckie_state": 1.5846302090394525e-06, "in-drivable-lane": 1.0500000000000034, "deviation-heading": 19.194972657771785, "agent_compute-ego0": 0.012101913222521866, "agent_compute-ego1": 0.012040473633888228, "agent_compute-ego2": 0.011648847586162178, "agent_compute-ego3": 0.011959747740606942, "complete-iteration": 1.0489563921268488, "set_robot_commands": 0.0022716584278032214, "deviation-center-line": 3.723808987515715, "driven_lanedir_consec": 6.576260201891321, "sim_compute_sim_state": 0.031397409139124276, "sim_compute_performance-ego0": 0.002030210743240058, "sim_compute_performance-ego1": 0.001988242608606169, "sim_compute_performance-ego2": 0.0019538045705269837, "sim_compute_performance-ego3": 0.0019973958650535205}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 9.752549891739577, "get_ui_image": 0.04720490563200249, "step_physics": 0.866019627535938, "survival_time": 46.04999999999952, "driven_lanedir": 9.134462478586954, "get_state_dump": 0.009754911162072303, "get_robot_state": 0.01428298370957116, "sim_render-ego0": 0.003914666279277677, "sim_render-ego1": 0.003811123314234802, "sim_render-ego2": 0.00378042006958074, "sim_render-ego3": 0.003801401421718639, "get_duckie_state": 1.5846302090394525e-06, "in-drivable-lane": 0.8500000000000121, "deviation-heading": 13.264489718503397, "agent_compute-ego0": 0.012101913222521866, "agent_compute-ego1": 0.012040473633888228, "agent_compute-ego2": 0.011648847586162178, "agent_compute-ego3": 0.011959747740606942, "complete-iteration": 1.0489563921268488, "set_robot_commands": 0.0022716584278032214, "deviation-center-line": 4.350466987993341, "driven_lanedir_consec": 9.134462478586954, "sim_compute_sim_state": 0.031397409139124276, "sim_compute_performance-ego0": 0.002030210743240058, "sim_compute_performance-ego1": 0.001988242608606169, "sim_compute_performance-ego2": 0.0019538045705269837, "sim_compute_performance-ego3": 0.0019973958650535205}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.736559256445668, "get_ui_image": 0.02958076179263149, "step_physics": 0.22667475085955835, "survival_time": 12.600000000000044, "driven_lanedir": 3.3203191461774137, "get_state_dump": 0.006259214265544424, "get_robot_state": 0.007082652668707927, "sim_render-ego0": 0.003725769020351968, "sim_render-ego1": 0.0036175241583420825, "get_duckie_state": 1.3570069324357708e-06, "in-drivable-lane": 1.5500000000000096, "deviation-heading": 2.926581157685326, "agent_compute-ego0": 0.012015016653792189, "agent_compute-ego1": 0.011757901534732622, "complete-iteration": 0.3189036374977926, "set_robot_commands": 0.002169411172979905, "deviation-center-line": 0.8801042742152121, "driven_lanedir_consec": 3.3203191461774137, "sim_compute_sim_state": 0.00993286573839753, "sim_compute_performance-ego0": 0.001922564073042436, "sim_compute_performance-ego1": 0.0018970071091482291}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.357769668716954, "get_ui_image": 0.02958076179263149, "step_physics": 0.22667475085955835, "survival_time": 12.600000000000044, "driven_lanedir": 3.1151168854187685, "get_state_dump": 0.006259214265544424, "get_robot_state": 0.007082652668707927, "sim_render-ego0": 0.003725769020351968, "sim_render-ego1": 0.0036175241583420825, "get_duckie_state": 1.3570069324357708e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.346543559873751, "agent_compute-ego0": 0.012015016653792189, "agent_compute-ego1": 0.011757901534732622, "complete-iteration": 0.3189036374977926, "set_robot_commands": 0.002169411172979905, "deviation-center-line": 0.9162563582979224, "driven_lanedir_consec": 3.1151168854187685, "sim_compute_sim_state": 0.00993286573839753, "sim_compute_performance-ego0": 0.001922564073042436, "sim_compute_performance-ego1": 0.0018970071091482291}}
set_robot_commands_max0.0022716584278032214
set_robot_commands_mean0.0022100352098312847
set_robot_commands_median0.002240417601166915
set_robot_commands_min0.0021383416189494067
sim_compute_performance-ego0_max0.002030210743240058
sim_compute_performance-ego0_mean0.001971808123941615
sim_compute_performance-ego0_median0.00195773892557492
sim_compute_performance-ego0_min0.001922564073042436
sim_compute_performance-ego1_max0.001988242608606169
sim_compute_performance-ego1_mean0.0019360927498418984
sim_compute_performance-ego1_median0.0019251910211606016
sim_compute_performance-ego1_min0.0018970071091482291
sim_compute_performance-ego2_max0.0019538045705269837
sim_compute_performance-ego2_mean0.0019235881794121472
sim_compute_performance-ego2_median0.001917196848708128
sim_compute_performance-ego2_min0.00189976311900133
sim_compute_performance-ego3_max0.0019973958650535205
sim_compute_performance-ego3_mean0.0019475982427060688
sim_compute_performance-ego3_median0.0019310022911898685
sim_compute_performance-ego3_min0.001914396571874817
sim_compute_sim_state_max0.038870446191640026
sim_compute_sim_state_mean0.025991466389021688
sim_compute_sim_state_median0.031397409139124276
sim_compute_sim_state_min0.00993286573839753
sim_render-ego0_max0.003914666279277677
sim_render-ego0_mean0.0037963841529941415
sim_render-ego0_median0.0037651959307287057
sim_render-ego0_min0.003725769020351968
sim_render-ego1_max0.003811123314234802
sim_render-ego1_mean0.003718396570945389
sim_render-ego1_median0.0037316726109665895
sim_render-ego1_min0.0036175241583420825
sim_render-ego2_max0.00378042006958074
sim_render-ego2_mean0.003712021126394955
sim_render-ego2_median0.003693304292169042
sim_render-ego2_min0.0036623390174350856
sim_render-ego3_max0.003801401421718639
sim_render-ego3_mean0.0037141743614547713
sim_render-ego3_median0.003683648041940351
sim_render-ego3_min0.003657473620705322
simulation-passed1
step_physics_max0.9031936576273788
step_physics_mean0.7838290131547154
step_physics_median0.866019627535938
step_physics_min0.22667475085955835
survival_time_max59.99999999999873
survival_time_mean39.071428571428136
survival_time_min12.600000000000044
No reset possible