Duckietown Challenges Home Challenges Submissions

Submission 13192

Submission13192
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserYury Belousov 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60453
Next
User labelJetBrains Research2 sim2real v0.1.1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60453LFVmultibodyv-simsuccessyes1:06:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8655971598025256
survival_time_median19.600000000000144
deviation-center-line_median1.6268780558120226
in-drivable-lane_median0.274999999999999


other stats
agent_compute-ego0_max0.031087946952450977
agent_compute-ego0_mean0.023632983965674977
agent_compute-ego0_median0.021211659759901372
agent_compute-ego0_min0.020139879032932257
agent_compute-ego1_max0.03184674350359968
agent_compute-ego1_mean0.02361036726393863
agent_compute-ego1_median0.02100579768295605
agent_compute-ego1_min0.019625128232515776
agent_compute-ego2_max0.03145027039311921
agent_compute-ego2_mean0.023966830248785553
agent_compute-ego2_median0.020356014061765553
agent_compute-ego2_min0.020094206291471888
agent_compute-ego3_max0.03163672646190071
agent_compute-ego3_mean0.02429424830456297
agent_compute-ego3_median0.02093150902585865
agent_compute-ego3_min0.020314509425929543
complete-iteration_max1.3648296421720785
complete-iteration_mean1.0946438219823402
complete-iteration_median1.2935909369307494
complete-iteration_min0.339378729233375
deviation-center-line_max7.669195331334856
deviation-center-line_mean2.011293575922879
deviation-center-line_min0.1994196711657981
deviation-heading_max57.472093656187674
deviation-heading_mean9.146032122990372
deviation-heading_median4.084601984518216
deviation-heading_min0.9971502618699504
driven_any_max16.619944521051437
driven_any_mean3.4458861972897705
driven_any_median1.9726509275585828
driven_any_min0.4800341099354089
driven_lanedir_consec_max8.886580244340138
driven_lanedir_consec_mean2.648437117141889
driven_lanedir_consec_min0.4315496430621055
driven_lanedir_max14.637370721964256
driven_lanedir_mean3.059207865543612
driven_lanedir_median1.8655971598025256
driven_lanedir_min0.4315496430621055
get_duckie_state_max1.346185310499662e-06
get_duckie_state_mean1.2730565247254098e-06
get_duckie_state_median1.345432645552386e-06
get_duckie_state_min1.13523923433744e-06
get_robot_state_max0.014054991892264591
get_robot_state_mean0.012966557676903532
get_robot_state_median0.014018095783301588
get_robot_state_min0.006956900083101712
get_state_dump_max0.009753162930120572
get_state_dump_mean0.00906247808598588
get_state_dump_median0.00960184842272266
get_state_dump_min0.006014125163738544
get_ui_image_max0.05133145334763078
get_ui_image_mean0.044882795264845746
get_ui_image_median0.046866154690567007
get_ui_image_min0.029436248999375563
in-drivable-lane_max8.85000000000004
in-drivable-lane_mean1.5214285714285698
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1969052958765884, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 1.1884375098132778, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.813600619584083, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 1.0600154228972154, "driven_lanedir_consec": 1.1884375098132778, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.3276488057208167, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 3.02611567471936, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 2.7358400201402033, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.9986870261204484, "driven_lanedir_consec": 3.02611567471936, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.7826677516035536, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 0.580655948776158, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 8.85000000000004, "deviation-heading": 1.7009696531195329, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.1994196711657981, "driven_lanedir_consec": 0.580655948776158, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.8647729745710084, "get_ui_image": 0.04417405088907456, "step_physics": 0.8023954872273805, "survival_time": 12.000000000000036, "driven_lanedir": 0.8242529279238888, "get_state_dump": 0.009753162930120572, "get_robot_state": 0.014054991892264591, "sim_render-ego0": 0.003790846504116454, "sim_render-ego1": 0.003696635550977778, "sim_render-ego2": 0.003626264477171838, "sim_render-ego3": 0.003729668890292219, "get_duckie_state": 1.345432645552386e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.692950907965249, "agent_compute-ego0": 0.021211659759901372, "agent_compute-ego1": 0.02100579768295605, "agent_compute-ego2": 0.020356014061765553, "agent_compute-ego3": 0.02093150902585865, "complete-iteration": 1.003143433218675, "set_robot_commands": 0.002257088902580293, "deviation-center-line": 0.9329501466830484, "driven_lanedir_consec": 0.8242529279238888, "sim_compute_sim_state": 0.017626033284357474, "sim_compute_performance-ego0": 0.001922916079952509, "sim_compute_performance-ego1": 0.0019748863837531, "sim_compute_performance-ego2": 0.0019033568528677913, "sim_compute_performance-ego3": 0.001931591152650192}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 4.9900106682619505, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 4.658069253267681, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 4.4762530610711835, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.6924220500417957, "driven_lanedir_consec": 4.658069253267681, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.136956076778972, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 3.4453600404121634, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 2.050000000000013, "deviation-heading": 6.527925561877326, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.6854959477934797, "driven_lanedir_consec": 3.4453600404121634, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.4800341099354089, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 0.4315496430621055, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.19573932620768, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.5682601638305655, "driven_lanedir_consec": 0.4315496430621055, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6932446185132177, "get_ui_image": 0.05133145334763078, "step_physics": 1.1074145756301683, "survival_time": 19.600000000000144, "driven_lanedir": 0.6822722504838361, "get_state_dump": 0.00960184842272266, "get_robot_state": 0.014018095783301588, "sim_render-ego0": 0.0037879076319493102, "sim_render-ego1": 0.003724340870786866, "sim_render-ego2": 0.003716520984057555, "sim_render-ego3": 0.0037031907768346577, "get_duckie_state": 1.346185310499662e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.999253463699411, "agent_compute-ego0": 0.031087946952450977, "agent_compute-ego1": 0.03184674350359968, "agent_compute-ego2": 0.03145027039311921, "agent_compute-ego3": 0.03163672646190071, "complete-iteration": 1.3648296421720785, "set_robot_commands": 0.002228727170832588, "deviation-center-line": 1.769391839464724, "driven_lanedir_consec": 0.6822722504838361, "sim_compute_sim_state": 0.024866452350567923, "sim_compute_performance-ego0": 0.001937751551620833, "sim_compute_performance-ego1": 0.001916097927336171, "sim_compute_performance-ego2": 0.0019118864724350943, "sim_compute_performance-ego3": 0.0019399209786917415}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.3358291917241853, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 2.253916589184453, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.071124256493012, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 1.73072899454825, "driven_lanedir_consec": 2.253916589184453, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 16.619944521051437, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 14.637370721964256, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 7.2499999999999165, "deviation-heading": 13.903344527988876, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 4.567504387740789, "driven_lanedir_consec": 8.886580244340138, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 6.35356476338459, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 5.948914100706613, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.899999999999997, "deviation-heading": 12.640649083524758, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 7.669195331334856, "driven_lanedir_consec": 5.948914100706613, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.9540249352358856, "get_ui_image": 0.046866154690567007, "step_physics": 1.0915161392075334, "survival_time": 59.99999999999873, "driven_lanedir": 1.7827492308250514, "get_state_dump": 0.009356599366238076, "get_robot_state": 0.013831414152045331, "sim_render-ego0": 0.003625614061442938, "sim_render-ego1": 0.00359891753311856, "sim_render-ego2": 0.0035922072709946708, "sim_render-ego3": 0.003622226572155853, "get_duckie_state": 1.1964602633181658e-06, "in-drivable-lane": 0.549999999999998, "deviation-heading": 57.472093656187674, "agent_compute-ego0": 0.020139879032932257, "agent_compute-ego1": 0.019971180120971575, "agent_compute-ego2": 0.020094206291471888, "agent_compute-ego3": 0.020314509425929543, "complete-iteration": 1.2935909369307494, "set_robot_commands": 0.002151457098104078, "deviation-center-line": 3.181860765760205, "driven_lanedir_consec": 1.7827492308250514, "sim_compute_sim_state": 0.020830009700257415, "sim_compute_performance-ego0": 0.0018798504939782031, "sim_compute_performance-ego1": 0.0018964863935179953, "sim_compute_performance-ego2": 0.0018586310419214456, "sim_compute_performance-ego3": 0.001877714851118941}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.99127691988128, "get_ui_image": 0.029436248999375563, "step_physics": 0.23245514172774095, "survival_time": 6.449999999999985, "driven_lanedir": 1.9484450887799991, "get_state_dump": 0.006014125163738544, "get_robot_state": 0.006956900083101712, "sim_render-ego0": 0.003605860930222731, "sim_render-ego1": 0.0035300676639263445, "get_duckie_state": 1.13523923433744e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9971502618699504, "agent_compute-ego0": 0.02055191626915565, "agent_compute-ego1": 0.019625128232515776, "complete-iteration": 0.339378729233375, "set_robot_commands": 0.002063740216768705, "deviation-center-line": 0.5604820721310846, "driven_lanedir_consec": 1.9484450887799991, "sim_compute_sim_state": 0.009259297297551082, "sim_compute_performance-ego0": 0.0018545040717491735, "sim_compute_performance-ego1": 0.001848453741807204}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.515526129517892, "get_ui_image": 0.029436248999375563, "step_physics": 0.23245514172774095, "survival_time": 6.449999999999985, "driven_lanedir": 1.420801137691721, "get_state_dump": 0.006014125163738544, "get_robot_state": 0.006956900083101712, "sim_render-ego0": 0.003605860930222731, "sim_render-ego1": 0.0035300676639263445, "get_duckie_state": 1.13523923433744e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.817555322136281, "agent_compute-ego0": 0.02055191626915565, "agent_compute-ego1": 0.019625128232515776, "complete-iteration": 0.339378729233375, "set_robot_commands": 0.002063740216768705, "deviation-center-line": 0.5416962434080459, "driven_lanedir_consec": 1.420801137691721, "sim_compute_sim_state": 0.009259297297551082, "sim_compute_performance-ego0": 0.0018545040717491735, "sim_compute_performance-ego1": 0.001848453741807204}}
set_robot_commands_max0.002257088902580293
set_robot_commands_mean0.0021911837942575176
set_robot_commands_median0.002228727170832588
set_robot_commands_min0.002063740216768705
sim_compute_performance-ego0_max0.001937751551620833
sim_compute_performance-ego0_mean0.0019050771889788953
sim_compute_performance-ego0_median0.001922916079952509
sim_compute_performance-ego0_min0.0018545040717491735
sim_compute_performance-ego1_max0.0019748863837531
sim_compute_performance-ego1_mean0.001917627878717391
sim_compute_performance-ego1_median0.001916097927336171
sim_compute_performance-ego1_min0.001848453741807204
sim_compute_performance-ego2_max0.0019118864724350943
sim_compute_performance-ego2_mean0.0018912914557414435
sim_compute_performance-ego2_median0.0019033568528677913
sim_compute_performance-ego2_min0.0018586310419214456
sim_compute_performance-ego3_max0.0019399209786917415
sim_compute_performance-ego3_mean0.0019164089941536252
sim_compute_performance-ego3_median0.001931591152650192
sim_compute_performance-ego3_min0.001877714851118941
sim_compute_sim_state_max0.024866452350567923
sim_compute_sim_state_mean0.019414898281130955
sim_compute_sim_state_median0.020830009700257415
sim_compute_sim_state_min0.009259297297551082
sim_render-ego0_max0.003790846504116454
sim_render-ego0_mean0.003716371046462878
sim_render-ego0_median0.0037879076319493102
sim_render-ego0_min0.003605860930222731
sim_render-ego1_max0.003724340870786866
sim_render-ego1_mean0.003652836510527538
sim_render-ego1_median0.003696635550977778
sim_render-ego1_min0.0035300676639263445
sim_render-ego2_max0.003716520984057555
sim_render-ego2_mean0.0036449975774080217
sim_render-ego2_median0.003626264477171838
sim_render-ego2_min0.0035922072709946708
sim_render-ego3_max0.003729668890292219
sim_render-ego3_mean0.003685028746427577
sim_render-ego3_median0.0037031907768346577
sim_render-ego3_min0.003622226572155853
simulation-passed1
step_physics_max1.1074145756301683
step_physics_mean0.8907296494082722
step_physics_median1.0915161392075334
step_physics_min0.23245514172774095
survival_time_max59.99999999999873
survival_time_mean27.092857142856833
survival_time_min6.449999999999985
No reset possible