Duckietown Challenges Home Challenges Submissions

Submission 13193

Submission13193
Competingyes
Challengeaido5-LFV_multi-sim-validation
UserYury Belousov 🇷🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60443
Next
User labelJetBrains Research2 sim2real v0.1.1
Admin priority50
Blessingn/a
User priority50

60443

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60443LFVmultibodyv-simsuccessyes1:16:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1112556072683653
survival_time_median27.300000000000253
deviation-center-line_median2.341153493287474
in-drivable-lane_median1.3249999999999975


other stats
agent_compute-ego0_max0.024779145862538057
agent_compute-ego0_mean0.021616850585115
agent_compute-ego0_median0.02061896568242549
agent_compute-ego0_min0.019787261360570005
agent_compute-ego1_max0.024335540601554063
agent_compute-ego1_mean0.02154280913761949
agent_compute-ego1_median0.020537671728879825
agent_compute-ego1_min0.020062657406455593
agent_compute-ego2_max0.023925518016831068
agent_compute-ego2_mean0.021345504549160847
agent_compute-ego2_median0.02024817553908995
agent_compute-ego2_min0.01986282009156153
agent_compute-ego3_max0.024515376102914425
agent_compute-ego3_mean0.02211269696844156
agent_compute-ego3_median0.020948974916224505
agent_compute-ego3_min0.02087373988618576
complete-iteration_max1.2927846947797257
complete-iteration_mean1.0798907180883757
complete-iteration_median1.1831992908760354
complete-iteration_min0.3586231357172916
deviation-center-line_max6.152228547652502
deviation-center-line_mean2.732956568244674
deviation-center-line_min0.24326675170087603
deviation-heading_max19.22917780083895
deviation-heading_mean6.193508020580992
deviation-heading_median4.026614862486915
deviation-heading_min0.7073084890183615
driven_any_max15.317386214441104
driven_any_mean5.391342636137883
driven_any_median3.3251662269217785
driven_any_min0.7071169290366108
driven_lanedir_consec_max11.836231657250028
driven_lanedir_consec_mean4.145195734947332
driven_lanedir_consec_min0.6970060855920459
driven_lanedir_max13.003709931317788
driven_lanedir_mean4.592454698360682
driven_lanedir_median3.1112556072683653
driven_lanedir_min0.6970060855920459
get_duckie_state_max1.4172108544596625e-06
get_duckie_state_mean1.37431828919363e-06
get_duckie_state_median1.4113333804951726e-06
get_duckie_state_min1.2698926423725328e-06
get_robot_state_max0.014416994202841728
get_robot_state_mean0.013230907448780454
get_robot_state_median0.0141781465506848
get_robot_state_min0.007089373939915707
get_state_dump_max0.009694154781222998
get_state_dump_mean0.00920694019323767
get_state_dump_median0.009687178339390434
get_state_dump_min0.006314315293964587
get_ui_image_max0.049922709262539805
get_ui_image_mean0.04445072600291334
get_ui_image_median0.046856748556524136
get_ui_image_min0.031103058865195828
in-drivable-lane_max32.54999999999848
in-drivable-lane_mean6.2035714285713075
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.8497751191545875, "get_ui_image": 0.043246553758534874, "step_physics": 0.9867783156932628, "survival_time": 24.25000000000021, "driven_lanedir": 0.7723187903320692, "get_state_dump": 0.009685799908736114, "get_robot_state": 0.0141781465506848, "sim_render-ego0": 0.0037728817865191177, "sim_render-ego1": 0.00371850518042168, "sim_render-ego2": 0.003672811229533129, "sim_render-ego3": 0.0036575838371559425, "get_duckie_state": 1.346623456036603e-06, "in-drivable-lane": 20.550000000000217, "deviation-heading": 0.9534794547050192, "agent_compute-ego0": 0.02036723482265394, "agent_compute-ego1": 0.020537671728879825, "agent_compute-ego2": 0.01986282009156153, "agent_compute-ego3": 0.02087373988618576, "complete-iteration": 1.1831992908760354, "set_robot_commands": 0.0021728257583492577, "deviation-center-line": 0.24326675170087603, "driven_lanedir_consec": 0.7723187903320692, "sim_compute_sim_state": 0.01573550063396187, "sim_compute_performance-ego0": 0.00197021460827486, "sim_compute_performance-ego1": 0.0019820011201709385, "sim_compute_performance-ego2": 0.0019715739866343054, "sim_compute_performance-ego3": 0.001973238992102352}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.0000393774815604, "get_ui_image": 0.043246553758534874, "step_physics": 0.9867783156932628, "survival_time": 24.25000000000021, "driven_lanedir": 2.637814777497288, "get_state_dump": 0.009685799908736114, "get_robot_state": 0.0141781465506848, "sim_render-ego0": 0.0037728817865191177, "sim_render-ego1": 0.00371850518042168, "sim_render-ego2": 0.003672811229533129, "sim_render-ego3": 0.0036575838371559425, "get_duckie_state": 1.346623456036603e-06, "in-drivable-lane": 1.349999999999998, "deviation-heading": 2.25148613033551, "agent_compute-ego0": 0.02036723482265394, "agent_compute-ego1": 0.020537671728879825, "agent_compute-ego2": 0.01986282009156153, "agent_compute-ego3": 0.02087373988618576, "complete-iteration": 1.1831992908760354, "set_robot_commands": 0.0021728257583492577, "deviation-center-line": 2.877374306145118, "driven_lanedir_consec": 2.637814777497288, "sim_compute_sim_state": 0.01573550063396187, "sim_compute_performance-ego0": 0.00197021460827486, "sim_compute_performance-ego1": 0.0019820011201709385, "sim_compute_performance-ego2": 0.0019715739866343054, "sim_compute_performance-ego3": 0.001973238992102352}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.1251548153900215, "get_ui_image": 0.043246553758534874, "step_physics": 0.9867783156932628, "survival_time": 24.25000000000021, "driven_lanedir": 1.0752290818512606, "get_state_dump": 0.009685799908736114, "get_robot_state": 0.0141781465506848, "sim_render-ego0": 0.0037728817865191177, "sim_render-ego1": 0.00371850518042168, "sim_render-ego2": 0.003672811229533129, "sim_render-ego3": 0.0036575838371559425, "get_duckie_state": 1.346623456036603e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.5065596104173125, "agent_compute-ego0": 0.02036723482265394, "agent_compute-ego1": 0.020537671728879825, "agent_compute-ego2": 0.01986282009156153, "agent_compute-ego3": 0.02087373988618576, "complete-iteration": 1.1831992908760354, "set_robot_commands": 0.0021728257583492577, "deviation-center-line": 2.3306177861300093, "driven_lanedir_consec": 1.0752290818512606, "sim_compute_sim_state": 0.01573550063396187, "sim_compute_performance-ego0": 0.00197021460827486, "sim_compute_performance-ego1": 0.0019820011201709385, "sim_compute_performance-ego2": 0.0019715739866343054, "sim_compute_performance-ego3": 0.001973238992102352}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 6.4094763113624, "get_ui_image": 0.043246553758534874, "step_physics": 0.9867783156932628, "survival_time": 24.25000000000021, "driven_lanedir": 5.882774282712674, "get_state_dump": 0.009685799908736114, "get_robot_state": 0.0141781465506848, "sim_render-ego0": 0.0037728817865191177, "sim_render-ego1": 0.00371850518042168, "sim_render-ego2": 0.003672811229533129, "sim_render-ego3": 0.0036575838371559425, "get_duckie_state": 1.346623456036603e-06, "in-drivable-lane": 1.2999999999999976, "deviation-heading": 5.213468273590386, "agent_compute-ego0": 0.02036723482265394, "agent_compute-ego1": 0.020537671728879825, "agent_compute-ego2": 0.01986282009156153, "agent_compute-ego3": 0.02087373988618576, "complete-iteration": 1.1831992908760354, "set_robot_commands": 0.0021728257583492577, "deviation-center-line": 2.3109298961652054, "driven_lanedir_consec": 5.882774282712674, "sim_compute_sim_state": 0.01573550063396187, "sim_compute_performance-ego0": 0.00197021460827486, "sim_compute_performance-ego1": 0.0019820011201709385, "sim_compute_performance-ego2": 0.0019715739866343054, "sim_compute_performance-ego3": 0.001973238992102352}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 7.814938144509935, "get_ui_image": 0.049922709262539805, "step_physics": 0.8801482837464192, "survival_time": 59.99999999999873, "driven_lanedir": 6.555338706944932, "get_state_dump": 0.009687178339390434, "get_robot_state": 0.014416994202841728, "sim_render-ego0": 0.003830075164718691, "sim_render-ego1": 0.003729839110553116, "sim_render-ego2": 0.0037096531365336622, "sim_render-ego3": 0.0037122092378030313, "get_duckie_state": 1.4172108544596625e-06, "in-drivable-lane": 32.54999999999848, "deviation-heading": 10.956006443919575, "agent_compute-ego0": 0.024779145862538057, "agent_compute-ego1": 0.024335540601554063, "agent_compute-ego2": 0.023925518016831068, "agent_compute-ego3": 0.024515376102914425, "complete-iteration": 1.1243219597949077, "set_robot_commands": 0.002259258028867342, "deviation-center-line": 2.3516892004449375, "driven_lanedir_consec": 5.343586267186227, "sim_compute_sim_state": 0.040554741836408094, "sim_compute_performance-ego0": 0.0019921803851608035, "sim_compute_performance-ego1": 0.0019705839498553247, "sim_compute_performance-ego2": 0.001954356002172364, "sim_compute_performance-ego3": 0.001943915809421714}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 12.830850586074968, "get_ui_image": 0.049922709262539805, "step_physics": 0.8801482837464192, "survival_time": 59.99999999999873, "driven_lanedir": 10.517196819621349, "get_state_dump": 0.009687178339390434, "get_robot_state": 0.014416994202841728, "sim_render-ego0": 0.003830075164718691, "sim_render-ego1": 0.003729839110553116, "sim_render-ego2": 0.0037096531365336622, "sim_render-ego3": 0.0037122092378030313, "get_duckie_state": 1.4172108544596625e-06, "in-drivable-lane": 7.649999999999826, "deviation-heading": 13.987728140840307, "agent_compute-ego0": 0.024779145862538057, "agent_compute-ego1": 0.024335540601554063, "agent_compute-ego2": 0.023925518016831068, "agent_compute-ego3": 0.024515376102914425, "complete-iteration": 1.1243219597949077, "set_robot_commands": 0.002259258028867342, "deviation-center-line": 6.152228547652502, "driven_lanedir_consec": 10.517196819621349, "sim_compute_sim_state": 0.040554741836408094, "sim_compute_performance-ego0": 0.0019921803851608035, "sim_compute_performance-ego1": 0.0019705839498553247, "sim_compute_performance-ego2": 0.001954356002172364, "sim_compute_performance-ego3": 0.001943915809421714}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 15.317386214441104, "get_ui_image": 0.049922709262539805, "step_physics": 0.8801482837464192, "survival_time": 59.99999999999873, "driven_lanedir": 13.003709931317788, "get_state_dump": 0.009687178339390434, "get_robot_state": 0.014416994202841728, "sim_render-ego0": 0.003830075164718691, "sim_render-ego1": 0.003729839110553116, "sim_render-ego2": 0.0037096531365336622, "sim_render-ego3": 0.0037122092378030313, "get_duckie_state": 1.4172108544596625e-06, "in-drivable-lane": 7.799999999999692, "deviation-heading": 15.442620268849508, "agent_compute-ego0": 0.024779145862538057, "agent_compute-ego1": 0.024335540601554063, "agent_compute-ego2": 0.023925518016831068, "agent_compute-ego3": 0.024515376102914425, "complete-iteration": 1.1243219597949077, "set_robot_commands": 0.002259258028867342, "deviation-center-line": 5.410519350521411, "driven_lanedir_consec": 11.836231657250028, "sim_compute_sim_state": 0.040554741836408094, "sim_compute_performance-ego0": 0.0019921803851608035, "sim_compute_performance-ego1": 0.0019705839498553247, "sim_compute_performance-ego2": 0.001954356002172364, "sim_compute_performance-ego3": 0.001943915809421714}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 13.53527843689912, "get_ui_image": 0.049922709262539805, "step_physics": 0.8801482837464192, "survival_time": 59.99999999999873, "driven_lanedir": 11.517728402919836, "get_state_dump": 0.009687178339390434, "get_robot_state": 0.014416994202841728, "sim_render-ego0": 0.003830075164718691, "sim_render-ego1": 0.003729839110553116, "sim_render-ego2": 0.0037096531365336622, "sim_render-ego3": 0.0037122092378030313, "get_duckie_state": 1.4172108544596625e-06, "in-drivable-lane": 6.19999999999999, "deviation-heading": 19.22917780083895, "agent_compute-ego0": 0.024779145862538057, "agent_compute-ego1": 0.024335540601554063, "agent_compute-ego2": 0.023925518016831068, "agent_compute-ego3": 0.024515376102914425, "complete-iteration": 1.1243219597949077, "set_robot_commands": 0.002259258028867342, "deviation-center-line": 5.0615650010392885, "driven_lanedir_consec": 7.635333628959403, "sim_compute_sim_state": 0.040554741836408094, "sim_compute_performance-ego0": 0.0019921803851608035, "sim_compute_performance-ego1": 0.0019705839498553247, "sim_compute_performance-ego2": 0.001954356002172364, "sim_compute_performance-ego3": 0.001943915809421714}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.7651867361753506, "get_ui_image": 0.046856748556524136, "step_physics": 1.091023760696216, "survival_time": 27.300000000000253, "driven_lanedir": 0.7437679888089672, "get_state_dump": 0.009694154781222998, "get_robot_state": 0.014168348347247192, "sim_render-ego0": 0.0037201592865548144, "sim_render-ego1": 0.003666430112430775, "sim_render-ego2": 0.003680703844841045, "sim_render-ego3": 0.0036512672138388456, "get_duckie_state": 1.4113333804951726e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.589078454181888, "agent_compute-ego0": 0.02061896568242549, "agent_compute-ego1": 0.020495290948006527, "agent_compute-ego2": 0.02024817553908995, "agent_compute-ego3": 0.020948974916224505, "complete-iteration": 1.2927846947797257, "set_robot_commands": 0.0022693164169897326, "deviation-center-line": 3.5792415586800024, "driven_lanedir_consec": 0.7437679888089672, "sim_compute_sim_state": 0.01707813290834863, "sim_compute_performance-ego0": 0.001935473307830978, "sim_compute_performance-ego1": 0.001976143943326347, "sim_compute_performance-ego2": 0.0019183786521228183, "sim_compute_performance-ego3": 0.001962177060421903}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.00923716524456, "get_ui_image": 0.046856748556524136, "step_physics": 1.091023760696216, "survival_time": 27.300000000000253, "driven_lanedir": 5.486239607439201, "get_state_dump": 0.009694154781222998, "get_robot_state": 0.014168348347247192, "sim_render-ego0": 0.0037201592865548144, "sim_render-ego1": 0.003666430112430775, "sim_render-ego2": 0.003680703844841045, "sim_render-ego3": 0.0036512672138388456, "get_duckie_state": 1.4113333804951726e-06, "in-drivable-lane": 7.600000000000104, "deviation-heading": 3.958525174468883, "agent_compute-ego0": 0.02061896568242549, "agent_compute-ego1": 0.020495290948006527, "agent_compute-ego2": 0.02024817553908995, "agent_compute-ego3": 0.020948974916224505, "complete-iteration": 1.2927846947797257, "set_robot_commands": 0.0022693164169897326, "deviation-center-line": 1.9430995340106016, "driven_lanedir_consec": 5.486239607439201, "sim_compute_sim_state": 0.01707813290834863, "sim_compute_performance-ego0": 0.001935473307830978, "sim_compute_performance-ego1": 0.001976143943326347, "sim_compute_performance-ego2": 0.0019183786521228183, "sim_compute_performance-ego3": 0.001962177060421903}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.7071169290366108, "get_ui_image": 0.046856748556524136, "step_physics": 1.091023760696216, "survival_time": 27.300000000000253, "driven_lanedir": 0.6970060855920459, "get_state_dump": 0.009694154781222998, "get_robot_state": 0.014168348347247192, "sim_render-ego0": 0.0037201592865548144, "sim_render-ego1": 0.003666430112430775, "sim_render-ego2": 0.003680703844841045, "sim_render-ego3": 0.0036512672138388456, "get_duckie_state": 1.4113333804951726e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7073084890183615, "agent_compute-ego0": 0.02061896568242549, "agent_compute-ego1": 0.020495290948006527, "agent_compute-ego2": 0.02024817553908995, "agent_compute-ego3": 0.020948974916224505, "complete-iteration": 1.2927846947797257, "set_robot_commands": 0.0022693164169897326, "deviation-center-line": 3.179904395975938, "driven_lanedir_consec": 0.6970060855920459, "sim_compute_sim_state": 0.01707813290834863, "sim_compute_performance-ego0": 0.001935473307830978, "sim_compute_performance-ego1": 0.001976143943326347, "sim_compute_performance-ego2": 0.0019183786521228183, "sim_compute_performance-ego3": 0.001962177060421903}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.6502930763619967, "get_ui_image": 0.046856748556524136, "step_physics": 1.091023760696216, "survival_time": 27.300000000000253, "driven_lanedir": 3.5846964370394425, "get_state_dump": 0.009694154781222998, "get_robot_state": 0.014168348347247192, "sim_render-ego0": 0.0037201592865548144, "sim_render-ego1": 0.003666430112430775, "sim_render-ego2": 0.003680703844841045, "sim_render-ego3": 0.0036512672138388456, "get_duckie_state": 1.4113333804951726e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.094704550504947, "agent_compute-ego0": 0.02061896568242549, "agent_compute-ego1": 0.020495290948006527, "agent_compute-ego2": 0.02024817553908995, "agent_compute-ego3": 0.020948974916224505, "complete-iteration": 1.2927846947797257, "set_robot_commands": 0.0022693164169897326, "deviation-center-line": 2.1573690210941288, "driven_lanedir_consec": 3.5846964370394425, "sim_compute_sim_state": 0.01707813290834863, "sim_compute_performance-ego0": 0.001935473307830978, "sim_compute_performance-ego1": 0.001976143943326347, "sim_compute_performance-ego2": 0.0019183786521228183, "sim_compute_performance-ego3": 0.001962177060421903}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.36037669608484, "get_ui_image": 0.031103058865195828, "step_physics": 0.24951426857396175, "survival_time": 4.699999999999991, "driven_lanedir": 1.0006533652663254, "get_state_dump": 0.006314315293964587, "get_robot_state": 0.007089373939915707, "sim_render-ego0": 0.003681039810180664, "sim_render-ego1": 0.0036175803134315897, "get_duckie_state": 1.2698926423725328e-06, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 0.7531834479358293, "agent_compute-ego0": 0.019787261360570005, "agent_compute-ego1": 0.020062657406455593, "complete-iteration": 0.3586231357172916, "set_robot_commands": 0.0021285132357948705, "deviation-center-line": 0.3717148857608295, "driven_lanedir_consec": 1.0006533652663254, "sim_compute_sim_state": 0.00929903231169048, "sim_compute_performance-ego0": 0.0018730941571687397, "sim_compute_performance-ego1": 0.0019211267170153167}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.1036872977133043, "get_ui_image": 0.031103058865195828, "step_physics": 0.24951426857396175, "survival_time": 4.699999999999991, "driven_lanedir": 0.8198914997063702, "get_state_dump": 0.006314315293964587, "get_robot_state": 0.007089373939915707, "sim_render-ego0": 0.003681039810180664, "sim_render-ego1": 0.0036175803134315897, "get_duckie_state": 1.2698926423725328e-06, "in-drivable-lane": 1.0999999999999963, "deviation-heading": 1.0657860485274029, "agent_compute-ego0": 0.019787261360570005, "agent_compute-ego1": 0.020062657406455593, "complete-iteration": 0.3586231357172916, "set_robot_commands": 0.0021285132357948705, "deviation-center-line": 0.2918717201045918, "driven_lanedir_consec": 0.8198914997063702, "sim_compute_sim_state": 0.00929903231169048, "sim_compute_performance-ego0": 0.0018730941571687397, "sim_compute_performance-ego1": 0.0019211267170153167}}
set_robot_commands_max0.0022693164169897326
set_robot_commands_mean0.0022187590920296476
set_robot_commands_median0.002259258028867342
set_robot_commands_min0.0021285132357948705
sim_compute_performance-ego0_max0.0019921803851608035
sim_compute_performance-ego0_mean0.0019526901085288608
sim_compute_performance-ego0_median0.00197021460827486
sim_compute_performance-ego0_min0.0018730941571687397
sim_compute_performance-ego1_max0.0019820011201709385
sim_compute_performance-ego1_mean0.0019683692491029342
sim_compute_performance-ego1_median0.001976143943326347
sim_compute_performance-ego1_min0.0019211267170153167
sim_compute_performance-ego2_max0.0019715739866343054
sim_compute_performance-ego2_mean0.0019481028803098295
sim_compute_performance-ego2_median0.001954356002172364
sim_compute_performance-ego2_min0.0019183786521228183
sim_compute_performance-ego3_max0.001973238992102352
sim_compute_performance-ego3_mean0.001959777287315323
sim_compute_performance-ego3_median0.001962177060421903
sim_compute_performance-ego3_min0.001943915809421714
sim_compute_sim_state_max0.040554741836408094
sim_compute_sim_state_mean0.022290826152732528
sim_compute_sim_state_median0.01707813290834863
sim_compute_sim_state_min0.00929903231169048
sim_render-ego0_max0.003830075164718691
sim_render-ego0_mean0.003761038897966559
sim_render-ego0_median0.0037728817865191177
sim_render-ego0_min0.003681039810180664
sim_render-ego1_max0.003729839110553116
sim_render-ego1_mean0.003692447017177533
sim_render-ego1_median0.00371850518042168
sim_render-ego1_min0.0036175803134315897
sim_render-ego2_max0.0037096531365336622
sim_render-ego2_mean0.003687722736969278
sim_render-ego2_median0.003680703844841045
sim_render-ego2_min0.003672811229533129
sim_render-ego3_max0.0037122092378030313
sim_render-ego3_mean0.003673686762932607
sim_render-ego3_median0.0036575838371559425
sim_render-ego3_min0.0036512672138388456
simulation-passed1
step_physics_max1.091023760696216
step_physics_mean0.8807735698351081
step_physics_median0.9867783156932628
step_physics_min0.24951426857396175
survival_time_max59.99999999999873
survival_time_mean32.54285714285691
survival_time_min4.699999999999991
No reset possible