Duckietown Challenges Home Challenges Submissions

Submission 13023

Submission13023
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserMárton Tim 🇭🇺
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60298
Next
User labelLF-only
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60298LFVmultibodyv-simsuccessyes1:49:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.959281092684185
survival_time_median59.99999999999873
deviation-center-line_median2.893874071330572
in-drivable-lane_median0.8750000000000042


other stats
agent_compute-ego0_max0.04246204520740874
agent_compute-ego0_mean0.041961710790193694
agent_compute-ego0_median0.04235946606041291
agent_compute-ego0_min0.04078462277308549
agent_compute-ego1_max0.04216203681634527
agent_compute-ego1_mean0.041643074377549126
agent_compute-ego1_median0.04188891354448888
agent_compute-ego1_min0.04110422169808114
agent_compute-ego2_max0.04175064744401435
agent_compute-ego2_mean0.04012534099592984
agent_compute-ego2_median0.04070554472442366
agent_compute-ego2_min0.03791983081935149
agent_compute-ego3_max0.04134693491171044
agent_compute-ego3_mean0.041150635302427775
agent_compute-ego3_median0.04131218178087627
agent_compute-ego3_min0.04079278921469664
complete-iteration_max1.381252694785049
complete-iteration_mean1.1025960308887968
complete-iteration_median1.202309395054
complete-iteration_min0.4062972629424369
deviation-center-line_max9.423398002733885
deviation-center-line_mean3.136909241007537
deviation-center-line_min0.14515834577784628
deviation-heading_max31.427282747970928
deviation-heading_mean13.153851111247898
deviation-heading_median13.091858305942832
deviation-heading_min0.9957826734970936
driven_any_max26.311725510771037
driven_any_mean14.435273513659174
driven_any_median12.51432205900625
driven_any_min1.061326823971363
driven_lanedir_consec_max24.117743914804574
driven_lanedir_consec_mean13.22103708263407
driven_lanedir_consec_min0.50185939514488
driven_lanedir_max24.117743914804574
driven_lanedir_mean13.22103708263407
driven_lanedir_median11.959281092684185
driven_lanedir_min0.50185939514488
get_duckie_state_max1.5297698339355876e-06
get_duckie_state_mean1.3495624014724835e-06
get_duckie_state_median1.2915497715526774e-06
get_duckie_state_min1.266267564561632e-06
get_robot_state_max0.01398577320883415
get_robot_state_mean0.01290602441627904
get_robot_state_median0.013972089054384
get_robot_state_min0.006898240287705223
get_state_dump_max0.009395892772944545
get_state_dump_mean0.008821590883804416
get_state_dump_median0.009233291897547432
get_state_dump_min0.006030135815686519
get_ui_image_max0.04912224558370497
get_ui_image_mean0.04326469951434488
get_ui_image_median0.04569963134397178
get_ui_image_min0.029333934925570345
in-drivable-lane_max58.19999999999872
in-drivable-lane_mean4.885714285714193
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 10.486847192766978, "get_ui_image": 0.04193760390974518, "step_physics": 0.7838990431565505, "survival_time": 29.20000000000028, "driven_lanedir": 10.014705495009542, "get_state_dump": 0.00923131551498022, "get_robot_state": 0.013764103049905892, "sim_render-ego0": 0.0037137793679522654, "sim_render-ego1": 0.003702294113289597, "sim_render-ego2": 0.003594290089403462, "sim_render-ego3": 0.003544295139801808, "get_duckie_state": 1.266267564561632e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.318992434048192, "agent_compute-ego0": 0.04165216511131352, "agent_compute-ego1": 0.041147699111547226, "agent_compute-ego2": 0.04070554472442366, "agent_compute-ego3": 0.04079278921469664, "complete-iteration": 1.0723753868005217, "set_robot_commands": 0.002117350162603916, "deviation-center-line": 1.99017983178482, "driven_lanedir_consec": 10.014705495009542, "sim_compute_sim_state": 0.028365179208608773, "sim_compute_performance-ego0": 0.001933144300411909, "sim_compute_performance-ego1": 0.0019333607111221703, "sim_compute_performance-ego2": 0.001907615987663595, "sim_compute_performance-ego3": 0.0018552865737523788}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.557761718007862, "get_ui_image": 0.04193760390974518, "step_physics": 0.7838990431565505, "survival_time": 29.20000000000028, "driven_lanedir": 11.934421392142044, "get_state_dump": 0.00923131551498022, "get_robot_state": 0.013764103049905892, "sim_render-ego0": 0.0037137793679522654, "sim_render-ego1": 0.003702294113289597, "sim_render-ego2": 0.003594290089403462, "sim_render-ego3": 0.003544295139801808, "get_duckie_state": 1.266267564561632e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.091616212936028, "agent_compute-ego0": 0.04165216511131352, "agent_compute-ego1": 0.041147699111547226, "agent_compute-ego2": 0.04070554472442366, "agent_compute-ego3": 0.04079278921469664, "complete-iteration": 1.0723753868005217, "set_robot_commands": 0.002117350162603916, "deviation-center-line": 1.7583816748451742, "driven_lanedir_consec": 11.934421392142044, "sim_compute_sim_state": 0.028365179208608773, "sim_compute_performance-ego0": 0.001933144300411909, "sim_compute_performance-ego1": 0.0019333607111221703, "sim_compute_performance-ego2": 0.001907615987663595, "sim_compute_performance-ego3": 0.0018552865737523788}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 12.47088240000464, "get_ui_image": 0.04193760390974518, "step_physics": 0.7838990431565505, "survival_time": 29.20000000000028, "driven_lanedir": 11.984140793226322, "get_state_dump": 0.00923131551498022, "get_robot_state": 0.013764103049905892, "sim_render-ego0": 0.0037137793679522654, "sim_render-ego1": 0.003702294113289597, "sim_render-ego2": 0.003594290089403462, "sim_render-ego3": 0.003544295139801808, "get_duckie_state": 1.266267564561632e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.1329519441168285, "agent_compute-ego0": 0.04165216511131352, "agent_compute-ego1": 0.041147699111547226, "agent_compute-ego2": 0.04070554472442366, "agent_compute-ego3": 0.04079278921469664, "complete-iteration": 1.0723753868005217, "set_robot_commands": 0.002117350162603916, "deviation-center-line": 1.5454491929917162, "driven_lanedir_consec": 11.984140793226322, "sim_compute_sim_state": 0.028365179208608773, "sim_compute_performance-ego0": 0.001933144300411909, "sim_compute_performance-ego1": 0.0019333607111221703, "sim_compute_performance-ego2": 0.001907615987663595, "sim_compute_performance-ego3": 0.0018552865737523788}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.979550454265096, "get_ui_image": 0.04193760390974518, "step_physics": 0.7838990431565505, "survival_time": 29.20000000000028, "driven_lanedir": 8.96740797090877, "get_state_dump": 0.00923131551498022, "get_robot_state": 0.013764103049905892, "sim_render-ego0": 0.0037137793679522654, "sim_render-ego1": 0.003702294113289597, "sim_render-ego2": 0.003594290089403462, "sim_render-ego3": 0.003544295139801808, "get_duckie_state": 1.266267564561632e-06, "in-drivable-lane": 0.7500000000000107, "deviation-heading": 9.78002175394646, "agent_compute-ego0": 0.04165216511131352, "agent_compute-ego1": 0.041147699111547226, "agent_compute-ego2": 0.04070554472442366, "agent_compute-ego3": 0.04079278921469664, "complete-iteration": 1.0723753868005217, "set_robot_commands": 0.002117350162603916, "deviation-center-line": 1.7976789934549702, "driven_lanedir_consec": 8.96740797090877, "sim_compute_sim_state": 0.028365179208608773, "sim_compute_performance-ego0": 0.001933144300411909, "sim_compute_performance-ego1": 0.0019333607111221703, "sim_compute_performance-ego2": 0.001907615987663595, "sim_compute_performance-ego3": 0.0018552865737523788}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 26.311725510771037, "get_ui_image": 0.04912224558370497, "step_physics": 1.0924424775732646, "survival_time": 59.99999999999873, "driven_lanedir": 24.089306355082748, "get_state_dump": 0.009233291897547432, "get_robot_state": 0.01398577320883415, "sim_render-ego0": 0.0037049365778152, "sim_render-ego1": 0.003699229420670661, "sim_render-ego2": 0.003589860803380199, "sim_render-ego3": 0.003622035202039072, "get_duckie_state": 1.2915497715526774e-06, "in-drivable-lane": 1.5499999999999865, "deviation-heading": 17.721278748058012, "agent_compute-ego0": 0.04246204520740874, "agent_compute-ego1": 0.04188891354448888, "agent_compute-ego2": 0.03791983081935149, "agent_compute-ego3": 0.04134693491171044, "complete-iteration": 1.381252694785049, "set_robot_commands": 0.002183248558012671, "deviation-center-line": 4.2552463622407295, "driven_lanedir_consec": 24.089306355082748, "sim_compute_sim_state": 0.021374031665620956, "sim_compute_performance-ego0": 0.001949722224925579, "sim_compute_performance-ego1": 0.001927170328653226, "sim_compute_performance-ego2": 0.0019408137871760511, "sim_compute_performance-ego3": 0.0019289297823306423}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.061326823971363, "get_ui_image": 0.04912224558370497, "step_physics": 1.0924424775732646, "survival_time": 59.99999999999873, "driven_lanedir": 0.50185939514488, "get_state_dump": 0.009233291897547432, "get_robot_state": 0.01398577320883415, "sim_render-ego0": 0.0037049365778152, "sim_render-ego1": 0.003699229420670661, "sim_render-ego2": 0.003589860803380199, "sim_render-ego3": 0.003622035202039072, "get_duckie_state": 1.2915497715526774e-06, "in-drivable-lane": 0.999999999999998, "deviation-heading": 31.427282747970928, "agent_compute-ego0": 0.04246204520740874, "agent_compute-ego1": 0.04188891354448888, "agent_compute-ego2": 0.03791983081935149, "agent_compute-ego3": 0.04134693491171044, "complete-iteration": 1.381252694785049, "set_robot_commands": 0.002183248558012671, "deviation-center-line": 9.423398002733885, "driven_lanedir_consec": 0.50185939514488, "sim_compute_sim_state": 0.021374031665620956, "sim_compute_performance-ego0": 0.001949722224925579, "sim_compute_performance-ego1": 0.001927170328653226, "sim_compute_performance-ego2": 0.0019408137871760511, "sim_compute_performance-ego3": 0.0019289297823306423}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.1675814359507672, "get_ui_image": 0.04912224558370497, "step_physics": 1.0924424775732646, "survival_time": 59.99999999999873, "driven_lanedir": 0.5229546754025345, "get_state_dump": 0.009233291897547432, "get_robot_state": 0.01398577320883415, "sim_render-ego0": 0.0037049365778152, "sim_render-ego1": 0.003699229420670661, "sim_render-ego2": 0.003589860803380199, "sim_render-ego3": 0.003622035202039072, "get_duckie_state": 1.2915497715526774e-06, "in-drivable-lane": 58.19999999999872, "deviation-heading": 0.9957826734970936, "agent_compute-ego0": 0.04246204520740874, "agent_compute-ego1": 0.04188891354448888, "agent_compute-ego2": 0.03791983081935149, "agent_compute-ego3": 0.04134693491171044, "complete-iteration": 1.381252694785049, "set_robot_commands": 0.002183248558012671, "deviation-center-line": 0.14515834577784628, "driven_lanedir_consec": 0.5229546754025345, "sim_compute_sim_state": 0.021374031665620956, "sim_compute_performance-ego0": 0.001949722224925579, "sim_compute_performance-ego1": 0.001927170328653226, "sim_compute_performance-ego2": 0.0019408137871760511, "sim_compute_performance-ego3": 0.0019289297823306423}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 13.67475968711498, "get_ui_image": 0.04912224558370497, "step_physics": 1.0924424775732646, "survival_time": 59.99999999999873, "driven_lanedir": 12.519447490800314, "get_state_dump": 0.009233291897547432, "get_robot_state": 0.01398577320883415, "sim_render-ego0": 0.0037049365778152, "sim_render-ego1": 0.003699229420670661, "sim_render-ego2": 0.003589860803380199, "sim_render-ego3": 0.003622035202039072, "get_duckie_state": 1.2915497715526774e-06, "in-drivable-lane": 0.5000000000000071, "deviation-heading": 19.36832529479091, "agent_compute-ego0": 0.04246204520740874, "agent_compute-ego1": 0.04188891354448888, "agent_compute-ego2": 0.03791983081935149, "agent_compute-ego3": 0.04134693491171044, "complete-iteration": 1.381252694785049, "set_robot_commands": 0.002183248558012671, "deviation-center-line": 4.237938149740452, "driven_lanedir_consec": 12.519447490800314, "sim_compute_sim_state": 0.021374031665620956, "sim_compute_performance-ego0": 0.001949722224925579, "sim_compute_performance-ego1": 0.001927170328653226, "sim_compute_performance-ego2": 0.0019408137871760511, "sim_compute_performance-ego3": 0.0019289297823306423}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 24.32510302792597, "get_ui_image": 0.04569963134397178, "step_physics": 0.8918901756343794, "survival_time": 59.99999999999873, "driven_lanedir": 22.01361642447356, "get_state_dump": 0.009395892772944545, "get_robot_state": 0.013972089054384, "sim_render-ego0": 0.003708231359794674, "sim_render-ego1": 0.0036917846466877576, "sim_render-ego2": 0.0036371192963891583, "sim_render-ego3": 0.003626624313024161, "get_duckie_state": 1.5297698339355876e-06, "in-drivable-lane": 1.7000000000000242, "deviation-heading": 17.825260775653064, "agent_compute-ego0": 0.04235946606041291, "agent_compute-ego1": 0.04216203681634527, "agent_compute-ego2": 0.04175064744401435, "agent_compute-ego3": 0.04131218178087627, "complete-iteration": 1.202309395054, "set_robot_commands": 0.0021302273231779507, "deviation-center-line": 4.189117731489474, "driven_lanedir_consec": 22.01361642447356, "sim_compute_sim_state": 0.042497590816983774, "sim_compute_performance-ego0": 0.001976711565409969, "sim_compute_performance-ego1": 0.0019233010392899715, "sim_compute_performance-ego2": 0.0019184304315978343, "sim_compute_performance-ego3": 0.0018922544141097629}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 23.353791474190412, "get_ui_image": 0.04569963134397178, "step_physics": 0.8918901756343794, "survival_time": 59.99999999999873, "driven_lanedir": 21.176065608560457, "get_state_dump": 0.009395892772944545, "get_robot_state": 0.013972089054384, "sim_render-ego0": 0.003708231359794674, "sim_render-ego1": 0.0036917846466877576, "sim_render-ego2": 0.0036371192963891583, "sim_render-ego3": 0.003626624313024161, "get_duckie_state": 1.5297698339355876e-06, "in-drivable-lane": 1.600000000000005, "deviation-heading": 17.66796142092357, "agent_compute-ego0": 0.04235946606041291, "agent_compute-ego1": 0.04216203681634527, "agent_compute-ego2": 0.04175064744401435, "agent_compute-ego3": 0.04131218178087627, "complete-iteration": 1.202309395054, "set_robot_commands": 0.0021302273231779507, "deviation-center-line": 3.797568310876324, "driven_lanedir_consec": 21.176065608560457, "sim_compute_sim_state": 0.042497590816983774, "sim_compute_performance-ego0": 0.001976711565409969, "sim_compute_performance-ego1": 0.0019233010392899715, "sim_compute_performance-ego2": 0.0019184304315978343, "sim_compute_performance-ego3": 0.0018922544141097629}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 26.22513788370986, "get_ui_image": 0.04569963134397178, "step_physics": 0.8918901756343794, "survival_time": 59.99999999999873, "driven_lanedir": 24.117743914804574, "get_state_dump": 0.009395892772944545, "get_robot_state": 0.013972089054384, "sim_render-ego0": 0.003708231359794674, "sim_render-ego1": 0.0036917846466877576, "sim_render-ego2": 0.0036371192963891583, "sim_render-ego3": 0.003626624313024161, "get_duckie_state": 1.5297698339355876e-06, "in-drivable-lane": 1.3499999999999233, "deviation-heading": 17.666510945221937, "agent_compute-ego0": 0.04235946606041291, "agent_compute-ego1": 0.04216203681634527, "agent_compute-ego2": 0.04175064744401435, "agent_compute-ego3": 0.04131218178087627, "complete-iteration": 1.202309395054, "set_robot_commands": 0.0021302273231779507, "deviation-center-line": 3.857193072083194, "driven_lanedir_consec": 24.117743914804574, "sim_compute_sim_state": 0.042497590816983774, "sim_compute_performance-ego0": 0.001976711565409969, "sim_compute_performance-ego1": 0.0019233010392899715, "sim_compute_performance-ego2": 0.0019184304315978343, "sim_compute_performance-ego3": 0.0018922544141097629}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 23.710562724644547, "get_ui_image": 0.04569963134397178, "step_physics": 0.8918901756343794, "survival_time": 59.99999999999873, "driven_lanedir": 21.677183447618265, "get_state_dump": 0.009395892772944545, "get_robot_state": 0.013972089054384, "sim_render-ego0": 0.003708231359794674, "sim_render-ego1": 0.0036917846466877576, "sim_render-ego2": 0.0036371192963891583, "sim_render-ego3": 0.003626624313024161, "get_duckie_state": 1.5297698339355876e-06, "in-drivable-lane": 1.500000000000021, "deviation-heading": 16.403694857939204, "agent_compute-ego0": 0.04235946606041291, "agent_compute-ego1": 0.04216203681634527, "agent_compute-ego2": 0.04175064744401435, "agent_compute-ego3": 0.04131218178087627, "complete-iteration": 1.202309395054, "set_robot_commands": 0.0021302273231779507, "deviation-center-line": 4.313956620106799, "driven_lanedir_consec": 21.677183447618265, "sim_compute_sim_state": 0.042497590816983774, "sim_compute_performance-ego0": 0.001976711565409969, "sim_compute_performance-ego1": 0.0019233010392899715, "sim_compute_performance-ego2": 0.0019184304315978343, "sim_compute_performance-ego3": 0.0018922544141097629}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.510184849412266, "get_ui_image": 0.029333934925570345, "step_physics": 0.25733976375938644, "survival_time": 20.15000000000015, "driven_lanedir": 7.967184778340263, "get_state_dump": 0.006030135815686519, "get_robot_state": 0.006898240287705223, "sim_render-ego0": 0.00353915797601832, "sim_render-ego1": 0.0035313668817576797, "get_duckie_state": 1.271762470207592e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.345360641251901, "agent_compute-ego0": 0.04078462277308549, "agent_compute-ego1": 0.04110422169808114, "complete-iteration": 0.4062972629424369, "set_robot_commands": 0.0020578639342053104, "deviation-center-line": 1.253390735388035, "driven_lanedir_consec": 7.967184778340263, "sim_compute_sim_state": 0.0097839885418958, "sim_compute_performance-ego0": 0.0018365052666994605, "sim_compute_performance-ego1": 0.001866979764239623}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 8.258614008492678, "get_ui_image": 0.029333934925570345, "step_physics": 0.25733976375938644, "survival_time": 20.15000000000015, "driven_lanedir": 7.6084814153627, "get_state_dump": 0.006030135815686519, "get_robot_state": 0.006898240287705223, "sim_render-ego0": 0.00353915797601832, "sim_render-ego1": 0.0035313668817576797, "get_duckie_state": 1.271762470207592e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 6.408875107116424, "agent_compute-ego0": 0.04078462277308549, "agent_compute-ego1": 0.04110422169808114, "complete-iteration": 0.4062972629424369, "set_robot_commands": 0.0020578639342053104, "deviation-center-line": 1.3520723505921086, "driven_lanedir_consec": 7.6084814153627, "sim_compute_sim_state": 0.0097839885418958, "sim_compute_performance-ego0": 0.0018365052666994605, "sim_compute_performance-ego1": 0.001866979764239623}}
set_robot_commands_max0.002183248558012671
set_robot_commands_mean0.0021313594316849124
set_robot_commands_median0.0021302273231779507
set_robot_commands_min0.0020578639342053104
sim_compute_performance-ego0_max0.001976711565409969
sim_compute_performance-ego0_mean0.0019365230640277671
sim_compute_performance-ego0_median0.001949722224925579
sim_compute_performance-ego0_min0.0018365052666994605
sim_compute_performance-ego1_max0.0019333607111221703
sim_compute_performance-ego1_mean0.0019192348460529089
sim_compute_performance-ego1_median0.001927170328653226
sim_compute_performance-ego1_min0.001866979764239623
sim_compute_performance-ego2_max0.0019408137871760511
sim_compute_performance-ego2_mean0.0019222867354791596
sim_compute_performance-ego2_median0.0019184304315978343
sim_compute_performance-ego2_min0.001907615987663595
sim_compute_performance-ego3_max0.0019289297823306423
sim_compute_performance-ego3_mean0.0018921569233975944
sim_compute_performance-ego3_median0.0018922544141097629
sim_compute_performance-ego3_min0.0018552865737523788
sim_compute_sim_state_max0.042497590816983774
sim_compute_sim_state_mean0.027751084560617544
sim_compute_sim_state_median0.028365179208608773
sim_compute_sim_state_min0.0097839885418958
sim_render-ego0_max0.0037137793679522654
sim_render-ego0_mean0.003684721798163228
sim_render-ego0_median0.003708231359794674
sim_render-ego0_min0.00353915797601832
sim_render-ego1_max0.003702294113289597
sim_render-ego1_mean0.0036739976061505295
sim_render-ego1_median0.003699229420670661
sim_render-ego1_min0.0035313668817576797
sim_render-ego2_max0.0036371192963891583
sim_render-ego2_mean0.0036070900630576063
sim_render-ego2_median0.003594290089403462
sim_render-ego2_min0.003589860803380199
sim_render-ego3_max0.003626624313024161
sim_render-ego3_mean0.003597651551621679
sim_render-ego3_median0.003622035202039072
sim_render-ego3_min0.003544295139801808
simulation-passed1
step_physics_max1.0924424775732646
step_physics_mean0.8276861652125395
step_physics_median0.8918901756343794
step_physics_min0.25733976375938644
survival_time_max59.99999999999873
survival_time_mean45.507142857142235
survival_time_min20.15000000000015
No reset possible