Duckietown Challenges Home Challenges Submissions

Submission 13268

Submission13268
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60501
Next
User label101-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

Show only up-to-date jobs
Job IDstepstatusup to datedate starteddate completeddurationmessage
60501LFVmultibodyv-simsuccessyes1:36:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.728373742682214
survival_time_median52.09999999999918
deviation-center-line_median3.889103748404394
in-drivable-lane_median0.4000000000000017


other stats
agent_compute-ego0_max0.018345114392702228
agent_compute-ego0_mean0.017839674348242563
agent_compute-ego0_median0.018138718547866785
agent_compute-ego0_min0.017112212578836588
agent_compute-ego1_max0.022167394599946315
agent_compute-ego1_mean0.01946740842169481
agent_compute-ego1_median0.019845290721463356
agent_compute-ego1_min0.01691387622292471
agent_compute-ego2_max0.017673933734306188
agent_compute-ego2_mean0.017371238899773548
agent_compute-ego2_median0.01737760811400928
agent_compute-ego2_min0.017062174851005165
agent_compute-ego3_max0.017220133647235805
agent_compute-ego3_mean0.01713308285048927
agent_compute-ego3_median0.01711283228427086
agent_compute-ego3_min0.01706628261996116
complete-iteration_max1.278016427562198
complete-iteration_mean1.053990440897141
complete-iteration_median1.151304473884894
complete-iteration_min0.3789508945640476
deviation-center-line_max4.817809376189137
deviation-center-line_mean3.034001667110522
deviation-center-line_min1.2341231701067854
deviation-heading_max19.147584244434963
deviation-heading_mean12.960656975021902
deviation-heading_median16.547947574239583
deviation-heading_min5.493801111175268
driven_any_max25.588312965408253
driven_any_mean15.973474633446568
driven_any_median16.350092733837474
driven_any_min5.521920516807052
driven_lanedir_consec_max23.57890707404141
driven_lanedir_consec_mean14.624602234209018
driven_lanedir_consec_min5.187602752233657
driven_lanedir_max23.57890707404141
driven_lanedir_mean14.624602234209018
driven_lanedir_median14.728373742682214
driven_lanedir_min5.187602752233657
get_duckie_state_max1.467435584278726e-06
get_duckie_state_mean1.3498349257401426e-06
get_duckie_state_median1.365332294711106e-06
get_duckie_state_min1.2581551863614573e-06
get_robot_state_max0.014257114396107188
get_robot_state_mean0.013022176154432267
get_robot_state_median0.013969922809006214
get_robot_state_min0.00705228135046831
get_state_dump_max0.009552903020510964
get_state_dump_mean0.008987374961047888
get_state_dump_median0.009488957105494805
get_state_dump_min0.006196605748143689
get_ui_image_max0.04941652993799285
get_ui_image_mean0.04398265509637288
get_ui_image_median0.046806295348841585
get_ui_image_min0.029907649961011164
in-drivable-lane_max1.7999999999999696
in-drivable-lane_mean0.6214285714285671
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.591056420966913, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 5.2613138910289745, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.15000000000000213, "deviation-heading": 5.8595278295708155, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.4668651072645158, "driven_lanedir_consec": 5.2613138910289745, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 8.450702724571348, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 7.484390788365532, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 6.64407466807961, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.264899901269214, "driven_lanedir_consec": 7.484390788365532, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.716088477182167, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 7.197702770954985, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 5.493801111175268, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.2341231701067854, "driven_lanedir_consec": 7.197702770954985, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.521920516807052, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 5.187602752233657, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.944675739980351, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.5271642790660924, "driven_lanedir_consec": 5.187602752233657, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 21.252554970124827, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 18.900473509045693, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.6499999999999728, "deviation-heading": 17.352022327556995, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 3.6938982603085417, "driven_lanedir_consec": 18.900473509045693, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 19.92207404242967, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 17.606256131898004, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.7999999999999696, "deviation-heading": 16.33637798813747, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.084309236500247, "driven_lanedir_consec": 17.606256131898004, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 16.401302578943803, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 15.06703412194712, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 0.25, "deviation-heading": 16.950347109159644, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.817809376189137, "driven_lanedir_consec": 15.06703412194712, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 16.298882888731146, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 14.389713363417307, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 16.759517160341694, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.29506407301795, "driven_lanedir_consec": 14.389713363417307, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 25.373408333865015, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.31052654277693, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.6999999999999993, "deviation-heading": 19.147584244434963, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.172232118677275, "driven_lanedir_consec": 23.31052654277693, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 25.07124937142427, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.461871225022108, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.54457326940323, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.098403925040743, "driven_lanedir_consec": 23.461871225022108, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 25.091320628083725, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.447291387041563, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.484393867360673, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.170333627041465, "driven_lanedir_consec": 23.447291387041563, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 25.588312965408253, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.57890707404141, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 1.1499999999999986, "deviation-heading": 18.0034691340668, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.099824531713598, "driven_lanedir_consec": 23.57890707404141, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.866533053074615, "get_ui_image": 0.029907649961011164, "step_physics": 0.27500617778164216, "survival_time": 26.050000000000235, "driven_lanedir": 9.97920754303314, "get_state_dump": 0.006196605748143689, "get_robot_state": 0.00705228135046831, "sim_render-ego0": 0.00375429880573375, "sim_render-ego1": 0.0037049498137843103, "get_duckie_state": 1.2669983494784183e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 7.750639373900587, "agent_compute-ego0": 0.017685629398886727, "agent_compute-ego1": 0.01691387622292471, "complete-iteration": 0.3789508945640476, "set_robot_commands": 0.0022610193011404454, "deviation-center-line": 1.60922791312662, "driven_lanedir_consec": 9.97920754303314, "sim_compute_sim_state": 0.01016929003470702, "sim_compute_performance-ego0": 0.001969510111315497, "sim_compute_performance-ego1": 0.0019428318944470636}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.483237896639128, "get_ui_image": 0.029907649961011164, "step_physics": 0.27500617778164216, "survival_time": 26.050000000000235, "driven_lanedir": 9.87214017811982, "get_state_dump": 0.006196605748143689, "get_robot_state": 0.00705228135046831, "sim_render-ego0": 0.00375429880573375, "sim_render-ego1": 0.0037049498137843103, "get_duckie_state": 1.2669983494784183e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.178193827138519, "agent_compute-ego0": 0.017685629398886727, "agent_compute-ego1": 0.01691387622292471, "complete-iteration": 0.3789508945640476, "set_robot_commands": 0.0022610193011404454, "deviation-center-line": 1.9418678202251176, "driven_lanedir_consec": 9.87214017811982, "sim_compute_sim_state": 0.01016929003470702, "sim_compute_performance-ego0": 0.001969510111315497, "sim_compute_performance-ego1": 0.0019428318944470636}}
set_robot_commands_max0.002275738489816429
set_robot_commands_mean0.0022574229611481136
set_robot_commands_median0.0022483340841974856
set_robot_commands_min0.0022463981394342586
sim_compute_performance-ego0_max0.0020554228488054997
sim_compute_performance-ego0_mean0.001975806474008352
sim_compute_performance-ego0_median0.0019636897446154403
sim_compute_performance-ego0_min0.0019114550099505448
sim_compute_performance-ego1_max0.001990849330562239
sim_compute_performance-ego1_mean0.0019551652730597515
sim_compute_performance-ego1_median0.0019853475282518127
sim_compute_performance-ego1_min0.0018954656496715451
sim_compute_performance-ego2_max0.0020103690824738946
sim_compute_performance-ego2_mean0.001939217462563451
sim_compute_performance-ego2_median0.001930451793350476
sim_compute_performance-ego2_min0.0018768315118659832
sim_compute_performance-ego3_max0.00203830197292204
sim_compute_performance-ego3_mean0.001952615211021402
sim_compute_performance-ego3_median0.0019318216996227237
sim_compute_performance-ego3_min0.0018877219605194413
sim_compute_sim_state_max0.04527041139848822
sim_compute_sim_state_mean0.032978130114723156
sim_compute_sim_state_median0.04125399580395005
sim_compute_sim_state_min0.01016929003470702
sim_render-ego0_max0.0038115287402785887
sim_render-ego0_mean0.003745583502954923
sim_render-ego0_median0.003752962290811882
sim_render-ego0_min0.003667901826384883
sim_render-ego1_max0.003749083519776
sim_render-ego1_mean0.003702598361673573
sim_render-ego1_median0.0037292988180256574
sim_render-ego1_min0.003628237021163692
sim_render-ego2_max0.0037637832857587753
sim_render-ego2_mean0.003693122568088729
sim_render-ego2_median0.003697272970807924
sim_render-ego2_min0.003618311447699484
sim_render-ego3_max0.003764105081359711
sim_render-ego3_mean0.003689931512725052
sim_render-ego3_median0.0036924645769224464
sim_render-ego3_min0.003613224879892995
simulation-passed1
step_physics_max1.0641739105561092
step_physics_mean0.8585368449259472
step_physics_median0.9274656994952252
step_physics_min0.27500617778164216
survival_time_max59.99999999999873
survival_time_mean41.69285714285663
survival_time_min20.80000000000016
No reset possible