Duckietown Challenges Home Challenges Submissions

Submission 13268

Submission13268
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 60501
Next
User label101-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
60501LFVmultibodyv-simsuccessyes1:36:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median14.728373742682214
survival_time_median52.09999999999918
deviation-center-line_median3.889103748404394
in-drivable-lane_median0.4000000000000017


other stats
agent_compute-ego0_max0.018345114392702228
agent_compute-ego0_mean0.017839674348242563
agent_compute-ego0_median0.018138718547866785
agent_compute-ego0_min0.017112212578836588
agent_compute-ego1_max0.022167394599946315
agent_compute-ego1_mean0.01946740842169481
agent_compute-ego1_median0.019845290721463356
agent_compute-ego1_min0.01691387622292471
agent_compute-ego2_max0.017673933734306188
agent_compute-ego2_mean0.017371238899773548
agent_compute-ego2_median0.01737760811400928
agent_compute-ego2_min0.017062174851005165
agent_compute-ego3_max0.017220133647235805
agent_compute-ego3_mean0.01713308285048927
agent_compute-ego3_median0.01711283228427086
agent_compute-ego3_min0.01706628261996116
complete-iteration_max1.278016427562198
complete-iteration_mean1.053990440897141
complete-iteration_median1.151304473884894
complete-iteration_min0.3789508945640476
deviation-center-line_max4.817809376189137
deviation-center-line_mean3.034001667110522
deviation-center-line_min1.2341231701067854
deviation-heading_max19.147584244434963
deviation-heading_mean12.960656975021902
deviation-heading_median16.547947574239583
deviation-heading_min5.493801111175268
driven_any_max25.588312965408253
driven_any_mean15.973474633446568
driven_any_median16.350092733837474
driven_any_min5.521920516807052
driven_lanedir_consec_max23.57890707404141
driven_lanedir_consec_mean14.624602234209018
driven_lanedir_consec_min5.187602752233657
driven_lanedir_max23.57890707404141
driven_lanedir_mean14.624602234209018
driven_lanedir_median14.728373742682214
driven_lanedir_min5.187602752233657
get_duckie_state_max1.467435584278726e-06
get_duckie_state_mean1.3498349257401426e-06
get_duckie_state_median1.365332294711106e-06
get_duckie_state_min1.2581551863614573e-06
get_robot_state_max0.014257114396107188
get_robot_state_mean0.013022176154432267
get_robot_state_median0.013969922809006214
get_robot_state_min0.00705228135046831
get_state_dump_max0.009552903020510964
get_state_dump_mean0.008987374961047888
get_state_dump_median0.009488957105494805
get_state_dump_min0.006196605748143689
get_ui_image_max0.04941652993799285
get_ui_image_mean0.04398265509637288
get_ui_image_median0.046806295348841585
get_ui_image_min0.029907649961011164
in-drivable-lane_max1.7999999999999696
in-drivable-lane_mean0.6214285714285671
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.591056420966913, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 5.2613138910289745, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.15000000000000213, "deviation-heading": 5.8595278295708155, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.4668651072645158, "driven_lanedir_consec": 5.2613138910289745, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 8.450702724571348, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 7.484390788365532, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 6.64407466807961, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.264899901269214, "driven_lanedir_consec": 7.484390788365532, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.716088477182167, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 7.197702770954985, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 5.493801111175268, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.2341231701067854, "driven_lanedir_consec": 7.197702770954985, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.521920516807052, "get_ui_image": 0.04276264256996502, "step_physics": 0.875736258298659, "survival_time": 20.80000000000016, "driven_lanedir": 5.187602752233657, "get_state_dump": 0.009488957105494805, "get_robot_state": 0.013969922809006214, "sim_render-ego0": 0.003752962290811882, "sim_render-ego1": 0.0037292988180256574, "sim_render-ego2": 0.003697272970807924, "sim_render-ego3": 0.0036924645769224464, "get_duckie_state": 1.365332294711106e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.944675739980351, "agent_compute-ego0": 0.018138718547866785, "agent_compute-ego1": 0.019845290721463356, "agent_compute-ego2": 0.01737760811400928, "agent_compute-ego3": 0.01706628261996116, "complete-iteration": 1.0701701944108777, "set_robot_commands": 0.0022483340841974856, "deviation-center-line": 1.5271642790660924, "driven_lanedir_consec": 5.187602752233657, "sim_compute_sim_state": 0.02381440318173928, "sim_compute_performance-ego0": 0.0019636897446154403, "sim_compute_performance-ego1": 0.0019853475282518127, "sim_compute_performance-ego2": 0.001930451793350476, "sim_compute_performance-ego3": 0.0019318216996227237}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 21.252554970124827, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 18.900473509045693, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.6499999999999728, "deviation-heading": 17.352022327556995, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 3.6938982603085417, "driven_lanedir_consec": 18.900473509045693, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 19.92207404242967, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 17.606256131898004, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.7999999999999696, "deviation-heading": 16.33637798813747, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.084309236500247, "driven_lanedir_consec": 17.606256131898004, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 16.401302578943803, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 15.06703412194712, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 0.25, "deviation-heading": 16.950347109159644, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.817809376189137, "driven_lanedir_consec": 15.06703412194712, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 16.298882888731146, "get_ui_image": 0.04941652993799285, "step_physics": 1.0641739105561092, "survival_time": 52.09999999999918, "driven_lanedir": 14.389713363417307, "get_state_dump": 0.009315649363589995, "get_robot_state": 0.01382443866016538, "sim_render-ego0": 0.003667901826384883, "sim_render-ego1": 0.003628237021163692, "sim_render-ego2": 0.003618311447699484, "sim_render-ego3": 0.003613224879892995, "get_duckie_state": 1.2581551863614573e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 16.759517160341694, "agent_compute-ego0": 0.017112212578836588, "agent_compute-ego1": 0.017666306043059805, "agent_compute-ego2": 0.017062174851005165, "agent_compute-ego3": 0.01711283228427086, "complete-iteration": 1.278016427562198, "set_robot_commands": 0.0022463981394342586, "deviation-center-line": 4.29506407301795, "driven_lanedir_consec": 14.389713363417307, "sim_compute_sim_state": 0.04125399580395005, "sim_compute_performance-ego0": 0.0019114550099505448, "sim_compute_performance-ego1": 0.0018954656496715451, "sim_compute_performance-ego2": 0.0018768315118659832, "sim_compute_performance-ego3": 0.0018877219605194413}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 25.373408333865015, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.31052654277693, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.6999999999999993, "deviation-heading": 19.147584244434963, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.172232118677275, "driven_lanedir_consec": 23.31052654277693, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 25.07124937142427, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.461871225022108, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.54457326940323, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.098403925040743, "driven_lanedir_consec": 23.461871225022108, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 25.091320628083725, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.447291387041563, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.484393867360673, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.170333627041465, "driven_lanedir_consec": 23.447291387041563, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 25.588312965408253, "get_ui_image": 0.046806295348841585, "step_physics": 0.9274656994952252, "survival_time": 59.99999999999873, "driven_lanedir": 23.57890707404141, "get_state_dump": 0.009552903020510964, "get_robot_state": 0.014257114396107188, "sim_render-ego0": 0.0038115287402785887, "sim_render-ego1": 0.003749083519776, "sim_render-ego2": 0.0037637832857587753, "sim_render-ego3": 0.003764105081359711, "get_duckie_state": 1.467435584278726e-06, "in-drivable-lane": 1.1499999999999986, "deviation-heading": 18.0034691340668, "agent_compute-ego0": 0.018345114392702228, "agent_compute-ego1": 0.022167394599946315, "agent_compute-ego2": 0.017673933734306188, "agent_compute-ego3": 0.017220133647235805, "complete-iteration": 1.151304473884894, "set_robot_commands": 0.002275738489816429, "deviation-center-line": 4.099824531713598, "driven_lanedir_consec": 23.57890707404141, "sim_compute_sim_state": 0.04527041139848822, "sim_compute_performance-ego0": 0.0020554228488054997, "sim_compute_performance-ego1": 0.001990849330562239, "sim_compute_performance-ego2": 0.0020103690824738946, "sim_compute_performance-ego3": 0.00203830197292204}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.866533053074615, "get_ui_image": 0.029907649961011164, "step_physics": 0.27500617778164216, "survival_time": 26.050000000000235, "driven_lanedir": 9.97920754303314, "get_state_dump": 0.006196605748143689, "get_robot_state": 0.00705228135046831, "sim_render-ego0": 0.00375429880573375, "sim_render-ego1": 0.0037049498137843103, "get_duckie_state": 1.2669983494784183e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 7.750639373900587, "agent_compute-ego0": 0.017685629398886727, "agent_compute-ego1": 0.01691387622292471, "complete-iteration": 0.3789508945640476, "set_robot_commands": 0.0022610193011404454, "deviation-center-line": 1.60922791312662, "driven_lanedir_consec": 9.97920754303314, "sim_compute_sim_state": 0.01016929003470702, "sim_compute_performance-ego0": 0.001969510111315497, "sim_compute_performance-ego1": 0.0019428318944470636}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.483237896639128, "get_ui_image": 0.029907649961011164, "step_physics": 0.27500617778164216, "survival_time": 26.050000000000235, "driven_lanedir": 9.87214017811982, "get_state_dump": 0.006196605748143689, "get_robot_state": 0.00705228135046831, "sim_render-ego0": 0.00375429880573375, "sim_render-ego1": 0.0037049498137843103, "get_duckie_state": 1.2669983494784183e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.178193827138519, "agent_compute-ego0": 0.017685629398886727, "agent_compute-ego1": 0.01691387622292471, "complete-iteration": 0.3789508945640476, "set_robot_commands": 0.0022610193011404454, "deviation-center-line": 1.9418678202251176, "driven_lanedir_consec": 9.87214017811982, "sim_compute_sim_state": 0.01016929003470702, "sim_compute_performance-ego0": 0.001969510111315497, "sim_compute_performance-ego1": 0.0019428318944470636}}
set_robot_commands_max0.002275738489816429
set_robot_commands_mean0.0022574229611481136
set_robot_commands_median0.0022483340841974856
set_robot_commands_min0.0022463981394342586
sim_compute_performance-ego0_max0.0020554228488054997
sim_compute_performance-ego0_mean0.001975806474008352
sim_compute_performance-ego0_median0.0019636897446154403
sim_compute_performance-ego0_min0.0019114550099505448
sim_compute_performance-ego1_max0.001990849330562239
sim_compute_performance-ego1_mean0.0019551652730597515
sim_compute_performance-ego1_median0.0019853475282518127
sim_compute_performance-ego1_min0.0018954656496715451
sim_compute_performance-ego2_max0.0020103690824738946
sim_compute_performance-ego2_mean0.001939217462563451
sim_compute_performance-ego2_median0.001930451793350476
sim_compute_performance-ego2_min0.0018768315118659832
sim_compute_performance-ego3_max0.00203830197292204
sim_compute_performance-ego3_mean0.001952615211021402
sim_compute_performance-ego3_median0.0019318216996227237
sim_compute_performance-ego3_min0.0018877219605194413
sim_compute_sim_state_max0.04527041139848822
sim_compute_sim_state_mean0.032978130114723156
sim_compute_sim_state_median0.04125399580395005
sim_compute_sim_state_min0.01016929003470702
sim_render-ego0_max0.0038115287402785887
sim_render-ego0_mean0.003745583502954923
sim_render-ego0_median0.003752962290811882
sim_render-ego0_min0.003667901826384883
sim_render-ego1_max0.003749083519776
sim_render-ego1_mean0.003702598361673573
sim_render-ego1_median0.0037292988180256574
sim_render-ego1_min0.003628237021163692
sim_render-ego2_max0.0037637832857587753
sim_render-ego2_mean0.003693122568088729
sim_render-ego2_median0.003697272970807924
sim_render-ego2_min0.003618311447699484
sim_render-ego3_max0.003764105081359711
sim_render-ego3_mean0.003689931512725052
sim_render-ego3_median0.0036924645769224464
sim_render-ego3_min0.003613224879892995
simulation-passed1
step_physics_max1.0641739105561092
step_physics_mean0.8585368449259472
step_physics_median0.9274656994952252
step_physics_min0.27500617778164216
survival_time_max59.99999999999873
survival_time_mean41.69285714285663
survival_time_min20.80000000000016
No reset possible