Duckietown Challenges Home Challenges Submissions

Submission 13250

Submission13250
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61701
Next
User label202-1
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
61701LFVmultibodyv-simsuccessyes1:04:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.398907506434838
survival_time_median20.10000000000015
deviation-center-line_median1.5671049462018256
in-drivable-lane_median0.3749999999999989


other stats
agent_compute-ego0_max0.016065363903122253
agent_compute-ego0_mean0.015131835613164096
agent_compute-ego0_median0.014788037037273728
agent_compute-ego0_min0.014675845579237264
agent_compute-ego1_max0.015377384591772854
agent_compute-ego1_mean0.01483929354034117
agent_compute-ego1_median0.014802680122053652
agent_compute-ego1_min0.01445580680205562
agent_compute-ego2_max0.01587479181557774
agent_compute-ego2_mean0.014662307235029782
agent_compute-ego2_median0.01416067982429902
agent_compute-ego2_min0.013951450065212584
agent_compute-ego3_max0.01572377231705141
agent_compute-ego3_mean0.014866943691021137
agent_compute-ego3_median0.014586005381600842
agent_compute-ego3_min0.014291053374411156
complete-iteration_max1.2962204825926018
complete-iteration_mean0.9549186178212572
complete-iteration_median0.9852972207319528
complete-iteration_min0.3282095077302721
deviation-center-line_max4.182413368754524
deviation-center-line_mean2.1251365937942155
deviation-center-line_min0.357887996188914
deviation-heading_max9.627892435906524
deviation-heading_mean4.752917934745189
deviation-heading_median3.3060076887908445
deviation-heading_min1.89705676504107
driven_any_max28.39892337331051
driven_any_mean12.184313875550597
driven_any_median9.642692966448996
driven_any_min0.5132501693561905
driven_lanedir_consec_max26.72308232966128
driven_lanedir_consec_mean11.5414023255884
driven_lanedir_consec_min0.4933655047332506
driven_lanedir_max26.72308232966128
driven_lanedir_mean11.5414023255884
driven_lanedir_median9.398907506434838
driven_lanedir_min0.4933655047332506
get_duckie_state_max1.3050784068892758e-06
get_duckie_state_mean1.255119829910073e-06
get_duckie_state_median1.261970780473466e-06
get_duckie_state_min1.209576924641927e-06
get_robot_state_max0.01419495291499249
get_robot_state_mean0.012880892391256707
get_robot_state_median0.0139153174417005
get_robot_state_min0.006883590486314562
get_state_dump_max0.009271806502437975
get_state_dump_mean0.008716585330697023
get_state_dump_median0.00923153502458736
get_state_dump_min0.005874186091952853
get_ui_image_max0.04989568296685276
get_ui_image_mean0.044025812680681016
get_ui_image_median0.046877230930884216
get_ui_image_min0.02929230584038629
in-drivable-lane_max4.64999999999986
in-drivable-lane_mean1.1535714285714025
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 9.493517613916708, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.166617178482266, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.5500000000000007, "deviation-heading": 2.7405524093202556, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.3686085467289304, "driven_lanedir_consec": 9.166617178482266, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.2388008766824794, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 2.9194499038438773, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.5865430672266743, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2369476251878697, "driven_lanedir_consec": 2.9194499038438773, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.4634410727910163, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 3.4141966865801687, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.104748324979441, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 2.2194255506254925, "driven_lanedir_consec": 3.4141966865801687, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.791868318981283, "get_ui_image": 0.04267127756445343, "step_physics": 0.7221098076321055, "survival_time": 20.10000000000015, "driven_lanedir": 9.652664810782866, "get_state_dump": 0.009067614084437825, "get_robot_state": 0.013531057769548212, "sim_render-ego0": 0.0035805672629003783, "sim_render-ego1": 0.0036493164138226, "sim_render-ego2": 0.003564079109551593, "sim_render-ego3": 0.0035327599007201845, "get_duckie_state": 1.221081755001551e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.6764542927150776, "agent_compute-ego0": 0.014675845579237264, "agent_compute-ego1": 0.014802680122053652, "agent_compute-ego2": 0.01416067982429902, "agent_compute-ego3": 0.014291053374411156, "complete-iteration": 0.8965927051847093, "set_robot_commands": 0.002174518836047454, "deviation-center-line": 1.2187613539963786, "driven_lanedir_consec": 9.652664810782866, "sim_compute_sim_state": 0.02051482011307558, "sim_compute_performance-ego0": 0.0018698678123152289, "sim_compute_performance-ego1": 0.0018620035488611415, "sim_compute_performance-ego2": 0.0018850011801897148, "sim_compute_performance-ego3": 0.0018717160000102989}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.2744148606514525, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.993356391273899, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.4499999999999989, "deviation-heading": 2.1886548795496132, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.7609525839948686, "driven_lanedir_consec": 4.993356391273899, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.2683724535747025, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 4.057498553336585, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.29999999999999893, "deviation-heading": 1.89705676504107, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.764810998767303, "driven_lanedir_consec": 4.057498553336585, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.5132501693561905, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.4933655047332506, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.008341826230814, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 0.357887996188914, "driven_lanedir_consec": 0.4933655047332506, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6407977537520776, "get_ui_image": 0.04989568296685276, "step_physics": 1.1047662874780984, "survival_time": 12.40000000000004, "driven_lanedir": 0.624954549718247, "get_state_dump": 0.009271806502437975, "get_robot_state": 0.01419495291499249, "sim_render-ego0": 0.0037735169192394578, "sim_render-ego1": 0.0037148400961634622, "sim_render-ego2": 0.003774793272516335, "sim_render-ego3": 0.003750002527811441, "get_duckie_state": 1.3050784068892758e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.990371604431699, "agent_compute-ego0": 0.016065363903122253, "agent_compute-ego1": 0.015377384591772854, "agent_compute-ego2": 0.01587479181557774, "agent_compute-ego3": 0.01572377231705141, "complete-iteration": 1.2962204825926018, "set_robot_commands": 0.002293376080003608, "deviation-center-line": 1.6061171092454496, "driven_lanedir_consec": 0.624954549718247, "sim_compute_sim_state": 0.022657280466163977, "sim_compute_performance-ego0": 0.002017482696288082, "sim_compute_performance-ego1": 0.0019899573192060233, "sim_compute_performance-ego2": 0.0019690214869487717, "sim_compute_performance-ego3": 0.002012623361794345}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 28.39892337331051, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.697153056659246, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.299999999999915, "deviation-heading": 9.233645184143096, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 3.9585946498045086, "driven_lanedir_consec": 26.697153056659246, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 28.11139009415567, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 25.914074013200757, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 4.64999999999986, "deviation-heading": 8.922783796519258, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.044790066759096, "driven_lanedir_consec": 25.914074013200757, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.35762199606153, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.662441724477063, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 3.2999999999999297, "deviation-heading": 8.95418148482855, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.182413368754524, "driven_lanedir_consec": 26.662441724477063, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 28.32396059392905, "get_ui_image": 0.046877230930884216, "step_physics": 0.7833969350857699, "survival_time": 59.99999999999873, "driven_lanedir": 26.72308232966128, "get_state_dump": 0.00923153502458736, "get_robot_state": 0.0139153174417005, "sim_render-ego0": 0.003631874087648924, "sim_render-ego1": 0.003591234737589993, "sim_render-ego2": 0.0035221713667209697, "sim_render-ego3": 0.0035266612193467317, "get_duckie_state": 1.261970780473466e-06, "in-drivable-lane": 2.899999999999934, "deviation-heading": 9.627892435906524, "agent_compute-ego0": 0.014788037037273728, "agent_compute-ego1": 0.01445580680205562, "agent_compute-ego2": 0.013951450065212584, "agent_compute-ego3": 0.014586005381600842, "complete-iteration": 0.9852972207319528, "set_robot_commands": 0.002206440075152522, "deviation-center-line": 4.086355625157938, "driven_lanedir_consec": 26.72308232966128, "sim_compute_sim_state": 0.043414650114251614, "sim_compute_performance-ego0": 0.001929421905276182, "sim_compute_performance-ego1": 0.0018679643054488897, "sim_compute_performance-ego2": 0.0018572579017785268, "sim_compute_performance-ego3": 0.0018609687748002968}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.829211963265012, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 10.629580021100676, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.507267052602248, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.5280927831582016, "driven_lanedir_consec": 10.629580021100676, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.87482311728065, "get_ui_image": 0.02929230584038629, "step_physics": 0.23146332422892252, "survival_time": 22.450000000000184, "driven_lanedir": 9.63119783438741, "get_state_dump": 0.005874186091952853, "get_robot_state": 0.006883590486314562, "sim_render-ego0": 0.003619694179958767, "sim_render-ego1": 0.0035496679941813152, "get_duckie_state": 1.209576924641927e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.102357962938321, "agent_compute-ego0": 0.014864356252882216, "agent_compute-ego1": 0.014603311750623914, "complete-iteration": 0.3282095077302721, "set_robot_commands": 0.002174705399407281, "deviation-center-line": 1.4181540547495373, "driven_lanedir_consec": 9.63119783438741, "sim_compute_sim_state": 0.009862181345621744, "sim_compute_performance-ego0": 0.0018813716040717232, "sim_compute_performance-ego1": 0.0018753894170125325}}
set_robot_commands_max0.002293376080003608
set_robot_commands_mean0.002217625054544921
set_robot_commands_median0.002206440075152522
set_robot_commands_min0.002174518836047454
sim_compute_performance-ego0_max0.002017482696288082
sim_compute_performance-ego0_mean0.0019307023474043864
sim_compute_performance-ego0_median0.001929421905276182
sim_compute_performance-ego0_min0.0018698678123152289
sim_compute_performance-ego1_max0.0019899573192060233
sim_compute_performance-ego1_mean0.001902177109149234
sim_compute_performance-ego1_median0.0018679643054488897
sim_compute_performance-ego1_min0.0018620035488611415
sim_compute_performance-ego2_max0.0019690214869487717
sim_compute_performance-ego2_mean0.0019037601896390048
sim_compute_performance-ego2_median0.0018850011801897148
sim_compute_performance-ego2_min0.0018572579017785268
sim_compute_performance-ego3_max0.002012623361794345
sim_compute_performance-ego3_mean0.0019151027122016472
sim_compute_performance-ego3_median0.0018717160000102989
sim_compute_performance-ego3_min0.0018609687748002968
sim_compute_sim_state_max0.043414650114251614
sim_compute_sim_state_mean0.026147954676086296
sim_compute_sim_state_median0.022657280466163977
sim_compute_sim_state_min0.009862181345621744
sim_render-ego0_max0.0037735169192394578
sim_render-ego0_mean0.003655944388505184
sim_render-ego0_median0.003631874087648924
sim_render-ego0_min0.0035805672629003783
sim_render-ego1_max0.0037148400961634622
sim_render-ego1_mean0.0036372072127619183
sim_render-ego1_median0.0036493164138226
sim_render-ego1_min0.0035496679941813152
sim_render-ego2_max0.003774793272516335
sim_render-ego2_mean0.003620347916262966
sim_render-ego2_median0.003564079109551593
sim_render-ego2_min0.0035221713667209697
sim_render-ego3_max0.003750002527811441
sim_render-ego3_mean0.003603141215959451
sim_render-ego3_median0.0035327599007201845
sim_render-ego3_min0.0035266612193467317
simulation-passed1
step_physics_max1.1047662874780984
step_physics_mean0.7788584835172674
step_physics_median0.7833969350857699
step_physics_min0.23146332422892252
survival_time_max59.99999999999873
survival_time_mean29.635714285714005
survival_time_min12.40000000000004
No reset possible