Duckietown Challenges Home Challenges Submissions

Job 60448

Job ID60448
submission13176
userAnastasiya Nikolskaya 🇷🇺
user labelJetBrains Research0 real2sim v0.1.0 --REAL
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration1:40:00
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.897214926494886
survival_time_median59.99999999999873
deviation-center-line_median2.8750987374354904
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.017380014645070656
agent_compute-ego0_mean0.01571897294181323
agent_compute-ego0_median0.015057896875007387
agent_compute-ego0_min0.014947503532200037
agent_compute-ego1_max0.01728461088487052
agent_compute-ego1_mean0.01547950193761708
agent_compute-ego1_median0.014799648677181145
agent_compute-ego1_min0.014677460600690143
agent_compute-ego2_max0.017099683429676726
agent_compute-ego2_mean0.01546837657932366
agent_compute-ego2_median0.014694817706978638
agent_compute-ego2_min0.014610628601315616
agent_compute-ego3_max0.018498614666166154
agent_compute-ego3_mean0.016136010486192
agent_compute-ego3_median0.014970619811503516
agent_compute-ego3_min0.01493879698090634
complete-iteration_max1.1533168490804713
complete-iteration_mean0.8781003727324509
complete-iteration_median0.9539490228489376
complete-iteration_min0.3019088778950423
deviation-center-line_max6.172977588516417
deviation-center-line_mean2.792254971822974
deviation-center-line_min0.3321049905324278
deviation-heading_max14.979368030783276
deviation-heading_mean9.090361697671725
deviation-heading_median9.48366636367884
deviation-heading_min0.9152715811826528
driven_any_max20.461710587319416
driven_any_mean14.063113803215575
driven_any_median15.528279741799276
driven_any_min3.2602755108792025
driven_lanedir_consec_max20.052090985581465
driven_lanedir_consec_mean13.204512484360247
driven_lanedir_consec_min2.3950557945728033
driven_lanedir_max20.052090985581465
driven_lanedir_mean13.53092121370394
driven_lanedir_median15.13006929781901
driven_lanedir_min2.3950557945728033
get_duckie_state_max1.2770580510910503e-06
get_duckie_state_mean1.2301013716223004e-06
get_duckie_state_median1.2411620945965115e-06
get_duckie_state_min1.1823655762938435e-06
get_robot_state_max0.013790008230879
get_robot_state_mean0.012748966275846488
get_robot_state_median0.013701069265678463
get_robot_state_min0.007011460094917111
get_state_dump_max0.009195668810511709
get_state_dump_mean0.008720065960789707
get_state_dump_median0.009177284177197306
get_state_dump_min0.006002917258015229
get_ui_image_max0.04847871314278252
get_ui_image_mean0.04287032063722341
get_ui_image_median0.04578948973454806
get_ui_image_min0.028954642839283742
in-drivable-lane_max34.99999999999981
in-drivable-lane_mean2.864285714285685
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 20.461710587319416, "get_ui_image": 0.04130059793330946, "step_physics": 0.6357958928234472, "survival_time": 59.99999999999873, "driven_lanedir": 20.052090985581465, "get_state_dump": 0.009195668810511709, "get_robot_state": 0.013624574421446689, "sim_render-ego0": 0.0035617371383654286, "sim_render-ego1": 0.0035358517493534643, "sim_render-ego2": 0.00349984002252304, "sim_render-ego3": 0.003502017750926657, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.005170493987034, "agent_compute-ego0": 0.014947503532200037, "agent_compute-ego1": 0.014799648677181145, "agent_compute-ego2": 0.014610628601315616, "agent_compute-ego3": 0.014970619811503516, "complete-iteration": 0.8151309936866474, "set_robot_commands": 0.0020534249765489817, "deviation-center-line": 2.959830313142054, "driven_lanedir_consec": 20.052090985581465, "sim_compute_sim_state": 0.026100918216371817, "sim_compute_performance-ego0": 0.001838855401959447, "sim_compute_performance-ego1": 0.0018245260681736776, "sim_compute_performance-ego2": 0.0018294306222247044, "sim_compute_performance-ego3": 0.001818942388428141}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 13.655646457395044, "get_ui_image": 0.04130059793330946, "step_physics": 0.6357958928234472, "survival_time": 59.99999999999873, "driven_lanedir": 13.396910667027942, "get_state_dump": 0.009195668810511709, "get_robot_state": 0.013624574421446689, "sim_render-ego0": 0.0035617371383654286, "sim_render-ego1": 0.0035358517493534643, "sim_render-ego2": 0.00349984002252304, "sim_render-ego3": 0.003502017750926657, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.313332051829832, "agent_compute-ego0": 0.014947503532200037, "agent_compute-ego1": 0.014799648677181145, "agent_compute-ego2": 0.014610628601315616, "agent_compute-ego3": 0.014970619811503516, "complete-iteration": 0.8151309936866474, "set_robot_commands": 0.0020534249765489817, "deviation-center-line": 6.172977588516417, "driven_lanedir_consec": 13.396910667027942, "sim_compute_sim_state": 0.026100918216371817, "sim_compute_performance-ego0": 0.001838855401959447, "sim_compute_performance-ego1": 0.0018245260681736776, "sim_compute_performance-ego2": 0.0018294306222247044, "sim_compute_performance-ego3": 0.001818942388428141}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 19.092210953883573, "get_ui_image": 0.04130059793330946, "step_physics": 0.6357958928234472, "survival_time": 59.99999999999873, "driven_lanedir": 18.34106653214181, "get_state_dump": 0.009195668810511709, "get_robot_state": 0.013624574421446689, "sim_render-ego0": 0.0035617371383654286, "sim_render-ego1": 0.0035358517493534643, "sim_render-ego2": 0.00349984002252304, "sim_render-ego3": 0.003502017750926657, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 12.752650124933597, "agent_compute-ego0": 0.014947503532200037, "agent_compute-ego1": 0.014799648677181145, "agent_compute-ego2": 0.014610628601315616, "agent_compute-ego3": 0.014970619811503516, "complete-iteration": 0.8151309936866474, "set_robot_commands": 0.0020534249765489817, "deviation-center-line": 2.7903671617289274, "driven_lanedir_consec": 18.34106653214181, "sim_compute_sim_state": 0.026100918216371817, "sim_compute_performance-ego0": 0.001838855401959447, "sim_compute_performance-ego1": 0.0018245260681736776, "sim_compute_performance-ego2": 0.0018294306222247044, "sim_compute_performance-ego3": 0.001818942388428141}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 17.068947939980838, "get_ui_image": 0.04130059793330946, "step_physics": 0.6357958928234472, "survival_time": 59.99999999999873, "driven_lanedir": 16.7229862987855, "get_state_dump": 0.009195668810511709, "get_robot_state": 0.013624574421446689, "sim_render-ego0": 0.0035617371383654286, "sim_render-ego1": 0.0035358517493534643, "sim_render-ego2": 0.00349984002252304, "sim_render-ego3": 0.003502017750926657, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.962162233370647, "agent_compute-ego0": 0.014947503532200037, "agent_compute-ego1": 0.014799648677181145, "agent_compute-ego2": 0.014610628601315616, "agent_compute-ego3": 0.014970619811503516, "complete-iteration": 0.8151309936866474, "set_robot_commands": 0.0020534249765489817, "deviation-center-line": 2.3042379442027356, "driven_lanedir_consec": 16.7229862987855, "sim_compute_sim_state": 0.026100918216371817, "sim_compute_performance-ego0": 0.001838855401959447, "sim_compute_performance-ego1": 0.0018245260681736776, "sim_compute_performance-ego2": 0.0018294306222247044, "sim_compute_performance-ego3": 0.001818942388428141}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 20.12967704392577, "get_ui_image": 0.04847871314278252, "step_physics": 0.7348767970622727, "survival_time": 59.99999999999873, "driven_lanedir": 19.49150921926639, "get_state_dump": 0.009177284177197306, "get_robot_state": 0.013701069265678463, "sim_render-ego0": 0.0036001431753395203, "sim_render-ego1": 0.0035489651682374876, "sim_render-ego2": 0.0035456815031942577, "sim_render-ego3": 0.0035269578033243986, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.866873157498985, "agent_compute-ego0": 0.017380014645070656, "agent_compute-ego1": 0.01728461088487052, "agent_compute-ego2": 0.017099683429676726, "agent_compute-ego3": 0.018498614666166154, "complete-iteration": 0.9539490228489376, "set_robot_commands": 0.0020445935632862912, "deviation-center-line": 3.5486656583151537, "driven_lanedir_consec": 19.49150921926639, "sim_compute_sim_state": 0.04748985153947841, "sim_compute_performance-ego0": 0.0018764618135908063, "sim_compute_performance-ego1": 0.0018388214556005575, "sim_compute_performance-ego2": 0.0018307872854799751, "sim_compute_performance-ego3": 0.0018352241341418568}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 19.935143350185765, "get_ui_image": 0.04847871314278252, "step_physics": 0.7348767970622727, "survival_time": 59.99999999999873, "driven_lanedir": 19.265332514925554, "get_state_dump": 0.009177284177197306, "get_robot_state": 0.013701069265678463, "sim_render-ego0": 0.0036001431753395203, "sim_render-ego1": 0.0035489651682374876, "sim_render-ego2": 0.0035456815031942577, "sim_render-ego3": 0.0035269578033243986, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.250534862103732, "agent_compute-ego0": 0.017380014645070656, "agent_compute-ego1": 0.01728461088487052, "agent_compute-ego2": 0.017099683429676726, "agent_compute-ego3": 0.018498614666166154, "complete-iteration": 0.9539490228489376, "set_robot_commands": 0.0020445935632862912, "deviation-center-line": 3.729432263340085, "driven_lanedir_consec": 19.265332514925554, "sim_compute_sim_state": 0.04748985153947841, "sim_compute_performance-ego0": 0.0018764618135908063, "sim_compute_performance-ego1": 0.0018388214556005575, "sim_compute_performance-ego2": 0.0018307872854799751, "sim_compute_performance-ego3": 0.0018352241341418568}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 20.057930318085745, "get_ui_image": 0.04847871314278252, "step_physics": 0.7348767970622727, "survival_time": 59.99999999999873, "driven_lanedir": 18.826999766948912, "get_state_dump": 0.009177284177197306, "get_robot_state": 0.013701069265678463, "sim_render-ego0": 0.0036001431753395203, "sim_render-ego1": 0.0035489651682374876, "sim_render-ego2": 0.0035456815031942577, "sim_render-ego3": 0.0035269578033243986, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 4.249999999999758, "deviation-heading": 11.922252695730146, "agent_compute-ego0": 0.017380014645070656, "agent_compute-ego1": 0.01728461088487052, "agent_compute-ego2": 0.017099683429676726, "agent_compute-ego3": 0.018498614666166154, "complete-iteration": 0.9539490228489376, "set_robot_commands": 0.0020445935632862912, "deviation-center-line": 3.606023477922144, "driven_lanedir_consec": 14.257277556137256, "sim_compute_sim_state": 0.04748985153947841, "sim_compute_performance-ego0": 0.0018764618135908063, "sim_compute_performance-ego1": 0.0018388214556005575, "sim_compute_performance-ego2": 0.0018307872854799751, "sim_compute_performance-ego3": 0.0018352241341418568}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 18.016453625074977, "get_ui_image": 0.04847871314278252, "step_physics": 0.7348767970622727, "survival_time": 59.99999999999873, "driven_lanedir": 17.201910193331972, "get_state_dump": 0.009177284177197306, "get_robot_state": 0.013701069265678463, "sim_render-ego0": 0.0036001431753395203, "sim_render-ego1": 0.0035489651682374876, "sim_render-ego2": 0.0035456815031942577, "sim_render-ego3": 0.0035269578033243986, "get_duckie_state": 1.1823655762938435e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.979368030783276, "agent_compute-ego0": 0.017380014645070656, "agent_compute-ego1": 0.01728461088487052, "agent_compute-ego2": 0.017099683429676726, "agent_compute-ego3": 0.018498614666166154, "complete-iteration": 0.9539490228489376, "set_robot_commands": 0.0020445935632862912, "deviation-center-line": 3.240125702029492, "driven_lanedir_consec": 17.201910193331972, "sim_compute_sim_state": 0.04748985153947841, "sim_compute_performance-ego0": 0.0018764618135908063, "sim_compute_performance-ego1": 0.0018388214556005575, "sim_compute_performance-ego2": 0.0018307872854799751, "sim_compute_performance-ego3": 0.0018352241341418568}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 10.973162852021918, "get_ui_image": 0.04578948973454806, "step_physics": 0.9662966436681678, "survival_time": 41.249999999999794, "driven_lanedir": 10.620391870619004, "get_state_dump": 0.009145819246047343, "get_robot_state": 0.013790008230879, "sim_render-ego0": 0.003626879710550747, "sim_render-ego1": 0.0035995383528185237, "sim_render-ego2": 0.0035880145957337163, "sim_render-ego3": 0.003565575250990454, "get_duckie_state": 1.2411620945965115e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.32809251636993, "agent_compute-ego0": 0.015057896875007387, "agent_compute-ego1": 0.01475526691926305, "agent_compute-ego2": 0.014694817706978638, "agent_compute-ego3": 0.01493879698090634, "complete-iteration": 1.1533168490804713, "set_robot_commands": 0.002061659718252556, "deviation-center-line": 2.2010381412321376, "driven_lanedir_consec": 10.620391870619004, "sim_compute_sim_state": 0.02825906028470462, "sim_compute_performance-ego0": 0.001875965993571801, "sim_compute_performance-ego1": 0.001870400391825752, "sim_compute_performance-ego2": 0.001873369367012966, "sim_compute_performance-ego3": 0.0018680061035525712}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 5.025477181713281, "get_ui_image": 0.04578948973454806, "step_physics": 0.9662966436681678, "survival_time": 41.249999999999794, "driven_lanedir": 4.825162398558945, "get_state_dump": 0.009145819246047343, "get_robot_state": 0.013790008230879, "sim_render-ego0": 0.003626879710550747, "sim_render-ego1": 0.0035995383528185237, "sim_render-ego2": 0.0035880145957337163, "sim_render-ego3": 0.003565575250990454, "get_duckie_state": 1.2411620945965115e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.304223651407854, "agent_compute-ego0": 0.015057896875007387, "agent_compute-ego1": 0.01475526691926305, "agent_compute-ego2": 0.014694817706978638, "agent_compute-ego3": 0.01493879698090634, "complete-iteration": 1.1533168490804713, "set_robot_commands": 0.002061659718252556, "deviation-center-line": 3.730399079249432, "driven_lanedir_consec": 4.825162398558945, "sim_compute_sim_state": 0.02825906028470462, "sim_compute_performance-ego0": 0.001875965993571801, "sim_compute_performance-ego1": 0.001870400391825752, "sim_compute_performance-ego2": 0.001873369367012966, "sim_compute_performance-ego3": 0.0018680061035525712}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.2602755108792025, "get_ui_image": 0.04578948973454806, "step_physics": 0.9662966436681678, "survival_time": 41.249999999999794, "driven_lanedir": 2.3950557945728033, "get_state_dump": 0.009145819246047343, "get_robot_state": 0.013790008230879, "sim_render-ego0": 0.003626879710550747, "sim_render-ego1": 0.0035995383528185237, "sim_render-ego2": 0.0035880145957337163, "sim_render-ego3": 0.003565575250990454, "get_duckie_state": 1.2411620945965115e-06, "in-drivable-lane": 34.99999999999981, "deviation-heading": 0.9152715811826528, "agent_compute-ego0": 0.015057896875007387, "agent_compute-ego1": 0.01475526691926305, "agent_compute-ego2": 0.014694817706978638, "agent_compute-ego3": 0.01493879698090634, "complete-iteration": 1.1533168490804713, "set_robot_commands": 0.002061659718252556, "deviation-center-line": 0.3321049905324278, "driven_lanedir_consec": 2.3950557945728033, "sim_compute_sim_state": 0.02825906028470462, "sim_compute_performance-ego0": 0.001875965993571801, "sim_compute_performance-ego1": 0.001870400391825752, "sim_compute_performance-ego2": 0.001873369367012966, "sim_compute_performance-ego3": 0.0018680061035525712}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 13.987611543617714, "get_ui_image": 0.04578948973454806, "step_physics": 0.9662966436681678, "survival_time": 41.249999999999794, "driven_lanedir": 13.537152296852517, "get_state_dump": 0.009145819246047343, "get_robot_state": 0.013790008230879, "sim_render-ego0": 0.003626879710550747, "sim_render-ego1": 0.0035995383528185237, "sim_render-ego2": 0.0035880145957337163, "sim_render-ego3": 0.003565575250990454, "get_duckie_state": 1.2411620945965115e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 8.67997131053997, "agent_compute-ego0": 0.015057896875007387, "agent_compute-ego1": 0.01475526691926305, "agent_compute-ego2": 0.014694817706978638, "agent_compute-ego3": 0.01493879698090634, "complete-iteration": 1.1533168490804713, "set_robot_commands": 0.002061659718252556, "deviation-center-line": 2.2619444260375583, "driven_lanedir_consec": 13.537152296852517, "sim_compute_sim_state": 0.02825906028470462, "sim_compute_performance-ego0": 0.001875965993571801, "sim_compute_performance-ego1": 0.001870400391825752, "sim_compute_performance-ego2": 0.001873369367012966, "sim_compute_performance-ego3": 0.0018680061035525712}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.49883766836592, "get_ui_image": 0.028954642839283742, "step_physics": 0.20509838952193504, "survival_time": 22.500000000000185, "driven_lanedir": 8.318186288770931, "get_state_dump": 0.006002917258015229, "get_robot_state": 0.007011460094917111, "sim_render-ego0": 0.003588895840021036, "sim_render-ego1": 0.003518000410295643, "get_duckie_state": 1.2095381573932927e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.09281972770327, "agent_compute-ego0": 0.015261980488136444, "agent_compute-ego1": 0.014677460600690143, "complete-iteration": 0.3019088778950423, "set_robot_commands": 0.0020861958717295443, "deviation-center-line": 1.2261964759489643, "driven_lanedir_consec": 8.318186288770931, "sim_compute_sim_state": 0.009792312550174688, "sim_compute_performance-ego0": 0.001848912291939137, "sim_compute_performance-ego1": 0.001858397227961843}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 6.720508212568929, "get_ui_image": 0.028954642839283742, "step_physics": 0.20509838952193504, "survival_time": 22.500000000000185, "driven_lanedir": 6.43814216447139, "get_state_dump": 0.006002917258015229, "get_robot_state": 0.007011460094917111, "sim_render-ego0": 0.003588895840021036, "sim_render-ego1": 0.003518000410295643, "get_duckie_state": 1.2095381573932927e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.892341329963219, "agent_compute-ego0": 0.015261980488136444, "agent_compute-ego1": 0.014677460600690143, "complete-iteration": 0.3019088778950423, "set_robot_commands": 0.0020861958717295443, "deviation-center-line": 0.9882263833241054, "driven_lanedir_consec": 6.43814216447139, "sim_compute_sim_state": 0.009792312550174688, "sim_compute_performance-ego0": 0.001848912291939137, "sim_compute_performance-ego1": 0.001858397227961843}}
set_robot_commands_max0.0020861958717295443
set_robot_commands_mean0.0020579360554150287
set_robot_commands_median0.0020534249765489817
set_robot_commands_min0.0020445935632862912
sim_compute_performance-ego0_max0.0018764618135908063
sim_compute_performance-ego0_mean0.001861639815740464
sim_compute_performance-ego0_median0.001875965993571801
sim_compute_performance-ego0_min0.001838855401959447
sim_compute_performance-ego1_max0.001870400391825752
sim_compute_performance-ego1_mean0.0018465561513088312
sim_compute_performance-ego1_median0.0018388214556005575
sim_compute_performance-ego1_min0.0018245260681736776
sim_compute_performance-ego2_max0.001873369367012966
sim_compute_performance-ego2_mean0.0018445290915725485
sim_compute_performance-ego2_median0.0018307872854799751
sim_compute_performance-ego2_min0.0018294306222247044
sim_compute_performance-ego3_max0.0018680061035525712
sim_compute_performance-ego3_mean0.001840724208707523
sim_compute_performance-ego3_median0.0018352241341418568
sim_compute_performance-ego3_min0.001818942388428141
sim_compute_sim_state_max0.04748985153947841
sim_compute_sim_state_mean0.030498853233040624
sim_compute_sim_state_median0.02825906028470462
sim_compute_sim_state_min0.009792312550174688
sim_render-ego0_max0.003626879710550747
sim_render-ego0_mean0.003595202269790347
sim_render-ego0_median0.0036001431753395203
sim_render-ego0_min0.0035617371383654286
sim_render-ego1_max0.0035995383528185237
sim_render-ego1_mean0.0035552444215877993
sim_render-ego1_median0.0035489651682374876
sim_render-ego1_min0.003518000410295643
sim_render-ego2_max0.0035880145957337163
sim_render-ego2_mean0.0035445120404836703
sim_render-ego2_median0.0035456815031942577
sim_render-ego2_min0.00349984002252304
sim_render-ego3_max0.003565575250990454
sim_render-ego3_mean0.0035315169350805028
sim_render-ego3_median0.0035269578033243986
sim_render-ego3_min0.003502017750926657
simulation-passed1
step_physics_max0.9662966436681678
step_physics_mean0.6970052938042443
step_physics_median0.7348767970622727
step_physics_min0.20509838952193504
survival_time_max59.99999999999873
survival_time_mean49.28571428571352
survival_time_min22.500000000000185

Highlights

60448

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.