Duckietown Challenges Home Challenges Submissions

Job 56896

Job ID56896
submission11427
userFrank (Chude) Qian 🇨🇦
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:13:18
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6184385091944629
survival_time_median59.99999999999873
deviation-center-line_median0.9814855520696704
in-drivable-lane_median50.77499999999882


other stats
agent_compute-ego0_max0.012642220196180002
agent_compute-ego0_mean0.011723648371673214
agent_compute-ego0_median0.011647864444170469
agent_compute-ego0_min0.011106186961254212
agent_compute-ego1_max0.01195404869035122
agent_compute-ego1_mean0.011452566589032391
agent_compute-ego1_median0.01138167635388021
agent_compute-ego1_min0.011058904447722296
agent_compute-ego2_max0.011937164247879675
agent_compute-ego2_mean0.011489374254466497
agent_compute-ego2_median0.011377477328247274
agent_compute-ego2_min0.011153481187272527
agent_compute-ego3_max0.011896620384362415
agent_compute-ego3_mean0.011616109445165864
agent_compute-ego3_median0.011608868812541978
agent_compute-ego3_min0.011342839138593203
complete-iteration_max1.3312145579764487
complete-iteration_mean1.131714276046862
complete-iteration_median1.3035080289959808
complete-iteration_min0.3759689432298214
deviation-center-line_max2.326440618638218
deviation-center-line_mean0.9774060585255132
deviation-center-line_min0.0915531009056297
deviation-heading_max19.55610613862144
deviation-heading_mean8.799197565135149
deviation-heading_median9.474324201143736
deviation-heading_min0.8824603763757757
driven_any_max12.441040374007104
driven_any_mean6.3230756989117625
driven_any_median4.760281015827156
driven_any_min0.2306001790305386
driven_lanedir_consec_max2.009035600045479
driven_lanedir_consec_mean0.7758228890573335
driven_lanedir_consec_min0.15075968617439028
driven_lanedir_max2.192905397687366
driven_lanedir_mean0.8461482369476971
driven_lanedir_median0.6798127360411651
driven_lanedir_min0.15075968617439028
get_duckie_state_max2.1938082578279496e-06
get_duckie_state_mean1.9364171523294625e-06
get_duckie_state_median1.910127866873634e-06
get_duckie_state_min1.707442297129508e-06
get_robot_state_max0.01410949934928443
get_robot_state_mean0.012958205723232192
get_robot_state_median0.013899262203562766
get_robot_state_min0.006996407099905657
get_state_dump_max0.009533545059725009
get_state_dump_mean0.008944556249993102
get_state_dump_median0.009391963928565693
get_state_dump_min0.006045560455639892
get_ui_image_max0.050744766994479495
get_ui_image_mean0.045007854661094145
get_ui_image_median0.0479134788719641
get_ui_image_min0.030327651026246943
in-drivable-lane_max58.49999999999873
in-drivable-lane_mean49.24999999999886
in-drivable-lane_min34.899999999999295
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 4.094733772546505, "get_ui_image": 0.04370541993426244, "step_physics": 0.9745562360447512, "survival_time": 59.99999999999873, "driven_lanedir": 0.5587967973725194, "get_state_dump": 0.009391963928565693, "get_robot_state": 0.013846754928512638, "sim_render-ego0": 0.003660832316948909, "sim_render-ego1": 0.003611598185555921, "sim_render-ego2": 0.0035950698820776386, "sim_render-ego3": 0.0035915398577865613, "get_duckie_state": 1.8198027598867805e-06, "in-drivable-lane": 54.599999999998715, "deviation-heading": 4.480407714635813, "agent_compute-ego0": 0.011106186961254212, "agent_compute-ego1": 0.01138167635388021, "agent_compute-ego2": 0.011153481187272527, "agent_compute-ego3": 0.011342839138593203, "complete-iteration": 1.138292907576676, "set_robot_commands": 0.002130532244857801, "deviation-center-line": 0.3955185913654762, "driven_lanedir_consec": 0.5443164995008047, "sim_compute_sim_state": 0.02093737885715761, "sim_compute_performance-ego0": 0.001910010742009629, "sim_compute_performance-ego1": 0.0019167585237933435, "sim_compute_performance-ego2": 0.0019016381008837445, "sim_compute_performance-ego3": 0.0018610767678952436}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.695125043190129, "get_ui_image": 0.04370541993426244, "step_physics": 0.9745562360447512, "survival_time": 59.99999999999873, "driven_lanedir": 0.5380023744915894, "get_state_dump": 0.009391963928565693, "get_robot_state": 0.013846754928512638, "sim_render-ego0": 0.003660832316948909, "sim_render-ego1": 0.003611598185555921, "sim_render-ego2": 0.0035950698820776386, "sim_render-ego3": 0.0035915398577865613, "get_duckie_state": 1.8198027598867805e-06, "in-drivable-lane": 56.249999999998735, "deviation-heading": 1.934088220648512, "agent_compute-ego0": 0.011106186961254212, "agent_compute-ego1": 0.01138167635388021, "agent_compute-ego2": 0.011153481187272527, "agent_compute-ego3": 0.011342839138593203, "complete-iteration": 1.138292907576676, "set_robot_commands": 0.002130532244857801, "deviation-center-line": 0.31750000785357557, "driven_lanedir_consec": 0.5380023744915894, "sim_compute_sim_state": 0.02093737885715761, "sim_compute_performance-ego0": 0.001910010742009629, "sim_compute_performance-ego1": 0.0019167585237933435, "sim_compute_performance-ego2": 0.0019016381008837445, "sim_compute_performance-ego3": 0.0018610767678952436}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.12984140404438, "get_ui_image": 0.04370541993426244, "step_physics": 0.9745562360447512, "survival_time": 59.99999999999873, "driven_lanedir": 2.192905397687366, "get_state_dump": 0.009391963928565693, "get_robot_state": 0.013846754928512638, "sim_render-ego0": 0.003660832316948909, "sim_render-ego1": 0.003611598185555921, "sim_render-ego2": 0.0035950698820776386, "sim_render-ego3": 0.0035915398577865613, "get_duckie_state": 1.8198027598867805e-06, "in-drivable-lane": 37.69999999999919, "deviation-heading": 18.588716572569588, "agent_compute-ego0": 0.011106186961254212, "agent_compute-ego1": 0.01138167635388021, "agent_compute-ego2": 0.011153481187272527, "agent_compute-ego3": 0.011342839138593203, "complete-iteration": 1.138292907576676, "set_robot_commands": 0.002130532244857801, "deviation-center-line": 1.7872548260339651, "driven_lanedir_consec": 2.009035600045479, "sim_compute_sim_state": 0.02093737885715761, "sim_compute_performance-ego0": 0.001910010742009629, "sim_compute_performance-ego1": 0.0019167585237933435, "sim_compute_performance-ego2": 0.0019016381008837445, "sim_compute_performance-ego3": 0.0018610767678952436}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.032792130490962, "get_ui_image": 0.04370541993426244, "step_physics": 0.9745562360447512, "survival_time": 59.99999999999873, "driven_lanedir": 0.9993963829339608, "get_state_dump": 0.009391963928565693, "get_robot_state": 0.013846754928512638, "sim_render-ego0": 0.003660832316948909, "sim_render-ego1": 0.003611598185555921, "sim_render-ego2": 0.0035950698820776386, "sim_render-ego3": 0.0035915398577865613, "get_duckie_state": 1.8198027598867805e-06, "in-drivable-lane": 34.899999999999295, "deviation-heading": 19.55610613862144, "agent_compute-ego0": 0.011106186961254212, "agent_compute-ego1": 0.01138167635388021, "agent_compute-ego2": 0.011153481187272527, "agent_compute-ego3": 0.011342839138593203, "complete-iteration": 1.138292907576676, "set_robot_commands": 0.002130532244857801, "deviation-center-line": 2.326440618638218, "driven_lanedir_consec": 0.9993963829339608, "sim_compute_sim_state": 0.02093737885715761, "sim_compute_performance-ego0": 0.001910010742009629, "sim_compute_performance-ego1": 0.0019167585237933435, "sim_compute_performance-ego2": 0.0019016381008837445, "sim_compute_performance-ego3": 0.0018610767678952436}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 3.535466558960387, "get_ui_image": 0.050744766994479495, "step_physics": 1.1357525500727137, "survival_time": 59.99999999999873, "driven_lanedir": 1.0982330143448369, "get_state_dump": 0.009533545059725009, "get_robot_state": 0.01410949934928443, "sim_render-ego0": 0.0038837483284574663, "sim_render-ego1": 0.003668608216818525, "sim_render-ego2": 0.003638678248180736, "sim_render-ego3": 0.003637724772381048, "get_duckie_state": 2.1938082578279496e-06, "in-drivable-lane": 52.89999999999869, "deviation-heading": 3.63669506439854, "agent_compute-ego0": 0.012642220196180002, "agent_compute-ego1": 0.01195404869035122, "agent_compute-ego2": 0.011937164247879675, "agent_compute-ego3": 0.011896620384362415, "complete-iteration": 1.3312145579764487, "set_robot_commands": 0.0021294042728624177, "deviation-center-line": 0.5817780013987771, "driven_lanedir_consec": 1.0982330143448369, "sim_compute_sim_state": 0.04132883594395417, "sim_compute_performance-ego0": 0.0019639388012151534, "sim_compute_performance-ego1": 0.0019373502659857224, "sim_compute_performance-ego2": 0.001887163849893359, "sim_compute_performance-ego3": 0.0018791249153715288}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.892703966329302, "get_ui_image": 0.050744766994479495, "step_physics": 1.1357525500727137, "survival_time": 59.99999999999873, "driven_lanedir": 0.6926144931833382, "get_state_dump": 0.009533545059725009, "get_robot_state": 0.01410949934928443, "sim_render-ego0": 0.0038837483284574663, "sim_render-ego1": 0.003668608216818525, "sim_render-ego2": 0.003638678248180736, "sim_render-ego3": 0.003637724772381048, "get_duckie_state": 2.1938082578279496e-06, "in-drivable-lane": 49.29999999999888, "deviation-heading": 11.099008421338796, "agent_compute-ego0": 0.012642220196180002, "agent_compute-ego1": 0.01195404869035122, "agent_compute-ego2": 0.011937164247879675, "agent_compute-ego3": 0.011896620384362415, "complete-iteration": 1.3312145579764487, "set_robot_commands": 0.0021294042728624177, "deviation-center-line": 1.3783609587228374, "driven_lanedir_consec": 0.692560518888121, "sim_compute_sim_state": 0.04132883594395417, "sim_compute_performance-ego0": 0.0019639388012151534, "sim_compute_performance-ego1": 0.0019373502659857224, "sim_compute_performance-ego2": 0.001887163849893359, "sim_compute_performance-ego3": 0.0018791249153715288}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.416145521310252, "get_ui_image": 0.050744766994479495, "step_physics": 1.1357525500727137, "survival_time": 59.99999999999873, "driven_lanedir": 2.1123162529681494, "get_state_dump": 0.009533545059725009, "get_robot_state": 0.01410949934928443, "sim_render-ego0": 0.0038837483284574663, "sim_render-ego1": 0.003668608216818525, "sim_render-ego2": 0.003638678248180736, "sim_render-ego3": 0.003637724772381048, "get_duckie_state": 2.1938082578279496e-06, "in-drivable-lane": 41.19999999999921, "deviation-heading": 15.38088459610387, "agent_compute-ego0": 0.012642220196180002, "agent_compute-ego1": 0.01195404869035122, "agent_compute-ego2": 0.011937164247879675, "agent_compute-ego3": 0.011896620384362415, "complete-iteration": 1.3312145579764487, "set_robot_commands": 0.0021294042728624177, "deviation-center-line": 1.6339098938063004, "driven_lanedir_consec": 1.6286312530628604, "sim_compute_sim_state": 0.04132883594395417, "sim_compute_performance-ego0": 0.0019639388012151534, "sim_compute_performance-ego1": 0.0019373502659857224, "sim_compute_performance-ego2": 0.001887163849893359, "sim_compute_performance-ego3": 0.0018791249153715288}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 4.48776990116335, "get_ui_image": 0.050744766994479495, "step_physics": 1.1357525500727137, "survival_time": 59.99999999999873, "driven_lanedir": 0.667010978898992, "get_state_dump": 0.009533545059725009, "get_robot_state": 0.01410949934928443, "sim_render-ego0": 0.0038837483284574663, "sim_render-ego1": 0.003668608216818525, "sim_render-ego2": 0.003638678248180736, "sim_render-ego3": 0.003637724772381048, "get_duckie_state": 2.1938082578279496e-06, "in-drivable-lane": 45.19999999999867, "deviation-heading": 11.624045896805397, "agent_compute-ego0": 0.012642220196180002, "agent_compute-ego1": 0.01195404869035122, "agent_compute-ego2": 0.011937164247879675, "agent_compute-ego3": 0.011896620384362415, "complete-iteration": 1.3312145579764487, "set_robot_commands": 0.0021294042728624177, "deviation-center-line": 1.2401992006601434, "driven_lanedir_consec": 0.4060590407685305, "sim_compute_sim_state": 0.04132883594395417, "sim_compute_performance-ego0": 0.0019639388012151534, "sim_compute_performance-ego1": 0.0019373502659857224, "sim_compute_performance-ego2": 0.001887163849893359, "sim_compute_performance-ego3": 0.0018791249153715288}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 6.9141519159348785, "get_ui_image": 0.0479134788719641, "step_physics": 1.1347030938217582, "survival_time": 59.99999999999873, "driven_lanedir": 0.3877396369293829, "get_state_dump": 0.00935765765886521, "get_robot_state": 0.013899262203562766, "sim_render-ego0": 0.0037461415020055714, "sim_render-ego1": 0.003586560264415884, "sim_render-ego2": 0.003678708945980278, "sim_render-ego3": 0.003606899096308699, "get_duckie_state": 1.910127866873634e-06, "in-drivable-lane": 56.14999999999871, "deviation-heading": 3.3693295690891687, "agent_compute-ego0": 0.011647864444170469, "agent_compute-ego1": 0.011058904447722296, "agent_compute-ego2": 0.011377477328247274, "agent_compute-ego3": 0.011608868812541978, "complete-iteration": 1.3035080289959808, "set_robot_commands": 0.002120708248001848, "deviation-center-line": 0.3211793287862603, "driven_lanedir_consec": 0.3659887902972043, "sim_compute_sim_state": 0.020838303927279433, "sim_compute_performance-ego0": 0.0018894908628694024, "sim_compute_performance-ego1": 0.0018960129311440092, "sim_compute_performance-ego2": 0.0019200316674504848, "sim_compute_performance-ego3": 0.001900612563515186}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.644398402231757, "get_ui_image": 0.0479134788719641, "step_physics": 1.1347030938217582, "survival_time": 59.99999999999873, "driven_lanedir": 0.37348956732773586, "get_state_dump": 0.00935765765886521, "get_robot_state": 0.013899262203562766, "sim_render-ego0": 0.0037461415020055714, "sim_render-ego1": 0.003586560264415884, "sim_render-ego2": 0.003678708945980278, "sim_render-ego3": 0.003606899096308699, "get_duckie_state": 1.910127866873634e-06, "in-drivable-lane": 56.749999999998735, "deviation-heading": 2.0311444548677917, "agent_compute-ego0": 0.011647864444170469, "agent_compute-ego1": 0.011058904447722296, "agent_compute-ego2": 0.011377477328247274, "agent_compute-ego3": 0.011608868812541978, "complete-iteration": 1.3035080289959808, "set_robot_commands": 0.002120708248001848, "deviation-center-line": 0.20132942039341195, "driven_lanedir_consec": 0.37348956732773586, "sim_compute_sim_state": 0.020838303927279433, "sim_compute_performance-ego0": 0.0018894908628694024, "sim_compute_performance-ego1": 0.0018960129311440092, "sim_compute_performance-ego2": 0.0019200316674504848, "sim_compute_performance-ego3": 0.001900612563515186}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.2306001790305386, "get_ui_image": 0.0479134788719641, "step_physics": 1.1347030938217582, "survival_time": 59.99999999999873, "driven_lanedir": 0.15075968617439028, "get_state_dump": 0.00935765765886521, "get_robot_state": 0.013899262203562766, "sim_render-ego0": 0.0037461415020055714, "sim_render-ego1": 0.003586560264415884, "sim_render-ego2": 0.003678708945980278, "sim_render-ego3": 0.003606899096308699, "get_duckie_state": 1.910127866873634e-06, "in-drivable-lane": 58.49999999999873, "deviation-heading": 0.8824603763757757, "agent_compute-ego0": 0.011647864444170469, "agent_compute-ego1": 0.011058904447722296, "agent_compute-ego2": 0.011377477328247274, "agent_compute-ego3": 0.011608868812541978, "complete-iteration": 1.3035080289959808, "set_robot_commands": 0.002120708248001848, "deviation-center-line": 0.0915531009056297, "driven_lanedir_consec": 0.15075968617439028, "sim_compute_sim_state": 0.020838303927279433, "sim_compute_performance-ego0": 0.0018894908628694024, "sim_compute_performance-ego1": 0.0018960129311440092, "sim_compute_performance-ego2": 0.0019200316674504848, "sim_compute_performance-ego3": 0.001900612563515186}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.9963646527171512, "get_ui_image": 0.0479134788719641, "step_physics": 1.1347030938217582, "survival_time": 59.99999999999873, "driven_lanedir": 0.47582236356440993, "get_state_dump": 0.00935765765886521, "get_robot_state": 0.013899262203562766, "sim_render-ego0": 0.0037461415020055714, "sim_render-ego1": 0.003586560264415884, "sim_render-ego2": 0.003678708945980278, "sim_render-ego3": 0.003606899096308699, "get_duckie_state": 1.910127866873634e-06, "in-drivable-lane": 44.499999999998906, "deviation-heading": 11.657230484149933, "agent_compute-ego0": 0.011647864444170469, "agent_compute-ego1": 0.011058904447722296, "agent_compute-ego2": 0.011377477328247274, "agent_compute-ego3": 0.011608868812541978, "complete-iteration": 1.3035080289959808, "set_robot_commands": 0.002120708248001848, "deviation-center-line": 1.4456897666532469, "driven_lanedir_consec": 0.47582236356440993, "sim_compute_sim_state": 0.020838303927279433, "sim_compute_performance-ego0": 0.0018894908628694024, "sim_compute_performance-ego1": 0.0018960129311440092, "sim_compute_performance-ego2": 0.0019200316674504848, "sim_compute_performance-ego3": 0.001900612563515186}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 12.441040374007104, "get_ui_image": 0.030327651026246943, "step_physics": 0.28454065164062603, "survival_time": 59.99999999999873, "driven_lanedir": 0.8888277430470055, "get_state_dump": 0.006045560455639892, "get_robot_state": 0.006996407099905657, "sim_render-ego0": 0.0036868991502417214, "sim_render-ego1": 0.0036282406361474286, "get_duckie_state": 1.707442297129508e-06, "in-drivable-lane": 49.849999999998815, "deviation-heading": 10.565895535567568, "agent_compute-ego0": 0.01127299539850316, "agent_compute-ego1": 0.011378707139319323, "complete-iteration": 0.3759689432298214, "set_robot_commands": 0.002160858849899457, "deviation-center-line": 1.0643787181477151, "driven_lanedir_consec": 0.8857815216077791, "sim_compute_sim_state": 0.0099085373842746, "sim_compute_performance-ego0": 0.00188650517142087, "sim_compute_performance-ego1": 0.0018748921418964217}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 11.011925962807988, "get_ui_image": 0.030327651026246943, "step_physics": 0.28454065164062603, "survival_time": 59.99999999999873, "driven_lanedir": 0.7101606283440818, "get_state_dump": 0.006045560455639892, "get_robot_state": 0.006996407099905657, "sim_render-ego0": 0.0036868991502417214, "sim_render-ego1": 0.0036282406361474286, "get_duckie_state": 1.707442297129508e-06, "in-drivable-lane": 51.69999999999882, "deviation-heading": 8.382752866719908, "agent_compute-ego0": 0.01127299539850316, "agent_compute-ego1": 0.011378707139319323, "complete-iteration": 0.3759689432298214, "set_robot_commands": 0.002160858849899457, "deviation-center-line": 0.8985923859916253, "driven_lanedir_consec": 0.6934438337949669, "sim_compute_sim_state": 0.0099085373842746, "sim_compute_performance-ego0": 0.00188650517142087, "sim_compute_performance-ego1": 0.0018748921418964217}}
set_robot_commands_max0.002160858849899457
set_robot_commands_mean0.002131735483049084
set_robot_commands_median0.0021294042728624177
set_robot_commands_min0.002120708248001848
sim_compute_performance-ego0_max0.0019639388012151534
sim_compute_performance-ego0_mean0.0019161979976584625
sim_compute_performance-ego0_median0.001910010742009629
sim_compute_performance-ego0_min0.00188650517142087
sim_compute_performance-ego1_max0.0019373502659857224
sim_compute_performance-ego1_mean0.0019107336548203672
sim_compute_performance-ego1_median0.0019167585237933435
sim_compute_performance-ego1_min0.0018748921418964217
sim_compute_performance-ego2_max0.0019200316674504848
sim_compute_performance-ego2_mean0.0019029445394091963
sim_compute_performance-ego2_median0.0019016381008837445
sim_compute_performance-ego2_min0.001887163849893359
sim_compute_performance-ego3_max0.001900612563515186
sim_compute_performance-ego3_mean0.001880271415593986
sim_compute_performance-ego3_median0.0018791249153715288
sim_compute_performance-ego3_min0.0018610767678952436
sim_compute_sim_state_max0.04132883594395417
sim_compute_sim_state_mean0.02515965354872243
sim_compute_sim_state_median0.02093737885715761
sim_compute_sim_state_min0.0099085373842746
sim_render-ego0_max0.0038837483284574663
sim_render-ego0_mean0.0037526204921522303
sim_render-ego0_median0.0037461415020055714
sim_render-ego0_min0.003660832316948909
sim_render-ego1_max0.003668608216818525
sim_render-ego1_mean0.003623110567104011
sim_render-ego1_median0.003611598185555921
sim_render-ego1_min0.003586560264415884
sim_render-ego2_max0.003678708945980278
sim_render-ego2_mean0.0036374856920795505
sim_render-ego2_median0.003638678248180736
sim_render-ego2_min0.0035950698820776386
sim_render-ego3_max0.003637724772381048
sim_render-ego3_mean0.003612054575492104
sim_render-ego3_median0.003606899096308699
sim_render-ego3_min0.0035915398577865613
simulation-passed1
step_physics_max1.1357525500727137
step_physics_mean0.967794915931296
step_physics_median1.1347030938217582
step_physics_min0.28454065164062603
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873

Highlights

56896

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.