Duckietown Challenges Home Challenges Submissions

Job 57096

Job ID57096
submission11427
userFrank (Chude) Qian 🇨🇦
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:12:34
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.447127254731348
survival_time_median59.99999999999873
deviation-center-line_median1.6283501088755528
in-drivable-lane_median36.77499999999916


other stats
agent_compute-ego0_max0.012595364096559753
agent_compute-ego0_mean0.012198120373330788
agent_compute-ego0_median0.012232071156307225
agent_compute-ego0_min0.011608942660761316
agent_compute-ego1_max0.011943334147495394
agent_compute-ego1_mean0.011392292772757964
agent_compute-ego1_median0.011324998044054476
agent_compute-ego1_min0.01081605676211088
agent_compute-ego2_max0.012306509168817042
agent_compute-ego2_mean0.01193543688773844
agent_compute-ego2_median0.011907718858552118
agent_compute-ego2_min0.011592082635846166
agent_compute-ego3_max0.01234396431070879
agent_compute-ego3_mean0.012158103363731652
agent_compute-ego3_median0.012108079996037543
agent_compute-ego3_min0.012022265784448628
complete-iteration_max1.3024133111316891
complete-iteration_mean1.108422967473576
complete-iteration_median1.2900912866902092
complete-iteration_min0.4026164242270388
deviation-center-line_max7.589457362821848
deviation-center-line_mean2.020982816197475
deviation-center-line_min0.6591087648584802
deviation-heading_max62.58432573331654
deviation-heading_mean19.79281609856873
deviation-heading_median17.431719611896632
deviation-heading_min5.073872371908684
driven_any_max13.500328602914006
driven_any_mean4.2237979584574665
driven_any_median2.529115884668586
driven_any_min0.26894841869576286
driven_lanedir_consec_max1.7311058069939012
driven_lanedir_consec_mean0.638779191122479
driven_lanedir_consec_min0.0366082895592188
driven_lanedir_max1.7311058069939012
driven_lanedir_mean0.6843986548769291
driven_lanedir_median0.6756708876191944
driven_lanedir_min0.0366082895592188
get_duckie_state_max1.807891756767635e-06
get_duckie_state_mean1.7330225943044348e-06
get_duckie_state_median1.739204972113896e-06
get_duckie_state_min1.6699226373041995e-06
get_robot_state_max0.013772207136257405
get_robot_state_mean0.012755784521038246
get_robot_state_median0.013720172529514386
get_robot_state_min0.0069456205677728075
get_state_dump_max0.009202363389814824
get_state_dump_mean0.008698819181901232
get_state_dump_median0.009179880577360562
get_state_dump_min0.005820003973256539
get_ui_image_max0.04912376086181844
get_ui_image_mean0.04417195052982611
get_ui_image_median0.04769778092834574
get_ui_image_min0.029137404137705884
in-drivable-lane_max52.99999999999871
in-drivable-lane_mean36.41428571428481
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.848049196456282, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.7956429541975616, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 32.399999999999366, "deviation-heading": 21.515669528699373, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 2.1262894639063923, "driven_lanedir_consec": 0.327842894389599, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.3871771105467976, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.11622760525843834, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 42.04999999999868, "deviation-heading": 13.88044522197606, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 1.236583104972925, "driven_lanedir_consec": 0.11622760525843834, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.500328602914006, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.7849301601652918, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 50.69999999999875, "deviation-heading": 10.097062676648228, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 0.8660974976284533, "driven_lanedir_consec": 0.7554722941179006, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.7791275800018385, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 1.3327536407836664, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 38.24999999999888, "deviation-heading": 17.13243498544962, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 1.7994111779324422, "driven_lanedir_consec": 1.3327536407836664, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 3.420565258264358, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 0.8084583546689144, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 39.89999999999872, "deviation-heading": 16.318164544269212, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 2.1599560740955117, "driven_lanedir_consec": 0.8084583546689144, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.0754661167825017, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 0.10977549119614904, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 49.799999999998654, "deviation-heading": 7.909102863271699, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 0.6591087648584802, "driven_lanedir_consec": 0.10977549119614904, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 13.19936902546716, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 1.1983701533493627, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 48.14999999999885, "deviation-heading": 11.57034391742593, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 1.1011612795133203, "driven_lanedir_consec": 1.0569555866424172, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.052468773087889, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 1.5291366821814316, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 35.299999999999436, "deviation-heading": 17.731004238343644, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 2.59318554243184, "driven_lanedir_consec": 1.5291366821814316, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.21018257288089, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.2308060620348482, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 52.99999999999871, "deviation-heading": 5.073872371908684, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 0.8038317929067985, "driven_lanedir_consec": 0.2308060620348482, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.0968974276640795, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.11280870900213658, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 29.649999999999373, "deviation-heading": 23.96330390774377, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 1.457289039818663, "driven_lanedir_consec": 0.11280870900213658, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.26894841869576286, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.2285456438129891, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 0.0, "deviation-heading": 62.58432573331654, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 7.589457362821848, "driven_lanedir_consec": 0.2285456438129891, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.947830950099486, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 1.7311058069939012, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 31.49999999999923, "deviation-heading": 22.29768596069948, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 2.5014880337722856, "driven_lanedir_consec": 1.7311058069939012, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.3092212615569792, "get_ui_image": 0.029137404137705884, "step_physics": 0.31281785524258704, "survival_time": 59.99999999999873, "driven_lanedir": 0.5664116150730969, "get_state_dump": 0.005820003973256539, "get_robot_state": 0.0069456205677728075, "sim_render-ego0": 0.003658638111657644, "sim_render-ego1": 0.0035943478767719, "get_duckie_state": 1.697119427759582e-06, "in-drivable-lane": 28.999999999999385, "deviation-heading": 23.710580728853778, "agent_compute-ego0": 0.011608942660761316, "agent_compute-ego1": 0.01081605676211088, "complete-iteration": 0.4026164242270388, "set_robot_commands": 0.002132779255596228, "deviation-center-line": 1.006250226407748, "driven_lanedir_consec": 0.5664116150730969, "sim_compute_sim_state": 0.010108294236868449, "sim_compute_performance-ego0": 0.0018769517528524407, "sim_compute_performance-ego1": 0.0018505944896002396}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.037539123986497, "get_ui_image": 0.029137404137705884, "step_physics": 0.31281785524258704, "survival_time": 59.99999999999873, "driven_lanedir": 0.0366082895592188, "get_state_dump": 0.005820003973256539, "get_robot_state": 0.0069456205677728075, "sim_render-ego0": 0.003658638111657644, "sim_render-ego1": 0.0035943478767719, "get_duckie_state": 1.697119427759582e-06, "in-drivable-lane": 30.099999999999355, "deviation-heading": 23.31542870135616, "agent_compute-ego0": 0.011608942660761316, "agent_compute-ego1": 0.01081605676211088, "complete-iteration": 0.4026164242270388, "set_robot_commands": 0.002132779255596228, "deviation-center-line": 2.3936500656979476, "driven_lanedir_consec": 0.0366082895592188, "sim_compute_sim_state": 0.010108294236868449, "sim_compute_performance-ego0": 0.0018769517528524407, "sim_compute_performance-ego1": 0.0018505944896002396}}
set_robot_commands_max0.0021444462816681492
set_robot_commands_mean0.002110377267805989
set_robot_commands_median0.002110231329658248
set_robot_commands_min0.0020652531981964492
sim_compute_performance-ego0_max0.0018801693118283593
sim_compute_performance-ego0_mean0.001870028113615531
sim_compute_performance-ego0_median0.0018769999924150732
sim_compute_performance-ego0_min0.0018494532169847067
sim_compute_performance-ego1_max0.001855133772888946
sim_compute_performance-ego1_mean0.001845306287810651
sim_compute_performance-ego1_median0.001851125918856072
sim_compute_performance-ego1_min0.001827015070792142
sim_compute_performance-ego2_max0.0018593095720657996
sim_compute_performance-ego2_mean0.0018464482032422257
sim_compute_performance-ego2_median0.001849114348945967
sim_compute_performance-ego2_min0.0018309206887149095
sim_compute_performance-ego3_max0.0018855860390135093
sim_compute_performance-ego3_mean0.0018615964846646757
sim_compute_performance-ego3_median0.0018651193623538816
sim_compute_performance-ego3_min0.001834084052626636
sim_compute_sim_state_max0.04498387772673671
sim_compute_sim_state_mean0.033021062594808866
sim_compute_sim_state_median0.03327051527196422
sim_compute_sim_state_min0.010108294236868449
sim_render-ego0_max0.003658638111657644
sim_render-ego0_mean0.0036058068573226734
sim_render-ego0_median0.0035939500492677204
sim_render-ego0_min0.003586661507942397
sim_render-ego1_max0.0035943478767719
sim_render-ego1_mean0.00357794534781465
sim_render-ego1_median0.0035840130963988547
sim_render-ego1_min0.0035528382294183966
sim_render-ego2_max0.003725986695110947
sim_render-ego2_mean0.0036167870817202983
sim_render-ego2_median0.0035813898964785814
sim_render-ego2_min0.003542984653571365
sim_render-ego3_max0.0035591117547612502
sim_render-ego3_mean0.003549486009934992
sim_render-ego3_median0.003552900762184772
sim_render-ego3_min0.0035364455128589537
simulation-passed1
step_physics_max1.1196536724017525
step_physics_mean0.9372980403491769
step_physics_median1.09477486876425
step_physics_min0.31281785524258704
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873

Highlights

57096

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.