Duckietown Challenges Home Challenges Submissions

Job 53874

Job ID53874
submission12643
userBea Baselines 🐤
user labeltemplate-pytorch
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration2:11:36
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6484044145152017
survival_time_median59.99999999999873
deviation-center-line_median1.1793254858577928
in-drivable-lane_median48.324999999998695


other stats
agent_compute-ego0_max0.014727246453621109
agent_compute-ego0_mean0.0131232365283442
agent_compute-ego0_median0.013391270824117922
agent_compute-ego0_min0.011820346290721782
agent_compute-ego1_max0.01541045484296686
agent_compute-ego1_mean0.013884494686659863
agent_compute-ego1_median0.014465934926524548
agent_compute-ego1_min0.011765321625162422
agent_compute-ego2_max0.015588998794555664
agent_compute-ego2_mean0.01345722522465613
agent_compute-ego2_median0.013033051375643995
agent_compute-ego2_min0.01174962550376873
agent_compute-ego3_max0.014024920507235687
agent_compute-ego3_mean0.012746478926960111
agent_compute-ego3_median0.012436721048982417
agent_compute-ego3_min0.011777795224662229
complete-iteration_max1.3034764926300555
complete-iteration_mean1.107826174376083
complete-iteration_median1.2395031051175185
complete-iteration_min0.40519441831717384
deviation-center-line_max2.0795342768194507
deviation-center-line_mean1.086384093559488
deviation-center-line_min0.04961564404319747
deviation-heading_max17.605145356012954
deviation-heading_mean8.902698432888606
deviation-heading_median8.77600979089662
deviation-heading_min0.6070223847639707
driven_any_max12.460484964869122
driven_any_mean7.258227844498035
driven_any_median7.512542285309959
driven_any_min0.2198051856755729
driven_lanedir_consec_max2.0417897993978293
driven_lanedir_consec_mean0.8390134449920675
driven_lanedir_consec_min0.09546725179377248
driven_lanedir_max2.477096768971399
driven_lanedir_mean1.062737299638124
driven_lanedir_median1.0320477848855285
driven_lanedir_min0.09546725179377248
get_duckie_state_max1.427335207110936e-06
get_duckie_state_mean1.3647740812041863e-06
get_duckie_state_median1.4193945383648391e-06
get_duckie_state_min1.2750728839045262e-06
get_robot_state_max0.014028308989106368
get_robot_state_mean0.01287621630490202
get_robot_state_median0.013815735500122883
get_robot_state_min0.006927059850128961
get_state_dump_max0.00955323355084752
get_state_dump_mean0.008926711355277185
get_state_dump_median0.00934214734912018
get_state_dump_min0.0060589607311823685
get_ui_image_max0.04955957176087798
get_ui_image_mean0.04356196846365857
get_ui_image_median0.046395846945757074
get_ui_image_min0.02952784423923413
in-drivable-lane_max58.59999999999873
in-drivable-lane_mean48.9999999999989
in-drivable-lane_min38.249999999999275
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 3.780126772892805, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 0.7330266869612989, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 52.24999999999869, "deviation-heading": 6.583779327607867, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 0.5601560198859746, "driven_lanedir_consec": 0.6476781171082246, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 12.460484964869122, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 1.123418892040022, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 47.499999999998984, "deviation-heading": 12.99868397653156, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.281640241505811, "driven_lanedir_consec": 0.3990990629682371, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 5.614864027361239, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 0.9658211472014951, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 46.19999999999936, "deviation-heading": 9.436903144357268, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.7439394931413217, "driven_lanedir_consec": 0.9658211472014951, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.0772530105938, "get_ui_image": 0.0417475487965529, "step_physics": 0.9547286065393046, "survival_time": 59.99999999999873, "driven_lanedir": 1.1690162041234513, "get_state_dump": 0.00934214734912018, "get_robot_state": 0.013759182652863336, "sim_render-ego0": 0.003550956687959009, "sim_render-ego1": 0.0035212492565628293, "sim_render-ego2": 0.0035135438301283355, "sim_render-ego3": 0.003513012400872503, "get_duckie_state": 1.427335207110936e-06, "in-drivable-lane": 47.84999999999874, "deviation-heading": 8.073637555075656, "agent_compute-ego0": 0.013391270824117922, "agent_compute-ego1": 0.01541045484296686, "agent_compute-ego2": 0.013033051375643995, "agent_compute-ego3": 0.014024920507235687, "complete-iteration": 1.1318148034101323, "set_robot_commands": 0.0021149189049357877, "deviation-center-line": 1.3736569466911133, "driven_lanedir_consec": 0.6491307119221786, "sim_compute_sim_state": 0.02612294821219083, "sim_compute_performance-ego0": 0.0018751613305669143, "sim_compute_performance-ego1": 0.0018787092213626705, "sim_compute_performance-ego2": 0.0018456649224426623, "sim_compute_performance-ego3": 0.001839227819323639}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 11.201937730547376, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 2.0417897993978293, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 40.249999999999154, "deviation-heading": 17.090187029236617, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 1.949991673663512, "driven_lanedir_consec": 2.0417897993978293, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.4159826558219435, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.6160775610852487, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 55.749999999998735, "deviation-heading": 2.944189789637947, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.37460353384286355, "driven_lanedir_consec": 0.6160775610852487, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 5.203943969574526, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.4943078452708538, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 51.44999999999868, "deviation-heading": 6.165356082025716, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.7909989300383918, "driven_lanedir_consec": 0.4943078452708538, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.236412958670156, "get_ui_image": 0.04955957176087798, "step_physics": 1.1250416023546612, "survival_time": 59.99999999999873, "driven_lanedir": 0.2032266827046889, "get_state_dump": 0.00931862847791127, "get_robot_state": 0.013815735500122883, "sim_render-ego0": 0.0035729305035466456, "sim_render-ego1": 0.0035375075773037444, "sim_render-ego2": 0.003525132045062952, "sim_render-ego3": 0.0035476384810067337, "get_duckie_state": 1.2750728839045262e-06, "in-drivable-lane": 58.49999999999873, "deviation-heading": 0.6070223847639707, "agent_compute-ego0": 0.011902637426104772, "agent_compute-ego1": 0.011765321625162422, "agent_compute-ego2": 0.01174962550376873, "agent_compute-ego3": 0.011777795224662229, "complete-iteration": 1.3034764926300555, "set_robot_commands": 0.0021387415067242346, "deviation-center-line": 0.14833891725193588, "driven_lanedir_consec": 0.2032266827046889, "sim_compute_sim_state": 0.028260915900745757, "sim_compute_performance-ego0": 0.0018687331607002305, "sim_compute_performance-ego1": 0.0018350399106269472, "sim_compute_performance-ego2": 0.001873362967612642, "sim_compute_performance-ego3": 0.0018346240181013704}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 11.135630858203626, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 1.2739683210000623, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 45.09999999999894, "deviation-heading": 14.621642579598644, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 1.546704818892302, "driven_lanedir_consec": 1.2739683210000623, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 11.372132751920008, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 1.0982744225695618, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 49.04999999999886, "deviation-heading": 10.246820809598262, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 1.077010730209775, "driven_lanedir_consec": 1.063103018943326, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.2198051856755729, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 0.09546725179377248, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 58.59999999999873, "deviation-heading": 0.7123904442007795, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 0.04961564404319747, "driven_lanedir_consec": 0.09546725179377248, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.947831560026117, "get_ui_image": 0.046395846945757074, "step_physics": 1.0511745292876384, "survival_time": 59.99999999999873, "driven_lanedir": 0.8260766882858807, "get_state_dump": 0.00955323355084752, "get_robot_state": 0.014028308989106368, "sim_render-ego0": 0.0036466999117480423, "sim_render-ego1": 0.00357876054254003, "sim_render-ego2": 0.0036490588859157897, "sim_render-ego3": 0.003617470707127097, "get_duckie_state": 1.4193945383648391e-06, "in-drivable-lane": 48.79999999999865, "deviation-heading": 9.198328418947936, "agent_compute-ego0": 0.014727246453621109, "agent_compute-ego1": 0.014465934926524548, "agent_compute-ego2": 0.015588998794555664, "agent_compute-ego3": 0.012436721048982417, "complete-iteration": 1.2395031051175185, "set_robot_commands": 0.002164326738457597, "deviation-center-line": 0.8616347045040561, "driven_lanedir_consec": 0.47317892317123217, "sim_compute_sim_state": 0.03005763553362107, "sim_compute_performance-ego0": 0.0019546924880104797, "sim_compute_performance-ego1": 0.0018837747724725245, "sim_compute_performance-ego2": 0.0018849837392891176, "sim_compute_performance-ego3": 0.001935627339384538}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 11.024411120116763, "get_ui_image": 0.02952784423923413, "step_physics": 0.31230509092567565, "survival_time": 59.99999999999873, "driven_lanedir": 1.760753923528174, "get_state_dump": 0.0060589607311823685, "get_robot_state": 0.006927059850128961, "sim_render-ego0": 0.003542060359729319, "sim_render-ego1": 0.0034778161807223025, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 46.44999999999902, "deviation-heading": 8.353691162845305, "agent_compute-ego0": 0.011820346290721782, "agent_compute-ego1": 0.01390804001731142, "complete-iteration": 0.40519441831717384, "set_robot_commands": 0.0021228587796150097, "deviation-center-line": 1.3715513793431275, "driven_lanedir_consec": 1.760753923528174, "sim_compute_sim_state": 0.009637770704385342, "sim_compute_performance-ego0": 0.0018408232981914484, "sim_compute_performance-ego1": 0.0018267472717386796}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.924372256699431, "get_ui_image": 0.02952784423923413, "step_physics": 0.31230509092567565, "survival_time": 59.99999999999873, "driven_lanedir": 2.477096768971399, "get_state_dump": 0.0060589607311823685, "get_robot_state": 0.006927059850128961, "sim_render-ego0": 0.003542060359729319, "sim_render-ego1": 0.0034778161807223025, "get_duckie_state": 1.3098133096687006e-06, "in-drivable-lane": 38.249999999999275, "deviation-heading": 17.605145356012954, "agent_compute-ego0": 0.011820346290721782, "agent_compute-ego1": 0.01390804001731142, "complete-iteration": 0.40519441831717384, "set_robot_commands": 0.0021228587796150097, "deviation-center-line": 2.0795342768194507, "driven_lanedir_consec": 1.0625858637936194, "sim_compute_sim_state": 0.009637770704385342, "sim_compute_performance-ego0": 0.0018408232981914484, "sim_compute_performance-ego1": 0.0018267472717386796}}
set_robot_commands_max0.002164326738457597
set_robot_commands_mean0.00213697615426432
set_robot_commands_median0.0021387415067242346
set_robot_commands_min0.0021149189049357877
sim_compute_performance-ego0_max0.0019546924880104797
sim_compute_performance-ego0_mean0.0018911424652495283
sim_compute_performance-ego0_median0.0018751613305669143
sim_compute_performance-ego0_min0.0018408232981914484
sim_compute_performance-ego1_max0.0018837747724725245
sim_compute_performance-ego1_mean0.0018602564400947096
sim_compute_performance-ego1_median0.0018787092213626705
sim_compute_performance-ego1_min0.0018267472717386796
sim_compute_performance-ego2_max0.0018849837392891176
sim_compute_performance-ego2_mean0.0018680038764481413
sim_compute_performance-ego2_median0.001873362967612642
sim_compute_performance-ego2_min0.0018456649224426623
sim_compute_performance-ego3_max0.001935627339384538
sim_compute_performance-ego3_mean0.001869826392269849
sim_compute_performance-ego3_median0.001839227819323639
sim_compute_performance-ego3_min0.0018346240181013704
sim_compute_sim_state_max0.03005763553362107
sim_compute_sim_state_mean0.02550296714250009
sim_compute_sim_state_median0.028260915900745757
sim_compute_sim_state_min0.009637770704385342
sim_render-ego0_max0.0036466999117480423
sim_render-ego0_mean0.0035833192237481014
sim_render-ego0_median0.0035729305035466456
sim_render-ego0_min0.003542060359729319
sim_render-ego1_max0.00357876054254003
sim_render-ego1_mean0.003536121561933644
sim_render-ego1_median0.0035375075773037444
sim_render-ego1_min0.0034778161807223025
sim_render-ego2_max0.0036490588859157897
sim_render-ego2_mean0.0035625782537023584
sim_render-ego2_median0.003525132045062952
sim_render-ego2_min0.0035135438301283355
sim_render-ego3_max0.003617470707127097
sim_render-ego3_mean0.0035593738630021114
sim_render-ego3_median0.0035476384810067337
sim_render-ego3_min0.003513012400872503
simulation-passed1
step_physics_max1.1250416023546612
step_physics_mean0.9391706524698408
step_physics_median1.0511745292876384
step_physics_min0.31230509092567565
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873

Highlights

53874

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.