Duckietown Challenges Home Challenges Submissions

Job 53574

Job ID53574
submission12658
userBea Baselines 🐤
user labeltemplate-tensorflow
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration0:21:59
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33621859888186423
survival_time_median9.6
deviation-center-line_median0.07125551675095831
in-drivable-lane_median7.749999999999991


other stats
agent_compute-ego0_max0.025088690504243102
agent_compute-ego0_mean0.015717084875489885
agent_compute-ego0_median0.0131527698101775
agent_compute-ego0_min0.010908529493543836
agent_compute-ego1_max0.025149945971332015
agent_compute-ego1_mean0.0159075098482717
agent_compute-ego1_median0.013203795092093512
agent_compute-ego1_min0.011137320850435542
agent_compute-ego2_max0.02480001238327992
agent_compute-ego2_mean0.01685496331332097
agent_compute-ego2_median0.013125314238321716
agent_compute-ego2_min0.012639563318361273
agent_compute-ego3_max0.02472201178345499
agent_compute-ego3_mean0.016543389166350182
agent_compute-ego3_median0.013603980059450772
agent_compute-ego3_min0.011304175656144793
complete-iteration_max1.0460239437562
complete-iteration_mean0.8560922613156984
complete-iteration_median0.987337391611208
complete-iteration_min0.29955343846921567
deviation-center-line_max0.240965720156589
deviation-center-line_mean0.08673564580201591
deviation-center-line_min0.035997628531515474
deviation-heading_max1.288730205627049
deviation-heading_mean0.6564118901500494
deviation-heading_median0.5747045201772181
deviation-heading_min0.4084887793264565
driven_any_max7.56053723655662
driven_any_mean1.8175963537104445
driven_any_median0.9721902819835128
driven_any_min0.3581894199750563
driven_lanedir_consec_max0.8622842577071264
driven_lanedir_consec_mean0.3427603040396071
driven_lanedir_consec_min0.107613810712069
driven_lanedir_max0.8622842577071264
driven_lanedir_mean0.3427603040396071
driven_lanedir_median0.33621859888186423
driven_lanedir_min0.107613810712069
get_duckie_state_max1.3106845203458954e-06
get_duckie_state_mean1.2662726833071142e-06
get_duckie_state_median1.2869334352609202e-06
get_duckie_state_min1.1426431161385996e-06
get_robot_state_max0.013542202470216109
get_robot_state_mean0.012486875424660811
get_robot_state_median0.013492259798170644
get_robot_state_min0.00676120122273763
get_state_dump_max0.009054589148012469
get_state_dump_mean0.00849018743506422
get_state_dump_median0.008963704109191895
get_state_dump_min0.005716629381533022
get_ui_image_max0.04585016226466698
get_ui_image_mean0.04045210790817506
get_ui_image_median0.04242727299428357
get_ui_image_min0.029069715076022677
in-drivable-lane_max16.75000000000012
in-drivable-lane_mean9.71428571428574
in-drivable-lane_min5.5999999999999845
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.5127684067108719, "get_ui_image": 0.03877008488165081, "step_physics": 0.6639622239118123, "survival_time": 18.05000000000012, "driven_lanedir": 0.4503654774210149, "get_state_dump": 0.008839048074753903, "get_robot_state": 0.013289001106557266, "sim_render-ego0": 0.0034444569224152117, "sim_render-ego1": 0.003358017015193707, "sim_render-ego2": 0.003473711277239889, "sim_render-ego3": 0.003319575641695307, "get_duckie_state": 1.2869334352609202e-06, "in-drivable-lane": 16.600000000000122, "deviation-heading": 0.4232034040154166, "agent_compute-ego0": 0.011314072003022084, "agent_compute-ego1": 0.011137320850435542, "agent_compute-ego2": 0.013125314238321716, "agent_compute-ego3": 0.011304175656144793, "complete-iteration": 0.8131848600029287, "set_robot_commands": 0.0020095689520651465, "deviation-center-line": 0.05457625694553754, "driven_lanedir_consec": 0.4503654774210149, "sim_compute_sim_state": 0.012398887734386802, "sim_compute_performance-ego0": 0.0018073979003653345, "sim_compute_performance-ego1": 0.0018102062341258012, "sim_compute_performance-ego2": 0.001792999262309206, "sim_compute_performance-ego3": 0.0017650068135551327}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.0773586972736953, "get_ui_image": 0.03877008488165081, "step_physics": 0.6639622239118123, "survival_time": 18.05000000000012, "driven_lanedir": 0.3375234935553282, "get_state_dump": 0.008839048074753903, "get_robot_state": 0.013289001106557266, "sim_render-ego0": 0.0034444569224152117, "sim_render-ego1": 0.003358017015193707, "sim_render-ego2": 0.003473711277239889, "sim_render-ego3": 0.003319575641695307, "get_duckie_state": 1.2869334352609202e-06, "in-drivable-lane": 16.55000000000012, "deviation-heading": 0.7001902904689402, "agent_compute-ego0": 0.011314072003022084, "agent_compute-ego1": 0.011137320850435542, "agent_compute-ego2": 0.013125314238321716, "agent_compute-ego3": 0.011304175656144793, "complete-iteration": 0.8131848600029287, "set_robot_commands": 0.0020095689520651465, "deviation-center-line": 0.09704769294060986, "driven_lanedir_consec": 0.3375234935553282, "sim_compute_sim_state": 0.012398887734386802, "sim_compute_performance-ego0": 0.0018073979003653345, "sim_compute_performance-ego1": 0.0018102062341258012, "sim_compute_performance-ego2": 0.001792999262309206, "sim_compute_performance-ego3": 0.0017650068135551327}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.56053723655662, "get_ui_image": 0.03877008488165081, "step_physics": 0.6639622239118123, "survival_time": 18.05000000000012, "driven_lanedir": 0.5696451020408935, "get_state_dump": 0.008839048074753903, "get_robot_state": 0.013289001106557266, "sim_render-ego0": 0.0034444569224152117, "sim_render-ego1": 0.003358017015193707, "sim_render-ego2": 0.003473711277239889, "sim_render-ego3": 0.003319575641695307, "get_duckie_state": 1.2869334352609202e-06, "in-drivable-lane": 15.850000000000117, "deviation-heading": 1.257654743808632, "agent_compute-ego0": 0.011314072003022084, "agent_compute-ego1": 0.011137320850435542, "agent_compute-ego2": 0.013125314238321716, "agent_compute-ego3": 0.011304175656144793, "complete-iteration": 0.8131848600029287, "set_robot_commands": 0.0020095689520651465, "deviation-center-line": 0.12110374827365604, "driven_lanedir_consec": 0.5696451020408935, "sim_compute_sim_state": 0.012398887734386802, "sim_compute_performance-ego0": 0.0018073979003653345, "sim_compute_performance-ego1": 0.0018102062341258012, "sim_compute_performance-ego2": 0.001792999262309206, "sim_compute_performance-ego3": 0.0017650068135551327}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6652715241546576, "get_ui_image": 0.03877008488165081, "step_physics": 0.6639622239118123, "survival_time": 18.05000000000012, "driven_lanedir": 0.3349137042084003, "get_state_dump": 0.008839048074753903, "get_robot_state": 0.013289001106557266, "sim_render-ego0": 0.0034444569224152117, "sim_render-ego1": 0.003358017015193707, "sim_render-ego2": 0.003473711277239889, "sim_render-ego3": 0.003319575641695307, "get_duckie_state": 1.2869334352609202e-06, "in-drivable-lane": 16.75000000000012, "deviation-heading": 0.4084887793264565, "agent_compute-ego0": 0.011314072003022084, "agent_compute-ego1": 0.011137320850435542, "agent_compute-ego2": 0.013125314238321716, "agent_compute-ego3": 0.011304175656144793, "complete-iteration": 0.8131848600029287, "set_robot_commands": 0.0020095689520651465, "deviation-center-line": 0.059540331760822546, "driven_lanedir_consec": 0.3349137042084003, "sim_compute_sim_state": 0.012398887734386802, "sim_compute_performance-ego0": 0.0018073979003653345, "sim_compute_performance-ego1": 0.0018102062341258012, "sim_compute_performance-ego2": 0.001792999262309206, "sim_compute_performance-ego3": 0.0017650068135551327}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.6707676687450694, "get_ui_image": 0.04585016226466698, "step_physics": 0.8216794367077984, "survival_time": 7.84999999999998, "driven_lanedir": 0.3450329946788502, "get_state_dump": 0.008963704109191895, "get_robot_state": 0.013492259798170644, "sim_render-ego0": 0.003668228282204157, "sim_render-ego1": 0.0035561715500264227, "sim_render-ego2": 0.003525074524215505, "sim_render-ego3": 0.0035241525384444223, "get_duckie_state": 1.2630148778987836e-06, "in-drivable-lane": 6.39999999999998, "deviation-heading": 0.587589057715665, "agent_compute-ego0": 0.025088690504243102, "agent_compute-ego1": 0.025149945971332015, "agent_compute-ego2": 0.02480001238327992, "agent_compute-ego3": 0.02472201178345499, "complete-iteration": 1.0460239437562, "set_robot_commands": 0.0020667299439635456, "deviation-center-line": 0.062455967758129935, "driven_lanedir_consec": 0.3450329946788502, "sim_compute_sim_state": 0.0261113915262343, "sim_compute_performance-ego0": 0.001885800421992435, "sim_compute_performance-ego1": 0.001855127419097514, "sim_compute_performance-ego2": 0.0018317820150640944, "sim_compute_performance-ego3": 0.0018466816672795935}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.560541884210065, "get_ui_image": 0.04585016226466698, "step_physics": 0.8216794367077984, "survival_time": 7.84999999999998, "driven_lanedir": 0.14619775342592956, "get_state_dump": 0.008963704109191895, "get_robot_state": 0.013492259798170644, "sim_render-ego0": 0.003668228282204157, "sim_render-ego1": 0.0035561715500264227, "sim_render-ego2": 0.003525074524215505, "sim_render-ego3": 0.0035241525384444223, "get_duckie_state": 1.2630148778987836e-06, "in-drivable-lane": 6.899999999999982, "deviation-heading": 0.8166796289905741, "agent_compute-ego0": 0.025088690504243102, "agent_compute-ego1": 0.025149945971332015, "agent_compute-ego2": 0.02480001238327992, "agent_compute-ego3": 0.02472201178345499, "complete-iteration": 1.0460239437562, "set_robot_commands": 0.0020667299439635456, "deviation-center-line": 0.08005506574378671, "driven_lanedir_consec": 0.14619775342592956, "sim_compute_sim_state": 0.0261113915262343, "sim_compute_performance-ego0": 0.001885800421992435, "sim_compute_performance-ego1": 0.001855127419097514, "sim_compute_performance-ego2": 0.0018317820150640944, "sim_compute_performance-ego3": 0.0018466816672795935}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.8027686156944285, "get_ui_image": 0.04585016226466698, "step_physics": 0.8216794367077984, "survival_time": 7.84999999999998, "driven_lanedir": 0.3916696984745678, "get_state_dump": 0.008963704109191895, "get_robot_state": 0.013492259798170644, "sim_render-ego0": 0.003668228282204157, "sim_render-ego1": 0.0035561715500264227, "sim_render-ego2": 0.003525074524215505, "sim_render-ego3": 0.0035241525384444223, "get_duckie_state": 1.2630148778987836e-06, "in-drivable-lane": 6.24999999999998, "deviation-heading": 0.6081310248246126, "agent_compute-ego0": 0.025088690504243102, "agent_compute-ego1": 0.025149945971332015, "agent_compute-ego2": 0.02480001238327992, "agent_compute-ego3": 0.02472201178345499, "complete-iteration": 1.0460239437562, "set_robot_commands": 0.0020667299439635456, "deviation-center-line": 0.08013548337613707, "driven_lanedir_consec": 0.3916696984745678, "sim_compute_sim_state": 0.0261113915262343, "sim_compute_performance-ego0": 0.001885800421992435, "sim_compute_performance-ego1": 0.001855127419097514, "sim_compute_performance-ego2": 0.0018317820150640944, "sim_compute_performance-ego3": 0.0018466816672795935}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.85755072505536, "get_ui_image": 0.04585016226466698, "step_physics": 0.8216794367077984, "survival_time": 7.84999999999998, "driven_lanedir": 0.45212723939806, "get_state_dump": 0.008963704109191895, "get_robot_state": 0.013492259798170644, "sim_render-ego0": 0.003668228282204157, "sim_render-ego1": 0.0035561715500264227, "sim_render-ego2": 0.003525074524215505, "sim_render-ego3": 0.0035241525384444223, "get_duckie_state": 1.2630148778987836e-06, "in-drivable-lane": 6.349999999999982, "deviation-heading": 0.7075157081152175, "agent_compute-ego0": 0.025088690504243102, "agent_compute-ego1": 0.025149945971332015, "agent_compute-ego2": 0.02480001238327992, "agent_compute-ego3": 0.02472201178345499, "complete-iteration": 1.0460239437562, "set_robot_commands": 0.0020667299439635456, "deviation-center-line": 0.13480280560346716, "driven_lanedir_consec": 0.45212723939806, "sim_compute_sim_state": 0.0261113915262343, "sim_compute_performance-ego0": 0.001885800421992435, "sim_compute_performance-ego1": 0.001855127419097514, "sim_compute_performance-ego2": 0.0018317820150640944, "sim_compute_performance-ego3": 0.0018466816672795935}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8323887561616258, "get_ui_image": 0.04242727299428357, "step_physics": 0.8223311579906879, "survival_time": 9.6, "driven_lanedir": 0.1765162833684295, "get_state_dump": 0.009054589148012469, "get_robot_state": 0.013542202470216109, "sim_render-ego0": 0.00367283574040072, "sim_render-ego1": 0.0036049963896756343, "sim_render-ego2": 0.003494237988723992, "sim_render-ego3": 0.00362795004572893, "get_duckie_state": 1.3106845203458954e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.561819982638771, "agent_compute-ego0": 0.0131527698101775, "agent_compute-ego1": 0.013203795092093512, "agent_compute-ego2": 0.012639563318361273, "agent_compute-ego3": 0.013603980059450772, "complete-iteration": 0.987337391611208, "set_robot_commands": 0.002082766646548257, "deviation-center-line": 0.054638405701831434, "driven_lanedir_consec": 0.1765162833684295, "sim_compute_sim_state": 0.017105979622954532, "sim_compute_performance-ego0": 0.0018365803160197995, "sim_compute_performance-ego1": 0.001861688386590987, "sim_compute_performance-ego2": 0.0018279181860889177, "sim_compute_performance-ego3": 0.0018221652569548456}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 0.3947810960621528, "get_ui_image": 0.04242727299428357, "step_physics": 0.8223311579906879, "survival_time": 9.6, "driven_lanedir": 0.11553852058534696, "get_state_dump": 0.009054589148012469, "get_robot_state": 0.013542202470216109, "sim_render-ego0": 0.00367283574040072, "sim_render-ego1": 0.0036049963896756343, "sim_render-ego2": 0.003494237988723992, "sim_render-ego3": 0.00362795004572893, "get_duckie_state": 1.3106845203458954e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.4312991322773665, "agent_compute-ego0": 0.0131527698101775, "agent_compute-ego1": 0.013203795092093512, "agent_compute-ego2": 0.012639563318361273, "agent_compute-ego3": 0.013603980059450772, "complete-iteration": 0.987337391611208, "set_robot_commands": 0.002082766646548257, "deviation-center-line": 0.035997628531515474, "driven_lanedir_consec": 0.11553852058534696, "sim_compute_sim_state": 0.017105979622954532, "sim_compute_performance-ego0": 0.0018365803160197995, "sim_compute_performance-ego1": 0.001861688386590987, "sim_compute_performance-ego2": 0.0018279181860889177, "sim_compute_performance-ego3": 0.0018221652569548456}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.7319739454128618, "get_ui_image": 0.04242727299428357, "step_physics": 0.8223311579906879, "survival_time": 9.6, "driven_lanedir": 0.8622842577071264, "get_state_dump": 0.009054589148012469, "get_robot_state": 0.013542202470216109, "sim_render-ego0": 0.00367283574040072, "sim_render-ego1": 0.0036049963896756343, "sim_render-ego2": 0.003494237988723992, "sim_render-ego3": 0.00362795004572893, "get_duckie_state": 1.3106845203458954e-06, "in-drivable-lane": 6.800000000000004, "deviation-heading": 1.288730205627049, "agent_compute-ego0": 0.0131527698101775, "agent_compute-ego1": 0.013203795092093512, "agent_compute-ego2": 0.012639563318361273, "agent_compute-ego3": 0.013603980059450772, "complete-iteration": 0.987337391611208, "set_robot_commands": 0.002082766646548257, "deviation-center-line": 0.240965720156589, "driven_lanedir_consec": 0.8622842577071264, "sim_compute_sim_state": 0.017105979622954532, "sim_compute_performance-ego0": 0.0018365803160197995, "sim_compute_performance-ego1": 0.001861688386590987, "sim_compute_performance-ego2": 0.0018279181860889177, "sim_compute_performance-ego3": 0.0018221652569548456}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3581894199750563, "get_ui_image": 0.04242727299428357, "step_physics": 0.8223311579906879, "survival_time": 9.6, "driven_lanedir": 0.20427199044043176, "get_state_dump": 0.009054589148012469, "get_robot_state": 0.013542202470216109, "sim_render-ego0": 0.00367283574040072, "sim_render-ego1": 0.0036049963896756343, "sim_render-ego2": 0.003494237988723992, "sim_render-ego3": 0.00362795004572893, "get_duckie_state": 1.3106845203458954e-06, "in-drivable-lane": 8.600000000000001, "deviation-heading": 0.4938264518321893, "agent_compute-ego0": 0.0131527698101775, "agent_compute-ego1": 0.013203795092093512, "agent_compute-ego2": 0.012639563318361273, "agent_compute-ego3": 0.013603980059450772, "complete-iteration": 0.987337391611208, "set_robot_commands": 0.002082766646548257, "deviation-center-line": 0.05828112308234561, "driven_lanedir_consec": 0.20427199044043176, "sim_compute_sim_state": 0.017105979622954532, "sim_compute_performance-ego0": 0.0018365803160197995, "sim_compute_performance-ego1": 0.001861688386590987, "sim_compute_performance-ego2": 0.0018279181860889177, "sim_compute_performance-ego3": 0.0018221652569548456}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.8670218666933306, "get_ui_image": 0.029069715076022677, "step_physics": 0.21339333498919452, "survival_time": 6.699999999999984, "driven_lanedir": 0.107613810712069, "get_state_dump": 0.005716629381533022, "get_robot_state": 0.00676120122273763, "sim_render-ego0": 0.0034023284912109374, "sim_render-ego1": 0.003456664968419958, "get_duckie_state": 1.1426431161385996e-06, "in-drivable-lane": 5.849999999999984, "deviation-heading": 0.4440557967990175, "agent_compute-ego0": 0.010908529493543836, "agent_compute-ego1": 0.01237044511017976, "complete-iteration": 0.29955343846921567, "set_robot_commands": 0.0020545924151385273, "deviation-center-line": 0.04115941867266226, "driven_lanedir_consec": 0.107613810712069, "sim_compute_sim_state": 0.00664351604602955, "sim_compute_performance-ego0": 0.0017837224183259188, "sim_compute_performance-ego1": 0.0017924891577826606}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.554429109240424, "get_ui_image": 0.029069715076022677, "step_physics": 0.21339333498919452, "survival_time": 6.699999999999984, "driven_lanedir": 0.30494393053805147, "get_state_dump": 0.005716629381533022, "get_robot_state": 0.00676120122273763, "sim_render-ego0": 0.0034023284912109374, "sim_render-ego1": 0.003456664968419958, "get_duckie_state": 1.1426431161385996e-06, "in-drivable-lane": 5.5999999999999845, "deviation-heading": 0.460582255660784, "agent_compute-ego0": 0.010908529493543836, "agent_compute-ego1": 0.01237044511017976, "complete-iteration": 0.29955343846921567, "set_robot_commands": 0.0020545924151385273, "deviation-center-line": 0.09353939268113208, "driven_lanedir_consec": 0.30494393053805147, "sim_compute_sim_state": 0.00664351604602955, "sim_compute_performance-ego0": 0.0017837224183259188, "sim_compute_performance-ego1": 0.0017924891577826606}}
set_robot_commands_max0.002082766646548257
set_robot_commands_mean0.002053246214327489
set_robot_commands_median0.0020667299439635456
set_robot_commands_min0.0020095689520651465
sim_compute_performance-ego0_max0.001885800421992435
sim_compute_performance-ego0_mean0.001834754242154436
sim_compute_performance-ego0_median0.0018365803160197995
sim_compute_performance-ego0_min0.0017837224183259188
sim_compute_performance-ego1_max0.001861688386590987
sim_compute_performance-ego1_mean0.0018352190339158952
sim_compute_performance-ego1_median0.001855127419097514
sim_compute_performance-ego1_min0.0017924891577826606
sim_compute_performance-ego2_max0.0018317820150640944
sim_compute_performance-ego2_mean0.0018175664878207392
sim_compute_performance-ego2_median0.0018279181860889177
sim_compute_performance-ego2_min0.001792999262309206
sim_compute_performance-ego3_max0.0018466816672795935
sim_compute_performance-ego3_mean0.001811284579263191
sim_compute_performance-ego3_median0.0018221652569548456
sim_compute_performance-ego3_min0.0017650068135551327
sim_compute_sim_state_max0.0261113915262343
sim_compute_sim_state_mean0.016839433401882976
sim_compute_sim_state_median0.017105979622954532
sim_compute_sim_state_min0.00664351604602955
sim_render-ego0_max0.00367283574040072
sim_render-ego0_mean0.0035676243401787304
sim_render-ego0_median0.003668228282204157
sim_render-ego0_min0.0034023284912109374
sim_render-ego1_max0.0036049963896756343
sim_render-ego1_mean0.0034992906968873564
sim_render-ego1_median0.0035561715500264227
sim_render-ego1_min0.003358017015193707
sim_render-ego2_max0.003525074524215505
sim_render-ego2_mean0.003497674596726461
sim_render-ego2_median0.003494237988723992
sim_render-ego2_min0.003473711277239889
sim_render-ego3_max0.00362795004572893
sim_render-ego3_mean0.0034905594086228875
sim_render-ego3_median0.0035241525384444223
sim_render-ego3_min0.003319575641695307
simulation-passed1
step_physics_max0.8223311579906879
step_physics_mean0.6899055674585417
step_physics_median0.8216794367077984
step_physics_min0.21339333498919452
survival_time_max18.05000000000012
survival_time_mean11.100000000000026
survival_time_min6.699999999999984

Highlights

53574

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.