Duckietown Challenges Home Challenges Submissions

Job 53572

Job ID53572
submission12658
userBea Baselines 🐤
user labeltemplate-tensorflow
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration0:31:09
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.33621859888186423
survival_time_median18.05000000000012
deviation-center-line_median0.07238629418679933
in-drivable-lane_median15.70000000000011


other stats
agent_compute-ego0_max0.01683333348005246
agent_compute-ego0_mean0.013909014149139292
agent_compute-ego0_median0.012868036881336193
agent_compute-ego0_min0.012583492420337818
agent_compute-ego1_max0.017228080676152155
agent_compute-ego1_mean0.013577641300804149
agent_compute-ego1_median0.012147330249529428
agent_compute-ego1_min0.0118877532073806
agent_compute-ego2_max0.01773801950307993
agent_compute-ego2_mean0.014274286266702492
agent_compute-ego2_median0.013092990079637393
agent_compute-ego2_min0.01199184921739015
agent_compute-ego3_max0.016545434487171662
agent_compute-ego3_mean0.013653372385556108
agent_compute-ego3_median0.012711767087946284
agent_compute-ego3_min0.011702915581550387
complete-iteration_max1.2121730260359935
complete-iteration_mean0.9721571668134922
complete-iteration_median1.1104911016059045
complete-iteration_min0.3292678532777009
deviation-center-line_max0.34809623003727935
deviation-center-line_mean0.10416951282863476
deviation-center-line_min0.035997628531515474
deviation-heading_max3.438360010858093
deviation-heading_mean0.8351132094842322
deviation-heading_median0.5515152988340777
deviation-heading_min0.4084887793264565
driven_any_max7.56053723655662
driven_any_mean2.202824312280221
driven_any_median1.0958824786927126
driven_any_min0.3581894199750563
driven_lanedir_consec_max0.8622842577071264
driven_lanedir_consec_mean0.3648252562665547
driven_lanedir_consec_min0.107613810712069
driven_lanedir_max0.8725099251708897
driven_lanedir_mean0.38665779336309153
driven_lanedir_median0.33621859888186423
driven_lanedir_min0.107613810712069
get_duckie_state_max1.5299623183782587e-06
get_duckie_state_mean1.4058541979447608e-06
get_duckie_state_median1.3681558462289664e-06
get_duckie_state_min1.3245476616753472e-06
get_robot_state_max0.01410319265081079
get_robot_state_mean0.012946567936688944
get_robot_state_median0.013868461618769354
get_robot_state_min0.006985424183033131
get_state_dump_max0.009612430525089496
get_state_dump_mean0.008937599071547822
get_state_dump_median0.009325383240694828
get_state_dump_min0.006082533023975514
get_ui_image_max0.05530833953466171
get_ui_image_mean0.046891104890098526
get_ui_image_median0.04844832173283236
get_ui_image_min0.032210779190063474
in-drivable-lane_max18.250000000000146
in-drivable-lane_mean12.839285714285785
in-drivable-lane_min5.5999999999999845
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.5127684067108719, "get_ui_image": 0.04425681625281908, "step_physics": 0.7524500940386103, "survival_time": 18.05000000000012, "driven_lanedir": 0.4503654774210149, "get_state_dump": 0.009612430525089496, "get_robot_state": 0.01410319265081079, "sim_render-ego0": 0.003746464766191514, "sim_render-ego1": 0.003599618679910734, "sim_render-ego2": 0.0037462461060581943, "sim_render-ego3": 0.0036015971589483608, "get_duckie_state": 1.5299623183782587e-06, "in-drivable-lane": 16.600000000000122, "deviation-heading": 0.4232034040154166, "agent_compute-ego0": 0.012868036881336193, "agent_compute-ego1": 0.0118877532073806, "agent_compute-ego2": 0.013092990079637393, "agent_compute-ego3": 0.011702915581550387, "complete-iteration": 0.915252029566475, "set_robot_commands": 0.002276125533804709, "deviation-center-line": 0.05457625694553754, "driven_lanedir_consec": 0.4503654774210149, "sim_compute_sim_state": 0.013415126510746571, "sim_compute_performance-ego0": 0.0019538600141830865, "sim_compute_performance-ego1": 0.001986988341610735, "sim_compute_performance-ego2": 0.0019632169554905337, "sim_compute_performance-ego3": 0.0019337413060730993}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.0773586972736953, "get_ui_image": 0.04425681625281908, "step_physics": 0.7524500940386103, "survival_time": 18.05000000000012, "driven_lanedir": 0.3375234935553282, "get_state_dump": 0.009612430525089496, "get_robot_state": 0.01410319265081079, "sim_render-ego0": 0.003746464766191514, "sim_render-ego1": 0.003599618679910734, "sim_render-ego2": 0.0037462461060581943, "sim_render-ego3": 0.0036015971589483608, "get_duckie_state": 1.5299623183782587e-06, "in-drivable-lane": 16.55000000000012, "deviation-heading": 0.7001902904689402, "agent_compute-ego0": 0.012868036881336193, "agent_compute-ego1": 0.0118877532073806, "agent_compute-ego2": 0.013092990079637393, "agent_compute-ego3": 0.011702915581550387, "complete-iteration": 0.915252029566475, "set_robot_commands": 0.002276125533804709, "deviation-center-line": 0.09704769294060986, "driven_lanedir_consec": 0.3375234935553282, "sim_compute_sim_state": 0.013415126510746571, "sim_compute_performance-ego0": 0.0019538600141830865, "sim_compute_performance-ego1": 0.001986988341610735, "sim_compute_performance-ego2": 0.0019632169554905337, "sim_compute_performance-ego3": 0.0019337413060730993}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.56053723655662, "get_ui_image": 0.04425681625281908, "step_physics": 0.7524500940386103, "survival_time": 18.05000000000012, "driven_lanedir": 0.5696451020408935, "get_state_dump": 0.009612430525089496, "get_robot_state": 0.01410319265081079, "sim_render-ego0": 0.003746464766191514, "sim_render-ego1": 0.003599618679910734, "sim_render-ego2": 0.0037462461060581943, "sim_render-ego3": 0.0036015971589483608, "get_duckie_state": 1.5299623183782587e-06, "in-drivable-lane": 15.850000000000117, "deviation-heading": 1.257654743808632, "agent_compute-ego0": 0.012868036881336193, "agent_compute-ego1": 0.0118877532073806, "agent_compute-ego2": 0.013092990079637393, "agent_compute-ego3": 0.011702915581550387, "complete-iteration": 0.915252029566475, "set_robot_commands": 0.002276125533804709, "deviation-center-line": 0.12110374827365604, "driven_lanedir_consec": 0.5696451020408935, "sim_compute_sim_state": 0.013415126510746571, "sim_compute_performance-ego0": 0.0019538600141830865, "sim_compute_performance-ego1": 0.001986988341610735, "sim_compute_performance-ego2": 0.0019632169554905337, "sim_compute_performance-ego3": 0.0019337413060730993}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6652715241546576, "get_ui_image": 0.04425681625281908, "step_physics": 0.7524500940386103, "survival_time": 18.05000000000012, "driven_lanedir": 0.3349137042084003, "get_state_dump": 0.009612430525089496, "get_robot_state": 0.01410319265081079, "sim_render-ego0": 0.003746464766191514, "sim_render-ego1": 0.003599618679910734, "sim_render-ego2": 0.0037462461060581943, "sim_render-ego3": 0.0036015971589483608, "get_duckie_state": 1.5299623183782587e-06, "in-drivable-lane": 16.75000000000012, "deviation-heading": 0.4084887793264565, "agent_compute-ego0": 0.012868036881336193, "agent_compute-ego1": 0.0118877532073806, "agent_compute-ego2": 0.013092990079637393, "agent_compute-ego3": 0.011702915581550387, "complete-iteration": 0.915252029566475, "set_robot_commands": 0.002276125533804709, "deviation-center-line": 0.059540331760822546, "driven_lanedir_consec": 0.3349137042084003, "sim_compute_sim_state": 0.013415126510746571, "sim_compute_performance-ego0": 0.0019538600141830865, "sim_compute_performance-ego1": 0.001986988341610735, "sim_compute_performance-ego2": 0.0019632169554905337, "sim_compute_performance-ego3": 0.0019337413060730993}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.1144062601117302, "get_ui_image": 0.05530833953466171, "step_physics": 1.0144691363359108, "survival_time": 19.45000000000014, "driven_lanedir": 0.39409864013481943, "get_state_dump": 0.009302516472645296, "get_robot_state": 0.01384862141731458, "sim_render-ego0": 0.0034940316126896784, "sim_render-ego1": 0.00361939760354849, "sim_render-ego2": 0.003605020351898976, "sim_render-ego3": 0.003527482350667318, "get_duckie_state": 1.3681558462289664e-06, "in-drivable-lane": 18.000000000000142, "deviation-heading": 0.5412106150293845, "agent_compute-ego0": 0.01683333348005246, "agent_compute-ego1": 0.017228080676152155, "agent_compute-ego2": 0.01773801950307993, "agent_compute-ego3": 0.016545434487171662, "complete-iteration": 1.2121730260359935, "set_robot_commands": 0.00214996765821408, "deviation-center-line": 0.06444590476090648, "driven_lanedir_consec": 0.39409864013481943, "sim_compute_sim_state": 0.020285712144313715, "sim_compute_performance-ego0": 0.0018832903641920824, "sim_compute_performance-ego1": 0.0018832860848842525, "sim_compute_performance-ego2": 0.001854741878998585, "sim_compute_performance-ego3": 0.00189663874797332}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.057022754256842, "get_ui_image": 0.05530833953466171, "step_physics": 1.0144691363359108, "survival_time": 19.45000000000014, "driven_lanedir": 0.8725099251708897, "get_state_dump": 0.009302516472645296, "get_robot_state": 0.01384862141731458, "sim_render-ego0": 0.0034940316126896784, "sim_render-ego1": 0.00361939760354849, "sim_render-ego2": 0.003605020351898976, "sim_render-ego3": 0.003527482350667318, "get_duckie_state": 1.3681558462289664e-06, "in-drivable-lane": 15.550000000000104, "deviation-heading": 3.438360010858093, "agent_compute-ego0": 0.01683333348005246, "agent_compute-ego1": 0.017228080676152155, "agent_compute-ego2": 0.01773801950307993, "agent_compute-ego3": 0.016545434487171662, "complete-iteration": 1.2121730260359935, "set_robot_commands": 0.00214996765821408, "deviation-center-line": 0.34809623003727935, "driven_lanedir_consec": 0.5668544058193756, "sim_compute_sim_state": 0.020285712144313715, "sim_compute_performance-ego0": 0.0018832903641920824, "sim_compute_performance-ego1": 0.0018832860848842525, "sim_compute_performance-ego2": 0.001854741878998585, "sim_compute_performance-ego3": 0.00189663874797332}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.8171995834009037, "get_ui_image": 0.05530833953466171, "step_physics": 1.0144691363359108, "survival_time": 19.45000000000014, "driven_lanedir": 0.40810479784516, "get_state_dump": 0.009302516472645296, "get_robot_state": 0.01384862141731458, "sim_render-ego0": 0.0034940316126896784, "sim_render-ego1": 0.00361939760354849, "sim_render-ego2": 0.003605020351898976, "sim_render-ego3": 0.003527482350667318, "get_duckie_state": 1.3681558462289664e-06, "in-drivable-lane": 17.85000000000014, "deviation-heading": 0.5892710437218239, "agent_compute-ego0": 0.01683333348005246, "agent_compute-ego1": 0.017228080676152155, "agent_compute-ego2": 0.01773801950307993, "agent_compute-ego3": 0.016545434487171662, "complete-iteration": 1.2121730260359935, "set_robot_commands": 0.00214996765821408, "deviation-center-line": 0.08032668361269218, "driven_lanedir_consec": 0.40810479784516, "sim_compute_sim_state": 0.020285712144313715, "sim_compute_performance-ego0": 0.0018832903641920824, "sim_compute_performance-ego1": 0.0018832860848842525, "sim_compute_performance-ego2": 0.001854741878998585, "sim_compute_performance-ego3": 0.00189663874797332}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 3.296191715912318, "get_ui_image": 0.05530833953466171, "step_physics": 1.0144691363359108, "survival_time": 19.45000000000014, "driven_lanedir": 0.27487917335532, "get_state_dump": 0.009302516472645296, "get_robot_state": 0.01384862141731458, "sim_render-ego0": 0.0034940316126896784, "sim_render-ego1": 0.00361939760354849, "sim_render-ego2": 0.003605020351898976, "sim_render-ego3": 0.003527482350667318, "get_duckie_state": 1.3681558462289664e-06, "in-drivable-lane": 18.250000000000146, "deviation-heading": 0.6528922207153259, "agent_compute-ego0": 0.01683333348005246, "agent_compute-ego1": 0.017228080676152155, "agent_compute-ego2": 0.01773801950307993, "agent_compute-ego3": 0.016545434487171662, "complete-iteration": 1.2121730260359935, "set_robot_commands": 0.00214996765821408, "deviation-center-line": 0.1086546424433068, "driven_lanedir_consec": 0.27487917335532, "sim_compute_sim_state": 0.020285712144313715, "sim_compute_performance-ego0": 0.0018832903641920824, "sim_compute_performance-ego1": 0.0018832860848842525, "sim_compute_performance-ego2": 0.001854741878998585, "sim_compute_performance-ego3": 0.00189663874797332}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8323887561616258, "get_ui_image": 0.04844832173283236, "step_physics": 0.9390295997184792, "survival_time": 9.6, "driven_lanedir": 0.1765162833684295, "get_state_dump": 0.009325383240694828, "get_robot_state": 0.013868461618769354, "sim_render-ego0": 0.0037779153319838134, "sim_render-ego1": 0.003728465095085183, "sim_render-ego2": 0.0036707122091184626, "sim_render-ego3": 0.0037629159621006465, "get_duckie_state": 1.3600976973617632e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.561819982638771, "agent_compute-ego0": 0.012688432950429963, "agent_compute-ego1": 0.012147330249529428, "agent_compute-ego2": 0.01199184921739015, "agent_compute-ego3": 0.012711767087946284, "complete-iteration": 1.1104911016059045, "set_robot_commands": 0.002226169862895432, "deviation-center-line": 0.054638405701831434, "driven_lanedir_consec": 0.1765162833684295, "sim_compute_sim_state": 0.01871353604015291, "sim_compute_performance-ego0": 0.001916114530415115, "sim_compute_performance-ego1": 0.0019376870881708177, "sim_compute_performance-ego2": 0.0019531546479062095, "sim_compute_performance-ego3": 0.00186842340261825}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 0.3947810960621528, "get_ui_image": 0.04844832173283236, "step_physics": 0.9390295997184792, "survival_time": 9.6, "driven_lanedir": 0.11553852058534696, "get_state_dump": 0.009325383240694828, "get_robot_state": 0.013868461618769354, "sim_render-ego0": 0.0037779153319838134, "sim_render-ego1": 0.003728465095085183, "sim_render-ego2": 0.0036707122091184626, "sim_render-ego3": 0.0037629159621006465, "get_duckie_state": 1.3600976973617632e-06, "in-drivable-lane": 8.75, "deviation-heading": 0.4312991322773665, "agent_compute-ego0": 0.012688432950429963, "agent_compute-ego1": 0.012147330249529428, "agent_compute-ego2": 0.01199184921739015, "agent_compute-ego3": 0.012711767087946284, "complete-iteration": 1.1104911016059045, "set_robot_commands": 0.002226169862895432, "deviation-center-line": 0.035997628531515474, "driven_lanedir_consec": 0.11553852058534696, "sim_compute_sim_state": 0.01871353604015291, "sim_compute_performance-ego0": 0.001916114530415115, "sim_compute_performance-ego1": 0.0019376870881708177, "sim_compute_performance-ego2": 0.0019531546479062095, "sim_compute_performance-ego3": 0.00186842340261825}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.7319739454128618, "get_ui_image": 0.04844832173283236, "step_physics": 0.9390295997184792, "survival_time": 9.6, "driven_lanedir": 0.8622842577071264, "get_state_dump": 0.009325383240694828, "get_robot_state": 0.013868461618769354, "sim_render-ego0": 0.0037779153319838134, "sim_render-ego1": 0.003728465095085183, "sim_render-ego2": 0.0036707122091184626, "sim_render-ego3": 0.0037629159621006465, "get_duckie_state": 1.3600976973617632e-06, "in-drivable-lane": 6.800000000000004, "deviation-heading": 1.288730205627049, "agent_compute-ego0": 0.012688432950429963, "agent_compute-ego1": 0.012147330249529428, "agent_compute-ego2": 0.01199184921739015, "agent_compute-ego3": 0.012711767087946284, "complete-iteration": 1.1104911016059045, "set_robot_commands": 0.002226169862895432, "deviation-center-line": 0.240965720156589, "driven_lanedir_consec": 0.8622842577071264, "sim_compute_sim_state": 0.01871353604015291, "sim_compute_performance-ego0": 0.001916114530415115, "sim_compute_performance-ego1": 0.0019376870881708177, "sim_compute_performance-ego2": 0.0019531546479062095, "sim_compute_performance-ego3": 0.00186842340261825}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3581894199750563, "get_ui_image": 0.04844832173283236, "step_physics": 0.9390295997184792, "survival_time": 9.6, "driven_lanedir": 0.20427199044043176, "get_state_dump": 0.009325383240694828, "get_robot_state": 0.013868461618769354, "sim_render-ego0": 0.0037779153319838134, "sim_render-ego1": 0.003728465095085183, "sim_render-ego2": 0.0036707122091184626, "sim_render-ego3": 0.0037629159621006465, "get_duckie_state": 1.3600976973617632e-06, "in-drivable-lane": 8.600000000000001, "deviation-heading": 0.4938264518321893, "agent_compute-ego0": 0.012688432950429963, "agent_compute-ego1": 0.012147330249529428, "agent_compute-ego2": 0.01199184921739015, "agent_compute-ego3": 0.012711767087946284, "complete-iteration": 1.1104911016059045, "set_robot_commands": 0.002226169862895432, "deviation-center-line": 0.05828112308234561, "driven_lanedir_consec": 0.20427199044043176, "sim_compute_sim_state": 0.01871353604015291, "sim_compute_performance-ego0": 0.001916114530415115, "sim_compute_performance-ego1": 0.0019376870881708177, "sim_compute_performance-ego2": 0.0019531546479062095, "sim_compute_performance-ego3": 0.00186842340261825}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 0.8670218666933306, "get_ui_image": 0.032210779190063474, "step_physics": 0.2365101831930655, "survival_time": 6.699999999999984, "driven_lanedir": 0.107613810712069, "get_state_dump": 0.006082533023975514, "get_robot_state": 0.006985424183033131, "sim_render-ego0": 0.003540766680682147, "sim_render-ego1": 0.0036468064343487777, "get_duckie_state": 1.3245476616753472e-06, "in-drivable-lane": 5.849999999999984, "deviation-heading": 0.4440557967990175, "agent_compute-ego0": 0.012583492420337818, "agent_compute-ego1": 0.012517160839504668, "complete-iteration": 0.3292678532777009, "set_robot_commands": 0.002110417683919271, "deviation-center-line": 0.04115941867266226, "driven_lanedir_consec": 0.107613810712069, "sim_compute_sim_state": 0.007032542758517795, "sim_compute_performance-ego0": 0.001894080197369611, "sim_compute_performance-ego1": 0.001879773316559968}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.554429109240424, "get_ui_image": 0.032210779190063474, "step_physics": 0.2365101831930655, "survival_time": 6.699999999999984, "driven_lanedir": 0.30494393053805147, "get_state_dump": 0.006082533023975514, "get_robot_state": 0.006985424183033131, "sim_render-ego0": 0.003540766680682147, "sim_render-ego1": 0.0036468064343487777, "get_duckie_state": 1.3245476616753472e-06, "in-drivable-lane": 5.5999999999999845, "deviation-heading": 0.460582255660784, "agent_compute-ego0": 0.012583492420337818, "agent_compute-ego1": 0.012517160839504668, "complete-iteration": 0.3292678532777009, "set_robot_commands": 0.002110417683919271, "deviation-center-line": 0.09353939268113208, "driven_lanedir_consec": 0.30494393053805147, "sim_compute_sim_state": 0.007032542758517795, "sim_compute_performance-ego0": 0.001894080197369611, "sim_compute_performance-ego1": 0.001879773316559968}}
set_robot_commands_max0.002276125533804709
set_robot_commands_mean0.0022021348276782446
set_robot_commands_median0.002226169862895432
set_robot_commands_min0.002110417683919271
sim_compute_performance-ego0_max0.0019538600141830865
sim_compute_performance-ego0_mean0.001914372859278597
sim_compute_performance-ego0_median0.001916114530415115
sim_compute_performance-ego0_min0.0018832903641920824
sim_compute_performance-ego1_max0.001986988341610735
sim_compute_performance-ego1_mean0.001927956620841654
sim_compute_performance-ego1_median0.0019376870881708177
sim_compute_performance-ego1_min0.001879773316559968
sim_compute_performance-ego2_max0.0019632169554905337
sim_compute_performance-ego2_mean0.0019237044941317763
sim_compute_performance-ego2_median0.0019531546479062095
sim_compute_performance-ego2_min0.001854741878998585
sim_compute_performance-ego3_max0.0019337413060730993
sim_compute_performance-ego3_mean0.001899601152221556
sim_compute_performance-ego3_median0.00189663874797332
sim_compute_performance-ego3_min0.00186842340261825
sim_compute_sim_state_max0.020285712144313715
sim_compute_sim_state_mean0.015980184592706316
sim_compute_sim_state_median0.01871353604015291
sim_compute_sim_state_min0.007032542758517795
sim_render-ego0_max0.0037779153319838134
sim_render-ego0_mean0.003653941443201737
sim_render-ego0_median0.003746464766191514
sim_render-ego0_min0.0034940316126896784
sim_render-ego1_max0.003728465095085183
sim_render-ego1_mean0.0036488241702053695
sim_render-ego1_median0.00361939760354849
sim_render-ego1_min0.003599618679910734
sim_render-ego2_max0.0037462461060581943
sim_render-ego2_mean0.003673992889025211
sim_render-ego2_median0.0036707122091184626
sim_render-ego2_min0.003605020351898976
sim_render-ego3_max0.0037629159621006465
sim_render-ego3_mean0.0036306651572387753
sim_render-ego3_median0.0036015971589483608
sim_render-ego3_min0.003527482350667318
simulation-passed1
step_physics_max1.0144691363359108
step_physics_mean0.8069154061970094
step_physics_median0.9390295997184792
step_physics_min0.2365101831930655
survival_time_max19.45000000000014
survival_time_mean14.414285714285786
survival_time_min6.699999999999984

Highlights

53572

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.