Duckietown Challenges Home Challenges Submissions

Job 60244

Job ID60244
submission13001
userMárton Tim 🇭🇺
user labeltest_submit
challengeaido5-LFV_multi-sim-validation
stepLFVmultibodyv-sim
statussuccess
up to dateyes
evaluatorgpu-prod-01
date started
date completed
duration1:15:56
message
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.120773585036747
survival_time_median36.650000000000055
deviation-center-line_median2.54127381833466
in-drivable-lane_median0.9000000000000039


other stats
agent_compute-ego0_max0.04267111831987408
agent_compute-ego0_mean0.04243040818371514
agent_compute-ego0_median0.04256291382968913
agent_compute-ego0_min0.041750682431687294
agent_compute-ego1_max0.042791093026360576
agent_compute-ego1_mean0.04215412628726749
agent_compute-ego1_median0.04213520031858855
agent_compute-ego1_min0.04099711949676575
agent_compute-ego2_max0.042116883719898295
agent_compute-ego2_mean0.04203957804643157
agent_compute-ego2_median0.042085269816240105
agent_compute-ego2_min0.04191658060315629
agent_compute-ego3_max0.04233468719934036
agent_compute-ego3_mean0.04189776256383446
agent_compute-ego3_median0.042071589332185584
agent_compute-ego3_min0.04128701115997744
complete-iteration_max1.4214498990729114
complete-iteration_mean1.1750496995659885
complete-iteration_median1.324746992890264
complete-iteration_min0.4161225463782758
deviation-center-line_max4.994399378554465
deviation-center-line_mean2.409545947122364
deviation-center-line_min1.103559339025059
deviation-heading_max14.890700323041496
deviation-heading_mean8.535831952173902
deviation-heading_median8.179603682049457
deviation-heading_min2.913480780430086
driven_any_max16.2537310439634
driven_any_mean7.982442669851723
driven_any_median8.480141708634637
driven_any_min0.6745496252070083
driven_lanedir_consec_max13.516781317995411
driven_lanedir_consec_mean6.8426580212028085
driven_lanedir_consec_min0.6207594423548879
driven_lanedir_max13.516781317995411
driven_lanedir_mean6.8426580212028085
driven_lanedir_median7.120773585036747
driven_lanedir_min0.6207594423548879
get_duckie_state_max1.4763112289054518e-06
get_duckie_state_mean1.3746322656952065e-06
get_duckie_state_median1.3861857669454226e-06
get_duckie_state_min1.2856374084349849e-06
get_robot_state_max0.014125753813283645
get_robot_state_mean0.0129395600265988
get_robot_state_median0.013869614384937046
get_robot_state_min0.006969297435921683
get_state_dump_max0.009629061501422434
get_state_dump_mean0.008941864817034021
get_state_dump_median0.009351497300913636
get_state_dump_min0.006041691816548706
get_ui_image_max0.05005711602323902
get_ui_image_mean0.04397235540959672
get_ui_image_median0.04655088102313834
get_ui_image_min0.029603368559593647
in-drivable-lane_max4.4499999999999655
in-drivable-lane_mean1.132142857142863
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 12.641444934608552, "get_ui_image": 0.04249356260741439, "step_physics": 0.8670211822525357, "survival_time": 36.650000000000055, "driven_lanedir": 11.223088056305375, "get_state_dump": 0.009629061501422434, "get_robot_state": 0.014125753813283645, "sim_render-ego0": 0.003755351827969668, "sim_render-ego1": 0.003737536698011351, "sim_render-ego2": 0.0036632365037050168, "sim_render-ego3": 0.003700443769345816, "get_duckie_state": 1.4763112289054518e-06, "in-drivable-lane": 1.0000000000000142, "deviation-heading": 14.890700323041496, "agent_compute-ego0": 0.04256291382968913, "agent_compute-ego1": 0.04213520031858855, "agent_compute-ego2": 0.042085269816240105, "agent_compute-ego3": 0.042071589332185584, "complete-iteration": 1.158415783328646, "set_robot_commands": 0.00224104629225562, "deviation-center-line": 2.5532599075117512, "driven_lanedir_consec": 11.223088056305375, "sim_compute_sim_state": 0.02432744054768326, "sim_compute_performance-ego0": 0.0020180524857232617, "sim_compute_performance-ego1": 0.001992371166759356, "sim_compute_performance-ego2": 0.001934180792410952, "sim_compute_performance-ego3": 0.001986980438232422}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 15.30204750684708, "get_ui_image": 0.04249356260741439, "step_physics": 0.8670211822525357, "survival_time": 36.650000000000055, "driven_lanedir": 13.516781317995411, "get_state_dump": 0.009629061501422434, "get_robot_state": 0.014125753813283645, "sim_render-ego0": 0.003755351827969668, "sim_render-ego1": 0.003737536698011351, "sim_render-ego2": 0.0036632365037050168, "sim_render-ego3": 0.003700443769345816, "get_duckie_state": 1.4763112289054518e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 13.29189447463689, "agent_compute-ego0": 0.04256291382968913, "agent_compute-ego1": 0.04213520031858855, "agent_compute-ego2": 0.042085269816240105, "agent_compute-ego3": 0.042071589332185584, "complete-iteration": 1.158415783328646, "set_robot_commands": 0.00224104629225562, "deviation-center-line": 2.679301492981796, "driven_lanedir_consec": 13.516781317995411, "sim_compute_sim_state": 0.02432744054768326, "sim_compute_performance-ego0": 0.0020180524857232617, "sim_compute_performance-ego1": 0.001992371166759356, "sim_compute_performance-ego2": 0.001934180792410952, "sim_compute_performance-ego3": 0.001986980438232422}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.841588398370817, "get_ui_image": 0.04249356260741439, "step_physics": 0.8670211822525357, "survival_time": 36.650000000000055, "driven_lanedir": 7.260550429010049, "get_state_dump": 0.009629061501422434, "get_robot_state": 0.014125753813283645, "sim_render-ego0": 0.003755351827969668, "sim_render-ego1": 0.003737536698011351, "sim_render-ego2": 0.0036632365037050168, "sim_render-ego3": 0.003700443769345816, "get_duckie_state": 1.4763112289054518e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 10.154705870949591, "agent_compute-ego0": 0.04256291382968913, "agent_compute-ego1": 0.04213520031858855, "agent_compute-ego2": 0.042085269816240105, "agent_compute-ego3": 0.042071589332185584, "complete-iteration": 1.158415783328646, "set_robot_commands": 0.00224104629225562, "deviation-center-line": 4.123334387361636, "driven_lanedir_consec": 7.260550429010049, "sim_compute_sim_state": 0.02432744054768326, "sim_compute_performance-ego0": 0.0020180524857232617, "sim_compute_performance-ego1": 0.001992371166759356, "sim_compute_performance-ego2": 0.001934180792410952, "sim_compute_performance-ego3": 0.001986980438232422}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.992529737033513, "get_ui_image": 0.04249356260741439, "step_physics": 0.8670211822525357, "survival_time": 36.650000000000055, "driven_lanedir": 8.377646889489755, "get_state_dump": 0.009629061501422434, "get_robot_state": 0.014125753813283645, "sim_render-ego0": 0.003755351827969668, "sim_render-ego1": 0.003737536698011351, "sim_render-ego2": 0.0036632365037050168, "sim_render-ego3": 0.003700443769345816, "get_duckie_state": 1.4763112289054518e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.700035467789704, "agent_compute-ego0": 0.04256291382968913, "agent_compute-ego1": 0.04213520031858855, "agent_compute-ego2": 0.042085269816240105, "agent_compute-ego3": 0.042071589332185584, "complete-iteration": 1.158415783328646, "set_robot_commands": 0.00224104629225562, "deviation-center-line": 2.016310139088805, "driven_lanedir_consec": 8.377646889489755, "sim_compute_sim_state": 0.02432744054768326, "sim_compute_performance-ego0": 0.0020180524857232617, "sim_compute_performance-ego1": 0.001992371166759356, "sim_compute_performance-ego2": 0.001934180792410952, "sim_compute_performance-ego3": 0.001986980438232422}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 16.2537310439634, "get_ui_image": 0.05005711602323902, "step_physics": 1.1227289234060485, "survival_time": 39.649999999999885, "driven_lanedir": 12.869625677399508, "get_state_dump": 0.009295122149008649, "get_robot_state": 0.013869614384937046, "sim_render-ego0": 0.0036430259795873538, "sim_render-ego1": 0.0036890455697585712, "sim_render-ego2": 0.003630255571840992, "sim_render-ego3": 0.0036156063416142303, "get_duckie_state": 1.3058972298648557e-06, "in-drivable-lane": 4.4499999999999655, "deviation-heading": 14.316467491868906, "agent_compute-ego0": 0.04239705527759619, "agent_compute-ego1": 0.042791093026360576, "agent_compute-ego2": 0.042116883719898295, "agent_compute-ego3": 0.04233468719934036, "complete-iteration": 1.4214498990729114, "set_robot_commands": 0.0022169922100807016, "deviation-center-line": 2.6342036043012858, "driven_lanedir_consec": 12.869625677399508, "sim_compute_sim_state": 0.024651126236999665, "sim_compute_performance-ego0": 0.0019138895294227888, "sim_compute_performance-ego1": 0.0019105786940913356, "sim_compute_performance-ego2": 0.001944613096395728, "sim_compute_performance-ego3": 0.0019187780111202368}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.084062203960533, "get_ui_image": 0.05005711602323902, "step_physics": 1.1227289234060485, "survival_time": 39.649999999999885, "driven_lanedir": 3.3111816608421885, "get_state_dump": 0.009295122149008649, "get_robot_state": 0.013869614384937046, "sim_render-ego0": 0.0036430259795873538, "sim_render-ego1": 0.0036890455697585712, "sim_render-ego2": 0.003630255571840992, "sim_render-ego3": 0.0036156063416142303, "get_duckie_state": 1.3058972298648557e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 4.539486507995271, "agent_compute-ego0": 0.04239705527759619, "agent_compute-ego1": 0.042791093026360576, "agent_compute-ego2": 0.042116883719898295, "agent_compute-ego3": 0.04233468719934036, "complete-iteration": 1.4214498990729114, "set_robot_commands": 0.0022169922100807016, "deviation-center-line": 2.628478000735534, "driven_lanedir_consec": 3.3111816608421885, "sim_compute_sim_state": 0.024651126236999665, "sim_compute_performance-ego0": 0.0019138895294227888, "sim_compute_performance-ego1": 0.0019105786940913356, "sim_compute_performance-ego2": 0.001944613096395728, "sim_compute_performance-ego3": 0.0019187780111202368}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 8.118695018898455, "get_ui_image": 0.05005711602323902, "step_physics": 1.1227289234060485, "survival_time": 39.649999999999885, "driven_lanedir": 6.0935276210584135, "get_state_dump": 0.009295122149008649, "get_robot_state": 0.013869614384937046, "sim_render-ego0": 0.0036430259795873538, "sim_render-ego1": 0.0036890455697585712, "sim_render-ego2": 0.003630255571840992, "sim_render-ego3": 0.0036156063416142303, "get_duckie_state": 1.3058972298648557e-06, "in-drivable-lane": 2.750000000000017, "deviation-heading": 8.157938187602044, "agent_compute-ego0": 0.04239705527759619, "agent_compute-ego1": 0.042791093026360576, "agent_compute-ego2": 0.042116883719898295, "agent_compute-ego3": 0.04233468719934036, "complete-iteration": 1.4214498990729114, "set_robot_commands": 0.0022169922100807016, "deviation-center-line": 2.529287729157569, "driven_lanedir_consec": 6.0935276210584135, "sim_compute_sim_state": 0.024651126236999665, "sim_compute_performance-ego0": 0.0019138895294227888, "sim_compute_performance-ego1": 0.0019105786940913356, "sim_compute_performance-ego2": 0.001944613096395728, "sim_compute_performance-ego3": 0.0019187780111202368}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 3.954737619993782, "get_ui_image": 0.05005711602323902, "step_physics": 1.1227289234060485, "survival_time": 39.649999999999885, "driven_lanedir": 3.4686189517249786, "get_state_dump": 0.009295122149008649, "get_robot_state": 0.013869614384937046, "sim_render-ego0": 0.0036430259795873538, "sim_render-ego1": 0.0036890455697585712, "sim_render-ego2": 0.003630255571840992, "sim_render-ego3": 0.0036156063416142303, "get_duckie_state": 1.3058972298648557e-06, "in-drivable-lane": 0.04999999999999982, "deviation-heading": 7.7473238717036175, "agent_compute-ego0": 0.04239705527759619, "agent_compute-ego1": 0.042791093026360576, "agent_compute-ego2": 0.042116883719898295, "agent_compute-ego3": 0.04233468719934036, "complete-iteration": 1.4214498990729114, "set_robot_commands": 0.0022169922100807016, "deviation-center-line": 4.994399378554465, "driven_lanedir_consec": 3.4686189517249786, "sim_compute_sim_state": 0.024651126236999665, "sim_compute_performance-ego0": 0.0019138895294227888, "sim_compute_performance-ego1": 0.0019105786940913356, "sim_compute_performance-ego2": 0.001944613096395728, "sim_compute_performance-ego3": 0.0019187780111202368}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.6745496252070083, "get_ui_image": 0.04655088102313834, "step_physics": 1.0373539051539462, "survival_time": 17.700000000000117, "driven_lanedir": 0.6207594423548879, "get_state_dump": 0.009351497300913636, "get_robot_state": 0.013808443176914268, "sim_render-ego0": 0.0037078877569923937, "sim_render-ego1": 0.003672914773645535, "sim_render-ego2": 0.0036072079564484073, "sim_render-ego3": 0.003603532952322086, "get_duckie_state": 1.3861857669454226e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.913480780430086, "agent_compute-ego0": 0.04267111831987408, "agent_compute-ego1": 0.04211458891210422, "agent_compute-ego2": 0.04191658060315629, "agent_compute-ego3": 0.04128701115997744, "complete-iteration": 1.324746992890264, "set_robot_commands": 0.002190495208955147, "deviation-center-line": 2.731405470307207, "driven_lanedir_consec": 0.6207594423548879, "sim_compute_sim_state": 0.01820524041081818, "sim_compute_performance-ego0": 0.0019246867005254184, "sim_compute_performance-ego1": 0.001993856967335016, "sim_compute_performance-ego2": 0.001910936328726755, "sim_compute_performance-ego3": 0.001945181967506946}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.489403466282273, "get_ui_image": 0.04655088102313834, "step_physics": 1.0373539051539462, "survival_time": 17.700000000000117, "driven_lanedir": 6.980996741063445, "get_state_dump": 0.009351497300913636, "get_robot_state": 0.013808443176914268, "sim_render-ego0": 0.0037078877569923937, "sim_render-ego1": 0.003672914773645535, "sim_render-ego2": 0.0036072079564484073, "sim_render-ego3": 0.003603532952322086, "get_duckie_state": 1.3861857669454226e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.340860385851225, "agent_compute-ego0": 0.04267111831987408, "agent_compute-ego1": 0.04211458891210422, "agent_compute-ego2": 0.04191658060315629, "agent_compute-ego3": 0.04128701115997744, "complete-iteration": 1.324746992890264, "set_robot_commands": 0.002190495208955147, "deviation-center-line": 1.1785418138939467, "driven_lanedir_consec": 6.980996741063445, "sim_compute_sim_state": 0.01820524041081818, "sim_compute_performance-ego0": 0.0019246867005254184, "sim_compute_performance-ego1": 0.001993856967335016, "sim_compute_performance-ego2": 0.001910936328726755, "sim_compute_performance-ego3": 0.001945181967506946}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.8517988588702526, "get_ui_image": 0.04655088102313834, "step_physics": 1.0373539051539462, "survival_time": 17.700000000000117, "driven_lanedir": 0.8397871322535113, "get_state_dump": 0.009351497300913636, "get_robot_state": 0.013808443176914268, "sim_render-ego0": 0.0037078877569923937, "sim_render-ego1": 0.003672914773645535, "sim_render-ego2": 0.0036072079564484073, "sim_render-ego3": 0.003603532952322086, "get_duckie_state": 1.3861857669454226e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.0254717262869755, "agent_compute-ego0": 0.04267111831987408, "agent_compute-ego1": 0.04211458891210422, "agent_compute-ego2": 0.04191658060315629, "agent_compute-ego3": 0.04128701115997744, "complete-iteration": 1.324746992890264, "set_robot_commands": 0.002190495208955147, "deviation-center-line": 1.3443343293752832, "driven_lanedir_consec": 0.8397871322535113, "sim_compute_sim_state": 0.01820524041081818, "sim_compute_performance-ego0": 0.0019246867005254184, "sim_compute_performance-ego1": 0.001993856967335016, "sim_compute_performance-ego2": 0.001910936328726755, "sim_compute_performance-ego3": 0.001945181967506946}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.960869681289189, "get_ui_image": 0.04655088102313834, "step_physics": 1.0373539051539462, "survival_time": 17.700000000000117, "driven_lanedir": 3.346412864947173, "get_state_dump": 0.009351497300913636, "get_robot_state": 0.013808443176914268, "sim_render-ego0": 0.0037078877569923937, "sim_render-ego1": 0.003672914773645535, "sim_render-ego2": 0.0036072079564484073, "sim_render-ego3": 0.003603532952322086, "get_duckie_state": 1.3861857669454226e-06, "in-drivable-lane": 0.5000000000000009, "deviation-heading": 5.5282293356571035, "agent_compute-ego0": 0.04267111831987408, "agent_compute-ego1": 0.04211458891210422, "agent_compute-ego2": 0.04191658060315629, "agent_compute-ego3": 0.04128701115997744, "complete-iteration": 1.324746992890264, "set_robot_commands": 0.002190495208955147, "deviation-center-line": 1.103559339025059, "driven_lanedir_consec": 3.346412864947173, "sim_compute_sim_state": 0.01820524041081818, "sim_compute_performance-ego0": 0.0019246867005254184, "sim_compute_performance-ego1": 0.001993856967335016, "sim_compute_performance-ego2": 0.001910936328726755, "sim_compute_performance-ego3": 0.001945181967506946}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 10.407095930312746, "get_ui_image": 0.029603368559593647, "step_physics": 0.2650477934171496, "survival_time": 24.800000000000217, "driven_lanedir": 9.115128786568768, "get_state_dump": 0.006041691816548706, "get_robot_state": 0.006969297435921683, "sim_render-ego0": 0.003647291924152336, "sim_render-ego1": 0.00363049372820787, "get_duckie_state": 1.2856374084349849e-06, "in-drivable-lane": 0.8500000000000112, "deviation-heading": 8.693783730124823, "agent_compute-ego0": 0.041750682431687294, "agent_compute-ego1": 0.04099711949676575, "complete-iteration": 0.4161225463782758, "set_robot_commands": 0.0020872673518221143, "deviation-center-line": 1.6220771262628622, "driven_lanedir_consec": 9.115128786568768, "sim_compute_sim_state": 0.01031506277425908, "sim_compute_performance-ego0": 0.0018893933632004429, "sim_compute_performance-ego1": 0.001925068362138161}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 10.181643352286548, "get_ui_image": 0.029603368559593647, "step_physics": 0.2650477934171496, "survival_time": 24.800000000000217, "driven_lanedir": 8.773106725825873, "get_state_dump": 0.006041691816548706, "get_robot_state": 0.006969297435921683, "sim_render-ego0": 0.003647291924152336, "sim_render-ego1": 0.00363049372820787, "get_duckie_state": 1.2856374084349849e-06, "in-drivable-lane": 2.10000000000003, "deviation-heading": 8.201269176496872, "agent_compute-ego0": 0.041750682431687294, "agent_compute-ego1": 0.04099711949676575, "complete-iteration": 0.4161225463782758, "set_robot_commands": 0.0020872673518221143, "deviation-center-line": 1.595150541155896, "driven_lanedir_consec": 8.773106725825873, "sim_compute_sim_state": 0.01031506277425908, "sim_compute_performance-ego0": 0.0018893933632004429, "sim_compute_performance-ego1": 0.001925068362138161}}
set_robot_commands_max0.00224104629225562
set_robot_commands_mean0.0021977621106292924
set_robot_commands_median0.0022169922100807016
set_robot_commands_min0.0020872673518221143
sim_compute_performance-ego0_max0.0020180524857232617
sim_compute_performance-ego0_mean0.0019432358277919112
sim_compute_performance-ego0_median0.0019246867005254184
sim_compute_performance-ego0_min0.0018893933632004429
sim_compute_performance-ego1_max0.001993856967335016
sim_compute_performance-ego1_mean0.0019598117169299396
sim_compute_performance-ego1_median0.001992371166759356
sim_compute_performance-ego1_min0.0019105786940913356
sim_compute_performance-ego2_max0.001944613096395728
sim_compute_performance-ego2_mean0.0019299100725111453
sim_compute_performance-ego2_median0.001934180792410952
sim_compute_performance-ego2_min0.001910936328726755
sim_compute_performance-ego3_max0.001986980438232422
sim_compute_performance-ego3_mean0.001950313472286535
sim_compute_performance-ego3_median0.001945181967506946
sim_compute_performance-ego3_min0.0019187780111202368
sim_compute_sim_state_max0.024651126236999665
sim_compute_sim_state_mean0.02066895388075161
sim_compute_sim_state_median0.02432744054768326
sim_compute_sim_state_min0.01031506277425908
sim_render-ego0_max0.003755351827969668
sim_render-ego0_mean0.0036942604361787377
sim_render-ego0_median0.0037078877569923937
sim_render-ego0_min0.0036430259795873538
sim_render-ego1_max0.003737536698011351
sim_render-ego1_mean0.003689926830148398
sim_render-ego1_median0.0036890455697585712
sim_render-ego1_min0.00363049372820787
sim_render-ego2_max0.0036632365037050168
sim_render-ego2_mean0.003633566677331472
sim_render-ego2_median0.003630255571840992
sim_render-ego2_min0.0036072079564484073
sim_render-ego3_max0.003700443769345816
sim_render-ego3_mean0.003639861021094045
sim_render-ego3_median0.0036156063416142303
sim_render-ego3_min0.003603532952322086
simulation-passed1
step_physics_max1.1227289234060485
step_physics_mean0.9027508307203156
step_physics_median1.0373539051539462
step_physics_min0.2650477934171496
survival_time_max39.649999999999885
survival_time_mean30.40000000000004
survival_time_min17.700000000000117

Highlights

60244

Click the images to see detailed statistics about the episode.

LFV_multi-norm-loop-000

LFV_multi-norm-small_loop-000

LFV_multi-norm-techtrack-000

LFV_multi-norm-zigzag-000

challenge-solution-output

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.