Duckietown Challenges Home Challenges Submissions

Submission 13242

Submission13242
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserAndras Beres
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 61705
Next
User label212-2
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
61705LFVmultibodyv-simsuccessyes0:56:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.5943112571645157
survival_time_median12.700000000000044
deviation-center-line_median1.0095116747271689
in-drivable-lane_median1.3499999999999974


other stats
agent_compute-ego0_max0.01567651920540388
agent_compute-ego0_mean0.015247377484176051
agent_compute-ego0_median0.01555179895139208
agent_compute-ego0_min0.014576464668102408
agent_compute-ego1_max0.015114319558237114
agent_compute-ego1_mean0.01471757940952681
agent_compute-ego1_median0.014915524527083996
agent_compute-ego1_min0.0141757183726086
agent_compute-ego2_max0.01608925437450806
agent_compute-ego2_mean0.01551521539572784
agent_compute-ego2_median0.015450233571669634
agent_compute-ego2_min0.01500615824100583
agent_compute-ego3_max0.01851084547971905
agent_compute-ego3_mean0.016169277942296806
agent_compute-ego3_median0.015068452025568762
agent_compute-ego3_min0.014928536321602615
complete-iteration_max1.4444289665596155
complete-iteration_mean1.0691343744115525
complete-iteration_median1.0847073710241983
complete-iteration_min0.37158558938814246
deviation-center-line_max4.801677703308765
deviation-center-line_mean1.886453970974328
deviation-center-line_min0.26550048111849733
deviation-heading_max10.3722041035841
deviation-heading_mean4.813056401195494
deviation-heading_median3.0900519366397123
deviation-heading_min0.5902319101970654
driven_any_max28.423723433765232
driven_any_mean9.692387223840552
driven_any_median3.3742516204283053
driven_any_min0.479751872777434
driven_lanedir_consec_max24.106516417678684
driven_lanedir_consec_mean8.100429064114048
driven_lanedir_consec_min0.45745027155590456
driven_lanedir_max24.106516417678684
driven_lanedir_mean8.100429064114048
driven_lanedir_median2.5943112571645157
driven_lanedir_min0.45745027155590456
get_duckie_state_max1.3334806575331575e-06
get_duckie_state_mean1.272414060649292e-06
get_duckie_state_median1.2734847501553068e-06
get_duckie_state_min1.2283739836319634e-06
get_robot_state_max0.013947736385256744
get_robot_state_mean0.01283024628439802
get_robot_state_median0.013764438442155427
get_robot_state_min0.007072313972141432
get_state_dump_max0.009447341741517533
get_state_dump_mean0.008877068971393986
get_state_dump_median0.009266844917746151
get_state_dump_min0.006301561127538266
get_ui_image_max0.05174747354844037
get_ui_image_mean0.0453439646887162
get_ui_image_median0.0474829153653287
get_ui_image_min0.030848523844843326
in-drivable-lane_max9.899999999999787
in-drivable-lane_mean3.29642857142851
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1044736791943737, "get_ui_image": 0.04404922557431598, "step_physics": 0.9087376150974008, "survival_time": 8.549999999999986, "driven_lanedir": 1.1014518762648788, "get_state_dump": 0.009447341741517533, "get_robot_state": 0.013947736385256744, "sim_render-ego0": 0.003681695738504099, "sim_render-ego1": 0.0035904396411984467, "sim_render-ego2": 0.0035283357598060784, "sim_render-ego3": 0.0036022718562636266, "get_duckie_state": 1.3334806575331575e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.7423134497955477, "agent_compute-ego0": 0.01567651920540388, "agent_compute-ego1": 0.014915524527083996, "agent_compute-ego2": 0.01500615824100583, "agent_compute-ego3": 0.015068452025568762, "complete-iteration": 1.0847073710241983, "set_robot_commands": 0.0022641614426014037, "deviation-center-line": 0.5181717159414083, "driven_lanedir_consec": 1.1014518762648788, "sim_compute_sim_state": 0.016777315805124683, "sim_compute_performance-ego0": 0.001901237077491228, "sim_compute_performance-ego1": 0.001911604127218557, "sim_compute_performance-ego2": 0.0018515545268391457, "sim_compute_performance-ego3": 0.0018776114596876989}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.576350399825394, "get_ui_image": 0.04404922557431598, "step_physics": 0.9087376150974008, "survival_time": 8.549999999999986, "driven_lanedir": 2.5302561977696283, "get_state_dump": 0.009447341741517533, "get_robot_state": 0.013947736385256744, "sim_render-ego0": 0.003681695738504099, "sim_render-ego1": 0.0035904396411984467, "sim_render-ego2": 0.0035283357598060784, "sim_render-ego3": 0.0036022718562636266, "get_duckie_state": 1.3334806575331575e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 1.3844387685956143, "agent_compute-ego0": 0.01567651920540388, "agent_compute-ego1": 0.014915524527083996, "agent_compute-ego2": 0.01500615824100583, "agent_compute-ego3": 0.015068452025568762, "complete-iteration": 1.0847073710241983, "set_robot_commands": 0.0022641614426014037, "deviation-center-line": 0.7197657981263804, "driven_lanedir_consec": 2.5302561977696283, "sim_compute_sim_state": 0.016777315805124683, "sim_compute_performance-ego0": 0.001901237077491228, "sim_compute_performance-ego1": 0.001911604127218557, "sim_compute_performance-ego2": 0.0018515545268391457, "sim_compute_performance-ego3": 0.0018776114596876989}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.1721528410312168, "get_ui_image": 0.04404922557431598, "step_physics": 0.9087376150974008, "survival_time": 8.549999999999986, "driven_lanedir": 2.8753671861343366, "get_state_dump": 0.009447341741517533, "get_robot_state": 0.013947736385256744, "sim_render-ego0": 0.003681695738504099, "sim_render-ego1": 0.0035904396411984467, "sim_render-ego2": 0.0035283357598060784, "sim_render-ego3": 0.0036022718562636266, "get_duckie_state": 1.3334806575331575e-06, "in-drivable-lane": 0.5499999999999987, "deviation-heading": 1.3836106446779282, "agent_compute-ego0": 0.01567651920540388, "agent_compute-ego1": 0.014915524527083996, "agent_compute-ego2": 0.01500615824100583, "agent_compute-ego3": 0.015068452025568762, "complete-iteration": 1.0847073710241983, "set_robot_commands": 0.0022641614426014037, "deviation-center-line": 0.7171584684189609, "driven_lanedir_consec": 2.8753671861343366, "sim_compute_sim_state": 0.016777315805124683, "sim_compute_performance-ego0": 0.001901237077491228, "sim_compute_performance-ego1": 0.001911604127218557, "sim_compute_performance-ego2": 0.0018515545268391457, "sim_compute_performance-ego3": 0.0018776114596876989}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 0.9540955639156574, "get_ui_image": 0.04404922557431598, "step_physics": 0.9087376150974008, "survival_time": 8.549999999999986, "driven_lanedir": 0.924135989215492, "get_state_dump": 0.009447341741517533, "get_robot_state": 0.013947736385256744, "sim_render-ego0": 0.003681695738504099, "sim_render-ego1": 0.0035904396411984467, "sim_render-ego2": 0.0035283357598060784, "sim_render-ego3": 0.0036022718562636266, "get_duckie_state": 1.3334806575331575e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.670353369819835, "agent_compute-ego0": 0.01567651920540388, "agent_compute-ego1": 0.014915524527083996, "agent_compute-ego2": 0.01500615824100583, "agent_compute-ego3": 0.015068452025568762, "complete-iteration": 1.0847073710241983, "set_robot_commands": 0.0022641614426014037, "deviation-center-line": 1.065277955114003, "driven_lanedir_consec": 0.924135989215492, "sim_compute_sim_state": 0.016777315805124683, "sim_compute_performance-ego0": 0.001901237077491228, "sim_compute_performance-ego1": 0.001911604127218557, "sim_compute_performance-ego2": 0.0018515545268391457, "sim_compute_performance-ego3": 0.0018776114596876989}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 5.359791724696884, "get_ui_image": 0.05174747354844037, "step_physics": 1.2548717984966202, "survival_time": 12.700000000000044, "driven_lanedir": 4.507073928859709, "get_state_dump": 0.009266844917746151, "get_robot_state": 0.013764438442155427, "sim_render-ego0": 0.003664706735049977, "sim_render-ego1": 0.003629195456411324, "sim_render-ego2": 0.003711681739956725, "sim_render-ego3": 0.0036007525874119178, "get_duckie_state": 1.232296812768076e-06, "in-drivable-lane": 1.6999999999999984, "deviation-heading": 2.509750503459589, "agent_compute-ego0": 0.01555179895139208, "agent_compute-ego1": 0.015114319558237114, "agent_compute-ego2": 0.015450233571669634, "agent_compute-ego3": 0.014928536321602615, "complete-iteration": 1.4444289665596155, "set_robot_commands": 0.0022550695082720587, "deviation-center-line": 0.9537453943403348, "driven_lanedir_consec": 4.507073928859709, "sim_compute_sim_state": 0.022597759845210057, "sim_compute_performance-ego0": 0.0018861667782652611, "sim_compute_performance-ego1": 0.0018656076169481465, "sim_compute_performance-ego2": 0.001882466147927677, "sim_compute_performance-ego3": 0.0018960868611055265}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.159257159237933, "get_ui_image": 0.05174747354844037, "step_physics": 1.2548717984966202, "survival_time": 12.700000000000044, "driven_lanedir": 2.6583663165594027, "get_state_dump": 0.009266844917746151, "get_robot_state": 0.013764438442155427, "sim_render-ego0": 0.003664706735049977, "sim_render-ego1": 0.003629195456411324, "sim_render-ego2": 0.003711681739956725, "sim_render-ego3": 0.0036007525874119178, "get_duckie_state": 1.232296812768076e-06, "in-drivable-lane": 2.9999999999999893, "deviation-heading": 1.596059962612893, "agent_compute-ego0": 0.01555179895139208, "agent_compute-ego1": 0.015114319558237114, "agent_compute-ego2": 0.015450233571669634, "agent_compute-ego3": 0.014928536321602615, "complete-iteration": 1.4444289665596155, "set_robot_commands": 0.0022550695082720587, "deviation-center-line": 1.1721108111464615, "driven_lanedir_consec": 2.6583663165594027, "sim_compute_sim_state": 0.022597759845210057, "sim_compute_performance-ego0": 0.0018861667782652611, "sim_compute_performance-ego1": 0.0018656076169481465, "sim_compute_performance-ego2": 0.001882466147927677, "sim_compute_performance-ego3": 0.0018960868611055265}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.479751872777434, "get_ui_image": 0.05174747354844037, "step_physics": 1.2548717984966202, "survival_time": 12.700000000000044, "driven_lanedir": 0.45745027155590456, "get_state_dump": 0.009266844917746151, "get_robot_state": 0.013764438442155427, "sim_render-ego0": 0.003664706735049977, "sim_render-ego1": 0.003629195456411324, "sim_render-ego2": 0.003711681739956725, "sim_render-ego3": 0.0036007525874119178, "get_duckie_state": 1.232296812768076e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.848624275517376, "agent_compute-ego0": 0.01555179895139208, "agent_compute-ego1": 0.015114319558237114, "agent_compute-ego2": 0.015450233571669634, "agent_compute-ego3": 0.014928536321602615, "complete-iteration": 1.4444289665596155, "set_robot_commands": 0.0022550695082720587, "deviation-center-line": 0.8221530036981759, "driven_lanedir_consec": 0.45745027155590456, "sim_compute_sim_state": 0.022597759845210057, "sim_compute_performance-ego0": 0.0018861667782652611, "sim_compute_performance-ego1": 0.0018656076169481465, "sim_compute_performance-ego2": 0.001882466147927677, "sim_compute_performance-ego3": 0.0018960868611055265}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.6232433604369946, "get_ui_image": 0.05174747354844037, "step_physics": 1.2548717984966202, "survival_time": 12.700000000000044, "driven_lanedir": 0.595060344638601, "get_state_dump": 0.009266844917746151, "get_robot_state": 0.013764438442155427, "sim_render-ego0": 0.003664706735049977, "sim_render-ego1": 0.003629195456411324, "sim_render-ego2": 0.003711681739956725, "sim_render-ego3": 0.0036007525874119178, "get_duckie_state": 1.232296812768076e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.81073230505852, "agent_compute-ego0": 0.01555179895139208, "agent_compute-ego1": 0.015114319558237114, "agent_compute-ego2": 0.015450233571669634, "agent_compute-ego3": 0.014928536321602615, "complete-iteration": 1.4444289665596155, "set_robot_commands": 0.0022550695082720587, "deviation-center-line": 1.4215903291531395, "driven_lanedir_consec": 0.595060344638601, "sim_compute_sim_state": 0.022597759845210057, "sim_compute_performance-ego0": 0.0018861667782652611, "sim_compute_performance-ego1": 0.0018656076169481465, "sim_compute_performance-ego2": 0.001882466147927677, "sim_compute_performance-ego3": 0.0018960868611055265}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 28.413333512732574, "get_ui_image": 0.0474829153653287, "step_physics": 0.8197475789885637, "survival_time": 59.99999999999873, "driven_lanedir": 24.106516417678684, "get_state_dump": 0.009204774176846136, "get_robot_state": 0.013657530181910175, "sim_render-ego0": 0.003572198572404974, "sim_render-ego1": 0.0035642825197319903, "sim_render-ego2": 0.003521434472661332, "sim_render-ego3": 0.0034812072433103233, "get_duckie_state": 1.2734847501553068e-06, "in-drivable-lane": 8.9499999999998, "deviation-heading": 9.867930113112806, "agent_compute-ego0": 0.014576464668102408, "agent_compute-ego1": 0.0141757183726086, "agent_compute-ego2": 0.01608925437450806, "agent_compute-ego3": 0.01851084547971905, "complete-iteration": 1.0270411781625486, "set_robot_commands": 0.00218377006143257, "deviation-center-line": 4.570695186256905, "driven_lanedir_consec": 24.106516417678684, "sim_compute_sim_state": 0.043276276020682125, "sim_compute_performance-ego0": 0.0018603803712462109, "sim_compute_performance-ego1": 0.001850840253297931, "sim_compute_performance-ego2": 0.0018313240746872111, "sim_compute_performance-ego3": 0.001821065921767566}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 27.950479673486704, "get_ui_image": 0.0474829153653287, "step_physics": 0.8197475789885637, "survival_time": 59.99999999999873, "driven_lanedir": 23.204040499599845, "get_state_dump": 0.009204774176846136, "get_robot_state": 0.013657530181910175, "sim_render-ego0": 0.003572198572404974, "sim_render-ego1": 0.0035642825197319903, "sim_render-ego2": 0.003521434472661332, "sim_render-ego3": 0.0034812072433103233, "get_duckie_state": 1.2734847501553068e-06, "in-drivable-lane": 9.899999999999787, "deviation-heading": 10.259986306945054, "agent_compute-ego0": 0.014576464668102408, "agent_compute-ego1": 0.0141757183726086, "agent_compute-ego2": 0.01608925437450806, "agent_compute-ego3": 0.01851084547971905, "complete-iteration": 1.0270411781625486, "set_robot_commands": 0.00218377006143257, "deviation-center-line": 4.699752956514113, "driven_lanedir_consec": 23.204040499599845, "sim_compute_sim_state": 0.043276276020682125, "sim_compute_performance-ego0": 0.0018603803712462109, "sim_compute_performance-ego1": 0.001850840253297931, "sim_compute_performance-ego2": 0.0018313240746872111, "sim_compute_performance-ego3": 0.001821065921767566}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 28.04547641273988, "get_ui_image": 0.0474829153653287, "step_physics": 0.8197475789885637, "survival_time": 59.99999999999873, "driven_lanedir": 23.897707152458263, "get_state_dump": 0.009204774176846136, "get_robot_state": 0.013657530181910175, "sim_render-ego0": 0.003572198572404974, "sim_render-ego1": 0.0035642825197319903, "sim_render-ego2": 0.003521434472661332, "sim_render-ego3": 0.0034812072433103233, "get_duckie_state": 1.2734847501553068e-06, "in-drivable-lane": 8.5999999999998, "deviation-heading": 10.3722041035841, "agent_compute-ego0": 0.014576464668102408, "agent_compute-ego1": 0.0141757183726086, "agent_compute-ego2": 0.01608925437450806, "agent_compute-ego3": 0.01851084547971905, "complete-iteration": 1.0270411781625486, "set_robot_commands": 0.00218377006143257, "deviation-center-line": 4.801677703308765, "driven_lanedir_consec": 23.897707152458263, "sim_compute_sim_state": 0.043276276020682125, "sim_compute_performance-ego0": 0.0018603803712462109, "sim_compute_performance-ego1": 0.001850840253297931, "sim_compute_performance-ego2": 0.0018313240746872111, "sim_compute_performance-ego3": 0.001821065921767566}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 28.423723433765232, "get_ui_image": 0.0474829153653287, "step_physics": 0.8197475789885637, "survival_time": 59.99999999999873, "driven_lanedir": 23.82040404646734, "get_state_dump": 0.009204774176846136, "get_robot_state": 0.013657530181910175, "sim_render-ego0": 0.003572198572404974, "sim_render-ego1": 0.0035642825197319903, "sim_render-ego2": 0.003521434472661332, "sim_render-ego3": 0.0034812072433103233, "get_duckie_state": 1.2734847501553068e-06, "in-drivable-lane": 9.34999999999978, "deviation-heading": 10.300315232750188, "agent_compute-ego0": 0.014576464668102408, "agent_compute-ego1": 0.0141757183726086, "agent_compute-ego2": 0.01608925437450806, "agent_compute-ego3": 0.01851084547971905, "complete-iteration": 1.0270411781625486, "set_robot_commands": 0.00218377006143257, "deviation-center-line": 4.3241176560638515, "driven_lanedir_consec": 23.82040404646734, "sim_compute_sim_state": 0.043276276020682125, "sim_compute_performance-ego0": 0.0018603803712462109, "sim_compute_performance-ego1": 0.001850840253297931, "sim_compute_performance-ego2": 0.0018313240746872111, "sim_compute_performance-ego3": 0.001821065921767566}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.788908792608217, "get_ui_image": 0.030848523844843326, "step_physics": 0.2730093416960343, "survival_time": 4.549999999999992, "driven_lanedir": 1.271154037675654, "get_state_dump": 0.006301561127538266, "get_robot_state": 0.007072313972141432, "sim_render-ego0": 0.003684489623360012, "sim_render-ego1": 0.0035714222037273903, "get_duckie_state": 1.2283739836319634e-06, "in-drivable-lane": 0.9499999999999966, "deviation-heading": 0.5902319101970654, "agent_compute-ego0": 0.01512207673943561, "agent_compute-ego1": 0.01461193095082822, "complete-iteration": 0.37158558938814246, "set_robot_commands": 0.002189548119254734, "deviation-center-line": 0.3586381344395899, "driven_lanedir_consec": 1.271154037675654, "sim_compute_sim_state": 0.009027105310688848, "sim_compute_performance-ego0": 0.0019190751987954843, "sim_compute_performance-ego1": 0.0018962492113528044}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6423827073192532, "get_ui_image": 0.030848523844843326, "step_physics": 0.2730093416960343, "survival_time": 4.549999999999992, "driven_lanedir": 1.4570226327189015, "get_state_dump": 0.006301561127538266, "get_robot_state": 0.007072313972141432, "sim_render-ego0": 0.003684489623360012, "sim_render-ego1": 0.0035714222037273903, "get_duckie_state": 1.2283739836319634e-06, "in-drivable-lane": 0.9999999999999968, "deviation-heading": 1.0462386706103912, "agent_compute-ego0": 0.01512207673943561, "agent_compute-ego1": 0.01461193095082822, "complete-iteration": 0.37158558938814246, "set_robot_commands": 0.002189548119254734, "deviation-center-line": 0.26550048111849733, "driven_lanedir_consec": 1.4570226327189015, "sim_compute_sim_state": 0.009027105310688848, "sim_compute_performance-ego0": 0.0019190751987954843, "sim_compute_performance-ego1": 0.0018962492113528044}}
set_robot_commands_max0.0022641614426014037
set_robot_commands_mean0.002227935734838114
set_robot_commands_median0.0022550695082720587
set_robot_commands_min0.00218377006143257
sim_compute_performance-ego0_max0.0019190751987954843
sim_compute_performance-ego0_mean0.0018878062361144116
sim_compute_performance-ego0_median0.0018861667782652611
sim_compute_performance-ego0_min0.0018603803712462109
sim_compute_performance-ego1_max0.001911604127218557
sim_compute_performance-ego1_mean0.0018789076008974388
sim_compute_performance-ego1_median0.0018656076169481465
sim_compute_performance-ego1_min0.001850840253297931
sim_compute_performance-ego2_max0.001882466147927677
sim_compute_performance-ego2_mean0.0018551149164846776
sim_compute_performance-ego2_median0.0018515545268391457
sim_compute_performance-ego2_min0.0018313240746872111
sim_compute_performance-ego3_max0.0018960868611055265
sim_compute_performance-ego3_mean0.00186492141418693
sim_compute_performance-ego3_median0.0018776114596876989
sim_compute_performance-ego3_min0.001821065921767566
sim_compute_sim_state_max0.043276276020682125
sim_compute_sim_state_mean0.02490425837896037
sim_compute_sim_state_median0.022597759845210057
sim_compute_sim_state_min0.009027105310688848
sim_render-ego0_max0.003684489623360012
sim_render-ego0_mean0.003645955959325445
sim_render-ego0_median0.003664706735049977
sim_render-ego0_min0.003572198572404974
sim_render-ego1_max0.003629195456411324
sim_render-ego1_mean0.0035913224912015587
sim_render-ego1_median0.0035904396411984467
sim_render-ego1_min0.0035642825197319903
sim_render-ego2_max0.003711681739956725
sim_render-ego2_mean0.0035871506574747113
sim_render-ego2_median0.0035283357598060784
sim_render-ego2_min0.003521434472661332
sim_render-ego3_max0.0036022718562636266
sim_render-ego3_mean0.0035614105623286226
sim_render-ego3_median0.0036007525874119178
sim_render-ego3_min0.0034812072433103233
simulation-passed1
step_physics_max1.2548717984966202
step_physics_mean0.8913890466944575
step_physics_median0.9087376150974008
step_physics_min0.2730093416960343
survival_time_max59.99999999999873
survival_time_mean23.86428571428536
survival_time_min4.549999999999992
No reset possible