Job 87667

Job ID	87667
submission	14820
user	Bea Baselines 🐤
user label	straight
challenge	aido-LFV_multi-sim-testing
step	426
status	success
up to date	yes
evaluator	nogpu-production-b-spot-0-01
date started	2021-10-18 21:48:54+00:00
date completed	2021-10-18 22:01:02+00:00
duration	0:12:08
message
	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
	survival_time_median 18.525000000000126 in-drivable-lane_median 14.00000000000014 driven_lanedir_consec_median 0.2992957315044227 deviation-center-line_median 0.2801542655121556 other stats agent_compute-ego0_max 0.00996838871381024 agent_compute-ego0_mean 0.009778747375290484 agent_compute-ego0_median 0.009778747375290484 agent_compute-ego0_min 0.009589106036770729 agent_compute-ego1_max 0.009144110064352713 agent_compute-ego1_mean 0.009060518522070031 agent_compute-ego1_median 0.009060518522070031 agent_compute-ego1_min 0.008976926979787355 agent_compute-ego2_max 0.009501657947417228 agent_compute-ego2_mean 0.00939304326424822 agent_compute-ego2_median 0.00939304326424822 agent_compute-ego2_min 0.009284428581079217 agent_compute-ego3_max 0.009543368777832312 agent_compute-ego3_mean 0.009409853277623472 agent_compute-ego3_median 0.009409853277623472 agent_compute-ego3_min 0.00927633777741463 complete-iteration_max 0.32597185488670105 complete-iteration_mean 0.3239405776681199 complete-iteration_median 0.3239405776681199 complete-iteration_min 0.32190930044953875 deviation-center-line_max 0.4630011560225056 deviation-center-line_mean 0.2688244965968186 deviation-center-line_min 0.12493966733272112 deviation-heading_max 2.680905793621579 deviation-heading_mean 1.5606570833555142 deviation-heading_median 1.185667811195002 deviation-heading_min 0.7908717500681216 distance-from-start_max 3.400473892129533 distance-from-start_mean 1.6410065116145356 distance-from-start_median 1.4390370207990508 distance-from-start_min 0.8367542263545045 driven_any_max 3.401196466784495 driven_any_mean 1.6412150710284563 driven_any_median 1.4391692332179122 driven_any_min 0.8367707339529249 driven_lanedir_consec_max 1.1975992089636844 driven_lanedir_consec_mean 0.4775055678748067 driven_lanedir_consec_min 0.1443938494610213 driven_lanedir_max 1.1975992089636844 driven_lanedir_mean 0.4775055678748067 driven_lanedir_median 0.2992957315044227 driven_lanedir_min 0.1443938494610213 get_duckie_state_max 2.357267564342868e-06 get_duckie_state_mean 2.1543329095801376e-06 get_duckie_state_median 2.1543329095801376e-06 get_duckie_state_min 1.951398254817407e-06 get_robot_state_max 0.013217716832314768 get_robot_state_mean 0.012922871767351136 get_robot_state_median 0.012922871767351136 get_robot_state_min 0.012628026702387505 get_state_dump_max 0.008659525840513167 get_state_dump_mean 0.008536769698489079 get_state_dump_median 0.008536769698489079 get_state_dump_min 0.00841401355646499 get_ui_image_max 0.06162370174161849 get_ui_image_mean 0.05692249309694253 get_ui_image_median 0.05692249309694253 get_ui_image_min 0.05222128445226656 in-drivable-lane_max 19.95000000000017 in-drivable-lane_mean 14.83750000000013 in-drivable-lane_min 12.10000000000006 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9367765102877108, "get_ui_image": 0.06162370174161849, "step_physics": 0.16076082414196383, "survival_time": 15.450000000000085, "driven_lanedir": 0.2679591433665225, "get_state_dump": 0.008659525840513167, "get_robot_state": 0.013217716832314768, "sim_render-ego0": 0.003457966927559145, "sim_render-ego1": 0.003314875018212103, "sim_render-ego2": 0.0034216665452526463, "sim_render-ego3": 0.0033354413124822803, "get_duckie_state": 2.357267564342868e-06, "in-drivable-lane": 12.55000000000009, "deviation-heading": 2.3794020199395867, "agent_compute-ego0": 0.009589106036770729, "agent_compute-ego1": 0.009144110064352713, "agent_compute-ego2": 0.009501657947417228, "agent_compute-ego3": 0.00927633777741463, "complete-iteration": 0.32597185488670105, "set_robot_commands": 0.0019929239826817664, "distance-from-start": 0.9366464336460611, "deviation-center-line": 0.27953678734795573, "driven_lanedir_consec": 0.2679591433665225, "sim_compute_sim_state": 0.015461577907685311, "sim_compute_performance-ego0": 0.001833358118610997, "sim_compute_performance-ego1": 0.0016980848004741053, "sim_compute_performance-ego2": 0.0017012634584980626, "sim_compute_performance-ego3": 0.0017074384996967932}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 0.9367765102875368, "get_ui_image": 0.06162370174161849, "step_physics": 0.16076082414196383, "survival_time": 15.450000000000085, "driven_lanedir": 0.1963700234252523, "get_state_dump": 0.008659525840513167, "get_robot_state": 0.013217716832314768, "sim_render-ego0": 0.003457966927559145, "sim_render-ego1": 0.003314875018212103, "sim_render-ego2": 0.0034216665452526463, "sim_render-ego3": 0.0033354413124822803, "get_duckie_state": 2.357267564342868e-06, "in-drivable-lane": 13.650000000000084, "deviation-heading": 1.0634182036828437, "agent_compute-ego0": 0.009589106036770729, "agent_compute-ego1": 0.009144110064352713, "agent_compute-ego2": 0.009501657947417228, "agent_compute-ego3": 0.00927633777741463, "complete-iteration": 0.32597185488670105, "set_robot_commands": 0.0019929239826817664, "distance-from-start": 0.9366464336460576, "deviation-center-line": 0.12572776108176023, "driven_lanedir_consec": 0.1963700234252523, "sim_compute_sim_state": 0.015461577907685311, "sim_compute_performance-ego0": 0.001833358118610997, "sim_compute_performance-ego1": 0.0016980848004741053, "sim_compute_performance-ego2": 0.0017012634584980626, "sim_compute_performance-ego3": 0.0017074384996967932}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.3732070962283656, "get_ui_image": 0.06162370174161849, "step_physics": 0.16076082414196383, "survival_time": 15.450000000000085, "driven_lanedir": 0.33063231964232287, "get_state_dump": 0.008659525840513167, "get_robot_state": 0.013217716832314768, "sim_render-ego0": 0.003457966927559145, "sim_render-ego1": 0.003314875018212103, "sim_render-ego2": 0.0034216665452526463, "sim_render-ego3": 0.0033354413124822803, "get_duckie_state": 2.357267564342868e-06, "in-drivable-lane": 12.10000000000006, "deviation-heading": 2.680905793621579, "agent_compute-ego0": 0.009589106036770729, "agent_compute-ego1": 0.009144110064352713, "agent_compute-ego2": 0.009501657947417228, "agent_compute-ego3": 0.00927633777741463, "complete-iteration": 0.32597185488670105, "set_robot_commands": 0.0019929239826817664, "distance-from-start": 2.372912275341674, "deviation-center-line": 0.28077174367635543, "driven_lanedir_consec": 0.33063231964232287, "sim_compute_sim_state": 0.015461577907685311, "sim_compute_performance-ego0": 0.001833358118610997, "sim_compute_performance-ego1": 0.0016980848004741053, "sim_compute_performance-ego2": 0.0017012634584980626, "sim_compute_performance-ego3": 0.0017074384996967932}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.5136554138413427, "get_ui_image": 0.06162370174161849, "step_physics": 0.16076082414196383, "survival_time": 15.450000000000085, "driven_lanedir": 0.1443938494610213, "get_state_dump": 0.008659525840513167, "get_robot_state": 0.013217716832314768, "sim_render-ego0": 0.003457966927559145, "sim_render-ego1": 0.003314875018212103, "sim_render-ego2": 0.0034216665452526463, "sim_render-ego3": 0.0033354413124822803, "get_duckie_state": 2.357267564342868e-06, "in-drivable-lane": 14.050000000000084, "deviation-heading": 0.7908717500681216, "agent_compute-ego0": 0.009589106036770729, "agent_compute-ego1": 0.009144110064352713, "agent_compute-ego2": 0.009501657947417228, "agent_compute-ego3": 0.00927633777741463, "complete-iteration": 0.32597185488670105, "set_robot_commands": 0.0019929239826817664, "distance-from-start": 1.5134961335898425, "deviation-center-line": 0.12493966733272112, "driven_lanedir_consec": 0.1443938494610213, "sim_compute_sim_state": 0.015461577907685311, "sim_compute_performance-ego0": 0.001833358118610997, "sim_compute_performance-ego1": 0.0016980848004741053, "sim_compute_performance-ego2": 0.0017012634584980626, "sim_compute_performance-ego3": 0.0017074384996967932}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8367707339529249, "get_ui_image": 0.05222128445226656, "step_physics": 0.16584686704375728, "survival_time": 21.600000000000172, "driven_lanedir": 0.1901546473857385, "get_state_dump": 0.00841401355646499, "get_robot_state": 0.012628026702387505, "sim_render-ego0": 0.0033814053612548265, "sim_render-ego1": 0.003177622449315448, "sim_render-ego2": 0.003203357339731265, "sim_render-ego3": 0.003249348999446314, "get_duckie_state": 1.951398254817407e-06, "in-drivable-lane": 19.95000000000017, "deviation-heading": 0.8235174021230246, "agent_compute-ego0": 0.00996838871381024, "agent_compute-ego1": 0.008976926979787355, "agent_compute-ego2": 0.009284428581079217, "agent_compute-ego3": 0.009543368777832312, "complete-iteration": 0.32190930044953875, "set_robot_commands": 0.001875878481611644, "distance-from-start": 0.8367542263545045, "deviation-center-line": 0.13407732948914874, "driven_lanedir_consec": 0.1901546473857385, "sim_compute_sim_state": 0.017633026246385818, "sim_compute_performance-ego0": 0.0017404760003915836, "sim_compute_performance-ego1": 0.0016124788112508231, "sim_compute_performance-ego2": 0.0016024388011553546, "sim_compute_performance-ego3": 0.0016161288730542048}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.7666547842507927, "get_ui_image": 0.05222128445226656, "step_physics": 0.16584686704375728, "survival_time": 21.600000000000172, "driven_lanedir": 0.8375165035120165, "get_state_dump": 0.00841401355646499, "get_robot_state": 0.012628026702387505, "sim_render-ego0": 0.0033814053612548265, "sim_render-ego1": 0.003177622449315448, "sim_render-ego2": 0.003203357339731265, "sim_render-ego3": 0.003249348999446314, "get_duckie_state": 1.951398254817407e-06, "in-drivable-lane": 15.600000000000176, "deviation-heading": 2.532867485380358, "agent_compute-ego0": 0.00996838871381024, "agent_compute-ego1": 0.008976926979787355, "agent_compute-ego2": 0.009284428581079217, "agent_compute-ego3": 0.009543368777832312, "complete-iteration": 0.32190930044953875, "set_robot_commands": 0.001875878481611644, "distance-from-start": 1.7665447902003522, "deviation-center-line": 0.4630011560225056, "driven_lanedir_consec": 0.8375165035120165, "sim_compute_sim_state": 0.017633026246385818, "sim_compute_performance-ego0": 0.0017404760003915836, "sim_compute_performance-ego1": 0.0016124788112508231, "sim_compute_performance-ego2": 0.0016024388011553546, "sim_compute_performance-ego3": 0.0016161288730542048}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.3646830525944815, "get_ui_image": 0.05222128445226656, "step_physics": 0.16584686704375728, "survival_time": 21.600000000000172, "driven_lanedir": 1.1975992089636844, "get_state_dump": 0.00841401355646499, "get_robot_state": 0.012628026702387505, "sim_render-ego0": 0.0033814053612548265, "sim_render-ego1": 0.003177622449315448, "sim_render-ego2": 0.003203357339731265, "sim_render-ego3": 0.003249348999446314, "get_duckie_state": 1.951398254817407e-06, "in-drivable-lane": 13.950000000000191, "deviation-heading": 0.9063565933214408, "agent_compute-ego0": 0.00996838871381024, "agent_compute-ego1": 0.008976926979787355, "agent_compute-ego2": 0.009284428581079217, "agent_compute-ego3": 0.009543368777832312, "complete-iteration": 0.32190930044953875, "set_robot_commands": 0.001875878481611644, "distance-from-start": 1.3645779080082594, "deviation-center-line": 0.4535304408604156, "driven_lanedir_consec": 1.1975992089636844, "sim_compute_sim_state": 0.017633026246385818, "sim_compute_performance-ego0": 0.0017404760003915836, "sim_compute_performance-ego1": 0.0016124788112508231, "sim_compute_performance-ego2": 0.0016024388011553546, "sim_compute_performance-ego3": 0.0016161288730542048}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.401196466784495, "get_ui_image": 0.05222128445226656, "step_physics": 0.16584686704375728, "survival_time": 21.600000000000172, "driven_lanedir": 0.655418847241895, "get_state_dump": 0.00841401355646499, "get_robot_state": 0.012628026702387505, "sim_render-ego0": 0.0033814053612548265, "sim_render-ego1": 0.003177622449315448, "sim_render-ego2": 0.003203357339731265, "sim_render-ego3": 0.003249348999446314, "get_duckie_state": 1.951398254817407e-06, "in-drivable-lane": 16.850000000000183, "deviation-heading": 1.30791741870716, "agent_compute-ego0": 0.00996838871381024, "agent_compute-ego1": 0.008976926979787355, "agent_compute-ego2": 0.009284428581079217, "agent_compute-ego3": 0.009543368777832312, "complete-iteration": 0.32190930044953875, "set_robot_commands": 0.001875878481611644, "distance-from-start": 3.400473892129533, "deviation-center-line": 0.2890110869636866, "driven_lanedir_consec": 0.655418847241895, "sim_compute_sim_state": 0.017633026246385818, "sim_compute_performance-ego0": 0.0017404760003915836, "sim_compute_performance-ego1": 0.0016124788112508231, "sim_compute_performance-ego2": 0.0016024388011553546, "sim_compute_performance-ego3": 0.0016161288730542048}} set_robot_commands_max 0.0019929239826817664 set_robot_commands_mean 0.0019344012321467052 set_robot_commands_median 0.0019344012321467052 set_robot_commands_min 0.001875878481611644 sim_compute_performance-ego0_max 0.001833358118610997 sim_compute_performance-ego0_mean 0.0017869170595012905 sim_compute_performance-ego0_median 0.0017869170595012905 sim_compute_performance-ego0_min 0.0017404760003915836 sim_compute_performance-ego1_max 0.0016980848004741053 sim_compute_performance-ego1_mean 0.0016552818058624642 sim_compute_performance-ego1_median 0.0016552818058624642 sim_compute_performance-ego1_min 0.0016124788112508231 sim_compute_performance-ego2_max 0.0017012634584980626 sim_compute_performance-ego2_mean 0.0016518511298267086 sim_compute_performance-ego2_median 0.0016518511298267086 sim_compute_performance-ego2_min 0.0016024388011553546 sim_compute_performance-ego3_max 0.0017074384996967932 sim_compute_performance-ego3_mean 0.001661783686375499 sim_compute_performance-ego3_median 0.001661783686375499 sim_compute_performance-ego3_min 0.0016161288730542048 sim_compute_sim_state_max 0.017633026246385818 sim_compute_sim_state_mean 0.016547302077035565 sim_compute_sim_state_median 0.016547302077035565 sim_compute_sim_state_min 0.015461577907685311 sim_render-ego0_max 0.003457966927559145 sim_render-ego0_mean 0.003419686144406986 sim_render-ego0_median 0.003419686144406986 sim_render-ego0_min 0.0033814053612548265 sim_render-ego1_max 0.003314875018212103 sim_render-ego1_mean 0.0032462487337637756 sim_render-ego1_median 0.0032462487337637756 sim_render-ego1_min 0.003177622449315448 sim_render-ego2_max 0.0034216665452526463 sim_render-ego2_mean 0.003312511942491956 sim_render-ego2_median 0.003312511942491956 sim_render-ego2_min 0.003203357339731265 sim_render-ego3_max 0.0033354413124822803 sim_render-ego3_mean 0.003292395155964297 sim_render-ego3_median 0.003292395155964297 sim_render-ego3_min 0.003249348999446314 simulation-passed 1 step_physics_max 0.16584686704375728 step_physics_mean 0.16330384559286054 step_physics_median 0.16330384559286054 step_physics_min 0.16076082414196383 survival_time_max 21.600000000000172 survival_time_mean 18.525000000000126 survival_time_min 15.450000000000085

Highlights

The highlights are hidden.

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.