Job 68894

Job ID	68894
submission	14820
user	Bea Baselines 🐤
user label	straight
challenge	aido-LFV_multi-sim-testing
step	426
status	success
up to date	Note that this job is not up to date; the challenge has been changed.
evaluator	nogpu-production-b-spot-0-02
date started	2021-04-20 23:03:20+00:00
date completed	2021-04-20 23:15:18+00:00
duration	0:11:58
message
	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
	survival_time_median 18.525000000000126 in-drivable-lane_median 14.00000000000014 driven_lanedir_consec_median 0.2992957315044227 deviation-center-line_median 0.2801542655121556 other stats agent_compute-ego0_max 0.009785039320278388 agent_compute-ego0_mean 0.00941508937803864 agent_compute-ego0_median 0.00941508937803864 agent_compute-ego0_min 0.00904513943579889 agent_compute-ego1_max 0.009068872306418474 agent_compute-ego1_mean 0.008987018097213419 agent_compute-ego1_median 0.008987018097213419 agent_compute-ego1_min 0.008905163888008364 agent_compute-ego2_max 0.009397938400162837 agent_compute-ego2_mean 0.009342664400724648 agent_compute-ego2_median 0.009342664400724648 agent_compute-ego2_min 0.009287390401286464 agent_compute-ego3_max 0.009458443309087952 agent_compute-ego3_mean 0.009225066957002708 agent_compute-ego3_median 0.009225066957002708 agent_compute-ego3_min 0.008991690604917465 complete-iteration_max 0.32011874828823167 complete-iteration_mean 0.3121382503318403 complete-iteration_median 0.3121382503318403 complete-iteration_min 0.3041577523754489 deviation-center-line_max 0.4630011560225056 deviation-center-line_mean 0.2688244965968186 deviation-center-line_min 0.12493966733272112 deviation-heading_max 2.680905793621579 deviation-heading_mean 1.5606570833555142 deviation-heading_median 1.185667811195002 deviation-heading_min 0.7908717500681216 distance-from-start_max 3.400473892129533 distance-from-start_mean 1.6410065116145356 distance-from-start_median 1.4390370207990508 distance-from-start_min 0.8367542263545045 driven_any_max 3.401196466784495 driven_any_mean 1.6412150710284563 driven_any_median 1.4391692332179122 driven_any_min 0.8367707339529249 driven_lanedir_consec_max 1.1975992089636844 driven_lanedir_consec_mean 0.4775055678748067 driven_lanedir_consec_min 0.1443938494610213 driven_lanedir_max 1.1975992089636844 driven_lanedir_mean 0.4775055678748067 driven_lanedir_median 0.2992957315044227 driven_lanedir_min 0.1443938494610213 get_duckie_state_max 1.185940157982611e-06 get_duckie_state_mean 1.1617608231296751e-06 get_duckie_state_median 1.1617608231296751e-06 get_duckie_state_min 1.1375814882767391e-06 get_robot_state_max 0.012992267520543334 get_robot_state_mean 0.012683071277007112 get_robot_state_median 0.012683071277007112 get_robot_state_min 0.012373875033470892 get_state_dump_max 0.008483301960017885 get_state_dump_mean 0.008303075712217195 get_state_dump_median 0.008303075712217195 get_state_dump_min 0.008122849464416503 get_ui_image_max 0.05727885538531888 get_ui_image_mean 0.054394643705310206 get_ui_image_median 0.054394643705310206 get_ui_image_min 0.05151043202530154 in-drivable-lane_max 19.95000000000017 in-drivable-lane_mean 14.83750000000013 in-drivable-lane_min 12.10000000000006 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9367765102877108, "get_ui_image": 0.05727885538531888, "step_physics": 0.1489651157009986, "survival_time": 15.450000000000085, "driven_lanedir": 0.2679591433665225, "get_state_dump": 0.008122849464416503, "get_robot_state": 0.012373875033470892, "sim_render-ego0": 0.0032510857428273846, "sim_render-ego1": 0.0031254268461658108, "sim_render-ego2": 0.003164705922526698, "sim_render-ego3": 0.0030959452352216166, "get_duckie_state": 1.185940157982611e-06, "in-drivable-lane": 12.55000000000009, "deviation-heading": 2.3794020199395867, "agent_compute-ego0": 0.00904513943579889, "agent_compute-ego1": 0.008905163888008364, "agent_compute-ego2": 0.009287390401286464, "agent_compute-ego3": 0.008991690604917465, "complete-iteration": 0.3041577523754489, "set_robot_commands": 0.0018475940150599328, "distance-from-start": 0.9366464336460611, "deviation-center-line": 0.27953678734795573, "driven_lanedir_consec": 0.2679591433665225, "sim_compute_sim_state": 0.014403007876488473, "sim_compute_performance-ego0": 0.0017589815201297884, "sim_compute_performance-ego1": 0.0016128963039767357, "sim_compute_performance-ego2": 0.00161842530773532, "sim_compute_performance-ego3": 0.001586232646819084}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 0.9367765102875368, "get_ui_image": 0.05727885538531888, "step_physics": 0.1489651157009986, "survival_time": 15.450000000000085, "driven_lanedir": 0.1963700234252523, "get_state_dump": 0.008122849464416503, "get_robot_state": 0.012373875033470892, "sim_render-ego0": 0.0032510857428273846, "sim_render-ego1": 0.0031254268461658108, "sim_render-ego2": 0.003164705922526698, "sim_render-ego3": 0.0030959452352216166, "get_duckie_state": 1.185940157982611e-06, "in-drivable-lane": 13.650000000000084, "deviation-heading": 1.0634182036828437, "agent_compute-ego0": 0.00904513943579889, "agent_compute-ego1": 0.008905163888008364, "agent_compute-ego2": 0.009287390401286464, "agent_compute-ego3": 0.008991690604917465, "complete-iteration": 0.3041577523754489, "set_robot_commands": 0.0018475940150599328, "distance-from-start": 0.9366464336460576, "deviation-center-line": 0.12572776108176023, "driven_lanedir_consec": 0.1963700234252523, "sim_compute_sim_state": 0.014403007876488473, "sim_compute_performance-ego0": 0.0017589815201297884, "sim_compute_performance-ego1": 0.0016128963039767357, "sim_compute_performance-ego2": 0.00161842530773532, "sim_compute_performance-ego3": 0.001586232646819084}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.3732070962283656, "get_ui_image": 0.05727885538531888, "step_physics": 0.1489651157009986, "survival_time": 15.450000000000085, "driven_lanedir": 0.33063231964232287, "get_state_dump": 0.008122849464416503, "get_robot_state": 0.012373875033470892, "sim_render-ego0": 0.0032510857428273846, "sim_render-ego1": 0.0031254268461658108, "sim_render-ego2": 0.003164705922526698, "sim_render-ego3": 0.0030959452352216166, "get_duckie_state": 1.185940157982611e-06, "in-drivable-lane": 12.10000000000006, "deviation-heading": 2.680905793621579, "agent_compute-ego0": 0.00904513943579889, "agent_compute-ego1": 0.008905163888008364, "agent_compute-ego2": 0.009287390401286464, "agent_compute-ego3": 0.008991690604917465, "complete-iteration": 0.3041577523754489, "set_robot_commands": 0.0018475940150599328, "distance-from-start": 2.372912275341674, "deviation-center-line": 0.28077174367635543, "driven_lanedir_consec": 0.33063231964232287, "sim_compute_sim_state": 0.014403007876488473, "sim_compute_performance-ego0": 0.0017589815201297884, "sim_compute_performance-ego1": 0.0016128963039767357, "sim_compute_performance-ego2": 0.00161842530773532, "sim_compute_performance-ego3": 0.001586232646819084}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.5136554138413427, "get_ui_image": 0.05727885538531888, "step_physics": 0.1489651157009986, "survival_time": 15.450000000000085, "driven_lanedir": 0.1443938494610213, "get_state_dump": 0.008122849464416503, "get_robot_state": 0.012373875033470892, "sim_render-ego0": 0.0032510857428273846, "sim_render-ego1": 0.0031254268461658108, "sim_render-ego2": 0.003164705922526698, "sim_render-ego3": 0.0030959452352216166, "get_duckie_state": 1.185940157982611e-06, "in-drivable-lane": 14.050000000000084, "deviation-heading": 0.7908717500681216, "agent_compute-ego0": 0.00904513943579889, "agent_compute-ego1": 0.008905163888008364, "agent_compute-ego2": 0.009287390401286464, "agent_compute-ego3": 0.008991690604917465, "complete-iteration": 0.3041577523754489, "set_robot_commands": 0.0018475940150599328, "distance-from-start": 1.5134961335898425, "deviation-center-line": 0.12493966733272112, "driven_lanedir_consec": 0.1443938494610213, "sim_compute_sim_state": 0.014403007876488473, "sim_compute_performance-ego0": 0.0017589815201297884, "sim_compute_performance-ego1": 0.0016128963039767357, "sim_compute_performance-ego2": 0.00161842530773532, "sim_compute_performance-ego3": 0.001586232646819084}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8367707339529249, "get_ui_image": 0.05151043202530154, "step_physics": 0.16310696954264653, "survival_time": 21.600000000000172, "driven_lanedir": 0.1901546473857385, "get_state_dump": 0.008483301960017885, "get_robot_state": 0.012992267520543334, "sim_render-ego0": 0.0034959211635809846, "sim_render-ego1": 0.0033145738253692555, "sim_render-ego2": 0.003322697676907511, "sim_render-ego3": 0.0033367049060847964, "get_duckie_state": 1.1375814882767391e-06, "in-drivable-lane": 19.95000000000017, "deviation-heading": 0.8235174021230246, "agent_compute-ego0": 0.009785039320278388, "agent_compute-ego1": 0.009068872306418474, "agent_compute-ego2": 0.009397938400162837, "agent_compute-ego3": 0.009458443309087952, "complete-iteration": 0.32011874828823167, "set_robot_commands": 0.0019215122381479029, "distance-from-start": 0.8367542263545045, "deviation-center-line": 0.13407732948914874, "driven_lanedir_consec": 0.1901546473857385, "sim_compute_sim_state": 0.017864772959614462, "sim_compute_performance-ego0": 0.0018704356001926624, "sim_compute_performance-ego1": 0.0017080345550255192, "sim_compute_performance-ego2": 0.0017086991536975182, "sim_compute_performance-ego3": 0.0016954066296372622}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.7666547842507927, "get_ui_image": 0.05151043202530154, "step_physics": 0.16310696954264653, "survival_time": 21.600000000000172, "driven_lanedir": 0.8375165035120165, "get_state_dump": 0.008483301960017885, "get_robot_state": 0.012992267520543334, "sim_render-ego0": 0.0034959211635809846, "sim_render-ego1": 0.0033145738253692555, "sim_render-ego2": 0.003322697676907511, "sim_render-ego3": 0.0033367049060847964, "get_duckie_state": 1.1375814882767391e-06, "in-drivable-lane": 15.600000000000176, "deviation-heading": 2.532867485380358, "agent_compute-ego0": 0.009785039320278388, "agent_compute-ego1": 0.009068872306418474, "agent_compute-ego2": 0.009397938400162837, "agent_compute-ego3": 0.009458443309087952, "complete-iteration": 0.32011874828823167, "set_robot_commands": 0.0019215122381479029, "distance-from-start": 1.7665447902003522, "deviation-center-line": 0.4630011560225056, "driven_lanedir_consec": 0.8375165035120165, "sim_compute_sim_state": 0.017864772959614462, "sim_compute_performance-ego0": 0.0018704356001926624, "sim_compute_performance-ego1": 0.0017080345550255192, "sim_compute_performance-ego2": 0.0017086991536975182, "sim_compute_performance-ego3": 0.0016954066296372622}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.3646830525944815, "get_ui_image": 0.05151043202530154, "step_physics": 0.16310696954264653, "survival_time": 21.600000000000172, "driven_lanedir": 1.1975992089636844, "get_state_dump": 0.008483301960017885, "get_robot_state": 0.012992267520543334, "sim_render-ego0": 0.0034959211635809846, "sim_render-ego1": 0.0033145738253692555, "sim_render-ego2": 0.003322697676907511, "sim_render-ego3": 0.0033367049060847964, "get_duckie_state": 1.1375814882767391e-06, "in-drivable-lane": 13.950000000000191, "deviation-heading": 0.9063565933214408, "agent_compute-ego0": 0.009785039320278388, "agent_compute-ego1": 0.009068872306418474, "agent_compute-ego2": 0.009397938400162837, "agent_compute-ego3": 0.009458443309087952, "complete-iteration": 0.32011874828823167, "set_robot_commands": 0.0019215122381479029, "distance-from-start": 1.3645779080082594, "deviation-center-line": 0.4535304408604156, "driven_lanedir_consec": 1.1975992089636844, "sim_compute_sim_state": 0.017864772959614462, "sim_compute_performance-ego0": 0.0018704356001926624, "sim_compute_performance-ego1": 0.0017080345550255192, "sim_compute_performance-ego2": 0.0017086991536975182, "sim_compute_performance-ego3": 0.0016954066296372622}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.401196466784495, "get_ui_image": 0.05151043202530154, "step_physics": 0.16310696954264653, "survival_time": 21.600000000000172, "driven_lanedir": 0.655418847241895, "get_state_dump": 0.008483301960017885, "get_robot_state": 0.012992267520543334, "sim_render-ego0": 0.0034959211635809846, "sim_render-ego1": 0.0033145738253692555, "sim_render-ego2": 0.003322697676907511, "sim_render-ego3": 0.0033367049060847964, "get_duckie_state": 1.1375814882767391e-06, "in-drivable-lane": 16.850000000000183, "deviation-heading": 1.30791741870716, "agent_compute-ego0": 0.009785039320278388, "agent_compute-ego1": 0.009068872306418474, "agent_compute-ego2": 0.009397938400162837, "agent_compute-ego3": 0.009458443309087952, "complete-iteration": 0.32011874828823167, "set_robot_commands": 0.0019215122381479029, "distance-from-start": 3.400473892129533, "deviation-center-line": 0.2890110869636866, "driven_lanedir_consec": 0.655418847241895, "sim_compute_sim_state": 0.017864772959614462, "sim_compute_performance-ego0": 0.0018704356001926624, "sim_compute_performance-ego1": 0.0017080345550255192, "sim_compute_performance-ego2": 0.0017086991536975182, "sim_compute_performance-ego3": 0.0016954066296372622}} set_robot_commands_max 0.0019215122381479029 set_robot_commands_mean 0.0018845531266039176 set_robot_commands_median 0.0018845531266039176 set_robot_commands_min 0.0018475940150599328 sim_compute_performance-ego0_max 0.0018704356001926624 sim_compute_performance-ego0_mean 0.0018147085601612255 sim_compute_performance-ego0_median 0.0018147085601612255 sim_compute_performance-ego0_min 0.0017589815201297884 sim_compute_performance-ego1_max 0.0017080345550255192 sim_compute_performance-ego1_mean 0.0016604654295011274 sim_compute_performance-ego1_median 0.0016604654295011274 sim_compute_performance-ego1_min 0.0016128963039767357 sim_compute_performance-ego2_max 0.0017086991536975182 sim_compute_performance-ego2_mean 0.001663562230716419 sim_compute_performance-ego2_median 0.001663562230716419 sim_compute_performance-ego2_min 0.00161842530773532 sim_compute_performance-ego3_max 0.0016954066296372622 sim_compute_performance-ego3_mean 0.001640819638228173 sim_compute_performance-ego3_median 0.001640819638228173 sim_compute_performance-ego3_min 0.001586232646819084 sim_compute_sim_state_max 0.017864772959614462 sim_compute_sim_state_mean 0.016133890418051466 sim_compute_sim_state_median 0.016133890418051466 sim_compute_sim_state_min 0.014403007876488473 sim_render-ego0_max 0.0034959211635809846 sim_render-ego0_mean 0.0033735034532041846 sim_render-ego0_median 0.0033735034532041846 sim_render-ego0_min 0.0032510857428273846 sim_render-ego1_max 0.0033145738253692555 sim_render-ego1_mean 0.0032200003357675333 sim_render-ego1_median 0.0032200003357675333 sim_render-ego1_min 0.0031254268461658108 sim_render-ego2_max 0.003322697676907511 sim_render-ego2_mean 0.0032437017997171045 sim_render-ego2_median 0.0032437017997171045 sim_render-ego2_min 0.003164705922526698 sim_render-ego3_max 0.0033367049060847964 sim_render-ego3_mean 0.0032163250706532063 sim_render-ego3_median 0.0032163250706532063 sim_render-ego3_min 0.0030959452352216166 simulation-passed 1 step_physics_max 0.16310696954264653 step_physics_mean 0.15603604262182258 step_physics_median 0.15603604262182258 step_physics_min 0.1489651157009986 survival_time_max 21.600000000000172 survival_time_mean 18.525000000000126 survival_time_min 15.450000000000085

Highlights

The highlights are hidden.

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.