Job 69770

Job ID	69770
submission	14706
user	Bea Baselines 🐤
user label	template-random
challenge	aido-LFV_multi-sim-testing
step	426
status	success
up to date	Note that this job is not up to date; the challenge has been changed.
evaluator	nogpu-production-b-spot-0-02
date started	2021-04-21 05:38:01+00:00
date completed	2021-04-21 05:44:10+00:00
duration	0:06:09
message
	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
	survival_time_median 7.599999999999987 in-drivable-lane_median 5.7499999999999885 driven_lanedir_consec_median 0.25364211091147704 deviation-center-line_median 0.12136641527111772 other stats agent_compute-ego0_max 0.01061868125742132 agent_compute-ego0_mean 0.010397216948595914 agent_compute-ego0_median 0.010397216948595914 agent_compute-ego0_min 0.010175752639770509 agent_compute-ego1_max 0.01015745916149833 agent_compute-ego1_mean 0.009967475952385188 agent_compute-ego1_median 0.009967475952385188 agent_compute-ego1_min 0.009777492743272049 agent_compute-ego2_max 0.010943118821490894 agent_compute-ego2_mean 0.010452326183969324 agent_compute-ego2_median 0.010452326183969324 agent_compute-ego2_min 0.009961533546447751 agent_compute-ego3_max 0.01093218136917461 agent_compute-ego3_mean 0.010330049776947582 agent_compute-ego3_median 0.010330049776947582 agent_compute-ego3_min 0.009727918184720552 complete-iteration_max 0.3907554935325276 complete-iteration_mean 0.3766515656993106 complete-iteration_median 0.3766515656993106 complete-iteration_min 0.3625476378660936 deviation-center-line_max 0.8070254100829372 deviation-center-line_mean 0.21357502203775955 deviation-center-line_min 0.05855448876459581 deviation-heading_max 3.9357793320854153 deviation-heading_mean 1.0990437624529514 deviation-heading_median 0.755058305247654 deviation-heading_min 0.36130522063763254 distance-from-start_max 3.446452083740982 distance-from-start_mean 1.7455451146884986 distance-from-start_median 1.5722296960105044 distance-from-start_min 0.9381441229153964 driven_any_max 3.469809905598219 driven_any_mean 1.7623055811921096 driven_any_median 1.5826230103432588 driven_any_min 0.9387868804282844 driven_lanedir_consec_max 1.1480416801675466 driven_lanedir_consec_mean 0.4644765924961373 driven_lanedir_consec_min 0.16438114766250012 driven_lanedir_max 1.1480416801675466 driven_lanedir_mean 0.4644765924961373 driven_lanedir_median 0.25364211091147704 driven_lanedir_min 0.16438114766250012 get_duckie_state_max 1.5741044824773616e-06 get_duckie_state_mean 1.3950196179476652e-06 get_duckie_state_median 1.3950196179476652e-06 get_duckie_state_min 1.2159347534179689e-06 get_robot_state_max 0.013658893379298124 get_robot_state_mean 0.013330843492404564 get_robot_state_median 0.013330843492404564 get_robot_state_min 0.013002793605511005 get_state_dump_max 0.008615106344223022 get_state_dump_mean 0.008609476227026718 get_state_dump_median 0.008609476227026718 get_state_dump_min 0.008603846109830416 get_ui_image_max 0.06124387887807993 get_ui_image_mean 0.05786382713309535 get_ui_image_median 0.05786382713309535 get_ui_image_min 0.05448377538811077 in-drivable-lane_max 7.849999999999989 in-drivable-lane_mean 5.54374999999999 in-drivable-lane_min 1.5499999999999992 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9387868804283056, "get_ui_image": 0.06124387887807993, "step_physics": 0.1969854263158945, "survival_time": 6.449999999999985, "driven_lanedir": 0.2692352254805084, "get_state_dump": 0.008603846109830416, "get_robot_state": 0.013002793605511005, "sim_render-ego0": 0.0035155149606557992, "sim_render-ego1": 0.0034087951366718, "sim_render-ego2": 0.003434923978952261, "sim_render-ego3": 0.003263427661015437, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 5.199999999999986, "deviation-heading": 0.9778348425090824, "agent_compute-ego0": 0.010175752639770509, "agent_compute-ego1": 0.009777492743272049, "agent_compute-ego2": 0.009961533546447751, "agent_compute-ego3": 0.009727918184720552, "complete-iteration": 0.3625476378660936, "set_robot_commands": 0.0019572918231670674, "distance-from-start": 0.9381441229154014, "deviation-center-line": 0.112481803251755, "driven_lanedir_consec": 0.2692352254805084, "sim_compute_sim_state": 0.01460406413445106, "sim_compute_performance-ego0": 0.0018291363349327672, "sim_compute_performance-ego1": 0.0016569724449744592, "sim_compute_performance-ego2": 0.0016675894077007587, "sim_compute_performance-ego3": 0.0016350856194129358}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 0.9387868804282844, "get_ui_image": 0.06124387887807993, "step_physics": 0.1969854263158945, "survival_time": 6.449999999999985, "driven_lanedir": 0.21699662961080435, "get_state_dump": 0.008603846109830416, "get_robot_state": 0.013002793605511005, "sim_render-ego0": 0.0035155149606557992, "sim_render-ego1": 0.0034087951366718, "sim_render-ego2": 0.003434923978952261, "sim_render-ego3": 0.003263427661015437, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 1.5499999999999992, "deviation-heading": 3.9357793320854153, "agent_compute-ego0": 0.010175752639770509, "agent_compute-ego1": 0.009777492743272049, "agent_compute-ego2": 0.009961533546447751, "agent_compute-ego3": 0.009727918184720552, "complete-iteration": 0.3625476378660936, "set_robot_commands": 0.0019572918231670674, "distance-from-start": 0.9381441229153964, "deviation-center-line": 0.8070254100829372, "driven_lanedir_consec": 0.21699662961080435, "sim_compute_sim_state": 0.01460406413445106, "sim_compute_performance-ego0": 0.0018291363349327672, "sim_compute_performance-ego1": 0.0016569724449744592, "sim_compute_performance-ego2": 0.0016675894077007587, "sim_compute_performance-ego3": 0.0016350856194129358}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.4534342003141583, "get_ui_image": 0.06124387887807993, "step_physics": 0.1969854263158945, "survival_time": 6.449999999999985, "driven_lanedir": 0.2380489963424457, "get_state_dump": 0.008603846109830416, "get_robot_state": 0.013002793605511005, "sim_render-ego0": 0.0035155149606557992, "sim_render-ego1": 0.0034087951366718, "sim_render-ego2": 0.003434923978952261, "sim_render-ego3": 0.003263427661015437, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 5.149999999999987, "deviation-heading": 1.153848918842727, "agent_compute-ego0": 0.010175752639770509, "agent_compute-ego1": 0.009777492743272049, "agent_compute-ego2": 0.009961533546447751, "agent_compute-ego3": 0.009727918184720552, "complete-iteration": 0.3625476378660936, "set_robot_commands": 0.0019572918231670674, "distance-from-start": 2.3708463731795346, "deviation-center-line": 0.09304469592429011, "driven_lanedir_consec": 0.2380489963424457, "sim_compute_sim_state": 0.01460406413445106, "sim_compute_performance-ego0": 0.0018291363349327672, "sim_compute_performance-ego1": 0.0016569724449744592, "sim_compute_performance-ego2": 0.0016675894077007587, "sim_compute_performance-ego3": 0.0016350856194129358}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6060558702806278, "get_ui_image": 0.06124387887807993, "step_physics": 0.1969854263158945, "survival_time": 6.449999999999985, "driven_lanedir": 0.16438114766250012, "get_state_dump": 0.008603846109830416, "get_robot_state": 0.013002793605511005, "sim_render-ego0": 0.0035155149606557992, "sim_render-ego1": 0.0034087951366718, "sim_render-ego2": 0.003434923978952261, "sim_render-ego3": 0.003263427661015437, "get_duckie_state": 1.2159347534179689e-06, "in-drivable-lane": 5.699999999999985, "deviation-heading": 0.410532969422752, "agent_compute-ego0": 0.010175752639770509, "agent_compute-ego1": 0.009777492743272049, "agent_compute-ego2": 0.009961533546447751, "agent_compute-ego3": 0.009727918184720552, "complete-iteration": 0.3625476378660936, "set_robot_commands": 0.0019572918231670674, "distance-from-start": 1.5884439183134522, "deviation-center-line": 0.06156075075720892, "driven_lanedir_consec": 0.16438114766250012, "sim_compute_sim_state": 0.01460406413445106, "sim_compute_performance-ego0": 0.0018291363349327672, "sim_compute_performance-ego1": 0.0016569724449744592, "sim_compute_performance-ego2": 0.0016675894077007587, "sim_compute_performance-ego3": 0.0016350856194129358}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 1.5591901504058898, "get_ui_image": 0.05448377538811077, "step_physics": 0.22158700092272324, "survival_time": 8.74999999999999, "driven_lanedir": 0.2017751507596792, "get_state_dump": 0.008615106344223022, "get_robot_state": 0.013658893379298124, "sim_render-ego0": 0.003716211427341808, "sim_render-ego1": 0.0035710781812667847, "sim_render-ego2": 0.003630035302855751, "sim_render-ego3": 0.0036193633621389217, "get_duckie_state": 1.5741044824773616e-06, "in-drivable-lane": 7.849999999999989, "deviation-heading": 0.4429322056306927, "agent_compute-ego0": 0.01061868125742132, "agent_compute-ego1": 0.01015745916149833, "agent_compute-ego2": 0.010943118821490894, "agent_compute-ego3": 0.01093218136917461, "complete-iteration": 0.3907554935325276, "set_robot_commands": 0.0021128844131122937, "distance-from-start": 1.5560154737075569, "deviation-center-line": 0.05855448876459581, "driven_lanedir_consec": 0.2017751507596792, "sim_compute_sim_state": 0.01884308321909471, "sim_compute_performance-ego0": 0.0020166459408673372, "sim_compute_performance-ego1": 0.0018220123919573696, "sim_compute_performance-ego2": 0.0018120123581452804, "sim_compute_performance-ego3": 0.0017830878496170044}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.7660349041174808, "get_ui_image": 0.05448377538811077, "step_physics": 0.22158700092272324, "survival_time": 8.74999999999999, "driven_lanedir": 0.8271391880458835, "get_state_dump": 0.008615106344223022, "get_robot_state": 0.013658893379298124, "sim_render-ego0": 0.003716211427341808, "sim_render-ego1": 0.0035710781812667847, "sim_render-ego2": 0.003630035302855751, "sim_render-ego3": 0.0036193633621389217, "get_duckie_state": 1.5741044824773616e-06, "in-drivable-lane": 6.399999999999995, "deviation-heading": 0.8906619315186565, "agent_compute-ego0": 0.01061868125742132, "agent_compute-ego1": 0.01015745916149833, "agent_compute-ego2": 0.010943118821490894, "agent_compute-ego3": 0.01093218136917461, "complete-iteration": 0.3907554935325276, "set_robot_commands": 0.0021128844131122937, "distance-from-start": 1.7627728702359189, "deviation-center-line": 0.18680177812656631, "driven_lanedir_consec": 0.8271391880458835, "sim_compute_sim_state": 0.01884308321909471, "sim_compute_performance-ego0": 0.0020166459408673372, "sim_compute_performance-ego1": 0.0018220123919573696, "sim_compute_performance-ego2": 0.0018120123581452804, "sim_compute_performance-ego3": 0.0017830878496170044}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.366345857963911, "get_ui_image": 0.05448377538811077, "step_physics": 0.22158700092272324, "survival_time": 8.74999999999999, "driven_lanedir": 1.1480416801675466, "get_state_dump": 0.008615106344223022, "get_robot_state": 0.013658893379298124, "sim_render-ego0": 0.003716211427341808, "sim_render-ego1": 0.0035710781812667847, "sim_render-ego2": 0.003630035302855751, "sim_render-ego3": 0.0036193633621389217, "get_duckie_state": 1.5741044824773616e-06, "in-drivable-lane": 5.799999999999992, "deviation-heading": 0.36130522063763254, "agent_compute-ego0": 0.01061868125742132, "agent_compute-ego1": 0.01015745916149833, "agent_compute-ego2": 0.010943118821490894, "agent_compute-ego3": 0.01093218136917461, "complete-iteration": 0.3907554935325276, "set_robot_commands": 0.0021128844131122937, "distance-from-start": 1.3635419524997452, "deviation-center-line": 0.2588802221042426, "driven_lanedir_consec": 1.1480416801675466, "sim_compute_sim_state": 0.01884308321909471, "sim_compute_performance-ego0": 0.0020166459408673372, "sim_compute_performance-ego1": 0.0018220123919573696, "sim_compute_performance-ego2": 0.0018120123581452804, "sim_compute_performance-ego3": 0.0017830878496170044}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.469809905598219, "get_ui_image": 0.05448377538811077, "step_physics": 0.22158700092272324, "survival_time": 8.74999999999999, "driven_lanedir": 0.6501947218997308, "get_state_dump": 0.008615106344223022, "get_robot_state": 0.013658893379298124, "sim_render-ego0": 0.003716211427341808, "sim_render-ego1": 0.0035710781812667847, "sim_render-ego2": 0.003630035302855751, "sim_render-ego3": 0.0036193633621389217, "get_duckie_state": 1.5741044824773616e-06, "in-drivable-lane": 6.699999999999989, "deviation-heading": 0.6194546789766517, "agent_compute-ego0": 0.01061868125742132, "agent_compute-ego1": 0.01015745916149833, "agent_compute-ego2": 0.010943118821490894, "agent_compute-ego3": 0.01093218136917461, "complete-iteration": 0.3907554935325276, "set_robot_commands": 0.0021128844131122937, "distance-from-start": 3.446452083740982, "deviation-center-line": 0.13025102729048044, "driven_lanedir_consec": 0.6501947218997308, "sim_compute_sim_state": 0.01884308321909471, "sim_compute_performance-ego0": 0.0020166459408673372, "sim_compute_performance-ego1": 0.0018220123919573696, "sim_compute_performance-ego2": 0.0018120123581452804, "sim_compute_performance-ego3": 0.0017830878496170044}} set_robot_commands_max 0.0021128844131122937 set_robot_commands_mean 0.0020350881181396803 set_robot_commands_median 0.0020350881181396803 set_robot_commands_min 0.0019572918231670674 sim_compute_performance-ego0_max 0.0020166459408673372 sim_compute_performance-ego0_mean 0.0019228911379000524 sim_compute_performance-ego0_median 0.0019228911379000524 sim_compute_performance-ego0_min 0.0018291363349327672 sim_compute_performance-ego1_max 0.0018220123919573696 sim_compute_performance-ego1_mean 0.0017394924184659143 sim_compute_performance-ego1_median 0.0017394924184659143 sim_compute_performance-ego1_min 0.0016569724449744592 sim_compute_performance-ego2_max 0.0018120123581452804 sim_compute_performance-ego2_mean 0.0017398008829230195 sim_compute_performance-ego2_median 0.0017398008829230195 sim_compute_performance-ego2_min 0.0016675894077007587 sim_compute_performance-ego3_max 0.0017830878496170044 sim_compute_performance-ego3_mean 0.00170908673451497 sim_compute_performance-ego3_median 0.00170908673451497 sim_compute_performance-ego3_min 0.0016350856194129358 sim_compute_sim_state_max 0.01884308321909471 sim_compute_sim_state_mean 0.016723573676772886 sim_compute_sim_state_median 0.016723573676772886 sim_compute_sim_state_min 0.01460406413445106 sim_render-ego0_max 0.003716211427341808 sim_render-ego0_mean 0.003615863193998803 sim_render-ego0_median 0.003615863193998803 sim_render-ego0_min 0.0035155149606557992 sim_render-ego1_max 0.0035710781812667847 sim_render-ego1_mean 0.003489936658969292 sim_render-ego1_median 0.003489936658969292 sim_render-ego1_min 0.0034087951366718 sim_render-ego2_max 0.003630035302855751 sim_render-ego2_mean 0.0035324796409040063 sim_render-ego2_median 0.0035324796409040063 sim_render-ego2_min 0.003434923978952261 sim_render-ego3_max 0.0036193633621389217 sim_render-ego3_mean 0.0034413955115771794 sim_render-ego3_median 0.0034413955115771794 sim_render-ego3_min 0.003263427661015437 simulation-passed 1 step_physics_max 0.22158700092272324 step_physics_mean 0.20928621361930888 step_physics_median 0.20928621361930888 step_physics_min 0.1969854263158945 survival_time_max 8.74999999999999 survival_time_mean 7.599999999999987 survival_time_min 6.449999999999985

Highlights

The highlights are hidden.

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.