Job 68793

Job ID	68793
submission	14820
user	Bea Baselines 🐤
user label	straight
challenge	aido-LFV_multi-sim-testing
step	426
status	success
up to date	Note that this job is not up to date; the challenge has been changed.
evaluator	nogpu-production-b-spot-0-03
date started	2021-04-20 22:25:32+00:00
date completed	2021-04-20 22:36:24+00:00
duration	0:10:52
message
	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
	survival_time_median 16.4750000000001 in-drivable-lane_median 13.125000000000073 driven_lanedir_consec_median 0.28434749895317757 deviation-center-line_median 0.2845115180845218 other stats agent_compute-ego0_max 0.010372099021206732 agent_compute-ego0_mean 0.01007961566497919 agent_compute-ego0_median 0.01007961566497919 agent_compute-ego0_min 0.00978713230875165 agent_compute-ego1_max 0.00996657280384884 agent_compute-ego1_mean 0.009935292119989765 agent_compute-ego1_median 0.009935292119989765 agent_compute-ego1_min 0.00990401143613069 agent_compute-ego2_max 0.009373219764750937 agent_compute-ego2_mean 0.009320173252803456 agent_compute-ego2_median 0.009320173252803456 agent_compute-ego2_min 0.009267126740855976 agent_compute-ego3_max 0.009841617034829182 agent_compute-ego3_mean 0.009555994029267285 agent_compute-ego3_median 0.009555994029267285 agent_compute-ego3_min 0.009270371023705388 complete-iteration_max 0.31212503560211347 complete-iteration_mean 0.3000359395260467 complete-iteration_median 0.3000359395260467 complete-iteration_min 0.2879468434499799 deviation-center-line_max 2.84437111141871 deviation-center-line_mean 0.6049519033148527 deviation-center-line_min 0.11710227410873655 deviation-heading_max 9.65656476252934 deviation-heading_mean 2.6089583226636206 deviation-heading_median 1.868751049850708 deviation-heading_min 0.6716521035984507 driven_any_max 2.8632822043276054 driven_any_mean 1.8585468659119504 driven_any_median 1.803096613004424 driven_any_min 0.17542098355678787 driven_lanedir_consec_max 1.2277876442714848 driven_lanedir_consec_mean 0.3693582668479613 driven_lanedir_consec_min 0.10946962426920748 driven_lanedir_max 1.2277876442714848 driven_lanedir_mean 0.3693582668479613 driven_lanedir_median 0.28434749895317757 driven_lanedir_min 0.10946962426920748 get_duckie_state_max 1.254936923151431e-06 get_duckie_state_mean 1.196255447213914e-06 get_duckie_state_median 1.196255447213914e-06 get_duckie_state_min 1.1375739712763973e-06 get_robot_state_max 0.013405749979226486 get_robot_state_mean 0.013221098983220592 get_robot_state_median 0.013221098983220592 get_robot_state_min 0.013036447987214697 get_state_dump_max 0.008824686641278475 get_state_dump_mean 0.008663777855122226 get_state_dump_median 0.008663777855122226 get_state_dump_min 0.008502869068965977 get_ui_image_max 0.04207897834155871 get_ui_image_mean 0.03951677037666948 get_ui_image_median 0.03951677037666948 get_ui_image_min 0.036954562411780245 in-drivable-lane_max 16.400000000000126 in-drivable-lane_mean 11.262500000000085 in-drivable-lane_min 0.0 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.230988911545899, "get_ui_image": 0.036954562411780245, "step_physics": 0.14442494216632518, "survival_time": 14.600000000000072, "driven_lanedir": 1.2277876442714848, "get_state_dump": 0.008502869068965977, "get_robot_state": 0.013036447987214697, "sim_render-ego0": 0.003554082160923668, "sim_render-ego1": 0.003496787653848173, "sim_render-ego2": 0.0034292623044687733, "sim_render-ego3": 0.0034659087861357287, "get_duckie_state": 1.1375739712763973e-06, "in-drivable-lane": 6.3000000000000895, "deviation-heading": 1.374954597684355, "agent_compute-ego0": 0.00978713230875165, "agent_compute-ego1": 0.00996657280384884, "agent_compute-ego2": 0.009267126740855976, "agent_compute-ego3": 0.009270371023705388, "complete-iteration": 0.2879468434499799, "set_robot_commands": 0.0019530411873254353, "deviation-center-line": 0.614203311050044, "driven_lanedir_consec": 1.2277876442714848, "sim_compute_sim_state": 0.017804699139383467, "sim_compute_performance-ego0": 0.0018836109304590843, "sim_compute_performance-ego1": 0.0017214431697598089, "sim_compute_performance-ego2": 0.001724195968575852, "sim_compute_performance-ego3": 0.0017201290195712458}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.6466994927628378, "get_ui_image": 0.036954562411780245, "step_physics": 0.14442494216632518, "survival_time": 14.600000000000072, "driven_lanedir": 0.10946962426920748, "get_state_dump": 0.008502869068965977, "get_robot_state": 0.013036447987214697, "sim_render-ego0": 0.003554082160923668, "sim_render-ego1": 0.003496787653848173, "sim_render-ego2": 0.0034292623044687733, "sim_render-ego3": 0.0034659087861357287, "get_duckie_state": 1.1375739712763973e-06, "in-drivable-lane": 13.450000000000072, "deviation-heading": 0.7100037032942462, "agent_compute-ego0": 0.00978713230875165, "agent_compute-ego1": 0.00996657280384884, "agent_compute-ego2": 0.009267126740855976, "agent_compute-ego3": 0.009270371023705388, "complete-iteration": 0.2879468434499799, "set_robot_commands": 0.0019530411873254353, "deviation-center-line": 0.11710227410873655, "driven_lanedir_consec": 0.10946962426920748, "sim_compute_sim_state": 0.017804699139383467, "sim_compute_performance-ego0": 0.0018836109304590843, "sim_compute_performance-ego1": 0.0017214431697598089, "sim_compute_performance-ego2": 0.001724195968575852, "sim_compute_performance-ego3": 0.0017201290195712458}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.8526978205379163, "get_ui_image": 0.036954562411780245, "step_physics": 0.14442494216632518, "survival_time": 14.600000000000072, "driven_lanedir": 0.3315816256831259, "get_state_dump": 0.008502869068965977, "get_robot_state": 0.013036447987214697, "sim_render-ego0": 0.003554082160923668, "sim_render-ego1": 0.003496787653848173, "sim_render-ego2": 0.0034292623044687733, "sim_render-ego3": 0.0034659087861357287, "get_duckie_state": 1.1375739712763973e-06, "in-drivable-lane": 11.200000000000076, "deviation-heading": 2.673739792600173, "agent_compute-ego0": 0.00978713230875165, "agent_compute-ego1": 0.00996657280384884, "agent_compute-ego2": 0.009267126740855976, "agent_compute-ego3": 0.009270371023705388, "complete-iteration": 0.2879468434499799, "set_robot_commands": 0.0019530411873254353, "deviation-center-line": 0.2853384508110534, "driven_lanedir_consec": 0.3315816256831259, "sim_compute_sim_state": 0.017804699139383467, "sim_compute_performance-ego0": 0.0018836109304590843, "sim_compute_performance-ego1": 0.0017214431697598089, "sim_compute_performance-ego2": 0.001724195968575852, "sim_compute_performance-ego3": 0.0017201290195712458}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.7534954054709315, "get_ui_image": 0.036954562411780245, "step_physics": 0.14442494216632518, "survival_time": 14.600000000000072, "driven_lanedir": 0.22168418606073925, "get_state_dump": 0.008502869068965977, "get_robot_state": 0.013036447987214697, "sim_render-ego0": 0.003554082160923668, "sim_render-ego1": 0.003496787653848173, "sim_render-ego2": 0.0034292623044687733, "sim_render-ego3": 0.0034659087861357287, "get_duckie_state": 1.1375739712763973e-06, "in-drivable-lane": 12.800000000000072, "deviation-heading": 0.7297843865720277, "agent_compute-ego0": 0.00978713230875165, "agent_compute-ego1": 0.00996657280384884, "agent_compute-ego2": 0.009267126740855976, "agent_compute-ego3": 0.009270371023705388, "complete-iteration": 0.2879468434499799, "set_robot_commands": 0.0019530411873254353, "deviation-center-line": 0.16703997265346987, "driven_lanedir_consec": 0.22168418606073925, "sim_compute_sim_state": 0.017804699139383467, "sim_compute_performance-ego0": 0.0018836109304590843, "sim_compute_performance-ego1": 0.0017214431697598089, "sim_compute_performance-ego2": 0.001724195968575852, "sim_compute_performance-ego3": 0.0017201290195712458}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.17542098355678787, "get_ui_image": 0.04207897834155871, "step_physics": 0.15607325214406717, "survival_time": 18.35000000000013, "driven_lanedir": 0.15208233382540448, "get_state_dump": 0.008824686641278475, "get_robot_state": 0.013405749979226486, "sim_render-ego0": 0.003790482230808424, "sim_render-ego1": 0.003666770846947379, "sim_render-ego2": 0.0034958797952403193, "sim_render-ego3": 0.0036360744548880534, "get_duckie_state": 1.254936923151431e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.65656476252934, "agent_compute-ego0": 0.010372099021206732, "agent_compute-ego1": 0.00990401143613069, "agent_compute-ego2": 0.009373219764750937, "agent_compute-ego3": 0.009841617034829182, "complete-iteration": 0.31212503560211347, "set_robot_commands": 0.0019989914220312367, "deviation-center-line": 2.84437111141871, "driven_lanedir_consec": 0.15208233382540448, "sim_compute_sim_state": 0.02192713514618252, "sim_compute_performance-ego0": 0.0019780650087024856, "sim_compute_performance-ego1": 0.0017836949099665103, "sim_compute_performance-ego2": 0.001769505765127099, "sim_compute_performance-ego3": 0.001764493791953377}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.6122826940675794, "get_ui_image": 0.04207897834155871, "step_physics": 0.15607325214406717, "survival_time": 18.35000000000013, "driven_lanedir": 0.3435657227673733, "get_state_dump": 0.008824686641278475, "get_robot_state": 0.013405749979226486, "sim_render-ego0": 0.003790482230808424, "sim_render-ego1": 0.003666770846947379, "sim_render-ego2": 0.0034958797952403193, "sim_render-ego3": 0.0036360744548880534, "get_duckie_state": 1.254936923151431e-06, "in-drivable-lane": 14.900000000000102, "deviation-heading": 2.692419733013308, "agent_compute-ego0": 0.010372099021206732, "agent_compute-ego1": 0.00990401143613069, "agent_compute-ego2": 0.009373219764750937, "agent_compute-ego3": 0.009841617034829182, "complete-iteration": 0.31212503560211347, "set_robot_commands": 0.0019989914220312367, "deviation-center-line": 0.2836845853579902, "driven_lanedir_consec": 0.3435657227673733, "sim_compute_sim_state": 0.02192713514618252, "sim_compute_performance-ego0": 0.0019780650087024856, "sim_compute_performance-ego1": 0.0017836949099665103, "sim_compute_performance-ego2": 0.001769505765127099, "sim_compute_performance-ego3": 0.001764493791953377}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.733507415026048, "get_ui_image": 0.04207897834155871, "step_physics": 0.15607325214406717, "survival_time": 18.35000000000013, "driven_lanedir": 0.31817925265586444, "get_state_dump": 0.008824686641278475, "get_robot_state": 0.013405749979226486, "sim_render-ego0": 0.003790482230808424, "sim_render-ego1": 0.003666770846947379, "sim_render-ego2": 0.0034958797952403193, "sim_render-ego3": 0.0036360744548880534, "get_duckie_state": 1.254936923151431e-06, "in-drivable-lane": 15.050000000000129, "deviation-heading": 2.362547502017061, "agent_compute-ego0": 0.010372099021206732, "agent_compute-ego1": 0.00990401143613069, "agent_compute-ego2": 0.009373219764750937, "agent_compute-ego3": 0.009841617034829182, "complete-iteration": 0.31212503560211347, "set_robot_commands": 0.0019989914220312367, "deviation-center-line": 0.33503359302341146, "driven_lanedir_consec": 0.31817925265586444, "sim_compute_sim_state": 0.02192713514618252, "sim_compute_performance-ego0": 0.0019780650087024856, "sim_compute_performance-ego1": 0.0017836949099665103, "sim_compute_performance-ego2": 0.001769505765127099, "sim_compute_performance-ego3": 0.001764493791953377}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.8632822043276054, "get_ui_image": 0.04207897834155871, "step_physics": 0.15607325214406717, "survival_time": 18.35000000000013, "driven_lanedir": 0.2505157452504907, "get_state_dump": 0.008824686641278475, "get_robot_state": 0.013405749979226486, "sim_render-ego0": 0.003790482230808424, "sim_render-ego1": 0.003666770846947379, "sim_render-ego2": 0.0034958797952403193, "sim_render-ego3": 0.0036360744548880534, "get_duckie_state": 1.254936923151431e-06, "in-drivable-lane": 16.400000000000126, "deviation-heading": 0.6716521035984507, "agent_compute-ego0": 0.010372099021206732, "agent_compute-ego1": 0.00990401143613069, "agent_compute-ego2": 0.009373219764750937, "agent_compute-ego3": 0.009841617034829182, "complete-iteration": 0.31212503560211347, "set_robot_commands": 0.0019989914220312367, "deviation-center-line": 0.19284192809540587, "driven_lanedir_consec": 0.2505157452504907, "sim_compute_sim_state": 0.02192713514618252, "sim_compute_performance-ego0": 0.0019780650087024856, "sim_compute_performance-ego1": 0.0017836949099665103, "sim_compute_performance-ego2": 0.001769505765127099, "sim_compute_performance-ego3": 0.001764493791953377}} set_robot_commands_max 0.0019989914220312367 set_robot_commands_mean 0.001976016304678336 set_robot_commands_median 0.001976016304678336 set_robot_commands_min 0.0019530411873254353 sim_compute_performance-ego0_max 0.0019780650087024856 sim_compute_performance-ego0_mean 0.001930837969580785 sim_compute_performance-ego0_median 0.001930837969580785 sim_compute_performance-ego0_min 0.0018836109304590843 sim_compute_performance-ego1_max 0.0017836949099665103 sim_compute_performance-ego1_mean 0.0017525690398631597 sim_compute_performance-ego1_median 0.0017525690398631597 sim_compute_performance-ego1_min 0.0017214431697598089 sim_compute_performance-ego2_max 0.001769505765127099 sim_compute_performance-ego2_mean 0.0017468508668514757 sim_compute_performance-ego2_median 0.0017468508668514757 sim_compute_performance-ego2_min 0.001724195968575852 sim_compute_performance-ego3_max 0.001764493791953377 sim_compute_performance-ego3_mean 0.0017423114057623114 sim_compute_performance-ego3_median 0.0017423114057623114 sim_compute_performance-ego3_min 0.0017201290195712458 sim_compute_sim_state_max 0.02192713514618252 sim_compute_sim_state_mean 0.01986591714278299 sim_compute_sim_state_median 0.01986591714278299 sim_compute_sim_state_min 0.017804699139383467 sim_render-ego0_max 0.003790482230808424 sim_render-ego0_mean 0.0036722821958660463 sim_render-ego0_median 0.0036722821958660463 sim_render-ego0_min 0.003554082160923668 sim_render-ego1_max 0.003666770846947379 sim_render-ego1_mean 0.0035817792503977765 sim_render-ego1_median 0.0035817792503977765 sim_render-ego1_min 0.003496787653848173 sim_render-ego2_max 0.0034958797952403193 sim_render-ego2_mean 0.003462571049854546 sim_render-ego2_median 0.003462571049854546 sim_render-ego2_min 0.0034292623044687733 sim_render-ego3_max 0.0036360744548880534 sim_render-ego3_mean 0.003550991620511891 sim_render-ego3_median 0.003550991620511891 sim_render-ego3_min 0.0034659087861357287 simulation-passed 1 step_physics_max 0.15607325214406717 step_physics_mean 0.1502490971551962 step_physics_median 0.1502490971551962 step_physics_min 0.14442494216632518 survival_time_max 18.35000000000013 survival_time_mean 16.4750000000001 survival_time_min 14.600000000000072

Highlights

The highlights are hidden.

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.