Job 69988

Job ID	69988
submission	14688
user	Andrea Censi 🇨🇭
user label	straight
challenge	aido-LFV_multi-sim-testing
step	426
status	success
up to date	Note that this job is not up to date; the challenge has been changed.
evaluator	nogpu-production-b-spot-0-04
date started	2021-04-21 07:23:16+00:00
date completed	2021-04-21 07:35:37+00:00
duration	0:12:21
message
	Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
	survival_time_median 18.525000000000126 in-drivable-lane_median 14.00000000000014 driven_lanedir_consec_median 0.2992957315044227 deviation-center-line_median 0.2801542655121556 other stats agent_compute-ego0_max 0.010077776589514751 agent_compute-ego0_mean 0.01003494961983062 agent_compute-ego0_median 0.01003494961983062 agent_compute-ego0_min 0.009992122650146484 agent_compute-ego1_max 0.00947083580878473 agent_compute-ego1_mean 0.009312887509888883 agent_compute-ego1_median 0.009312887509888883 agent_compute-ego1_min 0.009154939210993038 agent_compute-ego2_max 0.009848263186793174 agent_compute-ego2_mean 0.009724010768807398 agent_compute-ego2_median 0.009724010768807398 agent_compute-ego2_min 0.00959975835082162 agent_compute-ego3_max 0.009690357410880214 agent_compute-ego3_mean 0.009565633152171182 agent_compute-ego3_median 0.009565633152171182 agent_compute-ego3_min 0.009440908893462153 complete-iteration_max 0.32734325466200054 complete-iteration_mean 0.32124586872307437 complete-iteration_median 0.32124586872307437 complete-iteration_min 0.3151484827841482 deviation-center-line_max 0.4630011560225056 deviation-center-line_mean 0.2688244965968186 deviation-center-line_min 0.12493966733272112 deviation-heading_max 2.680905793621579 deviation-heading_mean 1.5606570833555142 deviation-heading_median 1.185667811195002 deviation-heading_min 0.7908717500681216 distance-from-start_max 3.400473892129533 distance-from-start_mean 1.6410065116145356 distance-from-start_median 1.4390370207990508 distance-from-start_min 0.8367542263545045 driven_any_max 3.401196466784495 driven_any_mean 1.6412150710284563 driven_any_median 1.4391692332179122 driven_any_min 0.8367707339529249 driven_lanedir_consec_max 1.1975992089636844 driven_lanedir_consec_mean 0.4775055678748067 driven_lanedir_consec_min 0.1443938494610213 driven_lanedir_max 1.1975992089636844 driven_lanedir_mean 0.4775055678748067 driven_lanedir_median 0.2992957315044227 driven_lanedir_min 0.1443938494610213 get_duckie_state_max 1.377444113454511e-06 get_duckie_state_mean 1.3491910766633392e-06 get_duckie_state_median 1.3491910766633392e-06 get_duckie_state_min 1.3209380398721671e-06 get_robot_state_max 0.01329696426215403 get_robot_state_mean 0.01329409892394043 get_robot_state_median 0.01329409892394043 get_robot_state_min 0.01329123358572683 get_state_dump_max 0.008686413665841964 get_state_dump_mean 0.008602893149134282 get_state_dump_median 0.008602893149134282 get_state_dump_min 0.0085193726324266 get_ui_image_max 0.058130898014191655 get_ui_image_mean 0.05518247429876776 get_ui_image_median 0.05518247429876776 get_ui_image_min 0.052234050583343856 in-drivable-lane_max 19.95000000000017 in-drivable-lane_mean 14.83750000000013 in-drivable-lane_min 12.10000000000006 per-episodes details {"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9367765102877108, "get_ui_image": 0.058130898014191655, "step_physics": 0.15162217463216474, "survival_time": 15.450000000000085, "driven_lanedir": 0.2679591433665225, "get_state_dump": 0.0085193726324266, "get_robot_state": 0.01329123358572683, "sim_render-ego0": 0.00361821343821864, "sim_render-ego1": 0.003460684899360903, "sim_render-ego2": 0.003544027574600712, "sim_render-ego3": 0.003499350240153651, "get_duckie_state": 1.377444113454511e-06, "in-drivable-lane": 12.55000000000009, "deviation-heading": 2.3794020199395867, "agent_compute-ego0": 0.009992122650146484, "agent_compute-ego1": 0.00947083580878473, "agent_compute-ego2": 0.009848263186793174, "agent_compute-ego3": 0.009440908893462153, "complete-iteration": 0.3151484827841482, "set_robot_commands": 0.0020636204750307144, "distance-from-start": 0.9366464336460611, "deviation-center-line": 0.27953678734795573, "driven_lanedir_consec": 0.2679591433665225, "sim_compute_sim_state": 0.014803484178358507, "sim_compute_performance-ego0": 0.0019680400048532796, "sim_compute_performance-ego1": 0.0017955433937811083, "sim_compute_performance-ego2": 0.0017558090148433562, "sim_compute_performance-ego3": 0.00174747436277328}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 0.9367765102875368, "get_ui_image": 0.058130898014191655, "step_physics": 0.15162217463216474, "survival_time": 15.450000000000085, "driven_lanedir": 0.1963700234252523, "get_state_dump": 0.0085193726324266, "get_robot_state": 0.01329123358572683, "sim_render-ego0": 0.00361821343821864, "sim_render-ego1": 0.003460684899360903, "sim_render-ego2": 0.003544027574600712, "sim_render-ego3": 0.003499350240153651, "get_duckie_state": 1.377444113454511e-06, "in-drivable-lane": 13.650000000000084, "deviation-heading": 1.0634182036828437, "agent_compute-ego0": 0.009992122650146484, "agent_compute-ego1": 0.00947083580878473, "agent_compute-ego2": 0.009848263186793174, "agent_compute-ego3": 0.009440908893462153, "complete-iteration": 0.3151484827841482, "set_robot_commands": 0.0020636204750307144, "distance-from-start": 0.9366464336460576, "deviation-center-line": 0.12572776108176023, "driven_lanedir_consec": 0.1963700234252523, "sim_compute_sim_state": 0.014803484178358507, "sim_compute_performance-ego0": 0.0019680400048532796, "sim_compute_performance-ego1": 0.0017955433937811083, "sim_compute_performance-ego2": 0.0017558090148433562, "sim_compute_performance-ego3": 0.00174747436277328}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.3732070962283656, "get_ui_image": 0.058130898014191655, "step_physics": 0.15162217463216474, "survival_time": 15.450000000000085, "driven_lanedir": 0.33063231964232287, "get_state_dump": 0.0085193726324266, "get_robot_state": 0.01329123358572683, "sim_render-ego0": 0.00361821343821864, "sim_render-ego1": 0.003460684899360903, "sim_render-ego2": 0.003544027574600712, "sim_render-ego3": 0.003499350240153651, "get_duckie_state": 1.377444113454511e-06, "in-drivable-lane": 12.10000000000006, "deviation-heading": 2.680905793621579, "agent_compute-ego0": 0.009992122650146484, "agent_compute-ego1": 0.00947083580878473, "agent_compute-ego2": 0.009848263186793174, "agent_compute-ego3": 0.009440908893462153, "complete-iteration": 0.3151484827841482, "set_robot_commands": 0.0020636204750307144, "distance-from-start": 2.372912275341674, "deviation-center-line": 0.28077174367635543, "driven_lanedir_consec": 0.33063231964232287, "sim_compute_sim_state": 0.014803484178358507, "sim_compute_performance-ego0": 0.0019680400048532796, "sim_compute_performance-ego1": 0.0017955433937811083, "sim_compute_performance-ego2": 0.0017558090148433562, "sim_compute_performance-ego3": 0.00174747436277328}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.5136554138413427, "get_ui_image": 0.058130898014191655, "step_physics": 0.15162217463216474, "survival_time": 15.450000000000085, "driven_lanedir": 0.1443938494610213, "get_state_dump": 0.0085193726324266, "get_robot_state": 0.01329123358572683, "sim_render-ego0": 0.00361821343821864, "sim_render-ego1": 0.003460684899360903, "sim_render-ego2": 0.003544027574600712, "sim_render-ego3": 0.003499350240153651, "get_duckie_state": 1.377444113454511e-06, "in-drivable-lane": 14.050000000000084, "deviation-heading": 0.7908717500681216, "agent_compute-ego0": 0.009992122650146484, "agent_compute-ego1": 0.00947083580878473, "agent_compute-ego2": 0.009848263186793174, "agent_compute-ego3": 0.009440908893462153, "complete-iteration": 0.3151484827841482, "set_robot_commands": 0.0020636204750307144, "distance-from-start": 1.5134961335898425, "deviation-center-line": 0.12493966733272112, "driven_lanedir_consec": 0.1443938494610213, "sim_compute_sim_state": 0.014803484178358507, "sim_compute_performance-ego0": 0.0019680400048532796, "sim_compute_performance-ego1": 0.0017955433937811083, "sim_compute_performance-ego2": 0.0017558090148433562, "sim_compute_performance-ego3": 0.00174747436277328}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8367707339529249, "get_ui_image": 0.052234050583343856, "step_physics": 0.1661889999072491, "survival_time": 21.600000000000172, "driven_lanedir": 0.1901546473857385, "get_state_dump": 0.008686413665841964, "get_robot_state": 0.01329696426215403, "sim_render-ego0": 0.003752713941261344, "sim_render-ego1": 0.0035224687695227927, "sim_render-ego2": 0.0035710092504911005, "sim_render-ego3": 0.003632346697272109, "get_duckie_state": 1.3209380398721671e-06, "in-drivable-lane": 19.95000000000017, "deviation-heading": 0.8235174021230246, "agent_compute-ego0": 0.010077776589514751, "agent_compute-ego1": 0.009154939210993038, "agent_compute-ego2": 0.00959975835082162, "agent_compute-ego3": 0.009690357410880214, "complete-iteration": 0.32734325466200054, "set_robot_commands": 0.002036743846831641, "distance-from-start": 0.8367542263545045, "deviation-center-line": 0.13407732948914874, "driven_lanedir_consec": 0.1901546473857385, "sim_compute_sim_state": 0.01825287325552925, "sim_compute_performance-ego0": 0.0019422480470864384, "sim_compute_performance-ego1": 0.0017768516276229613, "sim_compute_performance-ego2": 0.0017682476352048526, "sim_compute_performance-ego3": 0.001760558773683896}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.7666547842507927, "get_ui_image": 0.052234050583343856, "step_physics": 0.1661889999072491, "survival_time": 21.600000000000172, "driven_lanedir": 0.8375165035120165, "get_state_dump": 0.008686413665841964, "get_robot_state": 0.01329696426215403, "sim_render-ego0": 0.003752713941261344, "sim_render-ego1": 0.0035224687695227927, "sim_render-ego2": 0.0035710092504911005, "sim_render-ego3": 0.003632346697272109, "get_duckie_state": 1.3209380398721671e-06, "in-drivable-lane": 15.600000000000176, "deviation-heading": 2.532867485380358, "agent_compute-ego0": 0.010077776589514751, "agent_compute-ego1": 0.009154939210993038, "agent_compute-ego2": 0.00959975835082162, "agent_compute-ego3": 0.009690357410880214, "complete-iteration": 0.32734325466200054, "set_robot_commands": 0.002036743846831641, "distance-from-start": 1.7665447902003522, "deviation-center-line": 0.4630011560225056, "driven_lanedir_consec": 0.8375165035120165, "sim_compute_sim_state": 0.01825287325552925, "sim_compute_performance-ego0": 0.0019422480470864384, "sim_compute_performance-ego1": 0.0017768516276229613, "sim_compute_performance-ego2": 0.0017682476352048526, "sim_compute_performance-ego3": 0.001760558773683896}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.3646830525944815, "get_ui_image": 0.052234050583343856, "step_physics": 0.1661889999072491, "survival_time": 21.600000000000172, "driven_lanedir": 1.1975992089636844, "get_state_dump": 0.008686413665841964, "get_robot_state": 0.01329696426215403, "sim_render-ego0": 0.003752713941261344, "sim_render-ego1": 0.0035224687695227927, "sim_render-ego2": 0.0035710092504911005, "sim_render-ego3": 0.003632346697272109, "get_duckie_state": 1.3209380398721671e-06, "in-drivable-lane": 13.950000000000191, "deviation-heading": 0.9063565933214408, "agent_compute-ego0": 0.010077776589514751, "agent_compute-ego1": 0.009154939210993038, "agent_compute-ego2": 0.00959975835082162, "agent_compute-ego3": 0.009690357410880214, "complete-iteration": 0.32734325466200054, "set_robot_commands": 0.002036743846831641, "distance-from-start": 1.3645779080082594, "deviation-center-line": 0.4535304408604156, "driven_lanedir_consec": 1.1975992089636844, "sim_compute_sim_state": 0.01825287325552925, "sim_compute_performance-ego0": 0.0019422480470864384, "sim_compute_performance-ego1": 0.0017768516276229613, "sim_compute_performance-ego2": 0.0017682476352048526, "sim_compute_performance-ego3": 0.001760558773683896}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.401196466784495, "get_ui_image": 0.052234050583343856, "step_physics": 0.1661889999072491, "survival_time": 21.600000000000172, "driven_lanedir": 0.655418847241895, "get_state_dump": 0.008686413665841964, "get_robot_state": 0.01329696426215403, "sim_render-ego0": 0.003752713941261344, "sim_render-ego1": 0.0035224687695227927, "sim_render-ego2": 0.0035710092504911005, "sim_render-ego3": 0.003632346697272109, "get_duckie_state": 1.3209380398721671e-06, "in-drivable-lane": 16.850000000000183, "deviation-heading": 1.30791741870716, "agent_compute-ego0": 0.010077776589514751, "agent_compute-ego1": 0.009154939210993038, "agent_compute-ego2": 0.00959975835082162, "agent_compute-ego3": 0.009690357410880214, "complete-iteration": 0.32734325466200054, "set_robot_commands": 0.002036743846831641, "distance-from-start": 3.400473892129533, "deviation-center-line": 0.2890110869636866, "driven_lanedir_consec": 0.655418847241895, "sim_compute_sim_state": 0.01825287325552925, "sim_compute_performance-ego0": 0.0019422480470864384, "sim_compute_performance-ego1": 0.0017768516276229613, "sim_compute_performance-ego2": 0.0017682476352048526, "sim_compute_performance-ego3": 0.001760558773683896}} set_robot_commands_max 0.0020636204750307144 set_robot_commands_mean 0.0020501821609311775 set_robot_commands_median 0.0020501821609311775 set_robot_commands_min 0.002036743846831641 sim_compute_performance-ego0_max 0.0019680400048532796 sim_compute_performance-ego0_mean 0.001955144025969859 sim_compute_performance-ego0_median 0.001955144025969859 sim_compute_performance-ego0_min 0.0019422480470864384 sim_compute_performance-ego1_max 0.0017955433937811083 sim_compute_performance-ego1_mean 0.0017861975107020347 sim_compute_performance-ego1_median 0.0017861975107020347 sim_compute_performance-ego1_min 0.0017768516276229613 sim_compute_performance-ego2_max 0.0017682476352048526 sim_compute_performance-ego2_mean 0.0017620283250241043 sim_compute_performance-ego2_median 0.0017620283250241043 sim_compute_performance-ego2_min 0.0017558090148433562 sim_compute_performance-ego3_max 0.001760558773683896 sim_compute_performance-ego3_mean 0.001754016568228588 sim_compute_performance-ego3_median 0.001754016568228588 sim_compute_performance-ego3_min 0.00174747436277328 sim_compute_sim_state_max 0.01825287325552925 sim_compute_sim_state_mean 0.01652817871694388 sim_compute_sim_state_median 0.01652817871694388 sim_compute_sim_state_min 0.014803484178358507 sim_render-ego0_max 0.003752713941261344 sim_render-ego0_mean 0.003685463689739992 sim_render-ego0_median 0.003685463689739992 sim_render-ego0_min 0.00361821343821864 sim_render-ego1_max 0.0035224687695227927 sim_render-ego1_mean 0.003491576834441848 sim_render-ego1_median 0.003491576834441848 sim_render-ego1_min 0.003460684899360903 sim_render-ego2_max 0.0035710092504911005 sim_render-ego2_mean 0.0035575184125459063 sim_render-ego2_median 0.0035575184125459063 sim_render-ego2_min 0.003544027574600712 sim_render-ego3_max 0.003632346697272109 sim_render-ego3_mean 0.00356584846871288 sim_render-ego3_median 0.00356584846871288 sim_render-ego3_min 0.003499350240153651 simulation-passed 1 step_physics_max 0.1661889999072491 step_physics_mean 0.15890558726970694 step_physics_median 0.15890558726970694 step_physics_min 0.15162217463216474 survival_time_max 21.600000000000172 survival_time_mean 18.525000000000126 survival_time_min 15.450000000000085

Highlights

The highlights are hidden.

Artifacts

The artifacts are hidden.

Container logs

The logs are hidden.