Duckietown Challenges Home Challenges Submissions

Submission 12674

Submission12674
Competingyes
Challengeaido5-LFV_multi-sim-testing
UserBea Baselines 🐤
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💚
JobsLFVmultibodyv-sim: 53497
Next
User labelbaseline-duckietown
Admin priority50
Blessingn/a
User priority50

The highlights are available only to the owner and the admins.

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
53497LFVmultibodyv-simsuccessyes1:42:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0653124009090247
survival_time_median59.99999999999873
deviation-center-line_median3.5269811335906747
in-drivable-lane_median8.774999999999904


other stats
agent_compute-ego0_max0.01376057119297802
agent_compute-ego0_mean0.01207049405415167
agent_compute-ego0_median0.011660532788571272
agent_compute-ego0_min0.011143876948424124
agent_compute-ego1_max0.011805763848119733
agent_compute-ego1_mean0.011673112881559785
agent_compute-ego1_median0.01179619911409834
agent_compute-ego1_min0.011260593590671069
agent_compute-ego2_max0.01251318651273983
agent_compute-ego2_mean0.012083081460647654
agent_compute-ego2_median0.011946928531006163
agent_compute-ego2_min0.01178912933819697
agent_compute-ego3_max0.011412711465090736
agent_compute-ego3_mean0.0113453077649714
agent_compute-ego3_median0.011316363375288505
agent_compute-ego3_min0.011306848454534958
complete-iteration_max1.166461277725105
complete-iteration_mean0.9560285482629036
complete-iteration_median1.099287197254381
complete-iteration_min0.2741516959177305
deviation-center-line_max6.658525661278727
deviation-center-line_mean2.9922080985742023
deviation-center-line_min0.3487993547739799
deviation-heading_max27.898773454390817
deviation-heading_mean15.873855603124424
deviation-heading_median19.38328696414301
deviation-heading_min2.206078527664331
driven_any_max7.920431501175876
driven_any_mean4.7369239560146665
driven_any_median4.5514912282205575
driven_any_min0.160671805154944
driven_lanedir_consec_max5.602500060828261
driven_lanedir_consec_mean2.731521061487148
driven_lanedir_consec_min0.14746808103183673
driven_lanedir_max5.7266240465529705
driven_lanedir_mean3.170694365755834
driven_lanedir_median3.417872906512262
driven_lanedir_min0.14746808103183673
get_duckie_state_max1.8018827701272225e-06
get_duckie_state_mean1.725975120323046e-06
get_duckie_state_median1.7403960724258105e-06
get_duckie_state_min1.6568205338731396e-06
get_robot_state_max0.0138415809872744
get_robot_state_mean0.012784666016464294
get_robot_state_median0.013813085698962313
get_robot_state_min0.0068853407689969835
get_state_dump_max0.009192049652213955
get_state_dump_mean0.008700306973257367
get_state_dump_median0.009184334212377255
get_state_dump_min0.005873294725810012
get_ui_image_max0.05044645790652768
get_ui_image_mean0.044830890497356675
get_ui_image_median0.04772985328941123
get_ui_image_min0.02988703773446279
in-drivable-lane_max49.24999999999864
in-drivable-lane_mean12.760714285714077
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.160671805154944, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 0.14746808103183673, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.38963322176847, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 5.01805768121352, "driven_lanedir_consec": 0.14746808103183673, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 5.152127725592337, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 3.876487024868991, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 5.600000000000059, "deviation-heading": 14.041142982422402, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.775152956893138, "driven_lanedir_consec": 3.1884305453985156, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.9728867243526669, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.4675005289315144, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 3.1000000000000085, "deviation-heading": 16.901668181558097, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.721012784244379, "driven_lanedir_consec": 1.4675005289315144, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.8997756200461005, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.3073588183958913, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 28.449999999999815, "deviation-heading": 4.017439501190517, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 0.6232606486747951, "driven_lanedir_consec": 0.760029404494907, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.098694708375491, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 1.2021005996937888, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 49.24999999999864, "deviation-heading": 4.479160067115061, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 0.6685777393441074, "driven_lanedir_consec": 0.9545128566479312, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 7.906586753557528, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.565443751359446, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 8.599999999999866, "deviation-heading": 25.494099881646363, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 4.106553766736716, "driven_lanedir_consec": 3.171366013662516, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.913471073902338, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 4.57146845509793, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 17.349999999999767, "deviation-heading": 22.16918242628548, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.87448456982687, "driven_lanedir_consec": 4.57146845509793, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 7.913401758913237, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.2157658710816595, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 13.099999999999795, "deviation-heading": 21.589342506614155, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.6521403641664008, "driven_lanedir_consec": 3.95946232119375, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.920421466363552, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.7266240465529705, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 8.949999999999942, "deviation-heading": 21.5390492896068, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7659268681008897, "driven_lanedir_consec": 5.602500060828261, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.920329828289729, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 4.643283928995383, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 18.04999999999933, "deviation-heading": 18.378638396939017, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.4018219030149486, "driven_lanedir_consec": 4.643283928995383, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.950854730848779, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 2.9592587881555334, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 5.450000000000045, "deviation-heading": 27.898773454390817, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 6.658525661278727, "driven_lanedir_consec": 2.9592587881555334, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 7.920431501175876, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.3140278758051185, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 12.349999999999705, "deviation-heading": 20.387935531347008, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7900592621661313, "driven_lanedir_consec": 5.3140278758051185, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7936922895829552, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 1.6314436480886731, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 2.741834475193422, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.3487993547739799, "driven_lanedir_consec": 0.8664082177196974, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.793589398049799, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 0.7614897025229552, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 7.900000000000079, "deviation-heading": 2.206078527664331, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.48653981960423054, "driven_lanedir_consec": 0.6355777828571864, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}}
set_robot_commands_max0.002127653156887185
set_robot_commands_mean0.002096018546088179
set_robot_commands_median0.002094592665669912
set_robot_commands_min0.0020687498458444257
sim_compute_performance-ego0_max0.001884248036329792
sim_compute_performance-ego0_mean0.0018624519157663015
sim_compute_performance-ego0_median0.001860888679523516
sim_compute_performance-ego0_min0.0018348024316030007
sim_compute_performance-ego1_max0.0018902150610634555
sim_compute_performance-ego1_mean0.0018594752550591016
sim_compute_performance-ego1_median0.001855757909452389
sim_compute_performance-ego1_min0.0018260127877535888
sim_compute_performance-ego2_max0.0018652241331592837
sim_compute_performance-ego2_mean0.001861022160456932
sim_compute_performance-ego2_median0.001861942300788568
sim_compute_performance-ego2_min0.001855900047422944
sim_compute_performance-ego3_max0.001888312193982882
sim_compute_performance-ego3_mean0.0018717470826524235
sim_compute_performance-ego3_median0.0018720466032512576
sim_compute_performance-ego3_min0.001854882450723132
sim_compute_sim_state_max0.03844714978652433
sim_compute_sim_state_mean0.027749253625989432
sim_compute_sim_state_median0.03789032269874083
sim_compute_sim_state_min0.01026910461791574
sim_render-ego0_max0.003644954590570359
sim_render-ego0_mean0.0036105240064669662
sim_render-ego0_median0.0036303222824592175
sim_render-ego0_min0.003560206661485646
sim_render-ego1_max0.0036898544686323
sim_render-ego1_mean0.003648677000026128
sim_render-ego1_median0.003650173507537459
sim_render-ego1_min0.0035970039563636255
sim_render-ego2_max0.003804211612545779
sim_render-ego2_mean0.003752164094587169
sim_render-ego2_median0.003739946169363227
sim_render-ego2_min0.003712334501852501
sim_render-ego3_max0.0036842823028564457
sim_render-ego3_mean0.0036568941491668585
sim_render-ego3_median0.003653979540468756
sim_render-ego3_min0.0036324206041753737
simulation-passed1
step_physics_max1.004639977500552
step_physics_mean0.7895518543458537
step_physics_median0.9112773281052944
step_physics_min0.18357656344975512
survival_time_max59.99999999999873
survival_time_mean47.749999999999254
survival_time_min14.550000000000072
No reset possible