zbMATH — the first resource for mathematics

Sparse leaky-LMS algorithm for system identification and its convergence analysis. (English) Zbl 1337.93093
Summary: In this paper, a novel adaptive filter for sparse systems is proposed. The proposed algorithm incorporates a log-sum penalty into the cost function of the standard leaky Least Mean Square (LMS) algorithm, which results in a shrinkage in the update equation. This shrinkage, in turn, enhances the performance of the adaptive filter, especially, when the majority of unknown system coefficients are zero. Convergence analysis of the proposed algorithm is presented, and a stability criterion for the algorithm is derived. This algorithm is given a name of Zero-Attracting leaky-LMS (ZA-LLMS) algorithm. The performance of the proposed ZA-LLMS algorithm is compared to those of the standard leaky-LMS and ZA-LMS algorithms in sparse system identification settings, and it shows superior performance compared to the aforementioned algorithms.

93E11 Filtering in stochastic control theory
93C40 Adaptive control/observation systems
93E24 Least squares and related methods for stochastic control systems
93E10 Estimation and detection in stochastic control theory
93E12 Identification in stochastic control theory
Full Text: DOI
[1] Widrow, Adaptive Signal Processing (1985)
[2] Diniz, Adaptive Filtering Algorithms and Practical Implementation, 3. ed. (2008) · Zbl 1155.93002
[3] Mayyas, Leaky LMS algorithm: MSE analysis for Gaussian data, IEEE Transactions on Signal Processing 45 (4) pp 927– (1997)
[4] Guan X Chen X Wu D QX-LMS adaptive FIR filters for system identification 2nd International Congress on Image and Signal Processing (CISP2009) 2009 1 5
[5] Washi T Kawamura A Iiguni Y Sinusoidal noise reduction method using leaky LMS algorithm Proceeding of the International Symposium in Intelligent Signal Processing and Communications (ISPACS) 2006 303 306
[6] Kawamura, A tap selection algorithm for adaptive filters, IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP1986) 11 pp 2979– (1986)
[7] Li, Parallel NLMS filters with stochastic active taps and step-sizes for sparse system identification, IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP2006) 3 pp 109– (2006)
[8] Etter DM Identification of sparse impulse response systems using an adaptive delay filter IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP1985) 1985 1169 1172
[9] Jin, Robust zero-point attraction least mean square algorithm on near sparse system identification, IET Signal Processing 7 (3) (2013)
[10] Gu, l0 norm constraint LMS algorithm for sparse system identification, IEEE Signal Processing Letters 16 (9) pp 774– (2009)
[11] Su, Performance analysis of l0 norm constraint least mean square algorithm, IEEE Transactions on Signal Processing 60 (5) pp 2223– (2012) · Zbl 1391.65112
[12] Scott, Adaptive filters employing partial updates, IEEE Transactions on Circuits and Systems 44 (3) pp 209– (1997)
[13] Godavarti, Partial update LMS algorithms, IEEE Transactions on Signal Processing 53 (7) pp 2382– (2005) · Zbl 1370.93275
[14] Haykin, Adaptive Filter Theory, 4. ed. (2002) · Zbl 0723.93070
[15] Chen Y Gu Y Hero AO Sparse LMS for system identification IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP2009) 2009 3125 3128
[16] Hoyer, Non-negative matrix factorization with sparseness constraints, Journal of Machine Learning Research 49 pp 1208– (2001) · Zbl 1222.68218
[17] Huang, Acoustic MIMO Signal Processing (2006) · Zbl 1106.94003
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.