DCD-RLS adaptive filters with penalties for sparse identification

TY - JOUR

T1 - DCD-RLS adaptive filters with penalties for sparse identification

AU - Zakharov, Yury

AU - Nascimento, Vitor

PY - 2013/6/15

Y1 - 2013/6/15

N2 - In this paper, we propose a family of low-complexity adaptive filtering algorithms based on dichotomous coordinate descent (DCD) iterations for identification of sparse systems. The proposed algorithms are appealing for practical designs as they operate at the bit level, resulting in stable hardware implementations. We introduce a general approach for developing adaptive filters with different penalties and specify it for exponential and sliding window RLS. We then propose low-complexity DCD-based RLS adaptive filters with the lasso, ridge-regression, elastic net, and penalties that attract sparsity. We also propose a simple recursive reweighting of the penalties and incorporate the reweighting into the proposed adaptive algorithms to further improve the performance. For general regressors, the proposed algorithms have a complexity of operations per sample, where is the filter length. For transversal adaptive filters, the algorithms require only operations per sample. A unique feature of the proposed algorithms is that they are well suited for implementation in finite precision, e.g., on FPGAs. We demonstrate by simulation that the proposed algorithms have performance close to the oracle RLS performance.

AB - In this paper, we propose a family of low-complexity adaptive filtering algorithms based on dichotomous coordinate descent (DCD) iterations for identification of sparse systems. The proposed algorithms are appealing for practical designs as they operate at the bit level, resulting in stable hardware implementations. We introduce a general approach for developing adaptive filters with different penalties and specify it for exponential and sliding window RLS. We then propose low-complexity DCD-based RLS adaptive filters with the lasso, ridge-regression, elastic net, and penalties that attract sparsity. We also propose a simple recursive reweighting of the penalties and incorporate the reweighting into the proposed adaptive algorithms to further improve the performance. For general regressors, the proposed algorithms have a complexity of operations per sample, where is the filter length. For transversal adaptive filters, the algorithms require only operations per sample. A unique feature of the proposed algorithms is that they are well suited for implementation in finite precision, e.g., on FPGAs. We demonstrate by simulation that the proposed algorithms have performance close to the oracle RLS performance.

KW - adaptive filter

KW - DCD

KW - sparse identification

U2 - 10.1109/TSP.2013.2258340

DO - 10.1109/TSP.2013.2258340

M3 - Article

SN - 1053-587X

VL - 61

SP - 3198

EP - 3213

JO - IEEE Transactions on Signal Processing

JF - IEEE Transactions on Signal Processing

IS - 12

M1 - 6502744

ER -