×

Degenerate Kalman filter error covariances and their convergence onto the unstable subspace. (English) Zbl 1365.93497

Summary: The characteristics of the model dynamics are critical in the performance of (ensemble) Kalman filters. In particular, as emphasized in the seminal work of Anna Trevisan and coauthors, the error covariance matrix is asymptotically supported by the unstable-neutral subspace only, i.e., it is spanned by the backward Lyapunov vectors with nonnegative exponents. This behavior is at the core of algorithms known as assimilation in the unstable subspace, although a formal proof was still missing. This paper provides the analytical proof of the convergence of the Kalman filter covariance matrix onto the unstable-neutral subspace when the dynamics and the observation operator are linear and when the dynamical model is error free, for any, possibly rank-deficient, initial error covariance matrix. The rate of convergence is provided as well. The derivation is based on an expression that explicitly relates the error covariances at an arbitrary time to the initial ones. It is also shown that if the unstable and neutral directions of the model are sufficiently observed and if the column space of the initial covariance matrix has a nonzero projection onto all of the forward Lyapunov vectors associated with the unstable and neutral directions of the dynamics, the covariance matrix of the Kalman filter collapses onto an asymptotic sequence which is independent of the initial covariances. Numerical results are also shown to illustrate and support the theoretical findings.

MSC:

93E11 Filtering in stochastic control theory
93C05 Linear systems in control theory
93B07 Observability
60G35 Signal detection and filtering (aspects of stochastic processes)
15A03 Vector spaces, linear dependence, rank, lineability

Software:

EnKF
PDFBibTeX XMLCite
Full Text: DOI arXiv

References:

[1] B. D. O. Anderson and J. B. Moore, {\it Optimal Filtering}, Prentice-Hall, Englewood Cliffs, NJ, 1979. · Zbl 0688.93058
[2] M. Bocquet and A. Carrassi, {\it Four-dimensional ensemble variational data assimilation and the unstable subspace}, Tellus A, to appear. · Zbl 1405.93212
[3] M. Bocquet, C. A. Pires, and L. Wu, {\it Beyond Gaussian statistical modeling in geophysical data assimilation}, Monthly Weather Rev., 138 (2010), pp. 2997-3023.
[4] M. Bocquet, P. N. Raanes, and A. Hannart, {\it Expanding the validity of the ensemble Kalman filter without the intrinsic need for inflation}, Nonlinear Process. Geophys., 22 (2015), pp. 645-662.
[5] M. Bocquet and P. Sakov, {\it An iterative ensemble Kalman smoother}, Quart. J. Roy. Meteorol. Soc., 140 (2014), pp. 1521-1535.
[6] P. Bougerol, {\it Kalman filtering with random coefficients and contractions}, SIAM J. Control Optim., 31 (1993), pp. 942-959. · Zbl 0785.93040
[7] A. Carrassi, M. Ghil, A. Trevisan, and F. Uboldi, {\it Data assimilation as a nonlinear dynamical systems problem: Stability and convergence of the prediction-assimilation system}, Chaos, 18 (2008), 023112. · Zbl 1307.34064
[8] A. Carrassi, A. Trevisan, L. Descamps, O. Talagrand, and F. Uboldi, {\it Controlling instabilities along a 3DVar analysis cycle by assimilating in the unstable subspace: A comparison with the EnKF}, Nonlinear Process. Geophys., 15 (2008), pp. 503-521.
[9] A. Carrassi, S. Vannitsem, D. Zupanski, and M. Zupanski, {\it The maximum likelihood ensemble filter performances in chaotic systems}, Tellus A, 61 (2009), pp. 587-600.
[10] G. Evensen, {\it Data Assimilation: The Ensemble Kalman Filter}, 2nd ed., Springer, Berlin, 2009. · Zbl 1157.86001
[11] Z. Gajić and M. T. J. Qureshi, {\it Lyapunov Matrix Equation in System Stability and Control}, Academic Press, San Diego, CA, 1995. · Zbl 1153.93300
[12] F. Ginelli, H. Chaté, R. Livi, and A. Politi, {\it Covariant Lyapunov vectors}, J. Phys. A, 46 (2013), 254005. · Zbl 1351.37123
[13] K. S. Gurumoorthy, C. Grudzien, A. Apte, A. Carrassi, and C. K. R. T. Jones, {\it Rank deficiency of Kalman error covariance matrices in linear time-varying system with deterministic evolution}, SIAM J. Control Optim., to appear. · Zbl 1361.93062
[14] A. H. Jazwinski, {\it Stochastic Processes and Filtering Theory}, Academic Press, New York, 1970. · Zbl 0203.50101
[15] R. E. Kalman, {\it A new approach to linear filtering and prediction problems}, J. Fluids Eng., 82 (1960), pp. 35-45.
[16] P. V. Kuptsov and U. Parlitz, {\it Theory and computation of covariant Lyapunov vectors}, J. Nonlinear Sci., 22 (2012), pp. 727-762. · Zbl 1301.37065
[17] B. Legras and R. Vautard, {\it A guide to Lyapunov vectors}, in ECMWF Workshop on Predictability, European Centre for Medium Range Weather Forecasts, Reading, UK, 1996, pp. 135-146.
[18] E. N. Lorenz and K. A. Emanuel, {\it Optimal sites for supplementary weather observations: Simulation with a small model}, J. Atmos. Sci., 55 (1998), pp. 399-414.
[19] G.-H. C. Ng, D. McLaughlin, D. Entekhabi, and A. Ahanin, {\it The role of model dynamics in ensemble Kalman filter performance for chaotic systems}, Tellus A, 63 (2011), pp. 958-977.
[20] L. Palatella, A. Carrassi, and A. Trevisan, {\it Lyapunov vectors and assimilation in the unstable subspace: Theory and applications}, J. Phys. A, 46 (2013), 254020. · Zbl 1351.37130
[21] L. Palatella and A. Trevisan, {\it Interaction of Lyapunov vectors in the formulation of the nonlinear extension of the Kalman filter}, Phys. Rev. E (3), 91 (2015), 042905.
[22] L. Palatella, A. Trevisan, and S. Rambaldi, {\it Nonlinear stability of traffic models and the use of Lyapunov vectors for estimating the traffic state}, Phys. Rev. E (3), 88 (2013), 022901.
[23] T. S. Parker and L. O. Chua, {\it Practical Numerical Algorithms for Chaotic Systems}, Springer, New York, 1989. · Zbl 0692.58001
[24] D. T. Pham, J. Verron, and M. C. Roubaud, {\it A singular evolutive extended Kalman filter for data assimilation in oceanography}, J. Marine Syst., 16 (1998), pp. 323-340.
[25] P. Sakov and L. Bertino, {\it Relation between two common localisation methods for the EnKF}, Comput. Geosci., 15 (2011), pp. 225-237. · Zbl 1213.62150
[26] D. Simon, {\it Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches}, Wiley, Hoboken, NJ, 2006.
[27] A. Trevisan, M. D’Isidoro, and O. Talagrand, {\it Four-dimensional variational assimilation in the unstable subspace and the optimal subspace dimension}, Quart. J. Roy. Meteorol. Soc., 136 (2010), pp. 487-496.
[28] A. Trevisan and L. Palatella, {\it On the Kalman filter error covariance collapse into the unstable subspace}, Nonlinear Process. Geophys., 18 (2011), pp. 243-250.
[29] A. Trevisan and F. Pancotti, {\it Periodic orbits, Lyapunov vectors, and singular vectors in the Lorenz system}, J. Atmos. Sci., 55 (1998), pp. 390-398.
[30] A. Trevisan and F. Uboldi, {\it Assimilation of standard and targeted observations within the unstable subspace of the observation-analysis-forecast cycle}, J. Atmos. Sci., 61 (2004), pp. 103-113.
[31] F. Uboldi and A. Trevisan, {\it Detecting unstable structures and controlling error growth by assimilation of standard and adaptive observations in a primitive equation ocean model}, Nonlinear Process. Geophys., 16 (2006), pp. 67-81.
[32] S. Vannitsem and V. Lucarini, {\it Statistical and dynamical properties of covariant Lyapunov vectors in a coupled atmosphere-ocean model-multiscale effects, geometric degeneracy, and error dynamics}, J. Phys. A, 49 (2016), 224001. · Zbl 1351.86015
[33] M. P. Wojtowski, {\it Geometry of Kalman fiters}, J. Geom. Symmetry Phys., 9 (2007), pp. 83-95. · Zbl 1139.93035
[34] C. L. Wolfe and R. M. Samelson, {\it An efficient method for recovering Lyapunov vectors from singular vectors}, Tellus A, 59 (2007), pp. 355-366.
[35] F. Zhang, {\it Matrix Theory: Basic Results and Techniques}, Springer, New York, 1999. · Zbl 0948.15001
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.