Exponential stability of matrix-valued Markov chains via nonignorable periodic data
HTML articles powered by AMS MathViewer
- by Xiongping Dai, Tingwen Huang and Yu Huang PDF
- Trans. Amer. Math. Soc. 369 (2017), 5271-5292 Request permission
Abstract:
Let $\boldsymbol {\xi }=\{\xi _n\}_{n\ge 0}$ be a Markov chain defined on a probability space $(\Omega ,\mathscr {F},\mathbb {P})$ valued in a discrete topological space $\boldsymbol {S}$ that consists of a finite number of real $d\times d$ matrices. As usual, $\boldsymbol {\xi }$ is called uniformly exponentially stable if there exist two constants $C>0$ and $0<\lambda <1$ such that \begin{gather*} \mathbb {P}\left (\|\xi _0(\omega )\dotsm \xi _{n-1}(\omega )\|\le C\lambda ^{n}\ \forall n\ge 1\right )=1; \end{gather*} and $\boldsymbol {\xi }$ is called nonuniformly exponentially stable if there exist two random variables $C(\omega )>0$ and $0<\lambda (\omega )<1$ such that \begin{gather*} \mathbb {P}\left (\|\xi _0(\omega )\dotsm \xi _{n-1}(\omega )\|\le C(\omega )\lambda (\omega )^{n}\ \forall n\ge 1\right )=1. \end{gather*} In this paper, we characterize the exponential stabilities of $\boldsymbol {\xi }$ via its nonignorable periodic data whenever $\boldsymbol {\xi }$ has a constant transition binary matrix. As an application, we construct a Lipschitz continuous $\mathrm {SL}(2,\mathbb {R})$-cocycle driven by a Markov chain with $2$-points state space, which is nonuniformly but not uniformly hyperbolic and which has constant Oseledeč splitting with respect to a canonical Markov measure.References
- Ludwig Arnold, A formula connecting sample and moment stability of linear stochastic systems, SIAM J. Appl. Math. 44 (1984), no. 4, 793–802. MR 750951, DOI 10.1137/0144057
- N. Barabanov, Lyapunov indicators of discrete inclusions I–III, Autom. Remote $\&$ Control 49 (1988), 152–157, 283–287, 558–565.
- Marc A. Berger and Yang Wang, Bounded semigroups of matrices, Linear Algebra Appl. 166 (1992), 21–27. MR 1152485, DOI 10.1016/0024-3795(92)90267-E
- Patrick Billingsley, Probability and measure, 2nd ed., Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons, Inc., New York, 1986. MR 830424
- Vincent D. Blondel and Yurii Nesterov, Computationally efficient approximations of the joint spectral radius, SIAM J. Matrix Anal. Appl. 27 (2005), no. 1, 256–272. MR 2176820, DOI 10.1137/040607009
- V. D. Blondel, J. Theys, and J. N. Tsitsiklis, When is a pair of matrices stable?, in Unsolved Problems in Mathematical Systems and Control Theory, Ed. V. D. Blondel and A. Megretski, Princeton University Press, Princeton, NJ, 2004.
- John W. Brewer, Kronecker products and matrix calculus in system theory, IEEE Trans. Circuits and Systems 25 (1978), no. 9, 772–781. Special issue on the mathematical foundations of system theory. MR 510703, DOI 10.1109/TCS.1978.1084534
- O. L. V. Costa and D. Z. Figueiredo, Stochastic stability of jump discrete-time linear systems with Markov chain in a general Borel space, IEEE Trans. Automat. Control 59 (2014), no. 1, 223–227. MR 3163341, DOI 10.1109/TAC.2013.2270031
- Oswaldo L. V. Costa and Marcelo D. Fragoso, Stability results for discrete-time linear systems with Markovian jumping parameters, J. Math. Anal. Appl. 179 (1993), no. 1, 154–178. MR 1244955, DOI 10.1006/jmaa.1993.1341
- O. L. V. Costa, M. D. Fragoso, and R. P. Marques, Discrete-time Markov jump linear systems, Probability and its Applications (New York), Springer-Verlag London, Ltd., London, 2005. MR 2109487, DOI 10.1007/b138575
- Xiongping Dai, Extremal and Barabanov semi-norms of a semigroup generated by a bounded family of matrices, J. Math. Anal. Appl. 379 (2011), no. 2, 827–833. MR 2784362, DOI 10.1016/j.jmaa.2010.12.059
- Xiongping Dai, A Gel′fand-type spectral-radius formula and stability of linear constrained switching systems, Linear Algebra Appl. 436 (2012), no. 5, 1099–1113. MR 2890907, DOI 10.1016/j.laa.2011.07.029
- Xiongping Dai, Robust periodic stability implies uniform exponential stability of Markovian jump linear systems and random linear ordinary differential equations, J. Franklin Inst. 351 (2014), no. 5, 2910–2937. MR 3191925, DOI 10.1016/j.jfranklin.2014.01.010
- Xiongping Dai, Yu Huang, and Mingqing Xiao, Almost sure stability of discrete-time switched linear systems: a topological point of view, SIAM J. Control Optim. 47 (2008), no. 4, 2137–2156. MR 2421343, DOI 10.1137/070699676
- Xiongping Dai, Yu Huang, and Mingqing Xiao, Periodically switched stability induces exponential stability of discrete-time linear switched systems in the sense of Markovian probabilities, Automatica J. IFAC 47 (2011), no. 7, 1512–1519. MR 2889251, DOI 10.1016/j.automatica.2011.02.034
- Xiongping Dai, Yu Huang, and Mingqing Xiao, Pointwise stability of descrete-time stationary matrix-valued Markovian processes, IEEE Trans. Automat. Control 60 (2015), no. 7, 1898–1903. MR 3365076, DOI 10.1109/TAC.2014.2361594
- L. Elsner, The generalized spectral-radius theorem: an analytic-geometric proof, Proceedings of the Workshop “Nonnegative Matrices, Applications and Generalizations” and the Eighth Haifa Matrix Theory Conference (Haifa, 1993), 1995, pp. 151–159. MR 1334574, DOI 10.1016/0024-3795(93)00320-Y
- Yuguang Fang and Kenneth A. Loparo, Stochastic stability of jump linear systems, IEEE Trans. Automat. Control 47 (2002), no. 7, 1204–1208. MR 1911501, DOI 10.1109/TAC.2002.800674
- Yuguang Fang and Kenneth A. Loparo, On the relationship between the sample path and moment Lyapunov exponents for jump linear systems, IEEE Trans. Automat. Control 47 (2002), no. 9, 1556–1560. MR 1924329, DOI 10.1109/TAC.2002.802749
- Leonid Gurvits, Stability of discrete linear inclusion, Linear Algebra Appl. 231 (1995), 47–85. MR 1361100, DOI 10.1016/0024-3795(95)90006-3
- B. Hanlon, N. Wang, M. Egerstedt, and C. Martin, Switched linear systems: stability and the convergence of random products, Commun. Inf. Syst. 11 (2011), no. 4, 327–342. MR 2950834, DOI 10.4310/CIS.2011.v11.n4.a2
- Roger A. Horn and Charles R. Johnson, Topics in matrix analysis, Cambridge University Press, Cambridge, 1994. Corrected reprint of the 1991 original. MR 1288752
- F. Kozin, A survey of stability of stochastic systems, Automatica J. IFAC 5 (1969), 95–112 (French, with German and Russian summaries). MR 245343, DOI 10.1016/0005-1098(69)90060-0
- Victor Kozyakin, The Berger-Wang formula for the Markovian joint spectral radius, Linear Algebra Appl. 448 (2014), 315–328. MR 3182989, DOI 10.1016/j.laa.2014.01.022
- Chanying Li, Michael Z. Q. Chen, James Lam, and Xuerong Mao, On exponential almost sure stability of random jump systems, IEEE Trans. Automat. Control 57 (2012), no. 12, 3064–3077. MR 2999183, DOI 10.1109/TAC.2012.2200369
- D. Liberzon and A. S. Morse, Basic problems in stability and design of switched systems, IEEE Control Syst. Mag. 19 (1999), 59–70.
- M. Ogura and C. F. Martin, Generalized joint spectral radius and stability of switching systems, Linear Algebra Appl. 439 (2013), no. 8, 2222–2239. MR 3091300, DOI 10.1016/j.laa.2013.06.028
- Ja. B. Pesin, An example of a nonergodic flow with nonzero characteristic exponents, Funkcional. Anal. i Priložen. 8 (1974), no. 3, 81–82 (Russian). MR 0358859
- V. Yu. Protasov, A generalized joint spectral radius. A geometric approach, Izv. Ross. Akad. Nauk Ser. Mat. 61 (1997), no. 5, 99–136 (Russian, with Russian summary); English transl., Izv. Math. 61 (1997), no. 5, 995–1030. MR 1486700, DOI 10.1070/im1997v061n05ABEH000161
- V. Yu. Protasov, When do several linear operators share an invariant cone?, Linear Algebra Appl. 433 (2010), no. 4, 781–789. MR 2654106, DOI 10.1016/j.laa.2010.04.006
- E. S. Pyatnitskiĭ and L. B. Rapoport, Periodic motions and criteria for absolute stability of nonlinear time-dependent systems, Avtomat. i Telemekh. 10 (1991), 63–73 (Russian); English transl., Automat. Remote Control 52 (1991), no. 10, 1379–1387 (1992). MR 1152861
- Mau-Hsiang Shih, Jinn-Wen Wu, and Chin-Tzong Pang, Asymptotic stability and generalized Gelfand spectral radius formula, Linear Algebra Appl. 252 (1997), 61–70. MR 1428628, DOI 10.1016/0024-3795(95)00592-7
- Robert Shorten, Fabian Wirth, Oliver Mason, Kai Wulff, and Christopher King, Stability criteria for switched and hybrid systems, SIAM Rev. 49 (2007), no. 4, 545–592. MR 2375524, DOI 10.1137/05063516X
- Peter Walters, An introduction to ergodic theory, Graduate Texts in Mathematics, vol. 79, Springer-Verlag, New York-Berlin, 1982. MR 648108
- Jianhong Xu and Mingqing Xiao, A characterization of the generalized spectral radius with Kronecker powers, Automatica J. IFAC 47 (2011), no. 7, 1530–1533. MR 2889254, DOI 10.1016/j.automatica.2011.04.007
- L.-S. Young, Some open sets of nonuniformly hyperbolic cocycles, Ergodic Theory Dynam. Systems 13 (1993), no. 2, 409–415. MR 1235481, DOI 10.1017/S0143385700007446
- Ding-Xuan Zhou, The $p$-norm joint spectral radius for even integers, Methods Appl. Anal. 5 (1998), no. 1, 39–54. MR 1631335, DOI 10.4310/MAA.1998.v5.n1.a2
Additional Information
- Xiongping Dai
- Affiliation: Department of Mathematics, Nanjing University, Nanjing 210093, People’s Republic of China
- MR Author ID: 609395
- Email: xpdai@nju.edu.cn
- Tingwen Huang
- Affiliation: Science Program, Texas A$\&$M University at Qatar, P.O. Box 23874, Doha, Qatar
- Email: tingwen.huang@qatar.tamu.edu
- Yu Huang
- Affiliation: Department of Mathematics, Zhongshan (Sun Yat-Sen) University, Guangzhou 510275, People’s Republic of China
- MR Author ID: 197768
- Email: stshyu@mail.sysu.edu.cn
- Received by editor(s): August 19, 2015
- Published electronically: January 9, 2017
- © Copyright 2017 American Mathematical Society
- Journal: Trans. Amer. Math. Soc. 369 (2017), 5271-5292
- MSC (2010): Primary 93E15, 37C75; Secondary 60J10, 93C30, 15A52, 93D20
- DOI: https://doi.org/10.1090/tran/6912
- MathSciNet review: 3646762