Stability of random-switching systems of differential equations
Authors:
C. Zhu, G. Yin and Q. S. Song
Journal:
Quart. Appl. Math. 67 (2009), 201-220
MSC (2000):
Primary 60J27, 60J75, 93D05, 93D20, 93E15
DOI:
https://doi.org/10.1090/S0033-569X-09-01092-8
Published electronically:
February 18, 2009
MathSciNet review:
2514632
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: This work is devoted to the stability of random-switching systems of differential equations. After presenting the formulation of random-switching systems, the notion of stability is recalled, and sufficient conditions in terms of the Liapunov function are presented. Then easily verifiable conditions for stability and instability of systems arising in approximation are established. Using a logarithm transformation, necessary and sufficient conditions are derived for systems that are linear in the continuous state component. Several examples are provided as demonstrations. Among other things, a somewhat different behavior from the well-known Hartman-Grobman theorem is observed.
References
- G. Barone-Adesi and R. Whaley, Efficient analytic approximation of American option values, Journal of Finance, 42 (1987), 301–320.
- Gopal K. Basak, Arnab Bisi, and Mrinal K. Ghosh, Stability of a random diffusion with linear drift, J. Math. Anal. Appl. 202 (1996), no. 2, 604–622. MR 1406250, DOI https://doi.org/10.1006/jmaa.1996.0336
- Patrick Billingsley, Convergence of probability measures, John Wiley & Sons, Inc., New York-London-Sydney, 1968. MR 0233396
- M. H. A. Davis, Piecewise-deterministic Markov processes: a general class of nondiffusion stochastic models, J. Roy. Statist. Soc. Ser. B 46 (1984), no. 3, 353–388. With discussion. MR 790622
- Jack K. Hale, Ordinary differential equations, 2nd ed., Robert E. Krieger Publishing Co., Inc., Huntington, N.Y., 1980. MR 587488
- I.Ia. Kac and N.N. Krasovskii, On the stability of systems with random parameters, J. Appl. Math. Mech., 24 (1960), 1225–1246.
- Yuandong Ji and Howard Jay Chizeck, Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control, IEEE Trans. Automat. Control 35 (1990), no. 7, 777–788. MR 1058362, DOI https://doi.org/10.1109/9.57016
- R. Z. Has′minskiĭ, Stochastic stability of differential equations, Monographs and Textbooks on Mechanics of Solids and Fluids: Mechanics and Analysis, vol. 7, Sijthoff & Noordhoff, Alphen aan den Rijn—Germantown, Md., 1980. Translated from the Russian by D. Louvish. MR 600653
- R.Z. Khasminskii, C. Zhu, and G. Yin, Stability of regime-switching diffusions, Stochastic Process. Appl., 117 (2007), 177–194.
- Harold J. Kushner and G. George Yin, Stochastic approximation and recursive algorithms and applications, 2nd ed., Applications of Mathematics (New York), vol. 35, Springer-Verlag, New York, 2003. Stochastic Modelling and Applied Probability. MR 1993642
- Xuerong Mao, Stability of stochastic differential equations with Markovian switching, Stochastic Process. Appl. 79 (1999), no. 1, 45–67. MR 1666831, DOI https://doi.org/10.1016/S0304-4149%2898%2900070-2
- M. Mariton, Jump Linear Systems in Automatic Control, Marcel Dekker, Inc., New York, 1990.
- Lawrence Perko, Differential equations and dynamical systems, 3rd ed., Texts in Applied Mathematics, vol. 7, Springer-Verlag, New York, 2001. MR 1801796
- A. V. Skorokhod, Asymptotic methods in the theory of stochastic differential equations, Translations of Mathematical Monographs, vol. 78, American Mathematical Society, Providence, RI, 1989. Translated from the Russian by H. H. McFaden. MR 1020057
- G. George Yin and Vikram Krishnamurthy, Least mean square algorithms with Markov regime-switching limit, IEEE Trans. Automat. Control 50 (2005), no. 5, 577–593. MR 2141561, DOI https://doi.org/10.1109/TAC.2005.847060
- G. Yin, Vikram Krishnamurthy, and Cristina Ion, Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization, SIAM J. Optim. 14 (2004), no. 4, 1187–1215. MR 2112970, DOI https://doi.org/10.1137/S1052623403423709
- G. George Yin and Qing Zhang, Continuous-time Markov chains and applications, Applications of Mathematics (New York), vol. 37, Springer-Verlag, New York, 1998. A singular perturbation approach. MR 1488963
- G. Yin and C. Zhu, On the notion of weak stability and related issues of hybrid diffusion systems, Nonlinear Anal.: Hybrid Sys., 1 (2007), 173-187.
- Xun Yu Zhou and G. Yin, Markowitz’s mean-variance portfolio selection with regime switching: a continuous-time model, SIAM J. Control Optim. 42 (2003), no. 4, 1466–1482. MR 2044805, DOI https://doi.org/10.1137/S0363012902405583
- Chenggui Yuan and Xuerong Mao, Asymptotic stability in distribution of stochastic differential equations with Markovian switching, Stochastic Process. Appl. 103 (2003), no. 2, 277–291. MR 1950767, DOI https://doi.org/10.1016/S0304-4149%2802%2900230-2
References
- G. Barone-Adesi and R. Whaley, Efficient analytic approximation of American option values, Journal of Finance, 42 (1987), 301–320.
- G.K. Basak, A. Bisi, and M.K. Ghosh, Stability of a random diffusion with linear drift, J. Math. Anal. Appl., 202 (1996), 604–622. MR 1406250 (97g:60091)
- P. Billingsley, Convergence of Probability Measures, J. Wiley & Sons, Inc., New York, 1968. MR 0233396 (38:1718)
- M.H.A. Davis, Piecewise-deterministic Markov processes: a general class of nondiffusion stochastic models, J. Roy. Statist. Soc. Ser. B, 46(3) (1984), 353-388. MR 790622 (87g:60062)
- J. Hale, Ordinary Differential Equations, 2nd Ed., R.E. Krieger Pub. Co., Malabar, FL, 1980. MR 587488 (82e:34001)
- I.Ia. Kac and N.N. Krasovskii, On the stability of systems with random parameters, J. Appl. Math. Mech., 24 (1960), 1225–1246.
- Y. Ji and H.J. Chizeck, Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control, IEEE Trans. Automatic Control, 35 (1990), 777–788. MR 1058362 (91h:49037)
- R.Z. Khasminskii, Stochastic Stability of Differential Equations, Sijthoff and Noordhoff, Alphen aan den Rijn, Netherlands, 1980. MR 600653 (82b:60064)
- R.Z. Khasminskii, C. Zhu, and G. Yin, Stability of regime-switching diffusions, Stochastic Process. Appl., 117 (2007), 177–194.
- H.J. Kushner and G. Yin, Stochastic Approximation and Recursive Algorithms and Applications, 2nd Ed., Springer-Verlag, New York, NY, 2003. MR 1993642 (2004e:62005)
- X. Mao, Stability of stochastic differential equations with Markovian switching, Stochastic Process. Appl., 79 (1999), 45–67. MR 1666831 (2000e:60095)
- M. Mariton, Jump Linear Systems in Automatic Control, Marcel Dekker, Inc., New York, 1990.
- L. Perko, Differential Equations and Dynamical Systems, Springer, 3rd Ed., New York, 2001. MR 1801796 (2001k:34001)
- A.V. Skorohod, Asymptotic Methods in the Theory of Stochastic Differential Equations, Amer. Math. Soc., Providence, RI, 1989. MR 1020057 (90i:60038)
- G. Yin, and V. Krishnamurthy, Least mean square algorithms with Markov regime switching limit, IEEE Trans. Automat. Control, 50 (2005), 577-593. MR 2141561 (2006b:93245)
- G. Yin, V. Krishnamurthy, and C. Ion, Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization, SIAM J. Optim., 14 (2004), 1187-1215. MR 2112970 (2005m:62148)
- G. Yin and Q. Zhang, Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach, Springer-Verlag, New York, 1998. MR 1488963 (2000a:60142)
- G. Yin and C. Zhu, On the notion of weak stability and related issues of hybrid diffusion systems, Nonlinear Anal.: Hybrid Sys., 1 (2007), 173-187.
- X.Y. Zhou and G. Yin, Markowitz’s mean-variance portfolio selection with regime switching: A continuous-time model, SIAM J. Control Optim., 42 (2003), 1466-1482. MR 2044805 (2004m:91130)
- C. Yuan and X. Mao, Asymptotic stability in distribution of stochastic differential equations with Markovian switching, Stochastic Process Appl., 103 (2003), 277–291. MR 1950767 (2003k:60142)
Similar Articles
Retrieve articles in Quarterly of Applied Mathematics
with MSC (2000):
60J27,
60J75,
93D05,
93D20,
93E15
Retrieve articles in all journals
with MSC (2000):
60J27,
60J75,
93D05,
93D20,
93E15
Additional Information
C. Zhu
Affiliation:
Department of Mathematical Sciences, University of Wisconsin-Milwaukee, Milwaukee, Wisconsin 53201
Email:
zhu@uwm.edu
G. Yin
Affiliation:
Department of Mathematics, Wayne State University, Detroit, Michigan 48202
Email:
gyin@math.wayne.edu
Q. S. Song
Affiliation:
Department of Mathematics, University of Southern California, Los Angeles, California 90089
Email:
qingshus@usc.edu
Keywords:
Random switching,
hybrid system,
stability,
necessary condition,
sufficient condition
Received by editor(s):
September 6, 2007
Published electronically:
February 18, 2009
Additional Notes:
Research of the first author was supported in part by the National Science Foundation under DMS-0304928
Research of the second author was supported in part by the National Science Foundation under DMS-0603287, and in part by the National Security Agency under MSPF-068-029
Research of the third author was supported in part by the U.S. Army Research Office MURI grant W911NF-06-1-0094 at the University of Southern California
Article copyright:
© Copyright 2009
Brown University
The copyright for this article reverts to public domain 28 years after publication.
