On stochastic stability of Markov dynamical systems
Authors:
Je. Carkovs, I. Vernigora and V. Yasinskii
Original publication:
Teoriya Imovirnostei ta Matematichna Statistika, tom 75 (2006).
Journal:
Theor. Probability and Math. Statist. 75 (2007), 179188
MSC (2000):
Primary 37H10, 34D20
Published electronically:
January 25, 2008
MathSciNet review:
2321191
Fulltext PDF Free Access
Abstract 
References 
Similar Articles 
Additional Information
Abstract: This paper aims at discussing methods and results of Lyapunov stability theory for dynamical systems with vector field subjected to permanent Markov type perturbations. The paper is organized as follows. Section 1 introduces the model of Markov dynamical system (MDS) and suggests different possible definitions of equilibrium stochastic stability, which are under discussion in the next sections. It is proven that for linear Markov dynamical systems equilibrium asymptotical stability with probability one is equivalent to the exponential decreasing of the moment with sufficiently small . In Section 3 we will discuss validity of equilibrium stability analysis of Markov dynamical systems applying a linear approximation of a vector field. Section 4 is devoted to a semigroup approach for mean square stability analysis of linear Markov dynamical systems. It permits us to write the Lyapunov matrix in an explicit form and to reduce the equilibrium stability problem to real spectrum analysis of a specially constructed closed operator.
 1.
J.
L. Doob, Stochastic processes, John Wiley & Sons, Inc.,
New York; Chapman & Hall, Limited, London, 1953. MR 0058896
(15,445b)
 2.
E.
B. Dynkin, Markov processes. Vols. I, II, Translated with the
authorization and assistance of the author by J. Fabius, V. Greenberg, A.
Maitra, G. Majone. Die Grundlehren der Mathematischen Wissenschaften,
Bände 121, vol. 122, Academic Press Inc., Publishers, New York;
SpringerVerlag, BerlinGöttingenHeidelberg, 1965. MR 0193671
(33 #1887)
 3.
Einar
Hille and Ralph
S. Phillips, Functional analysis and semigroups, American
Mathematical Society Colloquium Publications, vol. 31, American
Mathematical Society, Providence, R. I., 1957. rev. ed. MR 0089373
(19,664d)
 4.
Lambros
Katafygiotis and Yevgeny
Tsarkov, Mean square stability of linear dynamical systems with
small Markov perturbations. I. Bounded coefficients, Random Oper.
Stochastic Equations 4 (1996), no. 2, 133–154.
MR
1399076 (98h:60084), http://dx.doi.org/10.1515/rose.1996.4.2.133
 5.
Tosio
Kato, Perturbation theory for linear operators, Die
Grundlehren der mathematischen Wissenschaften, Band 132, SpringerVerlag
New York, Inc., New York, 1966. MR 0203473
(34 #3324)
 6.
R.
Z. Has′minskiĭ, Stochastic stability of differential
equations, Monographs and Textbooks on Mechanics of Solids and Fluids:
Mechanics and Analysis, vol. 7, Sijthoff & Noordhoff, Alphen aan
den Rijn—Germantown, Md., 1980. Translated from the Russian by D.
Louvish. MR
600653 (82b:60064)
 7.
V.
Korolyuk and A.
Swishchuk, SemiMarkov random evolutions, Mathematics and its
Applications, vol. 308, Kluwer Academic Publishers, Dordrecht, 1995.
Translated from the 1992 Russian original by V. Zayats and revised by the
authors. MR
1472977 (98e:60145)
 8.
M.
G. Kreĭn and M.
A. Rutman, Linear operators leaving invariant a cone in a Banach
space, Uspehi Matem. Nauk (N. S.) 3 (1948),
no. 1(23), 3–95 (Russian). MR 0027128
(10,256c)
 9.
V.
I. Oseledec, A multiplicative ergodic theorem. Characteristic
Ljapunov, exponents of dynamical systems, Trudy Moskov. Mat.
Obšč. 19 (1968), 179–210 (Russian). MR 0240280
(39 #1629)
 10.
A.
V. Skorokhod, Asymptotic methods in the theory of stochastic
differential equations, Translations of Mathematical Monographs,
vol. 78, American Mathematical Society, Providence, RI, 1989.
Translated from the Russian by H. H. McFaden. MR 1020057
(90i:60038)
 11.
K. Sadurski and Ye. Tsarkov, On diffusion approximation and stochastic stability, Theory Stoch. Process. 2(18) (1996), no. 12, 8195.
 12.
Ye.
F. Tsarkov, Averaging and stability of cocycles under dynamical
systems with rapid Markov switching, Exploring stochastic laws, VSP,
Utrecht, 1995, pp. 469–479. MR 1714028
(2000i:37076)
 1.
 J. L. Doob, Stochastic Processes, John Willey & Sons, New York, 1953. MR 0058896 (15:445b)
 2.
 E. Dynkin, Markov Processes, Academic Press, New York, 1965. MR 0193671 (33:1887)
 3.
 E. Hille and R. Philips, Functional Analysis and Semigroups, AMS Colloquium Publications, vol. 34, AMS, Providence, 1957. MR 0089373 (19:664d)
 4.
 L. Katafygiotis and Ye. Tsarkov, Mean square stability of linear dynamical systems with small Markov perturbations. I. Bounded coefficients, Random Oper. and Stoch. Equ. 2 (1996), no. 4, 149170. MR 1399076 (98h:60084)
 5.
 T. Kato, Perturbation Theory for Linear Operators, SpringerVerlag, BerlinHeidelberg, 1966. MR 0203473 (34:3324)
 6.
 R. Has'minskii, Stochastic Stability of Differential Equations, Kluwer, Norwell, MA, 1980. MR 600653 (82b:60064)
 7.
 V. S. Korolyuk and A. V. Swishchuk, SemiMarkov Random Evolution, Mathematics and its Applications, vol. 308, Kluwer Academic Publishers, Dordrecht, 1995. MR 1472977 (98e:60145)
 8.
 M. G. Krein and M. A. Rutman, Linear operators leaving invariant a cone in a Banach space, Uspehi Matem. Nauk (N.S.) 3 (1948), no. 3, 395. (Russian) MR 0027128 (10:256e)
 9.
 V. I. Oseledec, A multiplicative ergodic theorem. Lyapunov characteristic numbers for dynamical systems, Transactions of Moscow Mathematical Society 19 (1968), 197231. MR 0240280 (39:1629)
 10.
 A. V. Skorokhod, Asymptotic Methods of the Theory of Stochastic Differential Equations, AMS, Providence, RI, 1989. MR 1020057 (90i:60038)
 11.
 K. Sadurski and Ye. Tsarkov, On diffusion approximation and stochastic stability, Theory Stoch. Process. 2(18) (1996), no. 12, 8195.
 12.
 Ye. F. Tsarkov, Averaging and stability of cocycles under dynamical systems with rapid Markov switching, Exploring Stochastic Laws (A. V. Skorokhod and Yu. V. Borovskih, eds.), VSP, Utrecht, The Netherlands, 1995, pp. 469479. MR 1714028 (2000i:37076)
Similar Articles
Retrieve articles in Theory of Probability and Mathematical Statistics
with MSC (2000):
37H10,
34D20
Retrieve articles in all journals
with MSC (2000):
37H10,
34D20
Additional Information
Je. Carkovs
Affiliation:
Department of Theory Probability and Mathematical Statistics, Riga Technical University, Meza Street, 1/4, Riga, LV1048, Latvia
Email:
carkovs@livas.lv
I. Vernigora
Affiliation:
Department of Computer Sciences, Chernivtsi National University, Kotsyubyns’kiĭ Street, 2, Chernivtsi, 58000, Ukraine
Email:
irchik78@ukr.net
V. Yasinskii
Affiliation:
Department of Computer Sciences, Chernivtsi National University, Kotsyubyns’kiĭ Street, 2, Chernivtsi, 58000, Ukraine
Email:
yasik@ukrtel.net
DOI:
http://dx.doi.org/10.1090/S0094900008007242
PII:
S 00949000(08)007242
Keywords:
Markov dynamical systems,
mean square stability,
Lyapunov methods,
limit theorems for random dynamical systems,
stochastic differential equations
Received by editor(s):
November 24, 2004
Published electronically:
January 25, 2008
Article copyright:
© Copyright 2008
American Mathematical Society
