Constructing asymptotic series for probability distributions of Markov chains with weak and strong interactions
Authors:
R. Z. Khasminskii, G. Yin and Q. Zhang
Journal:
Quart. Appl. Math. 55 (1997), 177-200
MSC:
Primary 34F05; Secondary 34E05, 34E15, 60J27
DOI:
https://doi.org/10.1090/qam/1433761
MathSciNet review:
MR1433761
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: Many applications arise in manufacturing systems, and queueing network problems involve Markov chains having slow and fast components. These components are coupled through weak and strong interactions. The main goal of this work is to study asymptotic properties for the probability distribution of the aforementioned Markov chains. Explicit construction of series expansions, consisting of regular part and boundary layer part or singular part, are developed by means of singular perturbation methods. The regular part is obtained by solving algebraic-differential equations, and the singular part is derived via solution of differential equations. One of the key points in the constructions is to select appropriate initial conditions. This is done by taking into consideration the regular part and the singular part together with their interactions. It is shown that the singular part decays exponentially fast. Analysis of residue is carried out, and the error bound for the remainder terms is ascertained.
N. N. Bogoliubov and Y. A. Mitropolskii, Asymptotic Methods in the Theory of Nonlinear Oscillations, Gordon and Breach Science Publishers, New York, 1961
- Kai Lai Chung, Markov chains with stationary transition probabilities, 2nd ed., Die Grundlehren der mathematischen Wissenschaften, Band 104, Springer-Verlag New York, Inc., New York, 1967. MR 0217872
E. B. Dynkin, Markov Processes, Springer-Verlag, Berlin, 1965
- Stewart N. Ethier and Thomas G. Kurtz, Markov processes, Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons, Inc., New York, 1986. Characterization and convergence. MR 838085
- Jack K. Hale, Ordinary differential equations, 2nd ed., Robert E. Krieger Publishing Co., Inc., Huntington, N.Y., 1980. MR 587488
- R. Z. Khasminskii, G. Yin, and Q. Zhang, Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains, SIAM J. Appl. Math. 56 (1996), no. 1, 277–293. MR 1372901, DOI https://doi.org/10.1137/S0036139993259933
- Robert E. O’Malley Jr., Singular perturbation methods for ordinary differential equations, Applied Mathematical Sciences, vol. 89, Springer-Verlag, New York, 1991. MR 1123483
- Suresh P. Sethi and Qing Zhang, Hierarchical decision making in stochastic manufacturing systems, Systems & Control: Foundations & Applications, Birkhäuser Boston, Inc., Boston, MA, 1994. MR 1301778
- A. B. Vasil′eva and V. F. Butuzov, Asimptoticheskie razlozheniya resheniĭ singulyarno- vozmushchennykh uravneniĭ, Izdat. “Nauka”, Moscow, 1973 (Russian). MR 0477344
- Wolfgang Wasow, Asymptotic expansions for ordinary differential equations, Pure and Applied Mathematics, Vol. XIV, Interscience Publishers John Wiley & Sons, Inc., New York-London-Sydney, 1965. MR 0203188
N. N. Bogoliubov and Y. A. Mitropolskii, Asymptotic Methods in the Theory of Nonlinear Oscillations, Gordon and Breach Science Publishers, New York, 1961
K. L. Chung, Markov Chains with Stationary Transition Probabilities, Second Edition, Springer-Verlag, New York, 1967
E. B. Dynkin, Markov Processes, Springer-Verlag, Berlin, 1965
S. N. Ethier and T. G. Kurtz, Markov Processes, Characterization and Convergence, J. Wiley, New York, 1986
J. K. Hale, Ordinary Differential Equations, Second Edition, R. E. Krieger Publishing Co., Malabar, FL, 1980
R. Z. Khasminskii, G. Yin, and Q. Zhang, Asymptotic expansions of singularly perturbed systems involving rapidly fluctuating Markov chains, SIAM J. Appl. Math. 56, 277–293 (1996)
R. E. O’Malley, Jr., Singular Perturbation Methods for Ordinary Differential Equations, Springer-Verlag, New York, 1991
S. P. Sethi and Q. Zhang,, Hierarchical Decision Making in Stochastic Manufacturing Systems, Birkhäuser, Boston, Cambridge, MA, 1994
A. B. Vasil’eva and V. F. Butuzov, Asymptotic expansions of the solutions of singularly perturbed equations, Nauka, Moscow, 1973
W. Wasow, Asymptotic Expansions for Ordinary Differential Equations, Wiley, New York, 1965
Similar Articles
Retrieve articles in Quarterly of Applied Mathematics
with MSC:
34F05,
34E05,
34E15,
60J27
Retrieve articles in all journals
with MSC:
34F05,
34E05,
34E15,
60J27
Additional Information
Article copyright:
© Copyright 1997
American Mathematical Society
