Asymptotic expansions for power-exponential moments of hitting times for nonlinearly perturbed semi-Markov processes
Authors:
D. S. Silvestrov and S. D. Silvestrov
Journal:
Theor. Probability and Math. Statist. 97 (2018), 183-200
MSC (2010):
Primary 60J10, 60J27, 60K15; Secondary 65C40
DOI:
https://doi.org/10.1090/tpms/1056
Published electronically:
February 21, 2019
MathSciNet review:
3746007
Full-text PDF
Abstract |
References |
Similar Articles |
Additional Information
Abstract: New algorithms for construction of asymptotic expansions for exponential and power-exponential moments of hitting times for nonlinearly perturbed semi-Markov processes are presented. The algorithms are based on special techniques of sequential phase space reduction and the systematical use of operational calculus for Laurent asymptotic expansions applied to moments of hitting times for perturbed semi-Markov processes. These algorithms have a universal character. They can be applied to nonlinearly perturbed semi-Markov processes with an arbitrary asymptotic communicative structure of a phase space. Asymptotic expansions are given in two forms, without and with explicit bounds for remainders. The algorithms are computationally effective, due to a recurrent character of the corresponding computational procedures.
References
- Konstantin E. Avrachenkov, Jerzy A. Filar, and Phil G. Howlett, Analytic perturbation theory and its applications, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2013. MR 3137641
- D. A. Bini, G. Latouche, and B. Meini, Numerical methods for structured Markov chains, Numerical Mathematics and Scientific Computation, Oxford University Press, New York, 2005. Oxford Science Publications. MR 2132031
- P.-J. Courtois, Decomposability, Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1977. Queueing and computer system applications; ACM Monograph Series. MR 0479702
- Mats Gyllenberg and Dmitrii S. Silvestrov, Quasi-stationary phenomena in nonlinearly perturbed stochastic systems, De Gruyter Expositions in Mathematics, vol. 44, Walter de Gruyter GmbH & Co. KG, Berlin, 2008. MR 2456816
- Xi-Ren Cao, The relations among potentials, perturbation analysis, and Markov decision processes, Discrete Event Dyn. Syst. 8 (1998), no. 1, 71–87. MR 1690496, DOI https://doi.org/10.1023/A%3A1008260528575
- N. V. Kartashov, Strong stable Markov chains, VSP, Utrecht; TBiMC Scientific Publishers, Kiev, 1996. MR 1451375
- Mihail Konstantinov, Da-Wei Gu, Volker Mehrmann, and Petko Petkov, Perturbation theory for matrix equations, Studies in Computational Mathematics, vol. 9, North-Holland Publishing Co., Amsterdam, 2003. MR 1991778
- Vladimir S. Korolyuk and Vladimir V. Korolyuk, Stochastic models of systems, Mathematics and its Applications, vol. 469, Kluwer Academic Publishers, Dordrecht, 1999. MR 1753470
- Vladimir S. Koroliuk and Nikolaos Limnios, Stochastic systems in merging phase space, World Scientific Publishing Co. Pte. Ltd., Hackensack, NJ, 2005. MR 2205562
- V. Korolyuk and A. Swishchuk, Semi-Markov random evolutions, Mathematics and its Applications, vol. 308, Kluwer Academic Publishers, Dordrecht, 1995. Translated from the 1992 Russian original by V. Zayats and revised by the authors. MR 1472977
- V. S. Korolyuk and A. F. Turbin, Polumarkovskie protsessy i ikh prilozheniya, Izdat. “Naukova Dumka”, Kiev, 1976 (Russian). MR 0420902
- Vladimir S. Korolyuk and Anatoly F. Turbin, Mathematical foundations of the state lumping of large systems, Mathematics and its Applications, vol. 264, Kluwer Academic Publishers Group, Dordrecht, 1993. Translated from the 1978 Russian original by V. V. Zayats and Y. A. Atanov and revised by the authors. MR 1281385
- Dmitrii Silvestrov, Upper bounds for exponential moments of hitting times for semi-Markov processes, Comm. Statist. Theory Methods 33 (2004), no. 3, 533–543. Semi-Markov processes: theory and applications. MR 2056953, DOI https://doi.org/10.1081/STA-120028683
- Dmitrii Silvestrov and Sergei Silvestrov, Asymptotic expansions for stationary distributions of perturbed semi-Markov processes, Engineering mathematics. II, Springer Proc. Math. Stat., vol. 179, Springer, Cham, 2016, pp. 151–222. MR 3630580, DOI https://doi.org/10.1007/978-3-319-42105-6_10
- Dmitrii Silvestrov and Sergei Silvestrov, Nonlinearly perturbed semi-Markov processes, SpringerBriefs in Probability and Mathematical Statistics, Springer, Cham, 2017. MR 3700359
- G. W. Stewart, Matrix algorithms. Vol. I, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1998. Basic decompositions. MR 1653546
- G. W. Stewart, Matrix algorithms. Vol. II, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2001. Eigensystems. MR 1853468
- G. W. Stewart and Ji Guang Sun, Matrix perturbation theory, Computer Science and Scientific Computing, Academic Press, Inc., Boston, MA, 1990. MR 1061154
- G. George Yin and Qing Zhang, Discrete-time Markov chains, Applications of Mathematics (New York), vol. 55, Springer-Verlag, New York, 2005. Two-time-scale methods and applications; Stochastic Modelling and Applied Probability. MR 2092994
- G. George Yin and Qing Zhang, Continuous-time Markov chains and applications, 2nd ed., Stochastic Modelling and Applied Probability, vol. 37, Springer, New York, 2013. A two-time-scale approach. MR 2985157
References
- K. E. Avrachenkov, J. A. Filar, and P. G. Howlett, Analytic Perturbation Theory and its Applications, SIAM, Philadelphia, 2013. MR 3137641
- D. A. Bini, G. Latouche, and B. Meini, Numerical Methods for Structured Markov Chains, Numerical Mathematics and Scientific Computation, Oxford Science Publications, Oxford University Press, New York, 2005. MR 2132031
- P. J. Courtois, Decomposability: Queueing and Computer System Applications, ACM Monograph Series, Academic Press, New York, 1977. MR 0479702
- M. Gyllenberg and D. S. Silvestrov, Quasi-Stationary Phenomena in Nonlinearly Perturbed Stochastic Systems, De Gruyter Expositions in Mathematics, vol. 44, Walter de Gruyter, Berlin, 2008. MR 2456816
- Y. C. Ho and X. R. Cao, Perturbation Analysis of Discrete Event Dynamic Systems, Springer International Series in Engineering and Computer Science, Springer, New York, 1991. MR 1690496
- M. V. Kartashov, Strong Stable Markov Chains, VSP/“TViMS”, Utrecht/Kiev, 1996. MR 1451375
- M. Konstantinov, D. W. Gu, V. Mehrmann, and P. Petkov, Perturbation Theory for Matrix Equations, Studies in Computational Mathematics, vol. 9, North-Holland, Amsterdam, 2003. MR 1991778
- V. S. Korolyuk and V. V. Korolyuk, Stochastic Models of Systems, Mathematics and its Applications, vol. 469, Kluwer, Dordrecht, 1999. MR 1753470
- V. S. Koroliuk and N. Limnios, Stochastic Systems in Merging Phase Space, World Scientific, Singapore, 2005. MR 2205562
- V. Korolyuk and A. Swishchuk, Semi-Markov Random Evolutions, Mathematics and its Applications, vol. 308, Kluwer, Dordrecht, 1995. MR 1472977
- V. S. Korolyuk and A. F. Turbin, Semi-Markov Processes and its Applications, “Naukova Dumka”, Kiev, 1976. MR 0420902
- V. S. Korolyuk and A. F. Turbin, Mathematical Foundations of the State Lumping of Large Systems, Mathematics and its Applications, vol. 264, Kluwer, Dordrecht, 1993. MR 1281385
- D. S. Silvestrov, Upper bounds for exponential moments of hitting times for semi-Markov processes, Comm. Statist. Theory Methods 33 (2005), no. 3, 533–544. MR 2056953
- D. Silvestrov and S. Silvestrov, Asymptotic expansions for stationary distributions of perturbed semi-Markov processes, Engineering Mathematics II. Algebraic, Stochastic and Analysis Structures for Networks, Data Classification and Optimization (S. Silvestrov and M. Ranc̆ić, eds.), Springer Proceedings in Mathematics & Statistics, vol. 179, Springer, Cham, 2016, 151–222. MR 3630580
- D. Silvestrov and S. Silvestrov, Nonlinearly Perturbed Semi-Markov Processes, Springer Briefs Probab. Math. Stat., Springer, Cham, 2017. MR 3700359
- G. W. Stewart, Matrix Algorithms. Vol. I. Basic Decompositions, SIAM, Philadelphia, 1998. MR 1653546
- G. W. Stewart, Matrix Algorithms. Vol. II. Eigensystems, SIAM, Philadelphia, 2001. MR 1853468
- G. W. Stewart and J. G. Sun, Matrix Perturbation Theory, Computer Science and Scientific Computing, Academic Press, Boston, 1990. MR 1061154
- G. G. Yin and Q. Zhang, Discrete-Time Markov Chains. Two-Time-Scale Methods and Applications, Stochastic Modelling and Applied Probability, Springer, New York, 2005. MR 2092994
- G. G. Yin and Q. Zhang, Continuous-Time Markov Chains and Applications. A Two-Time-Scale Approach, Stochastic Modelling and Applied Probability, vol. 37, Springer, New York, 2013. MR 2985157
Similar Articles
Retrieve articles in Theory of Probability and Mathematical Statistics
with MSC (2010):
60J10,
60J27,
60K15,
65C40
Retrieve articles in all journals
with MSC (2010):
60J10,
60J27,
60K15,
65C40
Additional Information
D. S. Silvestrov
Affiliation:
Department of Mathematics, Stockholm University, SE-106 81 Stockholm, Sweden
Email:
silvestrov@math.su.se
S. D. Silvestrov
Affiliation:
Division of Applied Mathematics, Mälardalen University, SE-721 23 Västerås, Sweden
Email:
sergei.silvestrov@mdh.se
Keywords:
Semi-Markov process,
nonlinear perturbation,
hitting time,
power-exponential moment,
Laurent asymptotic expansion
Received by editor(s):
September 5, 2017
Published electronically:
February 21, 2019
Article copyright:
© Copyright 2019
American Mathematical Society
