Skip to main content

Direct analytical methods for determining quasistationary distributions for continuous-time Markov chains

  • Conference paper
Athens Conference on Applied Probability and Time Series Analysis

Part of the book series: Lecture Notes in Statistics ((LNS,volume 114))

Abstract

We shall be concerned with the problem of determining the quasistationary distributions of an absorbing continuous-time Markov chain directly from the transition-rate matrix Q.We shall present conditions which ensure that any finite μ-invariant probability measure for Q is a quasistationary distribution. Our results will be illustrated with reference to birth and death processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. W.J. Anderson. Continuous-time Markov chains: an applications oriented approach. Springer-Verlag, New York, 1991.

    MATH  Google Scholar 

  2. S. Elmes, P.K. Pollett, and D. Walker. Further results on the relationship between μ-invariant measures and quasistationary distributions for continuous-time Markov chains. Submitted for publication, 1995.

    Google Scholar 

  3. P. Good. The limiting behaviour of transient birth and death processes conditioned on survival. J. Austral. Math. Soc. 8:716–722, 1968.

    Article  MathSciNet  MATH  Google Scholar 

  4. A.G. Hart. Quasistationary distributions for continuous-time Markov chains. Ph.D. Thesis, The University of Queensland, 1996.

    Google Scholar 

  5. J.F.C. Kingman. The exponential decay of Markov transition probabilities. Proc. London Math. Soc. 13:337–358, 1963.

    Article  MathSciNet  MATH  Google Scholar 

  6. M. Kijima, M.G. Nair, P.K. Pollett, and E. van Doom. Limiting conditional distributions for birth-death processes. Submitted for publication, 1995.

    Google Scholar 

  7. M.G. Nair and P.K. Pollett. On the relationship between μ-invariant measures and quasistationary distributions for continuous-time Markov chains. Adv. Appl. Probab. 25:82–102, 1993.

    Article  MathSciNet  MATH  Google Scholar 

  8. P.K. Pollett. On the equivalence of μ-invariant measures for the minimal process and its q-matrix. Stochastic Process. Appl. 22:203–221, 1986.

    Article  MathSciNet  MATH  Google Scholar 

  9. P.K. Pollett. Reversibility, invariance and μ-invariance. Adv. Appl. Probab. 20:600–621, 1988.

    Article  MathSciNet  MATH  Google Scholar 

  10. P.K. Pollett. Analytical and computational methods for modelling the long-term behaviour of evanescent random processes. In D.J. Sutton, C.E.M. Pearce, and E.A. Cousins, editors Decision Sciences: Tools for Today Proceedings of the 12th National Conference of the Australian Society for Operations Research pages 514–535, Adelaide, 1993. Australian Society for Operations Research.

    Google Scholar 

  11. P.K. Pollett. Modelling the long-term behaviour of evanescent ecological systems. In M. McAleer, editor Proceedings of the International Congress on Modelling and Simulation volume 1, pages 157–162, Perth, 1993. Modelling and Simulation Society of Australia.

    Google Scholar 

  12. P.K. Pollett. Recent advances in the theory and application of quasistationary distributions. In S. Osaki and D.N.P. Murthy, editors Proceedings of the Australia-Japan Workshop on Stochastic Models in Engineering Technology and Management pages 477–486, Singapore, 1993. World Scientific.

    Google Scholar 

  13. P.K. Pollett. The determination of quasistationary distributions directly from the transition rates of an absorbing Markov chain. Math. Computer Modelling 1995. To appear.

    Google Scholar 

  14. P.K. Pollett. Modelling the long-term behaviour of evanescent ecological systems. Ecological Modelling 75, 1995. To appear.

    Google Scholar 

  15. P.K. Pollett and D. Vere-Jones. A note on evanescent processes. Austral. J. Statist. 34:531–536, 1992.

    Article  MathSciNet  MATH  Google Scholar 

  16. G.E.H. Reuter. Denumerable Markov processes and the associated contraction semigroups on 1. Acta Math. 97:1–46, 1957.

    Article  MathSciNet  MATH  Google Scholar 

  17. R.L. Tweedie. Some ergodic properties of the feller minimal process. Quart. J. Math. Oxford 25:485–495, 1974.

    Article  MathSciNet  MATH  Google Scholar 

  18. E.A. van Doorn. Quasi-stationary distributions and convergence to quasi-stationarity of birth-death processes. Adv. Appt. Probab. 23:683–700, 1991.

    Article  MATH  Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer Science+Business Media New York

About this paper

Cite this paper

Hart, A.G., Pollett, P.K. (1996). Direct analytical methods for determining quasistationary distributions for continuous-time Markov chains. In: Heyde, C.C., Prohorov, Y.V., Pyke, R., Rachev, S.T. (eds) Athens Conference on Applied Probability and Time Series Analysis. Lecture Notes in Statistics, vol 114. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-0749-8_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-0749-8_8

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-387-94788-4

  • Online ISBN: 978-1-4612-0749-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics