Remote Access Transactions of the American Mathematical Society
Green Open Access

Transactions of the American Mathematical Society

ISSN 1088-6850(online) ISSN 0002-9947(print)



A new approach to the limit theory of recurrent Markov chains

Authors: K. B. Athreya and P. Ney
Journal: Trans. Amer. Math. Soc. 245 (1978), 493-501
MSC: Primary 60J10; Secondary 60K05
MathSciNet review: 511425
Full-text PDF

Abstract | References | Similar Articles | Additional Information

Abstract: Let $ \{ {X_n};\,n \geqslant 0\} $ be a Harris-recurrent Markov chain on a general state space. It is shown that there is a sequence of random times $ \{ {N_i};\,i \geqslant 1\} $ such that $ \{ {X_{{N_i}}};{\text{ }}i \geqslant 1\} $ are independent and identically distributed. This idea is used to show that $ \{ {X_n}\} $ is equivalent to a process having a recurrence point, and to develop a regenerative scheme which leads to simple proofs of the ergodic theorem, existence and uniqueness of stationary measures.

References [Enhancements On Off] (What's this?)

  • [1] K. B. Athreya, D. McDonald and P. E. Ney, Limit theorems for semi-Markov processes and renewal theory for Markov chains, Ann. Probability (to appear). MR 503952 (80f:60076)
  • [2] W. Doeblin, Éléments d'une théorie générale des chaînes simples constantes de Markoff, Ann. Sci. École Norm. Sup. 57 (1940), 61-111. MR 0004409 (3:3d)
  • [3] J. L. Doob, Stochastic processes, Wiley, New York, 1953. MR 0058896 (15:445b)
  • [4] W. Feller, An introduction to probability theory and its applications, Vol. 2, Wiley, New York, 1966. MR 0210154 (35:1048)
  • [5] D. Griffeath, Coupling methods for Markov processes, Thesis, Cornell University, 1976; Advances in Math. (to appear). MR 517252 (80k:60080)
  • [6] T. E. Harris, The existence of stationary measures for certain Markov processes, Proc. Third Berkeley Symposium on Mathematical Statistics and Probability, 1954-1955, Vol. II, Univ. of California Press, Berkeley and Los Angeles, pp. 113-124. MR 0084889 (18:941d)
  • [7] J. Neveu, Mathematical foundations of the calculus of probability, Holden-Day, San Francisco, 1965. MR 0198505 (33:6660)
  • [8] S. Orey, Limit theorems for Markov chain transition probabilities, Van Nostrand, New York, 1971. MR 0324774 (48:3123)
  • [9] D. Revuz, Markov chains, North-Holland, Amsterdam, 1975. MR 758799 (86a:60097)
  • [10] C. Stone, On moment generating functions and renewal theory, Ann. Math. Statist. 36 (1965), 1298-1301. MR 0179857 (31:4097)

Similar Articles

Retrieve articles in Transactions of the American Mathematical Society with MSC: 60J10, 60K05

Retrieve articles in all journals with MSC: 60J10, 60K05

Additional Information

Keywords: Markov chains, regeneration, ergodic theorem, invariant measure
Article copyright: © Copyright 1978 American Mathematical Society

American Mathematical Society