Random evolution processes with feedback

Author:
Kyle Siegrist

Journal:
Trans. Amer. Math. Soc. **265** (1981), 375-392

MSC:
Primary 60J25

MathSciNet review:
610955

Full-text PDF Free Access

Abstract | References | Similar Articles | Additional Information

Abstract: A general random evolution Markov process is constructed which switches back and forth at random among a given collection of Markov processes ("modes of evolution") defined on a common evolution state space and indexed by an evolution rule space. Feedback is incorporated by allowing the path of the evolution component to influence the changes in evolution rule. The semigroup of the random evolution process is studied and is used to compare the process with the operator random evolutions of Griego and Hersh. Using deterministic modes of evolution, we generalize the Markov processes constructed by Erickson and by Heath. We also study new random evolution processes constructed from Brownian motions and from regular step processes.

**[1]**R. M. Blumenthal and R. K. Getoor,*Markov processes and potential theory*, Pure and Applied Mathematics, Vol. 29, Academic Press, New York-London, 1968. MR**0264757****[2]**E. B. Dynkin,*Markov processes*(2 vols.), Springer-Verlag, Berlin, 1965.**[3]**R. V. Erickson,*Paths of random evolutions*, Z. Wahrscheinlichkeitstheorie und Verw. Gebiete**29**(1974), 309–321. MR**0418252****[4]**R. J. Griego and R. Hersh,*Random evolutions, Markov chains, and systems of partial differential equations*, Proc. Nat. Acad. Sci. U.S.A.**62**(1969), 305–308. MR**0270207****[5]**Richard Griego and Reuben Hersh,*Theory of random evolutions with applications to partial differential equations*, Trans. Amer. Math. Soc.**156**(1971), 405–418. MR**0275507**, 10.1090/S0002-9947-1971-0275507-7**[6]**Richard J. Griego and Alberto Moncayo,*Random evolutions and piecing out of Markov processes*, Bol. Soc. Mat. Mexicana (2)**15**(1970), 22–29. MR**0365723****[7]**G. J. Habetler and M. A. Martino,*Existence theorems and spectral theory for the multigroup diffusion model*, Proc. Sympos. Appl. Math., Vol. XI, American Mathematical Society, Providence, R.I., 1961, pp. 127–139. MR**0144739****[8]**D. C. Heath,*Probabilistic analysis of certain hyperbolic systems of partial differential equations*, Ph.D. dissertation, Univ. Illinois, 1969.**[9]**Reuben Hersh,*Random evolutions: a survey of results and problems*, Rocky Mountain J. Math.**4**(1974), 443–477. Based on lectures given by Richard Griego, Reuben Hersh, Tom Kurtz and George Papanicolaou; Papers arising from a Conference on Stochastic Differential Equations (Univ. Alberta, Edmonton, Alta., 1972). MR**0394877****[10]**Nobuyuki Ikeda, Masao Nagasawa, and Shinzo Watanabe,*A construction of Markov processes by piecing out*, Proc. Japan Acad.**42**(1966), 370–375. MR**0202197****[11]**Nobuyuki Ikeda, Masao Nagasawa, and Shinzo Watanabe,*Branching Markov processes. I*, J. Math. Kyoto Univ.**8**(1968), 233–278. MR**0232439****[12]**Robert P. Kertz,*Limit theorems for discontinuous random evolutions with applications to initial value problems and to Markov processes on 𝑁 lines*, Ann. Probability**2**(1974), 1046–1064. MR**0368180****[13]**Robert P. Kertz,*Perturbed semigroup limit theorems with applications to discontinuous random evolutions*, Trans. Amer. Math. Soc.**199**(1974), 29–53. MR**0362521**, 10.1090/S0002-9947-1974-0362521-9**[14]**Robert P. Kertz,*Random evolutions with underlying semi-Markov processes*, Publ. Res. Inst. Math. Sci.**14**(1978), no. 3, 589–614. MR**527191**, 10.2977/prims/1195188829**[15]**Mark A. Pinsky,*Multiplicative operator functionals and their asymptotic properties*, Advances in probability and related topics, Vol. 3, Dekker, New York, 1974, pp. 1–100. MR**0368182****[16]**K. T. Siegrist,*Random evolutions with feedback*, Ph.D. dissertation, Georgia Institute of Technology, 1979.

Retrieve articles in *Transactions of the American Mathematical Society*
with MSC:
60J25

Retrieve articles in all journals with MSC: 60J25

Additional Information

DOI:
https://doi.org/10.1090/S0002-9947-1981-0610955-0

Keywords:
Markov process,
random evolution,
semigroup,
infinitesimal operator,
Brownian motion,
regular step process

Article copyright:
© Copyright 1981
American Mathematical Society