Asymptotics of values in dynamic games on large intervals
HTML articles powered by AMS MathViewer
- by
D. V. Khlopin
Translated by: S. Kislyakov - St. Petersburg Math. J. 31 (2020), 157-179
- DOI: https://doi.org/10.1090/spmj/1590
- Published electronically: December 3, 2019
- PDF | Request permission
Abstract:
Dynamic antagonistic games are treated. The dependence of the game value on the payoff function is explored for games with one and the same dynamics, running cost, and possibilities of the players. Each payoff function is viewed as a running cost, averaged in terms of a certain probability distribution on the semiaxis. It is shown that if the dynamic programming principle is fulfilled, then a Tauberian-type theorem holds, specifically, the existence of a uniform limit of the values (as the scaling parameter tends to zero) for games with exponential and/or uniform distribution implies that the same limit exists (as the scaling parameter tends to zero) with arbitrary piecewise-continuous density. Also, a version of this theorem for games with discrete time is proved. The general results are applied to various game settings, both in the deterministic and in the stochastic case. Also, asymptotics are studied as the time horizon tends to infinity.References
- V. G. Gaĭtsgori, On the use of the averaging method in control problems, Differentsial′nye Uravneniya 22 (1986), no. 11, 1876–1886, 2019 (Russian). MR 876359
- A. F. Grishin and I. V. Poedintseva, Abelian and Tauberian theorems for integrals, Algebra i Analiz 26 (2014), no. 3, 1–88 (Russian, with Russian summary); English transl., St. Petersburg Math. J. 26 (2015), no. 3, 357–409. MR 3289177, DOI 10.1090/s1061-0022-2015-01343-5
- N. N. Krasovskiĭ and A. I. Subbotin, Pozitsionnye differentsial′nye igry, Izdat. “Nauka”, Moscow, 1974 (Russian). MR 0437107
- D. V. Khlopin, On a uniform Tauberian theorem for dynamical games, Mat. Sb. 209 (2018), no. 1, 127–150 (Russian, with Russian summary); English transl., Sb. Math. 209 (2018), no. 1, 122–144. MR 3740299, DOI 10.4213/sm8785
- D. V. Khlopin, Asymptotics of prices in differential games with averaging payoffs over large intervals, System Dynamics and Control Processes (SDCP-2014), UMC UPI, Ekaterinburg, 2015, pp. 341–348. (Russian)
- Dmitriĭ V. Khlopin, A Tauberian theorem for differential games, Mat. Teor. Igr Prilozh. 7 (2015), no. 1, 92–120 (Russian, with English and Russian summaries); English transl., Autom. Remote Control 77 (2016), no. 4, 734–750. MR 3460678, DOI 10.1134/s0005117916040172
- A. L. Yakimiv, Probabilistic applications of Tauberian theorems, Modern Probability and Statistics, VSP, Leiden, 2005. Translated from the Russian original by Andrei V. Kolchin. MR 2225340, DOI 10.1515/9783110195293.225
- Olivier Alvarez and Martino Bardi, Ergodic problems in differential games, Advances in dynamic game theory, Ann. Internat. Soc. Dynam. Games, vol. 9, Birkhäuser Boston, Boston, MA, 2007, pp. 131–152. MR 2341242, DOI 10.1007/978-0-8176-4553-3_{7}
- M. Arisawa and P.-L. Lions, On ergodic stochastic control, Comm. Partial Differential Equations 23 (1998), no. 11-12, 2187–2217. MR 1662180, DOI 10.1080/03605309808821413
- Z. Artstein and V. Gaitsgory, The value function of singularly perturbed control systems, Appl. Math. Optim. 41 (2000), no. 3, 425–445. MR 1739395, DOI 10.1007/s002459911022
- Martino Bardi, On differential games with long-time-average cost, Advances in dynamic games and their applications, Ann. Internat. Soc. Dynam. Games, vol. 10, Birkhäuser Boston, Boston, MA, 2009, pp. 3–18. MR 2521660
- G. Barles and Panagiotis E. Souganidis, On the large time behavior of solutions of Hamilton-Jacobi equations, SIAM J. Math. Anal. 31 (2000), no. 4, 925–939. MR 1752423, DOI 10.1137/S0036141099350869
- Truman Bewley and Elon Kohlberg, The asymptotic theory of stochastic games, Math. Oper. Res. 1 (1976), no. 3, 197–208. MR 529119, DOI 10.1287/moor.1.3.197
- N. H. Bingham, C. M. Goldie, and J. L. Teugels, Regular variation, Encyclopedia of Mathematics and its Applications, vol. 27, Cambridge University Press, Cambridge, 1989. MR 1015093
- R. Buckdahn, P. Cardaliaguet, and M. Quincampoix, Some recent aspects of differential game theory, Dyn. Games Appl. 1 (2011), no. 1, 74–114. MR 2800786, DOI 10.1007/s13235-010-0005-0
- Rainer Buckdahn, Dan Goreac, and Marc Quincampoix, Existence of asymptotic values for nonexpansive stochastic control systems, Appl. Math. Optim. 70 (2014), no. 1, 1–28. MR 3227533, DOI 10.1007/s00245-013-9230-4
- P. Cannarsa and M. Quincampoix, Vanishing discount limit and nonexpansive optimal control and differential games, SIAM J. Control Optim. 53 (2015), no. 4, 1789–1814. MR 3366910, DOI 10.1137/130945429
- Pierre Cardaliaguet, Ergodicity of Hamilton-Jacobi equations with a noncoercive nonconvex Hamiltonian in $\Bbb R^2/\Bbb Z^2$, Ann. Inst. H. Poincaré C Anal. Non Linéaire 27 (2010), no. 3, 837–856 (English, with English and French summaries). MR 2629882, DOI 10.1016/j.anihpc.2009.11.015
- Pierre Cardaliaguet and Sławomir Plaskacz, Invariant solutions of differential games and Hamilton-Jacobi-Isaacs equations for time-measurable Hamiltonians, SIAM J. Control Optim. 38 (2000), no. 5, 1501–1520. MR 1766427, DOI 10.1137/S0363012998296219
- Robert J. Elliott and Nigel J. Kalton, The existence of value in differential games, Memoirs of the American Mathematical Society, No. 126, American Mathematical Society, Providence, R.I., 1972. MR 0359845
- Beatris Adriana Escobedo-Trujillo, Héctor Jasso-Fuentes, and José Daniel López-Barrientos, Blackwell-Nash equilibria in zero-sum stochastic differential games, XII Symposium of Probability and Stochastic Processes, Progr. Probab., vol. 73, Birkhäuser/Springer, Cham, 2018, pp. 169–193. MR 3835792, DOI 10.1007/978-3-319-77643-9_{5}
- Albert Fathi, Sur la convergence du semi-groupe de Lax-Oleinik, C. R. Acad. Sci. Paris Sér. I Math. 327 (1998), no. 3, 267–270 (French, with English and French summaries). MR 1650261, DOI 10.1016/S0764-4442(98)80144-4
- Vladimir Gaitsgory, Alex Parkinson, and Ilya Shvartsman, Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time, Discrete Contin. Dyn. Syst. Ser. B 24 (2019), no. 4, 1743–1767. MR 3927477, DOI 10.3934/dcdsb.2018235
- V. Gaitsgory and M. Quincampoix, On sets of occupational measures generated by a deterministic control system on an infinite time horizon, Nonlinear Anal. 88 (2013), 27–41. MR 3057046, DOI 10.1016/j.na.2013.03.015
- Lars Grüne, On the relation between discounted and average optimal value functions, J. Differential Equations 148 (1998), no. 1, 65–99. MR 1637521, DOI 10.1006/jdeq.1998.3451
- D. V. Khlopin, On asymptotic value for dynamic games with saddle point, 2015 Proc. Conf. on Control and its Appl., SIAM, 2015, pp. 282–289; arXiv:1501.06993.
- Dmitry Khlopin, Tauberian theorem for value functions, Dyn. Games Appl. 8 (2018), no. 2, 401–422. MR 3784968, DOI 10.1007/s13235-017-0227-5
- D. V. Khlopin, On limit of value functions for various densities, Optimization and Applications (OPTIMA-2017, Petrovac, 2017), Proc. CEUR Workshop, vol. 1987, 2017, pp. 328–335.
- J. Korevaar, A century of complex Tauberian theory, Bull. Amer. Math. Soc. (N.S.) 39 (2002), no. 4, 475–531. MR 1920279, DOI 10.1090/S0273-0979-02-00951-5
- Xiaoxi Li and Xavier Venel, Recursive games: uniform value, Tauberian theorem and the Mertens conjecture “$Maxmin=\lim v_n=\lim v_\lambda$”, Internat. J. Game Theory 45 (2016), no. 1-2, 155–189. MR 3474864, DOI 10.1007/s00182-015-0496-4
- Ehud Lehrer and Sylvain Sorin, A uniform Tauberian theorem in dynamic programming, Math. Oper. Res. 17 (1992), no. 2, 303–307. MR 1161156, DOI 10.1287/moor.17.2.303
- Xiaoxi Li, Marc Quincampoix, and Jérôme Renault, Limit value for optimal control with general means, Discrete Contin. Dyn. Syst. 36 (2016), no. 4, 2113–2132. MR 3411556, DOI 10.3934/dcds.2016.36.2113
- J. Fritz, On the diffusive nature of entropy flow in infinite systems: remarks to a paper: “Nonlinear diffusion limit for a system with nearest neighbor interactions” [Comm. Math. Phys. 118 (1988), no. 1, 31–59; MR0954674 (89m:60255)] by M. Z. Guo, G. C. Papanicolau and S. R. S. Varadhan, Comm. Math. Phys. 133 (1990), no. 2, 331–352. MR 1090429
- J.-F. Mertens and A. Neyman, Stochastic games, Internat. J. Game Theory 10 (1981), no. 2, 53–66. MR 637403, DOI 10.1007/BF01769259
- Dov Monderer and Sylvain Sorin, Asymptotic properties in dynamic programming, Internat. J. Game Theory 22 (1993), no. 1, 1–11. MR 1229862, DOI 10.1007/BF01245566
- Miquel Oliu-Barton and Guillaume Vigeral, A uniform Tauberian theorem in optimal control, Advances in dynamic games, Ann. Internat. Soc. Dynam. Games, vol. 12, Birkhäuser/Springer, New York, 2012, pp. 199–215. MR 2976437
- Marc Quincampoix and Jérôme Renault, On the existence of a limit value in some nonexpansive optimal control problems, SIAM J. Control Optim. 49 (2011), no. 5, 2118–2132. MR 2861428, DOI 10.1137/090756818
- Jérôme Renault, General limit value in dynamic programming, J. Dyn. Games 1 (2014), no. 3, 471–484. MR 3306264, DOI 10.3934/jdg.2014.1.471
- Jérôme Renault and Xavier Venel, Long-term values in Markov decision processes and repeated games, and a new distance for probability spaces, Math. Oper. Res. 42 (2017), no. 2, 349–376. MR 3651995, DOI 10.1287/moor.2016.0814
- Sylvain Sorin, Zero-sum repeated games: recent advances and new links with differential games, Dyn. Games Appl. 1 (2011), no. 1, 172–207. MR 2800789, DOI 10.1007/s13235-010-0006-z
- Andreĭ I. Subbotin, Generalized solutions of first-order PDEs, Systems & Control: Foundations & Applications, Birkhäuser Boston, Inc., Boston, MA, 1995. The dynamical optimization perspective; Translated from the Russian. MR 1320507, DOI 10.1007/978-1-4612-0847-1
- Bruno Ziliotto, A Tauberian theorem for nonexpansive operators and applications to zero-sum stochastic games, Math. Oper. Res. 41 (2016), no. 4, 1522–1534. MR 3693739, DOI 10.1287/moor.2016.0788
- Bruno Ziliotto, General limit value in zero-sum stochastic games, Internat. J. Game Theory 45 (2016), no. 1-2, 353–374. MR 3474871, DOI 10.1007/s00182-015-0509-3
- Bruno Ziliotto, Tauberian theorems for general iterations of operators: applications to zero-sum stochastic games, Games Econom. Behav. 108 (2018), 486–503. MR 3818271, DOI 10.1016/j.geb.2018.01.009
Bibliographic Information
- D. V. Khlopin
- Affiliation: N. N. Krasovskii Institute of Mathematics and Mechanics of (IMM UB RAS), ul. S. Kovalevskoi 16, Ekaterinburg 620999, Russia
- Email: khlopin@imm.uran.ru
- Received by editor(s): September 25, 2017
- Published electronically: December 3, 2019
- Additional Notes: This investigation was supported by Russian Science Foundation, grant No. 17-11-01093
- © Copyright 2019 American Mathematical Society
- Journal: St. Petersburg Math. J. 31 (2020), 157-179
- MSC (2010): Primary 91A05; Secondary 49N90
- DOI: https://doi.org/10.1090/spmj/1590
- MathSciNet review: 3932823