AMS eBook CollectionsOne of the world's most respected mathematical collections, available in digital format for your library or institution
A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria
About this Title
Jean-François Chassagneux, Dan Crisan and François Delarue
Publication: Memoirs of the American Mathematical Society
Publication Year:
2022; Volume 280, Number 1379
ISBNs: 978-1-4704-5375-6 (print); 978-1-4704-7279-5 (online)
DOI: https://doi.org/10.1090/memo/1379
Published electronically: October 6, 2022
Keywords: Master equation,
McKean-Vlasov SDEs,
forward-backward systems,
decoupling field,
Wasserstein space,
master equation
Table of Contents
Chapters
- 1. Introduction
- 2. General step-up and overview of the results
- 3. Chain rule – application to uniqueness of classical solutions
- 4. Smoothness of the decoupling field and existence of classical solutions for small time horizons
- 5. Large population stochastic control and global in time existence and uniqueness results
- 6. Appendix
Abstract
We analyze a class of nonlinear partial differential equations (PDEs) defined on $\mathbb {R}^d \times \mathcal {P}_2(\mathbb {R}^d),$ where $\mathcal {P}_2(\mathbb {R}^d)$ is the Wasserstein space of probability measures on $\mathbb {R}^d$ with a finite second-order moment. We show that such equations admit a classical solutions for sufficiently small time intervals. Under additional constraints, we prove that their solution can be extended to arbitrary large intervals. These nonlinear PDEs arise in the recent developments in the theory of large population stochastic control. More precisely they are the so-called master equations corresponding to asymptotic equilibria for a large population of controlled players with mean-field interaction and subject to minimization constraints. The results in the paper are deduced by exploiting this connection. In particular, we study the differentiability with respect to the initial condition of the flow generated by a forward-backward stochastic system of McKean-Vlasov type. As a byproduct, we prove that the decoupling field generated by the forward-backward system is a classical solution of the corresponding master equation. Finally, we give several applications to mean-field games and to the control of McKean-Vlasov diffusion processes.- Ben Andrews and Christopher Hopper, The Ricci flow in Riemannian geometry, Lecture Notes in Mathematics, vol. 2011, Springer, Heidelberg, 2011. A complete proof of the differentiable 1/4-pinching sphere theorem. MR 2760593, DOI 10.1007/978-3-642-16286-2
- Erhan Bayraktar and Asaf Cohen, Analysis of a finite state many player game using its master equation, SIAM J. Control Optim. 56 (2018), no. 5, 3538–3568. MR 3860894, DOI 10.1137/17M113887X
- Erhan Bayraktar, Andrea Cosso, and Huyên Pham, Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics, Trans. Amer. Math. Soc. 370 (2018), no. 3, 2115–2160. MR 3739204, DOI 10.1090/tran/7118
- Alain Bensoussan, Jens Frehse, and Sheung Chi Phillip Yam, The master equation in mean field theory, J. Math. Pures Appl. (9) 103 (2015), no. 6, 1441–1474. MR 3343705, DOI 10.1016/j.matpur.2014.11.005
- A. Bensoussan, J. Frehse, and S. C. P. Yam, On the interpretation of the Master Equation, Stochastic Process. Appl. 127 (2017), no. 7, 2093–2137. MR 3652408, DOI 10.1016/j.spa.2016.10.004
- Alain Bensoussan and Sheung Chi Phillip Yam, Control problem on space of random variables and master equation, ESAIM Control Optim. Calc. Var. 25 (2019), Paper No. 10, 36. MR 3943358, DOI 10.1051/cocv/2018034
- David Blackwell and Lester E. Dubins, An extension of Skorohod’s almost sure representation theorem, Proc. Amer. Math. Soc. 89 (1983), no. 4, 691–692. MR 718998, DOI 10.1090/S0002-9939-1983-0718998-0
- Rainer Buckdahn, Juan Li, Shige Peng, and Catherine Rainer, Mean-field stochastic differential equations and associated PDEs, Ann. Probab. 45 (2017), no. 2, 824–878. MR 3630288, DOI 10.1214/15-AOP1076
- P. Cardaliaguet, Notes on mean field games, Notes from P.L. Lions’ lectures at the Collège de France, https://www.ceremade.dauphine.fr/~cardaliaguet/MFG20130420.pdf, 2013.
- Pierre Cardaliaguet, François Delarue, Jean-Michel Lasry, and Pierre-Louis Lions, The master equation and the convergence problem in mean field games, Annals of Mathematics Studies, vol. 201, Princeton University Press, Princeton, NJ, 2019. MR 3967062, DOI 10.2307/j.ctvckq7qf
- René Carmona and François Delarue, Forward-backward stochastic differential equations and controlled McKean-Vlasov dynamics, Ann. Probab. 43 (2015), no. 5, 2647–2700. MR 3395471, DOI 10.1214/14-AOP946
- René Carmona and Francois Delarue, Mean field forward-backward stochastic differential equations, Electron. Commun. Probab. 18 (2013), no. 68, 15. MR 3091726, DOI 10.1214/ECP.v18-2446
- René Carmona and François Delarue, Probabilistic analysis of mean-field games, SIAM J. Control Optim. 51 (2013), no. 4, 2705–2734. MR 3072222, DOI 10.1137/120883499
- René Carmona and François Delarue, The master equation for large population equilibriums, Stochastic analysis and applications 2014, Springer Proc. Math. Stat., vol. 100, Springer, Cham, 2014, pp. 77–128. MR 3332710, DOI 10.1007/978-3-319-11292-3_{4}
- René Carmona and François Delarue, Probabilistic theory of mean field games with applications. I, Probability Theory and Stochastic Modelling, vol. 83, Springer, Cham, 2018. Mean field FBSDEs, control, and games. MR 3752669
- René Carmona and François Delarue, Probabilistic theory of mean field games with applications. II, Probability Theory and Stochastic Modelling, vol. 84, Springer, Cham, 2018. Mean field games with common noise and master equations. MR 3753660
- René Carmona, François Delarue, and Aimé Lachapelle, Control of McKean-Vlasov dynamics versus mean field games, Math. Financ. Econ. 7 (2013), no. 2, 131–166. MR 3045029, DOI 10.1007/s11579-012-0089-y
- René Carmona and Daniel Lacker, A probabilistic weak formulation of mean field games and applications, Ann. Appl. Probab. 25 (2015), no. 3, 1189–1231. MR 3325272, DOI 10.1214/14-AAP1020
- Alekos Cecchin, Paolo Dai Pra, Markus Fischer, and Guglielmo Pelino, On the convergence problem in mean field games: a two state model without uniqueness, SIAM J. Control Optim. 57 (2019), no. 4, 2443–2466. MR 3981375, DOI 10.1137/18M1222454
- Alekos Cecchin and Guglielmo Pelino, Convergence, fluctuations and large deviations for finite state mean field games via the master equation, Stochastic Process. Appl. 129 (2019), no. 11, 4510–4555. MR 4013871, DOI 10.1016/j.spa.2018.12.002
- Sandra Cerrai, Second order PDE’s in finite and infinite dimension, Lecture Notes in Mathematics, vol. 1762, Springer-Verlag, Berlin, 2001. A probabilistic approach. MR 1840644, DOI 10.1007/b80743
- Jean-François Chassagneux, Dan Crisan, and François Delarue, Numerical method for FBSDEs of McKean-Vlasov type, Ann. Appl. Probab. 29 (2019), no. 3, 1640–1684. MR 3914553, DOI 10.1214/18-AAP1429
- Andrea Cosso and Huyên Pham, Zero-sum stochastic differential games of generalized McKean-Vlasov type, J. Math. Pures Appl. (9) 129 (2019), 180–212 (English, with English and French summaries). MR 3998794, DOI 10.1016/j.matpur.2018.12.005
- François Delarue, On the existence and uniqueness of solutions to FBSDEs in a non-degenerate case, Stochastic Process. Appl. 99 (2002), no. 2, 209–286. MR 1901154, DOI 10.1016/S0304-4149(02)00085-6
- François Delarue, Estimates of the solutions of a system of quasi-linear PDEs. A probabilistic scheme, Séminaire de Probabilités XXXVII, Lecture Notes in Math., vol. 1832, Springer, Berlin, 2003, pp. 290–332 (English, with English and French summaries). MR 2053051, DOI 10.1007/978-3-540-40004-2_{1}2
- François Delarue, Mean field games: a toy model on an Erdös-Renyi graph, Journées MAS 2016 de la SMAI—Phénomènes complexes et hétérogènes, ESAIM Proc. Surveys, vol. 60, EDP Sci., Les Ulis, 2017, pp. 1–26. MR 3772471, DOI 10.1051/proc/201760001
- François Delarue, Restoring uniqueness to mean-field games by randomizing the equilibria, Stoch. Partial Differ. Equ. Anal. Comput. 7 (2019), no. 4, 598–678. MR 4022284, DOI 10.1007/s40072-019-00135-9
- François Delarue and Rinel Foguen Tchuendom, Selection of equilibria in a linear quadratic mean-field game, Stochastic Process. Appl. 130 (2020), no. 2, 1000–1040. MR 4046528, DOI 10.1016/j.spa.2019.04.005
- François Delarue, Daniel Lacker, and Kavita Ramanan, From the master equation to mean field game limit theory: a central limit theorem, Electron. J. Probab. 24 (2019), Paper No. 51, 54. MR 3954791, DOI 10.1214/19-EJP298
- François Delarue, Daniel Lacker, and Kavita Ramanan, From the master equation to mean field game limit theory: large deviations and concentration of measure, Ann. Probab. 48 (2020), no. 1, 211–263. MR 4079435, DOI 10.1214/19-AOP1359
- Markus Fischer, On the connection between symmetric $N$-player games and mean field games, Ann. Appl. Probab. 27 (2017), no. 2, 757–810. MR 3655853, DOI 10.1214/16-AAP1215
- Wendell H. Fleming and H. Mete Soner, Controlled Markov processes and viscosity solutions, Applications of Mathematics (New York), vol. 25, Springer-Verlag, New York, 1993. MR 1199811
- Avner Friedman, Partial differential equations of parabolic type, Prentice-Hall, Inc., Englewood Cliffs, NJ, 1964. MR 181836
- Wilfrid Gangbo and Andrzej Święch, Existence of a solution to an equation arising from the theory of mean field games, J. Differential Equations 259 (2015), no. 11, 6573–6643. MR 3397332, DOI 10.1016/j.jde.2015.08.001
- Wilfrid Gangbo and Adrian Tudorascu, On differentiability in the Wasserstein space and well-posedness for Hamilton-Jacobi equations, J. Math. Pures Appl. (9) 125 (2019), 119–174 (English, with English and French summaries). MR 3944201, DOI 10.1016/j.matpur.2018.09.003
- Diogo A. Gomes and João Saúde, Mean field games models—a brief survey, Dyn. Games Appl. 4 (2014), no. 2, 110–154. MR 3195844, DOI 10.1007/s13235-013-0099-2
- Diogo A. Gomes and Vardan K. Voskanyan, Extended deterministic mean-field games, SIAM J. Control Optim. 54 (2016), no. 2, 1030–1055. MR 3489048, DOI 10.1137/130944503
- Olivier Guéant, Jean-Michel Lasry, and Pierre-Louis Lions, Mean field games and applications, Paris-Princeton Lectures on Mathematical Finance 2010, Lecture Notes in Math., vol. 2003, Springer, Berlin, 2011, pp. 205–266. MR 2762362, DOI 10.1007/978-3-642-14660-2_{3}
- Minyi Huang, Roland P. Malhamé, and Peter E. Caines, Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle, Commun. Inf. Syst. 6 (2006), no. 3, 221–251. MR 2346927
- Thomas G. Kurtz, Weak and strong solutions of general stochastic models, Electron. Commun. Probab. 19 (2014), no. 58, 16. MR 3254737, DOI 10.1214/ECP.v19-2833
- Daniel Lacker, A general characterization of the mean field limit for stochastic differential games, Probab. Theory Related Fields 165 (2016), no. 3-4, 581–648. MR 3520014, DOI 10.1007/s00440-015-0641-9
- Daniel Lacker, On the convergence of closed-loop Nash equilibria to the mean field game limit, Ann. Appl. Probab. 30 (2020), no. 4, 1693–1761. MR 4133381, DOI 10.1214/19-AAP1541
- Jean-Michel Lasry and Pierre-Louis Lions, Jeux à champ moyen. I. Le cas stationnaire, C. R. Math. Acad. Sci. Paris 343 (2006), no. 9, 619–625 (French, with English and French summaries). MR 2269875, DOI 10.1016/j.crma.2006.09.019
- Jean-Michel Lasry and Pierre-Louis Lions, Jeux à champ moyen. II. Horizon fini et contrôle optimal, C. R. Math. Acad. Sci. Paris 343 (2006), no. 10, 679–684 (French, with English and French summaries). MR 2271747, DOI 10.1016/j.crma.2006.09.018
- Jean-Michel Lasry and Pierre-Louis Lions, Mean field games, Jpn. J. Math. 2 (2007), no. 1, 229–260. MR 2295621, DOI 10.1007/s11537-007-0657-8
- P.L. Lions, Théorie des jeux à champs moyen et applications, Technical report, 2007–2008.
- P.L. Lions, Cours au collège de France, http://www.college-de-france.fr/site/pierre-louis-lions/seminar-2014-11-14-11h15.htm.
- Jin Ma, Philip Protter, and Jiong Min Yong, Solving forward-backward stochastic differential equations explicitly—a four step scheme, Probab. Theory Related Fields 98 (1994), no. 3, 339–359. MR 1262970, DOI 10.1007/BF01192258
- Jin Ma, Zhen Wu, Detao Zhang, and Jianfeng Zhang, On well-posedness of forward-backward SDEs—a unified approach, Ann. Appl. Probab. 25 (2015), no. 4, 2168–2214. MR 3349005, DOI 10.1214/14-AAP1046
- Jin Ma, Hong Yin, and Jianfeng Zhang, On non-Markovian forward-backward SDEs and backward stochastic PDEs, Stochastic Process. Appl. 122 (2012), no. 12, 3980–4004. MR 2971722, DOI 10.1016/j.spa.2012.08.002
- Marcel Nutz, Jaime San Martin, and Xiaowei Tan, Convergence to the mean field game limit: a case study, Ann. Appl. Probab. 30 (2020), no. 1, 259–286. MR 4068311, DOI 10.1214/19-AAP1501
- É. Pardoux and S. Peng, Backward stochastic differential equations and quasilinear parabolic partial differential equations, Stochastic partial differential equations and their applications (Charlotte, NC, 1991) Lect. Notes Control Inf. Sci., vol. 176, Springer, Berlin, 1992, pp. 200–217. MR 1176785, DOI 10.1007/BFb0007334
- Huyên Pham and Xiaoli Wei, Dynamic programming for optimal control of stochastic McKean-Vlasov dynamics, SIAM J. Control Optim. 55 (2017), no. 2, 1069–1101. MR 3631380, DOI 10.1137/16M1071390
- Huyên Pham and Xiaoli Wei, Bellman equation and viscosity solutions for mean-field stochastic control problem, ESAIM Control Optim. Calc. Var. 24 (2018), no. 1, 437–461. MR 3843191, DOI 10.1051/cocv/2017019
- Svetlozar T. Rachev and Ludger Rüschendorf, Mass transportation problems. Vol. II, Probability and its Applications (New York), Springer-Verlag, New York, 1998. Applications. MR 1619171
- Alain-Sol Sznitman, Topics in propagation of chaos, École d’Été de Probabilités de Saint-Flour XIX—1989, Lecture Notes in Math., vol. 1464, Springer, Berlin, 1991, pp. 165–251. MR 1108185, DOI 10.1007/BFb0085169
- Cédric Villani, Optimal transport, Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 338, Springer-Verlag, Berlin, 2009. Old and new. MR 2459454, DOI 10.1007/978-3-540-71050-9
- Jiongmin Yong and Xun Yu Zhou, Stochastic controls, Applications of Mathematics (New York), vol. 43, Springer-Verlag, New York, 1999. Hamiltonian systems and HJB equations. MR 1696772, DOI 10.1007/978-1-4612-1466-3