Skip to Main Content


AMS eBook CollectionsOne of the world's most respected mathematical collections, available in digital format for your library or institution


Numerical approximations of stochastic differential equations with non-globally Lipschitz continuous coefficients

About this Title

Martin Hutzenthaler, LMU Biozentrum, Department Biologie II, University of Munich (LMU), 82152 Planegg-Martinsried, Germany and Arnulf Jentzen, Seminar for Applied Mathematics, Swiss Federal Institute of Technology Zurich, 8092 Zurich, Switzerland; Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544-1000, USA

Publication: Memoirs of the American Mathematical Society
Publication Year: 2015; Volume 236, Number 1112
ISBNs: 978-1-4704-0984-5 (print); 978-1-4704-2278-3 (online)
DOI: https://doi.org/10.1090/memo/1112
Published electronically: November 14, 2014
Keywords: Stochastic differential equation, rare event, strong convergence, numerical approximation, local Lipschitz condition, Lyapunov condition
MSC: Primary 60H35; Secondary 65C05, 65C30

View full volume PDF

View other years and numbers:

Table of Contents

Chapters

  • 1. Introduction
  • 2. Integrability properties of approximation processes for SDEs
  • 3. Convergence properties of approximation processes for SDEs
  • 4. Examples of SDEs

Abstract

Many stochastic differential equations (SDEs) in the literature have a superlinearly growing nonlinearity in their drift or diffusion coefficient. Unfortunately, moments of the computationally efficient Euler-Maruyama approximation method diverge for these SDEs in finite time. This article develops a general theory based on rare events for studying integrability properties such as moment bounds for discrete-time stochastic processes. Using this approach, we establish moment bounds for fully and partially drift-implicit Euler methods and for a class of new explicit approximation methods which require only a few more arithmetical operations than the Euler-Maruyama method. These moment bounds are then used to prove strong convergence of the proposed schemes. Finally, we illustrate our results for several SDEs from finance, physics, biology and chemistry.

References [Enhancements On Off] (What's this?)

References
  • Ait-Sahalia, Y. Testing continuous-time models of the spot interest rate. Review of Financial Studies 9, 2 (1996), 385–426.
  • Anderson, R., and May, R. Population biology of infectious diseases: Part I. Nature 280 (1979), 361–367.
  • Ludwig Arnold, Random dynamical systems, Springer Monographs in Mathematics, Springer-Verlag, Berlin, 1998. MR 1723992
  • Ludwig Arnold, N. Sri Namachchivaya, and Klaus R. Schenk-Hoppé, Toward an understanding of stochastic Hopf bifurcation: a case study, Internat. J. Bifur. Chaos Appl. Sci. Engrg. 6 (1996), no. 11, 1947–1975. MR 1430980, DOI 10.1142/S0218127496001272
  • Barth, A., Lang, A., and Schwab, C. Multilevel Monte Carlo method for parabolic stochastic partial differential equations. BIT Num. Math., September (2012).
  • Nino Boccara, Modeling complex systems, 2nd ed., Graduate Texts in Physics, Springer, New York, 2010. MR 2676220
  • Alexandros Beskos and Andrew Stuart, MCMC methods for sampling function space, ICIAM 07—6th International Congress on Industrial and Applied Mathematics, Eur. Math. Soc., Zürich, 2009, pp. 337–364. MR 2588600, DOI 10.4171/056-1/16
  • Wolf-Jürgen Beyn and Raphael Kruse, Two-sided error estimates for the stochastic theta method, Discrete Contin. Dyn. Syst. Ser. B 14 (2010), no. 2, 389–407. MR 2660864, DOI 10.3934/dcdsb.2010.14.389
  • N. Bou-Rabee and M. Hairer, Nonasymptotic mixing of the MALA algorithm, IMA J. Numer. Anal. 33 (2013), no. 1, 80–110. MR 3020951, DOI 10.1093/imanum/drs003
  • Brzeźniak, Z., Carelli, E., and Prohl, A. Finite-element-based discretizations of the incompressible Navier-Stokes equations with multiplicative random forcing. IMA J. Numer. Anal. (2013), doi: 10.1093/imanum/drs032.
  • John C. Cox, Jonathan E. Ingersoll Jr., and Stephen A. Ross, A theory of the term structure of interest rates, Econometrica 53 (1985), no. 2, 385–407. MR 785475, DOI 10.2307/1911242
  • Cox, S. G., and van Neerven, J. M. A. M. Pathwise Hölder convergence of the implicit Euler scheme for semi-linear SPDEs with multiplicative noise. To appear in Numerische Mathematik (2013). arXiv:1201.4465v1 (2012), 67 pages.
  • Jakob Creutzig, Steffen Dereich, Thomas Müller-Gronbach, and Klaus Ritter, Infinite-dimensional quadrature and approximation of distributions, Found. Comput. Math. 9 (2009), no. 4, 391–429. MR 2519865, DOI 10.1007/s10208-008-9029-x
  • Giuseppe Da Prato and Jerzy Zabczyk, Stochastic equations in infinite dimensions, Encyclopedia of Mathematics and its Applications, vol. 44, Cambridge University Press, Cambridge, 1992. MR 1207136
  • D. A. Dawson, Galerkin approximation of nonlinear Markov processes, Statistics and related topics (Ottawa, Ont., 1980) North-Holland, Amsterdam-New York, 1981, pp. 317–339. MR 665284
  • Philipp Dörsek, Semigroup splitting and cubature approximations for the stochastic Navier-Stokes equations, SIAM J. Numer. Anal. 50 (2012), no. 2, 729–746. MR 2914284, DOI 10.1137/110833841
  • Steffen Dereich, Andreas Neuenkirch, and Lukasz Szpruch, An Euler-type method for the strong approximation of the Cox-Ingersoll-Ross process, Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 468 (2012), no. 2140, 1105–1115. MR 2898556, DOI 10.1098/rspa.2011.0505
  • Dobrinevski, A., and Frey, E. Extinction in neutrally stable stochastic Lotka-Volterra models. Phys. Rev. E 85, 051903 (2012), DOI: 10.1103/PhysRevE.85.051903, 12 pages.
  • Gan, S., and Wang, X. The tamed Milstein method for commutative stochastic differential equations with non-globally Lipschitz continuous coefficients. J. Difference Equ. Appl. 19, 3 (2013), 466-490.
  • Michael B. Giles, Multilevel Monte Carlo path simulation, Oper. Res. 56 (2008), no. 3, 607–617. MR 2436856, DOI 10.1287/opre.1070.0496
  • Ginzburg, V. L., and Landau, L. D. On the theory of superconductivity. Zh. Eksperim. i teor. Fiz. 20 (1950), 1064–1082.
  • Graham, Carl, and Denis Talay. Stochastic simulation and Monte-Carlo methods. Editions de l’École Polytechnique, Palaiseau, 2012. vi+198 pp. ISBN: 978-2-7302-1582-4.
  • István Gyöngy, A note on Euler’s approximations, Potential Anal. 8 (1998), no. 3, 205–216. MR 1625576, DOI 10.1023/A:1008605221617
  • István Gyöngy, Lattice approximations for stochastic quasi-linear parabolic partial differential equations driven by space-time white noise. II, Potential Anal. 11 (1999), no. 1, 1–37. MR 1699161, DOI 10.1023/A:1008699504438
  • István Gyöngy and Nicolai Krylov, Existence of strong solutions for Itô’s stochastic equations via approximations, Probab. Theory Related Fields 105 (1996), no. 2, 143–158. MR 1392450, DOI 10.1007/BF01203833
  • István Gyöngy and Annie Millet, On discretization schemes for stochastic evolution equations, Potential Anal. 23 (2005), no. 2, 99–134. MR 2139212, DOI 10.1007/s11118-004-5393-6
  • Hairer, M., Hutzenthaler, M., and Jentzen, A. Loss of regularity for Kolmogorov equations. In revision for Ann. Probab. (2013).
  • H. Haken, J. A. S. Kelso, and H. Bunz, A theoretical model of phase transitions in human hand movements, Biol. Cybernet. 51 (1985), no. 5, 347–356. MR 778098, DOI 10.1007/BF00336922
  • Heinrich, S. Multilevel Monte Carlo methods. In Large-Scale Scientific Computing, vol. 2179 of Lect. Notes Comput. Sci. Springer, Berlin, 2001, pp. 58–67.
  • Pierre Henry-Labordère, Solvable local and stochastic volatility models: supersymmetric methods in option pricing, Quant. Finance 7 (2007), no. 5, 525–535. MR 2358916, DOI 10.1080/14697680601103045
  • Heston, S. L. A closed-form solution for options with stochastic volatility with applications to bond and currency options. Commun. Comput. Phys. 6, 2 (1993), 327–343.
  • Fred J. Hickernell, Thomas Müller-Gronbach, Ben Niu, and Klaus Ritter, Multi-level Monte Carlo algorithms for infinite-dimensional integration on $\Bbb R^{\Bbb N}$, J. Complexity 26 (2010), no. 3, 229–254. MR 2657363, DOI 10.1016/j.jco.2010.02.002
  • Desmond J. Higham, Stochastic ordinary differential equations in applied and computational mathematics, IMA J. Appl. Math. 76 (2011), no. 3, 449–474. MR 2806005, DOI 10.1093/imamat/hxr016
  • Desmond J. Higham and Peter E. Kloeden, Strong convergence rates for backward Euler on a class of nonlinear jump-diffusion problems, J. Comput. Appl. Math. 205 (2007), no. 2, 949–956. MR 2329668, DOI 10.1016/j.cam.2006.03.039
  • Desmond J. Higham, Xuerong Mao, and Andrew M. Stuart, Strong convergence of Euler-type methods for nonlinear stochastic differential equations, SIAM J. Numer. Anal. 40 (2002), no. 3, 1041–1063. MR 1949404, DOI 10.1137/S0036142901389530
  • P. Holmes and D. Rand, Phase portraits and bifurcations of the nonlinear oscillator: $\ \ddot x+(\alpha +\gamma x^{2})\dot x+\beta x+\delta x^{3}=0$, Internat. J. Non-Linear Mech. 15 (1980), no. 6, 449–458 (English, with French summary). MR 605732, DOI 10.1016/0020-7462(80)90031-1
  • Yaozhong Hu, Semi-implicit Euler-Maruyama scheme for stiff stochastic equations, Stochastic analysis and related topics, V (Silivri, 1994) Progr. Probab., vol. 38, Birkhäuser Boston, Boston, MA, 1996, pp. 183–202. MR 1396331
  • Martin Hutzenthaler and Arnulf Jentzen, Convergence of the stochastic Euler scheme for locally Lipschitz coefficients, Found. Comput. Math. 11 (2011), no. 6, 657–706. MR 2859952, DOI 10.1007/s10208-011-9101-9
  • Hutzenthaler, M., Jentzen, A., and Kloeden, P. E. Divergence of the multilevel Monte Carlo Euler method for nonlinear stochastic differential equations. Ann. Appl. Probab. 23 (2012) no.4, 1913–1966, which can also be found at http://www.ams.org/mathscinet/.
  • Martin Hutzenthaler, Arnulf Jentzen, and Peter E. Kloeden, Strong convergence of an explicit numerical method for SDEs with nonglobally Lipschitz continuous coefficients, Ann. Appl. Probab. 22 (2012), no. 4, 1611–1641. MR 2985171, DOI 10.1214/11-AAP803
  • Martin Hutzenthaler, Arnulf Jentzen, and Peter E. Kloeden, Strong and weak divergence in finite time of Euler’s method for stochastic differential equations with non-globally Lipschitz continuous coefficients, Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 467 (2011), no. 2130, 1563–1576. MR 2795791, DOI 10.1098/rspa.2010.0348
  • Arnulf Jentzen, Pathwise numerical approximation of SPDEs with additive noise under non-global Lipschitz coefficients, Potential Anal. 31 (2009), no. 4, 375–404. MR 2551596, DOI 10.1007/s11118-009-9139-3
  • Jentzen, A., and Kloeden, P. Taylor Approximations for Stochastic Partial Differential Equations, vol. 83 of CBMS-NSF Regional Conference Series in Applied Mathematics. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2012.
  • A. Jentzen, P. E. Kloeden, and A. Neuenkirch, Pathwise approximation of stochastic differential equations on domains: higher order convergence rates without global Lipschitz coefficients, Numer. Math. 112 (2009), no. 1, 41–64. MR 2481529, DOI 10.1007/s00211-008-0200-8
  • Achim Klenke, Probability theory, Universitext, Springer-Verlag London, Ltd., London, 2008. A comprehensive course; Translated from the 2006 German original. MR 2372119
  • P. E. Kloeden and A. Neuenkirch, The pathwise convergence of approximation schemes for stochastic differential equations, LMS J. Comput. Math. 10 (2007), 235–253. MR 2320830, DOI 10.1112/S1461157000001388
  • Peter E. Kloeden and Eckhard Platen, Numerical solution of stochastic differential equations, Applications of Mathematics (New York), vol. 23, Springer-Verlag, Berlin, 1992. MR 1214374
  • Kruse, R. Optimal error estimates of Galerkin finite element methods for stochastic partical differential equations with multiplicative noise. arXiv:1103.4504v1 (2011), 30 pages.
  • N. V. Krylov, A simple proof of the existence of a solution to the Itô equation with monotone coefficients, Teor. Veroyatnost. i Primenen. 35 (1990), no. 3, 576–580 (Russian); English transl., Theory Probab. Appl. 35 (1990), no. 3, 583–587 (1991). MR 1091217, DOI 10.1137/1135082
  • Leung, H. Stochastic transient of a noisy von der Pol oscillator. Physica A 221 (1995), 340–347.
  • Alan L. Lewis, Option valuation under stochastic volatility, Finance Press, Newport Beach, CA, 2000. With Mathematica code. MR 1742310
  • Wei Liu and Michael Röckner, SPDE in Hilbert space with locally monotone coefficients, J. Funct. Anal. 259 (2010), no. 11, 2902–2922. MR 2719279, DOI 10.1016/j.jfa.2010.05.012
  • Wei Liu and Michael Röckner, Local and global well-posedness of SPDE with generalized coercivity conditions, J. Differential Equations 254 (2013), no. 2, 725–755. MR 2990049, DOI 10.1016/j.jde.2012.09.014
  • Lorenz, E. Determinisitic nonperiodic flow. J. Atmos. Sci. 20 (1963), 130–141.
  • Lotka, A. J. Undamped oscillations derived from the law of mass action. J. Amer. Chem. Soc. 42, 8 (1920), 1595–1599.
  • Xuerong Mao and Lukasz Szpruch, Strong convergence and stability of implicit numerical methods for stochastic differential equations with non-globally Lipschitz continuous coefficients, J. Comput. Appl. Math. 238 (2013), 14–28. MR 2972586, DOI 10.1016/j.cam.2012.08.015
  • Mao, X., and Szpruch, L. Strong convergence rates for backward Euler-Maruyama method for nonlinear dissipative-type stochastic differential equations with super-linear diffusion coefficients. Stochastics Stochastics Rep. 85, 1 (2013), 144–171.
  • Gisir\B{o} Maruyama, Continuous Markov processes and stochastic equations, Rend. Circ. Mat. Palermo (2) 4 (1955), 48–90. MR 71666, DOI 10.1007/BF02846028
  • J. C. Mattingly, A. M. Stuart, and D. J. Higham, Ergodicity for SDEs and approximations: locally Lipschitz vector fields and degenerate noise, Stochastic Process. Appl. 101 (2002), no. 2, 185–232. MR 1931266, DOI 10.1016/S0304-4149(02)00150-3
  • G. N. Mil′šteĭn, Approximate integration of stochastic differential equations, Teor. Verojatnost. i Primenen. 19 (1974), 583–588 (Russian, with English summary). MR 0356225
  • G. N. Milstein, Numerical integration of stochastic differential equations, Mathematics and its Applications, vol. 313, Kluwer Academic Publishers Group, Dordrecht, 1995. Translated and revised from the 1988 Russian original. MR 1335454
  • G. N. Milstein, E. Platen, and H. Schurz, Balanced implicit methods for stiff stochastic systems, SIAM J. Numer. Anal. 35 (1998), no. 3, 1010–1019. MR 1619926, DOI 10.1137/S0036142994273525
  • G. N. Milstein and M. V. Tretyakov, Numerical integration of stochastic differential equations with nonglobally Lipschitz coefficients, SIAM J. Numer. Anal. 43 (2005), no. 3, 1139–1154. MR 2177799, DOI 10.1137/040612026
  • Jacques Printems, On the discretization in time of parabolic stochastic partial differential equations, M2AN Math. Model. Numer. Anal. 35 (2001), no. 6, 1055–1078. MR 1873517, DOI 10.1051/m2an:2001148
  • Roger Pettersson and Mikael Signahl, Numerical approximation for a white noise driven SPDE with locally bounded drift, Potential Anal. 22 (2005), no. 4, 375–393. MR 2135265, DOI 10.1007/s11118-004-1329-4
  • Claudia Prévôt and Michael Röckner, A concise course on stochastic partial differential equations, Lecture Notes in Mathematics, vol. 1905, Springer, Berlin, 2007. MR 2329435
  • Prigogine, I., and Lefever, R. Symmetry breaking instabilities in dissipative systems ii. J. Chem. Phys 48 (1968), 1695–1700.
  • Philip E. Protter, Stochastic integration and differential equations, 2nd ed., Applications of Mathematics (New York), vol. 21, Springer-Verlag, Berlin, 2004. Stochastic Modelling and Applied Probability. MR 2020294
  • Gareth O. Roberts and Richard L. Tweedie, Exponential convergence of Langevin distributions and their discrete approximations, Bernoulli 2 (1996), no. 4, 341–363. MR 1440273, DOI 10.2307/3318418
  • K. R. Schenk-Hoppé, Bifurcation scenarios of the noisy Duffing-van der Pol oscillator, Nonlinear Dynam. 11 (1996), no. 3, 255–274. MR 1423974, DOI 10.1007/BF00120720
  • Michael Scheutzow, Periodic behavior of the stochastic Brusselator in the mean-field limit, Probab. Theory Relat. Fields 72 (1986), no. 3, 425–462. MR 843504, DOI 10.1007/BF00334195
  • Björn Schmalfuß, The random attractor of the stochastic Lorenz system, Z. Angew. Math. Phys. 48 (1997), no. 6, 951–975. MR 1488689, DOI 10.1007/s000330050074
  • Schöner, G., Haken, H., and Kelso, J. A. S. A stochastic theory of phase transitions in human hand movements. Biol. Cybernet. 53 (1986), 247–257.
  • Henri Schurz, General theorems for numerical approximation of stochastic processes on the Hilbert space $H_2([0,T],\mu ,\Bbb R^d)$, Electron. Trans. Numer. Anal. 16 (2003), 50–69. MR 1988720
  • Henri Schurz, Convergence and stability of balanced implicit methods for systems of SDEs, Int. J. Numer. Anal. Model. 2 (2005), no. 2, 197–220. MR 2111748
  • Henri Schurz, An axiomatic approach to numerical approximations of stochastic processes, Int. J. Numer. Anal. Model. 3 (2006), no. 4, 459–480. MR 2238168
  • Lukasz Szpruch, Xuerong Mao, Desmond J. Higham, and Jiazhu Pan, Numerical simulation of a strongly nonlinear Ait-Sahalia-type interest rate model, BIT 51 (2011), no. 2, 405–425. MR 2806537, DOI 10.1007/s10543-010-0288-y
  • Timmer, J., Haussler, S., Lauk, M., and Lucking, C.-H. Pathological tremors: Deterministic chaos or nonlinear stochastic oscillators? Chaos: An Interdisciplinary Journal of Nonlinear Science 10, 1 (2000), 278–288.
  • Tran Trong Nguyen and Dang Phuoc Huy, A note on fractional stochastic Verhulst equation with small perturbation, Soochow J. Math. 28 (2002), no. 1, 57–64. MR 1893605
  • Tyson, J. J. Some further studies of nonlinear oscillations in chemical systems. J. Chem. Phys. 58, 9 (1973), 3919–3930.
  • van der Pol, B. LXXXVIII. On “relaxation-oscillations”. Philosophical Magazine Series 7 2, 11 (1926), 978–992.
  • Volterra, V. Fluctuations in the abundance of a species considered mathematically. Nature 118, 2972 (1926), 558–560.
  • Liqing Yan, The Euler scheme with irregular coefficients, Ann. Probab. 30 (2002), no. 3, 1172–1194. MR 1920104, DOI 10.1214/aop/1029867124