Quasi-Monte Carlo Bayesian estimation under Besov priors in elliptic inverse problems

Herrmann, Lukas; Keller, Magdalena; Schwab, Christoph

doi:10.1090/mcom/3615

Quasi-Monte Carlo Bayesian estimation under Besov priors in elliptic inverse problems
HTML articles powered by AMS MathViewer

by Lukas Herrmann, Magdalena Keller and Christoph Schwab HTML | PDF

Math. Comp. 90 (2021), 1831-1860

Abstract:

We analyze rates of convergence for quasi-Monte Carlo (QMC) integration for Bayesian inversion of linear, elliptic partial differential equations with uncertain input from function spaces. Adopting a Riesz or Schauder basis representation of the uncertain inputs, function space priors are constructed as product measures on spaces of (sequences of) coefficients in the basis representations. The numerical approximation of the posterior expectation, given data, then amounts to a high- or infinite-dimensional numerical integration problem. We consider in particular so-called Besov priors on the admissible uncertain inputs. We extend the QMC convergence theory from the Gaussian case, and establish sufficient conditions on the uncertain inputs for achieving dimension-independent convergence rates greater than $1/2$ of QMC integration with randomly shifted lattice rules. We apply the theory to a concrete class of linear, second order elliptic boundary value problems with log-Besov uncertain diffusion coefficient.

References

Kweku Abraham and Richard Nickl, On statistical Calderón problems, Math. Stat. Learn. 2 (2019), no. 2, 165–216. MR 4130599
Milton Abramowitz and Irene A. Stegun, Handbook of mathematical functions with formulas, graphs, and mathematical tables, National Bureau of Standards Applied Mathematics Series, No. 55, U. S. Government Printing Office, Washington, D.C., 1964. For sale by the Superintendent of Documents. MR 0167642
James H. Adler and Victor Nistor, Graded mesh approximation in weighted Sobolev spaces and elliptic equations in 2D, Math. Comp. 84 (2015), no. 295, 2191–2220. MR 3356024, DOI 10.1090/S0025-5718-2015-02934-2
S. Agapiou, M. Dashti, and T. Helin. Rates of contraction of posterior distributions based on $p$-exponential priors. To appear in Bernoulli. arXiv:1811.12244.
I. Babuška and B. Q. Guo, Regularity of the solution of elliptic problems with piecewise analytic data. I. Boundary value problems for linear elliptic equation of second order, SIAM J. Math. Anal. 19 (1988), no. 1, 172–203. MR 924554, DOI 10.1137/0519014
Vladimir I. Bogachev, Gaussian measures, Mathematical Surveys and Monographs, vol. 62, American Mathematical Society, Providence, RI, 1998. MR 1642391, DOI 10.1090/surv/062
Constantin Băcuţă, Hengguang Li, and Victor Nistor, Differential operators on domains with conical points: precise uniform regularity estimates, Rev. Roumaine Math. Pures Appl. 62 (2017), no. 3, 383–411. MR 3711082
Peng Chen, Umberto Villa, and Omar Ghattas, Hessian-based adaptive sparse quadrature for infinite-dimensional Bayesian inverse problems, Comput. Methods Appl. Mech. Engrg. 327 (2017), 147–172. MR 3725766, DOI 10.1016/j.cma.2017.08.016
G. M. Constantine and T. H. Savits, A multivariate Faà di Bruno formula with applications, Trans. Amer. Math. Soc. 348 (1996), no. 2, 503–520. MR 1325915, DOI 10.1090/S0002-9947-96-01501-2
Masoumeh Dashti, Stephen Harris, and Andrew Stuart, Besov priors for Bayesian inverse problems, Inverse Probl. Imaging 6 (2012), no. 2, 183–200. MR 2942737, DOI 10.3934/ipi.2012.6.183
Masoumeh Dashti and Andrew M. Stuart, The Bayesian approach to inverse problems, Handbook of uncertainty quantification. Vol. 1, 2, 3, Springer, Cham, 2017, pp. 311–428. MR 3839555
Josef Dick, Robert N. Gantner, Quoc T. Le Gia, and Christoph Schwab, Multilevel higher-order quasi-Monte Carlo Bayesian estimation, Math. Models Methods Appl. Sci. 27 (2017), no. 5, 953–995. MR 3636617, DOI 10.1142/S021820251750021X
Josef Dick, Robert N. Gantner, Quoc T. Le Gia, and Christoph Schwab, Higher order quasi-Monte Carlo integration for Bayesian PDE inversion, Comput. Math. Appl. 77 (2019), no. 1, 144–172. MR 3907407, DOI 10.1016/j.camwa.2018.09.019
Josef Dick, Frances Y. Kuo, and Ian H. Sloan, High-dimensional integration: the quasi-Monte Carlo way, Acta Numer. 22 (2013), 133–288. MR 3038697, DOI 10.1017/S0962492913000044
Oliver G. Ernst, Björn Sprungk, and Hans-Jörg Starkloff, Analysis of the ensemble and polynomial chaos Kalman filters in Bayesian inverse problems, SIAM/ASA J. Uncertain. Quantif. 3 (2015), no. 1, 823–851. MR 3400030, DOI 10.1137/140981319
R. N. Gantner. Computational Higher-Order Quasi-Monte Carlo for Random Partial Differential Equations. PhD thesis, ETH Zürich, 2017. Diss ETH No. 24529.
Robert N. Gantner and Christoph Schwab, Computational higher order quasi-Monte Carlo integration, Monte Carlo and quasi-Monte Carlo methods, Springer Proc. Math. Stat., vol. 163, Springer, [Cham], 2016, pp. 271–288. MR 3536664, DOI 10.1007/978-3-319-33507-0_{1}2
Evarist Giné and Richard Nickl, Mathematical foundations of infinite-dimensional statistical models, Cambridge Series in Statistical and Probabilistic Mathematics, [40], Cambridge University Press, New York, 2016. MR 3588285, DOI 10.1017/CBO9781107337862
I. G. Graham, F. Y. Kuo, J. A. Nichols, R. Scheichl, Ch. Schwab, and I. H. Sloan, Quasi-Monte Carlo finite element methods for elliptic PDEs with lognormal random coefficients, Numer. Math. 131 (2015), no. 2, 329–368. MR 3385149, DOI 10.1007/s00211-014-0689-y
Pierre Grisvard, Elliptic problems in nonsmooth domains, Classics in Applied Mathematics, vol. 69, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2011. Reprint of the 1985 original [ MR0775683]; With a foreword by Susanne C. Brenner. MR 3396210, DOI 10.1137/1.9781611972030.ch1
L. Herrmann. Quasi-Monte Carlo Integration in Uncertainty Quantification for PDEs with log-Gaussian Random Field Inputs. PhD thesis, ETH Zürich, 2019. Diss ETH No. 25849.
Lukas Herrmann, Strong convergence analysis of iterative solvers for random operator equations, Calcolo 56 (2019), no. 4, Paper No. 46, 26. MR 4028206, DOI 10.1007/s10092-019-0342-3
Lukas Herrmann, Annika Lang, and Christoph Schwab, Numerical analysis of lognormal diffusions on the sphere, Stoch. Partial Differ. Equ. Anal. Comput. 6 (2018), no. 1, 1–44. MR 3768993, DOI 10.1007/s40072-017-0101-x
Lukas Herrmann and Christoph Schwab, QMC algorithms with product weights for lognormal-parametric, elliptic PDEs, Monte Carlo and quasi–Monte Carlo methods, Springer Proc. Math. Stat., vol. 241, Springer, Cham, 2018, pp. 313–330. MR 3828148, DOI 10.1007/978-3-319-91436-7_{1}7
Lukas Herrmann and Christoph Schwab, Multilevel quasi-Monte Carlo integration with product weights for elliptic PDEs with lognormal coefficients, ESAIM Math. Model. Numer. Anal. 53 (2019), no. 5, 1507–1552. MR 3989595, DOI 10.1051/m2an/2019016
Lukas Herrmann and Christoph Schwab, QMC integration for lognormal-parametric, elliptic PDEs: local supports and product weights, Numer. Math. 141 (2019), no. 1, 63–102. MR 3903203, DOI 10.1007/s00211-018-0991-1
Pierre L’Ecuyer, Randomized quasi–Monte Carlo: an introduction for practitioners, Monte Carlo and quasi–Monte Carlo methods, Springer Proc. Math. Stat., vol. 241, Springer, Cham, 2018, pp. 29–52. MR 3828133, DOI 10.1007/978-3-319-91436-7_{2}
Bamdad Hosseini and Nilima Nigam, Well-posed Bayesian inverse problems: priors with exponential tails, SIAM/ASA J. Uncertain. Quantif. 5 (2017), no. 1, 436–465. MR 3640629, DOI 10.1137/16M1076824
Frances Y. Kuo, Robert Scheichl, Christoph Schwab, Ian H. Sloan, and Elisabeth Ullmann, Multilevel quasi-Monte Carlo methods for lognormal diffusion problems, Math. Comp. 86 (2017), no. 308, 2827–2860. MR 3667026, DOI 10.1090/mcom/3207
F. Y. Kuo, Ch. Schwab, and I. H. Sloan, Quasi-Monte Carlo methods for high-dimensional integration: the standard (weighted Hilbert space) setting and beyond, ANZIAM J. 53 (2011), no. 1, 1–37. MR 2928989, DOI 10.1017/S1446181112000077
Frances Y. Kuo, Christoph Schwab, and Ian H. Sloan, Quasi-Monte Carlo finite element methods for a class of elliptic partial differential equations with random coefficients, SIAM J. Numer. Anal. 50 (2012), no. 6, 3351–3374. MR 3024159, DOI 10.1137/110845537
Frances Y. Kuo, Ian H. Sloan, Grzegorz W. Wasilkowski, and Benjamin J. Waterhouse, Randomly shifted lattice rules with the optimal rate of convergence for unbounded integrands, J. Complexity 26 (2010), no. 2, 135–160. MR 2607729, DOI 10.1016/j.jco.2009.07.005
Matti Lassas, Eero Saksman, and Samuli Siltanen, Discretization-invariant Bayesian inversion and Besov space priors, Inverse Probl. Imaging 3 (2009), no. 1, 87–122. MR 2558305, DOI 10.3934/ipi.2009.3.87
Harald Luschgy and Gilles Pagès, Expansions for Gaussian processes and Parseval frames, Electron. J. Probab. 14 (2009), no. 42, 1198–1221. MR 2511282, DOI 10.1214/EJP.v14-649
Hoang Nguyen and Rob Stevenson, Finite element wavelets with improved quantitative properties, J. Comput. Appl. Math. 230 (2009), no. 2, 706–727. MR 2532361, DOI 10.1016/j.cam.2009.01.007
James A. Nichols and Frances Y. Kuo, Fast CBC construction of randomly shifted lattice rules achieving $\scr {O}(n^{-1+\delta })$ convergence for unbounded integrands over $\Bbb {R}^s$ in weighted spaces with POD weights, J. Complexity 30 (2014), no. 4, 444–468. MR 3212781, DOI 10.1016/j.jco.2014.02.004
Nikolaos Rekatsinas and Rob Stevenson, A quadratic finite element wavelet Riesz basis, Int. J. Wavelets Multiresolut. Inf. Process. 16 (2018), no. 4, 1850033, 17. MR 3820677, DOI 10.1142/S0219691318500339
R. Scheichl, A. M. Stuart, and A. L. Teckentrup, Quasi-Monte Carlo and multilevel Monte Carlo methods for computing posterior expectations in elliptic inverse problems, SIAM/ASA J. Uncertain. Quantif. 5 (2017), no. 1, 493–518. MR 3640631, DOI 10.1137/16M1061692
Claudia Schillings and Andrew M. Stuart, Analysis of the ensemble Kalman filter for inverse problems, SIAM J. Numer. Anal. 55 (2017), no. 3, 1264–1290. MR 3654885, DOI 10.1137/16M105959X
C. Schwab and A. M. Stuart, Sparse deterministic approximation of Bayesian inverse problems, Inverse Problems 28 (2012), no. 4, 045003, 32. MR 2903278, DOI 10.1088/0266-5611/28/4/045003
A. M. Stuart, Inverse problems: a Bayesian perspective, Acta Numer. 19 (2010), 451–559. MR 2652785, DOI 10.1017/S0962492910000061
A. L. Teckentrup, R. Scheichl, M. B. Giles, and E. Ullmann, Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients, Numer. Math. 125 (2013), no. 3, 569–600. MR 3117512, DOI 10.1007/s00211-013-0546-4
Hans Triebel, Theory of function spaces. III, Monographs in Mathematics, vol. 100, Birkhäuser Verlag, Basel, 2006. MR 2250142
Hans Triebel, Function spaces and wavelets on domains, EMS Tracts in Mathematics, vol. 7, European Mathematical Society (EMS), Zürich, 2008. MR 2455724, DOI 10.4171/019
Kôsaku Yosida, Functional analysis, 6th ed., Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 123, Springer-Verlag, Berlin-New York, 1980. MR 617913