Hilbert space analysis of Latin Hypercube Sampling

Mathé, Peter

doi:10.1090/S0002-9939-00-05850-0

Hilbert space analysis of Latin Hypercube Sampling
HTML articles powered by AMS MathViewer

by Peter Mathé PDF

Proc. Amer. Math. Soc. 129 (2001), 1477-1492 Request permission

Abstract:

Latin Hypercube Sampling is a specific Monte Carlo estimator for numerical integration of functions on ${\mathbb R}^{d}$ with respect to some product probability distribution function. Previous analysis established that Latin Hypercube Sampling is superior to independent sampling, at least asymptotically; especially, if the function to be integrated allows a good additive fit. We propose an explicit approach to Latin Hypercube Sampling, based on orthogonal projections in an appropriate Hilbert space, related to the ANOVA decomposition, which allows a rigorous error analysis. Moreover, we indicate why convergence cannot be uniformly superior to independent sampling on the class of square integrable functions. We establish a general condition under which uniformity can be achieved, thereby indicating the rôle of certain Sobolev spaces.

References

Robert A. Adams, Sobolev spaces, Pure and Applied Mathematics, Vol. 65, Academic Press [Harcourt Brace Jovanovich, Publishers], New York-London, 1975. MR 0450957
E. B. Davies, Heat kernels and spectral theory, Cambridge Tracts in Mathematics, vol. 92, Cambridge University Press, Cambridge, 1990. MR 1103113
J. Diestel and J. J. Uhl Jr., Vector measures, Mathematical Surveys, No. 15, American Mathematical Society, Providence, R.I., 1977. With a foreword by B. J. Pettis. MR 0453964
R. E. Edwards, Functional analysis. Theory and applications, Holt, Rinehart and Winston, New York-Toronto-London, 1965. MR 0221256
B. Efron and C. Stein, The jackknife estimate of variance, Ann. Statist. 9 (1981), no. 3, 586–596. MR 615434
George S. Fishman, Monte Carlo, Springer Series in Operations Research, Springer-Verlag, New York, 1996. Concepts, algorithms, and applications. MR 1392474, DOI 10.1007/978-1-4757-2553-7
Ronald L. Iman and W. J. Conover, Small sample sensitivity analysis techniques for computer models, with an application to risk assessment, Comm. Statist. A—Theory Methods 9 (1980), no. 17, 1749–1874. Special issue on sensitivity analysis. MR 590121, DOI 10.1080/03610928008827996
Malvin H. Kalos and Paula A. Whitlock, Monte Carlo methods. Vol. I, A Wiley-Interscience Publication, John Wiley & Sons, Inc., New York, 1986. Basics. MR 864827, DOI 10.1002/9783527617395
L. V. Kantorovich and G. P. Akilov, Funktsional′nyĭ analiz, 3rd ed., “Nauka”, Moscow, 1984 (Russian). MR 788496
Michel Ledoux and Michel Talagrand, Probability in Banach spaces, Ergebnisse der Mathematik und ihrer Grenzgebiete (3) [Results in Mathematics and Related Areas (3)], vol. 23, Springer-Verlag, Berlin, 1991. Isoperimetry and processes. MR 1102015, DOI 10.1007/978-3-642-20212-4
Wei-Liem Loh, On Latin hypercube sampling, Ann. Statist. 24 (1996), no. 5, 2058–2080. MR 1421161, DOI 10.1214/aos/1069362310
M. D. McKay, R. J. Beckman, and W. J. Conover, A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics 21 (1979), no. 2, 239–245. MR 533252, DOI 10.2307/1268522
D. S. Mitrinović, J. E. Pečarić, and A. M. Fink, Classical and new inequalities in analysis, Mathematics and its Applications (East European Series), vol. 61, Kluwer Academic Publishers Group, Dordrecht, 1993. MR 1220224, DOI 10.1007/978-94-017-1043-5
Jacques Neveu, Bases mathématiques du calcul des probabilités, Masson et Cie, Éditeurs, Paris, 1964 (French). MR 0198504
Erich Novak, Deterministic and stochastic error bounds in numerical analysis, Lecture Notes in Mathematics, vol. 1349, Springer-Verlag, Berlin, 1988. MR 971255, DOI 10.1007/BFb0079792
Art B. Owen, A central limit theorem for Latin hypercube sampling, J. Roy. Statist. Soc. Ser. B 54 (1992), no. 2, 541–551. MR 1160481
Art B. Owen, Monte Carlo variance of scrambled net quadrature, SIAM J. Numer. Anal. 34 (1997), no. 5, 1884–1910. MR 1472202, DOI 10.1137/S0036142994277468
H. L. Royden, Real analysis, 3rd ed., Macmillan Publishing Company, New York, 1988. MR 1013117
Laurent Saloff-Coste, Lectures on finite Markov chains, Lectures on probability theory and statistics (Saint-Flour, 1996) Lecture Notes in Math., vol. 1665, Springer, Berlin, 1997, pp. 301–413. MR 1490046, DOI 10.1007/BFb0092621
S. Minakshi Sundaram, On non-linear partial differential equations of the parabolic type, Proc. Indian Acad. Sci., Sect. A. 9 (1939), 479–494. MR 0000088
H. Triebel, Höhere Analysis, Hochschulbücher für Mathematik, Band 76, VEB Deutscher Verlag der Wissenschaften, Berlin, 1972 (German). MR 0360061
N. N. Vakhania, V. I. Tarieladze, and S. A. Chobanyan, Probability distributions on Banach spaces, Mathematics and its Applications (Soviet Series), vol. 14, D. Reidel Publishing Co., Dordrecht, 1987. Translated from the Russian and with a preface by Wojbor A. Woyczynski. MR 1435288, DOI 10.1007/978-94-009-3873-1