Abstract
In this paper we study the nonparametric least squares estimator of a regression function in a random design setting under the constraint that this function is monotone, say, nonincreasing. The errors are not assumed conditionally i.i.d. given the observation points. In particular, this includes the case of conditional heteroscedasticity and the case of the current status model. The \( \mathbb{L}_p \)-error is shown to be of order n −p/3 and asymptotically Gaussian with explicit asymptotic mean and variance.
Similar content being viewed by others
References
R. Barlow, D. Bartholomew, J. Bremner, and H. Brunk, Statistical Inference under Order Restrictions. The Theory and Application of Isotonic Regression, in Wiley Series in Probability and Mathematical Statistics (Wiley, London—New York—Sydney, 1972).
H. Brunk, “On the Estimation of Parameters Restricted by Inequalities”, Ann. Math. Statist. 29, 437–454 (1958).
V. Chernozhukov, I. Fernandez-Val, and A. Galichon, “Improving Estimates of Monotone Functions By Rearrangement” (2007), arXiv: 0704.3686v1.
H. Dette, N. Neumeyer, and K. Pilz, “A Simple Nonparametric Estimator of a Strictly Monotone Regression Function”, Bernoulli 12, 469–490 (2006).
C. Durot, “Sharp Asymptotics for Isotonic Regression, Probab. Theory Rel. Fields 122, 222–240 (2002).
C. Durot, “On the L p Error of Monotonicity Constraint Estimators”, Ann. Statist. 35, 1080–1104 (2007).
A. Dvoretzky, J. Kiefer, and J. Wolfowitz, “Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator”, Ann. Math. Statist. 27, 642–669 (1956).
I. Gijbels, “Monotone Estimation”, in Encyclopedia of Statistical Sciences, Ed. by S. Kotz, N. L. Johnson, C. B. Read, N. Balakrishnan, and B. Vidakovic, 2nd ed. (Wiley, New York, 2005).
U. Grenander, “On the Theory of Mortality Measurement, II”, Skand. Actuar. 39, 125–153 (1956).
P. Groeneboom, “Estimating a Monotone Density”, in Proc. Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (Berkeley, California, 1983), Vol. II, in Wadsworth Statist./Probab. Ser. (Wadsworth, Belmont, CA, 1985), pp. 539–555.
P. Groeneboom, “Brownian Motion with a Parabolic Drift and Airy Functions”, Z. Wahrsch. Verw.Gebiete 81, 79–109 (1989).
P. Groeneboom and J. A. Wellner, Information Bounds and Nonparametric Maximum Likelihood Estimation, in DMV Seminar, Vol. 19 (Birkhäuser Verlag, Basel, 1992).
P. Groeneboom, G. Hooghiemstra, and H. Lopuhaä, “Asymptotic Normality of the L 1-Error of the Grenander Estimator”, Ann. Statist. 27, 1316–1347 (1999).
P. Hall and L. Huang, “Nonparametric Kernel Regression Subject to Monotonicity Constraints”, Ann. Statist. 29, 624–647 (2001).
J. Huang and J. A. Wellner, “Estimation of a Monotone Density or Monotone Hazard Rate under Random Censoring”, Scand. J. Statist. 22, 3–33 (1995).
J. Komlós, P. Major, and G. Tusnády, “An Approximation of Partial Sums of Independent RV’s, and the Sample DF”, Z. Wahrsch. verw. Gebiete 32 111–131 (1975).
N. V. Kulikov and H. P. Lopuhaä, “Asymptotic Normality of the L k-Error of the Grenander Estimator”, Ann. Statist. 33, 2228–2255 (2005).
E. Mammen, “Estimating a Smooth Monotone Regression Function”, Ann. Statist. 19, 724–740 (1991).
E. Mammen, J. S. Marron, B. A. Turlach, and M. P. Wand, “AGeneral Projection Framework for Constrained Smoothing”, Statist. Sci. 16, 232–248 (2001).
N. Neumeyer, “A Note on Uniform Consistency of Monotone Function Estimators”, Statist. Probab. Lett. 77, 693–703 (2007).
H. Rosenthal, “On the Subspaces of L p (p > 2) Spanned by Sequences of Independent Random Variables”, Israel J. Math. 8, 273–303 (1970).
A. Sakhanenko, “Estimates in the Invariance Principle”, in Trudy Mat. Inst. Steklov, Vol. 5: Limit Theorems of Probability Theory (Nauka, Moscow, 1985), pp. 27–44.
F. T. Wright, “The Asymptotic Behavior of Monotone Regression Estimates”, Ann. Statist. 9, 443–448 (1981).
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Durot, C. Monotone nonparametric regression with random design. Math. Meth. Stat. 17, 327–341 (2008). https://doi.org/10.3103/S1066530708040042
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S1066530708040042
Key words
- asymptotic distribution
- Brownian motion with parabolic drift
- current status data
- least concave majorant
- least squares
- monotone regression
- random design