Skip to main content
Log in

Monotone nonparametric regression with random design

  • Published:
Mathematical Methods of Statistics Aims and scope Submit manuscript

Abstract

In this paper we study the nonparametric least squares estimator of a regression function in a random design setting under the constraint that this function is monotone, say, nonincreasing. The errors are not assumed conditionally i.i.d. given the observation points. In particular, this includes the case of conditional heteroscedasticity and the case of the current status model. The \( \mathbb{L}_p \)-error is shown to be of order n p/3 and asymptotically Gaussian with explicit asymptotic mean and variance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. R. Barlow, D. Bartholomew, J. Bremner, and H. Brunk, Statistical Inference under Order Restrictions. The Theory and Application of Isotonic Regression, in Wiley Series in Probability and Mathematical Statistics (Wiley, London—New York—Sydney, 1972).

    Google Scholar 

  2. H. Brunk, “On the Estimation of Parameters Restricted by Inequalities”, Ann. Math. Statist. 29, 437–454 (1958).

    Article  MATH  MathSciNet  Google Scholar 

  3. V. Chernozhukov, I. Fernandez-Val, and A. Galichon, “Improving Estimates of Monotone Functions By Rearrangement” (2007), arXiv: 0704.3686v1.

  4. H. Dette, N. Neumeyer, and K. Pilz, “A Simple Nonparametric Estimator of a Strictly Monotone Regression Function”, Bernoulli 12, 469–490 (2006).

    Article  MATH  MathSciNet  Google Scholar 

  5. C. Durot, “Sharp Asymptotics for Isotonic Regression, Probab. Theory Rel. Fields 122, 222–240 (2002).

    Article  MATH  MathSciNet  Google Scholar 

  6. C. Durot, “On the L p Error of Monotonicity Constraint Estimators”, Ann. Statist. 35, 1080–1104 (2007).

    Article  MATH  MathSciNet  Google Scholar 

  7. A. Dvoretzky, J. Kiefer, and J. Wolfowitz, “Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator”, Ann. Math. Statist. 27, 642–669 (1956).

    Article  MATH  MathSciNet  Google Scholar 

  8. I. Gijbels, “Monotone Estimation”, in Encyclopedia of Statistical Sciences, Ed. by S. Kotz, N. L. Johnson, C. B. Read, N. Balakrishnan, and B. Vidakovic, 2nd ed. (Wiley, New York, 2005).

    Google Scholar 

  9. U. Grenander, “On the Theory of Mortality Measurement, II”, Skand. Actuar. 39, 125–153 (1956).

    MathSciNet  Google Scholar 

  10. P. Groeneboom, “Estimating a Monotone Density”, in Proc. Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (Berkeley, California, 1983), Vol. II, in Wadsworth Statist./Probab. Ser. (Wadsworth, Belmont, CA, 1985), pp. 539–555.

    Google Scholar 

  11. P. Groeneboom, “Brownian Motion with a Parabolic Drift and Airy Functions”, Z. Wahrsch. Verw.Gebiete 81, 79–109 (1989).

    MathSciNet  Google Scholar 

  12. P. Groeneboom and J. A. Wellner, Information Bounds and Nonparametric Maximum Likelihood Estimation, in DMV Seminar, Vol. 19 (Birkhäuser Verlag, Basel, 1992).

    Google Scholar 

  13. P. Groeneboom, G. Hooghiemstra, and H. Lopuhaä, “Asymptotic Normality of the L 1-Error of the Grenander Estimator”, Ann. Statist. 27, 1316–1347 (1999).

    Article  MATH  MathSciNet  Google Scholar 

  14. P. Hall and L. Huang, “Nonparametric Kernel Regression Subject to Monotonicity Constraints”, Ann. Statist. 29, 624–647 (2001).

    Article  MATH  MathSciNet  Google Scholar 

  15. J. Huang and J. A. Wellner, “Estimation of a Monotone Density or Monotone Hazard Rate under Random Censoring”, Scand. J. Statist. 22, 3–33 (1995).

    MATH  MathSciNet  Google Scholar 

  16. J. Komlós, P. Major, and G. Tusnády, “An Approximation of Partial Sums of Independent RV’s, and the Sample DF”, Z. Wahrsch. verw. Gebiete 32 111–131 (1975).

    Article  MATH  Google Scholar 

  17. N. V. Kulikov and H. P. Lopuhaä, “Asymptotic Normality of the L k-Error of the Grenander Estimator”, Ann. Statist. 33, 2228–2255 (2005).

    Article  MATH  MathSciNet  Google Scholar 

  18. E. Mammen, “Estimating a Smooth Monotone Regression Function”, Ann. Statist. 19, 724–740 (1991).

    Article  MATH  MathSciNet  Google Scholar 

  19. E. Mammen, J. S. Marron, B. A. Turlach, and M. P. Wand, “AGeneral Projection Framework for Constrained Smoothing”, Statist. Sci. 16, 232–248 (2001).

    Article  MATH  MathSciNet  Google Scholar 

  20. N. Neumeyer, “A Note on Uniform Consistency of Monotone Function Estimators”, Statist. Probab. Lett. 77, 693–703 (2007).

    Article  MATH  MathSciNet  Google Scholar 

  21. H. Rosenthal, “On the Subspaces of L p (p > 2) Spanned by Sequences of Independent Random Variables”, Israel J. Math. 8, 273–303 (1970).

    Article  MATH  MathSciNet  Google Scholar 

  22. A. Sakhanenko, “Estimates in the Invariance Principle”, in Trudy Mat. Inst. Steklov, Vol. 5: Limit Theorems of Probability Theory (Nauka, Moscow, 1985), pp. 27–44.

    Google Scholar 

  23. F. T. Wright, “The Asymptotic Behavior of Monotone Regression Estimates”, Ann. Statist. 9, 443–448 (1981).

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to C. Durot.

About this article

Cite this article

Durot, C. Monotone nonparametric regression with random design. Math. Meth. Stat. 17, 327–341 (2008). https://doi.org/10.3103/S1066530708040042

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S1066530708040042

Key words

2000 Mathematics Subject Classification

Navigation