Comparing the efficiency of structural and functional methods in measurement error models
Authors:
H. Schneeweiss and A. Kukush
Journal:
Theor. Probability and Math. Statist. 80 (2010), 131-142
MSC (2000):
Primary 62F12, 62J02
DOI:
https://doi.org/10.1090/S0094-9000-2010-00800-3
Published electronically:
August 20, 2010
MathSciNet review:
2541958
Full-text PDF Free Access
Abstract |
References |
Similar Articles |
Additional Information
Abstract: The paper is a survey of recent investigations by various researchers into the relative efficiencies of structural and functional estimators of the regression parameters in a measurement error model. Structural methods, in particular the quasi-score (QS) method, take advantage of the knowledge of the regressor distribution (if available). Functional methods, in particular the corrected score (CS) method, discard such knowledge and work even if such knowledge is not available. Among other results, it has been shown that QS is more efficient than CS as long as the regressor distribution is completely known. However, if nuisance parameters in the regressor distribution are to be estimated, this no longer remains true, in general. But by modifying the QS method, the adverse effect of the nuisance parameters can be overcome. For small measurement errors, the efficiencies of QS and CS become almost indistinguishable, whether nuisance parameters are present or not. QS is (asymptotically) biased if the regressor distribution has been misspecified, while CS is always consistent and thus more robust than QS.
References
- J. S. Buzas and L. A. Stefanski, A note on corrected-score estimation, Statist. Probab. Lett. 28 (1996), no. 1, 1–8. MR 1394413, DOI https://doi.org/10.1016/0167-7152%2895%2900074-7
- Raymond J. Carroll, David Ruppert, Leonard A. Stefanski, and Ciprian M. Crainiceanu, Measurement error in nonlinear models, 2nd ed., Monographs on Statistics and Applied Probability, vol. 105, Chapman & Hall/CRC, Boca Raton, FL, 2006. A modern perspective. MR 2243417
- Chi-Lun Cheng and Hans Schneeweiss, Polynomial regression with errors in the variables, J. R. Stat. Soc. Ser. B Stat. Methodol. 60 (1998), no. 1, 189–199. MR 1625632, DOI https://doi.org/10.1111/1467-9868.00118
- Chi-Lun Cheng and Hans Schneeweiss, On the polynomial measurement error model, Total least squares and errors-in-variables modeling (Leuven, 2001) Kluwer Acad. Publ., Dordrecht, 2002, pp. 131–143. MR 1952942
- Chi-Lun Cheng, Hans Schneeweiss, and Markus Thamerus, A small sample estimator for a polynomial regression with errors in the variables, J. R. Stat. Soc. Ser. B Stat. Methodol. 62 (2000), no. 4, 699–709. MR 1796286, DOI https://doi.org/10.1111/1467-9868.00258
- Chi-Lun Cheng and John W. Van Ness, Statistical regression with measurement error, Kendall’s Library of Statistics, vol. 6, Arnold, London; co-published by Oxford University Press, New York, 1999. MR 1719513
- J. Cook and L. A. Stefanski, Simulation-extrapolation estimation in parametric measurement error models, Journal of the American Statistical Association 89 (1994), 1314–1328.
- Edmund A. C. Crouch and Donna Spiegelman, The evaluation of integrals of the form $\int ^{+\infty }_{-\infty }f(t)\exp (-t^2)\,dt$: application to logistic-normal models, J. Amer. Statist. Assoc. 85 (1990), no. 410, 464–469. MR 1141749
- Wayne A. Fuller, Measurement error models, Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics, John Wiley & Sons, Inc., New York, 1987. MR 898653
- Christopher C. Heyde, Quasi-likelihood and its application, Springer Series in Statistics, Springer-Verlag, New York, 1997. A general approach to optimal parameter estimation. MR 1461808
- C. C. Heyde and R. Morton, Multiple roots in general estimating equations, Biometrika 85 (1998), 967–972.
- Norman L. Johnson and Samuel Kotz, Distributions in statistics. Continuous univariate distributions. 2., Houghton Mifflin Co., Boston, Mass., 1970. MR 0270476
- A. Kukush and H. Schneeweiss, Comparing different estimators in a nonlinear measurement error model. I, Math. Methods Statist. 14 (2005), no. 1, 53–79. MR 2158071
- A. Kukush and H. Schneeweiss, Comparing different estimators in a nonlinear measurement error model. II, Math. Methods Statist. 14 (2005), no. 2, 203–223. MR 2160395
- A. Kukush and H. Schneeweiss, Asymptotic optimality of the quasi-score estimator in a class of linear score estimators, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 477, University of Munich, 2006.
- A. Kukush, H. Schneeweiss, and S. Shklyar, Quasi Score is more efficient than Corrected Score in a general nonlinear measurement error model, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 451, University of Munich, 2005a.
- Alexander Kukush, Hans Schneeweiss, and Roland Wolf, Relative efficiency of three estimators in a polynomial regression with measurement errors, J. Statist. Plann. Inference 127 (2005), no. 1-2, 179–203. MR 2103032, DOI https://doi.org/10.1016/j.jspi.2003.09.016
- A. Kukush, A. Malenko, and H. Schneeweiss, Optimality of the quasi-score estimator in a mean-variance model with applications to measurement error models, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 494, University of Munich, 2006.
- Alexander Kukush, Andrii Malenko, and Hans Schneeweiss, Comparing the efficiency of estimates in concrete errors-in-variables models under unknown nuisance parameters, Theory Stoch. Process. 13 (2007), no. 4, 69–81. MR 2482252
- A. Kukush, A. Malenko, H. Schneeweiss, and Shalabh, Optimality of Quasi-Score in the multivariate mean-variance model with application to the zero-inflated Poisson model with measurement errors, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 498, University of Munich, 2007b.
- J. Monahan and L. A. Stefanski, Normal scale mixture approximations to $F^*(z)$ and computation of the logistic-normal integral, Handbook of the Logistic Distribution (N. Balakrishnan, ed.), Marcel Dekker, New York, 1992, pp. 529–540.
- Tsuyoshi Nakamura, Corrected score function for errors-in-variables models: methodology and application to generalized linear models, Biometrika 77 (1990), no. 1, 127–137. MR 1049414, DOI https://doi.org/10.1093/biomet/77.1.127
- Hans Schneeweiss, Quasi score and corrected score estimation in the polynomial measurement error model, Recent advances in linear models and related areas, Springer, Heidelberg, 2008, pp. 45–58. MR 2523524, DOI https://doi.org/10.1007/978-3-7908-2064-5_3
- Hans Schneeweiss and Thomas Augustin, Some recent advances in measurement error models and methods, Allg. Stat. Arch. 90 (2006), no. 1, 183–197. MR 2255581, DOI https://doi.org/10.1007/s10182-006-0229-x
- H. Schneeweiss and C.-L. Cheng, Bias of the quasi-score estimator of a measurement error model under misspecification of the regressor distribution, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 340, University of Munich, 2003.
- Hans Schneeweiss and Chi-Lun Cheng, Bias of the structural quasi-score estimator of a measurement error model under misspecification of the regressor distribution, J. Multivariate Anal. 97 (2006), no. 2, 455–473. MR 2234032, DOI https://doi.org/10.1016/j.jmva.2005.03.010
- Hans Schneeweiß and Hans-Joachim Mittag, Lineare Modelle mit fehlerbehafteten Daten, Physica-Paperback. [Physica Paperbacks], Physica-Verlag, Heidelberg, 1986 (German). MR 914793
- S. Shklyar, A comparison of estimates in the Poisson regression model with measurement errors, Bulletin of the University of Kyiv, Seria Physics and Mathematics 3 (2006), 60–67.
- S. Shklyar and H. Schneeweiss, A comparison of asymptotic covariance matrices of three consistent estimators in the Poisson regression model with measurement errors, J. Multivariate Anal. 94 (2005), no. 2, 250–270. MR 2167914, DOI https://doi.org/10.1016/j.jmva.2004.05.002
- Sergiy Shklyar, Hans Schneeweiss, and Alexander Kukush, Quasi score is more efficient than corrected score in a polynomial measurement error model, Metrika 65 (2007), no. 3, 275–295. MR 2299552, DOI https://doi.org/10.1007/s00184-006-0076-5
- Leonard A. Stefanski, Unbiased estimation of a nonlinear function of a normal mean with application to measurement error models, Comm. Statist. Theory Methods 18 (1989), no. 12, 4335–4358 (1990). MR 1046712, DOI https://doi.org/10.1080/03610928908830159
- Leonard A. Stefanski and Raymond J. Carroll, Conditional scores and optimal scores for generalized linear measurement-error models, Biometrika 74 (1987), no. 4, 703–716. MR 919838, DOI https://doi.org/10.1093/biomet/74.4.703
- Tom Wansbeek and Erik Meijer, Measurement error and latent variables in econometrics, Advanced Textbooks in Economics, vol. 37, North-Holland Publishing Co., Amsterdam, 2000. MR 1804397
References
- J. S. Buzas and L. A. A. Stefanski, Note on corrected-score estimation, Statistics and Probability Letters 28 (1996), 1–8. MR 1394413 (97d:62144)
- R. J. Carroll, D. Ruppert, L. A. Stefanski, and C. M. Crainiceanu, Measurement Error in Nonlinear Models, Second edition, Chapman and Hall, London, 2006. MR 2243417 (2007e:62004)
- C.-L. Cheng and H. Schneeweiss, Polynomial regression with errors in the variables, Journal of the Royal Statistical Society B 60 (1998), 189–199. MR 1625632
- C.-L. Cheng and H. Schneeweiss, On the polynomial measurement error model, Total Least Squares and Errors-in-Variables Modeling (S. van Huffel and P. Lemmerling, eds.), Kluwer, Dordrecht, 2002, pp. 131–143. MR 1952942
- C.-L. Cheng, H. Schneeweiss, and M. Thamerus, A small sample estimator for a polynomial regression with errors in the variables, Journal of the Royal Statistical Society 62 (2000), 699–709. MR 1796286
- C.-L. Cheng and J. W. Van Ness, Statistical Regression with Measurement Error, Arnold, London, 1999. MR 1719513 (2001k:62001)
- J. Cook and L. A. Stefanski, Simulation-extrapolation estimation in parametric measurement error models, Journal of the American Statistical Association 89 (1994), 1314–1328.
- E. A. Crouch and D. Spiegelman, The evaluation of integrals of the form $\int _{-\infty }^{\infty }f(t) \exp (-t^2)\ dt$: application to logistic-normal models, Journal of the American Statistical Association 85 (1990), 464–467. MR 1141749 (92h:65032)
- W. A. Fuller, Measurement Error Models, Wiley, New York, 1987. MR 898653 (89a:62160)
- C. C. Heyde, Quasi-Likelihood and its Application, Springer, New York, 1997. MR 1461808 (99f:62003)
- C. C. Heyde and R. Morton, Multiple roots in general estimating equations, Biometrika 85 (1998), 967–972.
- N. L. Johnson and S. Kotz, Distributions in Statistics: Continuous Univariate Distributions, vol. 2, Houghton Mifflin Co., Boston, MA, 1970. MR 0270476 (42:5364)
- A. Kukush and H. Schneeweiss, Comparing different estimators in a nonlinear measurement error model, I, Mathematical Methods of Statistics 14 (2005a), 53–79. MR 2158071 (2006j:62068a)
- A. Kukush and H. Schneeweiss, Comparing different estimators in a nonlinear measurement error model, II, Mathematical Methods of Statistics 14 (2005b), 203–223. MR 2160395 (2006j:62068b)
- A. Kukush and H. Schneeweiss, Asymptotic optimality of the quasi-score estimator in a class of linear score estimators, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 477, University of Munich, 2006.
- A. Kukush, H. Schneeweiss, and S. Shklyar, Quasi Score is more efficient than Corrected Score in a general nonlinear measurement error model, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 451, University of Munich, 2005a.
- A. Kukush, H. Schneeweiss, and R. Wolf, Relative efficiency of three estimators in a polynomial regression with measurement errors, Journal of Statistical Planning and Inference 127 (2005b), 179–203. MR 2103032 (2005h:62087)
- A. Kukush, A. Malenko, and H. Schneeweiss, Optimality of the quasi-score estimator in a mean-variance model with applications to measurement error models, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 494, University of Munich, 2006.
- A. Kukush, A. Malenko, and H. Schneeweiss, Comparing the efficiency of estimates in concrete errors-in-variables models under unknown nuisance parameters, Theory of Stochastic Processes 13(29) (2007a), 69–81. MR 2482252 (2010b:62256)
- A. Kukush, A. Malenko, H. Schneeweiss, and Shalabh, Optimality of Quasi-Score in the multivariate mean-variance model with application to the zero-inflated Poisson model with measurement errors, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 498, University of Munich, 2007b.
- J. Monahan and L. A. Stefanski, Normal scale mixture approximations to $F^*(z)$ and computation of the logistic-normal integral, Handbook of the Logistic Distribution (N. Balakrishnan, ed.), Marcel Dekker, New York, 1992, pp. 529–540.
- T. Nakamura, Corrected score functions for errors-in-variables models: Methodology and application to generalized linear models, Biometrika 77 (1990), 127–137. MR 1049414 (91e:62179)
- H. Schneeweiss, Quasi score and corrected score estimation in the polynomial measurement error model, Recent Advances in Linear Models and Related Areas (Shalabh and C. Heumann, eds.), Physica, Heidelberg, 2008, pp. 45–58. MR 2523524
- H. Schneeweiss and T. Augustin, Some recent advances in measurement error models and methods, Allgemeines Statistisches Archiv 90 (2006), 183–197. MR 2255581
- H. Schneeweiss and C.-L. Cheng, Bias of the quasi-score estimator of a measurement error model under misspecification of the regressor distribution, Discussion Paper, www.stat.uni-muenchen.de/sfb386, vol. 340, University of Munich, 2003.
- H. Schneeweiss and C.-L. Cheng, Bias of the structural quasi-score estimator of a measurement error model under misspecification of the regressor distribution, Journal of Multivariate Analysis 97 (2006), 455–473. MR 2234032
- H. Schneeweiss and H. J. Mittag, Lineare Modelle mit fehlerbehafteten Daten, Physica-Verlag, Heidelberg, 1986. MR 914793 (89e:62084)
- S. Shklyar, A comparison of estimates in the Poisson regression model with measurement errors, Bulletin of the University of Kyiv, Seria Physics and Mathematics 3 (2006), 60–67.
- S. Shklyar and H. Schneeweiss, A comparison of asymptotic covariance matrices of three consistent estimators in the Poisson regression model with measurement errors, Journal of Multivariate Analysis 94 (2005), 250–270. MR 2167914
- S. Shklyar, H. Schneeweiss, and A. Kukush, Quasi Score is more efficient than Corrected Score in a polynomial measurement error model, Metrika 65 (2007), 275–295. MR 2299552 (2008h:62071)
- L. A. Stefanski, Unbiased estimation of a nonlinear function of a normal mean with application to measurement error models, Communications in Statistics, Part A — Theory and Methods 18 (1989), 4335–4358. MR 1046712 (91e:62064)
- L. A. Stefanski and R. J. Carroll, Conditional scores and optimal scores in generalized linear measurement error models, Biometrika 74 (1987), 703–716. MR 919838 (89h:62048)
- T. Wansbeek and E. Meijer, Measurement Error and Latent Variables in Econometrics, Elsevier, Amsterdam, 2000. MR 1804397 (2002i:62184)
Similar Articles
Retrieve articles in Theory of Probability and Mathematical Statistics
with MSC (2000):
62F12,
62J02
Retrieve articles in all journals
with MSC (2000):
62F12,
62J02
Additional Information
H. Schneeweiss
Affiliation:
Department of Statistics, University of Munich, Akademiestrasse 1, Munich 80799, Germany
Email:
schneew@stat.uni-muenchen.de
A. Kukush
Affiliation:
Kyiv National Taras Shevchenko University, Volodymyrska Street, 64, Kyiv 01033, Ukraine
Email:
alexander_kukush@univ.kiev.ua
Keywords:
Measurement errors,
errors in variables,
quasi score,
corrected score,
structural methods,
functional methods,
efficiency comparison
Received by editor(s):
October 20, 2010
Published electronically:
August 20, 2010
Article copyright:
© Copyright 2010
American Mathematical Society