Regularization and the general Gauss-Markov linear model
Authors:
Hong Yuan Zha and Per Christian Hansen
Journal:
Math. Comp. 55 (1990), 613-624
MSC:
Primary 65F20; Secondary 15A06, 65F30
DOI:
https://doi.org/10.1090/S0025-5718-1990-1035946-9
MathSciNet review:
1035946
Full-text PDF Free Access
Abstract | References | Similar Articles | Additional Information
Abstract: If the coefficient matrix in the general Gauss-Markov linear model is ill-conditioned, then the solution is very sensitive to perturbations. For such problems, we propose to add Tikhonov regularization to the model, and we show that this actually stabilizes the solution and decreases its variance. We also give a numerically stable algorithm for computing the regularized solution efficiently.
-
Å. Björck, Least squares methods, Handbook of Numerical Analysis, Vol. I: Finite Difference Methods—Solution of Equations in ${\mathbb {R}^n}$ (P. G. Ciarlet and J. L. Lions, eds.), Elsevier, 1990.
- Lars Eldén, A weighted pseudoinverse, generalized singular values, and constrained least squares problems, BIT 22 (1982), no. 4, 487–502. MR 688717, DOI https://doi.org/10.1007/BF01934412
- C. W. Groetsch, The theory of Tikhonov regularization for Fredholm equations of the first kind, Research Notes in Mathematics, vol. 105, Pitman (Advanced Publishing Program), Boston, MA, 1984. MR 742928
- Per Christian Hansen, Truncated singular value decomposition solutions to discrete ill-posed problems with ill-determined numerical rank, SIAM J. Sci. Statist. Comput. 11 (1990), no. 3, 503–518. MR 1047208, DOI https://doi.org/10.1137/0911028
- Per Christian Hansen, Regularization, GSVD and truncated GSVD, BIT 29 (1989), no. 3, 491–504. MR 1009650, DOI https://doi.org/10.1007/BF02219234
- Per Christian Hansen, The discrete Picard condition for discrete ill-posed problems, BIT 30 (1990), no. 4, 658–672. MR 1082808, DOI https://doi.org/10.1007/BF01933214
- S. Kourouklis and C. C. Paige, A constrained least squares approach to the general Gauss-Markov linear model, J. Amer. Statist. Assoc. 76 (1981), no. 375, 620–625. MR 629748
- Charles L. Lawson and Richard J. Hanson, Solving least squares problems, Prentice-Hall, Inc., Englewood Cliffs, N.J., 1974. Prentice-Hall Series in Automatic Computation. MR 0366019
- C. C. Paige, Numerically stable computations for general univariate linear models, Comm. Statist. B—Simulation Comput. 7 (1978), no. 5, 437–453. MR 516832, DOI https://doi.org/10.1080/03610917808812090
- C. C. Paige, Computer solution and perturbation analysis of generalized linear least squares problems, Math. Comp. 33 (1979), no. 145, 171–183. MR 514817, DOI https://doi.org/10.1090/S0025-5718-1979-0514817-3
- C. C. Paige, Fast numerically stable computations for generalized linear least squares problems, SIAM J. Numer. Anal. 16 (1979), no. 1, 165–171. MR 518691, DOI https://doi.org/10.1137/0716012
- C. C. Paige, The general linear model and the generalized singular value decomposition, Linear Algebra Appl. 70 (1985), 269–284. MR 808548, DOI https://doi.org/10.1016/0024-3795%2885%2990059-X
- Charles F. Van Loan, Generalizing the singular value decomposition, SIAM J. Numer. Anal. 13 (1976), no. 1, 76–83. MR 411152, DOI https://doi.org/10.1137/0713009
- Hong Yuan Zha, The restricted singular value decomposition of matrix triplets, SIAM J. Matrix Anal. Appl. 12 (1991), no. 1, 172–194. MR 1082335, DOI https://doi.org/10.1137/0612014
Retrieve articles in Mathematics of Computation with MSC: 65F20, 15A06, 65F30
Retrieve articles in all journals with MSC: 65F20, 15A06, 65F30
Additional Information
Keywords:
Estimation in the general Gauss-Markov linear model,
Tikhonov regularization,
restricted SVD,
discrete Picard condition
Article copyright:
© Copyright 1990
American Mathematical Society
