|
Sharpness in rates of convergence for the symmetric Lanczos method
Author(s):
Ren-Cang
Li.
Journal:
Math. Comp.
79
(2010),
419-435.
MSC (2000):
Primary 65F10
Posted:
May 14, 2009
MathSciNet review:
2552233
Retrieve article in:
PDF
Abstract |
References |
Similar articles |
Additional information
Abstract:
The Lanczos method is often used to solve a large and sparse symmetric matrix eigenvalue problem. There is a well-established convergence theory that produces bounds to predict the rates of convergence good for a few extreme eigenpairs. These bounds suggest at least linear convergence in terms of the number of Lanczos steps, assuming there are gaps between individual eigenvalues. In practice, often superlinear convergence is observed. The question is ``do the existing bounds tell the correct convergence rate in general?''. An affirmative answer is given here for the two extreme eigenvalues by examples whose Lanczos approximations have errors comparable to the error bounds for all Lanczos steps.
References:
-
- 1.
- O. Axelsson, Iterative solution methods, Cambridge University Press, Cambridge, 1994. MR 1276069 (95f:65005)
- 2.
- E. W. Cheney, Introduction to approximation theory, 2nd ed., Chelsea Publishing Company, New York, 1982. MR 1656150 (99f:41001)
- 3.
- J. Demmel, Applied numerical linear algebra, SIAM, Philadelphia, PA, 1997. MR 1463942 (98m:65001)
- 4.
- Anne Greenbaum, Behavior of slightly perturbed Lanczos and conjugate-gradient recurrences, Linear Algebra Appl. 113 (1989), 7-63. MR 978581 (90e:65044)
- 5.
- -, Iterative methods for solving linear systems, SIAM, Philadelphia, 1997. MR 1474725 (98j:65023)
- 6.
- Anne Greenbaum and Z. Strakos, Predicting the behavior of finite precision Lanczos and conjugate gradient computations, SIAM J. Matrix Anal. Appl. 13 (1992), no. 1, 121-137. MR 1146656 (92j:65043)
- 7.
- Martin Hanke, Superlinear convergence rates for the Lanczos method applied to elliptic operators, Numer. Math. 77 (1997), no. 4, 487-499. MR 1473393 (98m:65182)
- 8.
- I. C. F. Ipsen, Expressions and bounds for the GMRES residual, BIT 40 (2000), no. 3, 524-535. MR 1780406 (2001g:65032)
- 9.
- Zhongxiao Jia and G. W. Stewart, An analysis of the Rayleigh-Ritz method for approximating eigenspaces, Math. Comp. 70 (2001), 637-647. MR 1697647 (2001g:65040)
- 10.
- S. Kaniel, Estimates for some computational techniques in linear algebra, Math. Comp. 20 (1966), no. 95, 369-378. MR 0234618 (38:2934)
- 11.
- J. Kovač-Striko and K. Veselić, Some remarks on the spectra of Hermitian matrices, Linear Algebra Appl. 145 (1991), 221-229. MR 1080687 (92b:15018)
- 12.
- A. B. J. Kuijlaars, Which eigenvalues are found by the Lanczos method?, SIAM J. Matrix Anal. Appl. 22 (2000), no. 1, 306-321. MR 1779731 (2001g:65042)
- 13.
- Arno B. J. Kuijlaars, Convergence analysis of Krylov subspace iterations with methods from potential theory, SIAM Rev. 48 (2006), no. 1, 3-40. MR 2219308 (2007a:65054)
- 14.
- Ren-Cang Li, On eigenvalues of a Rayleigh quotient matrix, Linear Algebra Appl. 169 (1992), 249-255. MR 1158372 (93a:15013)
- 15.
- -, Accuracy of computed eigenvectors via optimizing a Rayleigh quotient, BIT 44 (2004), no. 3, 585-593. MR 2106018 (2005i:65055)
- 16.
- -, Sharpness in rates of convergence for CG and symmetric Lanczos methods, Technical Report 2005-01, Department of Mathematics, University of Kentucky, 2005, Avaliable at http://www.ms.uky.edu/
math/MAreport/. - 17.
- -, Vandermonde matrices with Chebyshev nodes, Linear Algebra Appl. 428 (2007), 1803-1832. MR 2398120
- 18.
- -, On Meinardus' examples for the conjugate gradient method, Math. Comp. 77 (2008), no. 261, 335-352, Electronically published on September 17, 2007. MR 2353956
- 19.
- J. Liesen, M. Rozlozník, and Z. Strakoš, Least squares residuals and minimal residual methods, SIAM J. Sci. Comput. 23 (2002), no. 5, 1503-1525. MR 1885072 (2003a:65033)
- 20.
- B. N. Parlett, The symmetric eigenvalue problem, SIAM, Philadelphia, 1998. This SIAM edition is an unabridged, corrected reproduction of the work first published by Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1980. MR 570116 (81j:65063)
- 21.
- Y. Saad, On the rates of convergence of the Lanczos and the block-Lanczos methods, SIAM J. Numer. Anal. 15 (1980), no. 5, 687-706. MR 588755 (82g:65022)
- 22.
- Yousef Saad, Iterative methods for sparse linear systems, 2nd ed., SIAM, Philadelphia, 2003. MR 1990645 (2004h:65002)
- 23.
- D. S. Scott, How to make the Lanczos algorithm converge slowly, Math. Comp. 33 (1979), no. 145, 239-247. MR 514821 (80c:65091)
- 24.
- G. L. G. Sleijpen and A. van der Sluis, Further results on the convergence behavior of conjugate-gradients and Ritz values, Linear Algebra Appl. 246 (1996), 233-378. MR 1407670 (97j:65067)
- 25.
- Ji-Guang Sun, Eigenvalues of Rayleigh quotient matrices, Numer. Math. 59 (1991), 603-614. MR 1124130 (93a:15015)
- 26.
- Lloyd N. Trefethen and David Bau, III, Numerical linear algebra, SIAM, Philadelphia, 1997. MR 1444820 (98k:65002)
- 27.
- A. van der Sluis and H. A. van der Vorst, The convergence behavior of Ritz values in the presence of close eigenvalues, Linear Algebra Appl. 88/89 (1987), 651-694. MR 882466 (88f:65064)
Similar Articles:
Retrieve articles in Mathematics of Computation
with
MSC (2000):
65F10
Retrieve articles in all Journals with
MSC (2000):
65F10
Additional Information:
Ren-Cang
Li
Affiliation:
Department of Mathematics, University of Texas at Arlington, P.O. Box 19408, Arlington, Texas 76019-0408.
Email:
rcli@uta.edu
DOI:
10.1090/S0025-5718-09-02258-3
PII:
S 0025-5718(09)02258-3
Keywords:
Lanczos method,
Krylov subspace,
rate of convergence,
Chebyshev polynomial
Received by editor(s):
July 31, 2006
Received by editor(s) in revised form:
January 14, 2008 and January 6, 2009
Posted:
May 14, 2009
Additional Notes:
This work was supported in part by the National Science Foundation under Grant No. DMS-0702335 and DMS-0810506.
Copyright of article:
Copyright
2009,
American Mathematical Society
|