|
Superlinear PCG methods for symmetric Toeplitz systems
Author(s):
Stefano
Serra.
Journal:
Math. Comp.
68
(1999),
793-803.
MSC (1991):
Primary 65F10, 65F15
Retrieve article in:
PDF
This article is available free of charge
Abstract |
References |
Similar articles |
Additional information
Abstract:
In this paper we deal with the solution, by means of preconditioned conjugate gradient (PCG) methods, of symmetric Toeplitz systems with nonnegative generating function . Here the function is assumed to be continuous and strictly positive, or is assumed to have isolated zeros of even order. In the first case we use as preconditioner the natural and the optimal approximation of proposed by Bini and Di Benedetto, and we prove that the related PCG method has a superlinear rate of convergence and a total arithmetic cost of ops. Under the second hypothesis we cannot guarantee that the natural matrix is positive definite, while for the optimal we show that, in the ill-conditioned case, this can be really a bad choice. Consequently, we define a new matrix for preconditioning the given system; then, by applying the Sherman-Morrison-Woodbury inversion formula to the preconditioned system, we introduce a small, constant number of subsidiary systems which can be solved again by means of the previous PCG method. Finally, we perform some numerical experiments that show the effectiveness of the devised technique and the adherence with the theoretical analysis.
References:
- 1.
- G. Ammar and W. Gragg, ``Superfast solution of real positive definite Toeplitz systems'', SIAM J. Matrix Anal. Appl., 9, pp. 61-76 (1988). MR 89b:65065
- 2.
- O. Axelsson and G. Lindskog, ``The rate of convergence of the preconditioned conjugate gradient method'', Numer. Math., 48, pp. 499-523 (1986). MR 88a:65037b
- 3.
- D. Bini and M. Capovani, ``Spectral and computational properties of band symmetric Toeplitz matrices'', Linear Algebra Appl., 52/53, pp. 99-126 (1983). MR 85k:15008
- 4.
- D. Bini and F. Di Benedetto, ``A new preconditioner for the parallel solution of positive definite Toeplitz systems'', Proc. 2nd ACM SPAA, Crete, Greece, July 1990, pp. 220-223.
- 5.
- D. Bini and P. Favati, ``On a matrix algebra related to the discrete Hartley transform'', SIAM J. Matrix Anal. Appl., 14, pp. 500-507 (1993). MR 94h:65026
- 6.
- E. Bozzo, Matrix Algebras and Discrete Transforms. PhD. thesis in Comp. Sci., Dept. Comp. Sci., University of Pisa, Italy, 1994.
- 7.
- R.H. Chan, ``Toeplitz preconditioners for Toeplitz systems with nonnegative generating functions'', IMA J. Numer. Anal., 11, pp. 333-345 (1991).
- 8.
- R.H. Chan and W.-K. Ching, ``Toeplitz-circulant preconditioners for Toeplitz systems and their applications to queueing networks with batch arrivals'', SIAM J. Sci. Comput., 17, pp. 762-772 (1996). MR 97b:65054
- 9.
- R.H. Chan and M.K. Ng, ``Conjugate gradient method for Toeplitz systems'', SIAM Rev., 38, pp. 427-482, (1996). MR 97i:65048
- 10.
- R.H. Chan and G. Strang, ``Toeplitz equations by conjugate gradients with circulant preconditioner'', SIAM J. Sci. Statist. Comput., 10, pp. 104-119 (1989). MR 90d:65069
- 11.
- R.H. Chan and P. Tang, ``Fast band-Toeplitz preconditioners for Hermitian Toeplitz systems'', SIAM J. Sci. Comput., 15, pp. 164-171 (1994). MR 94j:65043
- 12.
- R.H. Chan and M.-C. Yeung, ``Circulant preconditioners for Toeplitz matrices with positive continuous generating functions'', Math. Comp., 58, pp. 233-240 (1992). MR 92e:65040
- 13.
- R.H. Chan and M.-C. Yeung, ``Jackson's theorem and circulant preconditioned Toeplitz systems'', J. Approx. Theory, 70, pp. 191-205 (1992). MR 93c:65046
- 14.
- T.F. Chan, ``An optimal circulant preconditioner for Toeplitz systems'', SIAM J. Sci. Statist. Comput., 9, pp. 766-771 (1988). MR 89e:65046
- 15.
- E. Cheney, Introduction to Approximation Theory. McGraw-Hill, New York, 1966. MR 36:5568
- 16.
- P. Davis, Circulant Matrices. John Wiley and Sons, New York, 1979. MR 81a:15003
- 17.
- F. de Hoog, ``A new algorithm for solving Toeplitz systems of equations'', Linear Algebra Appl., 88/89, pp. 123-138 (1987). MR 88d:65053
- 18.
- F. Di Benedetto, ``Analysis of preconditioning techniques for ill-conditioned Toeplitz matrices'', SIAM J. Sci. Comput., 16, pp. 682-697 (1995). MR 95m:65082
- 19.
- F. Di Benedetto, G. Fiorentino and S. Serra, ``C.G. preconditioning for Toeplitz matrices'', Comput. Math. Appl., 25, pp. 35-45 (1993). MR 93h:65063
- 20.
- F. Di Benedetto and S. Serra Capizzano, ``A unifying approach to matrix algebra preconditioning'', Numer. Math., in press.
- 21.
- I. Gohberg and I. Fel'dman, Convolution Equations and Projection Methods for Their Solution, Transl. Math. Monogr., 41, Amer. Math. Soc., Providence, RI, 1974. MR 50:8149
- 22.
- G.H. Golub and C.F. Van Loan, Matrix Computations. The Johns Hopkins University Press, Baltimore, MD, 1983. MR 85h:65063
- 23.
- B. Grasso, Tecniche di Precondizionamento per la Risoluzione Numerica di Sistemi Lineari Tramite Proiezioni su Particolari Algebre Matriciali. Undergraduate thesis, Dept. Math., University of Genova, Italy, 1995.
- 24.
- U. Grenander and M. Rosenblatt, Statistical Analysis of Stationary Time Series. Second edition, Chelsea, New York, 1984. MR 88f:62003
- 25.
- U. Grenander and G. Szegö, Toeplitz Forms and Their Applications. Second Edition, Chelsea, New York, 1984. MR 88b:42031
- 26.
- D. Jackson, The Theory of Approximation. Amer. Math. Soc., New York, 1930.
- 27.
- X.-Q. Jin, ``Hartley preconditioners for Toeplitz systems generated by positive continuous functions'', BIT, 34, pp. 367-371 (1994). MR 97i:65050
- 28.
- M. Kac, W. Murdock, and G. Szegö, ``On the eigenvalues of certain Hermitian forms'', J. Rational Mech. Anal., 2, pp. 767-800 (1953). MR 15:538b
- 29.
- A. Oppenheim, Applications of Digital Signal Processing. Prentice-Hall, Englewood Cliffs, NJ, 1978.
- 30.
- W. Rudin, Principles of Mathematical Analysis. McGraw-Hill, New York, 1985. MR 52:5893
- 31.
- S. Serra, ``Preconditioning strategies for asymptotically ill-conditioned block Toeplitz systems'', BIT, 34, pp. 579-594 (1994). MR 98a:65052
- 32.
- S. Serra, ``Conditioning and solution of Hermitian (block) Toeplitz systems by means of preconditioned conjugate gradient methods'', Proc. in Advanced Signal Processing Algorithms, Architectures, and Implementations - SPIE Conference, F. Luk ed., San Diego, CA, July 1995, pp. 326-337.
- 33.
- S. Serra, ``Preconditioning strategies for Hermitian Toeplitz systems with nondefinite generating functions'', SIAM J. Matrix Anal. Appl., 17, pp. 1007-1019 (1996). MR 98a:65042
- 34.
- S. Serra, ``On the extreme eigenvalues of Hermitian (block) Toeplitz matrices'', Linear Algebra Appl., 270, pp. 109-129 (1998). CMP 98:05
- 35.
- S. Serra, ``On the extreme spectral properties of Toeplitz matrices generated by
functions with several minima/maxima'', BIT, 36, pp. 135-142 (1996). MR 98a:65051 - 36.
- S. Serra, ``Asymptotic results on the spectra of preconditioned Toeplitz matrices and some applications'', TR nr. 9, LAN - Dept. Math., University of Calabria, (1995).
- 37.
- S. Serra, ``Optimal, quasi-optimal and superlinear band-Toeplitz preconditioners for asymptotically ill-conditioned positive definite Toeplitz systems'', Math. Comp., 66, pp. 651-665 (1997). MR 97h:65056
- 38.
- E.E. Tyrtyshnikov, ``Circulant preconditioners with unbounded inverses'', Linear Algebra Appl., 216, pp. 1-23 (1995). MR 95m:15019
- 39.
- C.F. Van Loan, Computational Frameworks for the Fast Fourier Transform. SIAM, Philadelphia, PA, 1992. MR 93a:65186
- 40.
- A. Zygmund, Trigonometric Series. Cambridge University Press, London, 1959. MR 21:6498
Similar Articles:
Retrieve articles in Mathematics of Computation
with MSC
(1991):
65F10, 65F15
Retrieve articles in all Journals with MSC
(1991):
65F10, 65F15
Additional Information:
Stefano
Serra
Affiliation:
Dipartimento di Informatica, Corso Italia 40, 56100 Pisa (ITALY)
Email:
serra@mail.dm.unipi.it
DOI:
10.1090/S0025-5718-99-01045-5
PII:
S 0025-5718(99)01045-5
Keywords:
Toeplitz matrix,
$\tau$ algebra,
conjugate gradient method
Received by editor(s):
February 7, 1996
Received by editor(s) in revised form:
October 15, 1996 and July 18, 1997
Copyright of article:
Copyright
1999,
American Mathematical Society
|