|
Homotopic residual correction processes
Author(s):
V.
Y.
Pan;
M.
Kunin;
R.
E.
Rosholt;
H.
Kodal.
Journal:
Math. Comp.
75
(2006),
345-368.
MSC (2000):
Primary 65F10, 65F30
Posted:
July 25, 2005
Retrieve article in:
PDF DVI PostScript
Abstract |
References |
Similar articles |
Additional information
Abstract:
We present and analyze homotopic (continuation) residual correction algorithms for the computation of matrix inverses. For complex indefinite Hermitian input matrices, our homotopic methods substantially accelerate the known nonhomotopic algorithms. Unlike the nonhomotopic case our algorithms require no pre-estimation of the smallest singular value of an input matrix. Furthermore, we guarantee rapid convergence to the inverses of well-conditioned structured matrices even where no good initial approximation is available. In particular we yield the inverse of a well-conditioned matrix with a structure of Toeplitz/Hankel type in flops. For a large class of input matrices, our methods can be extended to computing numerically the generalized inverses. Our numerical experiments confirm the validity of our analysis and the efficiency of the presented algorithms for well-conditioned input matrices and furnished us with the proper values of the parameters that define our algorithms.
References:
-
- [B85]
- J. R. Bunch, Stability of Methods for Solving Toeplitz Systems of Equations, SIAM Journal on Scientific and Statistical Computing, 6, 2, 349-364, 1985. MR 0779410 (87a:65073)
- [B-I66]
- A. Ben-Israel, A Note on Iterative Method for Generalized Inversion of Matrices, Math. Comp., 20, 439-440, 1966.
- [BM01]
- D. A. Bini, B. Meini, Approximate displacement rank and applications, Structured Matrices in Mathematics, Computer Science, and Engineering II (V. Olshevsky Editor), Contemporary Mathematics, 281, 215-232, American Mathematical Society, Rhode Island, 2001. MR 1855993 (2002g:15030)
- [CKL-A87]
- J. Chun, T. Kailath, H. Lev-Ari, Fast Parallel Algorithm for QR-factorization of Structured Matrices, SIAM Journal on Scientific and Statistical Computing, 8, 6, 899-913, 1987. MR 0911062 (89e:65035)
- [EPY98]
- I. A. Emiris, V. Y. Pan, Y. Yu, Modular Arithmetic for Linear Algebra Computations in the Real Field, J. of Symbolic Computation, 26, 71-87, 1998.MR 1633585 (2000f:15001)
- [FF63]
- D. K. Faddeev, V. N. Faddeeva, Computational Methods of Linear Algebra, W. H. Freeman, San Francisco, 1963. MR 0158519 (28:1742)
- [GL96]
- G. H. Golub, C. F. Van Loan, Matrix Computations, Johns Hopkins Univeristy Press, Baltimore, Maryland, 1989 (2nd edition), 1996 (3rd edition). MR 1002570 (90d:65055); MR 1417720 (97g:65006)
- [HH93]
- G. Heinig, F. Hellinger, On the Bezoutian Structure of the Moore-Penrose Inverses of Hankel Matrices, SIAM J. on Matrix Analysis and Applications, 14, 3, 629-645, 1993. MR 1227768 (94f:15006)
- [HH94]
- G. Heinig, F. Hellinger, Moore-Penrose Generalized Inverse of Square Toeplitz Matrices, SIAM J. on Matrix Analysis and Applications, 15, 2, 418-450, 1994. MR 1266596 (95c:15008)
- [IK66]
- E. Issacson, H. B. Keller, Analysis of Numerical Methods, Wiley, New York, 1966. MR 0201039 (34:924)
- [KKM79]
- T. Kailath, S. Y. Kung, M. Morf, Displacement Ranks of Matrices and Linear Equations, J. Math. Anal. Appl., 68, 2, 395-407, 1979. MR 0533501 (80k:65029)
- [KS99]
- T. Kailath, A. H. Sayed (Editors), Fast Reliable Algorithms for Matrices with Structure, SIAM Publications, Philadelphia, 1999. MR 1715813 (2000h:65003)
- [P90]
- V. Y. Pan, On Computations with Dense Structured Matrices, Math. Comp., 55, 191, 179-190, 1990. Proceeding version: Proc. Intern. Symp. on Symbolic and Algebraic Comp. (ISSAC'89), 34-42, ACM Press, New York, 1989. MR 1023051 (90m:65085)
- [P92]
- V. Y. Pan, Parallel Solution of Toeplitz-like Linear Systems, J. of Complexity, 8, 1-21, 1992. MR 1153611 (92k:65202)
- [P92b]
- V. Y. Pan, Can We Utilize the Cancelation of the Most Significant Digits? Tech. Report TR-92-061, The International Computer Science Institute, Berkeley, California, 1992.
- [P93]
- V. Y. Pan, Decreasing the Displacement Rank of a Matrix, SIAM Journal on Matrix Analysis and Applications, 14, 1, 118-121, 1993. MR 1199549 (93k:15039)
- [P01a]
- V. Y. Pan, Structured Matrices and Polynomials: Unified Superfast Algorithms, Birkhäuser/Springer, Boston/New York, 2001. MR 1843842 (2002i:65001)
- [P01b]
- V. Y. Pan, A Homotopic Residual Correction Process, Proceedings of the Second Conference on Numerical Analysis and Applications (P. Yalamov, editor), Lecture Notes in Computer Science, 1988, 644-649, Springer, Berlin, 2001.
- [Pa]
- V. Y. Pan, A Homotopic/Factorization Process for Toeplitz-like Matrices with Newton's/Conjugate Gradient Stages, Technical Report TR 2004014, Ph.D. Program in Computer Science, Graduate Center, City University of New York, New York, 2004.
- [PBRZ99]
- V. Y. Pan, S. Branham, R. Rosholt, A. Zheng, Newton's Iteration for Structured Matrices and Linear Systems of Equations, SIAM volume on Fast Reliable Algorithms for Matrices with Structure, (T. Kailath, A.H. Sayed, Editors), 189-210, SIAM Publications, Philadelphia, 1999. MR 1715820
- [PKRC02]
- V. Y. Pan, M. Kunin, R. Rosholt, H. Cebecioglu, Residual Correction Algorithms for General and Structured Matrices, Technical Report TR 2002020, Ph.D. Program in Computer Science, Graduate Center, City University of New York, New York, 2002.
- [PMRTY]
- V. Y. Pan, B. Murphy, R. E. Rosholt, Y. Tang, X. Yan, Additive Preconditioning in Matrix Computations, Technical Report TR 2005009, Ph.D. Program in Computer Science, Graduate Center, City University of New York, New York, 2005.
- [PR01]
- V. Y. Pan, Y. Rami, Newton's Iteration for the Inversion of Structured Matrices, Advances in the Theory of Computational Mathematics, Vol. 4: Structured Matrices: Recent Developments in Theory and Computation, (edited by D. A. Bini, E. Tyrtyshnikov and P. Yalamov), 79-90, Nova Science Publishers, Huntington, New York, 2001.
- [PRW02]
- V. Y. Pan, Y. Rami, X. Wang, Structured Matrices and Newton's Iteration: Unified Approach, Linear Algebra and Its Applications, 343-344, 233-265, 2002. MR 1878944 (2002m:65036)
- [PS91]
- V. Y. Pan, R. Schreiber, An Improved Newton Iteration for the Generalized Inverse of a Matrix, with Applications, SIAM J. on Scientific and Statistical Computing, 12, 5, 1109-1131, 1991. MR 1114976 (92d:65056)
- [PVBWC04]
- V. Y. Pan, M. Van Barel, X. Wang, G. Codevico, Iterative Inversion of Structured Matrices, Theoretical Computer Science, 315, 2-3, 581-592 (Special Issue on Algebraic and Numerical Computing), 2004.MR 2073066
- [PW03]
- V. Y. Pan and X. Wang, Inversion of Displacement Operators. SIAM Journal on Matrix Analysis and Applications, 24, 3, 660-677, 2003. MR 1972673 (2004a:47012)
- [PZHD97]
- V. Y. Pan, A. Zheng, X. Huang, O. Dias, Newton's Iteration for Inversion of Cauchy-like and Other Structured Matrices, J. of Complexity, 13, 108-124, 1997. MR 1449764 (98h:65014)
- [Par80]
- B. N. Parlett, The Symmetric Eigenvalue Problem, Prentice-Hall, Englewood Cliffs, NJ, 1980. MR (81j:65063)
- [S33]
- G. Schultz, Iterative Berechnung der Reciproken Matrix, Z. Angew. Meth. Mech., 13, 57-59, 1933.
- [SS74]
- T. Söderström, W. Stewart, On the Numerical Properties of an Iterative Method for Computing the Moore-Penrose Generalized Inverse, SIAM J. Numer. Anal., 11, 61-74, 1974. MR 0341843 (49:6589)
Similar Articles:
Retrieve articles in Mathematics of Computation
with MSC
(2000):
65F10, 65F30
Retrieve articles in all Journals with MSC
(2000):
65F10, 65F30
Additional Information:
V.
Y.
Pan
Affiliation:
Mathematics and Computer Science Department, Lehman College, CUNY, Bronx, New York 10468; Ph. D. Program in Mathematics, Graduate Center, CUNY, New York, New York 10016
Email:
victor.pan@lehman.cuny.edu
M.
Kunin
Affiliation:
Ph.D. Program in Computer Science, Graduate Center, CUNY, New York, New York 10016
R.
E.
Rosholt
Affiliation:
Mathematics and Computer Science Department, Lehman College, CUNY, Bronx, New York 10468
H.
Kodal
Affiliation:
University of Kocaeli, Department of Mathematics, 41300 Izmit, Kocaeli, Turkey
DOI:
10.1090/S0025-5718-05-01771-0
PII:
S 0025-5718(05)01771-0
Keywords:
Residual correction,
Newton's iteration,
homotopic (continuation) algorithms,
(generalized) inverse matrix
Received by editor(s):
December 20, 2001
Received by editor(s) in revised form:
March 10, 2004
Posted:
July 25, 2005
Additional Notes:
This work was supported by NSF Grant CCR9732206, PSC CUNY Awards 63383-0032 and 66406-0033, and a Grant from the CUNY Institute for Software Design and Development (CISDD)
The results of this paper were presented at the Second Conference on Numerical Analysis and Applications, Rousse, Bulgaria, in June 2000, and at the AMS/IMS/SIAM Summer Research Conference on Fast Algorithms in Mathematics, Computer Science, and Engineering in South Hadley, Massachusetts, in August 2001.
Copyright of article:
Copyright
2005,
American Mathematical Society
The copyright for this article reverts to public domain after 28 years from publication.
|