Sequential and parallel synchronous alternating iterative methods
HTML articles powered by AMS MathViewer
- by Joan-Josep Climent, Carmen Perea, Leandro Tortosa and Antonio Zamora PDF
- Math. Comp. 73 (2004), 691-717 Request permission
Abstract:
The so-called parallel multisplitting nonstationary iterative Model A was introduced by Bru, Elsner, and Neumann [Linear Algebra and its Applications 103:175-192 (1988)] for solving a nonsingular linear system $A\mathbfit {x} = \mathbfit {b}$ using a weak nonnegative multisplitting of the first type. In this paper new results are introduced when $A$ is a monotone matrix using a weak nonnegative multisplitting of the second type and when $A$ is a symmetric positive definite matrix using a $P$-regular multisplitting. Also, nonstationary alternating iterative methods are studied. Finally, combining Model A and alternating iterative methods, two new models of parallel multisplitting nonstationary iterations are introduced. When matrix $A$ is monotone and the multisplittings are weak nonnegative of the first or of the second type, both models lead to convergent schemes. Also, when matrix $A$ is symmetric positive definite and the multisplittings are $P$-regular, the schemes are also convergent.References
- Abraham Berman and Robert J. Plemmons, Nonnegative matrices in the mathematical sciences, Classics in Applied Mathematics, vol. 9, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1994. Revised reprint of the 1979 original. MR 1298430, DOI 10.1137/1.9781611971262
- Michele Benzi and Daniel B. Szyld, Existence and uniqueness of splittings for stationary iterative methods with applications to alternating methods, Numer. Math. 76 (1997), no. 3, 309–321. MR 1452511, DOI 10.1007/s002110050265
- Rafael Bru, Ludwig Elsner, and Michael Neumann, Models of parallel chaotic iteration methods, Linear Algebra Appl. 103 (1988), 175–192. MR 944001, DOI 10.1016/0024-3795(88)90227-3
- Rafael Bru, L. Elsner, and M. Neumann, Convergence of infinite products of matrices and inner-outer iteration schemes, Electron. Trans. Numer. Anal. 2 (1994), no. Dec., 183–193. MR 1308895
- R. Bru, V. Migallón, and J. Penadés. Chaotic methods for the parallel solution of linear systems. Computing Systems in Engineering, 6: 385–390 (1995).
- Joan-Josep Climent and Carmen Perea, Some comparison theorems for weak nonnegative splittings of bounded operators, Proceedings of the Sixth Conference of the International Linear Algebra Society (Chemnitz, 1996), 1998, pp. 77–106. MR 1628383, DOI 10.1016/S0024-3795(97)10065-9
- Joan-Josep Climent and Carmen Perea, Convergence and comparison theorems for multisplittings, Numer. Linear Algebra Appl. 6 (1999), no. 2, 93–107. Czech-US Workshop in Iterative Methods and Parallel Computing, Part 2 (Milovy, 1997). MR 1695402, DOI 10.1002/(SICI)1099-1506(199903)6:2<93::AID-NLA149>3.0.CO;2-8
- V. Conrad and Y. Wallach, Alternating methods for sets of linear equations, Numer. Math. 32 (1979), no. 1, 105–108. MR 525641, DOI 10.1007/BF01397654
- George Csordas and Richard S. Varga, Comparisons of regular splittings of matrices, Numer. Math. 44 (1984), no. 1, 23–35. MR 745083, DOI 10.1007/BF01389752
- George Csordas and Richard S. Varga, Comparisons of regular splittings of matrices, Numer. Math. 44 (1984), no. 1, 23–35. MR 745083, DOI 10.1007/BF01389752
- Andreas Frommer and Günter Mayer, Convergence of relaxed parallel multisplitting methods, Linear Algebra Appl. 119 (1989), 141–152. MR 1005240, DOI 10.1016/0024-3795(89)90074-8
- A. Frommer and G. Mayer, On the theory and practice of multisplitting methods in parallel computation, Computing 49 (1992), no. 1, 63–74 (English, with English and German summaries). MR 1182442, DOI 10.1007/BF02238650
- Andreas Frommer and Daniel B. Szyld, Weighted max norms, splittings, and overlapping additive Schwarz iterations, Numer. Math. 83 (1999), no. 2, 259–278. MR 1712686, DOI 10.1007/s002110050449
- J.M.D. Hill, B. McColl, D.C. Stefanescu, M.W. Goudreau, K. Lang, S.B. Rao, T. Suel, T. Tsantilas, and R.H. Bisseling. BSPlib: The BSP Programming Library. Parallel Computing, 24: 1947–1980 (1998).
- Paul J. Lanzkron, Donald J. Rose, and Daniel B. Szyld, Convergence of nested classical iterative methods for linear systems, Numer. Math. 58 (1991), no. 7, 685–702. MR 1090255, DOI 10.1007/BF01385649
- G.I. Marchuk. Splitting and alternating direction methods. In P.G. Ciarlet and J.L. Lions (editors). Handbook of Numerical Analysis, Vol. I, pages 197–462. North Holland, New York, NY, 1990.
- Ivo Marek and Daniel B. Szyld, Comparison theorems for weak splittings of bounded operators, Numer. Math. 58 (1990), no. 4, 387–397. MR 1077585, DOI 10.1007/BF01385632
- Valerie A. Miller and Michael Neumann, A note on comparison theorems for nonnegative matrices, Numer. Math. 47 (1985), no. 3, 427–434. MR 808561, DOI 10.1007/BF01389590
- Violeta Migallón, José Penadés, and Daniel B. Szyld, Nonstationary multisplittings with general weighting matrices, SIAM J. Matrix Anal. Appl. 22 (2001), no. 4, 1089–1094. MR 1824059, DOI 10.1137/S0895479800367038
- Reinhard Nabben, A note on comparison theorems for splittings and multisplittings of Hermitian positive definite matrices, Linear Algebra Appl. 233 (1996), 67–80. MR 1368073, DOI 10.1016/0024-3795(94)00050-6
- M. Neumann and R. J. Plemmons, Convergence of parallel multisplitting iterative methods for $M$-matrices, Linear Algebra Appl. 88/89 (1987), 559–573. MR 882463, DOI 10.1016/0024-3795(87)90125-X
- Dianne P. O’Leary and R. E. White, Multisplittings of matrices and parallel solution of linear systems, SIAM J. Algebraic Discrete Methods 6 (1985), no. 4, 630–640. MR 800993, DOI 10.1137/0606062
- James M. Ortega, Numerical analysis, 2nd ed., Classics in Applied Mathematics, vol. 3, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1990. A second course. MR 1037261, DOI 10.1137/1.9781611971323
- Richard S. Varga, Matrix iterative analysis, Prentice-Hall, Inc., Englewood Cliffs, N.J., 1962. MR 0158502
- De Ren Wang, On the convergence of the parallel multisplitting AOR algorithm, Linear Algebra Appl. 154/156 (1991), 473–486. MR 1113156, DOI 10.1016/0024-3795(91)90390-I
- Zbigniew I. Woźnicki, Nonnegative splitting theory, Japan J. Indust. Appl. Math. 11 (1994), no. 2, 289–342. MR 1286436, DOI 10.1007/BF03167226
- David M. Young, Iterative solution of large linear systems, Academic Press, New York-London, 1971. MR 0305568
Additional Information
- Joan-Josep Climent
- Affiliation: Departament de Ciència de la Computació i Intel$\cdot$ligència Artificial, Universitat d’Alacant, Ap. Correus 99, E–03080 Alacant, Spain
- Email: jcliment@dccia.ua.es
- Carmen Perea
- Affiliation: Departamento de Estadística y Matemática Aplicada, Universidad Miguel Hernández, Escuela Politécnica Superior de Orihuela, E-03550, Orihuela, Spain
- Email: perea@umh.es
- Leandro Tortosa
- Affiliation: Departament de Ciència de la Computació i Intel$\cdot$ligència Artificial, Universitat d’Alacant, Ap. Correus 99, E–03080 Alacant, Spain
- Email: tortosa@dccia.ua.es
- Antonio Zamora
- Affiliation: Departament de Ciència de la Computació i Intel$\cdot$ligència Artificial, Universitat d’Alacant, Ap. Correus 99, E–03080 Alacant, Spain
- Email: zamora@dccia.ua.es
- Received by editor(s): July 9, 2001
- Received by editor(s) in revised form: November 13, 2002
- Published electronically: November 24, 2003
- © Copyright 2003 American Mathematical Society
- Journal: Math. Comp. 73 (2004), 691-717
- MSC (2000): Primary 65F10, 65F15
- DOI: https://doi.org/10.1090/S0025-5718-03-01607-7
- MathSciNet review: 2031401