A stability analysis for perturbed nonlinear iterative methods

Boggs, Paul T.; Dennis, J. E.

doi:10.1090/S0025-5718-1976-0395209-4

A stability analysis for perturbed nonlinear iterative methods

Authors: Paul T. Boggs and J. E. Dennis
Journal: Math. Comp. 30 (1976), 199-215
MSC: Primary 65H10
DOI: https://doi.org/10.1090/S0025-5718-1976-0395209-4
MathSciNet review: 0395209
Full-text PDF Free Access

Abstract | References | Similar Articles | Additional Information

Abstract: This paper applies the asymptotic stability theory for ordinary differential equations to Gavurin's continuous analogue of several well-known nonlinear iterative methods. In particular, a general theory is developed which extends the Ortega-Rheinboldt concept of consistency to include the widely used finite-difference approximations to the gradient as well as the finite-difference approximations to the Jacobian in Newton's method. The theory is also shown to be applicable to the Levenberg-Marquardt and finite-difference Levenberg-Marquardt methods.

[1] Paul T. Boggs, The solution of nonlinear systems of equations by 𝐴-stable integration techniques, SIAM J. Numer. Anal. 8 (1971), 767–785. MR 297121, https://doi.org/10.1137/0708071
[2] Paul T. Boggs, The convergence of the Ben-Israel iteration for nonlinear least squares problems, Math. Comp. 30 (1976), no. 135, 512–522. MR 416018, https://doi.org/10.1090/S0025-5718-1976-0416018-3
[3] W. E. BOSARGE, JR. (1968) Infinite Dimensional Iterative Methods and Applications, IBM Publications 230-2347, Houston.
[4] Kenneth M. Brown and J. E. Dennis Jr., Derivative free analogues of the Levenberg-Marquardt and Gauss algorithms for nonlinear least squares approximation, Numer. Math. 18 (1971/72), 289–297. MR 303723, https://doi.org/10.1007/BF01404679
[5] Earl A. Coddington and Norman Levinson, Theory of ordinary differential equations, McGraw-Hill Book Company, Inc., New York-Toronto-London, 1955. MR 0069338
[6] J. E. DENNIS, JR. (1971) "Algorithms for nonlinear problems which use discrete approximations to derivatives," Proc. ACM 1971 Nat'l. Conference, Chicago.
[7] Philip Rabinowitz (ed.), Numerical methods for nonlinear algebraic equations, Gordon and Breach Science Publishers, London-New York-Paris, 1970. MR 0331759
[8] M. K. Gavurin, Nonlinear functional equations and continuous analogues of iteration methods, Izv. Vysš. Učebn. Zaved. Mattmatika 1958 (1958), no. 5 (6), 18–31 (Russian). MR 0137932
[9] Allen A. Goldstein, Constructive real analysis, Harper & Row, Publishers, New York-London, 1967. MR 0217616
[10] G. H. Golub and V. Pereyra, The differentiation of pseudo-inverses and nonlinear least squares problems whose variables separate, SIAM J. Numer. Anal. 10 (1973), 413–432. MR 336980, https://doi.org/10.1137/0710036
[11] Peter Henrici, Discrete variable methods in ordinary differential equations, John Wiley & Sons, Inc., New York-London, 1962. MR 0135729
[12] James Hurt, Some stability theorems for ordinary difference equations, SIAM J. Numer. Anal. 4 (1967), 582–596. MR 221787, https://doi.org/10.1137/0704053
[13] Kenneth Levenberg, A method for the solution of certain non-linear problems in least squares, Quart. Appl. Math. 2 (1944), 164–168. MR 0010666, https://doi.org/10.1090/S0033-569X-1944-10666-0
[14] Donald W. Marquardt, An algorithm for least-squares estimation of nonlinear parameters, J. Soc. Indust. Appl. Math. 11 (1963), 431–441. MR 153071
[15] Gunter H. Meyer, On solving nonlinear equations with a one-parameter operator imbedding, SIAM J. Numer. Anal. 5 (1968), 739–752. MR 242366, https://doi.org/10.1137/0705057
[16] James M. Ortega, Stability of difference equations and convergence of iterative processes, SIAM J. Numer. Anal. 10 (1973), 268–282. MR 339523, https://doi.org/10.1137/0710026
[17] J. M. Ortega and W. C. Rheinboldt, Iterative solution of nonlinear equations in several variables, Academic Press, New York-London, 1970. MR 0273810
[18] A. M. Ostrowski, Solution of equations and systems of equations, Second edition. Pure and Applied Mathematics, Vol. 9, Academic Press, New York-London, 1966. MR 0216746
[19] C. Radhakrishna Rao and Sujit Kumar Mitra, Generalized inverse of matrices and its applications, John Wiley & Sons, Inc., New York-London-Sydney, 1971. MR 0338013
[20] R. A. Tapia, The differentiation and integration of nonlinear operators, Nonlinear Functional Anal. and Appl. (Proc. Advanced Sem., Math. Res. Center, Univ. of Wisconsin, Madison, Wis., 1970) Academic Press, New York, 1971, pp. 45–101. MR 0285943