Minimum norm symmetric quasi-Newton updates restricted to subspaces

Author:
Robert B. Schnabel

Journal:
Math. Comp. **32** (1978), 829-837

MSC:
Primary 65K10; Secondary 65F30

DOI:
https://doi.org/10.1090/S0025-5718-1978-0492041-X

MathSciNet review:
492041

Full-text PDF

Abstract | References | Similar Articles | Additional Information

Abstract: The Davidon-Fletcher-Powell and Broyden-Fletcher-Goldfarb-Shanno updates have been the two most successful quasi-Newton updates for a variety of applications. One reason offered in explanation is that they constitute, in an appropriate norm and metric, the minimum norm change to the matrix, or its inverse, being approximated which preserves symmetry and obeys the quasi-Newton equation. Recent methods have reason to consider updates restricted to certain subspaces. In this paper we derive the general minimum norm symmetric quasi-Newton updates restricted to such subspaces. In the same appropriate norm and metric, the minimum norm change update to the matrix or its inverse is shown to be, respectively, the rank-two update which is a particular projection of the DFP or BFGS onto this subspace.

**[C]**G. BROYDEN (1970), "The convergence of a class of double-rank minimization algorithms,"*J. Inst. Math. Appl.*, v. 6, pp. 76-90. MR**0433870 (55:6841)****[W]**C. DAVIDON (1959),*Variable Metric Algorithm for Minimization*, Argonne National Laboratory Report ANL-5990 (Rev.).**[W]**C. DAVIDON (1975), "Optimally conditioned optimization algorithms without line searches,"*Math. Programming*, v. 9, pp. 1-30. MR**0383741 (52:4621)****[J]**E. DENNIS & J. MORÉ (1977), "Quasi-Newton methods, motivation and theory,"*SIAM Rev.*, v. 19, pp. 46-89. MR**0445812 (56:4146)****[R]**FLETCHER (1970), "A new approach to variable metric methods,"*Comput. J.*, v. 13, pp. 317-322.**[R]**FLETCHER & M. J. D. POWELL (1963), "A rapidly convergent descent method for minimization,"*Comput. J.*, v. 6, pp. 163-168. MR**0152116 (27:2096)****[D]**GOLDFARB (1970), "A family of variable metric updates derived by variational means,"*Math. Comp.*, v. 24, pp. 23-26. MR**0258249 (41:2896)****[J]**GREENSTADT (1970), "Variations of variable-metric methods,"*Math. Comp.*, v. 24, pp. 1-18. MR**0258248 (41:2895)****[H]**H.-W. MEI (1977), "An analysis and implementation of Davidon's techniques for unconstrained optimization," Ph.D. thesis, Cornell University.**[R]**B. SCHNABEL (1976), "Optimal conditioning in the convex class of rank-two updates,*Math. Programming*. (To appear.) MR**514611 (80c:65130)****[R]**B. SCHNABEL (1977), "Analyzing and improving quasi-Newton methods for unconstrained optimization," Ph.D. thesis, Cornell University.**[D]**F. SHANNO (1970), "Conditioning of quasi-Newton methods for function minimization,"*Math. Comp.*, v. 24, pp. 647-656. MR**0274029 (42:8905)**

Retrieve articles in *Mathematics of Computation*
with MSC:
65K10,
65F30

Retrieve articles in all journals with MSC: 65K10, 65F30

Additional Information

DOI:
https://doi.org/10.1090/S0025-5718-1978-0492041-X

Keywords:
Quasi-Newton updates,
minimum norm change updates

Article copyright:
© Copyright 1978
American Mathematical Society