Abstract
Inspired by the success of the projected Barzilai-Borwein (PBB) method for large-scale box-constrained quadratic programming, we propose and analyze the monotone projected gradient methods in this paper. We show by experiments and analyses that for the new methods, it is generally a bad option to compute steplengths based on the negative gradients. Thus in our algorithms, some continuous or discontinuous projected gradients are used instead to compute the steplengths. Numerical experiments on a wide variety of test problems are presented, indicating that the new methods usually outperform the PBB method.
Similar content being viewed by others
References
Nocedal, J., Wright, S. J., Numerical Optimization, Springer Series in Operations Research, New York: Springer-Verlag, 1999.
Goldstein, A. A., Convex programming in Hilbert space, Bulletin of the American Mathematical Society, 1964, 70: 709–710.
Levitin, E. S., Polyak, B. T., Constrained minimization problems, USSR Computational Mathematics and Mathematical Physics, 1966, 6: 1–50.
Burke, J. V., Moré, J. J., Exposing constraints, SIAM J. Optim., 1994, 4: 573–595.
Conn, A. R., Gould, N. I. M., Toint, Ph. L., Global convergence of a class of trust region algorithms for optimization with simple bounds, SIAM J. Numer. Anal., 1988, 25: 433–460; 1989, 26: 764–767.
Conn, A. R., Gould, N. I. M., Toint, Ph. L., Testing a class of algorithms for solving minimization problems with simple bounds on the variables, Mathematics of Computation, 1988, 50: 399–430.
Dunn, J. C., Gradient-related constrained minimization algorithms in function spaces: convergence properties and computational implications, in Large Scale Optimization: State of the Art (eds. Hager, W. W., Hearn, D. W., Pardalos, P. M.), Dordrecht: Kluwer Academic Publishers, 1994, 99–118.
Moré, J. J., Toraldo, G., On the solution of large quadratic programming problems with bound constraints, SIAM J. Optim., 1991, 13: 93–113.
Barzilai, J., Borwein, J. M., Two-point step size gradient methods, IMA J. Numer. Anal., 1988, 8: 141–148.
Raydan, M., On the Barzilai and Borwein choice of steplength for the gradient method, IMA J. Numer. Anal., 1993, 13: 321–326.
Dai, Y. H., Liao, L.-Z., R-linear convergence of the Barzilai and Borwein gradient method, IMA J. Numer. Anal., 2002, 22: 1–10.
Grippo, L., Lampariello, F., Lucidi, S., A nonmonotone line search technique for Newton’s method, SIAM J. Numer. Anal., 1986, 23: 707–716.
Raydan, M., The Barzilai and Borwein method for the large scale unconstrained minimization problem, SIAM J. Optim., 1997, 7: 26–33.
Birgin, E. G., Martínez, J. M., Raydan, M., Nonmonotone spectral projected gradient methods on convex sets, SIAM J. Optim., 2000, 10: 1196–1211.
Birgin, E. G., Martínez, J. M., Raydan, M., Algorithm 813: SPG—Software for convex-constrained optimization, ACM Trans. Math. Software, 2001, 27: 340–349.
Bongartz, I., Conn, A. R., Gould, N. I. M. et al., CUTE: Constrained and unconstrained testing environment, ACM Trans. Math. Software, 1995, 21: 123–160.
Conn, A. R., Gould, N. I. M., Toint, Ph. L., LANCELOT: A FORTRAN package for large-scale nonlinear optimization (Release A), Springer Series in Computational Mathematics 17, New York: Springer Verlag, 1992.
Dai, Y. H., Fletcher, R., Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming, Numerische Mathematik, 2005, 100: 21–47.
Dai, Y. H., Yuan, Y., Analysis of monotone gradient methods, Journal of Industrial and Management Optimization, 2005, 1: 181–192.
Yuan, Y., A new stepsize for the steepest descent method, J. Comput. Math., 2006, 24: 149–156.
Bertsekas, D. P., Nonlinear Programming, Belmont (MA): Athena Scientific, 1995.
Fletcher, R., On the Barzilai-Borwein method, Numerical Analysis Report NA/207, Department of Mathematics, University of Dundee, 2001.
Gould, N. I. M., Orban, D., Toint, Ph. L., CUTEr and SifDec: A constrained and unconstrained testing environment, revisited, ACM Trans. Math. Software, 2003, 29: 373–394.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, B., Gao, L. & Dai, Y. Monotone projected gradient methods for large-scale box-constrained quadratic programming. SCI CHINA SER A 49, 688–702 (2006). https://doi.org/10.1007/s11425-006-0688-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11425-006-0688-2