Abstract
Extended Linear-Quadratic Programming (ELQP) problems were introduced by Rockafellar and Wets for various models in stochastic programming and multistage optimization. Several numerical methods with linear convergence rates have been developed for solving fully quadratic ELQP problems, where the primal and dual coefficient matrices are positive definite. We present a two-stage sequential quadratic programming (SQP) method for solving ELQP problems arising in stochastic programming. The first stage algorithm realizes global convergence and the second stage algorithm realizes superlinear local convergence under a condition calledB-regularity.B-regularity is milder than the fully quadratic condition; the primal coefficient matrix need not be positive definite. Numerical tests are given to demonstrate the efficiency of the algorithm. Solution properties of the ELQP problem underB-regularity are also discussed.
Similar content being viewed by others
References
J.R. Birge and R.J-B. Wets, Designing approximation schemes for stochastic optimization problems, in particular, for stochastic programs with recourse, Math. Prog. Study 27 (1986) 54–102.
X. Chen, L. Qi and R.S. Womersley, Newton's method for quadratic stochastic programs with recourse, J. Comp. Appl. Math. 60, to appear.
X. Chen and R.S. Womersley, A parallel inexact Newton method for stochastic programs with recourse, Ann. Oper. Res., to appear.
F.H. Clarke,Optimization and Nonsmooth Analysis (Wiley, New York, 1983).
R. Fletcher,Practical Methods of Optimization, 2nd ed. (Wiley, 1987).
A. Genz and Z. Lin, Fast Givens goes slow in MATLAB, ACM Signum Newsletter 26/2 (April 1991) 11–16.
P. Kall, A. Ruszczyński and K. Frauendorfer, Approximation techniques in stochastic programming, in:Numerical Techniques for Stochastic Programming, eds. Y. Ermoliev and R.J-B. Wets (Springer, Berlin, 1988) pp. 33–64.
A. King, An implementation of the Lagrangian finite generation method, in:Numerical Techniques for Stochastic Programming, eds. Y. Ermoliev and R.J-B. Wets (Springer, Berlin, 1988) pp. 295–312.
J.M. Mulvey and A. Ruszczyński, A new scenario decomposition for large-scale stochastic optimization, Technical Report SOR-91-19, Princeton University, Princeton, NJ, USA (revised 1992).
J.S. Pang, S.P. Han and N. Rangaraj, Minimization of locally Lipschitzian functions, SIAM J. Optim. 1 (1991) 57–82.
J.S. Pang and L. Qi, Nonsmooth equations: Motivations and algorithms, SIAM J. Optim. 3 (1993) 443–465.
J.S. Pang and L. Qi, A globally convergent Newton method for convexSC 1 minimization problems, J. Optim. Theory Appl., to appear.
L. Qi, Convergence analysis of some algorithms for solving nonsmooth equations, Math. Oper. Res. 18 (1993) 227–244.
L. Qi, Superlinearly convergent approximate Newton methods forLC 1 optimization problems, Math. Progr. 64 (1994) 277–294.
R.T. Rockafellar, Linear-quadratic programming and optimal control, SIAM J. Contr. Optim. 25 (1987) 781–814.
R.T. Rockafellar, Computational schemes for solving large-scale problems in extended linear-quadratic programming, Math. Progr. 48 (1990) 447–474.
R.T. Rockafellar, Large-scale extended linear-quadratic programming and multistage optimization, in:Proc. 5th Mexico-US Workshop on Numerical Analysis, eds. S. Gomez, J.P. Hennart and R. Tapia (SIAM, Philadelphia, 1990).
R.T. Rockafellar and R.J-B. Wets, A dual solution procedure for quadratic stochastic programs with simple recourse, in:Numerical Methods, Lecture Notes in Mathematics 1005, ed. A. Reinoza (Springer, Berlin, 1983) pp. 252–265.
R.T. Rockafellar and R.J-B. Wets, A Lagrangian finite-generation technique for solving linear-quadratic problems in stochastic programming, Math. Prog. Study 28 (1986) 63–93.
R.T. Rockafellar and R.J-B. Wets, Linear-quadratic problems with stochastic penalties: the finite generation algorithm, in:Stochastic Optimization, Lecture Notes in Control and Information Sciences 81, eds. V.I. Arkin, A. Shiraev and R.J-B. Wets (Springer, Berlin, 1987) pp. 545–560.
R.T. Rockafellar and R.J-B. Wets, Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time, SIAM J. Contr. Optim. 28 (1990) 810–822.
A. Ruszczyński, A regularized decomposition method for minimizing a sum of polyhedral functions, Math. Progr. 35 (1986) 309–333.
R.J-B. Wets, Stochastic programming: Solution techniques and approximation schemes, in:Mathematical Programming: The State of the Art — Bonn 1982, eds. A. Bachem, M. Grötschel and B. Kort (Springer, Berlin, 1983) pp. 566–603.
R.J-B. Wets, Stochastic programming, in:Handbook in Operations Research and Management Science, Vol. 1:Optimization, eds. G.L. Nemhauser, A.H.G. Rinnooy Kan and M.J. Todd (North-Holland, Amsterdam, 1989) pp. 573–630.
C. Zhu and R.T. Rockafellar, Primal-dual projected gradient algorithms for extended linear-quadratic programming, SIAM J. Optim. 3 (1993) 751–783.
Author information
Authors and Affiliations
Additional information
Supported by the Australian Research Council.
Rights and permissions
About this article
Cite this article
Qi, L., Womersley, R.S. An SQP algorithm for extended linear-quadratic problems in stochastic programming. Ann Oper Res 56, 251–285 (1995). https://doi.org/10.1007/BF02031711
Issue Date:
DOI: https://doi.org/10.1007/BF02031711