Global and uniform convergence of subspace correction methods for some convex optimization problems

Tai, Xue-Cheng; Xu, Jinchao

doi:10.1090/S0025-5718-01-01311-4

Global and uniform convergence of subspace correction methods for some convex optimization problems
HTML articles powered by AMS MathViewer

by Xue-Cheng Tai and Jinchao Xu PDF

Math. Comp. 71 (2002), 105-124 Request permission

Abstract:

This paper gives some global and uniform convergence estimates for a class of subspace correction (based on space decomposition) iterative methods applied to some unconstrained convex optimization problems. Some multigrid and domain decomposition methods are also discussed as special examples for solving some nonlinear elliptic boundary value problems.

References

O. Axelsson and W. Layton, A two-level discretization of nonlinear boundary value problems, SIAM J. Numer. Anal. 33 (1996), no. 6, 2359–2374. MR 1427468, DOI 10.1137/S0036142993247104
Randolph E. Bank and Donald J. Rose, Analysis of a multilevel iterative method for nonlinear finite element equations, Math. Comp. 39 (1982), no. 160, 453–465. MR 669639, DOI 10.1090/S0025-5718-1982-0669639-X
James H. Bramble, Joseph E. Pasciak, Jun Ping Wang, and Jinchao Xu, Convergence estimates for product iterative methods with applications to domain decomposition, Math. Comp. 57 (1991), no. 195, 1–21. MR 1090464, DOI 10.1090/S0025-5718-1991-1090464-8
Xiao-Chuan Cai and Maksymilian Dryja, Domain decomposition methods for monotone nonlinear elliptic problems, Domain decomposition methods in scientific and engineering computing (University Park, PA, 1993) Contemp. Math., vol. 180, Amer. Math. Soc., Providence, RI, 1994, pp. 21–27. MR 1312374, DOI 10.1090/conm/180/01953
Jean Céa, Optimisation: Théorie et algorithmes, Méthodes Mathématiques de l’Informatique, vol. 2, Dunod, Paris, 1971 (French). MR 0298892
T. F. Chan and I. Sharapov. Subspace correction multilevel methods for elliptic eigenvalue problems. In P. Bjørstad, M. Espedal, and D. Keyes, editors, Domain decomposition methods in science and engineering, 9th international conference, Bergen, Norway., pages 311–317. DDM.org, 1998. Available online at http://www.ddm.org/DD9/.
Philippe G. Ciarlet, The finite element method for elliptic problems, Studies in Mathematics and its Applications, Vol. 4, North-Holland Publishing Co., Amsterdam-New York-Oxford, 1978. MR 0520174
P. Deuflhard and M. Weiser. Global inexact Newton multilevel FEM for nonlinear elliptic problems. In W. Hackbusch and G. Wittum, editors, Multigrid methods V, Lecture Notes in Computational Science and Engineering, Stuttgart, 1996, Springer.
Jim Douglas Jr., Todd Dupont, and Lars Wahlbin, The stability in $L^{q}$ of the $L^{2}$-projection into finite element function spaces, Numer. Math. 23 (1974/75), 193–197. MR 383789, DOI 10.1007/BF01400302
M. Dryja and W. Hackbusch, On the nonlinear domain decomposition method, BIT 37 (1997), no. 2, 296–311. MR 1450962, DOI 10.1007/BF02510214
Maksymilian Dryja and Olof B. Widlund, Towards a unified theory of domain decomposition algorithms for elliptic problems, Third International Symposium on Domain Decomposition Methods for Partial Differential Equations (Houston, TX, 1989) SIAM, Philadelphia, PA, 1990, pp. 3–21. MR 1064335
Ivar Ekeland and Roger Temam, Analyse convexe et problèmes variationnels, Collection Études Mathématiques, Dunod, Paris; Gauthier-Villars, Paris-Brussels-Montreal, Que., 1974 (French). MR 0463993
E. Gelman and J. Mandel, On multilevel iterative methods for optimization problems, Math. Programming 48 (1990), no. 1, (Ser. B), 1–17. MR 1049769, DOI 10.1007/BF01582249
R. Glowinski and A. Marrocco, Sur l’approximation, par éléments finis d’ordre un, et la résolution, par pénalisation-dualité, d’une classe de problèmes de Dirichlet non linéaires, Rev. Française Automat. Informat. Recherche Opérationnelle Sér. Rouge Anal. Numér. 9 (1975), no. R-2, 41–76 (French, with English summary). MR 388811
M. Griebel and P. Oswald, On the abstract theory of additive and multiplicative Schwarz algorithms, Numer. Math. 70 (1995), no. 2, 163–180. MR 1324736, DOI 10.1007/s002110050115
W. Hackbusch and A. Reusken, Analysis of a damped nonlinear multilevel method, Numer. Math. 55 (1989), no. 2, 225–246. MR 987387, DOI 10.1007/BF01406516
Ralf Kornhuber, Adaptive monotone multigrid methods for nonlinear variational problems, Advances in Numerical Mathematics, B. G. Teubner, Stuttgart, 1997. MR 1469497
R. Kornhuber. Globally convergent multigrid methods for porous medium type equations. Preprint, 1999.
P.-L. Lions, On the Schwarz alternating method. I, First International Symposium on Domain Decomposition Methods for Partial Differential Equations (Paris, 1987) SIAM, Philadelphia, PA, 1988, pp. 1–42. MR 972510
Jan Mandel, Étude algébrique d’une méthode multigrille pour quelques problèmes de frontière libre, C. R. Acad. Sci. Paris Sér. I Math. 298 (1984), no. 18, 469–472 (French, with English summary). MR 750748
Stephen F. McCormick, Multilevel projection methods for partial differential equations, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 62, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 1992. MR 1146209, DOI 10.1137/1.9781611970098
S. Oualibouch and N. el Mansouri. Proximal domain decomposition algorithms and applications to elliptic problems. In R. Glowinski, J. Periaux, Z-C. Shi, and O. Widlund, editors, Domain decomposition methods in sciences and engineering, 8th international conference, Beijing , China, pages 91–98. Wiley, 1997.
R. Rannacher. On the convergence of the Newton-Raphson method for strongly nonlinear finite element equations. In P. Wriggers and W. Wagner, editors, Nonlinear computational mechanics, pages 11–30. Springer-Verlag, 1991.
Arnold Reusken, Convergence of the multilevel full approximation scheme including the $V$-cycle, Numer. Math. 53 (1988), no. 6, 663–686. MR 955979, DOI 10.1007/BF01397135
Recent advances in matrix theory, University of Wisconsin Press, Madison, Wis., 1964. MR 0164974
I. Sharapov. Multilevel subspace correction for large scale optimization problems. Technical Report CAM-97-31, University of California at Los Angeles, 1997.
Barry F. Smith, Petter E. Bjørstad, and William D. Gropp, Domain decomposition, Cambridge University Press, Cambridge, 1996. Parallel multilevel methods for elliptic partial differential equations. MR 1410757
X.-C. Tai. Parallel function decomposition and space decomposition methods with applications to optimisation, splitting and domain decomposition. Report No. 231–1992, Institut für Mathematik, TechnischeUniversität Graz, 1992. Available online at http://www.mi.uib.no/$\tilde {\;}$tai.
X.-C. Tai. Parallel function and space decomposition methods. In P. Neittaanmäki, editor, Finite element methods, fifty years of the Courant element, Lecture notes in pure and applied mathematics, volume 164, pages 421–432. Marcel Dekker inc., 1994. Available online at http://www.mi.uib.no/$\tilde {\;}$tai.
Xue Cheng Tai, Domain decomposition for linear and nonlinear elliptic problems via function or space decomposition, Domain decomposition methods in scientific and engineering computing (University Park, PA, 1993) Contemp. Math., vol. 180, Amer. Math. Soc., Providence, RI, 1994, pp. 355–360. MR 1312410, DOI 10.1090/conm/180/01992
X.-C. Tai. Parallel function and space decomposition methods – Part I. function decomposition. Beijing Mathematics, 1, part 2:104–134, 1995. Available online at http://www.mi.uib.no/$\tilde {\;}$tai.
X.-C. Tai. Parallel function decomposition and space decomposition methods: Part II. space decomposition. Beijing Mathematics, 1, part 2:135–152, 1995. Available online at http://www.mi.uib.no/$\tilde {\;}$tai.
Xue-Cheng Tai and Magne Espedal, Rate of convergence of some space decomposition methods for linear and nonlinear problems, SIAM J. Numer. Anal. 35 (1998), no. 4, 1558–1570. MR 1626026, DOI 10.1137/S0036142996297461
X.-C. Tai and J. Xu. Global convergence of subspace correction methods for convex optimization problems. Report no. 114, Department of Mathematics, University of Bergen, Norway, 1998. Available online at http://www.mi.uib.no/$\tilde {\;}$tai.
Olof B. Widlund, Some Schwarz methods for symmetric and nonsymmetric elliptic problems, Fifth International Symposium on Domain Decomposition Methods for Partial Differential Equations (Norfolk, VA, 1991) SIAM, Philadelphia, PA, 1992, pp. 19–36. MR 1189560
J. Xu. Theory of Multilevel Methods. PhD thesis, Cornell University, 1989.
Jinchao Xu, Iterative methods by space decomposition and subspace correction, SIAM Rev. 34 (1992), no. 4, 581–613. MR 1193013, DOI 10.1137/1034116
Jinchao Xu, A novel two-grid method for semilinear elliptic equations, SIAM J. Sci. Comput. 15 (1994), no. 1, 231–237. MR 1257166, DOI 10.1137/0915016
Jinchao Xu, Two-grid discretization techniques for linear and nonlinear PDEs, SIAM J. Numer. Anal. 33 (1996), no. 5, 1759–1777. MR 1411848, DOI 10.1137/S0036142992232949
Jun Zou, A new fast solver—monotone MG method (MMG), J. Comput. Math. 5 (1987), no. 4, 325–335. MR 958612