Approximation and regularization of Lipschitz functions: Convergence of the gradients
HTML articles powered by AMS MathViewer
- by Marc-Olivier Czarnecki and Ludovic Rifford PDF
- Trans. Amer. Math. Soc. 358 (2006), 4467-4520 Request permission
Abstract:
We examine the possible extensions to the Lipschitzian setting of the classical result on $C^1$-convergence: first (approximation), if a sequence $(f_n)$ of functions of class $C^1$ from $\mathbb {R}^N$ to $\mathbb {R}$ converges uniformly to a function $f$ of class $C^1$, then the gradient of $f$ is a limit of gradients of $f_n$ in the sense that $\operatorname {graph}(\nabla f)\subset \liminf _{n\to +\infty } \operatorname {graph}(\nabla f_n)$; second (regularization), the functions $(f_n)$ can be chosen to be of class $C^{\infty }$ and $C^1$-converging to $f$ in the sense that $\lim _{n\to +\infty } \|f_n-f\|_{\infty }+ \|\nabla f_n-\nabla f\|_{\infty }=0$. In other words, the space of $C^{\infty }$ functions is dense in the space of $C^1$ functions endowed with the $C^1$ pseudo-norm. We first deepen the properties of Warga’s counterexample (1981) for the extension of the approximation part to the Lipschitzian setting. This part cannot be extended, even if one restricts the approximation schemes to the classical convolution and the Lasry-Lions regularization. We thus make more precise various results in the literature on the convergence of subdifferentials. We then show that the regularization part can be extended to the Lipschitzian setting, namely if $f:\mathbb {R}^N \rightarrow {\mathbb R}$ is a locally Lipschitz function, we build a sequence of smooth functions $(f_n)_{n \in \mathbb {N}}$ such that \begin{eqnarray*} &&\lim _{n\to +\infty } \|f_n-f\|_{\infty }=0,\\ &&\lim _{n\to +\infty } d_{Haus}(\operatorname {graph}(\nabla f_n), \operatorname {graph}(\partial f))=0. \end{eqnarray*} In other words, the space of $C^{\infty }$ functions is dense in the space of locally Lipschitz functions endowed with an appropriate Lipschitz pseudo-distance. Up to now, Rockafellar and Wets (1998) have shown that the convolution procedure permits us to have the equality $\limsup _{n\to +\infty } \operatorname {graph}(\nabla f_n) =\operatorname {graph}(\partial f)$, which cannot provide the exactness of our result. As a consequence, we obtain a similar result on the regularization of epi-Lipschitz sets. With both functional and set parts, we improve previous results in the literature on the regularization of functions and sets.References
- Hédy Attouch, Convergence de fonctions convexes, des sous-différentiels et semi-groupes associés, C. R. Acad. Sci. Paris Sér. A-B 284 (1977), no. 10, A539–A542 (French, with English summary). MR 473929
- H. Attouch, Variational convergence for functions and operators, Applicable Mathematics Series, Pitman (Advanced Publishing Program), Boston, MA, 1984. MR 773850
- Hédy Attouch and Gerald Beer, On the convergence of subdifferentials of convex functions, Arch. Math. (Basel) 60 (1993), no. 4, 389–400. MR 1206324, DOI 10.1007/BF01207197
- Jean-Pierre Aubin and Hélène Frankowska, Set-valued analysis, Systems & Control: Foundations & Applications, vol. 2, Birkhäuser Boston, Inc., Boston, MA, 1990. MR 1048347
- Joël Benoist, Convergence de la dérivée de la régularisée Lasry-Lions, C. R. Acad. Sci. Paris Sér. I Math. 315 (1992), no. 8, 941–944 (French, with English and French summaries). MR 1187139
- J. Benoist, Approximation and regularisation of arbitrary sets in finite dimension, Set-Valued Anal. 2 (1994), no. 1-2, 95–115. Set convergence in nonlinear analysis and optimization. MR 1285823, DOI 10.1007/BF01027095
- Bourbaki, Nicolas, Eléments de mathématique, Hermann, Paris
- Frank H. Clarke, Optimization and nonsmooth analysis, Canadian Mathematical Society Series of Monographs and Advanced Texts, John Wiley & Sons, Inc., New York, 1983. A Wiley-Interscience Publication. MR 709590
- F. H. Clarke, Yu. S. Ledyaev, R. J. Stern, and P. R. Wolenski, Nonsmooth analysis and control theory, Graduate Texts in Mathematics, vol. 178, Springer-Verlag, New York, 1998. MR 1488695
- F. H. Clarke, R. J. Stern, and P. R. Wolenski, Proximal smoothness and the lower-$C^2$ property, J. Convex Anal. 2 (1995), no. 1-2, 117–144. MR 1363364
- Bernard Cornet and Marc-Olivier Czarnecki, Smooth representations of epi-Lipschitzian subsets of $\mathbf R^n$, Nonlinear Anal. 37 (1999), no. 2, Ser. A: Theory Methods, 139–160. MR 1689740, DOI 10.1016/S0362-546X(98)00033-9
- Bernard Cornet and Marc-Olivier Czarnecki, Smooth normal approximations of epi-Lipschitzian subsets of $\textbf {R}^n$, SIAM J. Control Optim. 37 (1999), no. 3, 710–730. MR 1675157, DOI 10.1137/S0363012997320122
- Bernard Cornet and Marc-Olivier Czarnecki, Existence of (generalized) equilibria: necessary and sufficient conditions, Comm. Appl. Nonlinear Anal. 7 (2000), no. 1, 21–53. MR 1733400
- Bernard Cornet and Marc-Olivier Czarnecki, Existence of generalized equilibria, Nonlinear Anal. 44 (2001), no. 5, Ser. A: Theory Methods, 555–574. MR 1822230, DOI 10.1016/S0362-546X(99)00198-4
- Cornet, Bernard and Czarnecki, Marc-Olivier, Smoothing the distance function to a closed subset of $\mathbb {R}^{n}$ and applications, manuscript (1998)
- Czarnecki, Marc-Olivier, thèse de doctorat, Université Paris 1 Panthéon Sorbonne, 1996
- Herbert Federer, Curvature measures, Trans. Amer. Math. Soc. 93 (1959), 418–491. MR 110078, DOI 10.1090/S0002-9947-1959-0110078-1
- Pando Gr. Georgiev and Nadia P. Zlateva, Reconstruction of the Clarke subdifferential by the Lasry-Lions regularizations, J. Math. Anal. Appl. 248 (2000), no. 2, 415–428. MR 1775860, DOI 10.1006/jmaa.2000.6916
- A. D. Ioffe, Approximate subdifferentials and applications. I. The finite-dimensional theory, Trans. Amer. Math. Soc. 281 (1984), no. 1, 389–416. MR 719677, DOI 10.1090/S0002-9947-1984-0719677-1
- A. Jourani, Limit superior of subdifferentials of uniformly convergent functions, Positivity 3 (1999), no. 1, 33–47. MR 1675463, DOI 10.1023/A:1009740914637
- Kruger, A. Ya. and Mordukhovich, Boris. S., Generalized normals and derivatives, and necessary optimality conditions in nondifferentiable programming (in Russian), Depon. VINITI 494-80, Moscow, 1980
- Casimir Kuratowski, Topologie. Vol. II, Monografie Matematyczne, Tom XXI, Polskie Towarzystwo Matematyczne, Warszawa, 1952 (French). 2ème éd. MR 0054232
- J.-M. Lasry and P.-L. Lions, A remark on regularization in Hilbert spaces, Israel J. Math. 55 (1986), no. 3, 257–266. MR 876394, DOI 10.1007/BF02765025
- Gérard Lebourg, Sous-dérivabilité de fonctions semi-continues et convergence de dérivées: quelques résultats en densité, C. R. Acad. Sci. Paris Sér. A-B 288 (1979), no. 16, A753–A755 (French, with English summary). MR 535804
- A. B. Levy, R. Poliquin, and L. Thibault, Partial extensions of Attouch’s theorem with applications to proto-derivatives of subgradient mappings, Trans. Amer. Math. Soc. 347 (1995), no. 4, 1269–1294. MR 1290725, DOI 10.1090/S0002-9947-1995-1290725-3
- B. Sh. Mordukhovich, Maximum principle in the problem of time optimal response with nonsmooth constraints, Prikl. Mat. Meh. 40 (1976), no. 6, 1014–1023 (Russian); English transl., J. Appl. Math. Mech. 40 (1976), no. 6, 960–969 (1977). MR 0487669, DOI 10.1016/0021-8928(76)90136-2
- B. Sh. Mordukhovich, Metody approksimatsiĭ v zadachakh optimizatsii i upravleniya, “Nauka”, Moscow, 1988 (Russian). MR 945143
- Sławomir Plaskacz, On the solution sets for differential inclusions, Boll. Un. Mat. Ital. A (7) 6 (1992), no. 3, 387–394 (English, with Italian summary). MR 1196133
- René A. Poliquin, An extension of Attouch’s theorem and its application to second-order epi-differentiation of convexly composite functions, Trans. Amer. Math. Soc. 332 (1992), no. 2, 861–874. MR 1145732, DOI 10.1090/S0002-9947-1992-1145732-5
- R. A. Poliquin and R. T. Rockafellar, Prox-regular functions in variational analysis, Trans. Amer. Math. Soc. 348 (1996), no. 5, 1805–1838. MR 1333397, DOI 10.1090/S0002-9947-96-01544-9
- R. A. Poliquin, R. T. Rockafellar, and L. Thibault, Local differentiability of distance functions, Trans. Amer. Math. Soc. 352 (2000), no. 11, 5231–5249. MR 1694378, DOI 10.1090/S0002-9947-00-02550-2
- Hans Rademacher, Über partielle und totale differenzierbarkeit von Funktionen mehrerer Variabeln und über die Transformation der Doppelintegrale, Math. Ann. 79 (1919), no. 4, 340–359 (German). MR 1511935, DOI 10.1007/BF01498415
- R. T. Rockafellar, Clarke’s tangent cones and the boundaries of closed sets in $\textbf {R}^{n}$, Nonlinear Anal. 3 (1979), no. 1, 145–154 (1978). MR 520481, DOI 10.1016/0362-546X(79)90044-0
- R. T. Rockafellar, Proximal subgradients, marginal values, and augmented Lagrangians in nonconvex optimization, Math. Oper. Res. 6 (1981), no. 3, 424–436. MR 629642, DOI 10.1287/moor.6.3.424
- R. Tyrrell Rockafellar and Roger J.-B. Wets, Variational analysis, Grundlehren der mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 317, Springer-Verlag, Berlin, 1998. MR 1491362, DOI 10.1007/978-3-642-02431-3
- Andreĭ I. Subbotin, Generalized solutions of first-order PDEs, Systems & Control: Foundations & Applications, Birkhäuser Boston, Inc., Boston, MA, 1995. The dynamical optimization perspective; Translated from the Russian. MR 1320507, DOI 10.1007/978-1-4612-0847-1
- J. Warga, Fat homeomorphisms and unbounded derivate containers, J. Math. Anal. Appl. 81 (1981), no. 2, 545–560. MR 622836, DOI 10.1016/0022-247X(81)90081-0
- Tullio Zolezzi, Convergence of generalized gradients, Set-Valued Anal. 2 (1994), no. 1-2, 381–393. Set convergence in nonlinear analysis and optimization. MR 1285841, DOI 10.1007/BF01027113
Additional Information
- Marc-Olivier Czarnecki
- Affiliation: Institut de Mathematiques et Modelisation de Montpellier UMR 5030 CNRS, Université Montpellier 2, place Eugène Bataillon, 34095 Montpellier Cedex 5, France
- Email: marco@math.univ-montp2.fr
- Ludovic Rifford
- Affiliation: Institut Girard Desargues, Université Claude Bernard Lyon I, 43 Bd du 11 Novembre 1918, 69622 Villeurbanne Cedex, France
- Address at time of publication: Departement de Mathématiques (Bâtiment 425), Université de Paris-Sud, 91405 Orsay, France
- Email: rifford@igd.univ-lyon1.fr, Ludovic.Rifford@math.u-psud.fr
- Received by editor(s): January 28, 2003
- Received by editor(s) in revised form: August 28, 2004
- Published electronically: May 9, 2006
- © Copyright 2006 American Mathematical Society
- Journal: Trans. Amer. Math. Soc. 358 (2006), 4467-4520
- MSC (2000): Primary 49J45, 49J52, 57R12
- DOI: https://doi.org/10.1090/S0002-9947-06-04103-1
- MathSciNet review: 2231385