Isotropic non-Lipschitz regularization for sparse representations of random fields on the sphere

Li, Chao; Chen, Xiaojun

doi:10.1090/mcom/3655

Isotropic non-Lipschitz regularization for sparse representations of random fields on the sphere
HTML articles powered by AMS MathViewer

by Chao Li and Xiaojun Chen HTML | PDF

Math. Comp. 91 (2022), 219-243 Request permission

Abstract:

In this paper, we consider an infinite-dimensional isotropic non-Lipschitz optimization problem with $\ell _{2,p}$ ($0<p<1$) regularizer for random fields on the unit sphere with spherical harmonic representations. The regularizer not only gives a group sparse solution, but also preserves the isotropy of the regularized random field represented by the solution. We present first order and second order necessary optimality conditions for local minimizers of the optimization problem. We also derive two lower bounds for the nonzero groups of stationary points, which are used to prove that the infinite-dimensional optimization problem can be reduced to a finite-dimensional problem. Moreover, we propose an iteratively reweighted algorithm for the finite-dimensional problem and prove its convergence. Finally, numerical experiments on Cosmic Microwave Background data are presented to show the efficiency of the non-Lipschitz regularization.

References

R. Adam, et al., Planck 2015 results. I. Overview of products and scientific results, Astron. Astrophys. 594 (2016), no. A1.
R. Adam, et al., Planck 2015 results. IX. Diffuse component separation: CMB maps, Astron. Astrophys. 594 (2016), no. A9.
P. A. R. Ade, et al., Planck 2015 results. XVI. Isotropy and statistics of the CMB, Astron. Astrophys. 594 (2016), no. A16.
Y. Akrami, et al., Planck 2018 results. IV. Diffuse component separation, arXiv:1807.06208, 2018.
D. H. Brandwood, A complex gradient operator and its application in adaptive array theory, Proc. IEE-H 130 (1983), no. 1, 11–16. MR 698589, DOI 10.1049/ip-h-1.1983.0004
Valentina Cammarota and Domenico Marinucci, The stochastic properties of $\ell ^1$-regularized spherical Gaussian fields, Appl. Comput. Harmon. Anal. 38 (2015), no. 2, 262–283. MR 3303675, DOI 10.1016/j.acha.2014.04.003
J. F. Cardoso, M. Le Jeune, J. Delabrouille, M. Betoule, G. Patanchon, Component separation with flexible models-application to multichannel astrophysical observations, IEEE J. Sel. Top. Signal Process. 2 (2008), 735–746.
Xiaojun Chen, Dongdong Ge, Zizhuo Wang, and Yinyu Ye, Complexity of unconstrained $L_2$-$L_p$ minimization, Math. Program. 143 (2014), no. 1-2, Ser. A, 371–383. MR 3152074, DOI 10.1007/s10107-012-0613-0
Xiaojun Chen and Robert S. Womersley, Spherical designs and nonconvex minimization for recovery of sparse signals on the sphere, SIAM J. Imaging Sci. 11 (2018), no. 2, 1390–1415. MR 3805845, DOI 10.1137/17M1147378
Xiaojun Chen, Fengmin Xu, and Yinyu Ye, Lower bound theory of nonzero entries in solutions of $\ell _2$-$\ell _p$ minimization, SIAM J. Sci. Comput. 32 (2010), no. 5, 2832–2852. MR 2735983, DOI 10.1137/090761471
Xiaojun Chen and Weijun Zhou, Convergence of the reweighted $\ell _1$ minimization algorithm for $\ell _2$-$\ell _p$ minimization, Comput. Optim. Appl. 59 (2014), no. 1-2, 47–61. MR 3253732, DOI 10.1007/s10589-013-9553-8
Quoc Thong Le Gia, Ian H. Sloan, Robert S. Womersley, and Yu Guang Wang, Isotropic sparse regularization for spherical harmonic representations of random fields on the sphere, Appl. Comput. Harmon. Anal. 49 (2020), no. 1, 257–278. MR 4091198, DOI 10.1016/j.acha.2019.01.005
K. M. Górski, E. Hivon, A. J. Banday, B. D. Wandelt, F. K. Hansen, M. Reinecke, and M. Bartelmann, HEALPix: a framework for gigh-resolution discretization and fast analysis of data distributed on the sphere, Astrophys. J. 622 (2015), 759–771.
K. Kreutz-Delgado, The complex gradient operator and the CR-calculus, preprint, arXiv:0906.4835v1, 2009.
Zhaosong Lu, Iterative reweighted minimization methods for $l_p$ regularized unconstrained nonlinear programming, Math. Program. 147 (2014), no. 1-2, Ser. A, 277–307. MR 3258526, DOI 10.1007/s10107-013-0722-4
Ming-Jun Lai and Jingyue Wang, An unconstrained $\ell _q$ minimization with $0<q\leq 1$ for sparse solution of underdetermined linear systems, SIAM J. Optim. 21 (2011), no. 1, 82–101. MR 2765490, DOI 10.1137/090775397
Ming-Jun Lai, Yangyang Xu, and Wotao Yin, Improved iteratively reweighted least squares for unconstrained smoothed $\ell _q$ minimization, SIAM J. Numer. Anal. 51 (2013), no. 2, 927–957. MR 3033038, DOI 10.1137/110840364
Domenico Marinucci and Giovanni Peccati, Random fields on the sphere, London Mathematical Society Lecture Note Series, vol. 389, Cambridge University Press, Cambridge, 2011. Representation, limit theorems and cosmological applications. MR 2840154, DOI 10.1017/CBO9780511751677
Tongyao Pang, Qingna Li, Zaiwen Wen, and Zuowei Shen, Phase retrieval: a data-driven wavelet frame based approach, Appl. Comput. Harmon. Anal. 49 (2020), no. 3, 971–1000. MR 4135428, DOI 10.1016/j.acha.2019.05.004
J. L. Starck, D. Donoho, M. Fadili, and A. Rassat, Sparsity and the bayesian perspective, Astron. Astrophys. 552 (2013), no. A133.
Jean-Luc Starck, Fionn Murtagh, and Jalal M. Fadili, Sparse image and signal processing, Cambridge University Press, Cambridge, 2010. Wavelets, curvelets, morphological diversity. MR 2643260, DOI 10.1017/CBO9780511730344
H. Zhang, A. Milzarek, Z, Wen, and W. Yin, On the geometric analysis of a quartic-quadratic optimization problem under a spherical constraint, arXiv:1908.00745, 2019.