Low-rank quaternion tensor completion for color video inpainting via a novel factorization strategy
HTML articles powered by AMS MathViewer
- by Zhenzhi Qin, Zhenyu Ming, Defeng Sun and Liping Zhang;
- Math. Comp. 94 (2025), 2409-2456
- DOI: https://doi.org/10.1090/mcom/4025
- Published electronically: November 1, 2024
- HTML | PDF | Request permission
Abstract:
Recently, a quaternion tensor product named Qt-product was proposed, and then the singular value decomposition and the rank of a third-order quaternion tensor were given. From a more applicable perspective, we extend the Qt-product and propose a novel multiplication principle for third-order quaternion tensor named gQt-product. With the gQt-product, we introduce a brand-new singular value decomposition for third-order quaternion tensors named gQt-SVD and then define gQt-rank and multi-gQt-rank. We prove that the optimal low-rank approximation of a third-order quaternion tensor exists and some numerical experiments demonstrate the low-rankness of color videos. So, we apply the low-rank quaternion tensor completion to color video inpainting problems and present alternating least-square algorithms to solve the proposed low gQt-rank and multi-gQt-rank quaternion tensor completion models. The convergence analyses of the proposed algorithms are established and some numerical experiments on various color video datasets show the high recovery accuracy and computational efficiency of our methods.References
- E. Acar, D. Dunlavy, T. Kolda, and M. Mørup, Scalable tensor factorizations for incomplete data, Chemometrics Intell. Lab. Sys. 106 (2011), no. 1, 41–56.
- Hedy Attouch and Jérôme Bolte, On the convergence of the proximal algorithm for nonsmooth functions involving analytic features, Math. Program. 116 (2009), no. 1-2, Ser. B, 5–16. MR 2421270, DOI 10.1007/s10107-007-0133-5
- Jonathan Barzilai and Jonathan M. Borwein, Two-point step size gradient methods, IMA J. Numer. Anal. 8 (1988), no. 1, 141–148. MR 967848, DOI 10.1093/imanum/8.1.141
- Jérôme Bolte, Aris Daniilidis, and Adrian Lewis, The Łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems, SIAM J. Optim. 17 (2006), no. 4, 1205–1223. MR 2274510, DOI 10.1137/050644641
- Jian-Feng Cai, Emmanuel J. Candès, and Zuowei Shen, A singular value thresholding algorithm for matrix completion, SIAM J. Optim. 20 (2010), no. 4, 1956–1982. MR 2600248, DOI 10.1137/080738970
- J. Carroll and J. Chang, Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition, Psychometrika 35 (1970), no. 3, 283–319.
- Y. Chen, L. Qi, X. Zhang, and Y. Xu, A low rank quaternion decomposition algorithm and its application in color image inpainting, 2020, arXiv:2009.12203.
- Yongyong Chen, Xiaolin Xiao, and Yicong Zhou, Low-rank quaternion approximation for color image processing, IEEE Trans. Image Process. 29 (2020), 1426–1439. MR 4039278, DOI 10.1109/TIP.2019.2941319
- T. Ell, Quaternion-Fourier transforms for analysis of two-dimensional linear time-invariant partial differential systems, Proceedings of 32nd IEEE Conference on Decision and Control, 1993, pp. 1830–1841.
- Todd A. Ell and Stephen J. Sangwine, Hypercomplex Fourier transforms of color images, IEEE Trans. Image Process. 16 (2007), no. 1, 22–35. MR 2460142, DOI 10.1109/TIP.2006.884955
- K. Fukuchi, K. Miyazato, A. Kimura, S. Takagi, and J. Yamato, Saliency-based video segmentation with graph cuts and sequentially updated priors, 2009 IEEE International Conference on Multimedia and Expo, 2009, pp. 638–641.
- Gene H. Golub and Charles F. Van Loan, Matrix computations, 3rd ed., Johns Hopkins Studies in the Mathematical Sciences, Johns Hopkins University Press, Baltimore, MD, 1996. MR 1417720
- Hedy Attouch, Jérôme Bolte, and Benar Fux Svaiter, Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods, Math. Program. 137 (2013), no. 1-2, Ser. A, 91–129. MR 3010421, DOI 10.1007/s10107-011-0484-9
- R. Harshman, Foundations of the parafac procedure: Model and conditions for an “explanatory” multi-mode factor analysis, UCLA Working Papers in Phonetics 16 (1970), 1–84.
- Christopher J. Hillar and Lek-Heng Lim, Most tensor problems are NP-hard, J. ACM 60 (2013), no. 6, Art. 45, 39. MR 3144915, DOI 10.1145/2512329
- Z. Jia, Q. Jin, M. Ng, and X. Zhao, Non-local robust quaternion matrix completion for large-scale color image and video inpainting, IEEE Trans. Image Process. 31 (2022), 3868–3883.
- Zhigang Jia, Michael K. Ng, and Guang-Jing Song, Lanczos method for large-scale quaternion singular value decomposition, Numer. Algorithms 82 (2019), no. 2, 699–717. MR 4003765, DOI 10.1007/s11075-018-0621-0
- Zhigang Jia, Michael K. Ng, and Guang-Jing Song, Robust quaternion matrix completion with applications to image inpainting, Numer. Linear Algebra Appl. 26 (2019), no. 4, e2245, 35. MR 3979957, DOI 10.1002/nla.2245
- Z. Jia and J. Zhu, A new low-rank learning robust quaternion tensor completion method for color video inpainting problem and fast algorithms, Preprint, arXiv:2306.09652, 2023.
- Misha E. Kilmer and Carla D. Martin, Factorization strategies for third-order tensors, Linear Algebra Appl. 435 (2011), no. 3, 641–658. MR 2794595, DOI 10.1016/j.laa.2010.09.020
- J. Liu, M. Przemyslaw, W. Peter, and J. Ye, Tensor completion for estimating missing values in visual data, IEEE Trans. Pattern Anal. Mach. Intell. 35 (2013), no. 1, 208–220.
- Misha E. Kilmer, Karen Braman, Ning Hao, and Randy C. Hoover, Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging, SIAM J. Matrix Anal. Appl. 34 (2013), no. 1, 148–172. MR 3032996, DOI 10.1137/110837711
- J. Nelson, Lecture note: Cs 229r: Algorithms for big data: Leacture 22, 2020, http://people.seas.harvard.edu/~minilek/cs229r/fall15/lec/lec22.pdf.
- Jorge Nocedal and Stephen J. Wright, Numerical optimization, Springer Series in Operations Research, Springer-Verlag, New York, 1999. MR 1713114, DOI 10.1007/b98874
- S. Pei and C. Cheng, A novel block truncation coding of color images using a quaternion-moment-preserving principle, IEEE Trans. Commun. 45 (1997), no. 5, 583–595.
- Liqun Qi, Yannan Chen, Mayank Bakshi, and Xinzhen Zhang, Triple decomposition and tensor recovery of third order tensors, SIAM J. Matrix Anal. Appl. 42 (2021), no. 1, 299–329. MR 4224755, DOI 10.1137/20M1323266
- Zhenzhi Qin, Zhenyu Ming, and Liping Zhang, Singular value decomposition of third order quaternion tensors, Appl. Math. Lett. 123 (2022), Paper No. 107597, 7. MR 4307918, DOI 10.1016/j.aml.2021.107597
- Benjamin Recht, Maryam Fazel, and Pablo A. Parrilo, Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization, SIAM Rev. 52 (2010), no. 3, 471–501. MR 2680543, DOI 10.1137/070697835
- B. Romera-Paredes and M. Pontil, A new convex relaxation for tensor completion, Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2, Curran Associates Inc., 2013, pp. 2967–2975.
- B. Savas and L. Eldén, Handwritten digit classification using higher order singular value decomposition, Pattern Recognit. 40 (2007), no. 3, 993–1003.
- Oguz Semerci, Ning Hao, Misha E. Kilmer, and Eric L. Miller, Tensor-based formulation and nuclear norm regularization for multienergy computed tomography, IEEE Trans. Image Process. 23 (2014), no. 4, 1678–1693. MR 3191324, DOI 10.1109/TIP.2014.2305840
- N. Sidiropoulos, R. Bro, and G. Giannakis, Parallel factor analysis in sensor array processing, IEEE Trans. Signal Process. 48 (2000), no. 8, 2377–2388.
- Zhigang Jia, Michael K. Ng, and Guang-Jing Song, Robust quaternion matrix completion with applications to image inpainting, Numer. Linear Algebra Appl. 26 (2019), no. 4, e2245, 35. MR 3979957, DOI 10.1002/nla.2245
- Özlem N. Subakan and Baba C. Vemuri, A quaternion framework for color image smoothing and segmentation, Int. J. Comput. Vis. 91 (2011), no. 3, 233–250. MR 2764520, DOI 10.1007/s11263-010-0388-9
- Ledyard R. Tucker, Some mathematical notes on three-mode factor analysis, Psychometrika 31 (1966), 279–311. MR 205395, DOI 10.1007/BF02289464
- M. Vasilescu and Terzopoulos D., Multilinear Analysis of Image Ensembles: Tensorfaces, Springer, 2002.
- Zaiwen Wen, Wotao Yin, and Yin Zhang, Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm, Math. Program. Comput. 4 (2012), no. 4, 333–361. MR 3006618, DOI 10.1007/s12532-012-0044-1
- Yangyang Xu, Ruru Hao, Wotao Yin, and Zhixun Su, Parallel matrix factorization for low-rank tensor completion, Inverse Probl. Imaging 9 (2015), no. 2, 601–624. MR 3356574, DOI 10.3934/ipi.2015.9.601
- Lei Yang, Zheng-Hai Huang, Shenglong Hu, and Jiye Han, An iterative algorithm for third-order tensor multi-rank minimization, Comput. Optim. Appl. 63 (2016), no. 1, 169–202. MR 3441348, DOI 10.1007/s10589-015-9769-x
- Anru Zhang, Cross: efficient low-rank tensor completion, Ann. Statist. 47 (2019), no. 2, 936–964. MR 3909956, DOI 10.1214/18-AOS1694
- Fuzhen Zhang, Quaternions and matrices of quaternions, Linear Algebra Appl. 251 (1997), 21–57. MR 1421264, DOI 10.1016/0024-3795(95)00543-9
- Zemin Zhang and Shuchin Aeron, Exact tensor completion using t-SVD, IEEE Trans. Signal Process. 65 (2017), no. 6, 1511–1526. MR 3604692, DOI 10.1109/TSP.2016.2639466
- Z. Zhang, G. Ely, S. Aeron, N. Hao, and M. Kilmer, Novel methods for multilinear data completion and de-noising based on tensor-svd, 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 3842–3849.
- Pan Zhou, Canyi Lu, Zhouchen Lin, and Chao Zhang, Tensor factorization for low-rank tensor completion, IEEE Trans. Image Process. 27 (2018), no. 3, 1152–1163. MR 3747081, DOI 10.1109/TIP.2017.2762595
Bibliographic Information
- Zhenzhi Qin
- Affiliation: Department of Mathematical Sciences,Tsinghua University, New Sciences Building A302, Beijing 100084, People’s Republic of China
- MR Author ID: 1453343
- ORCID: 0000-0001-6756-4108
- Email: qzz19@mails.tsinghua.edu.cn
- Zhenyu Ming
- Affiliation: Theory Lab, Central Research Institute, 2012 Labs, Huawei Technologies Co., Ltd., Hung Hom, Kowloon, Hong Kong
- MR Author ID: 1409142
- Email: mathmzy@163.com
- Defeng Sun
- Affiliation: Department of Applied Mathematics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong
- MR Author ID: 360538
- ORCID: 0000-0003-0481-272X
- Email: defeng.sun@polyu.edu.hk
- Liping Zhang
- Affiliation: Department of Mathematical Sciences, Tsinghua University, New Sciences Building A302, Beijing 100084, People’s Republic of China
- ORCID: 0000-0002-3839-9470
- Email: lipingzhang@mail.tsinghua.edu.cn
- Received by editor(s): April 12, 2023
- Received by editor(s) in revised form: April 30, 2024, and June 30, 2024
- Published electronically: November 1, 2024
- Additional Notes: The third author was supported by the Hong Kong RGC Senior Research Fellow Scheme (No. SRFS22235S02) and the GRF Grant 15307822. The fourth author was supported by the National Nature Science Foundation of China (Grant No. 12171271).
The fourth author is the corresponding author - © Copyright 2024 American Mathematical Society
- Journal: Math. Comp. 94 (2025), 2409-2456
- MSC (2020): Primary 15A69, 65K10, 90C25, 90C26, 90C30
- DOI: https://doi.org/10.1090/mcom/4025