
Learnable spatial-spectral transform-based tensor nuclear norm for multi-dimensional visual data recovery
- Author
- Sheng Liu, Jinsong Leng, Xi-Le Zhao, Haijin Zeng (UGent) , Yao Wang and Jing-Hua Yang
- Organization
- Abstract
- Recently, transform-based tensor nuclear norm (TNN) methods have received increasing attention as a powerful tool for multi-dimensional visual data (color images, videos, and multispectral images, etc.) recovery. Especially, the redundant transform-based TNN achieves satisfactory recovery results, where the redundant transform along spectral mode can remarkably enhance the low-rankness of tensors. However, it suffers from expensive computational cost induced by the redundant transform. In this paper, we propose a learnable spatial-spectral transform-based TNN model for multi-dimensional visual data recovery, which not only enjoys better low-rankness capability but also allows us to design fast algorithms accompanying it. More specifically, we first project the large-scale original tensor to the small-scale intrinsic tensor via the learnable semi-orthogonal transforms along the spatial modes. Here, the semi-orthogonal transforms, serving as the key building block, can boost the spatial low-rankness and lead to a small-scale problem, which paves the way for designing fast algorithms. Secondly, to further boost the low-rankness, we apply the learnable redundant transform along the spectral mode to the small-scale intrinsic tensor. To tackle the proposed model, we apply an efficient proximal alternating minimization-based algorithm, which enjoys a theoretical convergence guarantee. Extensive experimental results on real-world data (color images, videos, and multispectral images) demonstrate that the proposed method outperforms state-of-the-art competitors in terms of evaluation metrics and running time.
- Keywords
- Tensor completion, semi-orthogonal transform, redundant transform, tensor nuclear norm, proximal alternating minimization algorithm, RANK, REPRESENTATION, DEEP, MINIMIZATION
Downloads
-
Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery.pdf
- full text (Accepted manuscript)
- |
- open access
- |
- |
- 46.54 MB
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 9.09 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01HMEEX27JPVPX8P2A5BP65K42
- MLA
- Liu, Sheng, et al. “Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery.” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, vol. 34, no. 5, 2024, pp. 3633–46, doi:10.1109/tcsvt.2023.3316279.
- APA
- Liu, S., Leng, J., Zhao, X.-L., Zeng, H., Wang, Y., & Yang, J.-H. (2024). Learnable spatial-spectral transform-based tensor nuclear norm for multi-dimensional visual data recovery. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 34(5), 3633–3646. https://doi.org/10.1109/tcsvt.2023.3316279
- Chicago author-date
- Liu, Sheng, Jinsong Leng, Xi-Le Zhao, Haijin Zeng, Yao Wang, and Jing-Hua Yang. 2024. “Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery.” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 34 (5): 3633–46. https://doi.org/10.1109/tcsvt.2023.3316279.
- Chicago author-date (all authors)
- Liu, Sheng, Jinsong Leng, Xi-Le Zhao, Haijin Zeng, Yao Wang, and Jing-Hua Yang. 2024. “Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery.” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 34 (5): 3633–3646. doi:10.1109/tcsvt.2023.3316279.
- Vancouver
- 1.Liu S, Leng J, Zhao X-L, Zeng H, Wang Y, Yang J-H. Learnable spatial-spectral transform-based tensor nuclear norm for multi-dimensional visual data recovery. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY. 2024;34(5):3633–46.
- IEEE
- [1]S. Liu, J. Leng, X.-L. Zhao, H. Zeng, Y. Wang, and J.-H. Yang, “Learnable spatial-spectral transform-based tensor nuclear norm for multi-dimensional visual data recovery,” IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, vol. 34, no. 5, pp. 3633–3646, 2024.
@article{01HMEEX27JPVPX8P2A5BP65K42, abstract = {{Recently, transform-based tensor nuclear norm (TNN) methods have received increasing attention as a powerful tool for multi-dimensional visual data (color images, videos, and multispectral images, etc.) recovery. Especially, the redundant transform-based TNN achieves satisfactory recovery results, where the redundant transform along spectral mode can remarkably enhance the low-rankness of tensors. However, it suffers from expensive computational cost induced by the redundant transform. In this paper, we propose a learnable spatial-spectral transform-based TNN model for multi-dimensional visual data recovery, which not only enjoys better low-rankness capability but also allows us to design fast algorithms accompanying it. More specifically, we first project the large-scale original tensor to the small-scale intrinsic tensor via the learnable semi-orthogonal transforms along the spatial modes. Here, the semi-orthogonal transforms, serving as the key building block, can boost the spatial low-rankness and lead to a small-scale problem, which paves the way for designing fast algorithms. Secondly, to further boost the low-rankness, we apply the learnable redundant transform along the spectral mode to the small-scale intrinsic tensor. To tackle the proposed model, we apply an efficient proximal alternating minimization-based algorithm, which enjoys a theoretical convergence guarantee. Extensive experimental results on real-world data (color images, videos, and multispectral images) demonstrate that the proposed method outperforms state-of-the-art competitors in terms of evaluation metrics and running time.}}, author = {{Liu, Sheng and Leng, Jinsong and Zhao, Xi-Le and Zeng, Haijin and Wang, Yao and Yang, Jing-Hua}}, issn = {{1051-8215}}, journal = {{IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY}}, keywords = {{Tensor completion,semi-orthogonal transform,redundant transform,tensor nuclear norm,proximal alternating minimization algorithm,RANK,REPRESENTATION,DEEP,MINIMIZATION}}, language = {{eng}}, number = {{5}}, pages = {{3633--3646}}, title = {{Learnable spatial-spectral transform-based tensor nuclear norm for multi-dimensional visual data recovery}}, url = {{http://doi.org/10.1109/tcsvt.2023.3316279}}, volume = {{34}}, year = {{2024}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: