Unmixing diffusion for self-supervised hyperspectral image denoising
- Author
- Haijin Zeng (UGent) , Jiezhang Cao, Kai Zhang, Yongyong Chen, Hiep Luong (UGent) and Wilfried Philips (UGent)
- Organization
- Project
- Abstract
- Hyperspectral images (HSIs) have extensive applications in various fields such as medicine, agriculture, and industry. Nevertheless, acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral filtering. Consequently, the importance of HSI denoising is substantial, especially for snapshot hyperspectral imaging technology. While most previous HSI denoising methods are supervised, creating supervised training datasets for the diverse scenes, hyperspectral cameras, and scan parameters is impractical. In this work, we present DiffUnmix, a self-supervised denoising method for HSI using diffusion denoising generative models. Specifically, Diff-Unmix addresses the challenge of recovering noise-degraded HSI through a fusion of Spectral Unmixing and conditional abundance generation. Firstly, it employs a learnable block-based spectral unmixing strategy, complemented by a pure transformer-based backbone. Then, we introduce a self-supervised generative diffusion network to enhance abundance maps from the spectral unmixing block. This network reconstructs noise-free Unmixing probability distributions, effectively mitigating noise-induced degradations within these components. Finally, the reconstructed HSI is reconstructed through unmixing reconstruction by blending the diffusion-adjusted abundance map with the spectral endmembers. Experimental results on both simulated and real-world noisy datasets show that Diff-Unmix achieves state-of-the-art performance.
- Keywords
- RANK, RECOVERY
Downloads
-
Diff Unmix camera ready.pdf
- full text (Accepted manuscript)
- |
- open access
- |
- |
- 5.05 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01J1A2X2RQYJN1HCZ3ZD6RJAYK
- MLA
- Zeng, Haijin, et al. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, pp. 27820–30, doi:10.1109/CVPR52733.2024.02628.
- APA
- Zeng, H., Cao, J., Zhang, K., Chen, Y., Luong, H., & Philips, W. (2024). Unmixing diffusion for self-supervised hyperspectral image denoising. 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–27830. https://doi.org/10.1109/CVPR52733.2024.02628
- Chicago author-date
- Zeng, Haijin, Jiezhang Cao, Kai Zhang, Yongyong Chen, Hiep Luong, and Wilfried Philips. 2024. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” In 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–30. https://doi.org/10.1109/CVPR52733.2024.02628.
- Chicago author-date (all authors)
- Zeng, Haijin, Jiezhang Cao, Kai Zhang, Yongyong Chen, Hiep Luong, and Wilfried Philips. 2024. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” In 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–27830. doi:10.1109/CVPR52733.2024.02628.
- Vancouver
- 1.Zeng H, Cao J, Zhang K, Chen Y, Luong H, Philips W. Unmixing diffusion for self-supervised hyperspectral image denoising. In: 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR). 2024. p. 27820–30.
- IEEE
- [1]H. Zeng, J. Cao, K. Zhang, Y. Chen, H. Luong, and W. Philips, “Unmixing diffusion for self-supervised hyperspectral image denoising,” in 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), Seattle WA, USA, 2024, pp. 27820–27830.
@inproceedings{01J1A2X2RQYJN1HCZ3ZD6RJAYK,
abstract = {{Hyperspectral images (HSIs) have extensive applications in various fields such as medicine, agriculture, and industry. Nevertheless, acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral filtering. Consequently, the importance of HSI denoising is substantial, especially for snapshot hyperspectral imaging technology. While most previous HSI denoising methods are supervised, creating supervised training datasets for the diverse scenes, hyperspectral cameras, and scan parameters is impractical. In this work, we present DiffUnmix, a self-supervised denoising method for HSI using diffusion denoising generative models. Specifically, Diff-Unmix addresses the challenge of recovering noise-degraded HSI through a fusion of Spectral Unmixing and conditional abundance generation. Firstly, it employs a learnable block-based spectral unmixing strategy, complemented by a pure transformer-based backbone. Then, we introduce a self-supervised generative diffusion network to enhance abundance maps from the spectral unmixing block. This network reconstructs noise-free Unmixing probability distributions, effectively mitigating noise-induced degradations within these components. Finally, the reconstructed HSI is reconstructed through unmixing reconstruction by blending the diffusion-adjusted abundance map with the spectral endmembers. Experimental results on both simulated and real-world noisy datasets show that Diff-Unmix achieves state-of-the-art performance.}},
author = {{Zeng, Haijin and Cao, Jiezhang and Zhang, Kai and Chen, Yongyong and Luong, Hiep and Philips, Wilfried}},
booktitle = {{2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)}},
isbn = {{9798350353013}},
issn = {{1063-6919}},
keywords = {{RANK,RECOVERY}},
language = {{eng}},
location = {{Seattle WA, USA}},
pages = {{27820--27830}},
title = {{Unmixing diffusion for self-supervised hyperspectral image denoising}},
url = {{http://doi.org/10.1109/CVPR52733.2024.02628}},
year = {{2024}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: