Advanced search
1 file | 5.05 MB Add to list
Author
Organization
Project
Abstract
Hyperspectral images (HSIs) have extensive applications in various fields such as medicine, agriculture, and industry. Nevertheless, acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral filtering. Consequently, the importance of HSI denoising is substantial, especially for snapshot hyperspectral imaging technology. While most previous HSI denoising methods are supervised, creating supervised training datasets for the diverse scenes, hyperspectral cameras, and scan parameters is impractical. In this work, we present DiffUnmix, a self-supervised denoising method for HSI using diffusion denoising generative models. Specifically, Diff-Unmix addresses the challenge of recovering noise-degraded HSI through a fusion of Spectral Unmixing and conditional abundance generation. Firstly, it employs a learnable block-based spectral unmixing strategy, complemented by a pure transformer-based backbone. Then, we introduce a self-supervised generative diffusion network to enhance abundance maps from the spectral unmixing block. This network reconstructs noise-free Unmixing probability distributions, effectively mitigating noise-induced degradations within these components. Finally, the reconstructed HSI is reconstructed through unmixing reconstruction by blending the diffusion-adjusted abundance map with the spectral endmembers. Experimental results on both simulated and real-world noisy datasets show that Diff-Unmix achieves state-of-the-art performance.
Keywords
RANK, RECOVERY

Downloads

  • Diff Unmix camera ready.pdf
    • full text (Accepted manuscript)
    • |
    • open access
    • |
    • PDF
    • |
    • 5.05 MB

Citation

Please use this url to cite or link to this publication:

MLA
Zeng, Haijin, et al. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, pp. 27820–30, doi:10.1109/CVPR52733.2024.02628.
APA
Zeng, H., Cao, J., Zhang, K., Chen, Y., Luong, H., & Philips, W. (2024). Unmixing diffusion for self-supervised hyperspectral image denoising. 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–27830. https://doi.org/10.1109/CVPR52733.2024.02628
Chicago author-date
Zeng, Haijin, Jiezhang Cao, Kai Zhang, Yongyong Chen, Hiep Luong, and Wilfried Philips. 2024. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” In 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–30. https://doi.org/10.1109/CVPR52733.2024.02628.
Chicago author-date (all authors)
Zeng, Haijin, Jiezhang Cao, Kai Zhang, Yongyong Chen, Hiep Luong, and Wilfried Philips. 2024. “Unmixing Diffusion for Self-Supervised Hyperspectral Image Denoising.” In 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 27820–27830. doi:10.1109/CVPR52733.2024.02628.
Vancouver
1.
Zeng H, Cao J, Zhang K, Chen Y, Luong H, Philips W. Unmixing diffusion for self-supervised hyperspectral image denoising. In: 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR). 2024. p. 27820–30.
IEEE
[1]
H. Zeng, J. Cao, K. Zhang, Y. Chen, H. Luong, and W. Philips, “Unmixing diffusion for self-supervised hyperspectral image denoising,” in 2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), Seattle WA, USA, 2024, pp. 27820–27830.
@inproceedings{01J1A2X2RQYJN1HCZ3ZD6RJAYK,
  abstract     = {{Hyperspectral images (HSIs) have extensive applications in various fields such as medicine, agriculture, and industry. Nevertheless, acquiring high signal-to-noise ratio HSI poses a challenge due to narrow-band spectral filtering. Consequently, the importance of HSI denoising is substantial, especially for snapshot hyperspectral imaging technology. While most previous HSI denoising methods are supervised, creating supervised training datasets for the diverse scenes, hyperspectral cameras, and scan parameters is impractical. In this work, we present DiffUnmix, a self-supervised denoising method for HSI using diffusion denoising generative models. Specifically, Diff-Unmix addresses the challenge of recovering noise-degraded HSI through a fusion of Spectral Unmixing and conditional abundance generation. Firstly, it employs a learnable block-based spectral unmixing strategy, complemented by a pure transformer-based backbone. Then, we introduce a self-supervised generative diffusion network to enhance abundance maps from the spectral unmixing block. This network reconstructs noise-free Unmixing probability distributions, effectively mitigating noise-induced degradations within these components. Finally, the reconstructed HSI is reconstructed through unmixing reconstruction by blending the diffusion-adjusted abundance map with the spectral endmembers. Experimental results on both simulated and real-world noisy datasets show that Diff-Unmix achieves state-of-the-art performance.}},
  author       = {{Zeng, Haijin and Cao, Jiezhang and Zhang, Kai and Chen, Yongyong and Luong, Hiep and Philips, Wilfried}},
  booktitle    = {{2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)}},
  isbn         = {{9798350353013}},
  issn         = {{1063-6919}},
  keywords     = {{RANK,RECOVERY}},
  language     = {{eng}},
  location     = {{Seattle WA, USA}},
  pages        = {{27820--27830}},
  title        = {{Unmixing diffusion for self-supervised hyperspectral image denoising}},
  url          = {{http://doi.org/10.1109/CVPR52733.2024.02628}},
  year         = {{2024}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: