Advanced search
1 file | 500.94 KB

Real time demosaicking and superresolution of multispectral images

Ljubomir Jovanov (UGent) and Wilfried Philips (UGent)
Author
Organization
Abstract
The human visual system registers electromagnetic waves lying in a 390 to 700 nm wavelength range. While visible light provides humans with sufficient guidance for everyday activities, a large amount of information remains unregistered. However, electromagnetic radiation outside the visible range can be registered using cameras and sensors. Due to the multiplexing of visible light and additional wavelengths, the resolution drops significantly. To improve the resolution, we propose a GPU based joint method for demosaicking, denoising and superresolution. In order to interpolate missing pixel values for all four wavelengths, we first extract high pass image features from all types of pixels in the mosaic. Using this information we perform directional interpolation, to preserve continuities of edges present in all four component images. After the initial interpolation, we introduce high spatial content from other frequency bands, giving preference to original over the interpolated edges. Moreover, we perform the refinement and upsampling of the demosaicked image by introducing information from previous frames. Motion compensation relies on a subpixel block-based motion estimation algorithm, relying on all 4 chromatic bands, and performs regularization to reduce estimation errors and related artifacts in the interpolated images. We perform experiments using the mosaic consisting of red, green, blue and near-infrared pixels (850nm). The proposed algorithm is implemented on Jetson TX 2 platform, achieving 120 fps at QVGA resolution. It operates recursively, requiring only one additional frame buffer for the previous results. The results of the proposed method compared favorably to the state-of-the-art multispectral demosaicing methods.
Keywords
multispectral images, denoising, demosaicking, super resolution

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 500.94 KB

Citation

Please use this url to cite or link to this publication:

Chicago
Jovanov, Ljubomir, and Wilfried Philips. 2018. “Real Time Demosaicking and Superresolution of Multispectral Images.” In REAL-TIME IMAGE AND VIDEO PROCESSING 2018. Vol. 10670. Bellingham: Spie-int Soc Optical Engineering.
APA
Jovanov, L., & Philips, W. (2018). Real time demosaicking and superresolution of multispectral images. REAL-TIME IMAGE AND VIDEO PROCESSING 2018 (Vol. 10670). Presented at the Conference on Real-Time Image and Video Processing, Bellingham: Spie-int Soc Optical Engineering.
Vancouver
1.
Jovanov L, Philips W. Real time demosaicking and superresolution of multispectral images. REAL-TIME IMAGE AND VIDEO PROCESSING 2018. Bellingham: Spie-int Soc Optical Engineering; 2018.
MLA
Jovanov, Ljubomir, and Wilfried Philips. “Real Time Demosaicking and Superresolution of Multispectral Images.” REAL-TIME IMAGE AND VIDEO PROCESSING 2018. Vol. 10670. Bellingham: Spie-int Soc Optical Engineering, 2018. Print.
@inproceedings{8591682,
  abstract     = {The human visual system registers electromagnetic waves lying in a 390 to 700 nm wavelength range. While visible light provides humans with sufficient guidance for everyday activities, a large amount of information remains unregistered. However, electromagnetic radiation outside the visible range can be registered using cameras and sensors. Due to the multiplexing of visible light and additional wavelengths, the resolution drops significantly. To improve the resolution, we propose a GPU based joint method for demosaicking, denoising and superresolution. In order to interpolate missing pixel values for all four wavelengths, we first extract high pass image features from all types of pixels in the mosaic. Using this information we perform directional interpolation, to preserve continuities of edges present in all four component images. After the initial interpolation, we introduce high spatial content from other frequency bands, giving preference to original over the interpolated edges. Moreover, we perform the refinement and upsampling of the demosaicked image by introducing information from previous frames. Motion compensation relies on a subpixel block-based motion estimation algorithm, relying on all 4 chromatic bands, and performs regularization to reduce estimation errors and related artifacts in the interpolated images. We perform experiments using the mosaic consisting of red, green, blue and near-infrared pixels (850nm). The proposed algorithm is implemented on Jetson TX 2 platform, achieving 120 fps at QVGA resolution. It operates recursively, requiring only one additional frame buffer for the previous results. The results of the proposed method compared favorably to the state-of-the-art multispectral demosaicing methods.},
  articleno    = {UNSP 1067006},
  author       = {Jovanov, Ljubomir and Philips, Wilfried},
  booktitle    = {REAL-TIME IMAGE AND VIDEO PROCESSING 2018},
  isbn         = {9781510618527},
  issn         = {0277-786X},
  language     = {eng},
  location     = {Orlando, FL},
  pages        = {9},
  publisher    = {Spie-int Soc Optical Engineering},
  title        = {Real time demosaicking and superresolution of multispectral images},
  url          = {http://dx.doi.org/10.1117/12.2307830},
  volume       = {10670},
  year         = {2018},
}

Altmetric
View in Altmetric
Web of Science
Times cited: