Advanced search
1 file | 834.93 KB

Real-time spatially adaptive deconvolution for CFA images

Ljubomir Jovanov (UGent) and Wilfried Philips (UGent)
Author
Organization
Abstract
In numerous applications, such as surveillance, industrial inspection, medical imaging and security, high resolution is of crucial importance for the performance of the computer vision systems. Besides spatial resolution, high frame rate is also of high importance in these applications. While the resolution of CMOS imaging sensors is following Moores law, for optics it is becoming increasingly challenging to follow such a development. In order to follow the pixel size reduction, lenses have to be constructed with much more precision, while the physical size increases dramatically. Moreover, expertise needed to construct a lens of sufficient quality is available at a very few locations in the world. The use of lower quality lenses with high resolution imaging sensors, lead to numerous artifacts. Due to the different light refraction indexes for different wavelengths, primary color components do not reach their targeted pixels in the sensor plane, which causes lateral chromatic aberration artifacts. These artifacts manifest as false colors in high contrast regions around the edges. Moreover, due to the variable refraction indexes, light rays do not focus on the imaging sensor plain, but in front or behind it, which leads to blur due to the axial aberration. Due to the increased resolution, the size of the pixel is significantly reduced, which reduces the amount of light it receives. As a consequence, the amount of noise increases dramatically. The amount of noise further increases due to the high frame rate and therefore shorter exposure times. In order to reduce the complexity and the price, most cameras today are built using one imaging sensor with spatial color multiplexing filter arrays. This way, camera manufacturers avoid using three imaging sensors and beam splitters, which significantly reduces the price of the system. Since not all color components are present at each pixel location it is necessary to interpolate them, i.e. to perform demosaicking. In the presence of lateral chromatic aberration, this task becomes more complex, since many pixels in the CFA do not receive a proper color, which creates occlusions which in turn create additional artifacts after demosaicing. To prevent this type of artifacts, occlusion inpainting has to be performed. In this paper we propose a new method for simultaneous correction of all artifacts mentioned above. We define operators representing spatially variable blur, subsampling and noise applied to the unknown artifacts free image, and perform reconstruction of the artifacts free image. First we perform lens calibration step in order to acquire the lens point spread (PSF) function at each pixel in the image using point source. Once we obtained PSFs we perform joint deconvolution using variable kernels obtained from the previous step.
Keywords
chromatic aberration, denoising, demosaicking

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 834.93 KB

Citation

Please use this url to cite or link to this publication:

Chicago
Jovanov, Ljubomir, and Wilfried Philips. 2018. “Real-time Spatially Adaptive Deconvolution for CFA Images.” In Optics, Photonics, and Digital Technologies for Imaging Applications V. Vol. 10679. Bellingham: Spie-int Soc Optical Engineering.
APA
Jovanov, L., & Philips, W. (2018). Real-time spatially adaptive deconvolution for CFA images. OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS V (Vol. 10679). Presented at the Conference on Optics, Photonics, and Digital Technologies for Imaging Applications V, Bellingham: Spie-int Soc Optical Engineering.
Vancouver
1.
Jovanov L, Philips W. Real-time spatially adaptive deconvolution for CFA images. OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS V. Bellingham: Spie-int Soc Optical Engineering; 2018.
MLA
Jovanov, Ljubomir, and Wilfried Philips. “Real-time Spatially Adaptive Deconvolution for CFA Images.” Optics, Photonics, and Digital Technologies for Imaging Applications V. Vol. 10679. Bellingham: Spie-int Soc Optical Engineering, 2018. Print.
@inproceedings{8591683,
  abstract     = {In numerous applications, such as surveillance, industrial inspection, medical imaging and security, high resolution is of crucial importance for the performance of the computer vision systems. Besides spatial resolution, high frame rate is also of high importance in these applications. While the resolution of CMOS imaging sensors is following Moores law, for optics it is becoming increasingly challenging to follow such a development. In order to follow the pixel size reduction, lenses have to be constructed with much more precision, while the physical size increases dramatically. Moreover, expertise needed to construct a lens of sufficient quality is available at a very few locations in the world. The use of lower quality lenses with high resolution imaging sensors, lead to numerous artifacts. Due to the different light refraction indexes for different wavelengths, primary color components do not reach their targeted pixels in the sensor plane, which causes lateral chromatic aberration artifacts. These artifacts manifest as false colors in high contrast regions around the edges. Moreover, due to the variable refraction indexes, light rays do not focus on the imaging sensor plain, but in front or behind it, which leads to blur due to the axial aberration. Due to the increased resolution, the size of the pixel is significantly reduced, which reduces the amount of light it receives. As a consequence, the amount of noise increases dramatically. The amount of noise further increases due to the high frame rate and therefore shorter exposure times. In order to reduce the complexity and the price, most cameras today are built using one imaging sensor with spatial color multiplexing filter arrays. This way, camera manufacturers avoid using three imaging sensors and beam splitters, which significantly reduces the price of the system. Since not all color components are present at each pixel location it is necessary to interpolate them, i.e. to perform demosaicking. In the presence of lateral chromatic aberration, this task becomes more complex, since many pixels in the CFA do not receive a proper color, which creates occlusions which in turn create additional artifacts after demosaicing. To prevent this type of artifacts, occlusion inpainting has to be performed. In this paper we propose a new method for simultaneous correction of all artifacts mentioned above. We define operators representing spatially variable blur, subsampling and noise applied to the unknown artifacts free image, and perform reconstruction of the artifacts free image. First we perform lens calibration step in order to acquire the lens point spread (PSF) function at each pixel in the image using point source. Once we obtained PSFs we perform joint deconvolution using variable kernels obtained from the previous step.},
  articleno    = {UNSP 106790X},
  author       = {Jovanov, Ljubomir and Philips, Wilfried},
  booktitle    = {OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS V},
  isbn         = {9781510618855},
  issn         = {0277-786X},
  language     = {eng},
  location     = {Strasbourg, FRANCE},
  pages        = {9},
  publisher    = {Spie-int Soc Optical Engineering},
  title        = {Real-time spatially adaptive deconvolution for CFA images},
  url          = {http://dx.doi.org/10.1117/12.2306110},
  volume       = {10679},
  year         = {2018},
}

Altmetric
View in Altmetric
Web of Science
Times cited: