Advanced search
1 file | 3.72 MB Add to list

Focal-plane sensing-processing: a power-efficient approach for the implementation of privacy-aware networked visual sensors

(2014) SENSORS. 14(8). p.15203-15226
Author
Organization
Abstract
The capture, processing and distribution of visual information is one of the major challenges for the paradigm of the Internet of Things. Privacy emerges as a fundamental barrier to overcome. The idea of networked image sensors pervasively collecting data generates social rejection in the face of sensitive information being tampered by hackers or misused by legitimate users. Power consumption also constitutes a crucial aspect. Images contain a massive amount of data to be processed under strict timing requirements, demanding high-performance vision systems. In this paper, we describe a hardware-based strategy to concurrently address these two key issues. By conveying processing capabilities to the focal plane in addition to sensing, we can implement privacy protection measures just at the point where sensitive data are generated. Furthermore, such measures can be tailored for efficiently reducing the computational load of subsequent processing stages. As a proof of concept, a full-custom QVGA vision sensor chip is presented. It incorporates a mixed-signal focal-plane sensing-processing array providing programmable pixelation of multiple image regions in parallel. In addition to this functionality, the sensor exploits reconfigurability to implement other processing primitives, namely block-wise dynamic range adaptation, integral image computation and multi-resolution filtering. The proposed circuitry is also suitable to build a granular space, becoming the raw material for subsequent feature extraction and recognition of categorized objects.
Keywords
privacy, security, Internet of Things (IoT), visual sensor networks, VIDEO, TRACKING, EVENT DETECTION, REAL-TIME, VISION-SENSOR, CMOS IMAGE SENSOR, vision sensor, focal-plane processing, obfuscation, pixelation, granular space, feature extraction

Downloads

  • sensors-14-15203.pdf
    • full text
    • |
    • open access
    • |
    • PDF
    • |
    • 3.72 MB

Citation

Please use this url to cite or link to this publication:

MLA
Fernández-Berni, Jorge, et al. “Focal-Plane Sensing-Processing: A Power-Efficient Approach for the Implementation of Privacy-Aware Networked Visual Sensors.” SENSORS, vol. 14, no. 8, MDPI, 2014, pp. 15203–26, doi:10.3390/s140815203.
APA
Fernández-Berni, J., Carmona-Galán, R., del Río, R., Kleihorst, R., Philips, W., & Rodríguez-Vázquez, Á. (2014). Focal-plane sensing-processing: a power-efficient approach for the implementation of privacy-aware networked visual sensors. SENSORS, 14(8), 15203–15226. https://doi.org/10.3390/s140815203
Chicago author-date
Fernández-Berni, Jorge, Ricardo Carmona-Galán, Rocío del Río, Richard Kleihorst, Wilfried Philips, and Ángel Rodríguez-Vázquez. 2014. “Focal-Plane Sensing-Processing: A Power-Efficient Approach for the Implementation of Privacy-Aware Networked Visual Sensors.” SENSORS 14 (8): 15203–26. https://doi.org/10.3390/s140815203.
Chicago author-date (all authors)
Fernández-Berni, Jorge, Ricardo Carmona-Galán, Rocío del Río, Richard Kleihorst, Wilfried Philips, and Ángel Rodríguez-Vázquez. 2014. “Focal-Plane Sensing-Processing: A Power-Efficient Approach for the Implementation of Privacy-Aware Networked Visual Sensors.” SENSORS 14 (8): 15203–15226. doi:10.3390/s140815203.
Vancouver
1.
Fernández-Berni J, Carmona-Galán R, del Río R, Kleihorst R, Philips W, Rodríguez-Vázquez Á. Focal-plane sensing-processing: a power-efficient approach for the implementation of privacy-aware networked visual sensors. SENSORS. 2014;14(8):15203–26.
IEEE
[1]
J. Fernández-Berni, R. Carmona-Galán, R. del Río, R. Kleihorst, W. Philips, and Á. Rodríguez-Vázquez, “Focal-plane sensing-processing: a power-efficient approach for the implementation of privacy-aware networked visual sensors,” SENSORS, vol. 14, no. 8, pp. 15203–15226, 2014.
@article{5674977,
  abstract     = {{The capture, processing and distribution of visual information is one of the major challenges for the paradigm of the Internet of Things. Privacy emerges as a fundamental barrier to overcome. The idea of networked image sensors pervasively collecting data generates social rejection in the face of sensitive information being tampered by hackers or misused by legitimate users. Power consumption also constitutes a crucial aspect. Images contain a massive amount of data to be processed under strict timing requirements, demanding high-performance vision systems. In this paper, we describe a hardware-based strategy to concurrently address these two key issues. By conveying processing capabilities to the focal plane in addition to sensing, we can implement privacy protection measures just at the point where sensitive data are generated. Furthermore, such measures can be tailored for efficiently reducing the computational load of subsequent processing stages. As a proof of concept, a full-custom QVGA vision sensor chip is presented. It incorporates a mixed-signal focal-plane sensing-processing array providing programmable pixelation of multiple image regions in parallel. In addition to this functionality, the sensor exploits reconfigurability to implement other processing primitives, namely block-wise dynamic range adaptation, integral image computation and multi-resolution filtering. The proposed circuitry is also suitable to build a granular space, becoming the raw material for subsequent feature extraction and recognition of categorized objects.}},
  author       = {{Fernández-Berni, Jorge and Carmona-Galán, Ricardo and del Río, Rocío and Kleihorst, Richard and Philips, Wilfried and Rodríguez-Vázquez, Ángel}},
  issn         = {{1424-8220}},
  journal      = {{SENSORS}},
  keywords     = {{privacy,security,Internet of Things (IoT),visual sensor networks,VIDEO,TRACKING,EVENT DETECTION,REAL-TIME,VISION-SENSOR,CMOS IMAGE SENSOR,vision sensor,focal-plane processing,obfuscation,pixelation,granular space,feature extraction}},
  language     = {{eng}},
  number       = {{8}},
  pages        = {{15203--15226}},
  publisher    = {{MDPI}},
  title        = {{Focal-plane sensing-processing: a power-efficient approach for the implementation of privacy-aware networked visual sensors}},
  url          = {{http://doi.org/10.3390/s140815203}},
  volume       = {{14}},
  year         = {{2014}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: