Advanced search
1 file | 9.62 MB Add to list

Iterative online 3D reconstruction from RGB images

Thorsten Cardoen (UGent) , Sam Leroux (UGent) and Pieter Simoens (UGent)
(2022) SENSORS. 22(24).
Author
Organization
Project
Abstract
3D reconstruction is the computer vision task of reconstructing the 3D shape of an object from multiple 2D images. Most existing algorithms for this task are designed for offline settings, producing a single reconstruction from a batch of images taken from diverse viewpoints. Alongside reconstruction accuracy, additional considerations arise when 3D reconstructions are used in real-time processing pipelines for applications such as robot navigation or manipulation. In these cases, an accurate 3D reconstruction is already required while the data gathering is still in progress. In this paper, we demonstrate how existing batch-based reconstruction algorithms lead to suboptimal reconstruction quality when used for online, iterative 3D reconstruction and propose appropriate modifications to the existing Pix2Vox++ architecture. When additional viewpoints become available at a high rate, e.g., from a camera mounted on a drone, selecting the most informative viewpoints is important in order to mitigate long term memory loss and to reduce the computational footprint. We present qualitative and quantitative results on the optimal selection of viewpoints and show that state-of-the-art reconstruction quality is already obtained with elementary selection algorithms.
Keywords
3D reconstruction, edge computing, deep learning

Downloads

  • 8223.pdf
    • full text (Published version)
    • |
    • open access
    • |
    • PDF
    • |
    • 9.62 MB

Citation

Please use this url to cite or link to this publication:

MLA
Cardoen, Thorsten, et al. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS, vol. 22, no. 24, 2022, doi:10.3390/s22249782.
APA
Cardoen, T., Leroux, S., & Simoens, P. (2022). Iterative online 3D reconstruction from RGB images. SENSORS, 22(24). https://doi.org/10.3390/s22249782
Chicago author-date
Cardoen, Thorsten, Sam Leroux, and Pieter Simoens. 2022. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS 22 (24). https://doi.org/10.3390/s22249782.
Chicago author-date (all authors)
Cardoen, Thorsten, Sam Leroux, and Pieter Simoens. 2022. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS 22 (24). doi:10.3390/s22249782.
Vancouver
1.
Cardoen T, Leroux S, Simoens P. Iterative online 3D reconstruction from RGB images. SENSORS. 2022;22(24).
IEEE
[1]
T. Cardoen, S. Leroux, and P. Simoens, “Iterative online 3D reconstruction from RGB images,” SENSORS, vol. 22, no. 24, 2022.
@article{01GPJP489RWMM4N3H4J1S95JHZ,
  abstract     = {{3D reconstruction is the computer vision task of reconstructing the 3D shape of an object from multiple 2D images. Most existing algorithms for this task are designed for offline settings, producing a single reconstruction from a batch of images taken from diverse viewpoints. Alongside reconstruction accuracy, additional considerations arise when 3D reconstructions are used in real-time processing pipelines for applications such as robot navigation or manipulation. In these cases, an accurate 3D reconstruction is already required while the data gathering is still in progress. In this paper, we demonstrate how existing batch-based reconstruction algorithms lead to suboptimal reconstruction quality when used for online, iterative 3D reconstruction and propose appropriate modifications to the existing Pix2Vox++ architecture. When additional viewpoints become available at a high rate, e.g., from a camera mounted on a drone, selecting the most informative viewpoints is important in order to mitigate long term memory loss and to reduce the computational footprint. We present qualitative and quantitative results on the optimal selection of viewpoints and show that state-of-the-art reconstruction quality is already obtained with elementary selection algorithms.}},
  articleno    = {{9782}},
  author       = {{Cardoen, Thorsten and Leroux, Sam and Simoens, Pieter}},
  issn         = {{1424-8220}},
  journal      = {{SENSORS}},
  keywords     = {{3D reconstruction,edge computing,deep learning}},
  language     = {{eng}},
  number       = {{24}},
  pages        = {{21}},
  title        = {{Iterative online 3D reconstruction from RGB images}},
  url          = {{http://doi.org/10.3390/s22249782}},
  volume       = {{22}},
  year         = {{2022}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: