- Author
- Thorsten Cardoen (UGent) , Sam Leroux (UGent) and Pieter Simoens (UGent)
- Organization
- Project
- Abstract
- 3D reconstruction is the computer vision task of reconstructing the 3D shape of an object from multiple 2D images. Most existing algorithms for this task are designed for offline settings, producing a single reconstruction from a batch of images taken from diverse viewpoints. Alongside reconstruction accuracy, additional considerations arise when 3D reconstructions are used in real-time processing pipelines for applications such as robot navigation or manipulation. In these cases, an accurate 3D reconstruction is already required while the data gathering is still in progress. In this paper, we demonstrate how existing batch-based reconstruction algorithms lead to suboptimal reconstruction quality when used for online, iterative 3D reconstruction and propose appropriate modifications to the existing Pix2Vox++ architecture. When additional viewpoints become available at a high rate, e.g., from a camera mounted on a drone, selecting the most informative viewpoints is important in order to mitigate long term memory loss and to reduce the computational footprint. We present qualitative and quantitative results on the optimal selection of viewpoints and show that state-of-the-art reconstruction quality is already obtained with elementary selection algorithms.
- Keywords
- 3D reconstruction, edge computing, deep learning
Downloads
-
8223.pdf
- full text (Published version)
- |
- open access
- |
- |
- 9.62 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01GPJP489RWMM4N3H4J1S95JHZ
- MLA
- Cardoen, Thorsten, et al. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS, vol. 22, no. 24, 2022, doi:10.3390/s22249782.
- APA
- Cardoen, T., Leroux, S., & Simoens, P. (2022). Iterative online 3D reconstruction from RGB images. SENSORS, 22(24). https://doi.org/10.3390/s22249782
- Chicago author-date
- Cardoen, Thorsten, Sam Leroux, and Pieter Simoens. 2022. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS 22 (24). https://doi.org/10.3390/s22249782.
- Chicago author-date (all authors)
- Cardoen, Thorsten, Sam Leroux, and Pieter Simoens. 2022. “Iterative Online 3D Reconstruction from RGB Images.” SENSORS 22 (24). doi:10.3390/s22249782.
- Vancouver
- 1.Cardoen T, Leroux S, Simoens P. Iterative online 3D reconstruction from RGB images. SENSORS. 2022;22(24).
- IEEE
- [1]T. Cardoen, S. Leroux, and P. Simoens, “Iterative online 3D reconstruction from RGB images,” SENSORS, vol. 22, no. 24, 2022.
@article{01GPJP489RWMM4N3H4J1S95JHZ, abstract = {{3D reconstruction is the computer vision task of reconstructing the 3D shape of an object from multiple 2D images. Most existing algorithms for this task are designed for offline settings, producing a single reconstruction from a batch of images taken from diverse viewpoints. Alongside reconstruction accuracy, additional considerations arise when 3D reconstructions are used in real-time processing pipelines for applications such as robot navigation or manipulation. In these cases, an accurate 3D reconstruction is already required while the data gathering is still in progress. In this paper, we demonstrate how existing batch-based reconstruction algorithms lead to suboptimal reconstruction quality when used for online, iterative 3D reconstruction and propose appropriate modifications to the existing Pix2Vox++ architecture. When additional viewpoints become available at a high rate, e.g., from a camera mounted on a drone, selecting the most informative viewpoints is important in order to mitigate long term memory loss and to reduce the computational footprint. We present qualitative and quantitative results on the optimal selection of viewpoints and show that state-of-the-art reconstruction quality is already obtained with elementary selection algorithms.}}, articleno = {{9782}}, author = {{Cardoen, Thorsten and Leroux, Sam and Simoens, Pieter}}, issn = {{1424-8220}}, journal = {{SENSORS}}, keywords = {{3D reconstruction,edge computing,deep learning}}, language = {{eng}}, number = {{24}}, pages = {{21}}, title = {{Iterative online 3D reconstruction from RGB images}}, url = {{http://doi.org/10.3390/s22249782}}, volume = {{22}}, year = {{2022}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: