Advanced search
1 file | 957.77 KB Add to list

Geolocalization of crowdsourced images for 3-D modeling of city points of interest

Author
Organization
Abstract
Geolocalization of crowdsourced images is a challenging task that is getting increased attention nowadays due to the rise in popularity of geotagging and its applications. Among these applications, 3-D modeling from Internet photograph collections is a very active research topic with great promise and potential. In order to automize and optimize the crowdsourced 3-D modeling process, this letter proposes a novel framework that can be used for automatic 3-D modeling of city points of interest (POIs), such as statues, buildings, and temporary artworks. Crowdsourced images related to the POI and its location are collected using a geographical Web search process based on geotags and semantic geodata. Subsequently, panoramic Google Street View (SV) images are used to geolocalize the images. If enough feature matches are found between the image and one of the SV images, the image is annotated with the location metadata of the best matching image from the SV database. Otherwise, when too fewmatches are found, the image most probably will not contain the POI in its field of view (FOV), and it is filtered out. For optimal performance, the equirectangular panoramic SV images are transformed into an SV data set of perspective cutouts facing the POI with different pitches and FOVs. From this data set, a basic 3-D model of the POI and its environment is generated. Finally, the geolocalized crowdsourced images refine and optimize the 3-D model using the matching matrix that is generated from the geolocalization results. Experiments show the feasibility of our approach on different types of city POIs. Our main contribution is that we can decrease the 3-D modeling computation time by more than half and significantly improve the model completeness. Finally, it is important to remark that the applicability of the proposed framework is not limited to 3-D modeling but can also be used in other domains, such as geoaugmented reality and location-based media annotation.
Keywords
geolocalization, Computer vision, RECONSTRUCTION, Google Street View (SV), point clouds, structure from motion, 3-D modeling

Downloads

  • (...).pdf
    • full text
    • |
    • UGent only
    • |
    • PDF
    • |
    • 957.77 KB

Citation

Please use this url to cite or link to this publication:

MLA
Verstockt, Steven, Markus Gerke, and Norman Kerle. “Geolocalization of Crowdsourced Images for 3-D Modeling of City Points of Interest.” IEEE GEOSCIENCE AND REMOTE SENSING LETTERS 12.8 (2015): 1670–1674. Print.
APA
Verstockt, S., Gerke, M., & Kerle, N. (2015). Geolocalization of crowdsourced images for 3-D modeling of city points of interest. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 12(8), 1670–1674.
Chicago author-date
Verstockt, Steven, Markus Gerke, and Norman Kerle. 2015. “Geolocalization of Crowdsourced Images for 3-D Modeling of City Points of Interest.” Ieee Geoscience and Remote Sensing Letters 12 (8): 1670–1674.
Chicago author-date (all authors)
Verstockt, Steven, Markus Gerke, and Norman Kerle. 2015. “Geolocalization of Crowdsourced Images for 3-D Modeling of City Points of Interest.” Ieee Geoscience and Remote Sensing Letters 12 (8): 1670–1674.
Vancouver
1.
Verstockt S, Gerke M, Kerle N. Geolocalization of crowdsourced images for 3-D modeling of city points of interest. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. 2015;12(8):1670–4.
IEEE
[1]
S. Verstockt, M. Gerke, and N. Kerle, “Geolocalization of crowdsourced images for 3-D modeling of city points of interest,” IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, vol. 12, no. 8, pp. 1670–1674, 2015.
@article{7034320,
  abstract     = {Geolocalization of crowdsourced images is a challenging task that is getting increased attention nowadays due to the rise in popularity of geotagging and its applications. Among these applications, 3-D modeling from Internet photograph collections is a very active research topic with great promise and potential. In order to automize and optimize the crowdsourced 3-D modeling process, this letter proposes a novel framework that can be used for automatic 3-D modeling of city points of interest (POIs), such as statues, buildings, and temporary artworks. Crowdsourced images related to the POI and its location are collected using a geographical Web search process based on geotags and semantic geodata. Subsequently, panoramic Google Street View (SV) images are used to geolocalize the images. If enough feature matches are found between the image and one of the SV images, the image is annotated with the location metadata of the best matching image from the SV database. Otherwise, when too fewmatches are found, the image most probably will not contain the POI in its field of view (FOV), and it is filtered out. For optimal performance, the equirectangular panoramic SV images are transformed into an SV data set of perspective cutouts facing the POI with different pitches and FOVs. From this data set, a basic 3-D model of the POI and its environment is generated. Finally, the geolocalized crowdsourced images refine and optimize the 3-D model using the matching matrix that is generated from the geolocalization results. Experiments show the feasibility of our approach on different types of city POIs. Our main contribution is that we can decrease the 3-D modeling computation time by more than half and significantly improve the model completeness. Finally, it is important to remark that the applicability of the proposed framework is not limited to 3-D modeling but can also be used in other domains, such as geoaugmented reality and location-based media annotation.},
  author       = {Verstockt, Steven and Gerke, Markus and Kerle, Norman},
  issn         = {1545-598X},
  journal      = {IEEE GEOSCIENCE AND REMOTE SENSING LETTERS},
  keywords     = {geolocalization,Computer vision,RECONSTRUCTION,Google Street View (SV),point clouds,structure from motion,3-D modeling},
  language     = {eng},
  number       = {8},
  pages        = {1670--1674},
  title        = {Geolocalization of crowdsourced images for 3-D modeling of city points of interest},
  url          = {http://dx.doi.org/10.1109/LGRS.2015.2418816},
  volume       = {12},
  year         = {2015},
}

Altmetric
View in Altmetric
Web of Science
Times cited: