Ghent University Academic Bibliography

Advanced

Feature fusion of hyperspectral and LiDAR data for classification of remote sensing data from urban area

Wenzhi Liao UGent, Rik Bellens UGent, Sidharta Gautama UGent and Wilfried Philips UGent (2014) EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts. p.34-34
abstract
Nowadays, we have very diverse sensor technologies and image processing algorithms that allow to measure different aspects of objects on the earth (spectral characteristics in hyperspectral (HS) images, height in Light Detection And Ranging (LiDAR) data, geometry in image processing technologies like morphological profiles). It is clear that no single technology can be sufficient for a reliable classification. Because the remote sensing data from urban area is a mix between man-made structures and natural materials, different objects may be made by same materials (e.g. roofs and roads made by the same asphalt). On the other hand, objects with same geometry or elevation may belong to different classes. The use of stacking different features together is widely applied in data fusion of multi-sensor data for classification. These methods first apply feature extraction on each individual data source, then concatenate all the features together into one stacked vector for classification. Despite of the simplicity of such feature fusion methods (simply concatenate several kinds of features together), the systems may not perform better (or even worse) than using single features. This is because the information contained by different features is not equally represented or measured. The element values of different features can be significantly unbalanced. Furthermore, the resulting data by stacking several kinds of features may contain redundant information. Last, but not least, the increase in the dimensionality of the stacked features, as well as the limited number of labeled samples in many real applications may pose the problem of the curse of dimensionality and, as a consequence, result in the risk of overfitting the training data. We propose a graph-based fusion method to couple dimensionality reduction and data fusion of the spectral information (of original HS image) and the features extracted by morphological features computed on both HS and LiDAR data together. Our proposed method takes into account the properties of different data sources, and makes full advantages of all the spectral, the spatial and the elevation information through fusion graph. Experimental results on fusion of Hyperspectral and LiDAR data from the 2013 IEEE GRSS Data Fusion Contest show effectiveness of the proposed method. Compared to the methods using only single feature and stacking all the features together, our proposed method has more than 10% and 5% improvements in overall classification accuracy, respectively. Moreover, our approach won the “Best Paper Challenge” of the 2013 IEEE GRSS Data Fusion Contest: http://hyperspectral.ee.uh.edu/?page_id=795.
Please use this url to cite or link to this publication:
author
organization
year
type
conference
publication status
published
subject
in
EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts
editor
Sebastian Van Der Linden, Tobias Kuemmerle and Katja Janson
pages
34 - 34
conference name
5th Workshop of the EARSeL Special Interest Group on Land Use and Land Cover: Frontiers in earth observation for land system science
conference location
Berlin, Germany
conference start
2014-03-17
conference end
2014-03-18
project
SBO-IWT project Chameleon: Domain-specific Hyperspectral Imaging Systems for Relevant Industrial Applications
language
English
UGent publication?
yes
classification
C3
id
4364973
handle
http://hdl.handle.net/1854/LU-4364973
date created
2014-04-17 10:43:55
date last changed
2016-12-19 15:37:46
@inproceedings{4364973,
  abstract     = {Nowadays, we have very diverse sensor technologies and image processing algorithms that allow to measure different aspects of objects on the earth (spectral characteristics in hyperspectral (HS) images, height in Light Detection And Ranging (LiDAR) data, geometry in image processing technologies like morphological profiles). It is clear that no single technology can be sufficient for a reliable classification. Because the remote sensing data from urban area is a mix between man-made structures and natural materials, different objects may be made by same materials (e.g. roofs and roads made by the same asphalt). On the other hand, objects with same geometry or elevation may belong to different classes. The use of stacking different features together is widely applied in data fusion of multi-sensor data for classification. These methods first apply feature extraction on each individual data source, then concatenate all the features together into one stacked vector for classification.
Despite of the simplicity of such feature fusion methods (simply concatenate several kinds of features together), the systems may not perform better (or even worse) than using single features. This is because the information contained by different features is not equally represented or measured. The element values of different features can be significantly unbalanced. Furthermore, the resulting data by stacking several kinds of features may contain redundant information. Last, but not least, the increase in the dimensionality of the stacked features, as well as the limited number of labeled samples in many real applications may pose the problem of the curse of dimensionality and, as a consequence, result in the risk of overfitting the training data.
We propose a graph-based fusion method to couple dimensionality reduction and data fusion of the spectral information (of original HS image) and the features extracted by morphological features computed on both HS and LiDAR data together. Our proposed method takes into account the properties of different data sources, and makes full advantages of all the spectral, the spatial and the elevation information through fusion graph. Experimental results on fusion of Hyperspectral and LiDAR data from the 2013 IEEE GRSS Data Fusion Contest show effectiveness of the proposed method. Compared to the methods using only single feature and stacking all the features together, our proposed method has more than 10\% and 5\% improvements in overall classification accuracy, respectively. Moreover, our approach won the {\textquotedblleft}Best Paper Challenge{\textquotedblright} of the 2013 IEEE GRSS Data Fusion Contest: http://hyperspectral.ee.uh.edu/?page\_id=795.},
  author       = {Liao, Wenzhi and Bellens, Rik and Gautama, Sidharta and Philips, Wilfried},
  booktitle    = {EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts},
  editor       = {Linden, Sebastian Van Der  and Kuemmerle, Tobias and Janson, Katja},
  language     = {eng},
  location     = {Berlin, Germany},
  pages        = {34--34},
  title        = {Feature fusion of hyperspectral and LiDAR data for classification of remote sensing data from urban area},
  year         = {2014},
}

Chicago
Liao, Wenzhi, Rik Bellens, Sidharta Gautama, and Wilfried Philips. 2014. “Feature Fusion of Hyperspectral and LiDAR Data for Classification of Remote Sensing Data from Urban Area.” In EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts, ed. Sebastian Van Der Linden, Tobias Kuemmerle, and Katja Janson, 34–34.
APA
Liao, Wenzhi, Bellens, R., Gautama, S., & Philips, W. (2014). Feature fusion of hyperspectral and LiDAR data for classification of remote sensing data from urban area. In S. V. D. Linden, T. Kuemmerle, & K. Janson (Eds.), EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts (pp. 34–34). Presented at the 5th Workshop of the EARSeL Special Interest Group on Land Use and Land Cover: Frontiers in earth observation for land system science.
Vancouver
1.
Liao W, Bellens R, Gautama S, Philips W. Feature fusion of hyperspectral and LiDAR data for classification of remote sensing data from urban area. In: Linden SVD, Kuemmerle T, Janson K, editors. EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts. 2014. p. 34–34.
MLA
Liao, Wenzhi, Rik Bellens, Sidharta Gautama, et al. “Feature Fusion of Hyperspectral and LiDAR Data for Classification of Remote Sensing Data from Urban Area.” EARSeL Special Interest Group on Land Use and Land Cover, 5th Workshop, Abstracts. Ed. Sebastian Van Der Linden, Tobias Kuemmerle, & Katja Janson. 2014. 34–34. Print.