Advanced search
1 file | 1.83 MB

Learning Morphological Operators for Depth Completion

Martin Dimitrievski (UGent), Peter Veelaert (UGent) and Wilfried Philips (UGent)
Author
Organization
Abstract
Depth images generated by direct projection of LiDAR point clouds on the image plane suffer from a great level of sparsity which is difficult to interpret by classical computer vision algorithms. We propose a method for completing sparse depth images in a semantically accurate manner by training a novel morphological neural network. Our method approximates morphological operations by Contraharmonic Mean Filter layers which are easily trained in a contemporary deep learning framework. An early fusion U-Net architecture then combines dilated depth channels and RGB using multi-scale processing. Using a large scale RGBD dataset we are able to learn the optimal morphological and convolutional filter shapes that produce an accurate and fully sampled depth image at the output. Independent experimental evaluation confirms that our method outperforms classical image restoration techniques as well as current state-of-the-art neural networks. The resulting depth images preserve object boundaries and can easily be used to augment various tasks in intelligent vehicles perception systems.
Keywords
deep learning, autonomous vehicles, upsampling, morphological filtering, cnn, neural networks

Downloads

  • paper camera ready.pdf
    • full text
    • |
    • open access
    • |
    • PDF
    • |
    • 1.83 MB

Citation

Please use this url to cite or link to this publication:

Chicago
Dimitrievski, Martin, Peter Veelaert, and Wilfried Philips. 2018. “Learning Morphological Operators for Depth Completion.” In Advanced Concepts for Intelligent Vision Systems.
APA
Dimitrievski, M., Veelaert, P., & Philips, W. (2018). Learning Morphological Operators for Depth Completion. Advanced Concepts for Intelligent Vision Systems. Presented at the Advanced Concepts for Intelligent Vision Systems.
Vancouver
1.
Dimitrievski M, Veelaert P, Philips W. Learning Morphological Operators for Depth Completion. Advanced Concepts for Intelligent Vision Systems. 2018.
MLA
Dimitrievski, Martin, Peter Veelaert, and Wilfried Philips. “Learning Morphological Operators for Depth Completion.” Advanced Concepts for Intelligent Vision Systems. 2018. Print.
@inproceedings{8569539,
  abstract     = {Depth images generated by direct projection of LiDAR point clouds on the image plane suffer from a great level of sparsity which is difficult to interpret by classical computer vision algorithms. We propose a method for completing sparse depth images in a semantically accurate manner by training a novel morphological neural network. Our method approximates morphological operations by Contraharmonic Mean Filter layers which are easily trained in a contemporary deep learning framework. An early fusion U-Net architecture then combines dilated depth channels and RGB using multi-scale processing. Using a large scale RGBD dataset we are able to learn the optimal morphological and convolutional filter shapes that produce an accurate and fully sampled depth image at the output. Independent experimental evaluation confirms that our method outperforms classical image restoration techniques as well as current state-of-the-art neural networks. The resulting depth images preserve object boundaries and can easily be used to augment various tasks in intelligent vehicles perception systems.},
  author       = {Dimitrievski, Martin and Veelaert, Peter and Philips, Wilfried},
  booktitle    = {Advanced Concepts for Intelligent Vision Systems},
  keyword      = {deep learning,autonomous vehicles,upsampling,morphological filtering,cnn,neural networks},
  language     = {eng},
  location     = {Poitiers, France },
  title        = {Learning Morphological Operators for Depth Completion},
  url          = {http://acivs.org/acivs2018/callforpapers.php\#},
  year         = {2018},
}