PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space

By Charles Ruizhongtai Qi, Li Yi, Hao Su, Leonidas J. Guibas. Neural Information Processing Systems, 2017

14,555 citations recorded by the source corpus.

Few prior works study deep learning on point sets. PointNet by Qi et al. is a pioneer in this direction. However, by design PointNet does not capture local structures induced by the metric space points live in, limiting its ability to recognize fine-grained patterns and generalizability to complex scenes. In this work, we introduce a hierarchical neural network that applies PointNet recursively on a nested partitioning of the input point set. By exploiting metric space distances, our network is able to learn local features with increasing contextual scales. With further observation that point sets are usually sampled with varying densities, which results in greatly decreased performance for networks trained on uniform densities, we propose novel set learning layers to adaptively combine features from multiple scales. Experiments show that our network called PointNet++ is able to learn deep point set features efficiently and robustly. In particular, results significantly better than state-of-the-art have been obtained on challenging benchmarks of 3D point clouds.

Subfields: Aerospace Engineering, Computational Mechanics, Geology, 3D Vision & Pose

View Paper: https://arxiv.org/abs/1706.02413

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Andreas Geiger
  2. Jitendra Malik
  3. Leonidas J. Guibas
  4. Vladlen Koltun
  5. Matthias Nießner
  6. Marc Pollefeys
  7. Xiaogang Wang
  8. Charles Ruizhongtai Qi

In Computational Mechanics

  1. Andreas Geiger
  2. Leonidas J. Guibas
  3. Matthias Nießner
  4. Charles Ruizhongtai Qi
  5. Michael Niemeyer
  6. Or Litany
  7. Yaron Lipman
  8. Thomas A. Funkhouser

In Geology

  1. Leonidas J. Guibas
  2. Charles Ruizhongtai Qi
  3. Matthias Nießner
  4. Binh-Son Hua
  5. Sai-Kit Yeung
  6. Or Litany
  7. Angela Dai
  8. Jiwen Lu

In 3D Vision & Pose

  1. Andreas Geiger
  2. Jitendra Malik
  3. Leonidas J. Guibas
  4. Michael Niemeyer
  5. Matthias Nießner
  6. Gerard Pons-Moll
  7. Yaron Lipman
  8. Justin Johnson

Citations in the corpus