Frustum PointNets for 3D Object Detection from RGB-D Data

By Charles Ruizhongtai Qi, Wei David Liu, Chenxia Wu, Hao Su, Leonidas J. Guibas. 2017

2,541 citations recorded by the source corpus.

In this work, we study 3D object detection from RGBD data in both indoor and outdoor scenes. While previous methods focus on images or 3D voxels, often obscuring natural 3D patterns and invariances of 3D data, we directly operate on raw point clouds by popping up RGB-D scans. However, a key challenge of this approach is how to efficiently localize objects in point clouds of large-scale scenes (region proposal). Instead of solely relying on 3D proposals, our method leverages both mature 2D object detectors and advanced 3D deep learning for object localization, achieving efficiency as well as high recall for even small objects. Benefited from learning directly in raw point clouds, our method is also able to precisely estimate 3D bounding boxes even under strong occlusion or with very sparse points. Evaluated on KITTI and SUN RGB-D 3D detection benchmarks, our method outperforms the state of the art by remarkable margins while having real-time capability.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, Geology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Shaoshuai Shi
  2. Hongsheng Li
  3. Xiaogang Wang
  4. Jiaya Jia
  5. Philipp Krahenbuhl
  6. Li Jiang
  7. Leonidas J. Guibas
  8. Jianping Shi

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Xiaogang Wang
  3. Dacheng Tao
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Alan L. Yuille
  8. Andrea Vedaldi

In Geology

  1. Or Litany
  2. Matthias Nießner
  3. Charles Ruizhongtai Qi
  4. Shaoshuai Shi
  5. Leonidas J. Guibas
  6. Li Jiang
  7. Hongsheng Li
  8. Jiaya Jia

Citations in the corpus