VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection

By Yin Zhou, Oncel Tuzel. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2017

4,599 citations recorded by the source corpus.

Accurate detection of objects in 3D point clouds is a central problem in many applications, such as autonomous navigation, housekeeping robots, and augmented/virtual reality. To interface a highly sparse LiDAR point cloud with a region proposal network (RPN), most existing efforts have focused on hand-crafted feature representations, for example, a bird's eye view projection. In this work, we remove the need of manual feature engineering for 3D point clouds and propose VoxelNet, a generic 3D detection network that unifies feature extraction and bounding box prediction into a single stage, end-to-end trainable deep network. Specifically, VoxelNet divides a point cloud into equally spaced 3D voxels and transforms a group of points within each voxel into a unified feature representation through the newly introduced voxel feature encoding (VFE) layer. In this way, the point cloud is encoded as a descriptive volumetric representation, which is then connected to a RPN to generate detections. Experiments on the KITTI car detection benchmark show that VoxelNet outperforms the state-of-the-art LiDAR based 3D detection methods by a large margin. Furthermore, our network learns an effective discriminative representation of objects with various geometries, leading to encouraging results in 3D detection of pedestrians and cyclists, based on only LiDAR.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, Environmental Engineering, 3D Vision & Pose

View Paper: https://arxiv.org/abs/1711.06396

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Hongsheng Li
  2. Shaoshuai Shi
  3. Xiaogang Wang
  4. Philipp Krahenbuhl
  5. Jiaya Jia
  6. Li Jiang
  7. Xingyi Zhou
  8. Jianping Shi

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Xiaogang Wang
  3. Dacheng Tao
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Alan L. Yuille
  7. Jitendra Malik
  8. Yi Yang

In Environmental Engineering

  1. Shaoshuai Shi
  2. Hongsheng Li
  3. Xiaogang Wang
  4. Jiaya Jia
  5. Shu Liu
  6. Qi Chen
  7. Li Jiang
  8. Philipp Krahenbuhl

In 3D Vision & Pose

  1. Raquel Urtasun
  2. Leonidas J. Guibas
  3. Jiaya Jia
  4. Charles Ruizhongtai Qi
  5. Shaoshuai Shi
  6. Hongsheng Li
  7. Xiaogang Wang
  8. Binh Yang

Citations in the corpus