Multi-view 3D Object Detection Network for Autonomous Driving

By Xiaozhi Chen, Huimin Ma, Ji Wan, Bo Li, Tian Xia. 2016

3,211 citations recorded by the source corpus.

This paper aims at high-accuracy 3D object detection in autonomous driving scenario. We propose Multi-View 3D networks (MV3D), a sensory-fusion framework that takes both LIDAR point cloud and RGB images as input and predicts oriented 3D bounding boxes. We encode the sparse 3D point cloud with a compact multi-view representation. The network is composed of two subnetworks: one for 3D object proposal generation and another for multi-view feature fusion. The proposal network generates 3D candidate boxes efficiently from the birds eye view representation of 3D point cloud. We design a deep fusion scheme to combine region-wise features from multiple views and enable interactions between intermediate layers of different paths. Experiments on the challenging KITTI benchmark show that our approach outperforms the state-of-the-art by around 25% and 30% AP on the tasks of 3D localization and 3D detection. In addition, for 2D detection, our approach obtains 14.9% higher AP than the state-of-the-art on the hard data among the LIDAR-based methods.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, 3D Vision & Pose, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Hongsheng Li
  2. Shaoshuai Shi
  3. Xiaogang Wang
  4. Philipp Krahenbuhl
  5. Jiaya Jia
  6. Andreas Geiger
  7. Jianping Shi
  8. Li Jiang

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Xiaogang Wang
  3. Dacheng Tao
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Alan L. Yuille
  8. Bernt Schiele

In 3D Vision & Pose

  1. Andreas Geiger
  2. Raquel Urtasun
  3. Leonidas J. Guibas
  4. Jiaya Jia
  5. Charles Ruizhongtai Qi
  6. Xiaogang Wang
  7. Hongsheng Li
  8. Shaoshuai Shi

In Robotics & Control

  1. Raquel Urtasun
  2. Yuke Zhu
  3. Silvio Savarese
  4. Li Fei-Fei
  5. Roberto Mart'in-Mart'in
  6. Andreas Geiger
  7. Lei Tai
  8. Binh Yang

Citations in the corpus