3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction

By Christopher Bongsoo Choy, Danfei Xu, JunYoung Gwak, Kevin Chen, Silvio Savarese. 2016

1,900 citations recorded by the source corpus.

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The network learns a mapping from images of objects to their underlying 3D shapes from a large collection of synthetic data [13]. Our network takes in one or more images of an object instance from arbitrary viewpoints and outputs a reconstruction of the object in the form of a 3D occupancy grid. Unlike most of the previous works, our network does not require any image annotations or object class labels for training or testing. Our extensive experimental analysis shows that our reconstruction framework (i) outperforms the state-of-the-art methods for single view reconstruction, and (ii) enables the 3D reconstruction of objects in situations when traditional SFM/SLAM methods fail (because of lack of texture and/or wide baseline).

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, Geology, 3D Vision & Pose

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Jitendra Malik
  2. Andreas Geiger
  3. Silvio Savarese
  4. Leonidas J. Guibas
  5. Matthias Nießner
  6. Vladlen Koltun
  7. Kristen Grauman
  8. Abhinav Kumar Gupta

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Jitendra Malik
  3. Dacheng Tao
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Andrea Vedaldi
  7. Xiaogang Wang
  8. Andrew Zisserman

In Geology

  1. Matthias Nießner
  2. Leonidas J. Guibas
  3. Jitendra Malik
  4. Angela Dai
  5. Andreas Geiger
  6. Or Litany
  7. Charles Ruizhongtai Qi
  8. Silvio Savarese

In 3D Vision & Pose

  1. Andreas Geiger
  2. Jitendra Malik
  3. Michael Niemeyer
  4. Jiajun Wu
  5. Matthias Nießner
  6. Justin Johnson
  7. Gerard Pons-Moll
  8. Josh Tenenbaum

Citations in the corpus