Occupancy Networks: Learning 3D Reconstruction in Function Space

By Lars M. Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, Andreas Geiger. Computer Vision and Pattern Recognition, 2018

3,446 citations recorded by the source corpus.

With the advent of deep neural networks, learning-based approaches for 3D reconstruction have gained popularity. However, unlike for images, in 3D there is no canonical representation which is both computationally and memory efficient yet allows for representing high-resolution geometry of arbitrary topology. Many of the state-of-the-art learning-based 3D reconstruction approaches can hence only represent very coarse 3D geometry or are limited to a restricted domain. In this paper, we propose Occupancy Networks, a new representation for learning-based 3D reconstruction methods. Occupancy networks implicitly represent the 3D surface as the continuous decision boundary of a deep neural network classifier. In contrast to existing approaches, our representation encodes a description of the 3D output at infinite resolution without excessive memory footprint. We validate that our representation can efficiently encode 3D structure and can be inferred from various kinds of input. Our experiments demonstrate competitive results, both qualitatively and quantitatively, for the challenging tasks of 3D reconstruction from single images, noisy point clouds and coarse discrete voxel grids. We believe that occupancy networks will become a useful tool in a wide variety of learning-based 3D tasks.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition, 3D Vision & Pose

View Paper: https://arxiv.org/abs/1812.03828

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

  1. Andreas Geiger
  2. Gerard Pons-Moll
  3. Michael Niemeyer
  4. Michael J. Black
  5. Matthias Nießner
  6. Jonathan T. Barron
  7. Christian Theobalt
  8. Songyou Peng

In Computer Graphics and Computer-Aided Design

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Ben Mildenhall
  4. Michael Niemeyer
  5. Pratul P. Srinivasan
  6. Matthias Nießner
  7. Matthew Tancik
  8. Justin Johnson

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Jitendra Malik
  3. Dacheng Tao
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Xiaogang Wang
  7. Andrea Vedaldi
  8. Andrew Zisserman

In 3D Vision & Pose

  1. Andreas Geiger
  2. Michael Niemeyer
  3. Gerard Pons-Moll
  4. Matthias Nießner
  5. Jitendra Malik
  6. Jonathan T. Barron
  7. Justin Johnson
  8. Christian Theobalt

Citations in the corpus