Local Implicit Grid Representations for 3D Scenes

By Chiyu "Max" Jiang, Avneesh Sud, Ameesh Makadia, Jingwei Huang, Matthias Nießner, Thomas A. Funkhouser. 2020

622 citations recorded by the source corpus.

Shape priors learned from data are commonly used to reconstruct 3D objects from partial or noisy data. Yet no such shape priors are available for indoor scenes, since typical 3D autoencoders cannot handle their scale, complexity, or diversity. In this paper, we introduce Local Implicit Grid Representations, a new 3D shape representation designed for scalability and generality. The motivating idea is that most 3D surfaces share geometric details at some scale -- i.e., at a scale smaller than an entire object and larger than a small patch. We train an autoencoder to learn an embedding of local crops of 3D shapes at that size. Then, we use the decoder as a component in a shape optimization that solves for a set of latent codes on a regular grid of overlapping crops such that an interpolation of the decoded local shapes matches a partial or noisy observation. We demonstrate the value of this proposed approach for 3D surface reconstruction from sparse point observations, showing significantly better results than alternative approaches.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition, Geology, 3D Vision & Pose

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

  1. Andreas Geiger
  2. Michael Niemeyer
  3. Songyou Peng
  4. Gerard Pons-Moll
  5. Jonathan T. Barron
  6. Matthias Nießner
  7. Gordon Wetzstein
  8. Matthew Tancik

In Computer Graphics and Computer-Aided Design

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Ben Mildenhall
  4. Pratul P. Srinivasan
  5. Michael Niemeyer
  6. Songyou Peng
  7. Matthew Tancik
  8. Gordon Wetzstein

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Andreas Geiger
  3. Jitendra Malik
  4. Ming-Hsuan Yang
  5. Dacheng Tao
  6. Andrea Vedaldi
  7. Xiaogang Wang
  8. Trevor Darrell

In Geology

  1. Matthias Nießner
  2. Andreas Geiger
  3. Gerard Pons-Moll
  4. Michael Niemeyer
  5. Marc Pollefeys
  6. Leonidas J. Guibas
  7. Julian Chibane
  8. Songyou Peng

In 3D Vision & Pose

  1. Andreas Geiger
  2. Michael Niemeyer
  3. Songyou Peng
  4. Jonathan T. Barron
  5. Matthias Nießner
  6. Gerard Pons-Moll
  7. Matthew Tancik
  8. Gordon Wetzstein

Citations in the corpus