DIST: Rendering Deep Implicit Signed Distance Function With Differentiable Sphere Tracing

By Shaohui Liu, Yinda Zhang, Songyou Peng, Boxin Shi, Marc Pollefeys, Zhaopeng Cui. 2019

310 citations recorded by the source corpus.

We propose a differentiable sphere tracing algorithm to bridge the gap between inverse graphics methods and the recently proposed deep learning based implicit signed distance function. Due to the nature of the implicit function, the rendering process requires tremendous function queries, which is particularly problematic when the function is represented as a neural network. We optimize both the forward and backward pass of our rendering layer to make it run efficiently with affordable memory consumption on a commodity graphics card. Our rendering method is fully differentiable such that losses can be directly computed on the rendered 2D observations, and the gradients can be propagated backward to optimize the 3D geometry. We show that our rendering method can effectively reconstruct accurate 3D shapes from various inputs, such as sparse depth and multi-view images, through inverse optimization. With the geometry based reasoning, our 3D shape prediction methods show excellent generalization capability and robustness against various noises.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition, 3D Vision & Pose

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Songyou Peng
  4. Michael Niemeyer
  5. Ben Mildenhall
  6. Pratul P. Srinivasan
  7. Matthias Nießner
  8. Matthew Tancik

In Computer Graphics and Computer-Aided Design

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Ben Mildenhall
  4. Pratul P. Srinivasan
  5. Matthias Nießner
  6. Michael Niemeyer
  7. Matthew Tancik
  8. Songyou Peng

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Andreas Geiger
  3. Jitendra Malik
  4. Dacheng Tao
  5. Ming-Hsuan Yang
  6. Trevor Darrell
  7. Andrea Vedaldi
  8. Xiaogang Wang

In 3D Vision & Pose

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Matthias Nießner
  4. Michael Niemeyer
  5. Matthew Tancik
  6. Songyou Peng
  7. Ben Mildenhall
  8. Christian Theobalt

Citations in the corpus