Instant neural graphics primitives with a multiresolution hash encoding

By T. Muller, Alex Evans, Christoph Schied, Alexander Keller. 2022

6,052 citations recorded by the source corpus.

Neural graphics primitives, parameterized by fully connected neural networks, can be costly to train and evaluate. We reduce this cost with a versatile new input encoding that permits the use of a smaller network without sacrificing quality, thus significantly reducing the number of floating point and memory access operations: a small neural network is augmented by a multiresolution hash table of trainable feature vectors whose values are optimized through stochastic gradient descent. The multiresolution structure allows the network to disambiguate hash collisions, making for a simple architecture that is trivial to parallelize on modern GPUs. We leverage this parallelism by implementing the whole system using fully-fused CUDA kernels with a focus on minimizing wasted bandwidth and compute operations. We achieve a combined speedup of several orders of magnitude, enabling training of high-quality neural graphics primitives in a matter of seconds, and rendering in tens of milliseconds at a resolution of 1920×1080.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

  1. Andreas Geiger
  2. Matthias Nießner
  3. Jonathan T. Barron
  4. Andrea Tagliasacchi
  5. Pratul P. Srinivasan
  6. Ben Mildenhall
  7. Michael Niemeyer
  8. Leonidas J. Guibas

In Computer Graphics and Computer-Aided Design

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Matthias Nießner
  4. Ben Mildenhall
  5. Pratul P. Srinivasan
  6. Zehao Yu
  7. Anpei Chen
  8. Vincent Lepetit

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Ming-Hsuan Yang
  3. Dacheng Tao
  4. Jitendra Malik
  5. Trevor Darrell
  6. Xiaogang Wang
  7. Andrea Vedaldi
  8. Andreas Geiger

Citations in the corpus