Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields

By Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, Peter Hedman. Computer Vision and Pattern Recognition, 2021

2,737 citations recorded by the source corpus.

Though neural radiance fields (NeRF) have demon-strated impressive view synthesis results on objects and small bounded regions of space, they struggle on “un-bounded” scenes, where the camera may point in any di-rection and content may exist at any distance. In this set-ting, existing NeRF-like models often produce blurry or low-resolution renderings (due to the unbalanced detail and scale of nearby and distant objects), are slow to train, and may exhibit artifacts due to the inherent ambiguity of the task of reconstructing a large scene from a small set of images. We present an extension of mip-NeRF (a NeRF variant that addresses sampling and aliasing) that uses a non-linear scene parameterization, online distillation, and a novel distortion-based regularizer to overcome the chal-lenges presented by unbounded scenes. Our model, which we dub “mip-NeRF 360” as we target scenes in which the camera rotates 360 degrees around a point, reduces mean-squared error by 57% compared to mip-NeRF, and is able to produce realistic synthesized views and detailed depth maps for highly intricate, unbounded real-world scenes.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/ec90ffa017a2cc6a51342509ce42b81b478aefb3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Matthias Nießner
  4. Ben Mildenhall
  5. Pratul P. Srinivasan
  6. Vincent Lepetit
  7. Antoine Guédon
  8. Zehao Yu

In Computer Graphics and Computer-Aided Design

  1. Andreas Geiger
  2. Jonathan T. Barron
  3. Ben Mildenhall
  4. Pratul P. Srinivasan
  5. Matthias Nießner
  6. Anpei Chen
  7. Vincent Lepetit
  8. Antoine Guédon

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Ming-Hsuan Yang
  3. Dacheng Tao
  4. Xiaogang Wang
  5. Jitendra Malik
  6. Trevor Darrell
  7. Chen Change Loy
  8. Andrea Vedaldi

Citations in the corpus