MVSNet: Depth Inference for Unstructured Multi-view Stereo

By Yao Yao, Zixin Luo, Shiwei Li, Tian Fang, Long Quan. 2018

1,670 citations recorded by the source corpus.

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the differentiable homography warping. Next, we apply 3D convolutions to regularize and regress the initial depth map, which is then refined with the reference image to generate the final output. Our framework flexibly adapts arbitrary N-view inputs using a variance-based cost metric that maps multiple features into one cost feature. The proposed MVSNet is demonstrated on the large-scale indoor DTU dataset. With simple post-processing, our method not only significantly outperforms previous state-of-the-arts, but also is several times faster in runtime. We also evaluate MVSNet on the complex outdoor Tanks and Temples dataset, where our method ranks first before April 18, 2018 without any fine-tuning, showing the strong generalization ability of MVSNet.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, 3D Vision & Pose

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Andreas Geiger
  2. Marc Pollefeys
  3. Vladlen Koltun
  4. Matthias Nießner
  5. Jia Deng
  6. Zachary Teed
  7. Torsten Sattler
  8. Jia-Bin Huang

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Jitendra Malik
  5. Andreas Geiger
  6. Trevor Darrell
  7. Xiaogang Wang
  8. Andrea Vedaldi

In 3D Vision & Pose

  1. Andreas Geiger
  2. Michael Niemeyer
  3. Songyou Peng
  4. Matthias Nießner
  5. Yaron Lipman
  6. Marc Pollefeys
  7. Lars M. Mescheder
  8. Matan Atzmon

Citations in the corpus