Multiview Photometric Stereo

By Carlos Hernández Esteban, George Vogiatzis, Roberto Cipolla. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008

310 citations recorded by the source corpus.

This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.

Subfields: Computational Mechanics, Computer Graphics and Computer-Aided Design, Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/00bfa802025014fc9c55e316e82da7c227c246bd

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Mechanics

In Computer Graphics and Computer-Aided Design

In Computer Vision and Pattern Recognition

Citations in the corpus

DIST: Rendering Deep Implicit Signed Distance Function With Differentiable Sphere Tracing (2019, background): “Early works mainly focus on multi-view reconstruction using multi-view stereo methods [41, 14, 42].”
Adaptive 3D Face Reconstruction from Unconstrained Photo Collections (2017, methodology): “different known lighting conditions [21].”
Real-time shading-based refinement for consumer depth cameras (2014, background): “Photometric stereo has demonstrated compelling reconstructions of surfaces with complex reflectance properties [Mulligan and Brolly 2004; Hernández et al. 2008; Ghosh et al. 2011; Tunwattanapong et al. 2013; Debevec 2012; Bermano et al. 2014; Nehab et al. 2005].”
Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes (2008, background): “Most often the authors approximate the visibility in some pre-processing steps which can be completely prior to the whole algorithm or else inside the iterations of the minimization process [1, 5, 8, 9, 12, 16, 21].”
Multi-View Stereo: A Tutorial (2015, background): “Pure passive solutions also exist, where MVS and photometric principles [197] are fused to handle textureless surfaces and improve reconstruction qualities [95, 199].”