Prior Image-Constrained Reconstruction using Style-Based Generative Models

By Varun A. Kelkar, Mark A. Anastasio. 2021

32 citations recorded by the source corpus.

Obtaining a useful estimate of an object from highly incomplete imaging measurements remains a holy grail of imaging science. Deep learning methods have shown promise in learning object priors or constraints to improve the conditioning of an ill-posed imaging inverse problem. In this study, a framework for estimating an object of interest that is semantically related to a known prior image, is proposed. An optimization problem is formulated in the disentangled latent space of a style-based generative model, and semantically meaningful constraints are imposed using the disentangled latent representation of the prior image. Stable recovery from incomplete measurements with the help of a prior image is theoretically analyzed. Numerical experiments demonstrating the superior performance of our approach as compared to related methods are presented.

Subfields: Computer Vision and Pattern Recognition, Media Technology, Generative Models

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Yujiu Yang
  2. Ming-Hsuan Yang
  3. Weihao Xia
  4. Yulun Zhang
  5. Jing-Hao Xue
  6. Luc Van Gool
  7. Bolei Zhou
  8. A. Dimakis

In Media Technology

  1. Yulun Zhang
  2. Ming-Hsuan Yang
  3. Yujiu Yang
  4. Weihao Xia
  5. Giannis Daras
  6. Bolei Zhou
  7. A. Dimakis
  8. Jing-Hao Xue

In Generative Models

  1. Yujiu Yang
  2. Weihao Xia
  3. A. Dimakis
  4. Jing-Hao Xue
  5. Giannis Daras
  6. Ajil Jalal
  7. Yulun Zhang
  8. Eric Price

Citations in the corpus