Denoising Diffusion Probabilistic Models

By Jonathan Ho, Ajay Jain, Pieter Abbeel. Neural Information Processing Systems, 2020

33,172 citations recorded by the source corpus.

We present high quality image synthesis results using diffusion probabilistic models, a class of latent variable models inspired by considerations from nonequilibrium thermodynamics. Our best results are obtained by training on a weighted variational bound designed according to a novel connection between diffusion probabilistic models and denoising score matching with Langevin dynamics, and our models naturally admit a progressive lossy decompression scheme that can be interpreted as a generalization of autoregressive decoding. On the unconditional CIFAR10 dataset, we obtain an Inception score of 9.46 and a state-of-the-art FID score of 3.17. On 256x256 LSUN, we obtain sample quality similar to ProgressiveGAN. Our implementation is available at this https URL

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Statistical and Nonlinear Physics, Generative Models, Probabilistic & Bayesian Methods

View Paper: https://arxiv.org/abs/2006.11239

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Sergey Levine
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Quoc V. Le
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Dacheng Tao

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Andrea Vedaldi

In Statistical and Nonlinear Physics

  1. Arash Vahdat
  2. Yang Song
  3. Stefano Ermon
  4. Jonathan Ho
  5. Karsten Kreis
  6. Diederik P. Kingma
  7. Prafulla Dhariwal
  8. Jun Zhu

In Generative Models

  1. Arash Vahdat
  2. Stefano Ermon
  3. Jun-Yan Zhu
  4. Karsten Kreis
  5. Richard Zhang
  6. Eli Shechtman
  7. Jiaming Song
  8. Jan Kautz

In Probabilistic & Bayesian Methods

  1. Stefano Ermon
  2. Yoshua Bengio
  3. Yang Song
  4. Arash Vahdat
  5. Diederik P. Kingma
  6. Aaron C. Courville
  7. Max Welling
  8. Jiaming Song

Citations in the corpus