Diffusion Models Beat GANs on Image Synthesis

By Prafulla Dhariwal, Alex Nichol. 2021

12,477 citations recorded by the source corpus.

We show that diffusion models can achieve image sample quality superior to the current state-of-the-art generative models. We achieve this on unconditional image synthesis by finding a better architecture through a series of ablations. For conditional image synthesis, we further improve sample quality with classifier guidance: a simple, compute-efficient method for trading off diversity for fidelity using gradients from a classifier. We achieve an FID of 2.97 on ImageNet 128$\times$128, 4.59 on ImageNet 256$\times$256, and 7.72 on ImageNet 512$\times$512, and we match BigGAN-deep even with as few as 25 forward passes per sample, all while maintaining better coverage of the distribution. Finally, we find that classifier guidance combines well with upsampling diffusion models, further improving FID to 3.94 on ImageNet 256$\times$256 and 3.85 on ImageNet 512$\times$512. We release our code at https://github.com/openai/guided-diffusion

Subfields: Biophysics, Computer Vision and Pattern Recognition, Statistical and Nonlinear Physics, Generative Models

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Biophysics

  1. Yang Song
  2. Prafulla Dhariwal
  3. Richard Zhang
  4. Jun-Yan Zhu
  5. Jonathan Ho
  6. Diederik P. Kingma
  7. Jong Chul Ye
  8. Stefano Ermon

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Ming-Hsuan Yang
  3. Dacheng Tao
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrea Vedaldi
  8. Andrew Zisserman

In Statistical and Nonlinear Physics

  1. Arash Vahdat
  2. Yang Song
  3. Stefano Ermon
  4. Karsten Kreis
  5. Jonathan Ho
  6. Prafulla Dhariwal
  7. Diederik P. Kingma
  8. Jun Zhu

In Generative Models

  1. Arash Vahdat
  2. Jun-Yan Zhu
  3. Stefano Ermon
  4. Eli Shechtman
  5. Richard Zhang
  6. Karsten Kreis
  7. Alexei A. Efros
  8. Daniel Cohen-Or

Citations in the corpus