Zero-Shot Text-to-Image Generation

By Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever. 2021

6,590 citations recorded by the source corpus.

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part labels or segmentation masks supplied during training. We describe a simple approach for this task based on a transformer that autoregressively models the text and image tokens as a single stream of data. With sufficient data and scale, our approach is competitive with previous domain-specific models when evaluated in a zero-shot fashion.

Subfields: Computer Vision and Pattern Recognition, Generative Models, Multimodal Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Andrea Vedaldi

In Generative Models

  1. Jun-Yan Zhu
  2. Stefano Ermon
  3. Richard Zhang
  4. Eli Shechtman
  5. Arash Vahdat
  6. Daniel Cohen-Or
  7. Alexei A. Efros
  8. Karsten Kreis

In Multimodal Learning

  1. Zhe Gan
  2. Lijuan Wang
  3. Jianfeng Gao
  4. Mohit Bansal
  5. Linjie Li
  6. Zicheng Liu
  7. Devi Parikh
  8. Jianfeng Wang

Citations in the corpus