Generative Adversarial Text to Image Synthesis

By Scott E. Reed, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, Honglak Lee. 2016

3,433 citations recorded by the source corpus.

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed to learn discriminative text feature representations. Meanwhile, deep convolutional generative adversarial networks (GANs) have begun to generate highly compelling images of specific categories, such as faces, album covers, and room interiors. In this work, we develop a novel deep architecture and GAN formulation to effectively bridge these advances in text and image modeling, translating visual concepts from characters to pixels. We demonstrate the capability of our model to generate plausible images of birds and flowers from detailed text descriptions.

Subfields: Computer Vision and Pattern Recognition, Generative Models, Multimodal Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Yi Yang
  8. Bernt Schiele

In Generative Models

  1. Jun-Yan Zhu
  2. Richard Zhang
  3. Stefano Ermon
  4. Eli Shechtman
  5. Alexei A. Efros
  6. Ming-Hsuan Yang
  7. Yoshua Bengio
  8. Daniel Cohen-Or

In Multimodal Learning

  1. Zhe Gan
  2. Mohit Bansal
  3. Devi Parikh
  4. Jianfeng Gao
  5. Trevor Darrell
  6. Marcus Rohrbach
  7. Linjie Li
  8. Lijuan Wang

Citations in the corpus