Categorical Reparameterization with Gumbel-Softmax

By Eric Jang, Shixiang Shane Gu, Ben Poole. 2016

6,514 citations recorded by the source corpus.

Categorical variables are a natural choice for representing discrete structure in the world. However, stochastic neural networks rarely use categorical latent variables due to the inability to backpropagate through samples. In this work, we present an efficient gradient estimator that replaces the non-differentiable sample from a categorical distribution with a differentiable sample from a novel Gumbel-Softmax distribution. This distribution has the essential property that it can be smoothly annealed into a categorical distribution. We show that our Gumbel-Softmax estimator outperforms state-of-the-art gradient estimators on structured output prediction and unsupervised generative modeling tasks with categorical latent variables, and enables large speedups on semi-supervised classification.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Generative Models

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Sergey Levine
  4. Jianfeng Gao
  5. Quoc V. Le
  6. Percy Liang
  7. Luke S. Zettlemoyer
  8. Ruslan Salakhutdinov

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Generative Models

  1. Stefano Ermon
  2. Yoshua Bengio
  3. Arash Vahdat
  4. Jiaming Song
  5. Diederik P. Kingma
  6. Aaron C. Courville
  7. Sergey Levine
  8. Jan Kautz

Citations in the corpus