Stochastic variational inference

By Matthew D. Hoffman, David M. Blei, Chong Wang, John William Paisley. 2012

2,851 citations recorded by the source corpus.

We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models, latent Dirichlet allocation and the hierarchical Dirichlet process topic model. Using stochastic variational inference, we analyze several large collections of documents: 300K articles from Nature, 1.8M articles from The New York Times, and 3.8M articles from Wikipedia. Stochastic inference can easily handle data sets of this size and outperforms traditional variational inference, which can only handle a smaller subset. (We also show that the Bayesian nonparametric topic model outperforms its parametric counterpart.) Stochastic variational inference lets us apply complex Bayesian models to massive data sets.

Subfields: Artificial Intelligence, Statistics and Probability, Probabilistic & Bayesian Methods

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Sergey Levine
  3. Mohit Bansal
  4. Ruslan Salakhutdinov
  5. Jianfeng Gao
  6. Quoc V. Le
  7. Percy Liang
  8. Kyunghyun Cho

In Statistics and Probability

  1. David M. Blei
  2. Qiang Liu
  3. Michalis K. Titsias
  4. Rajesh Ranganath
  5. Zoubin Ghahramani
  6. Stephan Mandt
  7. Matthew D. Hoffman
  8. Richard E. Turner

In Probabilistic & Bayesian Methods

  1. David M. Blei
  2. Zoubin Ghahramani
  3. Richard E. Turner
  4. Max Welling
  5. Stefano Ermon
  6. Qiang Liu
  7. Rajesh Ranganath
  8. Yarin Gal

Citations in the corpus