Sparse Variational Analysis of Linear Mixed Models for Large Data Sets.

By Artin Armagan, David B. Dunson. 2011

10 citations recorded by the source corpus.

It is increasingly common to be faced with longitudinal or multi-level data sets that have large numbers of predictors and/or a large sample size. Current methods of fitting and inference for mixed effects models tend to perform poorly in such settings. When there are many variables, it is appealing to allow uncertainty in subset selection and to obtain a sparse characterization of the data. Bayesian methods are available to address these goals using Markov chain Monte Carlo (MCMC), but MCMC is very computationally expensive and can be infeasible in large p and/or large n problems. As a fast approximate Bayes solution, we recommend a novel approximation to the posterior relying on variational methods. Variational methods are used to approximate the posterior of the parameters in a decomposition of the variance components, with priors chosen to obtain a sparse solution that allows selection of random effects. The method is evaluated through a simulation study, and applied to an epidemiological application.

Subfields: Artificial Intelligence, Statistics and Probability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. David M. Blei
  2. Alp Kucukelbir
  3. Jon D. McAuliffe
  4. Stephan Mandt
  5. Rajesh Ranganath
  6. Michael I. Jordan
  7. Dustin Tran
  8. Matthew D. Hoffman

In Statistics and Probability

  1. Alp Kucukelbir
  2. Jon D. McAuliffe
  3. David M. Blei
  4. Rajesh Ranganath
  5. Qiang Liu
  6. Stephan Mandt
  7. Michalis K. Titsias
  8. Dustin Tran

Citations in the corpus