Estimating the Marginal Likelihood Using the Arithmetic Mean Identity

By Anna Pajor. 2017

50 citations recorded by the source corpus.

In this paper we propose a conceptually straightforward method to estimate the marginal data density value (also called the marginal likelihood). We show that the marginal likelihood is equal to the prior mean of the conditional density of the data given the vector of parameters restricted to a certain subset of the parameter space, A, times the reciprocal of the posterior probability of the subset A. This identity motivates one to use Arithmetic Mean estimator based on simulation from the prior distribution restricted to any (but reasonable) subset of the space of parameters. By trimming this space, regions of relatively low likelihood are removed, and thereby the efficiency of the Arithmetic Mean estimator is improved. We show that the adjusted Arithmetic Mean estimator is unbiased and consistent.

Subfields: Artificial Intelligence, Statistics and Probability

View Paper: https://www.semanticscholar.org/paper/a049873399b9dcbedacb1d203970f1d1c3bd17c8

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. H. Steingroever
  2. Ruud Wetzels
  3. Annette Horstmann
  4. Jane Neumann
  5. Eric-Jan Wagenmakers
  6. Joachim Vandekerckhove

In Statistics and Probability

  1. Ruud Wetzels
  2. H. Steingroever
  3. Jane Neumann
  4. Annette Horstmann
  5. Eric-Jan Wagenmakers
  6. John K. Kruschke
  7. Zoltan Dienes
  8. M. Masson

Citations in the corpus