Causal Inference Using the Algorithmic Markov Condition

By Dominik Janzing, Bernhard Schölkopf. 2008

345 citations recorded by the source corpus.

Inferring the causal structure that links n observables is usually based upon detecting statistical dependences and choosing simple graphs that make the joint measure Markovian. Here we argue why causal inference is also possible when the sample size is one. We develop a theory how to generate causal graphs explaining similarities between single objects. To this end, we replace the notion of conditional stochastic independence in the causal Markov condition with the vanishing of conditional algorithmic mutual information and describe the corresponding causal inference rules. We explain why a consistent reformulation of causal inference in terms of algorithmic complexity implies a new inference principle that takes into account also the complexity of conditional probability densities, making it possible to select among Markov equivalent causal graphs. This insight provides a theoretical foundation of a heuristic principle proposed in earlier work. We also sketch some ideas on how to replace Kolmogorov complexity with decidable complexity criteria. This can be seen as an algorithmic analog of replacing the empirically undecidable question of statistical independence with practical independence tests that are based on implicit or explicit assumptions on the underlying distribution.

Subfields: Artificial Intelligence, Computational Theory and Mathematics, Causal Inference & Discovery, Information Theory

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Bernhard Schölkopf
  2. Yoshua Bengio
  3. Dacheng Tao
  4. Sergey Levine
  5. Quoc V. Le
  6. David Lopez-Paz
  7. Jan Peters
  8. Mohit Bansal

In Computational Theory and Mathematics

  1. Bernhard Schölkopf
  2. Kun Zhang
  3. Dominik Janzing
  4. Jan Peters
  5. David Lopez-Paz
  6. Jilles Vreeken
  7. Dino Sejdinovic
  8. Biwei Huang

In Causal Inference & Discovery

  1. Bernhard Schölkopf
  2. Dominik Janzing
  3. Kun Zhang
  4. David Lopez-Paz
  5. Jan Peters
  6. Joris M. Mooij
  7. Jilles Vreeken
  8. Stefan Bauer

In Information Theory

  1. Bernhard Schölkopf
  2. Dominik Janzing
  3. David Lopez-Paz
  4. Kun Zhang
  5. Jilles Vreeken
  6. Jan Peters
  7. Joris M. Mooij
  8. Kailash Budhathoki

Citations in the corpus