Recommendations as Treatments: Debiasing Learning and Evaluation

By Tobias Schnabel, Adith Swaminathan, Ashudeep Singh, Navin Chandak, Thorsten Joachims. 2016

833 citations recorded by the source corpus.

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach to handle selection biases by adapting models and estimation techniques from causal inference. The approach leads to unbiased performance estimators despite biased data, and to a matrix factorization method that provides substantially improved prediction performance on real-world data. We theoretically and empirically characterize the robustness of the approach, and find that it is highly practical and scalable.

Subfields: Information Systems, Management Science and Operations Research, Statistics and Probability, Recommender Systems, AI Ethics, Fairness & Society

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Information Systems

  1. Xiangnan He
  2. Xiang Wang
  3. Fuli Feng
  4. Meng Wang
  5. Yong Li
  6. Chen Gao
  7. Thorsten Joachims
  8. Mihaela van der Schaar

In Management Science and Operations Research

  1. Thorsten Joachims
  2. Xiangnan He
  3. Mihaela van der Schaar
  4. Nathan Kallus
  5. Adith Swaminathan
  6. Alekh Agarwal
  7. James Jordon
  8. Alberto Bietti

In Statistics and Probability

  1. Mihaela van der Schaar
  2. James Jordon
  3. Thorsten Joachims
  4. Jinsung Yoon
  5. Ahmed M. Alaa
  6. Adarsh Subbaswamy
  7. Suchi Saria
  8. Alekh Agarwal

In Recommender Systems

  1. Thorsten Joachims
  2. Mihaela van der Schaar
  3. Jinsung Yoon
  4. Xiang Wang
  5. Adith Swaminathan
  6. Fuli Feng
  7. Alekh Agarwal
  8. Xiangnan He

In AI Ethics, Fairness & Society

  1. Mihaela van der Schaar
  2. Jinsung Yoon
  3. Thorsten Joachims
  4. Aram Galstyan
  5. Kangwook Lee
  6. Fred Morstatter
  7. Ninareh Mehrabi
  8. Michael Gira

Citations in the corpus