Variational Autoencoders for Collaborative Filtering

By Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, Tony Jebara. The Web Conference, 2018

1,520 citations recorded by the source corpus.

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate collaborative filtering research.We introduce a generative model with multinomial likelihood and use Bayesian inference for parameter estimation. Despite widespread use in language modeling and economics, the multinomial likelihood receives less attention in the recommender systems literature. We introduce a different regularization parameter for the learning objective, which proves to be crucial for achieving competitive performance. Remarkably, there is an efficient way to tune the parameter using annealing. The resulting model and learning algorithm has information-theoretic connections to maximum entropy discrimination and the information bottleneck principle. Empirically, we show that the proposed approach significantly outperforms several state-of-the-art baselines, including two recently-proposed neural network approaches, on several real-world datasets. We also provide extended experiments comparing the multinomial likelihood with other commonly used likelihood functions in the latent factor collaborative filtering literature and show favorable results. Finally, we identify the pros and cons of employing a principled Bayesian inference approach and characterize settings where it provides the most significant improvements.

Subfields: Computer Vision and Pattern Recognition, Information Systems, Probabilistic & Bayesian Methods, Recommender Systems, Signal Processing

View Paper: https://arxiv.org/abs/1802.05814

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Xiangnan He
  2. Tat-seng Chua
  3. Dacheng Tao
  4. Xiang Wang
  5. Luc Van Gool
  6. Meng Wang
  7. Trevor Darrell
  8. Xiaogang Wang

In Information Systems

  1. Xiangnan He
  2. Xiang Wang
  3. Tat-seng Chua
  4. Meng Wang
  5. Fuli Feng
  6. Hongzhi Yin
  7. Wayne Xin Zhao
  8. Yongfeng Zhang

In Probabilistic & Bayesian Methods

  1. Brooks Paige
  2. Jan-Willem van de Meent
  3. Adji Bousso Dieng
  4. Hang Li
  5. Jun Xu
  6. David M. Blei
  7. Alexander M. Rush
  8. Yoon Kim

In Recommender Systems

  1. Xiangnan He
  2. Xiang Wang
  3. Tat-seng Chua
  4. Fuli Feng
  5. Yi Tay
  6. Julian McAuley
  7. Liqiang Nie
  8. Meng Wang

In Signal Processing

  1. Vojtěch Vančura
  2. Pavel Kordík
  3. Milan Straka
  4. Hang Li
  5. Jun Xu
  6. Harald Steck
  7. Wayne Xin Zhao
  8. Aminu Da’u

Citations in the corpus