Graph Convolutional Neural Networks for Web-Scale Recommender Systems

By Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, Jure Leskovec. Knowledge Discovery and Data Mining, 2018

4,201 citations recorded by the source corpus.

Recent advancements in deep neural networks for graph-structured data have led to state-of-the-art performance on recommender system benchmarks. However, making these methods practical and scalable to web-scale recommendation tasks with billions of items and hundreds of millions of users remains an unsolved challenge. Here we describe a large-scale deep recommendation engine that we developed and deployed at Pinterest. We develop a data-efficient Graph Convolutional Network (GCN) algorithm, which combines efficient random walks and graph convolutions to generate embeddings of nodes (i.e., items) that incorporate both graph structure as well as node feature information. Compared to prior GCN approaches, we develop a novel method based on highly efficient random walks to structure the convolutions and design a novel training strategy that relies on harder-and-harder training examples to improve robustness and convergence of the model. We also develop an efficient MapReduce model inference algorithm to generate embeddings using a trained model. Overall, we can train on and embed graphs that are four orders of magnitude larger than typical GCN implementations. We show how GCN embeddings can be used to make high-quality recommendations in various settings at Pinterest, which has a massive underlying graph with 3 billion nodes representing pins and boards, and 17 billion edges. According to offline metrics, user studies, as well as A/B tests, our approach generates higher-quality recommendations than comparable deep learning based systems. To our knowledge, this is by far the largest application of deep graph embeddings to date and paves the way for a new generation of web-scale recommender systems based on graph convolutional architectures.

Subfields: Artificial Intelligence, Information Systems, Graph Learning, Recommender Systems

View Paper: https://arxiv.org/abs/1806.01973

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Jure Leskovec
  3. Xiangnan He
  4. Percy Liang
  5. Mohit Bansal
  6. William L. Hamilton
  7. Jianfeng Gao
  8. Quoc V. Le

In Information Systems

  1. Xiangnan He
  2. Xiang Wang
  3. Tat-seng Chua
  4. Xing Xie
  5. Meng Wang
  6. Fuli Feng
  7. Liqiang Nie
  8. Yong Li

In Graph Learning

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Matthias Fey
  5. Michael M. Bronstein
  6. Rex Ying
  7. Marinka Zitnik
  8. Aleksandar Bojchevski

In Recommender Systems

  1. Xiangnan He
  2. Xiang Wang
  3. Xing Xie
  4. Tat-seng Chua
  5. Meng Wang
  6. Julian McAuley
  7. Chuhan Wu
  8. Fangzhao Wu

Citations in the corpus