Representation Learning on Graphs with Jumping Knowledge Networks

By Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, Stefanie Sabrina Jegelka. 2018

2,401 citations recorded by the source corpus.

Recent deep learning approaches for representation learning on graphs follow a neighborhood aggregation procedure. We analyze some important properties of these models, and propose a strategy to overcome those. In particular, the range of "neighboring" nodes that a node's representation draws from strongly depends on the graph structure, analogous to the spread of a random walk. To adapt to local neighborhood properties and tasks, we explore an architecture -- jumping knowledge (JK) networks -- that flexibly leverages, for each node, different neighborhood ranges to enable better structure-aware representation. In a number of experiments on social, bioinformatics and citation networks, we demonstrate that our model achieves state-of-the-art performance. Furthermore, combining the JK framework with models like Graph Convolutional Networks, GraphSAGE and Graph Attention Networks consistently improves those models' performance.

Subfields: Artificial Intelligence, Molecular Biology, Statistical and Nonlinear Physics, Representation & Self-Supervised Learning, Graph Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Jure Leskovec
  3. Percy Liang
  4. Mohit Bansal
  5. Sergey Levine
  6. William L. Hamilton
  7. Ruslan Salakhutdinov
  8. Quoc V. Le

In Molecular Biology

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Rex Ying
  5. Marinka Zitnik
  6. Aleksandar Bojchevski
  7. Tommi S. Jaakkola
  8. Jiaxuan You

In Statistical and Nonlinear Physics

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Matthias Fey
  5. Michael M. Bronstein
  6. Marinka Zitnik
  7. Aleksandar Bojchevski
  8. Pan Li

In Representation & Self-Supervised Learning

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Yoshua Bengio
  5. Aleksandar Bojchevski
  6. Stefano Ermon
  7. Marinka Zitnik
  8. Tat-seng Chua

In Graph Learning

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Matthias Fey
  5. Michael M. Bronstein
  6. Rex Ying
  7. Aleksandar Bojchevski
  8. Marinka Zitnik

Citations in the corpus