Hierarchical Graph Representation Learning with Differentiable Pooling

By Rex Ying, Jiaxuan You, Christopher Morris, Xiang Ren, William L. Hamilton, Jure Leskovec. 2018

2,540 citations recorded by the source corpus.

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link prediction. However, current GNN methods are inherently flat and do not learn hierarchical representations of graphs---a limitation that is especially problematic for the task of graph classification, where the goal is to predict the label associated with an entire graph. Here we propose DiffPool, a differentiable graph pooling module that can generate hierarchical representations of graphs and can be combined with various graph neural network architectures in an end-to-end fashion. DiffPool learns a differentiable soft cluster assignment for nodes at each layer of a deep GNN, mapping nodes to a set of clusters, which then form the coarsened input for the next GNN layer. Our experimental results show that combining existing GNN methods with DiffPool yields an average improvement of 5-10% accuracy on graph classification benchmarks, compared to all existing pooling approaches, achieving a new state-of-the-art on four out of five benchmark datasets.

Subfields: Artificial Intelligence, Information Systems, Statistical and Nonlinear Physics, Graph Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Percy Liang
  3. Mohit Bansal
  4. Jure Leskovec
  5. Ruslan Salakhutdinov
  6. Sergey Levine
  7. Jianfeng Gao
  8. Quoc V. Le

In Information Systems

  1. Charu C. Aggarwal
  2. Philip S. Yu
  3. Jure Leskovec
  4. Marinka Zitnik
  5. Yoshua Bengio
  6. George Karypis
  7. Michael M. Bronstein
  8. Xiangnan He

In Statistical and Nonlinear Physics

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Philip S. Yu
  5. Marinka Zitnik
  6. Matthias Fey
  7. Rex Ying
  8. Michael M. Bronstein

In Graph Learning

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Matthias Fey
  5. Michael M. Bronstein
  6. Rex Ying
  7. Marinka Zitnik
  8. Jian Tang

Citations in the corpus