Graph Clustering with Graph Neural Networks

By Anton Tsitsulin, John Palowitch, Bryan Perozzi, Emmanuel Müller. Journal of machine learning research, 2020

410 citations recorded by the source corpus.

Graph Neural Networks (GNNs) have achieved state-of-the-art results on many graph analysis tasks such as node classification and link prediction. However, important unsupervised problems on graphs, such as graph clustering, have proved more resistant to advances in GNNs. In this paper, we study unsupervised training of GNN pooling in terms of their clustering capabilities. We start by drawing a connection between graph clustering and graph pooling: intuitively, a good graph clustering is what one would expect from a GNN pooling layer. Counterintuitively, we show that this is not true for state-of-the-art pooling methods, such as MinCut pooling. To address these deficiencies, we introduce Deep Modularity Networks (DMoN), an unsupervised pooling method inspired by the modularity measure of clustering quality, and show how it tackles recovery of the challenging clustering structure of real-world graphs. In order to clarify the regimes where existing methods fail, we carefully design a set of experiments on synthetic data which show that DMoN is able to jointly leverage the signal from the graph structure and node attributes. Similarly, on real-world data, we show that DMoN produces high quality clusters which correlate strongly with ground truth labels, achieving state-of-the-art results.

Subfields: Artificial Intelligence, Molecular Biology, Statistical and Nonlinear Physics

View Paper: https://www.semanticscholar.org/paper/81a5cdc8fb5c58e7876b60fb735a785a9b16f62f

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Christopher R'e
  2. Ines Chami
  3. Kevin P. Murphy
  4. Sami Abu-El-Haija
  5. Bryan Perozzi
  6. Quoc V. Le
  7. Yoshua Bengio
  8. Mohit Bansal

In Molecular Biology

  1. Sami Abu-El-Haija
  2. Kevin P. Murphy
  3. Christopher R'e
  4. Bryan Perozzi
  5. Ines Chami

In Statistical and Nonlinear Physics

  1. Sami Abu-El-Haija
  2. Kevin P. Murphy
  3. Christopher R'e
  4. Bryan Perozzi
  5. Ines Chami

Citations in the corpus