Graph Attention Networks

By Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio', Yoshua Bengio. International Conference on Learning Representations, 2017

27,282 citations recorded by the source corpus.

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or their approximations. By stacking layers in which nodes are able to attend over their neighborhoods' features, we enable (implicitly) specifying different weights to different nodes in a neighborhood, without requiring any kind of costly matrix operation (such as inversion) or depending on knowing the graph structure upfront. In this way, we address several key challenges of spectral-based graph neural networks simultaneously, and make our model readily applicable to inductive as well as transductive problems. Our GAT models have achieved or matched state-of-the-art results across four established transductive and inductive graph benchmarks: the Cora, Citeseer and Pubmed citation network datasets, as well as a protein-protein interaction dataset (wherein test graphs remain unseen during training).

Subfields: Artificial Intelligence, Materials Chemistry, Molecular Biology, Model Architectures, Graph Learning

View Paper: https://arxiv.org/abs/1710.10903

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Yoshua Bengio
  3. Jianfeng Gao
  4. Percy Liang
  5. Quoc V. Le
  6. Sergey Levine
  7. Luke S. Zettlemoyer
  8. Ruslan Salakhutdinov

In Materials Chemistry

  1. William L. Hamilton
  2. Tommi S. Jaakkola
  3. Regina Barzilay
  4. Jure Leskovec
  5. Jian Tang
  6. Marinka Zitnik
  7. Wengong Jin
  8. Yoshua Bengio

In Molecular Biology

  1. William L. Hamilton
  2. Jure Leskovec
  3. Tommi S. Jaakkola
  4. Stephan Günnemann
  5. Rex Ying
  6. Regina Barzilay
  7. Marinka Zitnik
  8. Aleksandar Bojchevski

In Model Architectures

  1. Yoshua Bengio
  2. Quoc V. Le
  3. Ruslan Salakhutdinov
  4. Mohit Bansal
  5. Kyunghyun Cho
  6. Jianfeng Gao
  7. J. Urgen Schmidhuber
  8. Aaron C. Courville

In Graph Learning

  1. William L. Hamilton
  2. Jure Leskovec
  3. Stephan Günnemann
  4. Matthias Fey
  5. Michael M. Bronstein
  6. Rex Ying
  7. Aleksandar Bojchevski
  8. Marinka Zitnik

Citations in the corpus