Hyperbolic Neural Networks

By Octavian-Eugen Ganea, Gary Bécigneul, Thomas Hofmann. Neural Information Processing Systems, 2018

842 citations recorded by the source corpus.

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean geometry, mostly because of the absence of corresponding hyperbolic neural network layers. This makes it hard to use hyperbolic embeddings in downstream tasks. Here, we bridge this gap in a principled manner by combining the formalism of Mobius gyrovector spaces with the Riemannian geometry of the Poincare model of hyperbolic spaces. As a result, we derive hyperbolic versions of important deep learning tools: multinomial logistic regression, feed-forward and recurrent neural networks such as gated recurrent units. This allows to embed sequential data and perform classification in the hyperbolic space. Empirically, we show that, even if hyperbolic optimization tools are limited, hyperbolic sentence embeddings either outperform or are on par with their Euclidean variants on textual entailment and noisy-prefix recognition tasks.

Subfields: Artificial Intelligence, Computational Mathematics, Computational Theory and Mathematics

View Paper: https://www.semanticscholar.org/paper/562fa7faef812294bb1f235c97584f8560fb5cc0

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Christopher R'e
  2. Yoshua Bengio
  3. Timothy M. Hospedales
  4. Quoc V. Le
  5. Jure Leskovec
  6. Percy Liang
  7. Sergey Levine
  8. Mohit Bansal

In Computational Mathematics

  1. Timothy M. Hospedales
  2. Ivana Balazevic
  3. Carl Allen
  4. Octavian-Eugen Ganea
  5. Gary Bécigneul
  6. A. Tifrea
  7. Christopher R'e
  8. Jure Leskovec

In Computational Theory and Mathematics

  1. Timothy M. Hospedales
  2. Gary Bécigneul
  3. Octavian-Eugen Ganea
  4. Rex Ying
  5. Ivana Balazevic
  6. Carl Allen
  7. A. Tifrea
  8. Frank No'e

Citations in the corpus