SuperGlue: Learning Feature Matching With Graph Neural Networks

By Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich. 2019

2,839 citations recorded by the source corpus.

This paper introduces SuperGlue, a neural network that matches two sets of local features by jointly finding correspondences and rejecting non-matchable points. Assignments are estimated by solving a differentiable optimal transport problem, whose costs are predicted by a graph neural network. We introduce a flexible context aggregation mechanism based on attention, enabling SuperGlue to reason about the underlying 3D scene and feature assignments jointly. Compared to traditional, hand-designed heuristics, our technique learns priors over geometric transformations and regularities of the 3D world through end-to-end training from image pairs. SuperGlue outperforms other learned approaches and achieves state-of-the-art results on the task of pose estimation in challenging real-world indoor and outdoor environments. The proposed method performs matching in real-time on a modern GPU and can be readily integrated into modern SfM or SLAM systems. The code and trained weights are publicly available at github.com/magicleap/SuperGluePretrainedNetwork.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, Graph Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Marc Pollefeys
  2. Andreas Geiger
  3. Jitendra Malik
  4. Pascal Fua
  5. Eduard Trulls
  6. Jia Deng
  7. Kristen Grauman
  8. Luc Van Gool

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Jitendra Malik
  4. Ming-Hsuan Yang
  5. Trevor Darrell
  6. Kristen Grauman
  7. Xiaogang Wang
  8. Andrew Zisserman

In Graph Learning

  1. Bernard Ghanem
  2. Jia Deng
  3. Zachary Teed
  4. Marc Pollefeys
  5. Allan Jabri
  6. Dacheng Tao
  7. Antonio Torralba
  8. Long Quan

Citations in the corpus