Spatial Transformer Networks

By Max Jaderberg, Karen Simonyan, Andrew Zisserman, Koray Kavukcuoglu. 2015

8,156 citations recorded by the source corpus.

Convolutional Neural Networks define an exceptionally powerful class of models, but are still limited by the lack of ability to be spatially invariant to the input data in a computationally and parameter efficient manner. In this work we introduce a new learnable module, the Spatial Transformer, which explicitly allows the spatial manipulation of data within the network. This differentiable module can be inserted into existing convolutional architectures, giving neural networks the ability to actively spatially transform feature maps, conditional on the feature map itself, without any extra training supervision or modification to the optimisation process. We show that the use of spatial transformers results in models which learn invariance to translation, scale, rotation and more generic warping, resulting in state-of-the-art performance on several benchmarks, and for a number of classes of transformations.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Model Architectures

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Sergey Levine
  3. Mohit Bansal
  4. Quoc V. Le
  5. Trevor Darrell
  6. Dacheng Tao
  7. Jianfeng Gao
  8. Ruslan Salakhutdinov

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Xiaogang Wang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Model Architectures

  1. Quoc V. Le
  2. Yoshua Bengio
  3. Alan L. Yuille
  4. Kaiming He
  5. Xiaogang Wang
  6. Ruslan Salakhutdinov
  7. Dacheng Tao
  8. Jiashi Feng

Citations in the corpus