Spanet: Spatial Pyramid Attention Network for Enhanced Image Recognition
By Jingda Guo, Xu Ma, Andrew Sansom, M. McGuire, Andrew Kalaani, Qi Chen, Sihai Tang, Qing Yang, Song Fu. 2020
99 citations recorded by the source corpus.
Attention mechanism has shown great success in computer vision. In this paper, we introduce Spatial Pyramid Attention Network (SPANet) to investigate the role of attention block for image recognition. Our SPANet is conceptually simple but practically powerful. It enhances the base network by adding Spatial Pyramid Attention (SPA) Blocks laterally. In contrast to other attention based networks that leverage global average pooling, our proposed SPANet considers both structural regularization and structural information. Furthermore, we investigate the topology structure of attention path connection and present three SPANet structures. SPA block is flexible to be deployed to various convolutional neural network (CNN) architectures. The experimental results show that our SPANet significantly improves the recognition accuracy without introducing much computation overhead compared with other CNN models. Codes are made publicly available11https://github.com/13952522076/SPANet
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Neurology, Model Architectures
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
In Neurology
In Model Architectures
Citations in the corpus
- Dynamic Neural Networks: A Survey (2021, background): “The empirical performance of three computational graphs for soft attention is studied in [127]: 1) ỹ = y ⊗ A(y), 2) ỹ = y ⊗ A(x) and 3) ỹ = y ⊗ A(Conv(x)).”