Toward fast and accurate human pose estimation via soft-gated skip connections

By Adrian Bulat, Jean Kossaifi, Georgios Tzimiropoulos, Maja Pantic. 2020

96 citations recorded by the source corpus.

This paper is on highly accurate and highly efficient human pose estimation. Recent works based on Fully Convolutional Networks (FCNs) have demonstrated excellent results for this difficult problem. While residual connections within FCNs have proved to be quintessential for achieving high accuracy, we re-analyze this design choice in the context of improving both the accuracy and the efficiency over the state-of- the-art. In particular, we make the following contributions: (a) We propose gated skip connections with per-channel learnable parameters to control the data flow for each channel within the module within the macro-module. (b) We introduce a hybrid network that combines the HourGlass and U-Net architectures which minimizes the number of identity connections within the network and increases the performance for the same parameter budget. Our model achieves state-of-the-art results on the MPII and LSP datasets. In addition, with a reduction of 3× in model size and complexity, we show no decrease in performance when compared to the original HourGlass network.

Subfields: Artificial Intelligence, Biomedical Engineering, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Vision and Pattern Recognition

Citations in the corpus

Novel Class Discovery without Forgetting (2022, background): “Over the last decade, deep learning algorithms have achieved remarkable performances on multiple computer vision tasks [15,37,50,7,45], even outperforming humans on many of them.”
Spacing Loss for Discovering Novel Categories (2022, background): “Availability of large amount of annotated data has fueled unprecedented success of deep learning in various machine learning tasks [5, 9, 18, 30, 36, 37].”