Self-Supervised Learning for Few-Shot Image Classification
By Da Chen, YueFeng Chen, Yuhong Li, Feng Mao, Yuan He, Hui Xue. 2019
132 citations recorded by the source corpus.
Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited number of samples for each task, the initial embedding network for meta-learning becomes an essential component and can largely affect the performance in practice. To this end, most of the existing methods highly rely on the efficient embedding network. Due to the limited labelled data, the scale of embedding network is constrained under a supervised learning(SL) manner which becomes a bottleneck of the few-shot learning methods. In this paper, we proposed to train a more generalized embedding network with self-supervised learning (SSL) which can provide robust representation for downstream tasks by learning from the data itself. We evaluate our work by extensive comparisons with previous baseline methods on two few-shot classification datasets (i.e., MiniImageNet and CUB) and achieve better performance over baselines. Tests on four datasets in cross-domain few-shot learning classification show that the proposed method achieves state-of-the-art results and further prove the robustness of the proposed model. Our code is available at https://github.com/phecy/SSL-FEW-SHOT.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Radiology, Nuclear Medicine and Imaging, Representation & Self-Supervised Learning
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Katja Hofmann
- Daniela Massiceti
- Edward Cutrell
- Simone Stumpf
- Luisa M. Zintgraf
- John F. Bronskill
- Chelsea Finn
- Sergey Levine
In Computer Vision and Pattern Recognition
- Cecily Morrison
- Katja Hofmann
- Edward Cutrell
- Simone Stumpf
- Lida Theodorou
- Luisa M. Zintgraf
- Daniela Massiceti
- John F. Bronskill
In Representation & Self-Supervised Learning
Citations in the corpus
- ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition (2021, background): “While these datasets have catalyzed research in few-shot learning, state-of-the-art performance is now relatively saturated and leaves reduced scope for algorithmic innovation [16, 4, 33].”
- A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities (2022, unknown): “SSL-FEW [227] ICASSP’21 Embedding AmdimNet 76.”