Improvability Through Semi-Supervised Learning: A Survey of Theoretical Results

By Alexander Mey, Marco Loog. 2019

20 citations recorded by the source corpus.

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods that use unlabeled data rely on certain assumptions about the data distribution. When those assumptions are not met in reality, including unlabeled data may actually decrease performance. Studying such methods, it therefore is particularly important to have an understanding of the underlying theory. In this review we gather results about the possible gains one can achieve when using semi-supervised learning as well as results about the limits of such methods. More precisely, this review collects the answers to the following questions: What are, in terms of improving supervised methods, the limits of semi-supervised learning? What are the assumptions of different methods? What can we achieve if the assumptions are true? Finally, we also discuss the biggest bottleneck of semi-supervised learning, namely the assumptions they make.

Subfields: Artificial Intelligence

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Rong Jin
2. Qi Qian
3. Hao Li
4. Baigui Sun
5. Lei Shang
6. Yi Xu
7. Yu-Feng Li
8. Jinxing Ye

Citations in the corpus

• Dash: Semi-Supervised Learning with Dynamic Thresholding (2021, background): “An non-exhaustive list of those studies include [Cozman et al., 2003, Singh et al., 2009, Li and Zhou, 2011a, Balsubramani and Freund, 2015, Loog, 2015, Li et al., 2017, Krijthe and Loog, 2017, Li et al., 2021, Mey and Loog, 2019, Guo et al., 2020].”