A Survey on Transfer Learning

By Sinno Jialin Pan, Qiang Yang. 2010

23,590 citations recorded by the source corpus.

A major assumption in many machine learning and data mining algorithms is that the training and future data must be in the same feature space and have the same distribution. However, in many real-world applications, this assumption may not hold. For example, we sometimes have a classification task in one domain of interest, but we only have sufficient training data in another domain of interest, where the latter data may be in a different feature space or follow a different data distribution. In such cases, knowledge transfer, if done successfully, would greatly improve the performance of learning by avoiding much expensive data-labeling efforts. In recent years, transfer learning has emerged as a new learning framework to address this problem. This survey focuses on categorizing and reviewing the current progress on transfer learning for classification, regression, and clustering problems. In this survey, we discuss the relationship between transfer learning and other related machine learning techniques such as domain adaptation, multitask learning and sample selection bias, as well as covariate shift. We also explore some potential future issues in transfer learning research.

Subfields: Artificial Intelligence, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Sergey Levine
  4. Quoc V. Le
  5. Jianfeng Gao
  6. Percy Liang
  7. Dacheng Tao
  8. Trevor Darrell

In Representation & Self-Supervised Learning

  1. Mingsheng Long
  2. Jianmin Wang
  3. Trevor Darrell
  4. Dacheng Tao
  5. Mohammad Rostami
  6. Kate Saenko
  7. Andrea Vedaldi
  8. Qiang Yang

Citations in the corpus