Meta-Learning in Neural Networks: A Survey

By Timothy M. Hospedales, Antreas Antoniou, Paul Micaelli, Amos J. Storkey. 2020

2,723 citations recorded by the source corpus.

The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent years. Contrary to conventional approaches to AI where tasks are solved from scratch using a fixed learning algorithm, meta-learning aims to improve the learning algorithm itself, given the experience of multiple learning episodes. This paradigm provides an opportunity to tackle many conventional challenges of deep learning, including data and computation bottlenecks, as well as generalization. This survey describes the contemporary meta-learning landscape. We first discuss definitions of meta-learning and position it with respect to related fields, such as transfer learning and hyperparameter optimization. We then propose a new taxonomy that provides a more comprehensive breakdown of the space of meta-learning methods today. We survey promising applications and successes of meta-learning such as few-shot learning and reinforcement learning. Finally, we discuss outstanding challenges and promising areas for future research.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Quoc V. Le
  5. Dacheng Tao
  6. Jianfeng Gao
  7. Percy Liang
  8. Ruslan Salakhutdinov

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Xiaogang Wang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Andrea Vedaldi
  8. Yi Yang

In Meta & Continual Learning

  1. Zheda Mai
  2. Massimo Caccia
  3. Scott Sanner
  4. Hyunwoo J. Kim
  5. Xialei Liu
  6. Hakan Bilen
  7. Timothée Lesort
  8. Irina Rish

Citations in the corpus