Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

By Chelsea Finn, Pieter Abbeel, Sergey Levine. 2017

14,813 citations recorded by the source corpus.

We propose an algorithm for meta-learning that is model-agnostic, in the sense that it is compatible with any model trained with gradient descent and applicable to a variety of different learning problems, including classification, regression, and reinforcement learning. The goal of meta-learning is to train a model on a variety of learning tasks, such that it can solve new learning tasks using only a small number of training samples. In our approach, the parameters of the model are explicitly trained such that a small number of gradient steps with a small amount of training data from a new task will produce good generalization performance on that task. In effect, our method trains the model to be easy to fine-tune. We demonstrate that this approach leads to state-of-the-art performance on two few-shot image classification benchmarks, produces good results on few-shot regression, and accelerates fine-tuning for policy gradient reinforcement learning with neural network policies.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Quoc V. Le
  5. Jianfeng Gao
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Trevor Darrell

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Bernt Schiele
  8. Andrew Zisserman

In Representation & Self-Supervised Learning

  1. Yoshua Bengio
  2. Trevor Darrell
  3. Sergey Levine
  4. Han-Jia Ye
  5. Dacheng Tao
  6. De-chuan Zhan
  7. Andrea Vedaldi
  8. Fei Sha

Citations in the corpus