Meta Networks

By Tsendsuren Munkhdalai, Hong Yu. 2017

1,161 citations recorded by the source corpus.

Neural networks have been successfully applied in applications with a large amount of labeled data. However, the task of rapid generalization on new concepts with small training data while preserving performances on previously learned ones still presents a significant challenge to neural network models. In this work, we introduce a novel meta learning method, Meta Networks (MetaNet), that learns a meta-level knowledge across tasks and shifts its inductive biases via fast parameterization for rapid generalization. When evaluated on Omniglot and Mini-ImageNet benchmarks, our MetaNet models achieve a near human-level performance and outperform the baseline approaches by up to 6% accuracy. We demonstrate several appealing properties of MetaNet relating to generalization and continual learning.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Quoc V. Le
  6. Trevor Darrell
  7. Dacheng Tao
  8. Percy Liang

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Bernt Schiele
  7. Jitendra Malik
  8. Yi Yang

In Meta & Continual Learning

  1. Chelsea Finn
  2. Sergey Levine
  3. Han-Jia Ye
  4. Bernt Schiele
  5. Qianru Sun
  6. Yaoyao Liu
  7. De-chuan Zhan
  8. Wei-Lun Chao

Citations in the corpus