Few-Shot Object Detection via Feature Reweighting

By Bingyi Kang, Zhuang Liu, Xin Wang, Fisher Yu, Jiashi Feng, Trevor Darrell. 2018

862 citations recorded by the source corpus.

Conventional training of a deep CNN based object detector demands a large number of bounding box annotations, which may be unavailable for rare categories. In this work we develop a few-shot object detector that can learn to detect novel objects from only a few annotated examples. Our proposed model leverages fully labeled base classes and quickly adapts to novel classes, using a meta feature learner and a reweighting module within a one-stage detection architecture. The feature learner extracts meta features that are generalizable to detect novel object classes, using training data from base classes with sufficient samples. The reweighting module transforms a few support examples from the novel classes to a global vector that indicates the importance or relevance of meta features for detecting the corresponding objects. These two modules, together with a detection prediction module, are trained end-to-end based on an episodic few-shot learning scheme and a carefully designed loss function. Through extensive experiments we demonstrate that our model outperforms well-established baselines by a large margin for few-shot object detection, on multiple datasets and settings. We also present analysis on various aspects of our proposed model, aiming to provide some inspiration for future few-shot detection works.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Radiology, Nuclear Medicine and Imaging, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Trevor Darrell
  4. Dacheng Tao
  5. Sergey Levine
  6. Yoshua Bengio
  7. Quoc V. Le
  8. Jiashi Feng

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Bernt Schiele
  7. Jitendra Malik
  8. Andrew Zisserman

In Radiology, Nuclear Medicine and Imaging

  1. Jiashi Feng
  2. Weicheng Kuo
  3. Nick Barnes
  4. Shafin Rahman
  5. Martial Hebert
  6. Yu-Xiong Wang
  7. Tsung-Yi Lin
  8. Deva Ramanan

In Meta & Continual Learning

  1. Salman Hameed Khan
  2. Amos J. Storkey
  3. Yang Xiao
  4. Vincent Lepetit
  5. Renaud Marlet
  6. Lorenzo Pellegrini
  7. Antreas Antoniou
  8. Trevor Darrell

Citations in the corpus