Latent Embeddings for Zero-Shot Classification

By Yongqin Xian, Zeynep Akata, Gaurav Sharma, Quynh N. Nguyen, Matthias Hein, Bernt Schiele. 2016

750 citations recorded by the source corpus.

We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model by incorporating latent variables. Instead of learning a single bilinear map, it learns a collection of maps with the selection, of which map to use, being a latent variable for the current image-class pair. We train the model with a ranking based objective function which penalizes incorrect rankings of the true class for a given image. We empirically demonstrate that our model improves the state-of-the-art for various class embeddings consistently on three challenging publicly available datasets for the zero-shot setting. Moreover, our method leads to visually highly interpretable results with clear clusters of different fine-grained object properties that correspond to different latent variable maps.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Radiology, Nuclear Medicine and Imaging, Representation & Self-Supervised Learning, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Trevor Darrell
  2. Bernt Schiele
  3. Jianfeng Gao
  4. Mohit Bansal
  5. Zeynep Akata
  6. Dacheng Tao
  7. Yoshua Bengio
  8. Luc Van Gool

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Bernt Schiele
  6. Ming-Hsuan Yang
  7. Yi Yang
  8. Jitendra Malik

In Radiology, Nuclear Medicine and Imaging

  1. Zeynep Akata
  2. Shafin Rahman
  3. Bernt Schiele
  4. Yongqin Xian
  5. Fei Sha
  6. Trevor Darrell
  7. Salman Hameed Khan
  8. Matthieu Cord

In Representation & Self-Supervised Learning

  1. Trevor Darrell
  2. Mingsheng Long
  3. Jianmin Wang
  4. Boqing Gong
  5. Kate Saenko
  6. Fei Sha
  7. Zeynep Akata
  8. Bernt Schiele

In Meta & Continual Learning

  1. Shafin Rahman
  2. Salman Hameed Khan
  3. Bernt Schiele
  4. Venkatesh Saligrama
  5. Hanxiao Wang
  6. Pengkai Zhu
  7. Zeynep Akata
  8. Matthieu Cord

Citations in the corpus