Semantic-Fusion Gans for Semi-Supervised Satellite Image Classification

By Subhankar Roy, Enver Sangineto, Nicu Sebe, Begüm Demir. 2018

34 citations recorded by the source corpus.

Most of the public satellite image datasets contain only a small number of annotated images. The lack of a sufficient quantity of labeled data for training is a bottleneck for the use of modern deep-learning based classification approaches in this domain. In this paper we propose a semi -supervised approach to deal with this problem. We use the discriminator $(D)$ of a Generative Adversarial Network (GAN) as the final classifier, and we train $D$ using both labeled and unlabeled data. The main novelty we introduce is the representation of the visual information fed to $D$ by means of two different channels: the original image and its “semantic” representation, the latter being obtained by means of an external network trained on ImageNet. The two channels are fused in $D$ and jointly used to classify fake images, real labeled and real unlabeled images. We show that using only 100 labeled images, the proposed approach achieves an accuracy close to 69% and a significant improvement with respect to other GAN-based semi-supervised methods. Although we have tested our approach only on satellite images, we do not use any domain-specific knowledge. Thus, our method can be applied to other semi-supervised domains.

Subfields: Computer Vision and Pattern Recognition, Media Technology, Generative Models, Remote Sensing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Nicu Sebe
  2. Elisa Ricci
  3. Aliaksandr Siarohin
  4. Sergey Tulyakov
  5. Stéphane Lathuilière
  6. Jian Zhao
  7. Luc Van Gool
  8. Xiaogang Wang

In Media Technology

  1. Elisa Ricci
  2. Nicu Sebe
  3. Aliaksandr Siarohin
  4. Sergey Tulyakov
  5. Stéphane Lathuilière
  6. Peter Wonka
  7. Ibraheem Alhashim

In Generative Models

  1. Aliaksandr Siarohin
  2. Sergey Tulyakov
  3. Nicu Sebe
  4. Elisa Ricci
  5. Stéphane Lathuilière
  6. Jian Zhao

Citations in the corpus