Unsupervised Domain Adaptation for Semantic Segmentation of Urban Scenes

By Matteo Biasetton, Umberto Michieli, Gianluca Agresti, Pietro Zanuttigh. 2019

52 citations recorded by the source corpus.

The semantic understanding of urban scenes is one of the key components for an autonomous driving system. Complex deep neural networks for this task require to be trained with a huge amount of labeled data, which is difficult and expensive to acquire. A recently proposed workaround is the usage of synthetic data, however the differences between real world and synthetic scenes limit the performance. We propose an unsupervised domain adaptation strategy to adapt a synthetic supervised training to real world data. The proposed learning strategy exploits three components: a standard supervised learning on synthetic data, an adversarial learning strategy able to exploit both labeled synthetic data and unlabeled real data and finally a self-teaching strategy working on unlabeled data only. The last component is guided by the segmentation confidence, estimated by the fully convolutional discriminator of the adversarial learning module, helping to further reduce the domain shift between synthetic and real data. Furthermore we weighted this loss on the basis of the class frequencies to enhance the performance on less common classes. Experimental results prove the effectiveness of the proposed strategy in adapting a segmentation network trained on synthetic datasets, like GTA5 and SYNTHIA, to a real dataset as Cityscapes.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Pietro Zanuttigh
  2. Umberto Michieli
  3. Fabio Cermelli
  4. Arthur Douillard
  5. Matthieu Cord
  6. Barbara Caputo
  7. Brahim Chaib-draa
  8. Mathieu Pagé Fortin

In Computer Vision and Pattern Recognition

  1. Umberto Michieli
  2. Pietro Zanuttigh
  3. Fabio Cermelli
  4. Arthur Douillard
  5. Matthieu Cord
  6. Barbara Caputo
  7. Brahim Chaib-draa
  8. Mathieu Pagé Fortin

Citations in the corpus