Multi-Task Learning for Segmentation of Building Footprints with Deep Neural Networks

By Benjamin Bischke, Patrick Helber, Joachim Folz, Damian Borth, Andreas R. Dengel. 2017

272 citations recorded by the source corpus.

The increased availability of high-resolution satellite imagery allows to sense very detailed structures on the surface of our planet. Access to such information opens up new directions in the analysis of remote sensing imagery. While deep neural networks have achieved significant advances in semantic segmentation of high-resolution images, most of the existing approaches tend to produce predictions with poor boundaries. In this paper, we address the problem of preserving semantic segmentation boundaries in high-resolution satellite imagery by introducing a novel multi-task loss. The loss leverages multiple output representations of the segmentation mask and biases the network to focus more on pixels near boundaries. We evaluate our approach on the large-scale Inria Aerial Image Labeling Dataset which contains high-resolution images. Our results show that we are able to outperform state-of-the-art methods by 9.8% on the Intersection over Union (IoU) metric without any additional post-processing steps. Source code and all models will be available under https://github.com/bbischke/MultiTaskBuildingSegmentation.

Subfields: Computer Vision and Pattern Recognition, Media Technology, Ocean Engineering, Remote Sensing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Xilin Chen
  2. Jingdong Wang
  3. Yuhui Yuan
  4. Luc Van Gool
  5. Alexey A. Shvets
  6. Vladimir I. Iglovikov
  7. Dacheng Tao
  8. Jingyi Xie

In Media Technology

  1. Alexey A. Shvets
  2. Vladimir I. Iglovikov
  3. Jingdong Wang
  4. Jingyi Xie
  5. Senthil Kumar Yogamani
  6. Ghassan Hamarneh
  7. Xilin Chen
  8. Yuhui Yuan

In Ocean Engineering

  1. Vladimir I. Iglovikov
  2. Jingdong Wang
  3. Xilin Chen
  4. Yuhui Yuan

In Remote Sensing

  1. Xilin Chen

Citations in the corpus