Unsupervised Intra-Domain Adaptation for Semantic Segmentation Through Self-Supervision
By Fei Pan, Inkyu Shin, François Rameau, Seokju Lee, In-So Kweon. Computer Vision and Pattern Recognition, 2020
410 citations recorded by the source corpus.
Convolutional neural network-based approaches have achieved remarkable progress in semantic segmentation. However, these approaches heavily rely on annotated data which are labor intensive. To cope with this limitation, automatically annotated data generated from graphic engines are used to train segmentation models. However, the models trained from synthetic data are difficult to transfer to real images. To tackle this issue, previous works have considered directly adapting models from the source data to the unlabeled target data (to reduce the inter-domain gap). Nonetheless, these techniques do not consider the large distribution gap among the target data itself (intra-domain gap). In this work, we propose a two-step self-supervised domain adaptation approach to minimize the inter-domain and intra-domain gap together. First, we conduct the inter-domain adaptation of the model, from this adaptation, we separate target domain into an easy and hard split using an entropy-based ranking function. Finally, to decrease the intra-domain gap, we propose to employ a self-supervised adaptation technique from the easy to the hard subdomain. Experimental results on numerous benchmark datasets highlight the effectiveness of our method against existing state-of-the-art approaches. The source code is available at https://github.com/feipan664/IntraDA.git.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition
View Paper: https://www.semanticscholar.org/paper/f58b61d70caca32c265c39f539c81730b842a3df
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
Citations in the corpus
- Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation (2021, background): “The success of existing UDA methods heavily relies on the self-training strategy that alternatively generates highly confident pseudo labels for the target domain and re-trains the model using these labels [17, 15, 26, 41, 16, 45, 43, 31].”
- Where and How to Transfer: Knowledge Aggregation-Induced Transferability Perception for Unsupervised Domain Adaptation (2021, methodology): “…(cid:4) 10 (cid:6) 3 4 : 83 (cid:4) 10 (cid:6) 3 Ours versus CSCL [10] 6 : 19 (cid:4) 10 (cid:6) 3 3 : 71 (cid:4) 10 (cid:6) 3 Ours versus SS-UDA [33] 4 : 28 (cid:4) 10 (cid:6) 4 9 : 51 (cid:4) 10 (cid:6) 4 Ours versus DTST [45] 1 : 94 (cid:4) 10 (cid:6) 2 4 : 84 (cid:4) 10 (cid:6) 3 Ours versus…”
- MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentation (2021, positive): “Specifically, self-training methods assign pixel-wise pseudo labels according to confidence score [17, 23, 30, 51] or uncertainty [24, 48], providing extra supervision for target data to optimize the model.”
- FSDR: Frequency Space Domain Randomization for Domain Generalization (2021, background): “In addition, FSDR performs more stably across the three target domains, whereas UDA methods [88, 72, 66, 46] demonstrate much larger mIoU drops for unseen (in training) Mapillary and BDD data.”
- RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whitening (2021, methodology): “Domain adaptation (DA) is an approach to mitigate the performance degradation caused by such a domain gap [3, 12, 18, 11, 69, 41, 60, 43, 52].”
- Give Me Your Trained Model: Domain Adaptive Semantic Segmentation without Source Data (2021, methodology): “Inspired by the self-supervised intra-domain alignment method [36], we first divide the target data into easy and hard splits and then close the intra-domain gap to boost the adaptation performance.”
- Denoised Maximum Classifier Discrepancy for Source-Free Unsupervised Domain Adaptation (2022, methodology): “In addition to the inter-domain alignment method, some methods consider intra-domain alignment (Pan et al. 2020) or fit the target distribution in a straightforward manner (Wang and Breckon 2020; Liu et al. 2021).”