Enhanced Feature Alignment for Unsupervised Domain Adaptation of Semantic Segmentation

Tao Chen*, Shui Hua Wang, Qiong Wang, Zheng Zhang, Guo Sen Xie, Zhenmin Tang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)

Abstract

Unsupervised domain adaptation for semantic segmentation aims to transfer knowledge from a labeled source domain to another unlabeled target domain. However, due to the label noise and domain mismatch, learning directly from source domain data tends to have poor performance. Though adversarial learning methods strive to reduce domain discrepancies by aligning feature distributions, traditional methods suffer from the training imbalance and feature distortion problems. Besides, due to the absence of target domain labels, the classifier is blind to features from the target domain during training. Consequently, the final classifier overfits the source domain features and usually fails to predict the structured outputs of the target domain. To alleviate these problems, we focus on enhancing the adversarial learning based feature alignment from three perspectives. First, a classification constrained discriminator is proposed to balance the adversarial training and alleviate the feature distortion problem. Next, to alleviate the classifier overfitting problem, self-training is collaboratively used to learn a domain robust classifier with target domain pseudo labels. Moreover, an efficient class centroid calculation module is proposed and the domain discrepancy is further reduced by aligning the feature centroids of the same class from different domains. Experimental evaluations on GTA5 rightarrow Cityscapes and SYNTHIA rightarrow Cityscapes demonstrate state-of-the-art results compared to other counterpart methods. The source code and models have been made available at.11[Online]. Available: https://github.com/NUST-Machine-Intelligence-Laboratory/EFA.

Original languageEnglish
Pages (from-to)1042-1054
Number of pages13
JournalIEEE Transactions on Multimedia
Volume24
DOIs
Publication statusPublished - 2022
Externally publishedYes

Keywords

  • Adversarial learning
  • Domain adaptation
  • pseudo label
  • semantic segmentation

Fingerprint

Dive into the research topics of 'Enhanced Feature Alignment for Unsupervised Domain Adaptation of Semantic Segmentation'. Together they form a unique fingerprint.

Cite this