Class-guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery

Meng, Xiaoliang and Yang, Yuechi and Wang, Libo and Wang, Teng and Li, Rui and Zhang, Ce (2022) Class-guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery. IEEE Geoscience and Remote Sensing Letters, 19 (10): 6517505. ISSN 1545-598X

[thumbnail of GRSL-01132-2022]
Text (GRSL-01132-2022)
GRSL_01132_2022.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (3MB)


Semantic segmentation of remote sensing images plays a crucial role in a wide variety of practical applications, including land cover mapping, environmental protection, and economic assessment. In the last decade, convolutional neural network (CNN) is the mainstream deep learning-based method of semantic segmentation. Compared with conventional methods, CNN-based methods learn semantic features automatically, thereby achieving strong representation capability. However, the local receptive field of the convolution operation limits CNN-based methods from capturing long-range dependencies. In contrast, Vision Transformer (ViT) demonstrates its great potential in modeling long-range dependencies and obtains superior results in semantic segmentation. Inspired by this, in this letter, we propose a class-guided Swin Transformer (CG-Swin) for semantic segmentation of remote sensing images. Specifically, we adopt a Transformer-based encoder-decoder structure, which introduces the Swin Transformer backbone as the encoder and designs a class-guided Transformer block to construct the decoder. The experimental results on ISPRS Vaihingen and Potsdam datasets demonstrate the significant breakthrough of the proposed method over ten benchmarks, outperforming both advanced CNN-based and recent Transformer-based approaches.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Geoscience and Remote Sensing Letters
Additional Information:
©2022 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? fully transformer networkclass-guided mechanismsemantic segmentationremote sensinggeotechnical engineering and engineering geologyelectrical and electronic engineering ??
ID Code:
Deposited By:
Deposited On:
14 Oct 2022 10:45
Last Modified:
28 Jun 2024 02:15