A Novel Transformer based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images

Wang, Libo and Li, Rui and Duan, Chenxi and Zhang, Ce and Meng, Xiaoliang and Fang, Shenghui (2022) A Novel Transformer based Semantic Segmentation Scheme for Fine-Resolution Remote Sensing Images. IEEE Geoscience and Remote Sensing Letters, 19: 6506105. pp. 1-5. ISSN 1545-598X

[thumbnail of GRSL-00776-2021]
Text (GRSL-00776-2021)
GRSL_00776_2021.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (2MB)


The Fully Convolutional Network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multi-level feature maps, which are incorporated into the final prediction by a decoder. As the context is crucial for precise segmentation, tremendous effort has been made to extract such information in an intelligent fashion, including employing dilated/atrous convolutions or inserting attention modules. However, these endeavours are all based on the FCN architecture with ResNet or other backbones, which cannot fully exploit the context from the theoretical concept. By contrast, we introduce the Swin Transformer as the backbone to extract the context information and design a novel decoder of densely connected feature aggregation module (DCFAM) to restore the resolution and produce the segmentation map. The experimental results on two remotely sensed semantic segmentation datasets demonstrate the effectiveness of the proposed scheme.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Geoscience and Remote Sensing Letters
Additional Information:
©2022 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? fine-resolution remote sensing imagessemantic segmentationtransformergeotechnical engineering and engineering geologyelectrical and electronic engineering ??
ID Code:
Deposited By:
Deposited On:
07 Feb 2022 16:15
Last Modified:
15 Jul 2024 22:19