Self-Supervised Learning With Adaptive Distillation for Hyperspectral Image Classification

Yue, Jun and Fang, Leyuan and Rahmani, Hossein and Ghamisi, Pedram (2022) Self-Supervised Learning With Adaptive Distillation for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 60: 5501813. ISSN 0196-2892

[thumbnail of SSL_revision1]
Text (SSL_revision1)
SSL_revision1.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (7MB)


Hyperspectral image (HSI) classification is an important topic in the community of remote sensing, which has a wide range of applications in geoscience. Recently, deep learning-based methods have been widely used in HSI classification. However, due to the scarcity of labeled samples in HSI, the potential of deep learning-based methods has not been fully exploited. To solve this problem, a self-supervised learning (SSL) method with adaptive distillation is proposed to train the deep neural network with extensive unlabeled samples. The proposed method consists of two modules: adaptive knowledge distillation with spatial-spectral similarity and 3-D transformation on HSI cubes. The SSL with adaptive knowledge distillation uses the self-supervised information to train the network by knowledge distillation, where self-supervised knowledge is the adaptive soft label generated by spatial-spectral similarity measurement. The SSL with adaptive knowledge distillation mainly includes the following three steps. First, the similarity between unlabeled samples and object classes in HSI is generated based on the spatial-spectral joint distance (SSJD) between unlabeled samples and labeled samples. Second, the adaptive soft label of each unlabeled sample is generated to measure the probability that the unlabeled sample belongs to each object class. Third, a progressive convolutional network (PCN) is trained by minimizing the cross-entropy between the adaptive soft labels and the probabilities generated by the forward propagation of the PCN. The SSL with 3-D transformation rotates the HSI cube in both the spectral domain and the spatial domain to fully exploit the labeled samples. Experiments on three public HSI data sets have demonstrated that the proposed method can achieve better performance than existing state-of-the-art methods.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Transactions on Geoscience and Remote Sensing
Additional Information:
©2021 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
?? electrical and electronic engineeringearth and planetary sciences(all) ??
ID Code:
Deposited By:
Deposited On:
04 Aug 2021 14:55
Last Modified:
14 Apr 2024 00:48