Deep learning techniques have shown increasing potential in change detection (CD) in hyperspectral images (HSIs). However, most deep learning-based existing methods for HSI CD follow a patch-based local learning framework and concentrate on binary CD. In this letter, we propose an end-to end semantic feature fused global learning (SFFGL) framework for HSI multiclass CD (MCD). In SFFGL, a global spatialwise fully convolutional network (FCN), which introduces a spatial attention mechanism (PAM) between encoder and decoder, is designed to effectively exploit the global spatial information from the whole HSIs and achieve patch-free inference. PAM can adaptively extract global spatialwise feature representation. In the model training stage, a global hierarchical (GH) sampling strategy is introduced to obtain diverse gradients during back propagation for more robust performance. The semantic-spatial feature fusion (S2F2) unit is designed to effectively fuse the enhanced spatial context information in the encoder and the semantic information in the decoder. More importantly, a semantic feature enhancement module (SEM) is proposed to weaken the influence of the unchanged regional background on the change regional foreground, thus further improving the accuracy. Experimental results on two benchmark HSI datasets demonstrate the effectiveness of the proposed SFFGL.

SFFGL: A Semantic Feature Fused Global Learning Framework for Multiclass Change Detection in Hyperspectral Images / Wang, Lifeng; Zhang, Junguo; Wang, Liguo; Bruzzone, Lorenzo. - In: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. - ISSN 1545-598X. - 20:(2023), pp. 1-5. [10.1109/LGRS.2023.3310745]

SFFGL: A Semantic Feature Fused Global Learning Framework for Multiclass Change Detection in Hyperspectral Images

Bruzzone, Lorenzo
2023-01-01

Abstract

Deep learning techniques have shown increasing potential in change detection (CD) in hyperspectral images (HSIs). However, most deep learning-based existing methods for HSI CD follow a patch-based local learning framework and concentrate on binary CD. In this letter, we propose an end-to end semantic feature fused global learning (SFFGL) framework for HSI multiclass CD (MCD). In SFFGL, a global spatialwise fully convolutional network (FCN), which introduces a spatial attention mechanism (PAM) between encoder and decoder, is designed to effectively exploit the global spatial information from the whole HSIs and achieve patch-free inference. PAM can adaptively extract global spatialwise feature representation. In the model training stage, a global hierarchical (GH) sampling strategy is introduced to obtain diverse gradients during back propagation for more robust performance. The semantic-spatial feature fusion (S2F2) unit is designed to effectively fuse the enhanced spatial context information in the encoder and the semantic information in the decoder. More importantly, a semantic feature enhancement module (SEM) is proposed to weaken the influence of the unchanged regional background on the change regional foreground, thus further improving the accuracy. Experimental results on two benchmark HSI datasets demonstrate the effectiveness of the proposed SFFGL.
2023
Wang, Lifeng; Zhang, Junguo; Wang, Liguo; Bruzzone, Lorenzo
SFFGL: A Semantic Feature Fused Global Learning Framework for Multiclass Change Detection in Hyperspectral Images / Wang, Lifeng; Zhang, Junguo; Wang, Liguo; Bruzzone, Lorenzo. - In: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. - ISSN 1545-598X. - 20:(2023), pp. 1-5. [10.1109/LGRS.2023.3310745]
File in questo prodotto:
File Dimensione Formato  
LGRS3310745.pdf

Solo gestori archivio

Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.45 MB
Formato Adobe PDF
3.45 MB Adobe PDF   Visualizza/Apri
SFFGL_A_Semantic_Feature_Fused_Global_Learning_Framework_for_Multiclass_Change_Detection_in_Hyperspectral_Images_compressed.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 768.97 kB
Formato Adobe PDF
768.97 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/400187
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 0
social impact