Multimodal remote sensing change detection (MRS-CD) is essential for many geospatial applications. However, it remains challenging due to spectral heterogeneity, temporal misalignment, and inconsistencies between different data sources. Existing MRS-CD methods, particularly those employing graph structures, often suffer from parameter sensitivity, limited generalization across datasets, and difficulty in detecting fine-grained changes. Meanwhile, current weakly supervised approaches typically rely on image-level annotations, which often result in coarse localization, blurred boundaries, and limited transferability across heterogeneous modalities of changes. In this work, we present scribble-driven hybrid iterative feature tracker (SHIFT), a weakly supervised MRS-CD approach guided by sparse scribble annotations. SHIFT employs a scribble-driven feature extraction module to extract multimodal features, converting scribble annotations into smooth attention maps with a learnable Gaussian blur module to focus the model on potential change areas. Through iterative refinement, SHIFT enhances detection confidence in change regions. Experiments on 13 public datasets demonstrate the superior performance of the proposed approach compared with the number of state-of-the-art (SOTA) methods. Our approach achieves high accuracy with minimal annotations and robust generalization across diverse multimodal scenarios. The source code will be made publicly available at https://github.com/MissYongjie/SHIFT

SHIFT: Scribble-driven Hybrid Iterative Feature Tracker for Multimodal Remote Sensing Image Change Detection / Zheng, Yongjie; Liu, Sicong; Bruzzone, Lorenzo. - In: IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING. - ISSN 1558-0644. - ELETTRONICO. - 63:5636514(2025). [10.1109/TGRS.2025.3596064]

SHIFT: Scribble-driven Hybrid Iterative Feature Tracker for Multimodal Remote Sensing Image Change Detection

Yongjie Zheng
Primo
;
Sicong Liu
Secondo
;
Lorenzo Bruzzone
Ultimo
2025-01-01

Abstract

Multimodal remote sensing change detection (MRS-CD) is essential for many geospatial applications. However, it remains challenging due to spectral heterogeneity, temporal misalignment, and inconsistencies between different data sources. Existing MRS-CD methods, particularly those employing graph structures, often suffer from parameter sensitivity, limited generalization across datasets, and difficulty in detecting fine-grained changes. Meanwhile, current weakly supervised approaches typically rely on image-level annotations, which often result in coarse localization, blurred boundaries, and limited transferability across heterogeneous modalities of changes. In this work, we present scribble-driven hybrid iterative feature tracker (SHIFT), a weakly supervised MRS-CD approach guided by sparse scribble annotations. SHIFT employs a scribble-driven feature extraction module to extract multimodal features, converting scribble annotations into smooth attention maps with a learnable Gaussian blur module to focus the model on potential change areas. Through iterative refinement, SHIFT enhances detection confidence in change regions. Experiments on 13 public datasets demonstrate the superior performance of the proposed approach compared with the number of state-of-the-art (SOTA) methods. Our approach achieves high accuracy with minimal annotations and robust generalization across diverse multimodal scenarios. The source code will be made publicly available at https://github.com/MissYongjie/SHIFT
2025
5636514
Zheng, Yongjie; Liu, Sicong; Bruzzone, Lorenzo
SHIFT: Scribble-driven Hybrid Iterative Feature Tracker for Multimodal Remote Sensing Image Change Detection / Zheng, Yongjie; Liu, Sicong; Bruzzone, Lorenzo. - In: IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING. - ISSN 1558-0644. - ELETTRONICO. - 63:5636514(2025). [10.1109/TGRS.2025.3596064]
File in questo prodotto:
File Dimensione Formato  
SHIFT_Scribble-Driven_Hybrid_Iterative_Feature_Tracker_for_Multimodal_Remote_Sensing_Image_Change_Detection.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 12.16 MB
Formato Adobe PDF
12.16 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/471159
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact