General Convolutional Neural Networks (CNN) process the data in the spatial domain and lack of efficacy in modeling the spectral context in multispectral image processing task. To address this limitation, in this letter we propose a Wavelet Inspired Attention-based Convolution Neural Network (WIANet) architecture that combines the modeling of the spatio-spectral resolution of multispectral remote sensing images with a wavelet convolution and attention unit into a single deep learning architecture for land cover classification. Our aim is to add the characteristics of both Wavelet Transform and attention mechanism into an UNet based architecture to better exploit the spectral and texture information for distinguishing classes with high similarity in the spectral signatures. We evaluate the performance of the proposed approach on a multi-label multispectral Sentinel-2 dataset. The experiment shows that the proposed approach performs better than the reference methods in different conditions on the number of training samples.

WIANet: A Wavelet-Inspired Attention-based Convolution Neural Network for Land Cover Classification / Singh, Abhishek; Bruzzone, Lorenzo. - In: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. - ISSN 1558-0571. - ELETTRONICO. - 2022:(2022). [10.1109/LGRS.2022.3232224]

WIANet: A Wavelet-Inspired Attention-based Convolution Neural Network for Land Cover Classification

Abhishek Singh
Primo
;
Lorenzo Bruzzone
Secondo
2022-01-01

Abstract

General Convolutional Neural Networks (CNN) process the data in the spatial domain and lack of efficacy in modeling the spectral context in multispectral image processing task. To address this limitation, in this letter we propose a Wavelet Inspired Attention-based Convolution Neural Network (WIANet) architecture that combines the modeling of the spatio-spectral resolution of multispectral remote sensing images with a wavelet convolution and attention unit into a single deep learning architecture for land cover classification. Our aim is to add the characteristics of both Wavelet Transform and attention mechanism into an UNet based architecture to better exploit the spectral and texture information for distinguishing classes with high similarity in the spectral signatures. We evaluate the performance of the proposed approach on a multi-label multispectral Sentinel-2 dataset. The experiment shows that the proposed approach performs better than the reference methods in different conditions on the number of training samples.
2022
Singh, Abhishek; Bruzzone, Lorenzo
WIANet: A Wavelet-Inspired Attention-based Convolution Neural Network for Land Cover Classification / Singh, Abhishek; Bruzzone, Lorenzo. - In: IEEE GEOSCIENCE AND REMOTE SENSING LETTERS. - ISSN 1558-0571. - ELETTRONICO. - 2022:(2022). [10.1109/LGRS.2022.3232224]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/363923
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
social impact