Motivated by the good performance recorded for image captioning (IC) techniques in different remote sensing (RS) applications, we propose in this paper a change detection (CD) system based on IC. It aims to the creation of a user-friendly solution that describes, via human-like sentences, the changes detected comparing bi-temporal images acquired over the same geographical area. The model we propose, is based on a convolutional neural network (CNN), and a multimodal recurrent neural network (RNN). Our experiments have been performed combining a set of aerial images with semantic information that we generated to describe the changes observed for different types of objects. This work yielded to encouraging results, evaluated using the BLEU metric.

Captioning Changes in Bi-Temporal Remote Sensing Images / Chouaf, Seloua; Hoxha, Genc; Smara, Youcef; Melgani, Farid. - (2021), pp. 2891-2894. (Intervento presentato al convegno IGARSS 2021 tenutosi a Brussels, Belgium nel 12-16 July, 2021) [10.1109/IGARSS47720.2021.9554419].

Captioning Changes in Bi-Temporal Remote Sensing Images

Hoxha, Genc;Melgani, Farid
2021-01-01

Abstract

Motivated by the good performance recorded for image captioning (IC) techniques in different remote sensing (RS) applications, we propose in this paper a change detection (CD) system based on IC. It aims to the creation of a user-friendly solution that describes, via human-like sentences, the changes detected comparing bi-temporal images acquired over the same geographical area. The model we propose, is based on a convolutional neural network (CNN), and a multimodal recurrent neural network (RNN). Our experiments have been performed combining a set of aerial images with semantic information that we generated to describe the changes observed for different types of objects. This work yielded to encouraging results, evaluated using the BLEU metric.
2021
Proceedings of IEEE International Geoscience and Remote Sensing Symposium IGARSS 2021
New York, USA
IEEE
978-1-6654-0369-6
Chouaf, Seloua; Hoxha, Genc; Smara, Youcef; Melgani, Farid
Captioning Changes in Bi-Temporal Remote Sensing Images / Chouaf, Seloua; Hoxha, Genc; Smara, Youcef; Melgani, Farid. - (2021), pp. 2891-2894. (Intervento presentato al convegno IGARSS 2021 tenutosi a Brussels, Belgium nel 12-16 July, 2021) [10.1109/IGARSS47720.2021.9554419].
File in questo prodotto:
File Dimensione Formato  
Captioning_Changes_in_Bi-Temporal_Remote_Sensing_Images.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 651.57 kB
Formato Adobe PDF
651.57 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/329683
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? ND
social impact