Remote sensing (RS) image captioning (IC) is a novel technique introduced recently in the RS community to enrich the description of very high resolution (VHR) images. The goal of RSIC is to generate a sentence that summarizes the content of an image. In general, RSIC is developed in a supervised way where annotated samples are needed to train the system. However, obtaining annotated samples is costly and time consuming in particular when the labels are sentence descriptions that are very subjective. In order to cope with the problem of having large amounts of training samples in this work we propose an active learning solution for RSIC that selects the most important samples to label and include in the training. Experimental results performed on UCM caption dataset show the promising effectiveness of the proposed active learning strategy.

An Active Learning Strategy for SVM-Based Captioning / Hoxha, Genc; Melgani, Farid. - (2021), pp. 3229-3232. (Intervento presentato al convegno IGARSS 2021 tenutosi a Brussels, Belgium nel 12-16 July, 2021) [10.1109/IGARSS47720.2021.9553619].

An Active Learning Strategy for SVM-Based Captioning

Hoxha, Genc;Melgani, Farid
2021-01-01

Abstract

Remote sensing (RS) image captioning (IC) is a novel technique introduced recently in the RS community to enrich the description of very high resolution (VHR) images. The goal of RSIC is to generate a sentence that summarizes the content of an image. In general, RSIC is developed in a supervised way where annotated samples are needed to train the system. However, obtaining annotated samples is costly and time consuming in particular when the labels are sentence descriptions that are very subjective. In order to cope with the problem of having large amounts of training samples in this work we propose an active learning solution for RSIC that selects the most important samples to label and include in the training. Experimental results performed on UCM caption dataset show the promising effectiveness of the proposed active learning strategy.
2021
Proceedings of IEEE International Geoscience and Remote Sensing Symposium IGARSS 2021
New York, USA
IEEE
978-1-6654-0369-6
Hoxha, Genc; Melgani, Farid
An Active Learning Strategy for SVM-Based Captioning / Hoxha, Genc; Melgani, Farid. - (2021), pp. 3229-3232. (Intervento presentato al convegno IGARSS 2021 tenutosi a Brussels, Belgium nel 12-16 July, 2021) [10.1109/IGARSS47720.2021.9553619].
File in questo prodotto:
File Dimensione Formato  
An_Active_Learning_Strategy_for_SVM-Based_Captioning.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 609.87 kB
Formato Adobe PDF
609.87 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/329681
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? ND
social impact