We describe a system that can associate images with English proverbs. We start from a corpus of proverbs, harvest related images from the web and use this data to train two variants of a convolutional neural network. We then collect a small set of annotations, and use these to combine the outputs of the two networks into a single prediction for each input image. We carry out feature selection experiments on a set of features derived from the images and from the predicted proverbs, and demonstrate that the metaphoricity of the proverbs plays a significant role in classification accuracy. An empirical evaluation with human raters confirms the system's ability to abstract from the raw bits in the images and to learn meaningful, non-trivial associations.
A proverb is worth a thousand words: learning to associate images with proverbs / Gözde, Özbal; Pighin, Daniele; Strapparava, Carlo. - (2019), pp. 2515-2521. ((Intervento presentato al convegno 41st Annual Conference of the Cognitive Science Society (CogSci’19) tenutosi a Montreal, Quebec, Canada nel July 2019.
Scheda prodotto non validato
I dati visualizzati non sono stati ancora sottoposti a validazione formale da parte dello Staff di IRIS, ma sono stati ugualmente trasmessi al Sito Docente Cineca (Loginmiur).
Titolo: | A proverb is worth a thousand words: learning to associate images with proverbs | |
Autori: | Gözde, Özbal; Pighin, Daniele; Strapparava, Carlo | |
Autori Unitn: | ||
Titolo del volume contenente il saggio: | Proceedings of the 41st Annual Conference of the Cognitive Science Society (CogSci’19) | |
Luogo di edizione: | USA | |
Casa editrice: | Cognitive Science Society | |
Anno di pubblicazione: | 2019 | |
ISBN: | 0-9911967-7-5 | |
Handle: | http://hdl.handle.net/11572/343996 | |
Citazione: | A proverb is worth a thousand words: learning to associate images with proverbs / Gözde, Özbal; Pighin, Daniele; Strapparava, Carlo. - (2019), pp. 2515-2521. ((Intervento presentato al convegno 41st Annual Conference of the Cognitive Science Society (CogSci’19) tenutosi a Montreal, Quebec, Canada nel July 2019. | |
Appare nelle tipologie: | 04.1 Saggio in atti di convegno (Paper in proceedings) |