The way humans learn the meaning of words is a fundamental question in many different disciplines and, from a computational perspective, an answer to this question could lead to important advances in artificial intelligence. While the details of the learning process are still an open question, what we do know is that humans make use of the very rich perceptual input present in the communicative setups in which learning takes place. In this work, we will present three models of human learning from naturalistic multi-modal input. We will start by introducing a model that assumes a purely predictive learner existing in a non-communicative setup and show that such a computational learner when tested displays comparable learning behaviour to human learners on a novel word learning setup. We will then relax some of the learning assumptions and present a model that, instead of exposing the computational learner to a passive environment, such as the text corpora traditionally used in semantic learning experiments, it exposes the learner to communicative episodes, simulated in our experiments by corpora capturing multi-modal interactions between children and their caregivers, allowing the learner to make use of information beyond words and passive percept during learning. Finally, we will present on-going work towards interactive learning between two agents.

From predictive to interactive multimodal language learning / Lazaridou, Angeliki. - (2016), pp. 1-112.

From predictive to interactive multimodal language learning

Lazaridou, Angeliki
2016-01-01

Abstract

The way humans learn the meaning of words is a fundamental question in many different disciplines and, from a computational perspective, an answer to this question could lead to important advances in artificial intelligence. While the details of the learning process are still an open question, what we do know is that humans make use of the very rich perceptual input present in the communicative setups in which learning takes place. In this work, we will present three models of human learning from naturalistic multi-modal input. We will start by introducing a model that assumes a purely predictive learner existing in a non-communicative setup and show that such a computational learner when tested displays comparable learning behaviour to human learners on a novel word learning setup. We will then relax some of the learning assumptions and present a model that, instead of exposing the computational learner to a passive environment, such as the text corpora traditionally used in semantic learning experiments, it exposes the learner to communicative episodes, simulated in our experiments by corpora capturing multi-modal interactions between children and their caregivers, allowing the learner to make use of information beyond words and passive percept during learning. Finally, we will present on-going work towards interactive learning between two agents.
2016
XXVIII
2015-2016
CIMEC (29/10/12-)
Cognitive and Brain Sciences
Baroni, Marco
no
Inglese
Settore L-LIN/01 - Glottologia e Linguistica
File in questo prodotto:
File Dimensione Formato  
thesis_angeliki.pdf

accesso aperto

Tipologia: Tesi di dottorato (Doctoral Thesis)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 10.81 MB
Formato Adobe PDF
10.81 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/368956
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact