Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.
Scheda prodotto non validato
I dati visualizzati non sono stati ancora sottoposti a validazione formale da parte dello Staff di IRIS, ma sono stati ugualmente trasmessi al Sito Docente Cineca (Loginmiur).
Titolo: | Acting on a visual word: The role of perception in multimodal HCI | |
Autori: | F., Wolff; De Angeli, Antonella; L., Romary | |
Autori Unitn: | ||
Titolo del volume contenente il saggio: | Papers from the 1999 AAAI Workshop on Representations for Multimodal Human-Computer Interaction, Technical Report WS-98-09 | |
Luogo di edizione: | Menlo Park, CA | |
Casa editrice: | AAAI Press | |
Anno di pubblicazione: | 1998 | |
Handle: | http://hdl.handle.net/11572/90289 | |
Appare nelle tipologie: | 04.1 Saggio in atti di convegno (Paper in proceedings) |