This paper examines gestural deixis production in a multimodal (natural language and pointing) interaction. Users (N=30) were required to fill in 4 forms by interacting with a simulated system. Labelling of Entry Fields (LEF, Complete-Partial; between-subject) and Feedback (Present-Absent within-subject) were manipulated in a 2*2 design. Results indicate that deixis occurred more frequently in the Partial-LEF condition. Specific input device constraints influenced intermodal integration: pointing was performed after the end of writing, although feedback presence increased modality shifts. Simulation offered a valuable tool for the development of multimodal interaction models. Referring to objects in space is a typical communication action. Referent identification can be achieved by several means: directly naming or describing the target; linguistic devices like anaphora and metonymia; specifying target location. Target location can be specified in a speaker-independent mode, by reference to external entities, or in a deictic mode, by reference to speaker position. Space deixis is conveyed by deictic terms, mainly.
Scheda prodotto non validato
I dati visualizzati non sono stati ancora sottoposti a validazione formale da parte dello Staff di IRIS, ma sono stati ugualmente trasmessi al Sito Docente Cineca (Loginmiur).
Titolo: | Interface features affecting deixis production: A simulation study | |
Autori: | De Angeli, Antonella; D., Petrelli; W., Gerbino | |
Autori Unitn: | ||
Titolo del volume contenente il saggio: | Proceedings of the ICSLP Workshop on the Integration of Gesture in Language and Speech | |
Luogo di edizione: | Piscataway, N.J. | |
Casa editrice: | IEEE | |
Anno di pubblicazione: | 1996 | |
Handle: | http://hdl.handle.net/11572/90291 | |
Appare nelle tipologie: | 04.1 Saggio in atti di convegno (Paper in Proceedings) |