Multimodal human–computer interaction has been sought to provide not only more compelling interactive experiences, but also more accessible interfaces to mobile devices. With the advance in mobile technology and in affordable sensors, multimodal research that leverages and combines multiple interaction modalities (such as speech, touch, vision, and gesture) has become more and more prominent. This article provides a framework for the key aspects in mid-air gesture and speech-based interaction for older adults. It explores the literature on multimodal interaction and older adults as technology users and summarises the main findings for this type of users. Building on these findings, a number of crucial factors to take into consideration when designing multimodal mobile technology for older adults are described. The aim of this work is to promote the usefulness and potential of multimodal technologies based on mid-air gestures and voice input for making older adults’ interaction with mobile devices more accessible and inclusive.

Framing the design space of multimodal mid-air gesture and speech-based interaction with mobile devices for older people / Mich, O.; Schiavo, G.; Ferron, M.; Mana, N.. - In: INTERNATIONAL JOURNAL OF MOBILE HUMAN COMPUTER INTERACTION. - ISSN 1942-390X. - 12:1(2020), pp. 22-41. [10.4018/IJMHCI.2020010102]

Framing the design space of multimodal mid-air gesture and speech-based interaction with mobile devices for older people

Mich O.;Schiavo G.;Ferron M.;Mana N.
2020

Abstract

Multimodal human–computer interaction has been sought to provide not only more compelling interactive experiences, but also more accessible interfaces to mobile devices. With the advance in mobile technology and in affordable sensors, multimodal research that leverages and combines multiple interaction modalities (such as speech, touch, vision, and gesture) has become more and more prominent. This article provides a framework for the key aspects in mid-air gesture and speech-based interaction for older adults. It explores the literature on multimodal interaction and older adults as technology users and summarises the main findings for this type of users. Building on these findings, a number of crucial factors to take into consideration when designing multimodal mobile technology for older adults are described. The aim of this work is to promote the usefulness and potential of multimodal technologies based on mid-air gestures and voice input for making older adults’ interaction with mobile devices more accessible and inclusive.
1
Mich, O.; Schiavo, G.; Ferron, M.; Mana, N.
Framing the design space of multimodal mid-air gesture and speech-based interaction with mobile devices for older people / Mich, O.; Schiavo, G.; Ferron, M.; Mana, N.. - In: INTERNATIONAL JOURNAL OF MOBILE HUMAN COMPUTER INTERACTION. - ISSN 1942-390X. - 12:1(2020), pp. 22-41. [10.4018/IJMHCI.2020010102]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11572/321977
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 2
social impact