Children with reading difficulties face several obstacles in learning to fluently read written material. Multimedia applications integrating text-to-speech (TTS) synthesisers are valuable tools for supporting reading activities. The paper presents GARY, an application that combines TTS synthesis with eye tracking. GARY is meant to be used on a tablet device coupled with an eye tracker. Making use of the information from reader's eye movement, the system allows users to adapt the speed rate of the synthesised voice to their pace of reading. The paper describes the system, its functioning and future steps in designing a tool for supporting readers' ability in making the connection between the sounds heard and the letters read.
Gary: Combining speech synthesis and eye tracking to support struggling readers / Schiavo, G.; Osler, S.; Mana, N.; Mich, O.. - 30-:(2015), pp. 417-421. (Intervento presentato al convegno 14th International Conference on Mobile and Ubiquitous Multimedia, MUM 2015 tenutosi a Ars Electronica Center, aut nel 2015) [10.1145/2836041.2841220].
Gary: Combining speech synthesis and eye tracking to support struggling readers
Schiavo G.;Mana N.;Mich O.
2015-01-01
Abstract
Children with reading difficulties face several obstacles in learning to fluently read written material. Multimedia applications integrating text-to-speech (TTS) synthesisers are valuable tools for supporting reading activities. The paper presents GARY, an application that combines TTS synthesis with eye tracking. GARY is meant to be used on a tablet device coupled with an eye tracker. Making use of the information from reader's eye movement, the system allows users to adapt the speed rate of the synthesised voice to their pace of reading. The paper describes the system, its functioning and future steps in designing a tool for supporting readers' ability in making the connection between the sounds heard and the letters read.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione
