In this paper we propose a multimodal approach to distinguish between movements displaying three different expressive qualities: fluid, fragmented, and impulsive movements. Our approach is based on the Event Synchronization algorithm, which is applied to compute the amount of synchronization between two low-level features extracted from multimodal data. In more details, we use the energy of the audio respiration signal captured by a standard microphone placed near to the mouth, and the whole body kinetic energy estimated from motion capture data. The method was evaluated on 90 movement segments performed by 5 dancers. Results show that fragmented movements display higher average synchronization than fluid and impulsive movements.
Using the audio respiration signal for multimodal discrimination of expressive movement qualities / Lussu, V.; Niewiadomski, R.; Volpe, G.; Camurri, A.. - 9997:(2016), pp. 102-115. (Intervento presentato al convegno 7th International Workshop on Human Behavior Understanding, HBU 2016 tenutosi a nld nel 2016) [10.1007/978-3-319-46843-3_7].
Using the audio respiration signal for multimodal discrimination of expressive movement qualities
Niewiadomski R.;
2016-01-01
Abstract
In this paper we propose a multimodal approach to distinguish between movements displaying three different expressive qualities: fluid, fragmented, and impulsive movements. Our approach is based on the Event Synchronization algorithm, which is applied to compute the amount of synchronization between two low-level features extracted from multimodal data. In more details, we use the energy of the audio respiration signal captured by a standard microphone placed near to the mouth, and the whole body kinetic energy estimated from motion capture data. The method was evaluated on 90 movement segments performed by 5 dancers. Results show that fragmented movements display higher average synchronization than fluid and impulsive movements.File | Dimensione | Formato | |
---|---|---|---|
HBU16_lussu.pdf
Solo gestori archivio
Tipologia:
Post-print referato (Refereed author’s manuscript)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
445.37 kB
Formato
Adobe PDF
|
445.37 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione