This research is a part of a broader project exploring how movement qualities can be recognized by means of the auditory channel: can we perceive an expressive full-body movement quality by means of its interactive sonification? The paper presents a sonification framework and an experiment to evaluate if embodied sonic training (i.e., experiencing interactive sonification of your own body movements) increases the recognition of such qualities through the auditory channel only, compared to a non-embodied sonic training condition. We focus on the sonification of two mid-level movement qualities: fragility and lightness. We base our sonification models, described in the first part, on the assumption that specific compounds of spectral features of a sound can contribute to the cross-modal perception of a specific movement quality. The experiment, described in the second part, involved 40 participants divided into two groups (embodied sonic training vs. no training). Participants were asked to report the level of lightness and fragility they perceived in 20 audio stimuli generated using the proposed sonification models. Results show that (1) both expressive qualities were correctly recognized from the audio stimuli, (2) a positive effect of embodied sonic training was observed for fragility but not for lightness. The paper is concluded by the description of the artistic performance that took place in 2017 in Genoa (Italy), in which the outcomes of the presented experiment were exploited.

Does embodied training improve the recognition of mid-level expressive movement qualities sonification? / Niewiadomski, R.; Mancini, M.; Cera, A.; Piana, S.; Canepa, C.; Camurri, A.. - In: JOURNAL ON MULTIMODAL USER INTERFACES. - ISSN 1783-7677. - 13:3(2019), pp. 191-203. [10.1007/s12193-018-0284-0]

Does embodied training improve the recognition of mid-level expressive movement qualities sonification?

Niewiadomski R.;
2019-01-01

Abstract

This research is a part of a broader project exploring how movement qualities can be recognized by means of the auditory channel: can we perceive an expressive full-body movement quality by means of its interactive sonification? The paper presents a sonification framework and an experiment to evaluate if embodied sonic training (i.e., experiencing interactive sonification of your own body movements) increases the recognition of such qualities through the auditory channel only, compared to a non-embodied sonic training condition. We focus on the sonification of two mid-level movement qualities: fragility and lightness. We base our sonification models, described in the first part, on the assumption that specific compounds of spectral features of a sound can contribute to the cross-modal perception of a specific movement quality. The experiment, described in the second part, involved 40 participants divided into two groups (embodied sonic training vs. no training). Participants were asked to report the level of lightness and fragility they perceived in 20 audio stimuli generated using the proposed sonification models. Results show that (1) both expressive qualities were correctly recognized from the audio stimuli, (2) a positive effect of embodied sonic training was observed for fragility but not for lightness. The paper is concluded by the description of the artistic performance that took place in 2017 in Genoa (Italy), in which the outcomes of the presented experiment were exploited.
2019
3
Niewiadomski, R.; Mancini, M.; Cera, A.; Piana, S.; Canepa, C.; Camurri, A.
Does embodied training improve the recognition of mid-level expressive movement qualities sonification? / Niewiadomski, R.; Mancini, M.; Cera, A.; Piana, S.; Canepa, C.; Camurri, A.. - In: JOURNAL ON MULTIMODAL USER INTERFACES. - ISSN 1783-7677. - 13:3(2019), pp. 191-203. [10.1007/s12193-018-0284-0]
File in questo prodotto:
File Dimensione Formato  
Niewiadomski2019_Article_DoesEmbodiedTrainingImproveThe-1.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 2.1 MB
Formato Adobe PDF
2.1 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/278961
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 16
  • ???jsp.display-item.citation.isi??? 9
social impact