This work investigates classification of emotions from MoCap full-body data by using Convolutional Neural Networks (CNN). Rather than addressing regular day to day activities, we focus on a more complex type of full-body movement - dance. For this purpose, a new dataset was created which contains short excerpts of the performances of professional dancers who interpreted four emotional states: anger, happiness, sadness, and insecurity. Fourteen minutes of motion capture data are used to explore different CNN architectures and data representations. The results of the four-class classification task are up to 0.79 (F1 score) on test data of other performances by the same dancers. Hence, through deep learning, this paper proposes a novel and effective method of emotion classification which can be exploited in affective interfaces.
From motions to emotions: classification of affect from dance movements using deep learning / Karumuri, Sukumar; Volpe, Gualtiero; Niewiadomski, Radoslaw; Camurri, Antonio. - ELETTRONICO. - (2019), pp. 1-6. (Intervento presentato al convegno 2019 CHI Conference on Human Factors in Computing Systems, CHI EA 2019 tenutosi a Glasgow nel 04/05/2019) [10.1145/3290607.3312910].
From motions to emotions: classification of affect from dance movements using deep learning
Radoslaw Niewiadomski;
2019-01-01
Abstract
This work investigates classification of emotions from MoCap full-body data by using Convolutional Neural Networks (CNN). Rather than addressing regular day to day activities, we focus on a more complex type of full-body movement - dance. For this purpose, a new dataset was created which contains short excerpts of the performances of professional dancers who interpreted four emotional states: anger, happiness, sadness, and insecurity. Fourteen minutes of motion capture data are used to explore different CNN architectures and data representations. The results of the four-class classification task are up to 0.79 (F1 score) on test data of other performances by the same dancers. Hence, through deep learning, this paper proposes a novel and effective method of emotion classification which can be exploited in affective interfaces.File | Dimensione | Formato | |
---|---|---|---|
CHI2019_Karumurietal.pdf
Solo gestori archivio
Tipologia:
Post-print referato (Refereed author’s manuscript)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
811.67 kB
Formato
Adobe PDF
|
811.67 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione