One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has been annotated at several levels of information: communicative acts, emotion labels, and multimodal signs. We have defined a copy-synthesis approach to drive an Embodied Conversational Agent from these different levels of information. The second part of our paper focuses on a model of complex (superposition and masking of) emotions in facial expressions of the agent. We explain how the complementary aspects of our work on corpus and computational model is used to specify complex emotional behaviors.

Multimodal complex emotions: gesture expressivity and blended facial expressions / Martin, Jc; Niewiadomski, R; Devillers, L; Buisine, S; Pelachaud, C. - In: INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS. - ISSN 0219-8436. - 3:3(2006), pp. 269-291. [10.1142/S0219843606000825]

Multimodal complex emotions: gesture expressivity and blended facial expressions

Niewiadomski R;
2006-01-01

Abstract

One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has been annotated at several levels of information: communicative acts, emotion labels, and multimodal signs. We have defined a copy-synthesis approach to drive an Embodied Conversational Agent from these different levels of information. The second part of our paper focuses on a model of complex (superposition and masking of) emotions in facial expressions of the agent. We explain how the complementary aspects of our work on corpus and computational model is used to specify complex emotional behaviors.
2006
3
Martin, Jc; Niewiadomski, R; Devillers, L; Buisine, S; Pelachaud, C
Multimodal complex emotions: gesture expressivity and blended facial expressions / Martin, Jc; Niewiadomski, R; Devillers, L; Buisine, S; Pelachaud, C. - In: INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS. - ISSN 0219-8436. - 3:3(2006), pp. 269-291. [10.1142/S0219843606000825]
File in questo prodotto:
File Dimensione Formato  
IJHR06_martinetal_draft.pdf

Solo gestori archivio

Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 294.55 kB
Formato Adobe PDF
294.55 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/280647
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 61
  • ???jsp.display-item.citation.isi??? 40
social impact