This paper discusses an approach to monitoring the level of engagement of video game players based on the theory of flow in the gaming experience. Starting from the flow framework, we developed a non-obtrusive system that estimates the player's state of engagement by analysing non-verbal behavioral cues that are easily detected with simple hardware, such as a webcam and a traditional keyboard and mouse setup. We present the design and the results of an empirical study aimed at gathering data and model the player's engagement. Facial expressions, head movements, keyboard and mouse activities were recorded while participants played a first-person shooter video game. We used an adapted version of the Experience Sampling Methodology to gather the ground truth and trained a Support Vector Machine classifier that recognizes the affective states, reaching an accuracy of 73%. The results showed that the level of engagement is reasonably predicted by considering the head movements and facial expressions only. The findings could aid in developing digital games able to use the information about the player's affective state to adapt their content and support the game experience.

Engagement recognition using easily detectable behavioral cues / Schiavo, Gianluca; A., Cappelletti; Zancanaro, Massimo. - In: INTELLIGENZA ARTIFICIALE. - ISSN 1724-8035. - 2014:2(2014), pp. 197-210. [10.3233/IA-140073]

Engagement recognition using easily detectable behavioral cues

Schiavo, Gianluca;Zancanaro, Massimo
2014-01-01

Abstract

This paper discusses an approach to monitoring the level of engagement of video game players based on the theory of flow in the gaming experience. Starting from the flow framework, we developed a non-obtrusive system that estimates the player's state of engagement by analysing non-verbal behavioral cues that are easily detected with simple hardware, such as a webcam and a traditional keyboard and mouse setup. We present the design and the results of an empirical study aimed at gathering data and model the player's engagement. Facial expressions, head movements, keyboard and mouse activities were recorded while participants played a first-person shooter video game. We used an adapted version of the Experience Sampling Methodology to gather the ground truth and trained a Support Vector Machine classifier that recognizes the affective states, reaching an accuracy of 73%. The results showed that the level of engagement is reasonably predicted by considering the head movements and facial expressions only. The findings could aid in developing digital games able to use the information about the player's affective state to adapt their content and support the game experience.
2014
2
Schiavo, Gianluca; A., Cappelletti; Zancanaro, Massimo
Engagement recognition using easily detectable behavioral cues / Schiavo, Gianluca; A., Cappelletti; Zancanaro, Massimo. - In: INTELLIGENZA ARTIFICIALE. - ISSN 1724-8035. - 2014:2(2014), pp. 197-210. [10.3233/IA-140073]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/97997
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact