Empathy, reciprocity and turn-taking are critical therapeutic targets in conditions of social impairment such as Autism Spectrum Disorder (ASD). These aspects are related to each other, converging into the construct of synchrony, which includes emotional, behavioural and, possibly, physiological components. Therefore, being able to quantify the synchrony could impact the way therapists adapt and maximise the efficacy of the interventions. However, current methods are based on the observational coding of behavior, which is time-consuming and usually only performed after the interaction is over. In this study we propose to apply Artificial Intelligence (AI) methods on physiological data in order to obtain a real time and objective quantification of synchrony. In particular, we introduce the Multi-Modal Synchrony dataset (M-MS), which includes 3 sources of information—electrocardiographic signals, video recordings and behavioral coding—to support the study of synchrony in ASD. As a first AI application, we are currently developing an unsupervised model to extract a multivariate embedding of the physiological data. The multivariate embedding has to be compared with the behavioral synchrony label to create a map of physiological and behavioural synchrony. The application of AI in the treatment of ASD may become a new asset for the clinical practice, especially if the possibility of providing real time feedback to the therapist is exploited.

M-MS: A Multi-Modal Synchrony Dataset to Explore Dyadic Interaction in ASD / Calabrò, Gabriele; Bizzego, Andrea; Cainelli, Stefano; Furlanello, Cesare; Venuti, Paola. - 184:(2021), pp. 543-553. [10.1007/978-981-15-5093-5_46]

M-MS: A Multi-Modal Synchrony Dataset to Explore Dyadic Interaction in ASD

Calabrò, Gabriele;Bizzego, Andrea;Cainelli, Stefano;Furlanello, Cesare;Venuti, Paola
2021

Abstract

Empathy, reciprocity and turn-taking are critical therapeutic targets in conditions of social impairment such as Autism Spectrum Disorder (ASD). These aspects are related to each other, converging into the construct of synchrony, which includes emotional, behavioural and, possibly, physiological components. Therefore, being able to quantify the synchrony could impact the way therapists adapt and maximise the efficacy of the interventions. However, current methods are based on the observational coding of behavior, which is time-consuming and usually only performed after the interaction is over. In this study we propose to apply Artificial Intelligence (AI) methods on physiological data in order to obtain a real time and objective quantification of synchrony. In particular, we introduce the Multi-Modal Synchrony dataset (M-MS), which includes 3 sources of information—electrocardiographic signals, video recordings and behavioral coding—to support the study of synchrony in ASD. As a first AI application, we are currently developing an unsupervised model to extract a multivariate embedding of the physiological data. The multivariate embedding has to be compared with the behavioral synchrony label to create a map of physiological and behavioural synchrony. The application of AI in the treatment of ASD may become a new asset for the clinical practice, especially if the possibility of providing real time feedback to the therapist is exploited.
Progresses in Artificial Intelligence and Neural Systems
Singapore
Springer Nature Singapore
978-981-15-5092-8
978-981-15-5093-5
Calabrò, Gabriele; Bizzego, Andrea; Cainelli, Stefano; Furlanello, Cesare; Venuti, Paola
M-MS: A Multi-Modal Synchrony Dataset to Explore Dyadic Interaction in ASD / Calabrò, Gabriele; Bizzego, Andrea; Cainelli, Stefano; Furlanello, Cesare; Venuti, Paola. - 184:(2021), pp. 543-553. [10.1007/978-981-15-5093-5_46]
File in questo prodotto:
File Dimensione Formato  
WIRN_2019_paper_47.pdf

embargo fino al 31/12/2023

Tipologia: Post-print referato (Refereed author’s manuscript)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.25 MB
Formato Adobe PDF
3.25 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/319252
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact