Autism Spectrum Disorders are associated with atypical movements, of which stereotypical motor movements (SMMs) interfere with learning and social interaction. The automatic SMM detection using inertial measurement units (IMU) remains complex due to the strong intra and inter-subject variability, especially when handcrafted features are extracted from the signal. We propose a new application of the deep learning to facilitate automatic SMM detection using multi-axis IMUs. We use a convolutional neural network (CNN) to learn a discriminative feature space from raw data. We show how the CNN can be used for parameter transfer learning to enhance the detection rate on longitudinal data. We also combine the long short-term memory (LSTM) with CNN to model the temporal patterns in a sequence of multi-axis signals. Further, we employ ensemble learning to combine multiple LSTM learners into a more robust SMM detector. Our results show that: (1) feature learning outperforms handcrafted features; (2) parameter transfer learning is beneficial in longitudinal settings; (3) using LSTM to learn the temporal dynamic of signals enhances the detection rate especially for skewed training data; (4) an ensemble of LSTMs provides more accurate and stable detectors. These findings provide a significant step toward accurate SMM detection in real-time scenarios.

Deep learning for automatic stereotypical motor movement detection using wearable sensors in autism spectrum disorders / Mohammadian Rad, Nastaran; Kia, Seyed Mostafa; Zarbo, Calogero; van Laarhoven, Twan; Jurman, Giuseppe; Venuti, Paola; Marchiori, Elena; Furlanello, Cesare. - In: SIGNAL PROCESSING. - ISSN 0165-1684. - ELETTRONICO. - 144:(2018), pp. 180-191. [10.1016/j.sigpro.2017.10.011]

Deep learning for automatic stereotypical motor movement detection using wearable sensors in autism spectrum disorders

Mohammadian Rad, Nastaran;Zarbo, Calogero;Jurman, Giuseppe;Furlanello, Cesare
2018-01-01

Abstract

Autism Spectrum Disorders are associated with atypical movements, of which stereotypical motor movements (SMMs) interfere with learning and social interaction. The automatic SMM detection using inertial measurement units (IMU) remains complex due to the strong intra and inter-subject variability, especially when handcrafted features are extracted from the signal. We propose a new application of the deep learning to facilitate automatic SMM detection using multi-axis IMUs. We use a convolutional neural network (CNN) to learn a discriminative feature space from raw data. We show how the CNN can be used for parameter transfer learning to enhance the detection rate on longitudinal data. We also combine the long short-term memory (LSTM) with CNN to model the temporal patterns in a sequence of multi-axis signals. Further, we employ ensemble learning to combine multiple LSTM learners into a more robust SMM detector. Our results show that: (1) feature learning outperforms handcrafted features; (2) parameter transfer learning is beneficial in longitudinal settings; (3) using LSTM to learn the temporal dynamic of signals enhances the detection rate especially for skewed training data; (4) an ensemble of LSTMs provides more accurate and stable detectors. These findings provide a significant step toward accurate SMM detection in real-time scenarios.
2018
Mohammadian Rad, Nastaran; Kia, Seyed Mostafa; Zarbo, Calogero; van Laarhoven, Twan; Jurman, Giuseppe; Venuti, Paola; Marchiori, Elena; Furlanello, Ce...espandi
Deep learning for automatic stereotypical motor movement detection using wearable sensors in autism spectrum disorders / Mohammadian Rad, Nastaran; Kia, Seyed Mostafa; Zarbo, Calogero; van Laarhoven, Twan; Jurman, Giuseppe; Venuti, Paola; Marchiori, Elena; Furlanello, Cesare. - In: SIGNAL PROCESSING. - ISSN 0165-1684. - ELETTRONICO. - 144:(2018), pp. 180-191. [10.1016/j.sigpro.2017.10.011]
File in questo prodotto:
File Dimensione Formato  
rad2018deep.pdf

Solo gestori archivio

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 3.05 MB
Formato Adobe PDF
3.05 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/343516
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 70
  • ???jsp.display-item.citation.isi??? 55
  • OpenAlex ND
social impact