Recognizing the actions of others depends on segmentation into meaningful events. After decades of research in this area, it remains still unclear how humans do this and which brain areas support underlying processes. Here we show that a computer vision-based model of touching and untouching events can predict human behavior in segmenting object manipulation actions with high accuracy. Using this computational model and functional Magnetic Resonance Imaging (fMRI), we pinpoint the neural networks underlying this segmentation behavior during an implicit action observation task. Segmentation was announced by a strong increase of visual activity at touching events followed by the engagement of frontal, hippocampal and insula regions, signaling updating expectation at subsequent untouching events. Brain activity and behavior show that touching-untouching motifs are critical features for identifying the key elements of actions including object manipulations.

Touching events predict human action segmentation in brain and behavior / Pomp, J.; Heins, N.; Trempler, I.; Kulvicius, T.; Tamosiunaite, M.; Mecklenbrauck, F.; Wurm, Moritz; Worgotter, F.; Schubotz, R. I.. - In: NEUROIMAGE. - ISSN 1053-8119. - 243:(2021), pp. 11853401-11853415. [10.1016/j.neuroimage.2021.118534]

Touching events predict human action segmentation in brain and behavior

Wurm Moritz;
2021-01-01

Abstract

Recognizing the actions of others depends on segmentation into meaningful events. After decades of research in this area, it remains still unclear how humans do this and which brain areas support underlying processes. Here we show that a computer vision-based model of touching and untouching events can predict human behavior in segmenting object manipulation actions with high accuracy. Using this computational model and functional Magnetic Resonance Imaging (fMRI), we pinpoint the neural networks underlying this segmentation behavior during an implicit action observation task. Segmentation was announced by a strong increase of visual activity at touching events followed by the engagement of frontal, hippocampal and insula regions, signaling updating expectation at subsequent untouching events. Brain activity and behavior show that touching-untouching motifs are critical features for identifying the key elements of actions including object manipulations.
2021
Pomp, J.; Heins, N.; Trempler, I.; Kulvicius, T.; Tamosiunaite, M.; Mecklenbrauck, F.; Wurm, Moritz; Worgotter, F.; Schubotz, R. I.
Touching events predict human action segmentation in brain and behavior / Pomp, J.; Heins, N.; Trempler, I.; Kulvicius, T.; Tamosiunaite, M.; Mecklenbrauck, F.; Wurm, Moritz; Worgotter, F.; Schubotz, R. I.. - In: NEUROIMAGE. - ISSN 1053-8119. - 243:(2021), pp. 11853401-11853415. [10.1016/j.neuroimage.2021.118534]
File in questo prodotto:
File Dimensione Formato  
pomp_2021_Touching events predict human action segmentation in brain and behavior.pdf

accesso aperto

Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 2.31 MB
Formato Adobe PDF
2.31 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/320273
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
social impact