The partial information decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of partial information rate decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To concretely implement this idea, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.

Decomposing multivariate information rates in networks of random processes / Sparacino, Laura; Mijatovic, Gorana; Antonacci, Yuri; Ricci, Leonardo; Marinazzo, Daniele; Stramaglia, Sebastiano; Faes, Luca. - In: PHYSICAL REVIEW. E. - ISSN 2470-0053. - 112:4(2025), p. 044313. [10.1103/mn8p-kf6t]

Decomposing multivariate information rates in networks of random processes

Ricci, Leonardo;Faes, Luca
Ultimo
2025-01-01

Abstract

The partial information decomposition (PID) framework has emerged as a powerful tool for analyzing high-order interdependencies in complex network systems. However, its application to dynamic processes remains challenging due to the implicit assumption of memorylessness, which often falls in real-world scenarios. In this work, we introduce the framework of partial information rate decomposition (PIRD) that extends PID to random processes with temporal correlations. By leveraging mutual information rate instead of mutual information (MI), our approach decomposes the dynamic information shared by multivariate random processes into unique, redundant, and synergistic contributions obtained aggregating information rate atoms in a principled manner. To concretely implement this idea, we define a pointwise redundancy rate function based on the minimum MI principle applied locally in the frequency-domain representation of the processes. The framework is validated in benchmark simulations of Gaussian systems, demonstrating its advantages over traditional PID in capturing temporal correlations and showing how the spectral representation may reveal scale-specific higher-order interactions that are obscured in the time domain. Furthermore, we apply PIRD to a physiological network comprising cerebrovascular and cardiovascular variables, revealing frequency-dependent redundant information exchange during a protocol of postural stress. Our results highlight the necessity of accounting for the full temporal statistical structure and spectral content of vector random processes to meaningfully perform information decomposition in network systems with dynamic behavior such as those typically encountered in neuroscience and physiology.
2025
4
Settore IBIO-01/A - Bioingegneria
Settore PHYS-06/A - Fisica per le scienze della vita, l'ambiente e i beni culturali
Sparacino, Laura; Mijatovic, Gorana; Antonacci, Yuri; Ricci, Leonardo; Marinazzo, Daniele; Stramaglia, Sebastiano; Faes, Luca
Decomposing multivariate information rates in networks of random processes / Sparacino, Laura; Mijatovic, Gorana; Antonacci, Yuri; Ricci, Leonardo; Marinazzo, Daniele; Stramaglia, Sebastiano; Faes, Luca. - In: PHYSICAL REVIEW. E. - ISSN 2470-0053. - 112:4(2025), p. 044313. [10.1103/mn8p-kf6t]
File in questo prodotto:
File Dimensione Formato  
PhysRevE_2025_112_044313_Sparacino_Mijatovic_Antonacci_Ricci_Marinazzo_Stramaglia_Faes.pdf

Solo gestori archivio

Descrizione: Articolo originale
Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 1.17 MB
Formato Adobe PDF
1.17 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/466698
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
  • OpenAlex ND
social impact