The framework of information dynamics allows the dissection of the information processed in a network of multiple interacting dynamical systems into meaningful elements of computation that quantify ...the information generated in a target system, stored in it, transferred to it from one or more source systems, and modified in a synergistic or redundant way. The concepts of information transfer and modification have been recently formulated in the context of linear parametric modeling of vector stochastic processes, linking them to the notion of Granger causality and providing efficient tools for their computation based on the state–space (SS) representation of vector autoregressive (VAR) models. Despite their high computational reliability these tools still suffer from estimation problems which emerge, in the case of low ratio between data points available and the number of time series, when VAR identification is performed via the standard ordinary least squares (OLS). In this work we propose to replace the OLS with penalized regression performed through the Least Absolute Shrinkage and Selection Operator (LASSO), prior to computation of the measures of information transfer and information modification. First, simulating networks of several coupled Gaussian systems with complex interactions, we show that the LASSO regression allows, also in conditions of data paucity, to accurately reconstruct both the underlying network topology and the expected patterns of information transfer. Then we apply the proposed VAR-SS-LASSO approach to a challenging application context, i.e., the study of the physiological network of brain and peripheral interactions probed in humans under different conditions of rest and mental stress. Our results, which document the possibility to extract physiologically plausible patterns of interaction between the cardiovascular, respiratory and brain wave amplitudes, open the way to the use of our new analysis tools to explore the emerging field of Network Physiology in several practical applications.
Understanding how different areas of the human brain communicate with each other is a crucial issue in neuroscience. The concepts of structural, functional and effective connectivity have been widely ...exploited to describe the human connectome, consisting of brain networks, their structural connections and functional interactions. Despite high-spatial-resolution imaging techniques such as functional magnetic resonance imaging (fMRI) being widely used to map this complex network of multiple interactions, electroencephalographic (EEG) recordings claim high temporal resolution and are thus perfectly suitable to describe either spatially distributed and temporally dynamic patterns of neural activation and connectivity. In this work, we provide a technical account and a categorization of the most-used data-driven approaches to assess brain-functional connectivity, intended as the study of the statistical dependencies between the recorded EEG signals. Different pairwise and multivariate, as well as directed and non-directed connectivity metrics are discussed with a pros-cons approach, in the time, frequency, and information-theoretic domains. The establishment of conceptual and mathematical relationships between metrics from these three frameworks, and the discussion of novel methodological approaches, will allow the reader to go deep into the problem of inferring functional connectivity in complex networks. Furthermore, emerging trends for the description of extended forms of connectivity (e.g., high-order interactions) are also discussed, along with graph-theory tools exploring the topological properties of the network of connections provided by the proposed metrics. Applications to EEG data are reviewed. In addition, the importance of source localization, and the impacts of signal acquisition and pre-processing techniques (e.g., filtering, source localization, and artifact rejection) on the connectivity estimates are recognized and discussed. By going through this review, the reader could delve deeply into the entire process of EEG pre-processing and analysis for the study of brain functional connectivity and learning, thereby exploiting novel methodologies and approaches to the problem of inferring connectivity within complex networks.
This work presents a comparison between different approaches for the model-free estimation of information-theoretic measures of the dynamic coupling between short realizations of random processes. ...The measures considered are the mutual information rate (MIR) between two random processes X and Y and the terms of its decomposition evidencing either the individual entropy rates of X and Y and their joint entropy rate, or the transfer entropies from X to Y and from Y to X and the instantaneous information shared by X and Y. All measures are estimated through discretization of the random variables forming the processes, performed either via uniform quantization (binning approach) or rank ordering (permutation approach). The binning and permutation approaches are compared on simulations of two coupled non-identical Hènon systems and on three datasets, including short realizations of cardiorespiratory (CR, heart period and respiration flow), cardiovascular (CV, heart period and systolic arterial pressure), and cerebrovascular (CB, mean arterial pressure and cerebral blood flow velocity) measured in different physiological conditions, i.e., spontaneous vs paced breathing or supine vs upright positions. Our results show that, with careful selection of the estimation parameters (i.e., the embedding dimension and the number of quantization levels for the binning approach), meaningful patterns of the MIR and of its components can be achieved in the analyzed systems. On physiological time series, we found that paced breathing at slow breathing rates induces less complex and more coupled CR dynamics, while postural stress leads to unbalancing of CV interactions with prevalent baroreflex coupling and to less complex pressure dynamics with preserved CB interactions. These results are better highlighted by the permutation approach, thanks to its more parsimonious representation of the discretized dynamic patterns, which allows one to explore interactions with longer memory while limiting the curse of dimensionality.
In this work, we extend to the multivariate case the classical correlation analysis used in the field of network physiology to probe dynamic interactions between organ systems in the human body. To ...this end, we define different correlation-based measures of the multivariate interaction (MI) within and between the brain and body subnetworks of the human physiological network, represented, respectively, by the time series of δ, θ, α, and β electroencephalographic (EEG) wave amplitudes, and of heart rate, respiration amplitude, and pulse arrival time (PAT) variability (η, ρ, π). MI is computed: (i) considering all variables in the two subnetworks to evaluate overall brain-body interactions; (ii) focusing on a single target variable and dissecting its global interaction with all other variables into contributions arising from the same subnetwork and from the other subnetwork; and (iii) considering two variables conditioned to all the others to infer the network topology. The framework is applied to the time series measured from the EEG, electrocardiographic (ECG), respiration, and blood volume pulse (BVP) signals recorded synchronously via wearable sensors in a group of healthy subjects monitored at rest and during mental arithmetic and sustained attention tasks. We find that the human physiological network is highly connected, with predominance of the links internal of each subnetwork (mainly η-ρ and δ-θ, θ-α, α-β), but also statistically significant interactions between the two subnetworks (mainly η-β and η-δ). MI values are often spatially heterogeneous across the scalp and are modulated by the physiological state, as indicated by the decrease of cardiorespiratory interactions during sustained attention and by the increase of brain-heart interactions and of brain-brain interactions at the frontal scalp regions during mental arithmetic. These findings illustrate the complex and multi-faceted structure of interactions manifested within and between different physiological systems and subsystems across different levels of mental stress.
The evaluation of time and frequency domain measures of coupling and causality relies on the parametric representation of linear multivariate processes. The study of temporal dependencies among time ...series is based on the identification of a Vector Autoregressive model. This procedure is pursued through the definition of a regression problem solved by means of Ordinary Least Squares (OLS) estimator. However, its accuracy is strongly influenced by the lack of data points and a stable solution is not always guaranteed. To overcome this issue, it is possible to use penalized regression techniques. The aim of this work is to compare the behavior of OLS with different penalized regression methods used for a connectivity analysis in different experimental conditions. Bias, accuracy in the reconstruction of network structure and computational time were used for this purpose. Different penalized regressions were tested by means of simulated data implementing different ground-truth networks under different amounts of data samples available. Then, the approaches were applied to real electroencephalographic signals (EEG) recorded from a healthy volunteer performing a motor imagery task. Penalized regressions outperform OLS in simulation settings when few data samples are available. The application on real EEG data showed how it is possible to use features extracted from brain networks for discriminating between two tasks even in conditions of data paucity. Penalized regression techniques can be used for brain connectivity estimation and can be exploited for the computation of all the connectivity estimators based on linearity assumption overcoming the limitations imposed by the classical OLS.
Brain plasticity and functional reorganization are mechanisms behind functional motor recovery of patients after an ischemic stroke. The study of resting-state motor network functional connectivity ...by means of EEG proved to be useful in investigating changes occurring in the information flow and find correlation with motor function recovery. In the literature, most studies applying EEG to post-stroke patients investigated the undirected functional connectivity of interacting brain regions. Quite recently, works started to investigate the directionality of the connections and many approaches or features have been proposed, each of them being more suitable to describe different aspects, e.g., direct or indirect information flow between network nodes, the coupling strength or its characteristic oscillation frequency. Each work chose one specific measure, despite in literature there is not an agreed consensus, and the selection of the most appropriate measure is still an open issue. In an attempt to shed light on this methodological aspect, we propose here to combine the information of direct and indirect coupling provided by two frequency-domain measures based on Granger's causality, i.e., the directed coherence (DC) and the generalized partial directed coherence (gPDC), to investigate the longitudinal changes of resting-state directed connectivity associated with sensorimotor rhythms α and β, occurring in 18 sub-acute ischemic stroke patients who followed a rehabilitation treatment. Our results showed a relevant role of the information flow through the pre-motor regions in the reorganization of the motor network after the rehabilitation in the sub-acute stage. In particular, DC highlighted an increase in intra-hemispheric coupling strength between pre-motor and primary motor areas, especially in ipsi-lesional hemisphere in both α and β frequency bands, whereas gPDC was more sensitive in the detection of those connection whose variation was mostly represented within the population. A decreased causal flow from contra-lesional premotor cortex towards supplementary motor area was detected in both α and β frequency bands and a significant reinforced inter-hemispheric connection from ipsi to contra-lesional pre-motor cortex was observed in β frequency. Interestingly, the connection from contra towards ipsilesional pre-motor area correlated with upper limb motor recovery in α band. The usage of two different measures of directed connectivity allowed a better comprehension of those coupling changes between brain motor regions, either direct or mediated, which mostly were influenced by the rehabilitation, revealing a particular involvement of the pre-motor areas in the cerebral functional reorganization.
Odorant processing presents multiple parallels across animal species, and insects became relevant models for the study of olfactory coding because of the tractability of the underlying neural ...circuits. Within the insect brain, odorants are received by olfactory sensory neurons and processed by the antennal lobe network. Such a network comprises multiple nodes, named glomeruli, that receive sensory information and are interconnected by local interneurons participating in shaping the neural representation of an odorant. The study of functional connectivity between the nodes of a sensory network in vivo is a challenging task that requires simultaneous recording from multiple nodes at high temporal resolutions. Here, we followed the calcium dynamics of antennal lobe glomeruli and applied Granger causality analysis to assess the functional connectivity among network nodes in the presence and absence of an odorous stimulus. This approach revealed the existence of causal connectivity links between antennal lobe glomeruli in the absence of olfactory stimulation, while at odor arrival, the connectivity network's density increased and became stimulus-specific. Thus, such an analytical approach may provide a new tool for the investigation of neural network plasticity in vivo.
The concept of self-predictability plays a key role for the analysis of the self-driven dynamics of physiological processes displaying richness of oscillatory rhythms. While time domain measures of ...self-predictability, as well as time-varying and local extensions, have already been proposed and largely applied in different contexts, they still lack a clear spectral description, which would be significantly useful for the interpretation of the frequency-specific content of the investigated processes. Herein, we propose a novel approach to characterize the linear self-predictability (LSP) of Gaussian processes in the frequency domain. The LSP spectral functions are related to the peaks of the power spectral density (PSD) of the investigated process, which is represented as the sum of different oscillatory components with specific frequency through the method of spectral decomposition. Remarkably, each of the LSP profiles is linked to a specific oscillation of the process, and it returns frequency-specific measures when integrated along spectral bands of physiological interest, as well as a time domain self-predictability measure with a clear meaning in the field of information theory, corresponding to the well-known information storage, when integrated along the whole frequency axis. The proposed measure is first illustrated in a theoretical simulation, showing that it clearly reflects the degree and frequency-specific location of predictability patterns of the analyzed process in both time and frequency domains. Then, it is applied to beat-to-beat time series of arterial compliance obtained in young healthy subjects. The results evidence that the spectral decomposition strategy applied to both the PSD and the spectral LSP of compliance identifies physiological responses to postural stress of low and high frequency oscillations of the process which cannot be traced in the time domain only, highlighting the importance of computing frequency-specific measures of self-predictability in any oscillatory physiologic process.
Network Physiology is a rapidly growing field of study that aims to understand how physiological systems interact to maintain health. Within the information theory framework the information storage ...(IS) allows to measure the regularity and predictability of a dynamic process under stationarity assumption. However, this assumption does not allow to track over time the transient pathways occurring in the dynamical activity of a physiological system. To address this limitation, we propose a time-varying approach based on the recursive least squares algorithm (RLS) for estimating IS at each time instant, in non-stationary conditions. We tested this approach in simulated time-varying dynamics and in the analysis of electroencephalographic (EEG) signals recorded from healthy volunteers and timed with the heartbeat to investigate brain-heart interactions. In simulations, we show that the proposed approach allows to track both abrupt and slow changes in the information stored in a physiological system. These changes are reflected in its evolution and variability over time. The analysis of brain-heart interactions reveals marked differences across the cardiac cycle phases of the variability of the time-varying IS. On the other hand, the average IS values exhibit a weak modulation over parieto-occiptal areas of the scalp. Our study highlights the importance of developing more advanced methods for measuring IS that account for non-stationarity in physiological systems. The proposed time-varying approach based on RLS represents a useful tool for identifying spatio-temporal dynamics within the neurocardiac system and can contribute to the understanding of brain-heart interactions.
Many complex systems in physics, biology and engineering are modeled as dynamical networks and described using multivariate time series analysis. Recent developments have shown that the emergent ...dynamics of a network system are significantly affected by interactions involving multiple network nodes which cannot be described using pairwise links. While these higher-order interactions can be probed using information-theoretic measures, a rigorous framework to describe them in the frequency domain is still lacking. This work presents an approach for the spectral decomposition of multivariate information measures, capable of identifying higher-order synergistic and redundant interactions between oscillatory processes. We show theoretically that synergy and redundancy can coexist at different frequencies among the output signals of a network system and can be detected only using the proposed spectral method. To demonstrate the broad applicability of the framework, we provide parametric and non-parametric data-efficient estimators for the spectral information measures, and employ them to describe multivariate interactions in three complex systems producing rich oscillatory dynamics, namely the human brain, a ring of electronic oscillators, and the global climate system. In these systems, we show that the use of our framework for the spectral decomposition of information measures reveals multivariate and higher-order interactions not detectable in the time domain. Our results are exemplary of how the frequency-specific analysis of multivariate dynamics can aid the implementation of assessment and control strategies in real-world network systems.
PDF
