Machine learning (ML) holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities. An important step is to characterize ...the (un)fairness of ML models-their tendency to perform differently across subgroups of the population-and to understand its underlying mechanisms. One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data. Diagnosing this phenomenon is difficult as sensitive attributes may be causally linked with disease. Using multitask learning, we propose a method to directly test for the presence of shortcut learning in clinical ML systems and demonstrate its application to clinical tasks in radiology and dermatology. Finally, our approach reveals instances when shortcutting is not responsible for unfairness, highlighting the need for a holistic approach to fairness mitigation in medical AI.
We measured the fast temporal dynamics of face processing simultaneously across the human temporal cortex (TC) using intracranial recordings in eight participants. We found sites with selective ...responses to faces clustered in the ventral TC, which responded increasingly strongly to marine animal, bird, mammal, and human faces. Both face-selective and face-active but non-selective sites showed a posterior to anterior gradient in response time and selectivity. A sparse model focusing on information from the human face-selective sites performed as well as, or better than, anatomically distributed models when discriminating faces from non-faces stimuli. Additionally, we identified the posterior fusiform site (pFUS) as causally the most relevant node for inducing distortion of conscious face processing by direct electrical stimulation. These findings support anatomically discrete but temporally distributed response profiles in the human brain and provide a new common ground for unifying the seemingly contradictory modular and distributed modes of face processing.
Consciousness has been related to the amount of integrated information that the brain is able to generate. In this paper, we tested the hypothesis that the loss of consciousness caused by propofol ...anesthesia is associated with a significant reduction in the capacity of the brain to integrate information. To assess the functional structure of the whole brain, functional integration and partial correlations were computed from fMRI data acquired from 18 healthy volunteers during resting wakefulness and propofol-induced deep sedation. Total integration was significantly reduced from wakefulness to deep sedation in the whole brain as well as within and between its constituent networks (or systems). Integration was systematically reduced within each system (i.e., brain or networks), as well as between networks. However, the ventral attentional network maintained interactions with most other networks during deep sedation. Partial correlations further suggested that functional connectivity was particularly affected between parietal areas and frontal or temporal regions during deep sedation. Our findings suggest that the breakdown in brain integration is the neural correlate of the loss of consciousness induced by propofol. They stress the important role played by parietal and frontal areas in the generation of consciousness.
► Detection of low frequency fMRI group networks using sICA and clustering. ► Objective, automatic methods to quantify interactions between networks. ► Comparison of resting wakefulness and propofol-induced anesthesia using integration. ► Significant decreases in within- and between-network integration at the brain scale. ► Fronto-parietal segregation of networks during sedation.
Experimental data are subject to different sources of disturbance and errors, whose importance should be assessed. The level of noise, the presence of outliers or a measure of the "explainability" of ...the key variables with respect to the externally-imposed operating condition are important indicators, but are not straightforward to obtain, especially if the data are sparse and multivariate. This paper proposes a methodology and a suite of tools implementing Gaussian processes for quality assessment of steady-state experimental data. The aim of the proposed tool is to: (1) provide a smooth (de-noised) multivariate operating map of the measured variable with respect to the inputs; (2) determine which inputs are relevant to predict a selected output; (3) provide a sensitivity analysis of the measured variables with respect to the inputs; (4) provide a measure of the accuracy (confidence intervals) for the prediction of the data; (5) detect the observations that are likely to be outliers. We show that Gaussian processes regression provides insightful numerical indicators for these purposes and that the obtained performance is higher or comparable to alternative modeling techniques. Finally, the datasets and tools developed in this work are provided within the GPExp open-source package.
Multivariate classification is used in neuroimaging studies to infer brain activation or in medical applications to infer diagnosis. Their results are often assessed through either a binomial or a ...permutation test. Here, we simulated classification results of generated random data to assess the influence of the cross-validation scheme on the significance of results. Distributions built from classification of random data with cross-validation did not follow the binomial distribution. The binomial test is therefore not adapted. On the contrary, the permutation test was unaffected by the cross-validation scheme. The influence of the cross-validation was further illustrated on real-data from a brain-computer interface experiment in patients with disorders of consciousness and from an fMRI study on patients with Parkinson disease. Three out of 16 patients with disorders of consciousness had significant accuracy on binomial testing, but only one showed significant accuracy using permutation testing. In the fMRI experiment, the mental imagery of gait could discriminate significantly between idiopathic Parkinson's disease patients and healthy subjects according to the permutation test but not according to the binomial test. Hence, binomial testing could lead to biased estimation of significance and false positive or negative results. In our view, permutation testing is thus recommended for clinical application of classification with cross-validation.
Predicting a particular cognitive state from a specific pattern of fMRI voxel values is still a methodological challenge. Decoding brain activity is usually performed in highly controlled ...experimental paradigms characterized by a series of distinct states induced by a temporally constrained experimental design. In more realistic conditions, the number, sequence and duration of mental states are unpredictably generated by the individual, resulting in complex and imbalanced fMRI data sets. This study tests the classification of brain activity, acquired on 16 volunteers using fMRI, during mental imagery, a condition in which the number and duration of mental events were not externally imposed but self-generated. To deal with these issues, two classification techniques were considered (Support Vector Machines, SVM, and Gaussian Processes, GP), as well as different feature extraction methods (General Linear Model, GLM and SVM). These techniques were combined in order to identify the procedures leading to the highest accuracy measures. Our results showed that 12 data sets out of 16 could be significantly modeled by either SVM or GP. Model accuracies tended to be related to the degree of imbalance between classes and to task performance of the volunteers. We also conclude that the GP technique tends to be more robust than SVM to model unbalanced data sets.
It is becoming increasingly clear that pathophysiological processes underlying psychiatric disorders categories are heterogeneous on many levels, including symptoms, disease course, comorbidity and ...biological underpinnings. This heterogeneity poses challenges for identifying biological markers associated with dimensions of symptoms and behaviour that could provide targets to guide treatment choice and novel treatment. In response, the research domain criteria (RDoC) (Insel et al., 2010) was developed to advocate a dimensional approach which omits any disease definitions, disorder thresholds, or cut-points for various levels of psychopathology to understanding the pathophysiological processes underlying psychiatry disorders. In the present study we aimed to apply pattern regression analysis to identify brain signatures during dynamic emotional face processing that are predictive of anxiety and depression symptoms in a continuum that ranges from normal to pathological levels, cutting across categorically-defined diagnoses.
The sample was composed of one-hundred and fifty-four young adults (mean age=21.6 and s.d.=2.0, 103 females) consisting of eighty-two young adults seeking treatment for psychological distress that cut across categorically-defined diagnoses and 72 matched healthy young adults. Participants performed a dynamic face task involving fearful, angry and happy faces (and geometric shapes) while undergoing functional Magnetic Resonance Imaging (fMRI). Pattern regression analyses consisted of Gaussian Process Regression (GPR) implemented in the Pattern Recognition for Neuroimaging toolbox (PRoNTo). Predicted and actual clinical scores were compared using Pearson's correlation coefficient (r) and normalized mean squared error (MSE) to evaluate the models' performance. Permutation test was applied to estimate significance levels.
GPR identified patterns of neural activity to dynamic emotional face processing predictive of self-report anxiety in the whole sample, which covered a continuum that ranged from healthy to different levels of distress, including subthreshold to fully-syndromal psychiatric diagnoses. Results were significant using two different cross validation strategies (two-fold: r=0.28 (p-value=0.001), MSE=4.47 (p-value=0.001) and five fold r=0.28 (p-value=0.002), MSE=4.62 (p-value=0.003). The contributions of individual regions to the predictive model were very small, demonstrating that predictions were based on the overall pattern rather than on a small combination of regions.
These findings represent early evidence that neuroimaging techniques may inform clinical assessment of young adults irrespective of diagnoses by allowing accurate and objective quantitative estimation of psychopathology.
fMRI Artefact Rejection and Sleep Scoring Toolbox Leclercq, Yves; Schrouff, Jessica; Noirhomme, Quentin ...
Computational Intelligence and Neuroscience,
01/2011, Letnik:
2011
Journal Article, Web Resource
Recenzirano
Odprti dostop
We started writing the “fMRI artefact rejection and sleep scoring toolbox”, or “FA𝕊T”, to process our sleep EEG-fMRI data, that is, the simultaneous recording of electroencephalographic and ...functional magnetic resonance imaging data acquired while a subject is asleep. FA𝕊T tackles three crucial issues typical of this kind of data: (1) data manipulation (viewing, comparing, chunking, etc.) of long continuous M/EEG recordings, (2) rejection of the fMRI-induced artefact in the EEG signal, and (3) manual sleep-scoring of the M/EEG recording. Currently, the toolbox can efficiently deal with these issues via a GUI, SPM8 batching system or hand-written script. The tools developed are, of course, also useful for other EEG applications, for example, involving simultaneous EEG-fMRI acquisition, continuous EEG eye-balling, and manipulation. Even though the toolbox was originally devised for EEG data, it will also gracefully handle MEG data without any problem. “FA𝕊T” is developed in Matlab as an add-on toolbox for SPM8 and, therefore, internally uses its SPM8-meeg data format. “FA𝕊T” is available for free, under the GNU-GPL.
In the past years, mass univariate statistical analyses of neuroimaging data have been complemented by the use of multivariate pattern analyses, especially based on machine learning models. While ...these allow an increased sensitivity for the detection of spatially distributed effects compared to univariate techniques, they lack an established and accessible software framework. The goal of this work was to build a toolbox comprising all the necessary functionalities for multivariate analyses of neuroimaging data, based on machine learning models. The “Pattern Recognition for Neuroimaging Toolbox” (PRoNTo) is open-source, cross-platform, MATLAB-based and SPM compatible, therefore being suitable for both cognitive and clinical neuroscience research. In addition, it is designed to facilitate novel contributions from developers, aiming to improve the interaction between the neuroimaging and machine learning communities. Here, we introduce PRoNTo by presenting examples of possible research questions that can be addressed with the machine learning framework implemented in PRoNTo, and cannot be easily investigated with mass univariate statistical analysis.
Evidence for intrinsic functional connectivity (FC) within the human brain is largely from neuroimaging studies of hemodynamic activity. Data are lacking from anatomically precise ...electrophysiological recordings in the most widely studied nodes of human brain networks. Here we used a combination of fMRI and electrocorticography (ECoG) in five human neurosurgical patients with electrodes in the canonical "default" (medial prefrontal and posteromedial cortex), "dorsal attention" (frontal eye fields and superior parietal lobule), and "frontoparietal control" (inferior parietal lobule and dorsolateral prefrontal cortex) networks. In this unique cohort, simultaneous intracranial recordings within these networks were anatomically matched across different individuals. Within each network and for each individual, we found a positive, and reproducible, spatial correlation for FC measures obtained from resting-state fMRI and separately recorded ECoG in the same brains. This relationship was reliably identified for electrophysiological FC based on slow (<1 Hz) fluctuations of high-frequency broadband (70-170 Hz) power, both during wakeful rest and sleep. A similar FC organization was often recovered when using lower-frequency (1-70 Hz) power, but anatomical specificity and consistency were greatest for the high-frequency broadband range. An interfrequency comparison of fluctuations in FC revealed that high and low-frequency ranges often temporally diverged from one another, suggesting that multiple neurophysiological sources may underlie variations in FC. Together, our work offers a generalizable electrophysiological basis for intrinsic FC and its dynamics across individuals, brain networks, and behavioral states.
The study of human brain networks during wakeful "rest", largely with fMRI, is now a major focus in both cognitive and clinical neuroscience. However, little is known about the neurophysiology of these networks and their dynamics. We studied neural activity during wakeful rest and sleep within neurosurgical patients with directly implanted electrodes. We found that network activity patterns showed striking similarities between fMRI and direct recordings in the same brains. With improved resolution of direct recordings, we also found that networks were best characterized with specific activity frequencies and that different frequencies show different profiles of within-network activity over time. Our work clarifies how networks spontaneously organize themselves across individuals, brain networks, and behavioral states.
PDF
