Several studies underscore the potential of deep learning in identifying complex patterns, leading to diagnostic and prognostic biomarkers. Identifying sufficiently large and diverse datasets, ...required for training, is a significant challenge in medicine and can rarely be found in individual institutions. Multi-institutional collaborations based on centrally-shared patient data face privacy and ownership challenges. Federated learning is a novel paradigm for data-private multi-institutional collaborations, where model-learning leverages all available data without sharing data between institutions, by distributing the model-training to the data-owners and aggregating their results. We show that federated learning among 10 institutions results in models reaching 99% of the model quality achieved with centralized data, and evaluate generalizability on data from institutions outside the federation. We further investigate the effects of data distribution across collaborating institutions on model quality and learning patterns, indicating that increased access to data through data private multi-institutional collaborations can benefit model quality more than the errors introduced by the collaborative method. Finally, we compare with other collaborative-learning approaches demonstrating the superiority of federated learning, and discuss practical implementation considerations. Clinical adoption of federated learning is expected to lead to models trained on datasets of unprecedented size, hence have a catalytic impact towards precision/personalized medicine.
Brain extraction, or skull-stripping, is an essential pre-processing step in neuro-imaging that has a direct impact on the quality of all subsequent processing and analyses steps. It is also a key ...requirement in multi-institutional collaborations to comply with privacy-preserving regulations. Existing automated methods, including Deep Learning (DL) based methods that have obtained state-of-the-art results in recent years, have primarily targeted brain extraction without considering pathologically-affected brains. Accordingly, they perform sub-optimally when applied on magnetic resonance imaging (MRI) brain scans with apparent pathologies such as brain tumors. Furthermore, existing methods focus on using only T1-weighted MRI scans, even though multi-parametric MRI (mpMRI) scans are routinely acquired for patients with suspected brain tumors. In this study, we present a comprehensive performance evaluation of recent deep learning architectures for brain extraction, training models on mpMRI scans of pathologically-affected brains, with a particular focus on seeking a practically-applicable, low computational footprint approach, generalizable across multiple institutions, further facilitating collaborations. We identified a large retrospective multi-institutional dataset of n=3340 mpMRI brain tumor scans, with manually-inspected and approved gold-standard segmentations, acquired during standard clinical practice under varying acquisition protocols, both from private institutional data and public (TCIA) collections. To facilitate optimal utilization of rich mpMRI data, we further introduce and evaluate a novel ‘‘modality-agnostic training’’ technique that can be applied using any available modality, without need for model retraining. Our results indicate that the modality-agnostic approach11Publicly available source code: https://github.com/CBICA/BrainMaGe obtains accurate results, providing a generic and practical tool for brain extraction on scans with brain tumors.
•Accurate brain extraction on MRI scans in presence of diffuse gliomas is critical.•Comprehensive evaluation of prominent deep learning architectures, BET & FreeSurfer.•Multi-institutional data to test generalizability and to facilitate collaborations.•A novel “modality-agnostic” strategy to promote widespread application.
Functional magnetic resonance imaging (fMRI) is an important tool for pre-surgical evaluation of eloquent cortex. Classic task-based paradigms require patient participation and individual imaging ...sequence acquisitions for each functional domain that is being assessed. Resting state fMRI (rs-fMRI), however, enables functional localization without patient participation and can evaluate numerous functional domains with a single imaging session. To date, post-processing of this resting state data has been resource intensive, which limits its widespread application for routine clinical use. Through a novel automated algorithm and advanced imaging IT structure, we report the clinical application and the large-scale integration of rs-fMRI into routine neurosurgical practice. One hundred and ninety one consecutive patients underwent a 3T rs-fMRI, 83 of whom also underwent both motor and language task-based fMRI. Data were processed using a novel, automated, multi-layer perceptron algorithm and integrated into stereotactic navigation using a streamlined IT imaging pipeline. One hundred eighty-five studies were performed for intracranial neoplasm, 14 for refractory epilepsy and 33 for vascular malformations or other neurological disorders. Failure rate of rs-fMRI of 13% was significantly better than that for task-based fMRI (38.5%,) (p <0.001). In conclusion, at Washington University in St. Louis, rs-fMRI has become an integral part of standard imaging for neurosurgical planning. Resting state fMRI can be used in all patients, and due to its lower failure rate than task-based fMRI, it is useful for patients who are unable to cooperate with task-based studies.
Use of functional MRI (fMRI) in pre-surgical planning is a non-invasive method for pre-operative functional mapping for patients with brain tumors, especially tumors located near eloquent cortex. ...Currently, this practice predominantly involves task-based fMRI (T-fMRI). Resting state fMRI (RS-fMRI) offers an alternative with several methodological advantages. Here, we compare group-level analyses of RS-fMRI vs. T-fMRI as methods for language localization.
To contrast RS-fMRI vs. T-fMRI as techniques for localization of language function.
We analyzed data obtained in 35 patients who had both T-fMRI and RS-fMRI scans during the course of pre-surgical evaluation. The RS-fMRI data were analyzed using a previously trained resting-state network classifier. The T-fMRI data were analyzed using conventional techniques. Group-level results obtained by both methods were evaluated in terms of two outcome measures: (1) inter-subject variability of response magnitude and (2) sensitivity/specificity analysis of response topography, taking as ground truth previously reported maps of the language system based on intraoperative cortical mapping as well as meta-analytic maps of language task fMRI responses.
Both fMRI methods localized major components of the language system (areas of Broca and Wernicke) although not with equal inter-subject consistency. Word-stem completion T-fMRI strongly activated Broca's area but also several task-general areas not specific to language. RS-fMRI provided a more specific representation of the language system.
We demonstrate several advantages of classifier-based mapping of language representation in the brain. Language T-fMRI activated task-general (i.e., not language-specific) functional systems in addition to areas of Broca and Wernicke. In contrast, classifier-based analysis of RS-fMRI data generated maps confined to language-specific regions of the brain.
To explore if early perfusion-weighted magnetic resonance imaging (PWI) may be a promising imaging biomarker to predict local recurrence (LR) of brain metastases after stereotactic radiosurgery ...(SRS).
This is a prospective pilot study of adult brain metastasis patients who were treated with SRS and imaged with PWI before and 1 week later. Relative cerebral blood volume (rCBV) parameter maps were calculated by normalizing to the mean value of the contralateral white matter on PWI. Cox regression was conducted to explore factors associated with time to LR, with Bonferroni adjusted p<0.0006 for multiple testing correction. LR rates were estimated with the Kaplan-Meier method and compared using the log-rank test.
Twenty-three patients were enrolled from 2013 through 2016, with 22 evaluable lesions from 16 patients. After a median follow-up of 13.1 months (range: 3.0-53.7), 5 lesions (21%) developed LR after a median of 3.4 months (range: 2.3-5.7). On univariable analysis, larger tumor volume (HR 1.48, 95% CI 1.02-2.15, p = 0.04), lower SRS dose (HR 0.45, 95% CI 0.21-0.97, p = 0.04), and higher rCBV at week 1 (HR 1.07, 95% CI 1.003-1.14, p = 0.04) had borderline association with shorter time to LR. Tumors >2.0cm3 had significantly higher LR than if ≤2.0cm3: 54% vs 0% at 1 year, respectively, p = 0.008. A future study to confirm the association of early PWI and LR of the high-risk cohort of lesions >2.0cm3 is estimated to require 258 patients.
PWI at week 1 after SRS may have borderline association with LR. Tumors <2.0cm3 have low risk of LR after SRS and may be low-yield for predictive biomarker studies. Information regarding sample size and potential challenges for future imaging biomarker studies may be gleaned from this pilot study.
•Precise DBS electrode position is critical to study structure-function relationship.•We developed a precise method for determining DBS electrode position using CT scans.•Our semi-automated method ...(ESM-CT) is robust to resampling with good reproducibility.•Head angle at time of image acquisition affects calculated DBS electrode position.
Deep brain stimulation (DBS) of the subthalamic nucleus produces variable effects in Parkinson disease. Variation may result from different electrode positions relative to target. Thus, precise electrode localization is crucial when investigating DBS effects.
We developed a semi-automated method, Electrode Shaft Modeling in CT images (ESM-CT) to reconstruct DBS lead trajectories and contact locations. We evaluated methodological sensitivity to operator-dependent steps, robustness to image resampling, and test-retest replicability. ESM-CT was applied in 56 patients to study electrode position change (and relation to time between scans, postoperative subdural air volume, and head tilt during acquisition) between images acquired immediately post-implantation (DBS-CT) and months later (DEL-CT).
Electrode tip localization was robust to image resampling and replicable to within ∼ 0.2 mm on test-retest comparisons. Systematic electrode displacement occurred rostral-ventral-lateral between DBS-CT and DEL-CT scans. Head angle was a major explanatory factor (p < 0.001,Pearson’s r = 0.46, both sides) and volume of subdural air weakly predicted electrode displacement (p = 0.02,r = 0.29:p = 0.1,r = 0.25 for left:right). Modeled shaft curvature was slightly greater in DEL-CT. Magnitude of displacement and degree of curvature were independent of elapsed time between scans.
Comparison of ESM-CT against two existing methods revealed systematic differences in one coordinate (1 ± 0.3 mm,p < 0.001) for one method and in three coordinates for another method (x:0.1 ± 0.1 mm, y:0.4 ± 0.2 mm, z:0.4 ± 0.2 mm, p < 10−10). Within-method coordinate variability across participants is similar.
We describe a robust and precise method for CT DBS contact localization. Application revealed that acquisition head angle significantly impacts electrode position. DBS localization schemes should account for head angle.
Primary brain tumors are composed of tumor cells, neural/glial tissues, edema, and vasculature tissue. Conventional MRI has a limited ability to evaluate heterogeneous tumor pathologies. We developed ...a novel diffusion MRI-based method-Heterogeneity Diffusion Imaging (HDI)-to simultaneously detect and characterize multiple tumor pathologies and capillary blood perfusion using a single diffusion MRI scan.
Seven adult patients with primary brain tumors underwent standard-of-care MRI protocols and HDI protocol before planned surgical resection and/or stereotactic biopsy. Twelve tumor sampling sites were identified using a neuronavigational system and recorded for imaging data quantification. Metrics from both protocols were compared between World Health Organization (WHO) II and III tumor groups. Cerebral blood volume (CBV) derived from dynamic susceptibility contrast (DSC) perfusion imaging was also compared with the HDI-derived perfusion fraction.
The conventional apparent diffusion coefficient did not identify differences between WHO II and III tumor groups. HDI-derived slow hindered diffusion fraction was significantly elevated in the WHO III group as compared with the WHO II group. There was a non-significantly increasing trend of HDI-derived tumor cellularity fraction in the WHO III group, and both HDI-derived perfusion fraction and DSC-derived CBV were found to be significantly higher in the WHO III group. Both HDI-derived perfusion fraction and slow hindered diffusion fraction strongly correlated with DSC-derived CBV. Neither HDI-derived cellularity fraction nor HDI-derived fast hindered diffusion fraction correlated with DSC-derived CBV.
Conventional apparent diffusion coefficient, which measures averaged pathology properties of brain tumors, has compromised accuracy and specificity. HDI holds great promise to accurately separate and quantify the tumor cell fraction, the tumor cell packing density, edema, and capillary blood perfusion, thereby leading to an improved microenvironment characterization of primary brain tumors. Larger studies will further establish HDI's clinical value and use for facilitating biopsy planning, treatment evaluation, and noninvasive tumor grading.
To compare quantitative imaging parameter measures from diffusion- and perfusion-weighted imaging magnetic resonance imaging (MRI) sequences in subjects with brain tumors that have been processed ...with different software platforms.
Scans from 20 subjects with primary brain tumors were selected from the Comprehensive Neuro-oncology Data Repository at Washington University School of Medicine (WUSM) and the Swedish Neuroscience Institute. MR images were coregistered, and each subject's data set was processed by three software packages: 1) vendor-specific scanner software, 2) research software developed at WUSM, and 3) a commercially available, Food and Drug Administration-approved, processing platform (Nordic Ice). Regions of interest (ROIs) were chosen within the brain tumor and normal nontumor tissue. The results obtained using these methods were compared.
For diffusion parameters, including mean diffusivity and fractional anisotropy, concordance was high when comparing different processing methods. For perfusion-imaging parameters, a significant variance in cerebral blood volume, cerebral blood flow, and mean transit time (MTT) values was seen when comparing the same raw data processed using different software platforms. Correlation was better with larger ROIs (radii ≥ 5 mm). Greatest variance was observed in MTT.
Diffusion parameter values were consistent across different software processing platforms. Perfusion parameter values were more variable and were influenced by the software used. Variation in the MTT was especially large suggesting that MTT estimation may be unreliable in tumor tissues using current MRI perfusion methods.
PDF
