Abstract Normal and abnormal brains can be segmented by registering the target image with an atlas. Here, an atlas is defined as the combination of an intensity image (template) and its segmented ...image (the atlas labels). After registering the atlas template and the target image, the atlas labels are propagated to the target image. We define this process as atlas-based segmentation. In recent years, researchers have investigated registration algorithms to match atlases to query subjects and also strategies for atlas construction. In this paper we present a review of the automated approaches for atlas-based segmentation of magnetic resonance brain images. We aim to point out the strengths and weaknesses of atlas-based methods and suggest new research directions. We use two different criteria to present the methods. First, we refer to the algorithms according to their atlas-based strategy : label propagation, multi-atlas methods, and probabilistic techniques. Subsequently, we classify the methods according to their medical target : the brain and its internal structures, tissue segmentation in healthy subjects, tissue segmentation in fetus, neonates and elderly subjects, and segmentation of damaged brains. A quantitative comparison of the results reported in the literature is also presented.
Objectives
Neuropathological studies have shown that multiple sclerosis (MS) lesions are heterogeneous in terms of myelin/axon damage and repair as well as iron content. However, it remains a ...challenge to identify specific chronic lesion types, especially remyelinated lesions, in vivo in patients with MS.
Methods
We performed 3 studies: (1) a cross‐sectional study in a prospective cohort of 115 patients with MS and 76 healthy controls, who underwent 3 T magnetic resonance imaging (MRI) for quantitative susceptibility mapping (QSM), myelin water fraction (MWF), and neurite density index (NDI) maps. White matter (WM) lesions in QSM were classified into 5 QSM lesion types (iso‐intense, hypo‐intense, hyperintense, lesions with hypo‐intense rims, and lesions with paramagnetic rim legions PRLs); (2) a longitudinal study of 40 patients with MS to study the evolution of lesions over 2 years; (3) a postmortem histopathology‐QSM validation study in 3 brains of patients with MS to assess the accuracy of QSM classification to identify neuropathological lesion types in 63 WM lesions.
Results
At baseline, hypo‐ and isointense lesions showed higher mean MWF and NDI values compared to other QSM lesion types (p < 0.0001). Further, at 2‐year follow‐up, hypo‐/iso‐intense lesions showed an increase in MWF. Postmortem analyses revealed that QSM highly accurately identifies (1) fully remyelinated areas as hypo‐/iso‐intense (sensitivity = 88.89% and specificity = 100%), (2) chronic inactive lesions as hyperintense (sensitivity = 71.43% and specificity = 92.00%), and (3) chronic active/smoldering lesions as PRLs (sensitivity = 92.86% and specificity = 86.36%).
Interpretation
These results provide the first evidence that it is possible to distinguish chronic MS lesions in a clinical setting, hereby supporting with new biomarkers to develop and assess remyelinating treatments. ANN NEUROL 2022;92:486–502
To assess whether chronic white matter inflammation in patients with multiple sclerosis (MS) as detected in vivo by paramagnetic rim MRI lesions (PRLs) is associated with higher serum neurofilament ...light chain (sNfL) levels, a marker of neuroaxonal damage.
In 118 patients with MS with no gadolinium-enhancing lesions or recent relapses, we analyzed 3D-submillimeter phase MRI and sNfL levels. Histopathologic evaluation was performed in 25 MS lesions from 20 additional autopsy MS cases.
In univariable analyses, participants with ≥2 PRLs (n = 43) compared to those with ≤1 PRL (n = 75) had higher age-adjusted sNfL percentiles (median, 91 and 68;
< 0.001) and higher Multiple Sclerosis Severity Scale scores (MSSS median, 4.3 and 2.4;
= 0.003). In multivariable analyses, sNfL percentile levels were higher in PRLs ≥2 cases (β
, 16.3; 95% confidence interval CI, 4.6-28.0;
< 0.01), whereas disease-modifying treatment (DMT), Expanded Disability Status Scale (EDSS) score, and T2 lesion load did not affect sNfL. In a similar model, sNfL percentile levels were highest in cases with ≥4 PRLs (n = 30; β
, 30.4; 95% CI, 15.6-45.2;
< 0.01). Subsequent multivariable analysis revealed that PRLs ≥2 cases also had higher MSSS (β
, 1.1; 95% CI, 0.3-1.9;
< 0.01), whereas MSSS was not affected by DMT or T2 lesion load. On histopathology, both chronic active and smoldering lesions exhibited more severe acute axonal damage at the lesion edge than in the lesion center (edge vs center:
= 0.004 and
= 0.0002, respectively).
Chronic white matter inflammation was associated with increased levels of sNfL and disease severity in nonacute MS, suggesting that PRL contribute to clinically relevant, inflammation-driven neurodegeneration.
Damage to the myelin sheath and the neuroaxonal unit is a cardinal feature of multiple sclerosis; however, a detailed characterization of the interaction between myelin and axon damage in vivo ...remains challenging. We applied myelin water and multi-shell diffusion imaging to quantify the relative damage to myelin and axons (i) among different lesion types; (ii) in normal-appearing tissue; and (iii) across multiple sclerosis clinical subtypes and healthy controls. We also assessed the relation of focal myelin/axon damage with disability and serum neurofilament light chain as a global biological measure of neuroaxonal damage. Ninety-one multiple sclerosis patients (62 relapsing-remitting, 29 progressive) and 72 healthy controls were enrolled in the study. Differences in myelin water fraction and neurite density index were substantial when lesions were compared to healthy controls and normal-appearing MS tissue: both white matter and cortical lesions exhibited a decreased myelin water fraction and neurite density index compared with healthy (P < 0.0001) and peri-plaque white matter (P < 0.0001). Periventricular lesions showed decreased myelin water fraction and neurite density index compared with lesions in the juxtacortical region (P < 0.0001 and P < 0.05). Similarly, lesions with paramagnetic rims showed decreased myelin water fraction and neurite density index relative to lesions without a rim (P < 0.0001). Also, in 75% of white matter lesions, the reduction in neurite density index was higher than the reduction in the myelin water fraction. Besides, normal-appearing white and grey matter revealed diffuse reduction of myelin water fraction and neurite density index in multiple sclerosis compared to healthy controls (P < 0.01). Further, a more extensive reduction in myelin water fraction and neurite density index in normal-appearing cortex was observed in progressive versus relapsing-remitting participants. Neurite density index in white matter lesions correlated with disability in patients with clinical deficits (P < 0.01, beta=-10.00); and neurite density index and myelin water fraction in white matter lesions were associated to serum neurofilament light chain in the entire patients cohort (P < 0.01, beta=-3.60 and P < 0.01, beta=0.13, respectively). These findings suggest that (i) myelin and axon pathology in multiple sclerosis is extensive in both lesions and normal-appearing tissue; (ii) particular types of lesions exhibit more damage to myelin and axons than others; (iii) progressive patients differ from relapsing-remitting because of more extensive axon/myelin damage in the cortex; and (iv) myelin and axon pathology in lesions is related to disability in patients with clinical deficits and global measures of neuroaxonal damage.
Most fetal brain MRI reconstruction algorithms rely only on brain tissue-relevant voxels of low-resolution (LR) images to enhance the quality of inter-slice motion correction and image ...reconstruction. Consequently the fetal brain needs to be localized and extracted as a first step, which is usually a laborious and time consuming manual or semi-automatic task. We have proposed in this work to use age-matched template images as prior knowledge to automatize brain localization and extraction. This has been achieved through a novel automatic brain localization and extraction method based on robust template-to-slice block matching and deformable slice-to-template registration. Our template-based approach has also enabled the reconstruction of fetal brain images in standard radiological anatomical planes in a common coordinate space. We have integrated this approach into our new reconstruction pipeline that involves intensity normalization, inter-slice motion correction, and super-resolution (SR) reconstruction. To this end we have adopted a novel approach based on projection of every slice of the LR brain masks into the template space using a fusion strategy. This has enabled the refinement of brain masks in the LR images at each motion correction iteration. The overall brain localization and extraction algorithm has shown to produce brain masks that are very close to manually drawn brain masks, showing an average Dice overlap measure of 94.5%. We have also demonstrated that adopting a slice-to-template registration and propagation of the brain mask slice-by-slice leads to a significant improvement in brain extraction performance compared to global rigid brain extraction and consequently in the quality of the final reconstructed images. Ratings performed by two expert observers show that the proposed pipeline can achieve similar reconstruction quality to reference reconstruction based on manual slice-by-slice brain extraction. The proposed brain mask refinement and reconstruction method has shown to provide promising results in automatic fetal brain MRI segmentation and volumetry in 26 fetuses with gestational age range of 23 to 38 weeks.
•We offer a template-based fetal brain localization, extraction and segmentation.•We reconstruct fetal brain MRI in a standard common coordinate space.•We achieve brain extraction in addition to localization success rate of 93%.•Brain segmentation accuracy (Dice overlap) compared to manual delineation is 94.5%.•We report fetal brain tissue volume growth maps using atlas-based segmentation.
Although still limited in clinical practice, quantitative analysis is expected to increase the value of musculoskeletal (MSK) imaging. Segmentation aims at isolating the tissues and/or regions of ...interest in the image and is crucial to the extraction of quantitative features such as size, signal intensity, or image texture. These features may serve to support the diagnosis and monitoring of disease. Radiomics refers to the process of extracting large amounts of features from radiologic images and combining them with clinical, biological, genetic, or any other type of complementary data to build diagnostic, prognostic, or predictive models. The advent of machine learning offers promising prospects for automatic segmentation and integration of large amounts of data. We present commonly used segmentation methods and describe the radiomics pipeline, highlighting the challenges to overcome for adoption in clinical practice. We provide some examples of applications from the MSK literature.
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. ...Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of sensitive subjects remains scarce, thus hindering the validation of advanced image processing techniques. Numerical phantoms can mitigate these limitations by providing a controlled environment with a known ground truth. In this work, we present FaBiAN, an open-source Fetal Brain magnetic resonance Acquisition Numerical phantom that simulates clinical T2-weighted fast spin echo sequences of the fetal brain. This unique tool is based on a general, flexible and realistic setup that includes stochastic fetal movements, thus providing images of the fetal brain throughout maturation comparable to clinical acquisitions. We demonstrate its value to evaluate the robustness and optimize the accuracy of an algorithm for super-resolution fetal brain magnetic resonance imaging from simulated motion-corrupted 2D low-resolution series compared to a synthetic high-resolution reference volume. We also show that the images generated can complement clinical datasets to support data-intensive deep learning methods for fetal brain tissue segmentation.
It is critical to quantitatively analyse the developing human fetal brain in order to fully understand neurodevelopment in both normal fetuses and those with congenital disorders. To facilitate this ...analysis, automatic multi-tissue fetal brain segmentation algorithms are needed, which in turn requires open datasets of segmented fetal brains. Here we introduce a publicly available dataset of 50 manually segmented pathological and non-pathological fetal magnetic resonance brain volume reconstructions across a range of gestational ages (20 to 33 weeks) into 7 different tissue categories (external cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, deep grey matter, brainstem/spinal cord). In addition, we quantitatively evaluate the accuracy of several automatic multi-tissue segmentation algorithms of the developing human fetal brain. Four research groups participated, submitting a total of 10 algorithms, demonstrating the benefits the dataset for the development of automatic algorithms.
The thalamic nuclei are involved in many neurodegenerative diseases and therefore, their identification is of key importance in numerous clinical treatments. Automated segmentation of thalamic ...subparts is currently achieved by exploring diffusion-weighted magnetic resonance imaging (DW-MRI), but in absence of such data, atlas-based segmentation can be used as an alternative. Currently, there is a limited number of available digital atlases of the thalamus. Moreover, all atlases are created using a few subjects only, thus are prone to errors due to the inter-subject variability of the thalamic morphology. In this work, we present a probabilistic atlas of anatomical subparts of the thalamus built upon a relatively large dataset where the individual thalamic parcellation was done by employing a recently proposed automatic diffusion-based clustering method. Our analyses, comparing the segmentation performance between the atlas-based and the clustering method, demonstrate the ability of the provided atlas to substitute the automated diffusion-based subdivision in the individual space when the DW-MRI is not available.
Diffusion-weighted magnetic resonance imaging (dMRI) is widely used to assess the brain white matter. Fiber orientation distribution functions (FODs) are a common way of representing the orientation ...and density of white matter fibers. However, with standard FOD computation methods, accurate estimation requires a large number of measurements that usually cannot be acquired for newborns and fetuses. We propose to overcome this limitation by using a deep learning method to map as few as six diffusion-weighted measurements to the target FOD. To train the model, we use the FODs computed using multi-shell high angular resolution measurements as target. Extensive quantitative evaluations show that the new deep learning method, using significantly fewer measurements, achieves comparable or superior results than standard methods such as Constrained Spherical Deconvolution and two state-of-the-art deep learning methods. For voxels with one and two fibers, respectively, our method shows an agreement rate in terms of the number of fibers of 77.5% and 22.2%, which is 3% and 5.4% higher than other deep learning methods, and an angular error of 10° and 20°, which is 6° and 5° lower than other deep learning methods. To determine baselines for assessing the performance of our method, we compute agreement metrics using densely sampled newborn data. Moreover, we demonstrate the generalizability of the new deep learning method across scanners, acquisition protocols, and anatomy on two clinical external datasets of newborns and fetuses. We validate fetal FODs, successfully estimated for the first time with deep learning, using post-mortem histological data. Our results show the advantage of deep learning in computing the fiber orientation density for the developing brain from in-vivo dMRI measurements that are often very limited due to constrained acquisition times. Our findings also highlight the intrinsic limitations of dMRI for probing the developing brain microstructure.
•Estimating microstructure with dMRI requires multiple time-consuming measurements.•Acquisitions are time constrained in newborn and fetal populations.•With few samples, deep learning on high quality datasets can alleviate this problem.•Validated on research and clinical datasets of newborns and fetuses, with histology.
PDF
