Purpose
To study the influence of gradient echo–based contrasts as input channels to a 3D patch‐based neural network trained for synthetic CT (sCT) generation in canine and human populations.
Methods
...Magnetic resonance images and CT scans of human and canine pelvic regions were acquired and paired using nonrigid registration. Magnitude MR images and Dixon reconstructed water, fat, in‐phase and opposed‐phase images were obtained from a single T1‐weighted multi‐echo gradient‐echo acquisition. From this set, 6 input configurations were defined, each containing 1 to 4 MR images regarded as input channels. For each configuration, a UNet‐derived deep learning model was trained for synthetic CT generation. Reconstructed Hounsfield unit maps were evaluated with peak SNR, mean absolute error, and mean error. Dice similarity coefficient and surface distance maps assessed the geometric fidelity of bones. Repeatability was estimated by replicating the training up to 10 times.
Results
Seventeen canines and 23 human subjects were included in the study. Performance and repeatability of single‐channel models were dependent on the TE‐related water–fat interference with variations of up to 17% in mean absolute error, and variations of up to 28% specifically in bones. Repeatability, Dice similarity coefficient, and mean absolute error were statistically significantly better in multichannel models with mean absolute error ranging from 33 to 40 Hounsfield units in humans and from 35 to 47 Hounsfield units in canines.
Conclusion
Significant differences in performance and robustness of deep learning models for synthetic CT generation were observed depending on the input. In‐phase images outperformed opposed‐phase images, and Dixon reconstructed multichannel inputs outperformed single‐channel inputs.
Magnetic resonance imaging (MRI) is increasingly utilized as a radiation‐free alternative to computed tomography (CT) for the diagnosis and treatment planning of musculoskeletal pathologies. MR ...imaging of hard tissues such as cortical bone remains challenging due to their low proton density and short transverse relaxation times, rendering bone tissues as nonspecific low signal structures on MR images obtained from most sequences. Developments in MR image acquisition and post‐processing have opened the path for enhanced MR‐based bone visualization aiming to provide a CT‐like contrast and, as such, ease clinical interpretation. The purpose of this review is to provide an overview of studies comparing MR and CT imaging for diagnostic and treatment planning purposes in orthopedic care, with a special focus on selective bone visualization, bone segmentation, and three‐dimensional (3D) modeling. This review discusses conventional gradient‐echo derived techniques as well as dedicated short echo time acquisition techniques and post‐processing techniques, including the generation of synthetic CT, in the context of 3D and specific bone visualization. Based on the reviewed literature, it may be concluded that the recent developments in MRI‐based bone visualization are promising. MRI alone provides valuable information on both bone and soft tissues for a broad range of applications including diagnostics, 3D modeling, and treatment planning in multiple anatomical regions, including the skull, spine, shoulder, pelvis, and long bones.
Level of Evidence
3
Technical Efficacy
Stage 3
This study evaluated the accuracy of synthetic computed tomography (sCT), as compared to CT, for the 3D assessment of the hip morphology. Thirty male patients with asymptomatic hips, referred for ...magnetic resonance (MR) imaging and CT, were included in this retrospective study. sCT images were generated from three‐dimensional radiofrequency‐spoiled T1‐weighted multi‐echo gradient‐echo MR images using a commercially available deep learning‐enabled software and were compared with CT images through mean error and surface distance computation and by means of eight clinical morphometric parameters relevant for hip care. Parameters included center‐edge angle (CEA), sharp angle, acetabular index, extrusion index, femoral head center‐to‐midline distance, acetabular version (AV), and anterior and posterior acetabular sector angles. They were measured by two senior orthopedic surgeons and a radiologist in‐training on CT and sCT images. The reliability and agreement of CT‐ and sCT‐based measurements were assessed using intraclass correlation coefficients (ICCs) for absolute agreement, Bland–Altman plots, and two one‐sided tests for equivalence. The surface distance between CT‐ and sCT‐based bone models were on average submillimeter. CT‐ and sCT‐based measurements showed moderate to excellent interobserver and intraobserver correlation (0.56 < ICC < 0.99). In particular, the inter/intraobserver agreements were good for AV (ICC > 0.75). For CEA, the intraobserver agreement was good (ICC > 0.75) and the interobserver agreement was moderate (ICC > 0.69). Limits of agreements were similar between intraobserver CT and intermodal measurements. All measurements were found statistically equivalent, with average intermodal differences within the intraobserver limits of agreement. In conclusion, sCT and CT were equivalent for the assessment of the hip joint bone morphology.
This study compared magnetic resonance imaging‐based synthetic computed tomography (sCT) to conventional CT for the morphological assessment of the hip joint. The sCT generation technique reconstructed radiodensity contrast accurately, providing bone models within a submillimeter accuracy to CT‐based bone models. CT and sCT images were found statistically equivalent for measuring eight morphometric parameters clinically relevant in hip care. For both modalities, moderate to excellent interobserver and intraobserver reliability were obtained. This provides new possibilities in the radiation‐free diagnosis and surgical planning.
Purpose
To develop and evaluate a patch‐based convolutional neural network (CNN) to generate synthetic computed tomography (sCT) images for magnetic resonance (MR)‐only workflow for radiotherapy of ...head and neck tumors. A patch‐based deep learning method was chosen to improve robustness to abnormal anatomies caused by large tumors, surgical excisions, or dental artifacts. In this study, we evaluate whether the generated sCT images enable accurate MR‐based dose calculations in the head and neck region.
Methods
We conducted a retrospective study on 34 patients with head and neck cancer who underwent both CT and MR imaging for radiotherapy treatment planning. To generate the sCTs, a large field‐of‐view T2‐weighted Turbo Spin Echo MR sequence was used from the clinical protocol for multiple types of head and neck tumors. To align images as well as possible on a voxel‐wise level, CT scans were nonrigidly registered to the MR (CTreg). The CNN was based on a U‐net architecture and consisted of 14 layers with 3 × 3 × 3 filters. Patches of 48 × 48 × 48 were randomly extracted and fed into the training. sCTs were created for all patients using threefold cross validation. For each patient, the clinical CT‐based treatment plan was recalculated on sCT using Monaco TPS (Elekta). We evaluated mean absolute error (MAE) and mean error (ME) within the body contours and dice scores in air and bone mask. Also, dose differences and gamma pass rates between CT‐ and sCT‐based plans inside the body contours were calculated.
Results
sCT generation took 4 min per patient. The MAE over the patient population of the sCT within the intersection of body contours was 75 ± 9 Hounsfield Units (HU) (±1 SD), and the ME was 9 ± 11 HU. Dice scores of the air and bone masks (CTreg vs sCT) were 0.79 ± 0.08 and 0.70 ± 0.07, respectively. Dosimetric analysis showed mean deviations of −0.03% ± 0.05% for dose within the body contours and −0.07% ± 0.22% inside the >90% dose volume. Dental artifacts obscuring the CT could be circumvented in the sCT by the CNN‐based approach in combination with Turbo Spin Echo (TSE) magnetic resonance imaging (MRI) sequence that typically is less prone to susceptibility artifacts.
Conclusions
The presented CNN generated sCTs from conventional MR images without adding scan time to the acquisition. Dosimetric evaluation suggests that dose calculations performed on the sCTs are accurate, and can therefore be used for MR‐only radiotherapy treatment planning of the head and neck.
Display omitted
•Satisfactory synthetic CT images were derived from planning T1w and T2w MR images.•Deep learning-based MRI-only radiotherapy is feasible in pediatric abdominal tumors.•CT-sCT dose ...differences were clinically acceptable (<2%) for photon & proton plans.•Larger differences were caused by existing interscan differences (eg bowel filling)
To assess the feasibility of magnetic resonance imaging (MRI)-only treatment planning for photon and proton radiotherapy in children with abdominal tumours.
The study was conducted on 66 paediatric patients with Wilms’ tumour or neuroblastoma (age 4 ± 2 years) who underwent MR and computed tomography (CT) acquisition on the same day as part of the clinical protocol. MRI intensities were converted to CT Hounsfield units (HU) by means of a UNet-like neural network trained to generate synthetic CT (sCT) from T1- and T2-weighted MR images. The CT-to-sCT image similarity was evaluated by computing the mean error (ME), mean absolute error (MAE), peak signal-to-noise ratio (PSNR) and Dice similarity coefficient (DSC). Synthetic CT dosimetric accuracy was verified against CT-based dose distributions for volumetric-modulated arc therapy (VMAT) and intensity-modulated pencil-beam scanning (PBS). Relative dose differences (Ddiff) in the internal target volume and organs-at-risk were computed and a three-dimensional gamma analysis (2 mm, 2%) was performed.
The average ± standard deviation ME was −5 ± 12 HU, MAE was 57 ± 12 HU, PSNR was 30.3 ± 1.6 dB and DSC was 76 ± 8% for bones and 92 ± 9% for lungs. Average Ddiff were <0.5% for both VMAT (range −2.5; 2.4%) and PBS (range −2.7; 3.7%) dose distributions. The average gamma pass-rates were >99% (range 85; 100%) for VMAT and >96% (range 87; 100%) for PBS.
The deep learning-based model generated accurate sCT from planning T1w- and T2w-MR images. Most dosimetric differences were within clinically acceptable criteria for photon and proton radiotherapy, demonstrating the feasibility of an MRI-only workflow for paediatric patients with abdominal tumours.
This study aims at assessing approaches for generating high‐resolution magnetic resonance imaging‐ (MRI‐) based synthetic computed tomography (sCT) images suitable for orthopedic care using a deep ...learning model trained on low‐resolution computed tomography (CT) data. To that end, paired MRI and CT data of three anatomical regions were used: high‐resolution knee and ankle data, and low‐resolution hip data. Four experiments were conducted to investigate the impact of low‐resolution training CT data on sCT generation and to find ways to train models on low‐resolution data while providing high‐resolution sCT images. Experiments included resampling of the training data or augmentation of the low‐resolution data with high‐resolution data. Training sCT generation models using low‐resolution CT data resulted in blurry sCT images. By resampling the MRI/CT pairs before the training, models generated sharper images, presumably through an increase in the MRI/CT mutual information. Alternatively, augmenting the low‐resolution with high‐resolution data improved sCT in terms of mean absolute error proportionally to the amount of high‐resolution data. Overall, the morphological accuracy was satisfactory as assessed by an average intermodal distance between joint centers ranging from 0.7 to 1.2 mm and by an average intermodal root‐mean‐squared distances between bone surfaces under 0.7 mm. Average dice scores ranged from 79.8% to 87.3% for bony structures. To conclude, this paper proposed approaches to generate high‐resolution sCT suitable for orthopedic care using low‐resolution data. This can generalize the use of sCT for imaging the musculoskeletal system, paving the way for an MR‐only imaging with simplified logistics and no ionizing radiation.
Objectives
Visualization of the bone distribution is an important prerequisite for MRI-guided high-intensity focused ultrasound (MRI-HIFU) treatment planning of bone metastases. In this context, we ...evaluated MRI-based synthetic CT (sCT) imaging for the visualization of cortical bone.
Methods
MR and CT images of nine patients with pelvic and femoral metastases were retrospectively analyzed in this study. The metastatic lesions were osteolytic, osteoblastic or mixed. sCT were generated from pre-treatment or treatment MR images using a UNet-like neural network. sCT was qualitatively and quantitatively compared to CT in the bone (pelvis or femur) containing the metastasis and in a region of interest placed on the metastasis itself, through mean absolute difference (MAD), mean difference (MD), Dice similarity coefficient (DSC), and root mean square surface distance (RMSD).
Results
The dataset consisted of 3 osteolytic, 4 osteoblastic and 2 mixed metastases. For most patients, the general morphology of the bone was well represented in the sCT images and osteolytic, osteoblastic and mixed lesions could be discriminated. Despite an average timespan between MR and CT acquisitions of 61 days, in bone, the average (± standard deviation) MAD was 116 ± 26 HU, MD − 14 ± 66 HU, DSC 0.85 ± 0.05, and RMSD 2.05 ± 0.48 mm and, in the lesion, MAD was 132 ± 62 HU, MD − 31 ± 106 HU, DSC 0.75 ± 0.2, and RMSD 2.73 ± 2.28 mm.
Conclusions
Synthetic CT images adequately depicted the cancellous and cortical bone distribution in the different lesion types, which shows its potential for MRI-HIFU treatment planning.
Key Points
•
Synthetic computed tomography was able to depict bone distribution in metastatic lesions.
•
Synthetic computed tomography images intrinsically aligned with treatment MR images may have the potential to facilitate MR-HIFU treatment planning of bone metastases, by combining visualization of soft tissues and cancellous and cortical bone.
Background
Three-dimensional (3D)-printed saw guides are frequently used to optimize osteotomy results and are usually designed based on computed tomography (CT), despite the radiation burden, as ...radiation-less alternatives like magnetic resonance imaging (MRI) have inferior bone visualization capabilities. This study investigated the usability of MR-based synthetic-CT (sCT), a novel radiation-less bone visualization technique for 3D planning and design of patient-specific saw guides.
Methods
Eight human cadaveric lower arms (mean age: 78y) received MRI and CT scans as well as high-resolution micro-CT. From the MRI scans, sCT were generated using a conditional generative adversarial network. Digital 3D bone surface models based on the sCT and general CT were compared to the surface model from the micro-CT that was used as ground truth for image resolution. From both the sCT and CT digital bone models saw guides were designed and 3D-printed in nylon for one proximal and one distal bone position for each radius and ulna. Six blinded observers placed these saw guides as accurately as possible on dissected bones. The position of each guide was assessed by optical 3D-scanning of each bone with positioned saw guide and compared to the preplanning. Eight placement errors were evaluated: three translational errors (along each axis), three rotational errors (around each axis), a total translation (∆T) and a total rotation error (∆R).
Results
Surface models derived from micro-CT were on average smaller than sCT and CT-based models with average differences of 0.27 ± 0.30 mm for sCT and 0.24 ± 0.12 mm for CT. No statistically significant positioning differences on the bones were found between sCT- and CT-based saw guides for any axis specific translational or rotational errors nor between the ∆T (
p
= .284) and ∆R (
p
= .216). On Bland-Altman plots, the ∆T and ∆R limits of agreement (LoA) were within the inter-observer variability LoA.
Conclusions
This research showed a similar error for sCT and CT digital surface models when comparing to ground truth micro-CT models. Additionally, the saw guide study showed equivalent CT- and sCT-based saw guide placement errors. Therefore, MRI-based synthetic CT is a promising radiation-less alternative to CT for the creation of patient-specific osteotomy surgical saw guides.
Purpose: To assess the feasibility of deep learning-based high resolution synthetic CT generation from MRI scans of the lower arm for orthopedic applications. Methods: A conditional Generative ...Adversarial Network was trained to synthesize CT images from multi-echo MR images. A training set of MRI and CT scans of 9 ex vivo lower arms was acquired and the CT images were registered to the MRI images. Three-fold cross-validation was applied to generate independent results for the entire dataset. The synthetic CT images were quantitatively evaluated with the mean absolute error metric, and Dice similarity and surface to surface distance on cortical bone segmentations. Results: The mean absolute error was 63.5 HU on the overall tissue volume and 144.2 HU on the cortical bone. The mean Dice similarity of the cortical bone segmentations was 0.86. The average surface to surface distance between bone on real and synthetic CT was 0.48 mm. Qualitatively, the synthetic CT images corresponded well with the real CT scans and partially maintained high resolution structures in the trabecular bone. The bone segmentations on synthetic CT images showed some false positives on tendons, but the general shape of the bone was accurately reconstructed. Conclusions: This study demonstrates that high quality synthetic CT can be generated from MRI scans of the lower arm. The good correspondence of the bone segmentations demonstrates that synthetic CT could be competitive with real CT in applications that depend on such segmentations, such as planning of orthopedic surgery and 3D printing.
PDF
