Purpose
To identify optimal classification methods for computed tomography (CT) radiomics-based preoperative prediction of clear cell renal cell carcinoma (ccRCC) grade.
Materials and methods
...Seventy-one ccRCC patients (31 low grade and 40 high grade) were included in this study. Tumors were manually segmented on CT images followed by the application of three image preprocessing techniques (Laplacian of Gaussian, wavelet filter, and discretization of the intensity values) on delineated tumor volumes. Overall, 2530 radiomics features (tumor shape and size, intensity statistics, and texture) were extracted from each segmented tumor volume. Univariate analysis was performed to assess the association between each feature and the histological condition. Multivariate analysis involved the use of machine learning (ML) algorithms and the following three feature selection algorithms: the least absolute shrinkage and selection operator, Student’s
t
test, and minimum Redundancy Maximum Relevance. These selected features were then used to construct three classification models (SVM, random forest, and logistic regression) to discriminate high from low-grade ccRCC at nephrectomy. Lastly, multivariate model performance was evaluated on the bootstrapped validation cohort using the area under the receiver operating characteristic curve (AUC) metric.
Results
The univariate analysis demonstrated that among the different image sets, 128 bin-discretized images have statistically significant different texture parameters with a mean AUC of 0.74 ± 3 (
q
value < 0.05). The three ML-based classifiers showed proficient discrimination between high and low-grade ccRCC. The AUC was 0.78 for logistic regression, 0.62 for random forest, and 0.83 for the SVM model, respectively.
Conclusion
CT radiomic features can be considered as a useful and promising noninvasive methodology for preoperative evaluation of ccRCC Fuhrman grades.
Objective
To obtain attenuation-corrected PET images directly from non-attenuation-corrected images using a convolutional encoder-decoder network.
Methods
Brain PET images from 129 patients were ...evaluated. The network was designed to map non-attenuation-corrected (NAC) images to pixel-wise continuously valued measured attenuation-corrected (MAC) PET images via an encoder-decoder architecture. Image quality was evaluated using various evaluation metrics. Image quantification was assessed for 19 radiomic features in 83 brain regions as delineated using the Hammersmith atlas (n30r83). Reliability of measurements was determined using pixel-wise relative errors (RE; %) for radiomic feature values in reference MAC PET images.
Results
Peak signal-to-noise ratio (PSNR) and structural similarity index metric (SSIM) values were 39.2 ± 3.65 and 0.989 ± 0.006 for the external validation set, respectively. RE (%) of SUV
mean
was − 0.10 ± 2.14 for all regions, and only 3 of 83 regions depicted significant differences. However, the mean RE (%) of this region was 0.02 (range, − 0.83 to 1.18). SUV
max
had mean RE (%) of − 3.87 ± 2.84 for all brain regions, and 17 regions in the brain depicted significant differences with respect to MAC images with a mean RE of − 3.99 ± 2.11 (range, − 8.46 to 0.76). Homogeneity amongst Haralick-based radiomic features had the highest number (20) of regions with significant differences with a mean RE (%) of 7.22 ± 2.99.
Conclusions
Direct AC of PET images using deep convolutional encoder-decoder networks is a promising technique for brain PET images. The proposed deep learning method shows significant potential for emission-based AC in PET images with applications in PET/MRI and dedicated brain PET scanners.
Key Points
• We demonstrate direct emission-based attenuation correction of PET images without using anatomical information.
• We performed radiomics analysis of 83 brain regions to show robustness of direct attenuation correction of PET images.
• Deep learning methods have significant promise for emission-based attenuation correction in PET images with potential applications in PET/MRI and dedicated brain PET scanners.
Purpose
Considerable progress has been made in the assessment and management of non-small cell lung cancer (NSCLC) patients based on mutation status in the epidermal growth factor receptor (EGFR) and ...Kirsten rat sarcoma viral oncogene (KRAS). At the same time, NSCLC management through KRAS and EGFR mutation profiling faces challenges. In the present work, we aimed to evaluate a comprehensive radiomics framework that enabled prediction of EGFR and KRAS mutation status in NSCLC patients based on radiomic features from low-dose computed tomography (CT), contrast-enhanced diagnostic quality CT (CTD), and positron emission tomography (PET) imaging modalities and use of machine learning algorithms.
Methods
Our study involved NSCLC patients including 150 PET, low-dose CT, and CTD images. Radiomic features from original and preprocessed (including 64 bin discretizing, Laplacian-of-Gaussian (LOG), and Wavelet) images were extracted. Conventional clinically used standard uptake value (SUV) parameters and metabolic tumor volume (MTV) were also obtained from PET images. Highly correlated features were pre-eliminated, and false discovery rate (FDR) correction was performed with the resulting q-values reported for univariate analysis. Six feature selection methods and 12 classifiers were then used for multivariate prediction of gene mutation status (provided by polymerase chain reaction (PCR)) in patients. We performed 10-fold cross-validation for model tuning to improve robustness, and our developed models were assessed on an independent validation set with 68 patients (common in all three imaging modalities). The average area under the receiver operator characteristic curve (AUC) was utilized for performance evaluation.
Results
The best predictive power for conventional PET parameters was achieved by SUV
peak
(AUC 0.69,
p
value = 0.0002) and MTV (AUC 0.55,
p
value = 0.0011) for EGFR and KRAS, respectively. Univariate analysis of extracted radiomics features improved AUC performance to 0.75 (q-value 0.003, Short-Run Emphasis feature of GLRLM from LOG preprocessed image of PET with sigma value 1.5) and 0.71 (q-value 0.00005, Large Dependence Low Gray-Level Emphasis feature of GLDM in LOG preprocessed image of CTD with sigma value 5) for EGFR and KRAS, respectively. Furthermore, multivariate machine learning-based AUC performances were significantly improved to 0.82 for EGFR (LOG preprocessed image of PET with sigma 3 with variance threshold (VT) feature selector and stochastic gradient descent (SGD) classifier (q-value = 4.86E-05) and 0.83 for KRAS (LOG preprocessed image of CT with sigma 3.5 with select model (SM) feature selector and SGD classifier (q-value = 2.81E−09).
Conclusion
Our work demonstrated that non-invasive and reliable radiomics analysis can be successfully used to predict EGFR and KRAS mutation status in NSCLC patients. We demonstrated that radiomic features extracted from different image-feature sets could be used for EGFR and KRAS mutation status prediction in NSCLC patients and showed improved predictive power relative to conventional image-derived metrics.
This study aimed to predict methylation status of the O6 methylguanine-DNA methyltransferase (MGMT) gene promoter status by using magnetic resonance imaging radiomics features, as well as univariate ...and multivariate analysis.
Eighty-two patients who had an MGMT methylation status were included in this study. Tumors were manually segmented in the 4 regions of magnetic resonance images, 1) whole tumor, 2) active/enhanced region, 3) necrotic regions, and 4) edema regions. About 7000 radiomics features were extracted for each patient. Feature selection and classifier were used to predict MGMT status through different machine learning algorithms. The area under the curve (AUC) of the receiver operating characteristic curve was used for model evaluations.
Regarding univariate analysis, the Inverse Variance feature From Gray Level Co-occurrence Matrix in whole tumor segment with 4.5 mm Sigma of Laplacian of Gaussian filter with AUC of 0.71 (P value = 0.002) was found to be the best predictor. For multivariate analysis, the Decision Tree classifier with Select from Model feature selector and LOG (Laplacian of Gaussian) filter in edema region had the highest performance (AUC, 0.78), followed by Ada-Boost classifier with Select from Model feature selector and LOG filter in edema region (AUC, 0.74).
This study showed that radiomics using machine learning algorithms is a feasible noninvasive approach to predict MGMT methylation status in patients with glioblastoma multiforme cancer.
The aim of this work was to assess the robustness of cardiac SPECT radiomic features against changes in imaging settings, including acquisition, and reconstruction parameters.
Four commercial SPECT ...and SPECT/CT cameras were used to acquire images of a static cardiac phantom mimicking typical myorcardial perfusion imaging using 185 MBq of 99mTc. The effects of different image acquisition and reconstruction parameters, including number of views, view matrix size, attenuation correction, as well as image reconstruction related parameters (algorithm, number of iterations, number of subsets, type of post-reconstruction filter, and its associated parameters, including filter order and cut-off frequency) were studied. In total, 5,063 transverse views were reconstructed by varying the aforementioned factors. Eighty-seven radiomic features including first-, second-, and high-order textures were extracted from these images. To assess reproducibility and repeatability, the coefficient of variation (COV), as a widely adopted metric, was measured for each of the radiomic features over the different imaging settings.
The Inverse Difference Moment Normalized (IDMN) and Inverse Difference Normalized (IDN) features from the Gray Level Co-occurrence Matrix (GLCM), Run Percentage (RP) from the Gray Level Co-occurrence Matrix (GLRLM), Zone Entropy (ZE) from the Gray Level Size Zone Matrix (GLSZM), and Dependence Entropy (DE) from the Gray Level Dependence Matrix (GLDM) feature sets were the only features that exhibited high reproducibility (COV ≤ 5%) against changes in all imaging settings. In addition, Large Area Low Gray Level Emphasis (LALGLE), Small Area Low Gray Level Emphasis (SALGLE) and Low Gray Level Zone Emphasis (LGLZE) from GLSZM, and Small Dependence Low Gray Level Emphasis (SDLGLE) from GLDM feature sets turned out to be less reproducible (COV > 20%) against changes in imaging settings. The GLRLM (31.88%) and GLDM feature set (54.2%) had the highest (COV < 5%) and lowest (COV > 20%) number of the reproducible features, respectively. Matrix size had the largest impact on feature variability as most of the features were not repeatable when matrix size was modified with 82.8% of them having a COV > 20%.
The repeatability and reproducibility of SPECT/CT cardiac radiomic features under different imaging settings is feature-dependent. Different image acquisition and reconstruction protocols have variable effects on radiomic features. The radiomic features exhibiting low COV are potential candidates for future clinical studies.
To investigate the impact of harmonization on the performance of CT, PET, and fused PET/CT radiomic features toward the prediction of mutations status, for epidermal growth factor receptor (EGFR) and ...Kirsten rat sarcoma viral oncogene (KRAS) genes in non-small cell lung cancer (NSCLC) patients.
Radiomic features were extracted from tumors delineated on CT, PET, and wavelet fused PET/CT images obtained from 136 histologically proven NSCLC patients. Univariate and multivariate predictive models were developed using radiomic features before and after ComBat harmonization to predict EGFR and KRAS mutation statuses. Multivariate models were built using minimum redundancy maximum relevance feature selection and random forest classifier. We utilized 70/30% splitting patient datasets for training/testing, respectively, and repeated the procedure 10 times. The area under the receiver operator characteristic curve (AUC), accuracy, sensitivity, and specificity were used to assess model performance. The performance of the models (univariate and multivariate), before and after ComBat harmonization was compared using statistical analyses.
While the performance of most features in univariate modeling was significantly improved for EGFR prediction, most features did not show any significant difference in performance after harmonization in KRAS prediction. Average AUCs of all multivariate predictive models for both EGFR and KRAS were significantly improved (q-value < 0.05) following ComBat harmonization. The mean ranges of AUCs increased following harmonization from 0.87–0.90 to 0.92–0.94 for EGFR, and from 0.85–0.90 to 0.91–0.94 for KRAS. The highest performance was achieved by harmonized F_R0.66_W0.75 model with AUC of 0.94, and 0.93 for EGFR and KRAS, respectively.
Our results demonstrated that regarding univariate modelling, while ComBat harmonization had generally a better impact on features for EGFR compared to KRAS status prediction, its effect is feature-dependent. Hence, no systematic effect was observed. Regarding the multivariate models, ComBat harmonization significantly improved the performance of all radiomics models toward more successful prediction of EGFR and KRAS mutation statuses in lung cancer patients. Thus, by eliminating the batch effect in multi-centric radiomic feature sets, harmonization is a promising tool for developing robust and reproducible radiomics using vast and variant datasets.
Display omitted
•We examine the impact of harmonization on multimodality PET/CT radiomics for EGFR and KRAS mutation prediction in NSCLC.•Harmonization had overall a better impact on features for EGFR prediction compared to KRAS, in univariate analysis.•Harmonization effect is feature dependent without a systematic effect on performance, in univariate analysis.•Harmonization significantly improved the performance of multivariate models for EGFR and KRAS mutation prediction.•Harmonization is promising for batch-effect elimination, for robust and reproducible biological status capturing.
The aim of this work is to investigate the applicability of radiomic features alone and in combination with clinical information for the prediction of renal cell carcinoma (RCC) patients’ overall ...survival after partial or radical nephrectomy. Clinical studies of 210 RCC patients from The Cancer Imaging Archive (TCIA) who underwent either partial or radical nephrectomy were included in this study. Regions of interest (ROIs) were manually defined on CT images. A total of 225 radiomic features were extracted and analyzed along with the 59 clinical features. An elastic net penalized Cox regression was used for feature selection. Accelerated failure time (AFT) with the shared frailty model was used to determine the effects of the selected features on the overall survival time. Eleven radiomic and twelve clinical features were selected based on their non-zero coefficients. Tumor grade, tumor malignancy, and pathology t-stage were the most significant predictors of overall survival (OS) among the clinical features (
p
< 0.002, < 0.02, and < 0.018, respectively). The most significant predictors of OS among the selected radiomic features were flatness, area density, and median (
p
< 0.02, < 0.02, and < 0.05, respectively). Along with important clinical features, such as tumor heterogeneity and tumor grade, imaging biomarkers such as tumor flatness, area density, and median are significantly correlated with OS of RCC patients.
This study aimed to investigate the value of clinical, radiomic features extracted from gross tumor volumes (GTVs) delineated on CT images, dose distributions (Dosiomics), and fusion of CT and dose ...distributions to predict outcomes in head and neck cancer (HNC) patients.
A cohort of 240 HNC patients from five different centers was obtained from The Cancer Imaging Archive. Seven strategies, including four non-fusion (Clinical, CT, Dose, DualCT-Dose), and three fusion algorithms (latent low-rank representation referred (LLRR),Wavelet, weighted least square (WLS)) were applied. The fusion algorithms were used to fuse the pre-treatment CT images and 3-dimensional dose maps. Overall, 215 radiomics and Dosiomics features were extracted from the GTVs, alongside with seven clinical features incorporated. Five feature selection (FS) methods in combination with six machine learning (ML) models were implemented. The performance of the models was quantified using the concordance index (CI) in one-center-leave-out 5-fold cross-validation for overall survival (OS) prediction considering the time-to-event.
The mean CI and Kaplan-Meier curves were used for further comparisons. The CoxBoost ML model using the Minimal Depth (MD) FS method and the glmnet model using the Variable hunting (VH) FS method showed the best performance with CI = 0.73 ± 0.15 for features extracted from LLRR fused images. In addition, both glmnet-Cindex and Coxph-Cindex classifiers achieved a CI of 0.72 ± 0.14 by employing the dose images (+ incorporated clinical features) only.
Our results demonstrated that clinical features, Dosiomics and fusion of dose and CT images by specific ML-FS models could predict the overall survival of HNC patients with acceptable accuracy. Besides, the performance of ML methods among the three different strategies was almost comparable.
Patients' rights are integral to medical ethics. This study aimed to perform sentiment analysis and opinion mining on patients' messages by a combination of lexicon-based and machine learning methods ...to identify positive or negative comments and to determine the different ward and staff names mentioned in patients' messages.
The level of satisfaction and observance of the rights of 250 service recipients of the hospital was evaluated through the related checklists by the evaluator. In total, 822 Persian messages, composed of 540 negative and 282 positive comments, were collected and labeled by the evaluator. Pre-processing was performed on the messages and followed by 2 feature vectors which were extracted from the messages, including the term frequency-inverse document frequency (TFIDF) vector and a combination of the multifeature (MF) (a lexicon-based method) and TFIDF (MF + TFIDF) vectors. Six feature selectors and 5 classifiers were used in this study. For the evaluations, 5-fold cross-validation with different metrics including area under the receiver operating characteristic curve (AUC), accuracy (ACC), F1 score, sensitivity (SEN), specificity (SPE) and Precision-Recall Curves (PRC) were reported. Message tag detection, which featured different hospital wards and identified staff names mentioned in the study patients' messages, was implemented by the lexicon-based method.
The best classifier was Multinomial Naïve Bayes in combination with MF + TFIDF feature vector and SelectFromModel (SFM) feature selection (ACC = 0.89 ± 0.03, AUC = 0.87 ± 0.03, F1 = 0.92 ± 0.03, SEN = 0.93 ± 0.04, and SPE = 0.82 ± 0.02, PRC-AUC = 0.97). Two methods of assessment by the evaluator and artificial intelligence as well as survey systems were compared.
Our results demonstrated that the lexicon-based method, in combination with machine learning classifiers, could extract sentiments in patients' comments and classify them into positive and negative categories. We also developed an online survey system to analyze patients' satisfaction in different wards and to remove conventional assessments by the evaluator.
Purpose
Glioblastoma Multiforme (GBM) represents the predominant aggressive primary tumor of the brain with short overall survival (OS) time. We aim to assess the potential of radiomic features in ...predicting the time-to-event OS of patients with GBM using machine learning (ML) algorithms.
Materials and methods
One hundred nineteen patients with GBM, who had T1-weighted contrast-enhanced and T2-FLAIR MRI sequences, along with clinical data and survival time, were enrolled. Image preprocessing methods included 64 bin discretization, Laplacian of Gaussian (LOG) filters with three Sigma values and eight variations of Wavelet Transform. Images were then segmented, followed by the extraction of 1212 radiomic features. Seven feature selection (FS) methods and six time-to-event ML algorithms were utilized. The combination of preprocessing, FS, and ML algorithms (12 × 7 × 6 = 504 models) was evaluated by multivariate analysis.
Results
Our multivariate analysis showed that the best prognostic FS/ML combinations are the Mutual Information (MI)/Cox Boost, MI/Generalized Linear Model Boosting (GLMB) and MI/Generalized Linear Model Network (GLMN), all of which were done via the LOG (Sigma = 1 mm) preprocessing method (C-index = 0.77). The LOG filter with Sigma = 1 mm preprocessing method, MI, GLMB and GLMN achieved significantly higher C-indices than other preprocessing, FS, and ML methods (all
p
values < 0.05, mean C-indices of 0.65, 0.70, and 0.64, respectively).
Conclusion
ML algorithms are capable of predicting the time-to-event OS of patients using MRI-based radiomic and clinical features. MRI-based radiomics analysis in combination with clinical variables might appear promising in assisting clinicians in the survival prediction of patients with GBM. Further research is needed to establish the applicability of radiomics in the management of GBM in the clinic.