Virtual reality (VR) enables data visualization in an immersive and engaging manner, and it can be used for creating ways to explore scientific data. Here, we use VR for visualization of 3D histology ...data, creating a novel interface for digital pathology to aid cancer research.
Our contribution includes 3D modeling of a whole organ and embedded objects of interest, fusing the models with associated quantitative features and full resolution serial section patches, and implementing the virtual reality application. Our VR application is multi-scale in nature, covering two object levels representing different ranges of detail, namely organ level and sub-organ level. In addition, the application includes several data layers, including the measured histology image layer and multiple representations of quantitative features computed from the histology.
In our interactive VR application, the user can set visualization properties, select different samples and features, and interact with various objects, which is not possible in the traditional 2D-image view used in digital pathology. In this work, we used whole mouse prostates (organ level) with prostate cancer tumors (sub-organ objects of interest) as example cases, and included quantitative histological features relevant for tumor biology in the VR model.
Our application enables a novel way for exploration of high-resolution, multidimensional data for biomedical research purposes, and can also be used in teaching and researcher training. Due to automated processing of the histology data, our application can be easily adopted to visualize other organs and pathologies from various origins.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Cell counting from cell cultures is required in multiple biological and biomedical research applications. Especially, accurate brightfield-based cell counting methods are needed for cell growth ...analysis. With deep learning, cells can be detected with high accuracy, but manually annotated training data is required. We propose a method for cell detection that requires annotated training data for one cell line only, and generalizes to other, unseen cell lines.
Training a deep learning model with one cell line only can provide accurate detections for similar unseen cell lines (domains). However, if the new domain is very dissimilar from training domain, high precision but lower recall is achieved. Generalization capabilities of the model can be improved with training data transformations, but only to a certain degree. To further improve the detection accuracy of unseen domains, we propose iterative unsupervised domain adaptation method. Predictions of unseen cell lines with high precision enable automatic generation of training data, which is used to train the model together with parts of the previously used annotated training data. We used U-Net-based model, and three consecutive focal planes from brightfield image z-stacks. We trained the model initially with PC-3 cell line, and used LNCaP, BT-474 and 22Rv1 cell lines as target domains for domain adaptation. Highest improvement in accuracy was achieved for 22Rv1 cells. F
-score after supervised training was only 0.65, but after unsupervised domain adaptation we achieved a score of 0.84. Mean accuracy for target domains was 0.87, with mean improvement of 16 percent.
With our method for generalized cell detection, we can train a model that accurately detects different cell lines from brightfield images. A new cell line can be introduced to the model without a single manual annotation, and after iterative domain adaptation the model is ready to detect these cells with high accuracy.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Abstract
Hematoxylin and eosin-stained biopsy slides are regularly available for colorectal cancer patients. These slides are often not used to define objective biomarkers for patient stratification ...and treatment selection. Standard biomarkers often pertain to costly and slow genetic tests. However, recent work has shown that relevant biomarkers can be extracted from these images using convolutional neural networks (CNNs). The CNN-based biomarkers predicted colorectal cancer patient outcomes comparably to gold standards. Extracting CNN-biomarkers is fast, automatic, and of minimal cost. CNN-based biomarkers rely on the ability of CNNs to recognize distinct tissue types from microscope whole slide images. The quality of these biomarkers (coined ‘Deep Stroma’) depends on the accuracy of CNNs in decomposing all relevant tissue classes. Improving tissue decomposition accuracy is essential for improving the prognostic potential of CNN-biomarkers. In this study, we implemented a novel training strategy to refine an established CNN model, which then surpassed all previous solutions . We obtained a 95.6% average accuracy in the external test set and 99.5% in the internal test set. Our approach reduced errors in biomarker-relevant classes, such as Lymphocytes, and was the first to include interpretability methods. These methods were used to better apprehend our model’s limitations and capabilities.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
Unreliable predictions can occur when an artificial intelligence (AI) system is presented with data it has not been exposed to during training. We demonstrate the use of conformal prediction to ...detect unreliable predictions, using histopathological diagnosis and grading of prostate biopsies as example. We digitized 7788 prostate biopsies from 1192 men in the STHLM3 diagnostic study, used for training, and 3059 biopsies from 676 men used for testing. With conformal prediction, 1 in 794 (0.1%) predictions is incorrect for cancer diagnosis (compared to 14 errors 2% without conformal prediction) while 175 (22%) of the predictions are flagged as unreliable when the AI-system is presented with new data from the same lab and scanner that it was trained on. Conformal prediction could with small samples (N = 49 for external scanner, N = 10 for external lab and scanner, and N = 12 for external lab, scanner and pathology assessment) detect systematic differences in external data leading to worse predictive performance. The AI-system with conformal prediction commits 3 (2%) errors for cancer detection in cases of atypical prostate tissue compared to 44 (25%) without conformal prediction, while the system flags 143 (80%) unreliable predictions. We conclude that conformal prediction can increase patient safety of AI-systems.
Identifying localization of proteins and their specific subpopulations associated with certain cellular compartments is crucial for understanding protein function and interactions with other ...macromolecules. Fluorescence microscopy is a powerful method to assess protein localizations, with increasing demand of automated high throughput analysis methods to supplement the technical advancements in high throughput imaging. Here, we study the applicability of deep neural network-based artificial intelligence in classification of protein localization in 13 cellular subcompartments. We use deep learning-based on convolutional neural network and fully convolutional network with similar architectures for the classification task, aiming at achieving accurate classification, but importantly, also comparison of the networks. Our results show that both types of convolutional neural networks perform well in protein localization classification tasks for major cellular organelles. Yet, in this study, the fully convolutional network outperforms the convolutional neural network in classification of images with multiple simultaneous protein localizations. We find that the fully convolutional network, using output visualizing the identified localizations, is a very useful tool for systematic protein localization assessment.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
miR-32 is an androgen receptor (AR)-regulated microRNA, expression of which is increased in castration-resistant prostate cancer (PC). We have previously shown that overexpression of miR-32 in the ...prostate of transgenic mice potentiates proliferation in prostate epithelium. Here, we set out to determine whether increased expression of miR-32 influences growth or phenotype in prostate adenocarcinoma in vivo. We studied transgenic mice expressing MYC oncogene (hiMYC mice) to induce tumorigenesis in the mouse prostate and discovered that transgenic overexpression of miR-32 resulted in increased tumor burden as well as a more aggressive tumor phenotype in this model. Elevated expression of miR-32 increased proliferation as assessed by Ki-67 immunohistochemistry, increased nuclear density, and higher mitotic index in the tumors. By gene expression analysis of the tumorous prostate tissue, we confirmed earlier findings that miR-32 expression regulates prostate secretome by modulating expression levels of several PC-related target genes such as Spink1, Spink5, and Msmb. Further, we identified Pdk4 as a tumor-associated miR-32 target in the mouse prostate. Expression analysis of PDK4 in human PC reveals an inverse correlation with miR-32 expression and Gleason score, a decrease in castration-resistant and metastatic tumors compared to untreated primary PC, and an association of low PDK4 expression with a shorter recurrence-free survival of patients. Although decreased PDK4 expression induces the higher metabolic activity of PC cells, induced expression of PDK4 reduces both mitotic respiration and glycolysis rates as well as inhibits cell growth. In conclusion, we show that miR-32 promotes MYC-induced prostate adenocarcinoma and identifies PDK4 as a PC-relevant metabolic target of miR-32-3p.
Tumor-stroma ratio (TSR) is a prognostic factor for many types of solid tumors. In this study, we propose a method for automated estimation of TSR from histopathological images of colorectal cancer. ...The method is based on convolutional neural networks which were trained to classify colorectal cancer tissue in hematoxylin-eosin stained samples into three classes: stroma, tumor and other. The models were trained using a data set that consists of 1343 whole slide images. Three different training setups were applied with a transfer learning approach using domain-specific data i.e. an external colorectal cancer histopathological data set. The three most accurate models were chosen as a classifier, TSR values were predicted and the results were compared to a visual TSR estimation made by a pathologist. The results suggest that classification accuracy does not improve when domain-specific data are used in the pre-training of the convolutional neural network models in the task at hand. Classification accuracy for stroma, tumor and other reached 96.1% on an independent test set. Among the three classes the best model gained the highest accuracy (99.3%) for class tumor. When TSR was predicted with the best model, the correlation between the predicted values and values estimated by an experienced pathologist was 0.57. Further research is needed to study associations between computationally predicted TSR values and other clinicopathological factors of colorectal cancer and the overall survival of the patients.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Numerous studies have shown a correlation between perineural invasion (PNI) in prostate biopsies and outcome. The reporting of PNI varies widely in the literature. While the interobserver variability ...of prostate cancer grading has been studied extensively, less is known regarding the reproducibility of PNI. A total of 212 biopsy cores from a population-based screening trial were included in this study (106 with and 106 without PNI according to the original pathology reports). The glass slides were scanned and circulated among four pathologists with a special interest in urological pathology for assessment of PNI. Discordant cases were stained by immunohistochemistry for S-100 protein. PNI was diagnosed by all four observers in 34.0% of cases, while 41.5% were considered to be negative for PNI. In 24.5% of cases, there was a disagreement between the observers. The kappa for interobserver variability was 0.67–0.75 (mean 0.73). The observations from one participant were compared with data from the original reports, and a kappa for intraobserver variability of 0.87 was achieved. Based on immunohistochemical findings among discordant cases, 88.6% had PNI while 11.4% did not. The most common diagnostic pitfall was the presence of bundles of stroma or smooth muscle. It was noted in a few cases that collagenous micronodules could be mistaken for a nerve. The distance between cancer and nerve was another cause of disagreement. Although the results suggest that the reproducibility of PNI may be greater than that of prostate cancer grading, there is still a need for improvement and standardization.
Full text
Available for:
EMUNI, FIS, FZAB, GEOZS, GIS, IJS, IMTLJ, KILJ, KISLJ, MFDPS, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, SBMB, SBNM, UKNU, UL, UM, UPUK, VKSCE, VSZLJ, ZAGLJ
We describe a supervised prediction method for diagnosis of acute myeloid leukemia (AML) from patient samples based on flow cytometry measurements. We use a data driven approach with machine learning ...methods to train a computational model that takes in flow cytometry measurements from a single patient and gives a confidence score of the patient being AML-positive. Our solution is based on an Formula: see text regularized logistic regression model that aggregates AML test statistics calculated from individual test tubes with different cell populations and fluorescent markers. The model construction is entirely data driven and no prior biological knowledge is used. The described solution scored a 100% classification accuracy in the DREAM6/FlowCAP2 Molecular Classification of Acute Myeloid Leukaemia Challenge against a golden standard consisting of 20 AML-positive and 160 healthy patients. Here we perform a more extensive validation of the prediction model performance and further improve and simplify our original method showing that statistically equal results can be obtained by using simple average marker intensities as features in the logistic regression model. In addition to the logistic regression based model, we also present other classification models and compare their performance quantitatively. The key benefit in our prediction method compared to other solutions with similar performance is that our model only uses a small fraction of the flow cytometry measurements making our solution highly economical.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Platinum-based drugs are cytotoxic drugs commonly used in cancer treatment. They cause DNA damage, effects of which on chromatin and cellular responses are relatively well described. Yet, the nuclear ...stress responses related to RNA processing are incompletely known and may be relevant for the heterogeneity with which cancer cells respond to these drugs. Here, we determine the type and extent of nuclear stress responses of prostate cancer cells to clinically relevant platinum drugs.
We study nucleolar and Cajal body (CB) responses to cisplatin, carboplatin, and oxaliplatin with immunofluorescence-based methods in prostate cancer cells. We utilize organelle-specific markers NPM, Fibrillarin, Coilin, and SMN1, and study CB-regulatory proteins FUS and TDP-43 using siRNA-mediated downregulation.
Different types of prostate cancer cells have different sensitivities to platinum drugs. With equally cytotoxic doses, cisplatin, and oxaliplatin induce prominent nucleolar and CB stress responses while the nuclear stress phenotypes to carboplatin are milder. We find that Coilin is a stress-specific marker for platinum drug response heterogeneity. We also find that CB-associated, stress-responsive RNA binding proteins FUS and TDP-43 control Coilin and CB biology in prostate cancer cells and, further, that TDP-43 is associated with stress-responsive CBs in prostate cancer cells.
Our findings provide insight into the heterologous responses of prostate cancer cells to different platinum drug treatments and indicate Coilin and TDP-43 as stress mediators in the varied outcomes. These results help understand cancer drug responses at a cellular level and have implications in tackling heterogeneity in cancer treatment outcomes.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
PDF
