Circulating tumor DNA (ctDNA) sequencing is being rapidly adopted in precision oncology, but the accuracy, sensitivity and reproducibility of ctDNA assays is poorly understood. Here we report the ...findings of a multi-site, cross-platform evaluation of the analytical performance of five industry-leading ctDNA assays. We evaluated each stage of the ctDNA sequencing workflow with simulations, synthetic DNA spike-in experiments and proficiency testing on standardized, cell-line-derived reference samples. Above 0.5% variant allele frequency, ctDNA mutations were detected with high sensitivity, precision and reproducibility by all five assays, whereas, below this limit, detection became unreliable and varied widely between assays, especially when input material was limited. Missed mutations (false negatives) were more common than erroneous candidates (false positives), indicating that the reliable sampling of rare ctDNA fragments is the key challenge for ctDNA assays. This comprehensive evaluation of the analytical performance of ctDNA assays serves to inform best practice guidelines and provides a resource for precision oncology.
Full text
Available for:
GEOZS, IJS, IMTLJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBMB, UL, UM, UPUK, ZAGLJ
Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 ...independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.
Platelet-leukocyte aggregates (PLAs) are associated with increased thrombosis risk. The influence of PLA formation is especially important for cancer patients, since thrombosis accounts for ...approximately 10% of cancer-associated deaths. Our objective was to characterize and quantify PLAs in whole blood samples from lung cancer patients compared to healthy volunteers with the intent to analyze PLA formation in the context of lung cancer-associated thrombosis. Consenting lung cancer patients (57) and healthy volunteers (56) were enrolled at the Dana Cancer Center at the University of Toledo Health Science Campus. Peripheral blood samples were analyzed by flow cytometry. Patient medical history was reviewed through electronic medical records. Most importantly, we found lung cancer patients to have higher percentages of platelet-T cell aggregates (PTCAs) than healthy volunteers among both CD4+ T lymphocyte and CD8+ T lymphocyte populations. Our findings demonstrate that characterization of PTCAs may have clinical utility in differentiating lung cancer patients from healthy volunteers and stratifying lung cancer patients by history of thrombosis.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Mobile stroke units have CT scanners and personnel trained to administer tissue plasminogen activator. In a multicity trial, functional outcomes at 90 days after acute stroke were better with mobile ...stroke units than with standard care by emergency medical services and transfer to an emergency department.
We present primary results from the Sequencing Quality Control (SEQC) project, coordinated by the US Food and Drug Administration. Examining Illumina HiSeq, Life Technologies SOLiD and Roche 454 ...platforms at multiple laboratory sites using reference RNA samples with built-in controls, we assess RNA sequencing (RNA-seq) performance for junction discovery and differential expression profiling and compare it to microarray and quantitative PCR (qPCR) data using complementary metrics. At all sequencing depths, we discover unannotated exon-exon junctions, with >80% validated by qPCR. We find that measurements of relative expression are accurate and reproducible across sites and platforms if specific filters are used. In contrast, RNA-seq and microarrays do not provide accurate absolute measurements, and gene-specific biases are observed for all examined platforms, including qPCR. Measurement performance depends on the platform and data analysis pipeline, and variation is large for transcript-level profiling. The complete SEQC data sets, comprising >100 billion reads (10Tb), provide unique resources for evaluating RNA-seq analyses for clinical and regulatory settings.
Reproducibility is a fundamental requirement in scientific experiments. Some recent publications have claimed that microarrays are unreliable because lists of differentially expressed genes (DEGs) ...are not reproducible in similar experiments. Meanwhile, new statistical methods for identifying DEGs continue to appear in the scientific literature. The resultant variety of existing and emerging methods exacerbates confusion and continuing debate in the microarray community on the appropriate choice of methods for identifying reliable DEG lists.
Using the data sets generated by the MicroArray Quality Control (MAQC) project, we investigated the impact on the reproducibility of DEG lists of a few widely used gene selection procedures. We present comprehensive results from inter-site comparisons using the same microarray platform, cross-platform comparisons using multiple microarray platforms, and comparisons between microarray results and those from TaqMan - the widely regarded "standard" gene expression platform. Our results demonstrate that (1) previously reported discordance between DEG lists could simply result from ranking and selecting DEGs solely by statistical significance (P) derived from widely used simple t-tests; (2) when fold change (FC) is used as the ranking criterion with a non-stringent P-value cutoff filtering, the DEG lists become much more reproducible, especially when fewer genes are selected as differentially expressed, as is the case in most microarray studies; and (3) the instability of short DEG lists solely based on P-value ranking is an expected mathematical consequence of the high variability of the t-values; the more stringent the P-value threshold, the less reproducible the DEG list is. These observations are also consistent with results from extensive simulation calculations.
We recommend the use of FC-ranking plus a non-stringent P cutoff as a straightforward and baseline practice in order to generate more reproducible DEG lists. Specifically, the P-value cutoff should not be stringent (too small) and FC should be as large as possible. Our results provide practical guidance to choose the appropriate FC and P-value cutoffs when selecting a given number of DEGs. The FC criterion enhances reproducibility, whereas the P criterion balances sensitivity and specificity.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Background There is a need for biomarkers that improve accuracy compared with current demographic risk indices to detect individuals at the highest lung cancer risk. Improved risk determination will ...enable more effective lung cancer screening and better stratification of lung nodules into high or low-risk category. We previously reported discovery of a biomarker for lung cancer risk characterized by increased prevalence of TP53 somatic mutations in airway epithelial cells (AEC). Here we present results from a validation study in an independent retrospective case-control cohort. Methods Targeted next generation sequencing was used to identify mutations within three TP53 exons spanning 193 base pairs in AEC genomic DNA. Results TP53 mutation prevalence was associated with cancer status (P < 0.001). The lung cancer detection receiver operator characteristic (ROC) area under the curve (AUC) for the TP53 biomarker was 0.845 (95% confidence limits 0.749-0.942). In contrast, TP53 mutation prevalence was not significantly associated with age or smoking pack-years. The combination of TP53 mutation prevalence with PLCO.sub.M2012 risk score had an ROC AUC of 0.916 (0.846-0.986) and this was significantly higher than that for either factor alone (P < 0.03). Conclusions These results support the validity of the TP53 mutation prevalence biomarker and justify taking additional steps to assess this biomarker in AEC specimens from a prospective cohort and in matched nasal brushing specimens as a potential non-invasive surrogate specimen. Keywords: Lung cancer prevention, Lung cancer early detection, Biomarker, Next generation sequencing, TP53, Lung nodule risk classification
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Harmful algal blooms plague bodies of freshwater globally. These blooms are often composed of outgrowths of cyanobacteria capable of producing the heptapeptide Microcystin-LR (MC-LR) which is a ...well-known hepatotoxin. Recently, MC-LR has been detected in aerosols generated from lake water. However, the risk for human health effects due to MC-LR inhalation exposure have not been extensively investigated. In this study, we exposed a fully differentiated 3D human airway epithelium derived from 14 healthy donors to MC-LR-containing aerosol once a day for 3 days. Concentrations of MC-LR ranged from 100 pM to 1 µM. Although there were little to no detrimental alterations in measures of the airway epithelial function (i.e. cell survival, tissue integrity, mucociliary clearance, or cilia beating frequency), a distinct shift in the transcriptional activity was found. Genes related to inflammation were found to be upregulated such as C-C motif chemokine 5 (CCL5; log2FC = 0.57, p = 0.03) and C-C chemokine receptor type 7 (CCR7; log2FC = 0.84, p = 0.03). Functionally, conditioned media from MC-LR exposed airway epithelium was also found to have significant chemo-attractive properties for primary human neutrophils. Additionally, increases were found in the concentration of secreted chemokine proteins in the conditioned media such as CCL1 (log2FC = 5.07, p = 0.0001) and CCL5 (log2FC = 1.02, p = 0.046). These results suggest that MC-LR exposure to the human airway epithelium is capable of inducing an inflammatory response that may potentiate acute or chronic disease.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UILJ, UL, UM, UPCLJ, UPUK, ZAGLJ, ZRSKP
Oncopanel genomic testing, which identifies important somatic variants, is increasingly common in medical practice and especially in clinical trials. Currently, there is a paucity of reliable genomic ...reference samples having a suitably large number of pre-identified variants for properly assessing oncopanel assay analytical quality and performance. The FDA-led Sequencing and Quality Control Phase 2 (SEQC2) consortium analyze ten diverse cancer cell lines individually and their pool, termed Sample A, to develop a reference sample with suitably large numbers of coding positions with known (variant) positives and negatives for properly evaluating oncopanel analytical performance.
In reference Sample A, we identify more than 40,000 variants down to 1% allele frequency with more than 25,000 variants having less than 20% allele frequency with 1653 variants in COSMIC-related genes. This is 5-100× more than existing commercially available samples. We also identify an unprecedented number of negative positions in coding regions, allowing statistical rigor in assessing limit-of-detection, sensitivity, and precision. Over 300 loci are randomly selected and independently verified via droplet digital PCR with 100% concordance. Agilent normal reference Sample B can be admixed with Sample A to create new samples with a similar number of known variants at much lower allele frequency than what exists in Sample A natively, including known variants having allele frequency of 0.02%, a range suitable for assessing liquid biopsy panels.
These new reference samples and their admixtures provide superior capability for performing oncopanel quality control, analytical accuracy, and validation for small to large oncopanels and liquid biopsy assays.
Clinical applications of precision oncology require accurate tests that can distinguish true cancer-specific mutations from errors introduced at each step of next-generation sequencing (NGS). To ...date, no bulk sequencing study has addressed the effects of cross-site reproducibility, nor the biological, technical and computational factors that influence variant identification. Here we report a systematic interrogation of somatic mutations in paired tumor-normal cell lines to identify factors affecting detection reproducibility and accuracy at six different centers. Using whole-genome sequencing (WGS) and whole-exome sequencing (WES), we evaluated the reproducibility of different sample types with varying input amount and tumor purity, and multiple library construction protocols, followed by processing with nine bioinformatics pipelines. We found that read coverage and callers affected both WGS and WES reproducibility, but WES performance was influenced by insert fragment size, genomic copy content and the global imbalance score (GIV; G > T/C > A). Finally, taking into account library preparation protocol, tumor content, read coverage and bioinformatics processes concomitantly, we recommend actionable practices to improve the reproducibility and accuracy of NGS experiments for cancer mutation detection.
Full text
Available for:
GEOZS, IJS, IMTLJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBMB, UL, UM, UPUK, ZAGLJ
PDF
