Network meta-analysis has been established in recent years as a particularly useful evidence synthesis tool. However, it is still challenging to develop understandable and concise ways to present ...data, assumptions, and results from network meta-analysis to inform decision making and evaluate the credibility of the results. In this article, we provide a suite of commands with graphical tools to facilitate the understanding of data, the evaluation of assumptions, and the interpretation of findings from network meta-analysis.
Multivariate meta-analysis is becoming increasingly popular and official routines or self-programmed functions have been included in many statistical software. In this article, we review the ...statistical methods and the related software for multivariate meta-analysis. Emphasis is placed on Bayesian methods using Markov chain Monte Carlo, and codes in WinBUGS are provided. The various model-fitting options are illustrated in two examples and specific guidance is provided on how to run a multivariate meta-analysis using various software packages.
There is disagreement about the level of asymptomatic severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection. We conducted a living systematic review and meta-analysis to address ...three questions: (1) Amongst people who become infected with SARS-CoV-2, what proportion does not experience symptoms at all during their infection? (2) Amongst people with SARS-CoV-2 infection who are asymptomatic when diagnosed, what proportion will develop symptoms later? (3) What proportion of SARS-CoV-2 transmission is accounted for by people who are either asymptomatic throughout infection or presymptomatic?
We searched PubMed, Embase, bioRxiv, and medRxiv using a database of SARS-CoV-2 literature that is updated daily, on 25 March 2020, 20 April 2020, and 10 June 2020. Studies of people with SARS-CoV-2 diagnosed by reverse transcriptase PCR (RT-PCR) that documented follow-up and symptom status at the beginning and end of follow-up or modelling studies were included. One reviewer extracted data and a second verified the extraction, with disagreement resolved by discussion or a third reviewer. Risk of bias in empirical studies was assessed with an adapted checklist for case series, and the relevance and credibility of modelling studies were assessed using a published checklist. We included a total of 94 studies. The overall estimate of the proportion of people who become infected with SARS-CoV-2 and remain asymptomatic throughout infection was 20% (95% confidence interval CI 17-25) with a prediction interval of 3%-67% in 79 studies that addressed this review question. There was some evidence that biases in the selection of participants influence the estimate. In seven studies of defined populations screened for SARS-CoV-2 and then followed, 31% (95% CI 26%-37%, prediction interval 24%-38%) remained asymptomatic. The proportion of people that is presymptomatic could not be summarised, owing to heterogeneity. The secondary attack rate was lower in contacts of people with asymptomatic infection than those with symptomatic infection (relative risk 0.35, 95% CI 0.10-1.27). Modelling studies fit to data found a higher proportion of all SARS-CoV-2 infections resulting from transmission from presymptomatic individuals than from asymptomatic individuals. Limitations of the review include that most included studies were not designed to estimate the proportion of asymptomatic SARS-CoV-2 infections and were at risk of selection biases; we did not consider the possible impact of false negative RT-PCR results, which would underestimate the proportion of asymptomatic infections; and the database does not include all sources.
The findings of this living systematic review suggest that most people who become infected with SARS-CoV-2 will not remain asymptomatic throughout the course of the infection. The contribution of presymptomatic and asymptomatic infections to overall SARS-CoV-2 transmission means that combination prevention measures, with enhanced hand hygiene, masks, testing tracing, and isolation strategies and social distancing, will continue to be needed.
The evaluation of the credibility of results from a meta-analysis has become an important part of the evidence synthesis process. We present a methodological framework to evaluate confidence in the ...results from network meta-analyses, Confidence in Network Meta-Analysis (CINeMA), when multiple interventions are compared.
CINeMA considers 6 domains: (i) within-study bias, (ii) reporting bias, (iii) indirectness, (iv) imprecision, (v) heterogeneity, and (vi) incoherence. Key to judgments about within-study bias and indirectness is the percentage contribution matrix, which shows how much information each study contributes to the results from network meta-analysis. The contribution matrix can easily be computed using a freely available web application. In evaluating imprecision, heterogeneity, and incoherence, we consider the impact of these components of variability in forming clinical decisions.
Via 3 examples, we show that CINeMA improves transparency and avoids the selective use of evidence when forming judgments, thus limiting subjectivity in the process. CINeMA is easy to apply even in large and complicated networks.
Summary Background The question of which antipsychotic drug should be preferred for the treatment of schizophrenia is controversial, and conventional pairwise meta-analyses cannot provide a hierarchy ...based on the randomised evidence. We aimed to integrate the available evidence to create hierarchies of the comparative efficacy, risk of all-cause discontinuation, and major side-effects of antipsychotic drugs. Methods We did a Bayesian-framework, multiple-treatments meta-analysis (which uses both direct and indirect comparisons) of randomised controlled trials to compare 15 antipsychotic drugs and placebo in the acute treatment of schizophrenia. We searched the Cochrane Schizophrenia Group's specialised register, Medline, Embase, the Cochrane Central Register of Controlled Trials, and ClinicalTrials.gov for reports published up to Sept 1, 2012. Search results were supplemented by reports from the US Food and Drug Administration website and by data requested from pharmaceutical companies. Blinded, randomised controlled trials of patients with schizophrenia or related disorders were eligible. We excluded trials done in patients with predominant negative symptoms, concomitant medical illness, or treatment resistance, and those done in stable patients. Data for seven outcomes were independently extracted by two reviewers. The primary outcome was efficacy, as measured by mean overall change in symptoms. We also examined all-cause discontinuation, weight gain, extrapyramidal side-effects, prolactin increase, QTc prolongation, and sedation. Findings We identified 212 suitable trials, with data for 43 049 participants. All drugs were significantly more effective than placebo. The standardised mean differences with 95% credible intervals were: clozapine 0·88, 0·73–1·03; amisulpride 0·66, 0·53–0·78; olanzapine 0·59, 0·53–0·65; risperidone 0·56, 0·50–0·63; paliperidone 0·50, 0·39–0·60; zotepine 0·49, 0·31–0·66; haloperidol 0·45, 0·39–0·51; quetiapine 0·44, 0·35–0·52; aripiprazole 0·43, 0·34–0·52; sertindole 0·39, 0·26–0·52; ziprasidone 0·39, 0·30–0·49; chlorpromazine 0·38, 0·23–0·54; asenapine 0·38, 0·25–0·51; lurasidone 0·33, 0·21–0·45; and iloperidone 0·33, 0·22–0·43. Odds ratios compared with placebo for all-cause discontinuation ranged from 0·43 for the best drug (amisulpride) to 0·80 for the worst drug (haloperidol); for extrapyramidal side-effects 0·30 (clozapine) to 4·76 (haloperidol); and for sedation 1·42 (amisulpride) to 8·82 (clozapine). Standardised mean differences compared with placebo for weight gain varied from −0·09 for the best drug (haloperidol) to −0·74 for the worst drug (olanzapine), for prolactin increase 0·22 (aripiprazole) to −1·30 (paliperidone), and for QTc prolongation 0·10 (lurasidone) to −0·90 (sertindole). Efficacy outcomes did not change substantially after removal of placebo or haloperidol groups, or when dose, percentage of withdrawals, extent of blinding, pharmaceutical industry sponsorship, study duration, chronicity, and year of publication were accounted for in meta-regressions and sensitivity analyses. Interpretation Antipsychotics differed substantially in side-effects, and small but robust differences were seen in efficacy. Our findings challenge the straightforward classification of antipsychotics into first-generation and second-generation groupings. Rather, hierarchies in the different domains should help clinicians to adapt the choice of antipsychotic drug to the needs of individual patients. These findings should be considered by mental health policy makers and in the revision of clinical practice guidelines. Funding None.
Network meta-analysis synthesizes direct and indirect evidence in a network of trials that compare multiple interventions and has the potential to rank the competing treatments according to the ...studied outcome. Despite its usefulness network meta-analysis is often criticized for its complexity and for being accessible only to researchers with strong statistical and computational skills. The evaluation of the underlying model assumptions, the statistical technicalities and presentation of the results in a concise and understandable way are all challenging aspects in the network meta-analysis methodology. In this paper we aim to make the methodology accessible to non-statisticians by presenting and explaining a series of graphical tools via worked examples. To this end, we provide a set of STATA routines that can be easily employed to present the evidence base, evaluate the assumptions, fit the network meta-analysis model and interpret its results.
The increase in treatment options creates an urgent need for comparative effectiveness research. Randomized, controlled trials comparing several treatments are usually not feasible, so other ...methodological approaches are needed. Meta-analyses provide summary estimates of treatment effects by combining data from many studies. However, an important drawback is that standard meta-analyses can compare only 2 interventions at a time. A new meta-analytic technique, called network meta-analysis (or multiple treatments meta-analysis or mixed-treatment comparison), allows assessment of the relative effectiveness of several interventions, synthesizing evidence across a network of randomized trials. Despite the growing prevalence and influence of network meta-analysis in many fields of medicine, several issues need to be addressed when constructing one to avoid conclusions that are inaccurate, invalid, or not clearly justified. This article explores the scope and limitations of network meta-analysis and offers advice on dealing with heterogeneity, inconsistency, and potential sources of bias in the available evidence to increase awareness among physicians about some of the challenges in interpretation.
Antipsychotic drug efficacy may have decreased over recent decades. The authors present a meta-analysis of all placebo-controlled trials in patients with acute exacerbations of schizophrenia, and ...they investigate which trial characteristics have changed over the years and which are moderators of drug-placebo efficacy differences.
The search included multiple electronic databases. The outcomes were overall efficacy (primary outcome); responder and dropout rates; positive, negative, and depressive symptoms; quality of life; functioning; and major side effects. Potential moderators of efficacy were analyzed by meta-regression.
The analysis included 167 double-blind randomized controlled trials with 28,102 mainly chronic participants. The standardized mean difference (SMD) for overall efficacy was 0.47 (95% credible interval 0.42, 0.51), but accounting for small-trial effects and publication bias reduced the SMD to 0.38. At least a "minimal" response occurred in 51% of the antipsychotic group versus 30% in the placebo group, and 23% versus 14% had a "good" response. Positive symptoms (SMD 0.45) improved more than negative symptoms (SMD 0.35) and depression (SMD 0.27). Quality of life (SMD 0.35) and functioning (SMD 0.34) improved even in the short term. Antipsychotics differed substantially in side effects. Of the response predictors analyzed, 16 trial characteristics changed over the decades. However, in a multivariable meta-regression, only industry sponsorship and increasing placebo response were significant moderators of effect sizes. Drug response remained stable over time.
Approximately twice as many patients improved with antipsychotics as with placebo, but only a minority experienced a good response. Effect sizes were reduced by industry sponsorship and increasing placebo response, not decreasing drug response. Drug development may benefit from smaller samples but better-selected patients.
Abstract
Aims
Owing to new evidence from randomized controlled trials (RCTs) in low-risk patients with severe aortic stenosis, we compared the collective safety and efficacy of transcatheter aortic ...valve implantation (TAVI) vs. surgical aortic valve replacement (SAVR) across the entire spectrum of surgical risk patients.
Methods and results
The meta-analysis is registered with PROSPERO (CRD42016037273). We identified RCTs comparing TAVI with SAVR in patients with severe aortic stenosis reporting at different follow-up periods. We extracted trial, patient, intervention, and outcome characteristics following predefined criteria. The primary outcome was all-cause mortality up to 2 years for the main analysis. Seven trials that randomly assigned 8020 participants to TAVI (4014 patients) and SAVR (4006 patients) were included. The combined mean STS score in the TAVI arm was 9.4%, 5.1%, and 2.0% for high-, intermediate-, and low surgical risk trials, respectively. Transcatheter aortic valve implantation was associated with a significant reduction of all-cause mortality compared to SAVR {hazard ratio HR 0.88 95% confidence interval (CI) 0.78–0.99, P = 0.030}; an effect that was consistent across the entire spectrum of surgical risk (P-for-interaction = 0.410) and irrespective of type of transcatheter heart valve (THV) system (P-for-interaction = 0.674). Transcatheter aortic valve implantation resulted in lower risk of strokes HR 0.81 (95% CI 0.68–0.98), P = 0.028. Surgical aortic valve replacement was associated with a lower risk of major vascular complications HR 1.99 (95% CI 1.34–2.93), P = 0.001 and permanent pacemaker implantations HR 2.27 (95% CI 1.47–3.64), P < 0.001 compared to TAVI.
Conclusion
Compared with SAVR, TAVI is associated with reduction in all-cause mortality and stroke up to 2 years irrespective of baseline surgical risk and type of THV system.
Abstract Objective To present some simple graphical and quantitative ways to assist interpretation and improve presentation of results from multiple-treatment meta-analysis (MTM). Study Design and ...Setting We reanalyze a published network of trials comparing various antiplatelet interventions regarding the incidence of serious vascular events using Bayesian approaches for random effects MTM, and we explore the advantages and drawbacks of various traditional and new forms of quantitative displays and graphical presentations of results. Results We present the results under various forms, conventionally based on the mean of the distribution of the effect sizes; based on predictions; based on ranking probabilities; and finally, based on probabilities to be within an acceptable range from a reference. We show how to obtain and present results on ranking of all treatments and how to appraise the overall ranks. Conclusions Bayesian methodology offers a multitude of ways to present results from MTM models, as it enables a natural and easy estimation of all measures based on probabilities, ranks, or predictions.
PDF
