ObjectiveMeta-analysing studies with low event rates is challenging as some of the standard methods for meta-analysis are not well suited to handle rare outcomes. This is more evident when some ...studies have zero events in one or both treatment groups. In this article, we discuss why rare events require special attention in meta-analysis, we present an overview of some approaches suitable for meta-analysing rare events and we provide practical recommendations for their use.MethodsWe go through several models suggested in the literature for performing a rare events meta-analysis, highlighting their respective advantages and limitations. We illustrate these models using a published example from mental health. We provide the software code needed to perform all analyses in the appendix.ResultsDifferent methods may give different results, and using a suboptimal approach may lead to erroneous conclusions. When data are very sparse, the choice between the available methods may have a large impact on the results. Methods that use the so-called continuity correction (eg, adding 0.5 to the number of events and non-events in studies with zero events in one treatment group) may lead to biased estimates.ConclusionsResearchers should define the primary analysis a priori, in order to avoid selective reporting. A sensitivity analysis using a range of methods should be used to assess the robustness of results. Suboptimal methods such as using a continuity correction should be avoided.
Network meta-analysis compares different interventions for the same condition, by combining direct and indirect evidence derived from all eligible studies. Network metaanalysis has been increasingly ...used by applied scientists and it is a major research topic for methodologists. This article describes the R package netmeta, which adopts frequentist methods to fit network meta-analysis models. We provide a roadmap to perform network meta-analysis, along with an overview of the main functions of the package. We present three worked examples considering different types of outcomes and different data formats to facilitate researchers aiming to conduct network meta-analysis with netmeta.
Behavioural, cognitive, and pharmacological interventions can all be effective for insomnia. However, because of inadequate resources, medications are more frequently used worldwide. We aimed to ...estimate the comparative effectiveness of pharmacological treatments for the acute and long-term treatment of adults with insomnia disorder.
In this systematic review and network meta-analysis, we searched the Cochrane Central Register of Controlled Trials, MEDLINE, PubMed, Embase, PsycINFO, WHO International Clinical Trials Registry Platform, ClinicalTrials.gov, and websites of regulatory agencies from database inception to Nov 25, 2021, to identify published and unpublished randomised controlled trials. We included studies comparing pharmacological treatments or placebo as monotherapy for the treatment of adults (≥18 year) with insomnia disorder. We assessed the certainty of evidence using the confidence in network meta-analysis (CINeMA) framework. Primary outcomes were efficacy (ie, quality of sleep measured by any self-rated scale), treatment discontinuation for any reason and due to side-effects specifically, and safety (ie, number of patients with at least one adverse event) both for acute and long-term treatment. We estimated summary standardised mean differences (SMDs) and odds ratios (ORs) using pairwise and network meta-analysis with random effects. This study is registered with Open Science Framework, https://doi.org/10.17605/OSF.IO/PU4QJ.
We included 170 trials (36 interventions and 47 950 participants) in the systematic review and 154 double-blind, randomised controlled trials (30 interventions and 44 089 participants) were eligible for the network meta-analysis. In terms of acute treatment, benzodiazepines, doxylamine, eszopiclone, lemborexant, seltorexant, zolpidem, and zopiclone were more efficacious than placebo (SMD range: 0·36-0·83 CINeMA estimates of certainty: high to moderate). Benzodiazepines, eszopiclone, zolpidem, and zopiclone were more efficacious than melatonin, ramelteon, and zaleplon (SMD 0·27-0·71 moderate to very low). Intermediate-acting benzodiazepines, long-acting benzodiazepines, and eszopiclone had fewer discontinuations due to any cause than ramelteon (OR 0·72 95% CI 0·52-0·99; moderate, 0·70 0·51-0·95; moderate and 0·71 0·52-0·98; moderate, respectively). Zopiclone and zolpidem caused more dropouts due to adverse events than did placebo (zopiclone: OR 2·00 95% CI 1·28-3·13; very low; zolpidem: 1·79 1·25-2·50; moderate); and zopiclone caused more dropouts than did eszopiclone (OR 1·82 95% CI 1·01-3·33; low), daridorexant (3·45 1·41-8·33; low), and suvorexant (3·13 1·47-6·67; low). For the number of individuals with side-effects at study endpoint, benzodiazepines, eszopiclone, zolpidem, and zopiclone were worse than placebo, doxepin, seltorexant, and zaleplon (OR range 1·27-2·78 high to very low). For long-term treatment, eszopiclone and lemborexant were more effective than placebo (eszopiclone: SMD 0·63 95% CI 0·36-0·90; very low; lemborexant: 0·41 0·04-0·78; very low) and eszopiclone was more effective than ramelteon (0.63 0·16-1·10; very low) and zolpidem (0·60 0·00-1·20; very low). Compared with ramelteon, eszopiclone and zolpidem had a lower rate of all-cause discontinuations (eszopiclone: OR 0·43 95% CI 0·20-0·93; very low; zolpidem: 0·43 0·19-0·95; very low); however, zolpidem was associated with a higher number of dropouts due to side-effects than placebo (OR 2·00 95% CI 1·11-3·70; very low).
Overall, eszopiclone and lemborexant had a favorable profile, but eszopiclone might cause substantial adverse events and safety data on lemborexant were inconclusive. Doxepin, seltorexant, and zaleplon were well tolerated, but data on efficacy and other important outcomes were scarce and do not allow firm conclusions. Many licensed drugs (including benzodiazepines, daridorexant, suvorexant, and trazodone) can be effective in the acute treatment of insomnia but are associated with poor tolerability, or information about long-term effects is not available. Melatonin, ramelteon, and non-licensed drugs did not show overall material benefits. These results should serve evidence-based clinical practice.
UK National Institute for Health Research Oxford Health Biomedical Research Centre.
Network meta-analysis (NMA) is a common approach to summarizing relative treatment effects from randomized trials with different treatment comparisons. Most NMAs are based on published aggregate data ...(AD) and have limited possibilities for investigating the extent of network consistency and between-study heterogeneity. Given that individual participant data (IPD) are considered the gold standard in evidence synthesis, we explored statistical methods for IPD-NMA and investigated their potential advantages and limitations, compared with AD-NMA. We discuss several one-stage random-effects NMA models that account for within-trial imbalances, treatment effect modifiers, missing response data and longitudinal responses. We illustrate all models in a case study of 18 antidepressant trials with a continuous endpoint (the Hamilton Depression Score). All trials suffered from drop-out; missingness of longitudinal responses ranged from 21 to 41% after 6 weeks follow-up. Our results indicate that NMA based on IPD may lead to increased precision of estimated treatment effects. Furthermore, it can help to improve network consistency and explain between-study heterogeneity by adjusting for participant-level effect modifiers and adopting more advanced models for dealing with missing response data. We conclude that implementation of IPD-NMA should be considered when trials are affected by substantial drop-out rate, and when treatment effects are potentially influenced by participant-level covariates.
Purpose
To assess the prospective association between metabolic syndrome (MetS), its components, and incidence of thyroid disorders by conducting a systematic review and meta-analysis.
Methods
A ...systematic search was performed in Ovid Medline, Embase.com, and Cochrane CENTRAL from inception to February 22, 2023. Publications from prospective studies were included if they provided data on baseline MetS status or one of its components and assessed the incidence of thyroid disorders over time. A random effects meta-analysis was conducted to calculate the odds ratio (OR) for developing thyroid disorders.
Results
After full-text screening of 2927 articles, seven studies met our inclusion criteria. Two of these studies assessed MetS as an exposure (
N
= 71,727) and were included in our meta-analysis. The association between MetS at baseline and incidence of overt hypothyroidism at follow-up yielded an OR of 0.78 (95% confidence interval CI: 0.52–1.16 for two studies, I
2
= 0%). Pooled analysis was not possible for subclinical hypothyroidism, due to large heterogeneity (I
2
= 92.3%), nor for hyperthyroidism, as only one study assessed this association. We found evidence of an increased risk of overt (RR: 3.10 (1.56–4.64, I
2
= 0%) and subclinical hypothyroidism (RR 1.50 (1.05–1.94), I
2
= 0%) in individuals with obesity at baseline. There was a lower odds of developing overt hyperthyroidism in individuals with prediabetes at baseline (OR: 0.68 (0.47–0.98), I
2
= 0%).
Conclusions
We were unable to draw firm conclusions regarding the association between MetS and the incidence of thyroid disorders due to the limited number of available studies and the presence of important heterogeneity in reporting results. However, we did find an association between obesity at baseline and incidence of overt and subclinical hypothyroidism.
Many healthcare interventions are complex, consisting of multiple, possibly interacting, components. Several methodological articles addressing complex interventions in the meta-analytical context ...have been published. We hereby provide an overview of methods used to evaluate the effects of complex interventions with meta-analytical models. We summarized the methodology, highlighted new developments, and described the benefits, drawbacks, and potential challenges of each identified method. We expect meta-analytical methods focusing on components of several multicomponent interventions to become increasingly popular due to recently developed, easy-to-use, software tools that can be used to conduct the relevant analyses. The different meta-analytical methods are illustrated through two examples comparing psychotherapies for panic disorder.
Meta‐analysis of individual patient data (IPD) is increasingly used to synthesize data from multiple trials. IPD meta‐analysis offers several advantages over meta‐analyzing aggregate data, including ...the capacity to individualize treatment recommendations. Trials usually collect information on many patient characteristics. Some of these covariates may strongly interact with treatment (and thus be associated with treatment effect modification) while others may have little effect. It is currently unclear whether a systematic approach to the selection of treatment‐covariate interactions in an IPD meta‐analysis can lead to better estimates of patient‐specific treatment effects. We aimed to answer this question by comparing in simulations the standard approach to IPD meta‐analysis (no variable selection, all treatment‐covariate interactions included in the model) with six alternative methods: stepwise regression, and five regression methods that perform shrinkage on treatment‐covariate interactions, that is, least absolute shrinkage and selection operator (LASSO), ridge, adaptive LASSO, Bayesian LASSO, and stochastic search variable selection. Exploring a range of scenarios, we found that shrinkage methods performed well for both continuous and dichotomous outcomes, for a variety of settings. In most scenarios, these methods gave lower mean squared error of the patient‐specific treatment effect as compared with the standard approach and stepwise regression. We illustrate the application of these methods in two datasets from cardiology and psychiatry. We recommend that future IPD meta‐analysis that aim to estimate patient‐specific treatment effects using multiple effect modifiers should use shrinkage methods, whereas stepwise regression should be avoided.