New approaches to evidence synthesis, which use human effort and machine automation in mutually reinforcing ways, can enhance the feasibility and sustainability of living systematic reviews. Human ...effort is a scarce and valuable resource, required when automation is impossible or undesirable, and includes contributions from online communities (“crowds”) as well as more conventional contributions from review authors and information specialists. Automation can assist with some systematic review tasks, including searching, eligibility assessment, identification and retrieval of full-text reports, extraction of data, and risk of bias assessment. Workflows can be developed in which human effort and machine automation can each enable the other to operate in more effective and efficient ways, offering substantial enhancement to the productivity of systematic reviews. This paper describes and discusses the potential—and limitations—of new ways of undertaking specific tasks in living systematic reviews, identifying areas where these human/machine “technologies” are already in use, and where further research and development is needed. While the context is living systematic reviews, many of these enabling technologies apply equally to standard approaches to systematic reviewing.
AbstractObjectiveTo develop an instrument to evaluate the credibility of anchor based minimal important differences (MIDs) for outcome measures reported by patients, and to assess the reliability of ...the instrument.DesignInstrument development and reliability study.Data sourcesInitial criteria were developed for evaluating the credibility of anchor based MIDs based on a literature review (Medline, Embase, CINAHL, and PsycInfo databases) and the experience of the authors in the methodology for estimation of MIDs. Iterative discussions by the team and pilot testing with experts and potential users facilitated the development of the final instrument.ParticipantsWith the newly developed instrument, pairs of masters, doctoral, or postdoctoral students with a background in health research methodology independently evaluated the credibility of a sample of MID estimates.Main outcome measuresCore credibility criteria applicable to all anchor types, additional criteria for transition rating anchors, and inter-rater reliability coefficients were determined.ResultsThe credibility instrument has five core criteria: the anchor is rated by the patient; the anchor is interpretable and relevant to the patient; the MID estimate is precise; the correlation between the anchor and the outcome measure reported by the patient is satisfactory; and the authors select a threshold on the anchor that reflects a small but important difference. The additional criteria for transition rating anchors are: the time elapsed between baseline and follow-up measurement for estimation of the MID is optimal; and the correlations of the transition rating with the baseline, follow-up, and change score in the patient reported outcome measures are satisfactory. Inter-rater reliability coefficients (ĸ) for the core criteria and for one item from the additional criteria ranged from 0.70 to 0.94. Reporting issues prevented the evaluation of the reliability of the three other additional criteria for the transition rating anchors.ConclusionsResearchers, clinicians, and healthcare policy decision makers can consider using this instrument to evaluate the design, conduct, and analysis of studies estimating anchor based minimal important differences.
ObjectivesTo identify the most credible anchor-based minimal important differences (MIDs) for patient important outcomes in patients with degenerative knee disease, and to inform BMJ Rapid ...Recommendations for arthroscopic surgery versus conservative managementDesignSystematic review.Outcome measuresEstimates of anchor-based MIDs, and their credibility, for knee symptoms and health-related quality of life (HRQoL).Data sourcesMEDLINE, EMBASE and PsycINFO.Eligibility criteriaWe included original studies documenting the development of anchor-based MIDs for patient-reported outcomes (PROs) reported in randomised controlled trials included in the linked systematic review and meta-analysis and judged by the parallel BMJ Rapid Recommendations panel as critically important for informing their recommendation: measures of pain, function and HRQoL.Results13 studies reported 95 empirically estimated anchor-based MIDs for 8 PRO instruments and/or their subdomains that measure knee pain, function or HRQoL. All studies used a transition rating (global rating of change) as the anchor to ascertain the MID. Among PROs with more than 1 estimated MID, we found wide variation in MID values. Many studies suffered from serious methodological limitations. We identified the following most credible MIDs: Western Ontario and McMaster University Osteoarthritis Index (WOMAC; pain: 12, function: 13), Knee injury and Osteoarthritis Outcome Score (KOOS; pain: 12, activities of daily living: 8) and EuroQol five dimensions Questionnaire (EQ-5D; 0.15).ConclusionsWe were able to distinguish between more and less credible MID estimates and provide best estimates for key instruments that informed evidence presentation in the associated systematic review and judgements made by the Rapid Recommendation panel.Trial registration numberCRD42016047912.
Objective To determine the frequency of survival, stroke, atrial fibrillation, structural valve deterioration, and length of hospital stay after surgical replacement of an aortic valve (SAVR) with a ...bioprosthetic valve in patients with severe symptomatic aortic stenosis.Design Systematic review and meta-analysis of observational studies.Data sources Medline, Embase, PubMed (non-Medline records only), Cochrane Database of Systematic Reviews, and Cochrane CENTRAL from 2002 to June 2016.Study selection Eligible observational studies followed patients after SAVR with a bioprosthetic valve for at least two years.Methods Reviewers, independently and in duplicate, evaluated study eligibility, extracted data, and assessed risk of bias for patient important outcomes. We used the GRADE system to quantify absolute effects and quality of evidence. Published survival curves provided data for survival and freedom from structural valve deterioration, and random effect models provided the framework for estimates of pooled incidence rates of stroke, atrial fibrillation, and length of hospital stay.Results In patients undergoing SAVR with a bioprosthetic valve, median survival was 16 years in those aged 65 or less, 12 years in those aged 65 to 75, seven years in those aged 75 to 85, and six years in those aged more than 85. The incidence rate of stroke was 0.25 per 100 patient years (95% confidence interval 0.06 to 0.54) and atrial fibrillation 2.90 per 100 patient years (1.78 to 4.79). Post-SAVR, freedom from structural valve deterioration was 94.0% at 10 years, 81.7% at 15 years, and 52% at 20 years, and mean length of hospital stay was 12 days (95% confidence interval 9 to 15).Conclusion Patients with severe symptomatic aortic stenosis undergoing SAVR with a bioprosthetic valve can expect only slightly lower survival than those without aortic stenosis, and a low incidence of stroke and, up to 10 years, of structural valve deterioration. The rate of deterioration increases rapidly after 10 years, and particularly after 15 years.
More recently, an increasing number of acute care hospitals in the United States have implemented policies requiring influenza vaccination as a condition of service. Generally, these policies either ...require vaccination as a condition of employment (vaccination-required policies) or offer workers the choice of either being vaccinated or wearing a mask during periods of influenza activity (vaccinate-or-mask policies). Such policies typically include students, volunteers and contractors as well as employees. Based on the evidence of effectiveness of the vaccination of health care workers, all arbitrators but one have concluded that policies prohibiting health care workers from working during facility outbreaks are consistent with collective agreements, given the weight of evidence that such policies are connected with the health care organization's interest in patient safety.42-45,48 These arbitrators have reasoned that such policies are not disciplinary in nature and that they are consistent with the fundamental obligations of the employee to safeguard the health and safety of patients. In the single contradictory decision, in 2002, the arbitrator concluded that an unpaidleave policy was unreasonable because it constituted mandatory medical treatment and removed the employee's choice.46 However, in two other cases concerning vaccination-required policies, arbitrators have upheld the employers' decisions to dismiss an unvaccinated employee. In the case of the Kotsopoulos grievance,48 the arbitrator concluded that the decision to dismiss a paramedic who declined vaccination, which was then required by the Ontario Ambulance Act, was consistent with the collective agreement. In the case of Barkley, an arbitrator upheld the decision to dismiss a nonunionized health care worker when she refused to be vaccinated.49 Vaccinate-or-mask policies for influenza vaccination in health care organizations result in substantial increases in the vaccination rates among health care workers, are supported by most health care workers and, based on decisions to date, are likely to be found to be in compliance with Canadian law. Although vaccination-required policies have been upheld by arbitrators, employers who opt for more intrusive policies should carefully consider whether the details of such a policy maximize patient safety while impairing the charter rights of health care workers as little as possible. Physicians and employers should work together to find the best means to improve vaccination rates and protect both patients and providers from influenza.
The basis for the inconsistency between these two meta-analyses can be explained and current evidence suggests a net benefit for glucocorticoids in acute respiratory distress syndrome.4 In the 1980s, ...on the basis of a faulty laboratory model, clinical investigations focused on 1 day administration of massive doses of methylprednisolone (120 mg/kg per day) for prevention or treatment of acute respiratory distress syndrome. References 1 RM Sweeney, DF McAuley, Acute respiratory distress syndrome, Lancet, Vol. 388,...
HIV viral load (VL) testing is the gold standard for antiretroviral treatment monitoring, but many barriers exist to VL testing in resource-limited settings, including storage and transport ...limitations for whole blood and plasma. Data from various studies indicate that HIV RNA is stable beyond current recommendations. We conducted a systematic review to assess stability data of HIV RNA in whole blood and plasma across times and temperatures.
Using a pre-defined protocol, five databases were searched for studies where blood samples from HIV patients were stored at time and temperature points that exceeded manufacturer recommendations. RNA stability, the primary outcome, was measured by the difference in means compared to samples stored within established thresholds. RNA stability was defined as ≤0.5 log degradation. The search identified 10,716 titles, of which nine full-text articles were included for review. HIV RNA maintained stability in EDTA whole blood and plasma at all measured time points up to 168 hours when stored at 4°C, while stability was detected at 72 hours (95% confidence) in whole blood at 25°C, with data points before and beyond 72 hours suggesting stability but not reaching statistical significance. For EDTA plasma stored at 30°C, stability was maintained up to 48 hours (95% confidence), with OLS linear regression estimates up to 127 hours, suggesting stability. Overall, quality of studies was moderate. Limitations included small sample sizes, few studies meeting inclusion criteria, and no studies examining RNA stability in low viremia (<3,000 copies/mL) environments.
Whole blood and plasma samples in EDTA may remain stable under conditions exceeding current manufacturer recommendations for HIV VL testing. However, given the limited number of studies addressing this question, especially at low levels of viremia, additional evaluations on HIV RNA stability in EDTA tubes and PPT in field conditions are needed.
Resistance to antiretroviral therapy (ART) among people living with human immunodeficiency virus (HIV) compromises treatment effectiveness, often leading to virological failure and mortality. ...Antiretroviral drug resistance tests may be used at the time of initiation of therapy, or when treatment failure occurs, to inform the choice of ART regimen. Resistance tests (genotypic or phenotypic) are widely used in high-income countries, but not in resource-limited settings. This systematic review summarizes the relative merits of resistance testing in treatment-naive and treatment-exposed people living with HIV.
To evaluate the effectiveness of antiretroviral resistance testing (genotypic or phenotypic) in reducing mortality and morbidity in HIV-positive people.
We attempted to identify all relevant studies, regardless of language or publication status, through searches of electronic databases and conference proceedings up to 26 January 2018. We searched MEDLINE, Embase, the Cochrane Central Register of Controlled Trials (CENTRAL), in the Cochrane Library, the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP), and ClinicalTrials.gov to 26 January 2018. We searched Latin American and Caribbean Health Sciences Literature (LILACS) and the Web of Science for publications from 1996 to 26 January 2018.
We included all randomized controlled trials (RCTs) and observational studies that compared resistance testing to no resistance testing in people with HIV irrespective of their exposure to ART.Primary outcomes of interest were mortality and virological failure. Secondary outcomes were change in mean CD4-T-lymphocyte count, clinical progression to AIDS, development of a second or new opportunistic infection, change in viral load, and quality of life.
Two review authors independently assessed each reference for prespecified inclusion criteria. Two review authors then independently extracted data from each included study using a standardized data extraction form. We analysed data on an intention-to-treat basis using a random-effects model. We performed subgroup analyses for the type of resistance test used (phenotypic or genotypic), use of expert advice to interpret resistance tests, and age (children and adolescents versus adults). We followed standard Cochrane methodological procedures.
Eleven RCTs (published between 1999 and 2006), which included 2531 participants, met our inclusion criteria. All of these trials exclusively enrolled patients who had previous exposure to ART. We found no observational studies. Length of follow-up time, study settings, and types of resistance testing varied greatly. Follow-up ranged from 12 to 150 weeks. All studies were conducted in Europe, USA, or South America. Seven studies used genotypic testing, two used phenotypic testing, and two used both phenotypic and genotypic testing. Only one study was funded by a manufacturer of resistance tests.Resistance testing made little or no difference in mortality (odds ratio (OR) 0.89, 95% confidence interval (CI) 0.36 to 2.22; 5 trials, 1140 participants; moderate-certainty evidence), and may have slightly reduced the number of people with virological failure (OR 0.70, 95% CI 0.56 to 0.87; 10 trials, 1728 participants; low-certainty evidence); and probably made little or no difference in change in CD4 cell count (mean difference (MD) -1.00 cells/mm³, 95% CI -12.49 to 10.50; 7 trials, 1349 participants; moderate-certainty evidence) or progression to AIDS (OR 0.64, 95% CI 0.31 to 1.29; 3 trials, 809 participants; moderate-certainty evidence). Resistance testing made little or no difference in adverse events (OR 0.89, 95% CI 0.51 to 1.55; 4 trials, 808 participants; low-certainty evidence) and probably reduced viral load (MD -0.23, 95% CI -0.35 to -0.11; 10 trials, 1837 participants; moderate-certainty evidence). No studies reported on development of new opportunistic infections or quality of life. We found no statistically significant heterogeneity for any outcomes, and the I² statistic value ranged from 0 to 25%. We found no subgroup effects for types of resistance testing (genotypic versus phenotypic), the addition of expert advice to interpretation of resistance tests, or age. Results for mortality were consistent when we compared studies at high or unclear risk of bias versus studies at low risk of bias.
Resistance testing probably improved virological outcomes in people who have had virological failure in trials conducted 12 or more years ago. We found no evidence in treatment-naive people. Resistance testing did not demonstrate important patient benefits in terms of risk of death or progression to AIDS. The trials included very few participants from low- and middle-income countries.
Does low intensity pulsed ultrasound (LIPUS) accelerate recovery in adults and children who have experienced bone fractures or osteotomy (cutting of a bone)? An expert panel rapidly produced these ...recommendations based on a linked systematic review triggered by a large multicentre randomised trial in adults with tibial fracture.
ObjectiveTo examine the relative impact of three management options in patients aged <60 years with cryptogenic stroke and a patent foramen ovale (PFO): PFO closure plus antiplatelet therapy, ...antiplatelet therapy alone and anticoagulation alone.DesignSystematic review and network meta-analysis (NMA) supported by complementary external evidence.Data sourcesMedline, EMBASE and Cochrane CENTRAL.Study selectionRandomised controlled trials (RCTs) addressing PFO closure and/or medical therapies in patients with PFO and cryptogenic stroke.Review methodsWe conducted an NMA complemented with external evidence and rated certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system.ResultsTen RCTs in eight studies proved eligible (n=4416). Seven RCTs (n=3913) addressed PFO closure versus medical therapy. Of these, three (n=1257) addressed PFO closure versus antiplatelet therapy, three (n=2303) addressed PFO closure versus mixed antiplatelet and anticoagulation therapies and one (n=353) addressed PFO closure versus anticoagulation. The remaining three RCTs (n=503) addressed anticoagulant versus antiplatelet therapy. PFO closure versus antiplatelet therapy probably results in substantial reduction in ischaemic stroke recurrence (risk difference per 1000 patients over 5 years (RD): −87, 95% credible interval (CrI) −100 to −33; moderate certainty). Compared with anticoagulation, PFO closure may confer little or no difference in ischaemic stroke recurrence (low certainty) but probably has a lower risk of major bleeding (RD −20, 95% CrI −27 to −2, moderate certainty). Relative to either medical therapy, PFO closure probably increases the risk of persistent atrial fibrillation (RD 18, 95% CI +5 to +56, moderate certainty) and device-related adverse events (RD +36, 95% CI +23 to +50, high certainty). Anticoagulation, compared with antiplatelet therapy, may reduce the risk of ischaemic stroke recurrence (RD −71, 95% CrI −100 to +17, low certainty), but probably increases the risk of major bleeding (RD +12, 95% CrI −5 to +65, moderate certainty).ConclusionsIn patients aged <60 years, PFO closure probably confers an important reduction in ischaemic stroke recurrence compared with antiplatelet therapy alone but may make no difference compared with anticoagulation. PFO closure incurs a risk of persistent atrial fibrillation and device-related adverse events. Compared with alternatives, anticoagulation probably increases major bleeding.PROSPERO registration numberCRD42017081567.
PDF
