One of the greatest challenges in healthcare is how to best translate research evidence into clinical practice, which includes how to change health-care professionals' behaviours. A commonly held ...view is that multifaceted interventions are more effective than single-component interventions. The purpose of this study was to conduct an overview of systematic reviews to evaluate the effectiveness of multifaceted interventions in comparison to single-component interventions in changing health-care professionals' behaviour in clinical settings.
The Rx for Change database, which consists of quality-appraised systematic reviews of interventions to change health-care professional behaviour, was used to identify systematic reviews for the overview. Dual, independent screening and data extraction was conducted. Included reviews used three different approaches (of varying methodological robustness) to evaluate the effectiveness of multifaceted interventions: (1) effect size/dose-response statistical analyses, (2) direct (non-statistical) comparisons of multifaceted to single interventions and (3) indirect comparisons of multifaceted to single interventions.
Twenty-five reviews were included in the overview. Three reviews provided effect size/dose-response statistical analyses of the effectiveness of multifaceted interventions; no statistical evidence of a relationship between the number of intervention components and the effect size was found. Eight reviews reported direct (non-statistical) comparisons of multifaceted to single-component interventions; four of these reviews found multifaceted interventions to be generally effective compared to single interventions, while the remaining four reviews found that multifaceted interventions had either mixed effects or were generally ineffective compared to single interventions. Twenty-three reviews indirectly compared the effectiveness of multifaceted to single interventions; nine of which also reported either a statistical (dose-response) analysis (N = 2) or a non-statistical direct comparison (N = 7). The majority (N = 15) of reviews reporting indirect comparisons of multifaceted to single interventions showed similar effectiveness for multifaceted and single interventions when compared to controls. Of the remaining eight reviews, six found single interventions to be generally effective while multifaceted had mixed effectiveness.
This overview of systematic reviews offers no compelling evidence that multifaceted interventions are more effective than single-component interventions.
Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of ...guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this first paper we discuss: the target audience(s) for guidelines and their use of guidelines; identifying topics for guidelines; guideline group composition (including consumer involvement) and the processes by which guideline groups function and the important procedural issue of managing conflicts of interest in guideline development.
Organisational culture is an anthropological metaphor used to inform research and consultancy and to explain organisational environments. In recent years, increasing emphasis has been placed on the ...need to change organisational culture in order to improve healthcare performance. However, the precise function of organisational culture in healthcare policy often remains underspecified and the desirability and feasibility of strategies to be adopted have been called into question. The objective of this review was to determine the effectiveness of strategies to change organisational culture in order to improve healthcare performance.
We searched the following electronic databases: The Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, CINAHL, Sociological Abstracts, Web of Knowledge, PsycINFO, Business and Management, EThOS, Index to Theses, Intute, HMIC, SIGLE, and Scopus until October 2009. The Database of Abstracts of Reviews of Effectiveness (DARE) was searched for related reviews. We also searched the reference lists of all papers and relevant reviews identified, and we contacted experts in the field for advice on further potential studies. We considered randomised controlled trials (RCTs) or well designed quasi-experimental studies (controlled clinical trials (CCTs), controlled before and after studies (CBAs), and interrupted time series (ITS) analyses). Studies could be set in any type of healthcare organisation in which strategies to change organisational culture in order to improve healthcare performance were applied. Our main outcomes were objective measures of professional performance and patient outcome.
The search strategy yielded 4,239 records. After the full text assessment, two CBA studies were included in the review. They both assessed the impact of interventions aimed at changing organisational culture, but one evaluated the impact on work-related and personal outcomes while the other measured clinical outcomes. Both were at high risk of bias. Both reported positive results.
Current available evidence does not identify any effective, generalisable strategies to change organisational culture. Healthcare organisations considering implementing interventions aimed at changing culture should seriously consider conducting an evaluation (using a robust design, e.g., ITS) to strengthen the evidence about this topic.
An implementation research agenda Eccles, Martin P; Armstrong, David; Baker, Richard ...
Implementation science : IS,
04/2009, Letnik:
4, Številka:
1
Journal Article
Recenzirano
Odprti dostop
In October 2006, the Chief Medical Officer (CMO) of England asked Professor Sir John Tooke to chair a High Level Group on Clinical Effectiveness in response to the chapter 'Waste not, want not' in ...the CMOs 2005 annual report 'On the State of the Public Health'. The high level group made recommendations to the CMO to address possible ways forward to improve clinical effectiveness in the UK National Health Service (NHS) and promote clinical engagement to deliver this. The report contained a short section on research needs that emerged from the process of writing the report, but in order to more fully identify the relevant research agenda Professor Sir John Tooke asked Professor Martin Eccles to convene an expert group - the Clinical Effectiveness Research Agenda Group (CERAG) - to define the research agenda. The CERAG's terms of reference were 'to further elaborate the research agenda in relation to pursuing clinically effective practice within the (UK) National Health Service'. This editorial presents the summary of the CERAG report and recommendations.
In interview studies, sample size is often justified by interviewing participants until reaching 'data saturation'. However, there is no agreed method of establishing this. We propose principles for ...deciding saturation in theory-based interview studies (where conceptual categories are pre-established by existing theory). First, specify a minimum sample size for initial analysis (initial analysis sample). Second, specify how many more interviews will be conducted without new ideas emerging (stopping criterion). We demonstrate these principles in two studies, based on the theory of planned behaviour, designed to identify three belief categories (Behavioural, Normative and Control), using an initial analysis sample of 10 and stopping criterion of 3. Study 1 (retrospective analysis of existing data) identified 84 shared beliefs of 14 general medical practitioners about managing patients with sore throat without prescribing antibiotics. The criterion for saturation was achieved for Normative beliefs but not for other beliefs or studywise saturation. In Study 2 (prospective analysis), 17 relatives of people with Paget's disease of the bone reported 44 shared beliefs about taking genetic testing. Studywise data saturation was achieved at interview 17. We propose specification of these principles for reporting data saturation in theory-based interview studies. The principles may be adaptable for other types of studies.
There is considerable interest in the effectiveness of financial incentives in the delivery of health care. Incentives may be used in an attempt to increase the use of evidence-based treatments among ...healthcare professionals or to stimulate health professionals to change their clinical behaviour with respect to preventive, diagnostic and treatment decisions, or both. Financial incentives are an extrinsic source of motivation and exist when an individual can expect a monetary transfer which is made conditional on acting in a particular way. Since there are numerous reviews performed within the healthcare area describing the effects of various types of financial incentives, it is important to summarise the effectiveness of these in an overview to discern which are most effective in changing health professionals' behaviour and patient outcomes.
To conduct an overview of systematic reviews that evaluates the impact of financial incentives on healthcare professional behaviour and patient outcomes.
We searched the Cochrane Database of Systematic Reviews (CDSR) (The Cochrane Library); Database of Abstracts of Reviews of Effectiveness (DARE); TRIP; MEDLINE; EMBASE; Science Citation Index; Social Science Citation Index; NHS EED; HEED; EconLit; and Program in Policy Decision-Making (PPd) (from their inception dates up to January 2010). We searched the reference lists of all included reviews and carried out a citation search of those papers which cited studies included in the review. We included both Cochrane and non-Cochrane reviews of randomised controlled trials (RCTs), controlled clinical trials (CCTs), interrupted time series (ITSs) and controlled before and after studies (CBAs) that evaluated the effects of financial incentives on professional practice and patient outcomes, and that reported numerical results of the included individual studies. Two review authors independently extracted data and assessed the methodological quality of each review according to the AMSTAR criteria. We included systematic reviews of studies evaluating the effectiveness of any type of financial incentive. We grouped financial incentives into five groups: payment for working for a specified time period; payment for each service, episode or visit; payment for providing care for a patient or specific population; payment for providing a pre-specified level or providing a change in activity or quality of care; and mixed or other systems. We summarised data using vote counting.
We identified four reviews reporting on 32 studies. Two reviews scored 7 on the AMSTAR criteria (moderate, score 5 to 7, quality) and two scored 9 (high, score 8 to 11, quality). The reported quality of the included studies was, by a variety of methods, low to moderate. Payment for working for a specified time period was generally ineffective, improving 3/11 outcomes from one study reported in one review. Payment for each service, episode or visit was generally effective, improving 7/10 outcomes from five studies reported in three reviews; payment for providing care for a patient or specific population was generally effective, improving 48/69 outcomes from 13 studies reported in two reviews; payment for providing a pre-specified level or providing a change in activity or quality of care was generally effective, improving 17/20 reported outcomes from 10 studies reported in two reviews; and mixed and other systems were of mixed effectiveness, improving 20/31 reported outcomes from seven studies reported in three reviews. When looking at the effect of financial incentives overall across categories of outcomes, they were of mixed effectiveness on consultation or visit rates (improving 10/17 outcomes from three studies in two reviews); generally effective in improving processes of care (improving 41/57 outcomes from 19 studies in three reviews); generally effective in improving referrals and admissions (improving 11/16 outcomes from 11 studies in four reviews); generally ineffective in improving compliance with guidelines outcomes (improving 5/17 outcomes from five studies in two reviews); and generally effective in improving prescribing costs outcomes (improving 28/34 outcomes from 10 studies in one review).
Financial incentives may be effective in changing healthcare professional practice. The evidence has serious methodological limitations and is also very limited in its completeness and generalisability. We found no evidence from reviews that examined the effect of financial incentives on patient outcomes.
Objectives The Newcastle 85+ Study aims to systematically study the clinical, biological, and psychosocial attributes of an unselected cohort of 85 year olds and to examine subsequent health ...trajectories as the cohort ages; health at baseline is reported.Design Cross sectional analysis of baseline data from a cohort study.Setting Newcastle upon Tyne and North Tyneside primary care trusts, United Kingdom.Participants 1042 people born in 1921 and registered with the participating general practices.Main outcome measures Detailed health assessment and review of general practice records (disease, medication, and use of general practice services); participants could decline elements of the protocol. Results Of the 1453 eligible people, 851 (58.6%) were recruited to health assessment plus record review, 188 (12.9%) to record review only, and 3 (0.2%) to health assessment only. Data from record review are reported on a maximum of 1030 and from health assessment on a maximum of 853; individual denominators differ owing to withdrawal and missing values. Of the health assessment sample (n=853), 62.1% (n=530) were women and 10.4% (n=89) were in institutional care. The most prevalent diseases were hypertension (57.5%, 592/1030) and osteoarthritis (51.8%, 534/1030). Moderate or severe cognitive impairment was present in 11.7% (96/824) of participants, severe or profound urinary incontinence in 21.3% (173/813), hearing impairment in 59.6% (505/848), and visual impairment in 37.2% (309/831). Health assessment identified participants with possible disease but without a previous diagnosis in their medical record for hypertension (25.1%, 206/821), ischaemic heart disease (12.6%, 99/788), depression (6.9%, 53/772), dementia (6.7%, 56/840), and atrial fibrillation (3.8%, 30/788). Undiagnosed diabetes mellitus and thyroid disease were rare (1%, 7/717 and 6/762, respectively). A median of 3 (interquartile range 1-8) activities of daily living were undertaken with difficulty. Overall, 77.6% (646/832) of participants rated their health compared with others of the same age as good, very good, or excellent. High contact rates in the previous year with general practitioners (93.8%, 960/1024) were recorded. Women had significantly higher disease counts (medians: women 5, men 4; P=0.033) and disability scores (medians: women 4, men 2; P=0.0006) than men, but were less likely to have attended outpatient clinics in the previous three months (women 29% (150/524), men 37% (118/320), odds ratio 0.7, 95% confidence interval 0.5 to 0.9).Conclusions This large cohort of 85 year olds showed good levels of both self rated health and functional ability despite significant levels of disease and impairment. Hypertension, ischaemic heart disease, atrial fibrillation, depression, and dementia may be underdiagnosed. Notable differences were found between the sexes: women outnumbered men and had more disease and disability.
Tailored intervention strategies are frequently recommended among approaches to the implementation of improvement in health professional performance. Attempts to change the behaviour of health ...professionals may be impeded by a variety of different barriers, obstacles, or factors (which we collectively refer to as determinants of practice). Change may be more likely if implementation strategies are specifically chosen to address these determinants.
To determine whether tailored intervention strategies are effective in improving professional practice and healthcare outcomes. We compared interventions tailored to address the identified determinants of practice with either no intervention or interventions not tailored to the determinants.
We conducted searches of The Cochrane Library, MEDLINE, EMBASE, PubMed, CINAHL, and the British Nursing Index to May 2014. We conducted a final search in December 2014 (in MEDLINE only) for more recently published trials. We conducted searches of the metaRegister of Controlled Trials (mRCT) in March 2013. We also handsearched two journals.
Cluster-randomised controlled trials (RCTs) of interventions tailored to address prospectively identified determinants of practice, which reported objectively measured professional practice or healthcare outcomes, and where at least one group received an intervention designed to address prospectively identified determinants of practice.
Two review authors independently assessed quality and extracted data. We undertook qualitative and quantitative analyses, the quantitative analysis including two elements: we carried out 1) meta-regression analyses to compare interventions tailored to address identified determinants with either no interventions or an intervention(s) not tailored to the determinants, and 2) heterogeneity analyses to investigate sources of differences in the effectiveness of interventions. These included the effects of: risk of bias, use of a theory when developing the intervention, whether adjustment was made for local factors, and number of domains addressed with the determinants identified.
We added nine studies to this review to bring the total number of included studies to 32 comparing an intervention tailored to address identified determinants of practice to no intervention or an intervention(s) not tailored to the determinants. The outcome was implementation of recommended practice, e.g. clinical practice guideline recommendations. Fifteen studies provided enough data to be included in the quantitative analysis. The pooled odds ratio was 1.56 (95% confidence interval (CI) 1.27 to 1.93, P value < 0.001). The 17 studies not included in the meta-analysis had findings showing variable effectiveness consistent with the findings of the meta-regression.
Despite the increase in the number of new studies identified, our overall finding is similar to that of the previous review. Tailored implementation can be effective, but the effect is variable and tends to be small to moderate. The number of studies remains small and more research is needed, including trials comparing tailored interventions to no or other interventions, but also studies to develop and investigate the components of tailoring (identification of the most important determinants, selecting interventions to address the determinants). Currently available studies have used different methods to identify determinants of practice and different approaches to selecting interventions to address the determinants. It is not yet clear how best to tailor interventions and therefore not clear what the effect of an optimally tailored intervention would be.
Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Opinion leaders disseminating and implementing 'best evidence' is one method that holds promise as a ...strategy to bridge evidence-practice gaps.
To assess the effectiveness of the use of local opinion leaders in improving professional practice and patient outcomes.
We searched Cochrane EPOC Group Trials Register, the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, HMIC, Science Citation Index, Social Science Citation Index, ISI Conference Proceedings and World Cat Dissertations up to 5 May 2009. In addition, we searched reference lists of included articles.
Studies eligible for inclusion were randomised controlled trials investigating the effectiveness of using opinion leaders to disseminate evidence-based practice and reporting objective measures of professional performance and/or health outcomes.
Two review authors independently extracted data from each study and assessed its risk of bias. For each trial, we calculated the median risk difference (RD) for compliance with desired practice, adjusting for baseline where data were available. We reported the median adjusted RD for each of the main comparisons.
We included 18 studies involving more than 296 hospitals and 318 PCPs. Fifteen studies (18 comparisons) contributed to the calculations of the median adjusted RD for the main comparisons. The effects of interventions varied across the 63 outcomes from 15% decrease in compliance to 72% increase in compliance with desired practice. The median adjusted RD for the main comparisons were: i) Opinion leaders compared to no intervention, +0.09; ii) Opinion leaders alone compared to a single intervention, +0.14; iii) Opinion leaders with one or more additional intervention(s) compared to the one or more additional intervention(s), +0.10; iv) Opinion leaders as part of multiple interventions compared to no intervention, +0.10. Overall, across all 18 studies the median adjusted RD was +0.12 representing a 12% absolute increase in compliance in the intervention group.
Opinion leaders alone or in combination with other interventions may successfully promote evidence-based practice, but effectiveness varies both within and between studies. These results are based on heterogeneous studies differing in terms of type of intervention, setting, and outcomes measured. In most of the studies the role of the opinion leader was not clearly described, and it is therefore not possible to say what the best way is to optimise the effectiveness of opinion leaders.
Evidence syntheses are used to inform health care policy and practice. Behaviour change theories offer frameworks for categorising and evaluating interventions and identifying likely mechanisms ...through which effects are achieved. Yet systematic reviews rarely explicitly classify intervention components using theory, which may result in evidence syntheses and health care practice recommendations that are less than optimal. This paper outlines a method for applying theory to evidence syntheses of behaviour change interventions. We illustrate this method with an analysis of ‘audit and feedback’ interventions, based on data from a Cochrane review. Our analysis is based on Control Theory, which suggests that behaviour change is most likely if feedback is accompanied by comparison with a behavioural target and by action plans, and we coded interventions for these three techniques. Multivariate meta-regression was performed on 85 comparisons from 61 studies. However, few interventions incorporated targets or action plans, and so meta-regression models were likely to be underfitted due to insufficient power. The utility of our approach could not be tested via our analysis because of the limited nature of the audit and feedback interventions. However, we show that conceptualising and categorising interventions using behaviour change theory can reveal the theoretical coherence of interventions and so point towards improvements in intervention design, evaluation and synthesis. The results demonstrate that a theory-based approach to evidence synthesis is feasible, and can prove beneficial in understanding intervention design, even where there is insufficient empirical evidence to reliably synthesise effects of specific intervention components.
PDF
