Evidence syntheses are used to inform health care policy and practice. Behaviour change theories offer frameworks for categorising and evaluating interventions and identifying likely mechanisms ...through which effects are achieved. Yet systematic reviews rarely explicitly classify intervention components using theory, which may result in evidence syntheses and health care practice recommendations that are less than optimal. This paper outlines a method for applying theory to evidence syntheses of behaviour change interventions. We illustrate this method with an analysis of ‘audit and feedback’ interventions, based on data from a Cochrane review. Our analysis is based on Control Theory, which suggests that behaviour change is most likely if feedback is accompanied by comparison with a behavioural target and by action plans, and we coded interventions for these three techniques. Multivariate meta-regression was performed on 85 comparisons from 61 studies. However, few interventions incorporated targets or action plans, and so meta-regression models were likely to be underfitted due to insufficient power. The utility of our approach could not be tested via our analysis because of the limited nature of the audit and feedback interventions. However, we show that conceptualising and categorising interventions using behaviour change theory can reveal the theoretical coherence of interventions and so point towards improvements in intervention design, evaluation and synthesis. The results demonstrate that a theory-based approach to evidence synthesis is feasible, and can prove beneficial in understanding intervention design, even where there is insufficient empirical evidence to reliably synthesise effects of specific intervention components.
Evidence of variations in red blood cell transfusion practices have been reported in a wide range of clinical settings. Parallel studies in Canada and the United Kingdom were designed to explore ...transfusion behaviour in intensive care physicians. The aim of this paper is three-fold: first, to explore beliefs that influence Canadian intensive care physicians' transfusion behaviour; second, to systematically select relevant theories and models using the Theoretical Domains Framework (TDF) to inform a future predictive study; and third, to compare its results with the UK study.
Ten intensive care unit (ICU) physicians throughout Canada were interviewed. Physicians' responses were coded into theoretical domains, and specific beliefs were generated for each response. Theoretical domains relevant to behaviour change were identified, and specific constructs from the relevant domains were used to select psychological theories. The results from Canada and the United Kingdom were compared.
Seven theoretical domains populated by 31 specific beliefs were identified as relevant to the target behaviour. The domains Beliefs about capabilities (confident to not transfuse if patients' clinical condition is stable), Beliefs about consequences (positive beliefs of reducing infection and saving resources and negative beliefs about risking patients' clinical outcome and potentially more work), Social influences (transfusion decision is influenced by team members and patients' relatives), and Behavioural regulation (wide range of approaches to encourage restrictive transfusion) that were identified in the UK study were also relevant in the Canadian context. Three additional domains, Knowledge (it requires more evidence to support restrictive transfusion), Social/professional role and identity (conflicting beliefs about not adhering to guidelines, referring to evidence, believing restrictive transfusion as professional standard, and believing that guideline is important for other professionals), and Motivation and goals (opposing beliefs about the importance of restrictive transfusion and compatibility with other goals), were also identified in this study. Similar to the UK study, the Theory of Planned Behaviour, Social Cognitive Theory, Operant Learning Theory, Action Planning, and Knowledge-Attitude-Behaviour model were identified as potentially relevant theories and models for further study. Personal project analysis was added to the Canadian study to explore the Motivation and goals domain in further detail.
A wide range of beliefs was identified by the Canadian ICU physicians as likely to influence their transfusion behaviour. We were able to demonstrate similar though not identical results in a cross-country comparison. Designing targeted behaviour-change interventions based on unique beliefs identified by physicians from two countries are more likely to encourage restrictive transfusion in ICU physicians in respective countries. This needs to be tested in future prospective clinical trials.
Implementation research is the scientific study of methods to promote the systematic uptake of clinical research findings into routine clinical practice. Several interventions have been shown to be ...effective in changing health care professionals' behaviour, but heterogeneity within interventions, targeted behaviours, and study settings make generalisation difficult. Therefore, it is necessary to identify the 'active ingredients' in professional behaviour change strategies. Theories of human behaviour that feature an individual's "intention" to do something as the most immediate predictor of their behaviour have proved to be useful in non-clinical populations. As clinical practice is a form of human behaviour such theories may offer a basis for developing a scientific rationale for the choice of intervention to use in the implementation of new practice. The aim of this review was to explore the relationship between intention and behaviour in clinicians and how this compares to the intention-behaviour relationship in studies of non-clinicians.
We searched: PsycINFO, MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, Science/Social science citation index, Current contents (social & behavioural med/clinical med), ISI conference proceedings, and Index to Theses. The reference lists of all included papers were checked manually. Studies were eligible for inclusion if they had: examined a clinical behaviour within a clinical context, included measures of both intention and behaviour, measured behaviour after intention, and explored this relationship quantitatively. All titles and abstracts retrieved by electronic searching were screened independently by two reviewers, with disagreements resolved by discussion.
Ten studies were found that examined the relationship between intention and clinical behaviours in 1623 health professionals. The proportion of variance in behaviour explained by intention was of a similar magnitude to that found in the literature relating to non-health professionals. This was more consistently the case for studies in which intention-behaviour correspondence was good and behaviour was self-reported. Though firm conclusions are limited by a smaller literature, our findings are consistent with that of the non-health professional literature. This review, viewed in the context of the larger populations of studies, provides encouragement for the contention that there is a predictable relationship between the intentions of a health professional and their subsequent behaviour. However, there remain significant methodological challenges.
In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of ...five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change.
These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior.
Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R2 of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior.
We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.
The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. ...Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.
To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.
We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.
Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.
Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.
Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).
Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.
Behavioural theory can be used to better understand the effects of behaviour change interventions targeting healthcare professional behaviour to improve quality of care. However, the explicit use of ...theory is rarely reported despite interventions inevitably involving at least an implicit idea of what factors to target to implement change. There is a quality of care gap in the post-fracture investigation (bone mineral density (BMD) scanning) and management (bisphosphonate prescription) of patients at risk of osteoporosis. We aimed to use the Theoretical Domains Framework (TDF) within a systematic review of interventions to improve quality of care in post-fracture investigation. Our objectives were to explore which theoretical factors the interventions in the review may have been targeting and how this might be related to the size of the effect on rates of BMD scanning and osteoporosis treatment with bisphosphonate medication.
A behavioural scientist and a clinician independently coded TDF domains in intervention and control groups. Quantitative analyses explored the relationship between intervention effect size and total number of domains targeted, and as number of different domains targeted.
Nine randomised controlled trials (RCTs) (10 interventions) were analysed. The five theoretical domains most frequently coded as being targeted by the interventions in the review included "memory, attention and decision processes", "knowledge", "environmental context and resources", "social influences" and "beliefs about consequences". Each intervention targeted a combination of at least four of these five domains. Analyses identified an inverse relationship between both number of times and number of different domains coded and the effect size for BMD scanning but not for bisphosphonate prescription, suggesting that the more domains the intervention targeted, the lower the observed effect size.
When explicit use of theory to inform interventions is absent, it is possible to retrospectively identify the likely targeted factors using theoretical frameworks such as the TDF. In osteoporosis management, this suggested that several likely determinants of healthcare professional behaviour appear not yet to have been considered in implementation interventions. This approach may serve as a useful basis for using theory-based frameworks such as the TDF to retrospectively identify targeted factors within systematic reviews of implementation interventions in other implementation contexts.
The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this ...problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs.
To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective.
We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites.
We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area.
Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines.
We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service.
Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.
Inspection systems are used in health care to promote quality improvements, i.e. to achieve changes in organisational structures or processes, healthcare provider behaviour and patient outcomes. ...These systems are based on the assumption that externally promoted adherence to evidence-based standards (through inspection/assessment) will result in higher quality of health care. However, the benefits of external inspection in terms of organisational, provider and patient level outcomes are not clear.
To evaluate the effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour and patient outcomes.
We searched the following electronic databases for studies: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effectiveness, Scopus, HMIC, Index to Theses and Intute from their inception dates up to May 2011. There was no language restriction and studies were included regardless of publication status. We searched the reference lists of included studies and contacted authors of relevant papers, accreditation bodies and the International Organization for Standardisation (ISO), regarding any further published or unpublished work.
We included randomised controlled trials (RCTs), controlled clinical trials (CCTs), interrupted time-series (ITSs) and controlled before and after studies (CBAs) evaluating the effect of external inspection against external standards on healthcare organisation change, healthcare professional behaviour or patient outcomes in hospitals, primary healthcare organisations and other community-based healthcare organisations.
Two review authors independently applied eligibility criteria, extracted data and assessed the risk of bias of each included study. Since meta-analysis was not possible, we produced a narrative results summary.
We identified one cluster-RCT involving 20 South African public hospitals (Salmon 2003) and one ITS involving all acute trusts in England (OPM 2009) for inclusion in this review.Salmon and colleagues (Salmon 2003) showed mixed effects of a hospital accreditation system on the compliance with COHSASA (the Council for Health Services Accreditation for South Africa) accreditation standards and eight indicators of hospital quality. Significantly improved total mean compliance score with COHSASA accreditation standards was found for 21/28 service elements: mean intervention effect (95% confidence interval (CI)) was 30% (23% to 57%) (P < 0.001). The score increased from 48% to 78% in intervention hospitals, while remaining the same in control hospitals (43%). A sub-analysis of 424 a priori identified critical criteria (19 service elements) showed significantly improved compliance with the critical standards (P < 0.001). The score increased from 41% (21% to 46%) to 75% (55% to 96%) in intervention hospitals, but was unchanged in control hospitals (37%). Only one of the nine intervention hospitals gained full accreditation status at the end of the study period, with two others reached pre-accreditation status.The median intervention effect (range) for the indicators of hospital quality of care was 2.4 (-1.9 to +11.8) and only one of the eight indicators: 'nurses perception of clinical quality, participation and teamwork' was significantly improved (mean intervention effect 5.7, P = 0.03).Re-analysis of the MRSA (methicillin-resistant Staphylococcus aureus) data showed statistically non-significant effects of the Healthcare Commissions Infection Inspection programme.
We only identified two studies for inclusion in this review, which highlights the paucity of high-quality controlled evaluations of the effectiveness of external inspection systems. No firm conclusions could therefore be drawn about the effectiveness of external inspection on compliance with standards.
Abstract Objectives We aimed to explore key themes for the implementation of guidelines’ prescribing recommendations. Methods We interviewed a purposeful sample of 25 participants in British primary ...care in late 2000 and early 2001. Thirteen were academics in primary care and 12 were non-academic GPs. We asked about implementation of guidelines for five conditions (asthma, coronary heart disease prevention, depression, epilepsy, menorrhagia) ensuring variation in complexity, role of prescribing in patient management, GP role in prescribing and GP awareness of guidelines. We used the Theory of Planned Behaviour to design the study and the framework method for the analysis. Results Seven themes explain implementation of prescribing recommendations in primary care: credibility of content, credibility of source, presentation, influential people, organisational factors, disease characteristics, and dissemination strategy. Change in recommendations may hinder implementation. This is important since the development of evidence-based guidelines requires change in recommendations. Practitioners do not have a universal view or a common understanding of valid ‘evidence’. Credibility is improved if national bodies develop primary care guidelines with less input from secondary care and industry, and with simple and systematic presentation. Dissemination should target GPs’ perceived needs, improve ownership and get things right in the first implementation attempt. Enforcement strategies should not be used routinely. Conclusions GPs were critical of guidelines’ development, relevance and implementation. Guidelines should be clear about changes they propose. Future studies should quantify the relationship between evidence base of recommendations and implementation, and between change in recommendations and implementation. Small but important costs and side effects of implementing guidelines should be measured in evaluative studies.
Cluster randomised trials have unique features that complicate the application of standard ethics guidelines for research. The Ottawa Statement on the ethical design and conduct of cluster randomised ...trials was developed to provide detailed guidance to researchers, research ethics committees, regulators, and sponsors as they seek to fulfil their respective roles. This article describes the development of the Ottawa Statement and outlines key implications for researchers and research ethics committees.
PDF
