Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical ...information exist regarding how often such assessments need to be made.
To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete.
We developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics).
Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated.
For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval CI, 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years).
More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.
A consistent finding in articles on quality improvement in health care is that change is difficult to achieve. According to the research literature, the majority of interventions are targeted at ...health care professionals. But success in achieving change may be influenced by factors other than those relating to individual professionals, and theories may help explain whether change is possible. This article argues for a more systematic use of theories in planning and evaluating quality-improvement interventions in clinical practice. It demonstrates how different theories can be used to generate testable hypotheses regarding factors that influence the implementation of change, and it shows how different theoretical assumptions lead to different quality-improvement strategies.
Evaluations of interventions to improve implementation of guidelines have failed to produce a clear pattern of results favouring a particular method. While implementation depends on clinicians and ...managers changing a variety of behaviours, psychological theories of behaviour and behaviour change are seldom used to try to understand difficulties in implementation or to develop interventions to overcome them.
This study applied psychological theory to examine explanations for difficulties in implementation. It used a theoretical framework derived from an interdisciplinary consensus exercise to code interviews across 11 theoretical domains. The focus of the study was a National Institute for Health and Clinical Excellence's Schizophrenia guideline recommendation that family intervention should be offered to the families of people with schizophrenia.
Participants were recruited from community mental health teams from three United Kingdom National Health Service (NHS) Trusts; 20 members (social workers, nurses, team managers, psychologists, and psychiatrists) participated. Semi-structured interviews were audio-taped and transcribed. Interview questions were based on the theoretical domains and addressed respondents' knowledge, attitudes and opinions regarding the guideline. Two researchers independently coded the transcript segments from each interview that were related to each theoretical domain. A score of 1 indicated that the transcript segments relating to the domain did not appear to contain description of difficulties in implementation of the family therapy guidelines; similarly a score of 0.5 indicated possible difficulties and a score of 0 indicated definite difficulties.
Coding respondents' answers to questions related to the three domains 'beliefs about consequences,' 'social/professional role and identity,' and 'motivation' produced the three highest total scores indicating that factors relating to these domains were unlikely to constitute difficulties in implementation. 'Environmental context and resources' was the lowest scoring domain, with 'Emotion' scoring the second lowest, suggesting that these were likely to be areas for considering intervention. The two main resources identified as problems were time and training. The emotions that appeared to potentially influence the offer of family therapy were self-doubt and fear.
This exploratory study demonstrates an approach to developing a theoretical understanding of implementation difficulties.
Background
Clinicians’ behaviours require deliberate decision-making in complex contexts and may involve both impulsive (automatic) and reflective (motivational and volitional) processes.
Purpose
The ...purpose of this study was to test a dual process model applied to clinician behaviours in their management of type 2 diabetes.
Methods
The design used six nested prospective correlational studies. Questionnaires were sent to general practitioners and nurses in 99 UK primary care practices, measuring reflective (intention, action planning and coping planning) and impulsive (automaticity) predictors for six guideline-recommended behaviours: blood pressure prescribing (
N
= 335), prescribing for glycemic control (
N
= 288), providing diabetes-related education (
N
= 346), providing weight advice (
N
= 417), providing self-management advice (
N
= 332) and examining the feet (
N
= 218).
Results
Respondent retention was high. A dual process model was supported for prescribing behaviours, weight advice, and examining the feet. A sequential reflective process was supported for blood pressure prescribing, self-management and weight advice, and diabetes-related education.
Conclusions
Reflective and impulsive processes predict behaviour. Quality improvement interventions should consider both reflective and impulsive approaches to behaviour change.
Healthcare professional response rates to postal questionnaires are declining and this may threaten the validity and generalisability of their findings. Methods to improve response rates do incur ...costs (resources) and increase the cost of research projects. The aim of these randomised controlled trials (RCTs) was to assess whether 1) incentives, 2) type of reminder and/or 3) reduced response burden improve response rates; and to assess the cost implications of such additional effective interventions.
Two RCTs were conducted. In RCT A general dental practitioners (dentists) in Scotland were randomised to receive either an incentive; an abridged questionnaire or a full length questionnaire. In RCT B non-responders to a postal questionnaire sent to general medical practitioners (GPs) in the UK were firstly randomised to receive a second full length questionnaire as a reminder or a postcard reminder. Continued non-responders from RCT B were then randomised within their first randomisation to receive a third full length or an abridged questionnaire reminder. The cost-effectiveness of interventions that effectively increased response rates was assessed as a secondary outcome.
There was no evidence that an incentive (52% versus 43%, Risk Difference (RD) -8.8 (95%CI -22.5, 4.8); or abridged questionnaire (46% versus 43%, RD -2.9 (95%CI -16.5, 10.7); statistically significantly improved dentist response rates compared to a full length questionnaire in RCT A. In RCT B there was no evidence that a full questionnaire reminder statistically significantly improved response rates compared to a postcard reminder (10.4% versus 7.3%, RD 3 (95%CI -0.1, 6.8). At a second reminder stage, GPs sent the abridged questionnaire responded more often (14.8% versus 7.2%, RD -7.7 (95%CI -12.8, -2.6). GPs who received a postcard reminder followed by an abridged questionnaire were most likely to respond (19.8% versus 6.3%, RD 8.1%, and 9.1% for full/postcard/full, three full or full/full/abridged questionnaire respectively). An abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy for increasing the response rate (£15.99 per response).
When expecting or facing a low response rate to postal questionnaires, researchers should carefully identify the most efficient way to boost their response rate. In these studies, an abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy. An increase in response rates may be explained by a combination of the number and type of contacts. Increasing the sampling frame may be more cost-effective than interventions to prompt non-responders. However, this may not strengthen the validity and generalisability of the survey findings and affect the representativeness of the sample.
It is becoming increasingly common to release information about the performance of hospitals, health professionals or providers, and healthcare organisations into the public domain. However, we do ...not know how this information is used and to what extent such reporting leads to quality improvement by changing the behaviour of healthcare consumers, providers and purchasers, or to what extent the performance of professionals and providers can be affected.
To determine the effectiveness of the public release of performance data in changing the behaviour of healthcare consumers, professionals and organisations.
We searched the Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Effective Practice and Organisation of Care (EPOC) Trials Register, MEDLINE Ovid (from 1966), EMBASE Ovid (from 1979), CINAHL, PsycINFO Ovid (from 1806) and DARE up to 2011.
We searched for randomised or quasi-randomised trials, interrupted time series and controlled before-after studies of the effects of publicly releasing data regarding any aspect of the performance of healthcare organisations or individuals. The papers had to report at least one main outcome related to selecting or changing care. Other outcome measures were awareness, attitude, views and knowledge of performance data and costs.
Two review authors independently screened studies for eligibility and extracted data. For each study, we extracted data about the target groups (healthcare consumers, healthcare providers and healthcare purchasers), performance data, main outcomes (choice of healthcare provider and improvement by means of changes in care) and other outcomes (awareness, attitude, views, knowledge of performance data and costs).
We included four studies containing more than 35,000 consumers, and 1560 hospitals. Three studies were conducted in the USA and examined consumer behaviour after the public release of performance data. Two studies found no effect of Consumer Assessment of Healthcare Providers and Systems information on health plan choice in a Medicaid population. One interrupted time series study found a small positive effect of the publishing of data on patient volumes for coronary bypass surgery and low-complication outliers for lumbar discectomy, but these effects did not persist longer than two months after each public release. No effects on patient volumes for acute myocardial infarction were found.One cluster-randomised controlled trial, conducted in Canada, studied improvement changes in care after the public release of performance data for patients with acute myocardial infarction and congestive heart failure. No effects for the composite process-of-care indicators for either condition were found, but there were some improvements in the individual process-of-care indicators. There was an effect on the mortality rates for acute myocardial infarction. More quality improvement activities were initiated in response to the publicly-released report cards. No secondary outcomes were reported.
The small body of evidence available provides no consistent evidence that the public release of performance data changes consumer behaviour or improves care. Evidence that the public release of performance data may have an impact on the behaviour of healthcare professionals or organisations is lacking.
Psychological models can be used to understand and predict behaviour in a wide range of settings. However, they have not been consistently applied to health professional behaviours, and the ...contribution of differing theories is not clear. The aim of this study was to explore the usefulness of a range of psychological theories to predict health professional behaviour relating to management of upper respiratory tract infections (URTIs) without antibiotics.
Psychological measures were collected by postal questionnaire survey from a random sample of general practitioners (GPs) in Scotland. The outcome measures were clinical behaviour (using antibiotic prescription rates as a proxy indicator), behavioural simulation (scenario-based decisions to managing URTI with or without antibiotics) and behavioural intention (general intention to managing URTI without antibiotics). Explanatory variables were the constructs within the following theories: Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Stage Model (SM), and knowledge (a non-theoretical construct). For each outcome measure, multiple regression analysis was used to examine the predictive value of each theoretical model individually. Following this 'theory level' analysis, a 'cross theory' analysis was conducted to investigate the combined predictive value of all significant individual constructs across theories.
All theories were tested, but only significant results are presented. When predicting behaviour, at the theory level, OLT explained 6% of the variance and, in a cross theory analysis, OLT 'evidence of habitual behaviour' also explained 6%. When predicting behavioural simulation, at the theory level, the proportion of variance explained was: TPB, 31%; SCT, 26%; II, 6%; OLT, 24%. GPs who reported having already decided to change their management to try to avoid the use of antibiotics made significantly fewer scenario-based decisions to prescribe. In the cross theory analysis, perceived behavioural control (TPB), evidence of habitual behaviour (OLT), CS-SRM cause (chance/bad luck), and intention entered the equation, together explaining 36% of the variance. When predicting intention, at the theory level, the proportion of variance explained was: TPB, 30%; SCT, 29%; CS-SRM 27%; OLT, 43%. GPs who reported that they had already decided to change their management to try to avoid the use of antibiotics had a significantly higher intention to manage URTIs without prescribing antibiotics. In the cross theory analysis, OLT evidence of habitual behaviour, TPB attitudes, risk perception, CS-SRM control by doctor, TPB perceived behavioural control and CS-SRM control by treatment entered the equation, together explaining 49% of the variance in intention.
The study provides evidence that psychological models can be useful in understanding and predicting clinical behaviour. Taking a theory-based approach enables the creation of a replicable methodology for identifying factors that predict clinical behaviour. However, a number of conceptual and methodological challenges remain.
Reporting of adverse clinical events is thought to be an effective method of improving the safety of healthcare. Underreporting of these adverse events is often said to occur with consequence of ...missing of opportunities to learn from these incidents. A clinical incident can be defined as any occurrence which is not consistent with the routine care of the patient or the routine operation of the institution.
To assess the effects of interventions designed to increase clinical incident reporting in healthcare settings.
We searched the the following databases: Cochrane Effective Practice and Organisation of Care Group Specialised Register, the Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE (OVID), EMBASE (OVID), CINAHL (EBSCO), Social Science Citation Index and Science Citation Index (Web of Knowledge), Healthstar (OVID), INSPEC, DHSS-DATA, SIGLE, ISI Conference Proceedings, Web of Science Conference Proceedings Citation Index (Science), Database of Abstracts of Reviews of Effectiveness (DARE).
Randomised controlled trials (RCT), controlled before-after studies (CBA) and interrupted time series (ITS) of interventions designed to increase clinical incident reporting in healthcare.
At least two review authors assessed the eligibility of potentially relevant studies, extracted the data and assessed the quality of included studies.
Four studies (one CBA and three ITS studies) met our inclusion criteria and were included in the review. The CBA study showed a significant improvement in incident reporting rates after the introduction of the new reporting system. Just one of the ITS studies showed a statistically significant improved effectiveness of the new reporting system from nine months. The other two studies reported no statistically significant improvements.
Because of the limitations of the studies it is not possible to draw conclusions for clinical practice. Anyone introducing a system into practice should give careful consideration to conducting an evaluation using a robust design.
Although most people with Type 2 diabetes receive their diabetes care in primary care, only a limited amount is known about the quality of diabetes care in this setting. We investigated the provision ...and receipt of diabetes care delivered in UK primary care.
Postal surveys with all healthcare professionals and a random sample of 100 patients with Type 2 diabetes from 99 UK primary care practices.
326/361 (90.3%) doctors, 163/186 (87.6%) nurses and 3591 patients (41.8%) returned a questionnaire. Clinicians reported giving advice about lifestyle behaviours (e.g. 88% would routinely advise about calorie restriction; 99.6% about increasing exercise) more often than patients reported having received it (43% and 42%) and correlations between clinician and patient report were low. Patients' reported levels of confidence about managing their diabetes were moderately high; a median (range) of 21% (3% to 39%) of patients reporting being not confident about various areas of diabetes self-management.
Primary care practices have organisational structures in place and are, as judged by routine quality indicators, delivering high quality care. There remain evidence-practice gaps in the care provided and in the self confidence that patients have for key aspects of self management and further research is needed to address these issues. Future research should use robust designs and appropriately designed studies to investigate how best to improve this situation.
Background Many theories of behaviour are potentially relevant to predictive and intervention studies but most studies investigate a narrow range of theories. Michie et al. (2005) agreed 12 ...‘theoretical domains’ from 33 theories that explain behaviour change. They developed a ‘Theoretical Domains Interview’ (TDI) for identifying relevant domains for specific clinical behaviours, but the framework has not been used for selecting theories for predictive studies. It was used here to investigate clinicians' transfusion behaviour in intensive care units (ICU). Evidence suggests that red blood cells transfusion could be reduced for some patients without reducing quality of care.
Objectives (1) To identify the domains relevant to transfusion practice in ICUs and neonatal intensive care units (NICUs), using the TDI. (2) To use the identified domains to select appropriate theories for a study predicting transfusion behaviour.
Methods An adapted TDI about managing a patient with borderline haemoglobin by watching and waiting instead of transfusing red blood cells was used to conduct semi‐structured, one‐to‐one interviews with 18 intensive care consultants and neonatologists across the UK.
Results Relevant theoretical domains were: knowledge, beliefs about capabilities, beliefs about consequences, social influences, behavioural regulation. Further analysis at the construct level resulted in selection of seven theoretical approaches relevant to this context: Knowledge‐Attitude‐Behaviour Model, Theory of Planned Behaviour, Social Cognitive Theory, Operant Learning Theory, Control Theory, Normative Model of Work Team Effectiveness and Action Planning Approaches.
Conclusions This study illustrated, the use of the TDI to identify relevant domains in a complex area of inpatient care. This approach is potentially valuable for selecting theories relevant to predictive studies and resulted in greater breadth of potential explanations than would be achieved if a single theoretical model had been adopted.
PDF
