Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based ...instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions.
Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85.
A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.
Continuing professional development (CPD) activities are one way that new knowledge can be translated into changes in practice. However, few tools are available for evaluating the extent to which ...these activities change health professionals' behavior. We developed a questionnaire called CPD-Reaction for assessing the impact of CPD activities on health professionals' clinical behavioral intentions. We evaluated its responsiveness to change in behavioral intention and verified its acceptability among stakeholders.
We enrolled 376 health professionals who completed CPD-Reaction before and immediately after attending a CPD activity. We contacted them three months later and asked them to self-report on any behavior change. We compared the mean rankings on each CPD-Reaction construct before and immediately after CPD activities. To estimate its predictive validity, we compared the median behavioral intention score (post-activity) of health professionals reporting a behavior change three months later with the median behavioral intention score of physicians who reported no change. We explored stakeholders' views on CPD-Reaction in semi-structured interviews. Participants were mostly family physicians (62.2%), with an average of 19 years of clinical practice. Post-activity, we observed an increase in intention-related scores for all constructs (P < 0.001) with the most appreciable for the construct beliefs about capabilities. A total of 313 participants agreed to be contacted at follow up, and of these only 69 (22%) reported back. Of these, 43 (62%) self-reported a behavior change. We observed no statistically significant difference in intention between health professionals who later reported a behavior change and those who reported no change (P = 0.30). Overall, CPD stakeholders found the CPD-Reaction questionnaire of interest and suggested potential solutions to perceived barriers to its implementation.
The CPD-Reaction questionnaire seems responsive to change in behavioral intention. Although CPD stakeholders found it interesting, future implementation will require addressing barriers they identified.
ObjectivesAssess the feasibility and impact of a continuous professional development (CPD) course on type 2 diabetes and depression on health professionals’ intention to include sex and gender ...considerations in patient care.Design and settingIn collaboration with CPD organisations and patient-partners, we conducted a mixed-methods feasibility controlled trial with postintervention measures in three Canadian provinces.ParticipantsOf 178 eligible health professionals, 127 completed questionnaires and 67 participated in semistructured group discussions.Intervention and comparatorAn interactive 1 hour CPD course, codesigned with patient-partners, on diabetes and depression that included sex and gender considerations (innovation) was compared with a similar course that did not include them (comparator).OutcomesFeasibility of recruitment and retention of CPD organisations and patient-partners throughout the study; adherence to planned activities; health professionals’ intention to include sex and gender considerations in patient care as measured by the CPD-Reaction questionnaire; and barriers and facilitators using the Theoretical Domains Framework.ResultsAll recruited CPD organisations and patient-partners remained engaged throughout the study. All planned CPD courses occurred. Overall, 71% of eligible health professionals participated (63% under 44 years old; 79.5% women; 67.7% practising in French; 66.9% practising in Quebec; 78.8% in urban practice). After training, mean intention scores for the innovation (n=49) and control groups (n=78) were 5.65±0.19 and 5.19±0.15, respectively. Mean difference was −0.47 (CI −0.95 to 0.01; p=0.06). Adjusted for age, gender and practice settings, mean difference was −0.57 (CI −1.09 to −0.05; p=0.03). We identified eight theoretical domains related to barriers and six related to facilitators for providing sex-adapted and gender-adapted diabetes and depression care.ConclusionsCPD training on diabetes and depression that includes sex and gender considerations is feasible and, compared with CPD training that does not, may prompt health professionals to modify their care. Addressing identified barriers and facilitators could increase intention.Trial registration numberNCT03928132 with ClinicalTrials.gov; Post-results.
Continuing professional development (CPD) is one of the principal means by which health professionals (i.e. primary care physicians and specialists) maintain, improve, and broaden the knowledge and ...skills required for optimal patient care and safety. However, the lack of a widely accepted instrument to assess the impact of CPD activities on clinical practice thwarts researchers' comparisons of the effectiveness of CPD activities. Using an integrated model for the study of healthcare professionals' behaviour, our objective is to develop a theory-based, valid, reliable global instrument to assess the impact of accredited CPD activities on clinical practice.
Phase 1: We will analyze the instruments identified in a systematic review of factors influencing health professionals' behaviours using criteria that reflect the literature on measurement development and CPD decision makers' priorities. The outcome of this phase will be an inventory of instruments based on social cognitive theories. Phase 2: Working from this inventory, the most relevant instruments and their related items for assessing the concepts listed in the integrated model will be selected. Through an e-Delphi process, we will verify whether these instruments are acceptable, what aspects need revision, and whether important items are missing and should be added. The outcome of this phase will be a new global instrument integrating the most relevant tools to fit our integrated model of healthcare professionals' behaviour. Phase 3: Two data collections are planned: (1) a test-retest of the new instrument, including item analysis, to assess its reliability and (2) a study using the instrument before and after CPD activities with a randomly selected control group to explore the instrument's mere-measurement effect. Phase 4: We will conduct individual interviews and focus groups with key stakeholders to identify anticipated barriers and enablers for implementing the new instrument in CPD practice. Phase 5: Drawing on the results from the previous phases, we will use consensus-building methods to develop with the decision makers a plan to implement the new instrument.
This project proposes to give stakeholders a theory-based global instrument to validly and reliably measure the impacts of CPD activities on clinical practice, thus laying the groundwork for more targeted and effective knowledge-translation interventions in the future.
Shared decision-making is not widely implemented in healthcare. We aimed to set a research agenda about promoting shared decision-making through continuing professional development.
Thirty-six ...participants met for two days.
Participants suggested ways to improve an environmental scan that had inventoried 53 shared decision-making training programs from 14 countries. Their proposed research agenda included reaching an international consensus on shared decision-making competencies and creating a framework for accrediting continuing professional development initiatives in shared decision-making.
Variability in shared decision-making training programs showcases the need for quality assurance frameworks.
Shared decision making (SDM) is a process by which a healthcare choice is made jointly by the healthcare professional and the patient. SDM is the essential element of patient-centered care, a core ...concept of primary care. However, SDM is seldom translated into primary practice. Continuing professional development (CPD) is the principal means by which healthcare professionals continue to gain, improve, and broaden the knowledge and skills required for patient-centered care. Our international collaboration seeks to improve the knowledge base of CPD that targets translating SDM into the clinical practice of primary care in diverse healthcare systems.
Funded by the Canadian Institutes of Health Research (CIHR), our project is to form an international, interdisciplinary research team composed of health services researchers, physicians, nurses, psychologists, dietitians, CPD decision makers and others who will study how CPD causes SDM to be practiced in primary care. We will perform an environmental scan to create an inventory of CPD programs and related activities for translating SDM into clinical practice. These programs will be critically assessed and compared according to their strengths and limitations. We will use the empirical data that results from the environmental scan and the critical appraisal to identify knowledge gaps and generate a research agenda during a two-day workshop to be held in Quebec City. We will ask CPD stakeholders to validate these knowledge gaps and the research agenda.
This project will analyse existing CPD programs and related activities for translating SDM into the practice of primary care. Because this international collaboration will develop and identify various factors influencing SDM, the project could shed new light on how SDM is implemented in primary care.
Continually improving patient outcomes requires that physicians start new behaviors, stop old behaviors, or adjust how they practice medicine. Continuing professional development (CPD) is the method ...most commonly used by physicians to improve their knowledge and skills. However, despite regular physician attendance at these activities, change in clinical behavior is rarely observed. The authors sought to identify which of Bloom's domains (cognitive, affective, or psychomotor) are targeted by the learning objectives of CPD activities offered by medical associations, regulatory bodies, and academic institutions in the province of Quebec, Canada.
The authors evaluated the objectives of 110 accredited CPD activities offered to physicians and other health professionals from November 2012 to March 2013. The objectives of each activity were extracted and classified into learning domains using Bloom's taxonomy.
Ninety-six percent of the learning objectives analyzed targeted the cognitive domain, which consists of six levels of increasing complexity: knowledge, comprehension, application, analysis, synthesis, and evaluation. Half (47%) targeted knowledge and comprehension, whereas only 26% aimed to improve skills in analysis, synthesis, and evaluation.
Most accredited CPD activities within this sample were generally not designed to promote clinical behavior change because the focus of these activities was on remembering and understanding information instead of preparing physicians to put knowledge into practice by analyzing information, evaluating new evidence, and planning operations that lead to behavior change. Educators and CPD providers should take advantage of well-established theories of health professional behavior change, such as sociocognitive theories, to develop their activities.
The present supplement summarizes the proceedings of the symposium “Implementing practice guidelines: A workshop on guidelines dissemination and implementation with a focus on asthma and COPD”, which ...took place in Quebec City, Quebec, from April 14 to 16, 2005. This international symposium was a joint initiative of the Laval University Office of Continuing Medical Education (Bureau de la Formation Médicale Continue), the Canadian Thoracic Society and the Canadian Network for Asthma Care, and was supported by many other organizations and by industrial partners. The objectives of this meeting were to examine the optimal implementation of practice guidelines, review current initiatives for the implementation of asthma and chronic obstructive pulmonary disease (COPD) guidelines in Canada and in the rest of the world, and develop an optimal strategy for future guideline implementation. An impressive group of scientists, physicians and other health care providers, as well as policy makers and representatives of patients’ associations, the pharmaceutical industry, research and health networks, and communications specialists, conveyed their perspectives on how to achieve these goals. This important event provided a unique opportunity for all participants to discuss key issues in improving the care of patients with asthma and COPD. These two diseases are responsible for an enormous human and socioeconomic burden around the world. Many reports have indicated that current evidence‐based guidelines are underused by physicians and others, and that there are many barriers to an effective translation of recommendations into day‐to‐day care. There is therefore a need to develop more effective ways to communicate key information to both caregivers and patients, and to promote appropriate health behaviours. This symposium contributed to the initiation of what could become the “Canadian Asthma and COPD Campaign”, aimed at improving care and, hence, the quality of life of those suffering from these diseases. It is hoped that this event will be followed by other meetings that focus on how to improve the transfer of key recommendations from evidence‐based guidelines into current care, and how to stimulate research to accomplish this.
To describe an interactive playing card workshop in the communication of asthma guidelines recommendations, and to assess the initial evaluation of this educational tool by family physicians.
Family ...physicians were invited to participate in the workshop by advertisements or personal contacts. Each physician completed a standardized questionnaire on his or her perception of the rules, content and properties of the card game.
A university-based continuing medical education initiative.
Primary care physicians.
Physicians' evaluation of the rules, content and usefulness of the program.
The game allowed the communication of relevant asthma-related content, as well as experimentation with a different learning format. It also stimulated interaction in a climate of friendly competition. Participating physicians considered the method to be an innovative tool that facilitated reflection, interaction and learning. It generated relevant discussions on how to apply guideline recommendations to current asthma care.
This new, interactive, educational intervention, integrating play and scientific components, was well received by participants. This method may be of value to help integrate current guidelines into current practice, thus facilitating knowledge transfer to caregivers.
Shared decision making is now making inroads in health care professionals' continuing education curriculum, but there is no consensus on what core competencies are required by clinicians for ...effectively involving patients in health‐related decisions. Ready‐made programs for training clinicians in shared decision making are in high demand, but existing programs vary widely in their theoretical foundations, length, and content. An international, interdisciplinary group of 25 individuals met in 2012 to discuss theoretical approaches to making health‐related decisions, compare notes on existing programs, take stock of stakeholders concerns, and deliberate on core competencies. This article summarizes the results of those discussions. Some participants believed that existing models already provide a sufficient conceptual basis for developing and implementing shared decision making competency‐based training programs on a wide scale. Others argued that this would be premature as there is still no consensus on the definition of shared decision making or sufficient evidence to recommend specific competencies for implementing shared decision making. However, all participants agreed that there were 2 broad types of competencies that clinicians need for implementing shared decision making: relational competencies and risk communication competencies. Further multidisciplinary research could broaden and deepen our understanding of core competencies for shared decision making training.
PDF
