Educational practice and educational research are not aligned with each other. Current educational practice heavily relies on information transmission or content delivery to learners. Yet evidence ...shows that delivery is only a minor part of learning. To illustrate the directions we might take to find better educational strategies, six areas of educational evidence are briefly reviewed. The flipped classroom idea is proposed to shift our expenditure and focus in education. All information delivery could be web distributed, thus creating more time for other more expensive educational strategies to support the learner. In research our focus should shift from comparing one curriculum to the other, to research that explains why things work in education and under which conditions. This may generate ideas for creative designers to develop new educational strategies. These best practices should be shared and further researched. At the same time attention should be paid to implementation and the realization that teachers learn in a way very similar to the people they teach. If we take the evidence seriously, our educational practice will look quite different to the way it does now.
Introduction
Health professions education (HPE) has adopted the conceptualization of validity as an argument. However, the theoretical and practical aspects of how validity arguments should be ...developed, used and evaluated in HPE have not been deeply explored. Articulating the argumentation theory undergirding validity and validation can help HPE better operationalise validity as an argument. To better understand this, the authors explored how HPE validity scholars conceptualise assessment validity arguments and argumentation, seeking to understand potential consequences of these views on validation practices.
Methods
The authors used critical case sampling to identify HPE assessment validity experts in three ways: (1) participation in a prominent validity research group, (2) appearing in a bibliometric study of HPE validity publications and (3) authorship of recent HPE validity literature. Qualitative semi‐structured interviews were conducted with 16 experts in HPE assessment validity from four different countries. The authors used reflexive thematic analysis to develop themes relevant to their research question.
Results
The authors developed three themes grounded in participants' responses: (1) In theory, HPE validity is a social and situated argument. (2) In practice, the absence of audience and evaluation stymies the social nature of HPE validity. (3) Lack of validity argumentation creates and maintains power differentials within HPE. Participants articulated that current HPE validation practices are rooted in post‐positivist epistemology when they should be situated (i.e. context‐dependent), audience‐centric and inclusive.
Discussion
When discussing validity argumentation in theory, participants' descriptions reflect an interpretivist lens for evaluation that is misaligned with real‐world validity practices. This misalignment likely arises from HPE's adoption of “validity as an argument” as a slogan, without integrating theoretical and practical principles of argumentation theory.
How do HPE experts conceptualize the argumentation aspect of validity? @Midwest_MedPeds @ab_martini @LaraVarpio @erikdriessen @DrDanSchumacher explore the gap between theory and practice.
PURPOSETo maintain scientific integrity and engender public confidence, research must be conducted responsibly. Whereas deliberate scientific misconduct such as data fabrication is clearly unethical, ...other behaviors—often referred to as questionable research practices (QRPs)—exploit the ethical shades of gray that color acceptable practice. This study aimed to measure the frequency of self-reported misconduct and QRPs in a diverse, international sample of health professions education (HPE) researchers.
METHODIn 2017, the authors conducted an anonymous, cross-sectional survey study. The web-based survey contained 43 items that asked respondents to rate how often they had engaged in a variety of irresponsible research behaviors. The items were adapted from previously published surveys.
RESULTSIn total, 590 HPE researchers took the survey. The mean age was 46 years (SD = 11.6), and the majority of participants were from the United States (26.4%), Europe (23.2%), and Canada (15.3%). The three most frequently reported irresponsible research behaviors were adding authors who did not qualify for authorship (60.6%), citing articles that were not read (49.5%), and selectively citing papers to please editors or reviewers (49.4%). Additionally, respondents reported misrepresenting a participant’s words (6.7%), plagiarizing (5.5%), inappropriately modifying results (5.3%), deleting data without disclosure (3.4%), and fabricating data (2.4%). Overall, 533 (90.3%) respondents reported at least one irresponsible behavior.
CONCLUSIONSNotwithstanding the methodological limitations of survey research, these findings indicate that a substantial proportion of HPE researchers report a range of misconduct and QRPs. Consequently, reforms may be needed to improve the conduct of HPE research.
The past decade has witnessed an upsurge in medical curriculum partnerships established across national boundaries to offer students at the foreign institution (host) a learning experience comparable ...to that of students at the exporting institution (home). However, since the learning environments and national healthcare contexts differ greatly between institutions, concerns have been raised in the literature about potential low quality of curriculum delivery, inadequate preparation of students to practice in the host country healthcare setting, and a culture shock for host students having to study a home curriculum.. The experiences and opinions of medical students related to these concerns have not been investigated. This study takes an explorative approach on key challenges faced by host institution students.
Three hundred sixty-one host students recruited from 3 partnerships completed a survey about their motives, transition from high school, language, preparedness for practice, future career planning, and general satisfaction. Descriptive statistics of closed-ended items and thematic analysis of open-ended items were performed.
Findings revealed that students generally held positive views of the education they received. Switching to a new language of instruction (English) and learning environment was not perceived as a major obstacle. However, a significant portion of students who as non-nationals did not speak the language of the patient population felt this complicated effective workplace-based learning.
Despite differences in learning experiences, host students felt the partnership afforded opportunities to acquire unique academic competencies and boost their career. Further adaptation of the home curriculum to the host country healthcare system may be beneficial, without losing sight of medical curriculum partnerships' potential to offer graduates an international outlook on global healthcare.
In 1990, Miller wrote that no tools were available for assessment of what a learner does when functioning independently at the clinical workplace (Miller 1990). Since then portfolios have filled this ...gap and found their way into medical education, not only as tools for assessment of performance in the workplace, but also as tools to stimulate learning from experience. We give an overview of the content and structure of various types of portfolios, describe the potential of electronic portfolios, present techniques and strategies for using portfolios as tools for stimulating learning and for assessment, and discuss factors that influence the success of the introduction. We conclude that portfolios have a lot of potential but that their introduction also often leads to disappointment, because they require a new perspective on education from mentors and learners and a significant investment of time and energy.
We propose a model for programmatic assessment in action, which simultaneously optimises assessment for learning and assessment for decision making about learner progress. This model is based on a ...set of assessment principles that are interpreted from empirical research. It specifies cycles of training, assessment and learner support activities that are complemented by intermediate and final moments of evaluation on aggregated assessment data points. A key principle is that individual data points are maximised for learning and feedback value, whereas high-stake decisions are based on the aggregation of many data points. Expert judgement plays an important role in the programme. Fundamental is the notion of sampling and bias reduction to deal with the inevitable subjectivity of this type of judgement. Bias reduction is further sought in procedural assessment strategies derived from criteria for qualitative research. We discuss a number of challenges and opportunities around the proposed model. One of its prime virtues is that it enables assessment to move, beyond the dominant psychometric discourse with its focus on individual instruments, towards a systems approach to assessment design underpinned by empirically grounded theory.
IMPORTANCE: Increasing health care expenditures are taxing the sustainability of the health care system. Physicians should be prepared to deliver high-value, cost-conscious care. OBJECTIVE: To ...understand the circumstances in which the delivery of high-value, cost-conscious care is learned, with a goal of informing development of effective educational interventions. DATA SOURCES: PubMed, EMBASE, ERIC, and Cochrane databases were searched from inception until September 5, 2015, to identify learners and cost-related topics. STUDY SELECTION: Studies were included on the basis of topic relevance, implementation of intervention, evaluation of intervention, educational components in intervention, and appropriate target group. There was no restriction on study design. DATA EXTRACTION AND SYNTHESIS: Data extraction was guided by a merged and modified version of a Best Evidence in Medical Education abstraction form and a Cochrane data coding sheet. Articles were analyzed using the realist review method, a narrative review technique that focuses on understanding the underlying mechanisms in interventions. Recurrent patterns were identified in the data through thematic analyses. Resulting themes were discussed within the research team until consensus was reached. MAIN OUTCOMES AND MEASURES: Main outcomes were factors that promote education in delivering high-value, cost-conscious care. FINDINGS: The initial search identified 2650 articles; 79 met the inclusion criteria, of which 14 were randomized clinical trials. The majority of the studies were conducted in North America (78.5%) using a pre-post interventional design (58.2%; at least 1619 participants); they focused on practicing physicians (36.7%; at least 3448 participants), resident physicians (6.3%; n = 516), and medical students (15.2%; n = 275). Among the 14 randomized clinical trials, 12 addressed knowledge transmission, 7 reflective practice, and 1 supportive environment; 10 (71%) concluded that the intervention was effective. The data analysis suggested that 3 factors aid successful learning: (1) effective transmission of knowledge, related, for example, to general health economics and prices of health services, to scientific evidence regarding guidelines and the benefits and harms of health care, and to patient preferences and personal values (67 articles); (2) facilitation of reflective practice, such as providing feedback or asking reflective questions regarding decisions related to laboratory ordering or prescribing to give trainees insight into their past and current behavior (56 articles); and (3) creation of a supportive environment in which the organization of the health care system, the presence of role models of delivering high-value, cost-conscious care, and a culture of high-value, cost-conscious care reinforce the desired training goals (27 articles). CONCLUSIONS AND RELEVANCE: Research on educating physicians to deliver high-value, cost-conscious care suggests that learning by practicing physicians, resident physicians, and medical students is promoted by combining specific knowledge transmission, reflective practice, and a supportive environment. These factors should be considered when educational interventions are being developed.
Processes involved in the regulation of learning have been researched for decades, because of its impact on academic and workplace performance. In fact, self‐regulated learning is the focus of ...countless studies in health professions education and higher education in general. While we will always need competent individuals who are able to regulate their own learning, developments in healthcare require a shift from a focus on the individual to the collective: collaboration within and between healthcare teams is at the heart of high‐quality patient care. Concepts of collaborative learning and collective competence challenge commonly held conceptualisations of regulatory learning and call for a focus on the social embeddedness of regulatory learning and processes regulating the learning of the collective. Therefore, this article questions the alignment of current conceptualisations of regulation of learning with demands for collaboration in current healthcare. We explore different conceptualisations of regulation of learning (self‐, co‐, and socially shared regulation of learning), and elaborate on how the integration of these conceptualisations adds to our understanding of regulatory learning in healthcare settings. Building on these insights, we furthermore suggest ways forward for research and educational practice.
Bransen et al. explore the concept of 'self' to argue that the health professions need to shift from striving to optimize self‐regulation to understanding how to effectively regulate across self‐, co‐, and shared‐regulation.
Aim Portfolios are often used as an instrument with which to stimulate students to reflect on their experiences. Research has shown that working with portfolios does not automatically stimulate ...reflection. In this study we addressed the question: What are the conditions for successful reflective use of portfolios in undergraduate medical education?
Methodology/research design We designed a portfolio that was aimed at stimulating reflection in early undergraduate medical education, using experiences described in the medical education literature and elsewhere. Conditions for reflective portfolio use were identified through interviews with 13 teachers (mentors), who were experienced in mentoring students in the process of developing their portfolios. The interviews were analysed according to the principles of grounded theory.
Results The conditions for successful reflective use of portfolios that emerged from the interviews fell into 4 categories: coaching; portfolio structure and guidelines; relevant experiences and materials, and summative assessment. According to the mentors, working with a portfolio designed to meet these conditions will stimulate students' reflective abilities.
Conclusion This study shows that portfolios are a potentially valuable method of assessing and developing students' reflective skills in undergraduate medical training, provided certain conditions for effective portfolios are recognised and met. Portfolios have a strong potential for enhancing learning and assessment but they are very vulnerable and may easily lead to disappointment. Before implementing portfolios in education, one should first consider whether the necessary conditions can be fulfilled, including an appropriate portfolio structure, an appropriate assessment procedure, the provision of enough new experiences and materials, and sufficient teacher capacity for adequate coaching and assessment.
Workplace-based assessment may be further optimized by drawing upon the perspectives of multiple assessors, including those outside the trainee's discipline. Interprofessional competencies like ...communication and collaboration are often considered suitable for team input.
We sought to characterize multidisciplinary expectations of communicator and collaborator competency roles.
We adopted a constructivist grounded theory approach to explore perspectives of multidisciplinary team members on a clinical teaching unit. In semi-structured interviews, participants described expectations for competent collaboration and communication of trainees outside their own discipline. Data were analyzed to identify recurring themes, underlying concepts and their interactions using constant comparison.
Three main underlying perspectives influenced interprofessional characterization of competent communication and collaboration: (1) general expectations of best practice; (2) specific expectations of supportive practice; and (3) perceived commitment to teaching practice. However, participants seemingly judged trainees outside their discipline according to how competencies were exercised to advance their own professional patient care decision-making, with minimal attention to the trainee's specific skillset demonstrated.
While team members expressed commitment to supporting interprofessional competency development of trainees outside their discipline, service-oriented judgement of performance loomed large. The potential impact on the credibility of multidisciplinary sources for workplace-based assessment requires consideration.
PDF
