Qualitative evidence syntheses (QES) have increased in prominence and profile over the last decade as a discrete set of methodologies to undertake systematic reviews of primary qualitative research ...in health and social care and in education. The findings from a qualitative evidence synthesis can enable a richer interpretation of a particular phenomenon, set of circumstances, or experiences than single primary qualitative research studies can achieve. Qualitative evidence synthesis methods were developed in response to an increasing demand from health and social professionals, policy makers, guideline developers and educationalists for review evidence that goes beyond “what works” afforded by systematic reviews of effectiveness. The increasing interest in the synthesis of qualitative research has led to methodological developments documented across a plethora of texts and journal articles. This “State of the Method” paper aims to bring together these methodological developments in one place, contextualizing advances in methods with exemplars to support readers in making choices in approach to a synthesis and aid understanding. The paper clarifies what a “qualitative evidence synthesis” is and explores its role, purpose and development. It details the kind of questions a QES can explore, the processes associated with a QES, including the methods for synthesis. The rational and methods for integrating a QES with systematic reviews of effectiveness are also detailed. Finally approaches reporting and recognition of what a “good” or rigorous QES look like are provided.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, ODKLJ, PILJ, PNG, SAZU, UILJ, UKNU, UL, UM, UPUK
The evaluation of interventions and policies designed to promote resilience, and research to understand the determinants and associations, require reliable and valid measures to ensure data quality. ...This paper systematically reviews the psychometric rigour of resilience measurement scales developed for use in general and clinical populations.
Eight electronic abstract databases and the internet were searched and reference lists of all identified papers were hand searched. The focus was to identify peer reviewed journal articles where resilience was a key focus and/or is assessed. Two authors independently extracted data and performed a quality assessment of the scale psychometric properties.
Nineteen resilience measures were reviewed; four of these were refinements of the original measure. All the measures had some missing information regarding the psychometric properties. Overall, the Connor-Davidson Resilience Scale, the Resilience Scale for Adults and the Brief Resilience Scale received the best psychometric ratings. The conceptual and theoretical adequacy of a number of the scales was questionable.
We found no current 'gold standard' amongst 15 measures of resilience. A number of the scales are in the early stages of development, and all require further validation work. Given increasing interest in resilience from major international funders, key policy makers and practice, researchers are urged to report relevant validation statistics when using the measures.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
A dedicated group of statistical reviewers was also established to handle these papers across the three journals. Since the publication of the joint Editorial (Jackson et al., 2021), we have closely ...monitored submissions, and in this Editorial, we provide an update on our experience with a particular focus on JAN where the new processes have been in place the longest. Submitting manuscripts as quantitative or mixed-methods studies and avoiding mentioning that the study design was actually a trial, presumably to avoid the requirements of registration. The longer-term goal needs to be raising author awareness about research misconduct and fraud and ensuring better compliance with journal eligibility criteria and the requirements of the AllTrials initiative.
Full text
Available for:
FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SAZU, SBCE, SBMB, UL, UM, UPUK, VSZLJ
The GRADE-CERQual ('Confidence in the Evidence from Reviews of Qualitative research') approach provides guidance for assessing how much confidence to place in findings from systematic reviews of ...qualitative research (or qualitative evidence syntheses). The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. Confidence in the evidence from qualitative evidence syntheses is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. CERQual provides a systematic and transparent framework for assessing confidence in individual review findings, based on consideration of four components: (1) methodological limitations, (2) coherence, (3) adequacy of data, and (4) relevance. A fifth component, dissemination (or publication) bias, may also be important and is being explored. As with the GRADE (Grading of Recommendations Assessment, Development, and Evaluation) approach for effectiveness evidence, CERQual suggests summarising evidence in succinct, transparent, and informative Summary of Qualitative Findings tables. These tables are designed to communicate the review findings and the CERQual assessment of confidence in each finding. This article is the first of a seven-part series providing guidance on how to apply the CERQual approach. In this paper, we describe the rationale and conceptual basis for CERQual, the aims of the approach, how the approach was developed, and its main components. We also outline the purpose and structure of this series and discuss the growing role for qualitative evidence in decision-making. Papers 3, 4, 5, 6, and 7 in this series discuss each CERQual component, including the rationale for including the component in the approach, how the component is conceptualised, and how it should be assessed. Paper 2 discusses how to make an overall assessment of confidence in a review finding and how to create a Summary of Qualitative Findings table. The series is intended primarily for those undertaking qualitative evidence syntheses or using their findings in decision-making processes but is also relevant to guideline development agencies, primary qualitative researchers, and implementation scientists and practitioners.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
The GRADE-CERQual (Grading of Recommendations Assessment, Development and Evaluation-Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE working ...group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision-making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) relevance, (3) coherence and (4) adequacy of data. This paper is part of a series providing guidance on how to apply CERQual and focuses on CERQual's coherence component.
We developed the coherence component by searching the literature for definitions, gathering feedback from relevant research communities and developing consensus through project group meetings. We tested the CERQual coherence component within several qualitative evidence syntheses before agreeing on the current definition and principles for application.
When applying CERQual, we define coherence as how clear and cogent the fit is between the data from the primary studies and a review finding that synthesises that data. In this paper, we describe the coherence component and its rationale and offer guidance on how to assess coherence in the context of a review finding as part of the CERQual approach. This guidance outlines the information required to assess coherence, the steps that need to be taken to assess coherence and examples of coherence assessments.
This paper provides guidance for review authors and others on undertaking an assessment of coherence in the context of the CERQual approach. We suggest that threats to coherence may arise when the data supporting a review finding are contradictory, ambiguous or incomplete or where competing theories exist that could be used to synthesise the data. We expect the CERQual approach, and its individual components, to develop further as our experiences with the practical implementation of the approach increase.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
A rapid review of gray literature from 2015 to 2016 was conducted to identify the lessons learned for emergency risk communication from recent outbreaks of Ebola, Zika, and yellow fever. Gray ...literature databases and key websites were searched and requests for documents were posted to expert networks. A total of 83 documents met inclusion criteria, 68 of which are cited in this report. This article focuses on the 3 questions, out of 12 posed by World Health Organization as part of a Guideline development process, dealing most directly with communicating risk during health emergencies: community engagement, trust building, and social media. Documents were evaluated for credibility using an Authority, Accuracy, Coverage, Objectivity, Date, Significance (AACODS) checklist? and if the document contained a study, a method-specific tool was applied. A rapid content analysis of included sources was undertaken with relevant text either extracted verbatim or summarized and mapped against the questions. A database subset was created for each question and citations were assigned to the subset(s) for which they contained relevant information. Multiple designations per document were common. Database subsets were used to synthesize the results into a coherent narrative.
The gray literature strongly underlines the central importance of local communities. A one-size-fits-all approach does not work. For maximum effectiveness, local communities need to be involved with and own emergency risk communication processes, preferably well before an emergency occurs. Social media can open new avenues for communication, but is not a general panacea and should not be viewed as a replacement for traditional modes of communication. In general, the gray literature indicates movement toward greater recognition of emergency risk communication as a vitally important element of public health.
Full text
Available for:
BFBNIB, NUK, PILJ, SAZU, UL, UM, UPUK
The GRADE-CERQual (Confidence in Evidence from Reviews of Qualitative research) approach has been developed by the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working ...Group. The approach has been developed to support the use of findings from qualitative evidence syntheses in decision making, including guideline development and policy formulation. CERQual includes four components for assessing how much confidence to place in findings from reviews of qualitative research (also referred to as qualitative evidence syntheses): (1) methodological limitations, (2) coherence, (3) adequacy of data and (4) relevance. This paper is part of a series providing guidance on how to apply CERQual and focuses on making an overall assessment of confidence in a review finding and creating a CERQual Evidence Profile and a CERQual Summary of Qualitative Findings table.
We developed this guidance by examining the methods used by other GRADE approaches, gathering feedback from relevant research communities and developing consensus through project group meetings. We then piloted the guidance on several qualitative evidence syntheses before agreeing on the approach.
Confidence in the evidence is an assessment of the extent to which a review finding is a reasonable representation of the phenomenon of interest. Creating a summary of each review finding and deciding whether or not CERQual should be used are important steps prior to assessing confidence. Confidence should be assessed for each review finding individually, based on the judgements made for each of the four CERQual components. Four levels are used to describe the overall assessment of confidence: high, moderate, low or very low. The overall CERQual assessment for each review finding should be explained in a CERQual Evidence Profile and Summary of Qualitative Findings table.
Structuring and summarising review findings, assessing confidence in those findings using CERQual and creating a CERQual Evidence Profile and Summary of Qualitative Findings table should be essential components of undertaking qualitative evidence syntheses. This paper describes the end point of a CERQual assessment and should be read in conjunction with the other papers in the series that provide information on assessing individual CERQual components.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
Keeping the health workforce and the public informed about the latest evolving health information during a health emergency is critical to preventing, detecting and responding to infectious disease ...outbreaks or other health emergencies. Having a well-informed, ready, willing, and skilled workforce and an informed public can help save lives, reduce diseases and suffering, and minimize socio-economic loss in affected communities and countries. Providing "just in time" support and opportunities for learning in health emergencies is much needed for capacity building. In this paper, 'learning intervention' refers to the provision of ad-hoc, focused, or personalized training sessions with the goal of preparing the health workers for emergencies or filling specific knowledge or skill gaps. We refer to 'training methods' as instructional design strategies used to teach someone the necessary knowledge and skills to perform a task. We conducted a scoping review to map and better understand what learning interventions and training methods have been used in different types of health emergencies and by whom. Studies were identified using six databases (Pubmed/Medline, Embase, Hinari, WorldCat, CABI and Web of Science) and by consulting with experts. Characteristics of studies were mapped and displayed and major topic areas were identified. Of the 319 records that were included, contexts most frequently covered were COVID-19, disasters in general, Ebola and wars. Four prominent topic areas were identified: 1) Knowledge acquisition, 2) Emergency plans, 3) Impact of the learning intervention, and 4) Training methods. Much of the evidence was based on observational methods with few trials, which likely reflects the unique context of each health emergency. Evolution of methods was apparent, particularly in virtual learning. Learning during health emergencies appeared to improve knowledge, general management of the situation, quality of life of both trainers and affected population, satisfaction and clinical outcomes. This is the first scoping review to map the evidence, which serves as a first step in developing urgently needed global guidance to further improve the quality and reach of learning interventions and training methods in this context.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
PDF
