The effectiveness of complex interventions, as well as their success in reaching relevant populations, is critically influenced by their implementation in a given context. Current conceptual ...frameworks often fail to address context and implementation in an integrated way and, where addressed, they tend to focus on organisational context and are mostly concerned with specific health fields. Our objective was to develop a framework to facilitate the structured and comprehensive conceptualisation and assessment of context and implementation of complex interventions.
The Context and Implementation of Complex Interventions (CICI) framework was developed in an iterative manner and underwent extensive application. An initial framework based on a scoping review was tested in rapid assessments, revealing inconsistencies with respect to the underlying concepts. Thus, pragmatic utility concept analysis was undertaken to advance the concepts of context and implementation. Based on these findings, the framework was revised and applied in several systematic reviews, one health technology assessment (HTA) and one applicability assessment of very different complex interventions. Lessons learnt from these applications and from peer review were incorporated, resulting in the CICI framework.
The CICI framework comprises three dimensions-context, implementation and setting-which interact with one another and with the intervention dimension. Context comprises seven domains (i.e., geographical, epidemiological, socio-cultural, socio-economic, ethical, legal, political); implementation consists of five domains (i.e., implementation theory, process, strategies, agents and outcomes); setting refers to the specific physical location, in which the intervention is put into practise. The intervention and the way it is implemented in a given setting and context can occur on a micro, meso and macro level. Tools to operationalise the framework comprise a checklist, data extraction tools for qualitative and quantitative reviews and a consultation guide for applicability assessments.
The CICI framework addresses and graphically presents context, implementation and setting in an integrated way. It aims at simplifying and structuring complexity in order to advance our understanding of whether and how interventions work. The framework can be applied in systematic reviews and HTA as well as primary research and facilitate communication among teams of researchers and with various stakeholders.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
The complexity associated with how interventions result—or fail to result—in outcomes and how context matters is increasingly recognised. Logic models provide an important tool for handling ...complexity, with contrasting uses in programme evaluation and evidence synthesis. To reconcile these, we developed an approach that combines the strengths of both traditions, propose a taxonomy of logic models, and provide guidance on how to choose between approaches and types of logic models in systematic reviews and health technology assessments (HTA).
The taxonomy distinguishes 3 approaches (a priori, staged, and iterative) and 2 types (systems‐based and process‐orientated) of logic models. An a priori logic model is specified at the start of the systematic review/HTA and remains unchanged. With a staged logic model, the reviewer prespecifies several points, at which major data inputs require a subsequent version. An iterative logic model is continuously modified throughout the systematic review/HTA process. System‐based logic models describe the system, in which the interaction between participants, intervention, and context takes place; process‐orientated models display the causal pathways leading from the intervention to multiple outcomes.
The proposed taxonomy of logic models offers an improved understanding of the advantages and limitations of logic models across the spectrum from a priori to fully iterative approaches. Choice of logic model should be informed by scope of evidence synthesis, presence/absence of clearly defined population, intervention, comparison, outcome (PICO) elements, and feasibility considerations. Applications across distinct interventions and methodological approaches will deliver good practice case studies and offer further insights on the choice and implementation of logic modelling approaches.
Full text
Available for:
FZAB, GIS, IJS, KILJ, NLZOH, NUK, OILJ, SBCE, SBMB, UL, UM, UPUK
The importance of respecting patients' preferences when making treatment decisions is increasingly recognized. Efficiently retrieving papers from the scientific literature reporting on the presence ...and nature of such preferences can help to achieve this goal. The objective of this study was to create a search filter for PubMed to help retrieve evidence on patient preferences for treatment outcomes.
A total of 27 journals were hand-searched for articles on patient preferences for treatment outcomes published in 2011. Selected articles served as a reference set. To develop optimal search strategies to retrieve this set, all articles in the reference set were randomly split into a development and a validation set. MeSH-terms and keywords retrieved using PubReMiner were tested individually and as combinations in PubMed and evaluated for retrieval performance (e.g. sensitivity (Se) and specificity (Sp)).
Of 8238 articles, 22 were considered to report empirical evidence on patient preferences for specific treatment outcomes. The best search filters reached Se of 100 % 95 % CI 100-100 with Sp of 95 % 94-95 % and Sp of 97 % 97-98 % with 75 % Se 74-76 %. In the validation set these queries reached values of Se of 90 % 89-91 % with Sp 94 % 93-95 % and Se of 80 % 79-81 % with Sp of 97 % 96-96 %, respectively.
Narrow and broad search queries were developed which can help in retrieving literature on patient preferences for treatment outcomes. Identifying such evidence may in turn enhance the incorporation of patient preferences in clinical decision making and health technology assessment.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Feminismen heute Yvonne Franke, Kati Mozygemba, Kathleen Pöge, Bettina Ritter, Dagmar Venohr / Yvonne Franke, Kati Mozygemba, Kathleen Pöge, Bettina Ritter, Dagmar Venohr
2014, 201412
eBook
Im Fokus des Bandes stehen aktuelle feministische Positionen. Die Beiträge bieten Einblicke in ausgewählte Forschungsbereiche, Themenfelder sowie Aktionsformen und fragen nach inhaltlichen ...Überschneidungen und möglicher feministischer Solidarität. Theoretische Beiträge wie beispielsweise von Maureen Maisha Eggers und Sabine Mohamed zum Schwarzen feministischen Denken, Frigga Haug zu marxistisch-feministischen Ansätzen oder von Karen Wagels zu queerfeministischen Positionen stehen dabei gleichberechtigt neben Beiträgen, die aus feministischen Themenfeldern und Praxen berichten.Frauengesundheitspolitik, wendo und die Frauenhausbewegung als eher klassische feministische Felder werden ebenso beleuchtet wie die Möglichkeiten des Web 2.0, mit denen sich Kübra Gümüsay und Nadia Shehadeh beschäftigen. Feministische Künstler*innen und Aktivist*innen wie Sookee, Bernadette LaHengst oder Kerstin und Sandra Grether erweitern das Spektrum durch ihre künstlerischen Ausdrucksformen.
To compare and contrast different methods of qualitative evidence synthesis (QES) against criteria identified from the literature and to map their attributes to inform selection of the most ...appropriate QES method to answer research questions addressed by qualitative research.
Electronic databases, citation searching, and a study register were used to identify studies reporting QES methods. Attributes compiled from 26 methodological papers (2001–2014) were used as a framework for data extraction. Data were extracted into summary tables by one reviewer and then considered within the author team.
We identified seven considerations determining choice of methods from the methodological literature, encapsulated within the mnemonic Review question–Epistemology–Time/Timescale–Resources–Expertise–Audience and purpose–Type of data. We mapped 15 different published QES methods against these seven criteria. The final framework focuses on stand-alone QES methods but may also hold potential when integrating quantitative and qualitative data.
These findings offer a contemporary perspective as a conceptual basis for future empirical investigation of the advantages and disadvantages of different methods of QES. It is hoped that this will inform appropriate selection of QES approaches.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NLZOH, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UL, UM, UPCLJ, UPUK, ZRSKP
The evaluation of complex interventions such as palliative care is challenging. Methods guidance such as the guidance documents of the Integrated Health Technology Assessment for the Evaluation of ...Complex Technologies (INTEGRATE-HTA) project help address specific challenges. The INTEGRATE-guidance was developed cooperatively by various international stakeholders and it was applied in a case study on palliative care. The presented study was part of the INTEGRATE-HTA project. ObjectivesThe objective was to identify important assessment aspects of palliative care in Germany from the perspective of patients, relatives and professional providers.
Applying the structured consensus method of the Improved Nominal Group Technique, we conducted interviews with two focus groups - one with relatives and one with professionals. Additionally, we conducted 4 interviews with patients. We used an open coding procedure to analyze the data and a dialogical approach to validate the results.
8 assessment aspects were found to be important. These are the definition and legitimacy of the term benefit, understanding of palliative care, patient-centered and holistic care approach, access to palliative care, continuity and flexibility of care, education of palliative care providers, and multidisciplinary approach. A central point was the need to address the intervention in its complexity and to include interactions between the different components.
To be able to integrate various models and different perspectives of palliative care, it is important to have the involvement of different stakeholders. This also enhances the incorporation of important aspects during the development of assessment instruments.
Context and implementation of health interventions have received increasing attention over the past decade, in particular with respect to their influence on the effectiveness and reach of complex ...interventions. The underlying concepts are both considered partially mature, limiting their operationalization in research and practice. We conducted systematic literature searches and pragmatic utility (PU) concept analyses to provide a state-of-the-art assessment of the concepts of “context” and “implementation” in the health sciences to create a common understanding for their use within systematic reviews and HTA.
We performed two separate searches, one for context (EMBASE, MEDLINE) and the other for implementation (Google Scholar) to identify relevant models, theories and frameworks. 17 publications on context and 35 articles on implementation met our inclusion criteria. PU concept analysis comprises three guiding principles: selection of the literature, organization and structuring of the literature, and asking analytic questions of the literature. Both concepts were analyzed according to four features of conceptual maturity, i.e., consensual definitions, clear characteristics, fully described preconditions and outcomes, and delineated boundaries.
Context and implementation are highly intertwined, with both concepts influencing and interacting with each other. Context is defined as a set of characteristics and circumstances that surround the implementation effort. Implementation is conceptualized as a planned and deliberately initiated effort with the intention to put an intervention into practice. The concept of implementation presents largely consensual definitions and relatively well-defined boundaries, while distinguishing features, preconditions and outcomes are not yet fully articulated. In contrast, definitions of context vary widely, and boundaries with neighbouring concepts, such as setting and environment, are blurred; characteristics, preconditions and outcomes are ill-defined. Therefore, the maturity of both concepts should be further improved to facilitate operationalization in systematic reviews and HTAs.
Dem Kontext und der Implementierung von Gesundheitsinterventionen wurde während des vergangenen Jahrzehnts erhöhte Aufmerksamkeit zuteil - insbesondere was den Einfluss auf Effektivität und Reichweite komplexer Interventionen anbelangt. Dem aktuellen Forschungsstand nach können beide zugrunde liegenden Konzepte als noch nicht voll ausdifferenziert betrachtet werden, was sich negativ auf die Operationalisierung in Forschung und Praxis auswirkt. Um dem entgegenzuwirken, wurde eine systematische Literatursuche sowie eine „Pragmatic-Utility-“ (PU-) Konzeptanalyse durchgeführt, die die Verwendung beider Konzepte in den Gesundheitswissenschaften darstellen soll. Übergeordnetes Ziel ist es, durch den Austausch über die unterschiedlichen Konzeptualisierungen ein gemeinsames Verständnis beider Konzepte in systematischen Reviews und Health Technology Assessments (HTAs) zu schaffen. Es wurden jeweils zwei separate Suchen für Kontext (EMBASE, MEDLINE) und Implementierung (Google Scholar) durchgeführt, um relevante Modelle, Theorien und Frameworks zu identifizieren. Dabei stimmten 17 Publikationen zu Kontext und 35 zu Implementierung mit unseren Einschlusskriterien überein. Die Literatur wurde den drei Grundprinzipien der PU folgend (1) ausgewählt, (2) organisiert und strukturiert sowie (3) analytischen Fragen unterworfen. Zudem wurden beide Konzepte bezüglich vier vordefinierter Kriterien von konzeptioneller Reife analysiert (übereinstimmende Definitionen, klare Charakteristika, vollständig umschriebene Vorbedingungen und Ergebnisse sowie eindeutige Grenzen). Die Analyse zeigt, dass Kontext und Implementierung zwei stark miteinander verflochtene Konzepte sind, die interagieren. Kontext bezieht sich dabei auf die einen Implementierungsversuch umgebenden Charakteristika und Umstände. Implementierung hingegen wird als geplante und bewusst initiierte Anstrengung verstanden, die darauf abzielt, eine Intervention in die Praxis zu überführen. Das Konzept der Implementierung zeichnet sich durch größtenteils übereinstimmende Definitionen sowie relativ klar definierte Grenzen gegenüber anderen Konzepten aus, wohingegen abgrenzende Eigenschaften, Vorbedingungen sowie dem Konzept folgende Ergebnisse noch nicht ausreichend artikuliert sind. Im Gegensatz dazu variieren die Definitionen von Kontext stark, wodurch eine Abgrenzung von benachbarten Konzepten wie Setting und Umwelt erschwert wird; auch sind die Charakteristika, Vorbedingungen sowie Ergebnisse des Konzepts unklar. Beide Konzepte sollten dahingehend weiterentwickelt werden, dass sie eine einheitliche Verwendung in systematischen Reviews, HTAs sowie in der Praxis erleichtern.
Full text
Available for:
GEOZS, IJS, IMTLJ, KILJ, KISLJ, NUK, OILJ, PNG, SAZU, SBCE, SBJE, UL, UM, UPCLJ, UPUK
Objectives: The INTEGRATE-HTA project provided methodology to evaluate complex technologies. This study provides guidance on how to retrieve and critically appraise available evidence on moderators ...and predictors of treatment effects and on patient preferences for treatment outcomes as a source of complexity.
Methods: Search filters for PubMed were developed by hand-searching a large volume of articles reporting on relevant aspects. Search terms were retrieved from selected papers and algorithmically combined to find the optimal combination of search terms. For the development of the appraisal checklists literature was searched in PubMed and Google Scholar together with citation chasing. For the CHecklist for the Appraisal of Moderators and Predictors (CHAMP) a Delphi procedure was used to value a set of eligible appraisal criteria retrieved from the literature.
Results: Search filters were developed optimized for different accuracy measures. The final version of CHAMP consists of a seventeen questions covering the design, analysis, results and transferability of results of moderator and predictor analysis. The final checklist for appraisal of literature on patient preferences for treatment outcomes consist of six questions meant to help the user to identify relevant quality issues together with a guidance toward existing tools concerning the appraisal of specific preference elicitation methods.
Conclusions: Incorporating knowledge on subgroups for whom a specific treatment will produce more benefit holds the promise of better targeting and, ultimately, enhancing overall effectiveness and efficiency of healthcare technology. Finally, incorporating information on preferences for treatment outcomes will foster health technology assessment that addresses outcomes that are important to patients.
Background:
Stakeholders are people with an interest in a topic. Internationally, stakeholder involvement in palliative care research and health technology assessment requires development. ...Stakeholder involvement adds value throughout research (from prioritising topics to disseminating findings). Philosophies and understandings about the best ways to involve stakeholders in research differ internationally. Stakeholder involvement took place in seven countries (England, Germany, Italy, Lithuania, the Netherlands, Norway and Poland). Findings informed a project that developed concepts and methods for health technology assessment and applied these to evaluate models of palliative care service delivery.
Aims:
To report on stakeholder involvement in the INTEGRATE-HTA project and how issues identified informed project development.
Design:
Using stakeholder consultation or a qualitative research design, as appropriate locally, stakeholders in seven countries acted as ‘advisors’ to aid researchers’ decision making. Thematic analysis was used to identify key issues across countries.
Setting/participants:
A total of 132 stakeholders (82 professionals and 50 ‘lay’ people) aged ⩾18 participated in individual face-to-face or telephone interviews, consultation meetings or focus groups.
Results:
Different stakeholder involvement methods were used successfully to identify key issues in palliative care. A total of 23 issues common to three or more countries informed decisions about the intervention and comparator of interest, sub questions and specific assessments within the health technology assessment.
Conclusion:
Stakeholders, including patients and families undergoing palliative care, can inform project decision making using various involvement methods according to the local context. Researchers should consider local understandings about stakeholder involvement as views of appropriate and feasible methods vary. Methods for stakeholder involvement, especially consultation, need further development.
Full text
Available for:
NUK, OILJ, SAZU, UKNU, UL, UM, UPUK
Objectives: Despite recent development of health technology assessment (HTA) methods, there are still methodological gaps for the assessment of complex health technologies. The INTEGRATE-HTA guidance ...for effectiveness, economic, ethical, socio-cultural, and legal aspects, deals with challenges when assessing complex technologies, such as heterogeneous study designs, multiple stakeholder perspectives, and unpredictable outcomes. The objective of this article is to outline this guidance and describe the added value of integrating these assessment aspects.
Methods: Different methods were used to develop the various parts of the guidance, but all draw on existing, published knowledge and were supported by stakeholder involvement. The guidance was modified after application in a case study and in response to feedback from internal and external reviewers.
Results: The guidance consists of five parts, addressing five core aspects of HTA, all presenting stepwise approaches based on the assessment of complexity, context, and stakeholder involvement. The guidance on effectiveness, health economics and ethics aspects focus on helping users choose appropriate, or further develop, existing methods. The recommendations are based on existing methods’ applicability for dealing with problems arising with complex interventions. The guidance offers new frameworks to identify socio-cultural and legal issues, along with overviews of relevant methods and sources.
Conclusions: The INTEGRATE-HTA guidance outlines a wide range of methods and facilitates appropriate choices among them. The guidance enables understanding of how complexity matters for HTA and brings together assessments from disciplines, such as epidemiology, economics, ethics, law, and social theory. This indicates relevance for a broad range of technologies.
PDF
