The use of core outcome sets (COS) ensures that researchers measure and report those outcomes that are most likely to be relevant to users of their research. Several hundred COS projects have been ...systematically identified to date, but there has been no formal quality assessment of these studies. The Core Outcome Set-STAndards for Development (COS-STAD) project aimed to identify minimum standards for the design of a COS study agreed upon by an international group, while other specific guidance exists for the final reporting of COS development studies (Core Outcome Set-STAndards for Reporting COS-STAR).
An international group of experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives produced the COS-STAD recommendations to help improve the quality of COS development and support the assessment of whether a COS had been developed using a reasonable approach. An open survey of experts generated an initial list of items, which was refined by a 2-round Delphi survey involving nearly 250 participants representing key stakeholder groups. Participants assigned importance ratings for each item using a 1-9 scale. Consensus that an item should be included in the set of minimum standards was defined as at least 70% of the voting participants from each stakeholder group providing a score between 7 and 9. The Delphi survey was followed by a consensus discussion with the study management group representing multiple stakeholder groups. COS-STAD contains 11 minimum standards that are the minimum design recommendations for all COS development projects. The recommendations focus on 3 key domains: the scope, the stakeholders, and the consensus process.
The COS-STAD project has established 11 minimum standards to be followed by COS developers when planning their projects and by users when deciding whether a COS has been developed using reasonable methods.
Core outcome sets (COS) can enhance the relevance of research by ensuring that outcomes of importance to health service users and other people making choices about health care in a particular topic ...area are measured routinely. Over 200 COS to date have been developed, but the clarity of these reports is suboptimal. COS studies will not achieve their goal if reports of COS are not complete and transparent.
In recognition of these issues, an international group that included experienced COS developers, methodologists, journal editors, potential users of COS (clinical trialists, systematic reviewers, and clinical guideline developers), and patient representatives developed the Core Outcome Set-STAndards for Reporting (COS-STAR) Statement as a reporting guideline for COS studies. The developmental process consisted of an initial reporting item generation stage and a two-round Delphi survey involving nearly 200 participants representing key stakeholder groups, followed by a consensus meeting. The COS-STAR Statement consists of a checklist of 18 items considered essential for transparent and complete reporting in all COS studies. The checklist items focus on the introduction, methods, results, and discussion section of a manuscript describing the development of a particular COS. A limitation of the COS-STAR Statement is that it was developed without representative views of low- and middle-income countries. COS have equal relevance to studies conducted in these areas, and, subsequently, this guideline may need to evolve over time to encompass any additional challenges from developing COS in these areas.
With many ongoing COS studies underway, the COS-STAR Statement should be a helpful resource to improve the reporting of COS studies for the benefit of all COS users.
Summary The preceding papers in this Series have outlined how underuse and overuse of health-care services occur within a complex system of health-care production, with a multiplicity of causes. ...Because poor care is ubiquitous and has considerable consequences for the health and wellbeing of billions of people around the world, remedying this problem is a morally and politically urgent task. Universal health coverage is a key step towards achieving the right care. Therefore, full consideration of potential levers of change must include an upstream perspective—ie, an understanding of the system-level factors that drive overuse and underuse, as well as the various incentives at work during a clinical encounter. One example of a system-level factor is the allocation of resources (eg, hospital beds and clinicians) to meet the needs of a local population to minimise underuse or overuse. Another example is priority setting using tools such as health technology assessment to guide the optimum diffusion of safe, effective, and cost-effective health-care services. In this Series paper we investigate a range of levers for eliminating medical underuse and overuse. Some levers could operate effectively (and be politically viable) across many different health and political systems (eg, increase patient activation with decision support) whereas other levers must be tailored to local contexts (eg, basing coverage decisions on a particular cost-effectiveness ratio). Ideally, policies must move beyond the purely incremental; that is, policies that merely tinker at the policy edges after underuse or overuse arises. In this regard, efforts to increase public awareness, mobilisation, and empowerment hold promise as universal methods to reset all other contexts and thereby enhance all other efforts to promote the right care.
Several hundred core outcome set (COS) projects have been systematically identified to date which, if adopted, ensure that researchers measure and report those outcomes that are most likely to be ...relevant to users of their research. The uptake of a COS by COS users will depend in part on the transparency and robustness of the methods used in the COS development study, which would be increased by the use of a standardised protocol. This article describes the development of the COS-STAP (Core Outcome Set-STAndardised Protocol Items) Statement for the content of a COS development study protocol.
The COS-STAP Statement was developed following the Enhancing the Quality and Transparency Of Health Research (EQUATOR) Network's methodological framework for guideline development. This included an initial item generation stage, a two-round Delphi survey involving more than 150 participants representing three stakeholder groups (COS developers, journal editors and patient and public involvement researchers interested in COS development), followed by a consensus meeting with eight voting participants.
The COS-STAP Statement consists of a checklist of 13 items considered essential documentation in a protocol, outlining the scope of the COS, stakeholder involvement, COS development plans and consensus processes.
Journal editors and peer reviewers can use the guidance to assess the completeness of a COS development study protocol submitted for publication. By providing guidance for key content, the COS-STAP Statement will enhance the drafting of high-quality protocols and determine how the COS development study will be carried out.
Decision makers in health care are increasingly interested in using high-quality scientific evidence to support clinical and health policy choices; however, the quality of available scientific ...evidence is often found to be inadequate. Reliable evidence is essential to improve health care quality and to support efficient use of limited resources. The widespread gaps in evidence-based knowledge suggest that systematic flaws exist in the production of scientific evidence, in part because there is no consistent effort to conduct clinical trials designed to meet the needs of decision makers. Clinical trials for which the hypothesis and study design are developed specifically to answer the questions faced by decision makers are called pragmatic or practical clinical trials (PCTs). The characteristic features of PCTs are that they (1) select clinically relevant alternative interventions to compare, (2) include a diverse population of study participants, (3) recruit participants from heterogeneous practice settings, and (4) collect data on a broad range of health outcomes. The supply of PCTs is limited primarily because the major funders of clinical research, the National Institutes of Health and the medical products industry, do not focus on supporting such trials. Increasing the supply of PCTs will depend on the development of a mechanism to establish priorities for these studies, significant expansion of an infrastructure to conduct clinical research within the health care delivery system, more reliance on high-quality evidence by health care decision makers, and a substantial increase in public and private funding for these studies. For these changes to occur, clinical and health policy decision makers will need to become more involved in all aspects of clinical research, including priority setting, infrastructure development, and funding.
Doctors, patients, and other decision makers need access to the best available clinical evidence, which can come from systematic reviews, experimental trials, and observational research. Despite ...methodological challenges, high-quality observational studies have an important role in comparative effectiveness research because they can address issues that are otherwise difficult or impossible to study. In addition, many clinical and policy decisions do not require the very high levels of certainty provided by large, rigorous randomized trials. This paper provides insights and a framework to guide good decision making that involves the full range of high-quality comparative effectiveness research techniques, including observational research.
In this project, we set out to identify ways to increase the uptake of core outcome sets in clinical research. In doing so, we uncovered a growing recognition, across many different health care ...sectors, of the need for common, relevant outcomes to improve the quality of decision-making. This has led to a plethora of projects, initiatives, and new organizations all intended to develop standardized outcomes and outcome measures for their particular fields. However, the standardized outcome sets developed across siloed initiatives do not carry over to other sectors, such as from research to quality of care. This trend has the potential to lead to confusion and unintended redundancies, as well as wasteful use of both financial and intellectual resources. Better communication and collaboration among different initiatives, and more deliberate alignments of initiative scopes, are needed to ensure a future paradigm in which standards align across contexts where possible and differ for understandable and transparent reasons.
Examining the patient's subjective experience in prospective clinical comparative effectiveness research (CER) of oncology treatments or process interventions is essential for informing decision ...making. Patient-reported outcome (PRO) measures are the standard tools for directly eliciting the patient experience. There are currently no widely accepted standards for developing or implementing PRO measures in CER. Recommendations for the design and implementation of PRO measures in CER were developed via a standardized process including multistakeholder interviews, a technical working group, and public comments. Key recommendations are to include assessment of patient-reported symptoms as well as health-related quality of life in all prospective clinical CER studies in adult oncology; to identify symptoms relevant to a particular study population and context based on literature review and/or qualitative and quantitative methods; to assure that PRO measures used are valid, reliable, and sensitive in a comparable population (measures particularly recommended include EORTC QLQ-C30, FACT, MDASI, PRO-CTCAE, and PROMIS); to collect PRO data electronically whenever possible; to employ methods that minimize missing patient reports and include a plan for analyzing and reporting missing PRO data; to report the proportion of responders and cumulative distribution of responses in addition to mean changes in scores; and to publish results of PRO analyses simultaneously with other clinical outcomes. Twelve core symptoms are recommended for consideration in studies in advanced or metastatic cancers. Adherence to methodologic standards for the selection, implementation, and analysis/reporting of PRO measures will lead to an understanding of the patient experience that informs better decisions by patients, providers, regulators, and payers.
PDF
