This article describes the initial validation of the Diagnostic Assessment Research Tool (DART), a modular semistructured interview to facilitate diagnosis of various disorders among adults ...corresponding with the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5). In this study, the construct, convergent, and discriminant validity of DART modules for anxiety disorders, depressive disorders, obsessive-compulsive disorder, posttraumatic stress disorder, and substance-related and addictive disorders was assessed among a sample of 610 participants in a clinical outpatient setting. The data indicated excellent construct validity among DART modules assessed. Individuals with and without DSM-5 diagnoses identified via the DART had significant between-group differences on self-report measures corresponding to these diagnoses. Follow-up logistic regressions supported convergent validity for all diagnostic categories assessed. Discriminant validity was established for the majority of diagnostic categories assessed. High rates of interrater agreement in a small subsample (n = 15) were observed for the various diagnostic categories of the DART (88% average agreement). The results of the present study provide initial support for the DART as a useful tool to aid in the assessment of several major diagnostic categories corresponding with DSM-5 disorders.
Public Significance Statement
This study describes the development of an interview to help clinicians and researchers identify mental health disorders, which was then studied among 610 patients in a mental health clinic. Strong statistical support for the interview was observed, demonstrating its usefulness and efficiency for identifying mental health disorders when administered by clinicians of various mental health backgrounds.
Low front-end cost and rapid accrual make Web-based surveys and enrolment in studies attractive, but participants are often self-selected with little reference to a well-defined study base. Of ...course, high quality studies must be internally valid (validity of inferences for the sample at hand), but Web-based enrolment reactivates discussion of external validity (generalization of within-study inferences to a target population or context) in epidemiology and clinical trials. Survey research relies on a representative sample produced by a sampling frame, prespecified sampling process and weighting that maps results to an intended population. In contrast, recent analytical epidemiology has shifted the focus away from survey-type representativity to internal validity in the sample. Against this background, it is a good time for statisticians to take stock of our role and position regarding surveys, observational research in epidemiology and clinical studies. The central issue is whether conditional effects in the sample (the study population) may be transported to desired target populations. Success depends on compatibility of causal structures in study and target populations, and will require subject matter considerations in each concrete case. Statisticians, epidemiologists and survey researchers should work together to increase understanding of these challenges and to develop improved tools to handle them.
The Buddhist construct of mindfulness is a central element of mindfulness-based interventions and derives from an age-old systematic phenomenological program to investigate subjective experience. ...Recent enthusiasm for "mindfulness" in psychology has resulted in proliferation of self-report inventories that purport to measure mindful awareness as a trait. This paper addresses a number of intractable issues regarding these scales, in general, and also specifically highlights vulnerabilities of the adult and adolescent forms of the Mindfulness Attention Awareness Scale. These problems include (a) lack of available external referents for determining the construct validity of these inventories, (b) inadequacy of content validity of measures, (c) lack of evidence that self-reports of mindfulness competencies correspond to actual behavior and evidence that they do not, (d) lack of convergent validity among different mindfulness scales, (e) inequivalence of semantic item interpretation among different groups, (f) response biases related to degree of experience with mindfulness practice, (g) conflation of perceived mindfulness competencies with valuations of importance or meaningfulness, and (h) inappropriateness of samples employed to validate questionnaires. Current self-report attempts to measure mindfulness may serve to denature, distort, and banalize the meaning of mindful awareness in psychological research and may adversely affect further development of mindfulness-based interventions. Opportunities to enrich positivist Western psychological paradigms with a detailed and complex Buddhist phenomenology of the mind are likely to require a depth of understanding of mindfulness that, in turn, depends upon direct and long-term experience with mindfulness practice. Psychologists should consider pursuing this avenue before attempting to characterize and quantify mindfulness.
In this update of Clark and Watson (1995), we provide a synopsis of major points of our earlier article and discuss issues in scale construction that have become more salient as clinical and ...personality assessment has progressed over the past quarter-century. It remains true that the primary goal of scale development is to create valid measures of underlying constructs and that Loevinger's theoretical scheme provides a powerful model for scale development. We still discuss practical issues to help developers maximize their measures' construct validity, reiterating the importance of (a) clear conceptualization of target constructs, (b) an overinclusive initial item pool, (c) paying careful attention to item wording, (d) testing the item pool against closely related constructs, (e) choosing validation samples thoughtfully, and (f) emphasizing unidimensionality over internal consistency. We have added (g) consideration of the hierarchical structures of personality and psychopathology in scale development, discussion of (h) codeveloping scales in the context of these structures, (i) "orphan," and "interstitial" constructs, which do not fit neatly within these structures, (j) problems with "conglomerate" constructs, and (k) developing alternative versions of measures, including short forms, translations, informant versions, and age-based adaptations. Finally, we have expanded our discussions of (l) item-response theory and of external validity, emphasizing (m) convergent and discriminant validity, (n) incremental validity, and (o) cross-method analyses, such as questionnaires and interviews. We conclude by reaffirming that all mature sciences are built on the bedrock of sound measurement and that psychology must redouble its efforts to develop reliable and valid measures.
Public Significance Statement
Over the past 50 years, our understanding has greatly increased regarding how various psychological problems are interrelated and how they relate to various aspects of personality. In this context, this article describes a "best practice" process and relevant specific issues for developing measures to assess personality and psychological problems.
The advent of wearable sensor technologies has the potential to transform organizational research by offering the unprecedented opportunity to collect continuous, objective, highly granular data over ...extended time periods. Recent evidence has demonstrated the potential utility of Bluetooth-enabled sensors, specifically, in identifying emergent networks via colocation signals in highly controlled contexts with known distances and groups. Although there is proof of concept that wearable Bluetooth sensors may be able to contribute to organizational research in highly controlled contexts, to date there has been no explicit psychometric construct validation effort dedicated to these sensors in field settings. Thus, the two studies described here represent the first attempt to formally evaluate longitudinal Bluetooth data streams generated in field settings, testing their ability to (a) show convergent validity with respect to traditional self-reports of relational data; (b) display discriminant validity with respect to qualitative differences in the nature of alternative relationships (i.e., advice vs. friendship); (c) document predictive validity with respect to performance; (d) decompose variance in network-related measures into meaningful within- and between-unit variability over time; and (e) complement retrospective self-reports of time spent with different groups where there is a "ground truth" criterion. Our results provide insights into the validity of Bluetooth signals with respect to capturing variables traditionally studied in organizational science and highlight how the continuous data collection capabilities made possible by wearable sensors can advance research far beyond that of the static perspectives imposed by traditional data collection strategies.
Further Validation of the IDAS Watson, David; O'Hara, Michael W; Chmielewski, Michael ...
Psychological assessment,
09/2008, Letnik:
20, Številka:
3
Journal Article
Recenzirano
The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS;
D. Watson et al., 2007
) in 2 samples (306 college students and 605 psychiatric patients). The IDAS ...scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to
Diagnostic and Statistical Manual of Mental Disorders
(4th ed.;
DSM-IV
;
American Psychiatric Association, 1994
) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several
DSM-IV
diagnoses when compared against the Beck Depression Inventory-II (
A. T. Beck, R. A. Steer, & G. K. Brown, 1996
) and the Beck Anxiety Inventory (
A. T. Beck & R. A. Steer, 1990
).
The current article enhances the test validation process by addressing important issues with the quantifying construct validity (QCV) procedure. The QCV procedure is intended to help researchers ...systematically and objectively evaluate the degree to which a pattern of convergent and discriminant validity correlations correspond to a priori hypotheses. Although the QCV procedure holds promise as a psychometric tool and has enjoyed some use, at least three factors have likely limited the frequency and accuracy of its use—questions regarding its role and utility in test validation, a lack of clarity about its key concepts, and a lack of integration with widely available statistical software. We address these important issues and provide psychometrically grounded recommendations for applying the QCV procedure. This work facilitates the understanding, computation, and useful application of the QCV procedure, and ultimately it is intended to enhance work in test validation.
How to develop a condition‐specific PROM Comins, Jonathan D.; Brodersen, John; Siersma, Volkert ...
Scandinavian journal of medicine & science in sports,
June 2021, 2021-Jun, 2021-06-00, 20210601, Letnik:
31, Številka:
6
Journal Article
Recenzirano
Developing new patient‐reported outcome measures (PROMs) for application in clinical studies can be necessary if an adequate PROM does not exist. For adequate measurement, it is essential that the ...PROM has face validity (ie, is perceived to be relevant by clinicians and researchers) and has high content validity (ie, content relevance and content coverage for the targeted patient group). The steps needed to create PROMs that possess face and content validity for a specific condition are described in this paper. Face validity is achieved by item identification and generation through literature review. Content validity is confirmed through repetitive cognitive interviews of patients from the targeted patient group in order to generate a consensus‐based pilot‐version of the new PROM. This qualitative process ensures that items are appropriately worded, understandable, and minimizes doubts about how items should be answered. A practical example of this process is presented, which shows the development of the Knee Numeric‐Entity Evaluation Score (KNEES‐ACL), a condition‐specific PROM for patients with deficiency of the anterior cruciate ligament (ACL).
Scholarly interest in workaholism has increased dramatically in recent years. This research has underscored the detrimental effects of workaholism for employees, their families, and the organizations ...that employ them. Despite drastic improvements in the quality of studies examining workaholism over the past several decades, researchers continue to almost exclusively rely on older measures of workaholism or new measures derived from these original measures. In the present study, we outline why a new measure is needed and propose a multidimensional conceptualization of workaholism that encompasses motivational, cognitive, emotional, and behavioral dimensions. We then develop and validate a new multidimensional measure of workaholism: the Multidimensional Workaholism Scale (MWS). Evidence from 5 samples representing individuals working in a wide variety of occupations and industries throughout the United States (total N = 1,252) provides support that (a) our proposed 4-factor structure replicates and fits better than alternative models; (b) the measure demonstrates high reliability and content validity; (c) the measure demonstrates evidence for convergent and discriminant validity with constructs in workaholism's nomological network; (d) the measure demonstrates incremental validity in the prediction of important outcomes over and above prior measures of workaholism; and (e) the different dimensions demonstrate incremental validity in the prediction of specific outcomes over and above other dimensions of the MWS. Overall, results from the present study suggest that the MWS is a reliable and valid measure that can advance a more nuanced approach to research and practice relating to workaholism.
Several reviews have been critical of the degree to which scales in industrial/organizational psychology and organizational behavior adequately reflect the content of their construct. One potential ...reason for that circumstance is a tendency for scholars to focus less on content validation than on other validation methods (e.g., establishing reliability, performing convergent, discriminant, and criterion-related validation, and examining factor structure). We provide clear evaluation criteria for 2 commonly used content validation approaches: Anderson and Gerbing (1991) and Hinkin and Tracey (1999). To create those guidelines, we gathered all new scales introduced in Journal of Applied Psychology, Academy of Management Journal, Personnel Psychology, and Organizational Behavior and Human Decision Processes from 2010 to 2016. We then subjected those 112 scales to Anderson and Gerbing's (1991) and Hinkin and Tracey's (1999) approaches using 6,240 participants from Amazon's Mechanical Turk with detailed, transparent, and replicable instructions. For both approaches, our results provide evaluation criteria for definitional correspondence-the degree to which a scale's items correspond to the construct's definition-and definitional distinctiveness-the degree to which a scale's items correspond more to the construct's definition than to the definitions of other orbiting constructs.
PDF
