The Buddhist construct of mindfulness is a central element of mindfulness-based interventions and derives from an age-old systematic phenomenological program to investigate subjective experience. ...Recent enthusiasm for "mindfulness" in psychology has resulted in proliferation of self-report inventories that purport to measure mindful awareness as a trait. This paper addresses a number of intractable issues regarding these scales, in general, and also specifically highlights vulnerabilities of the adult and adolescent forms of the Mindfulness Attention Awareness Scale. These problems include (a) lack of available external referents for determining the construct validity of these inventories, (b) inadequacy of content validity of measures, (c) lack of evidence that self-reports of mindfulness competencies correspond to actual behavior and evidence that they do not, (d) lack of convergent validity among different mindfulness scales, (e) inequivalence of semantic item interpretation among different groups, (f) response biases related to degree of experience with mindfulness practice, (g) conflation of perceived mindfulness competencies with valuations of importance or meaningfulness, and (h) inappropriateness of samples employed to validate questionnaires. Current self-report attempts to measure mindfulness may serve to denature, distort, and banalize the meaning of mindful awareness in psychological research and may adversely affect further development of mindfulness-based interventions. Opportunities to enrich positivist Western psychological paradigms with a detailed and complex Buddhist phenomenology of the mind are likely to require a depth of understanding of mindfulness that, in turn, depends upon direct and long-term experience with mindfulness practice. Psychologists should consider pursuing this avenue before attempting to characterize and quantify mindfulness.
Further Validation of the IDAS Watson, David; O'Hara, Michael W; Chmielewski, Michael ...
Psychological assessment,
09/2008, Letnik:
20, Številka:
3
Journal Article
Recenzirano
The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS;
D. Watson et al., 2007
) in 2 samples (306 college students and 605 psychiatric patients). The IDAS ...scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to
Diagnostic and Statistical Manual of Mental Disorders
(4th ed.;
DSM-IV
;
American Psychiatric Association, 1994
) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several
DSM-IV
diagnoses when compared against the Beck Depression Inventory-II (
A. T. Beck, R. A. Steer, & G. K. Brown, 1996
) and the Beck Anxiety Inventory (
A. T. Beck & R. A. Steer, 1990
).
The current article enhances the test validation process by addressing important issues with the quantifying construct validity (QCV) procedure. The QCV procedure is intended to help researchers ...systematically and objectively evaluate the degree to which a pattern of convergent and discriminant validity correlations correspond to a priori hypotheses. Although the QCV procedure holds promise as a psychometric tool and has enjoyed some use, at least three factors have likely limited the frequency and accuracy of its use—questions regarding its role and utility in test validation, a lack of clarity about its key concepts, and a lack of integration with widely available statistical software. We address these important issues and provide psychometrically grounded recommendations for applying the QCV procedure. This work facilitates the understanding, computation, and useful application of the QCV procedure, and ultimately it is intended to enhance work in test validation.
How to develop a condition‐specific PROM Comins, Jonathan D.; Brodersen, John; Siersma, Volkert ...
Scandinavian journal of medicine & science in sports,
June 2021, 2021-Jun, 2021-06-00, 20210601, Letnik:
31, Številka:
6
Journal Article
Recenzirano
Developing new patient‐reported outcome measures (PROMs) for application in clinical studies can be necessary if an adequate PROM does not exist. For adequate measurement, it is essential that the ...PROM has face validity (ie, is perceived to be relevant by clinicians and researchers) and has high content validity (ie, content relevance and content coverage for the targeted patient group). The steps needed to create PROMs that possess face and content validity for a specific condition are described in this paper. Face validity is achieved by item identification and generation through literature review. Content validity is confirmed through repetitive cognitive interviews of patients from the targeted patient group in order to generate a consensus‐based pilot‐version of the new PROM. This qualitative process ensures that items are appropriately worded, understandable, and minimizes doubts about how items should be answered. A practical example of this process is presented, which shows the development of the Knee Numeric‐Entity Evaluation Score (KNEES‐ACL), a condition‐specific PROM for patients with deficiency of the anterior cruciate ligament (ACL).
Scholarly interest in workaholism has increased dramatically in recent years. This research has underscored the detrimental effects of workaholism for employees, their families, and the organizations ...that employ them. Despite drastic improvements in the quality of studies examining workaholism over the past several decades, researchers continue to almost exclusively rely on older measures of workaholism or new measures derived from these original measures. In the present study, we outline why a new measure is needed and propose a multidimensional conceptualization of workaholism that encompasses motivational, cognitive, emotional, and behavioral dimensions. We then develop and validate a new multidimensional measure of workaholism: the Multidimensional Workaholism Scale (MWS). Evidence from 5 samples representing individuals working in a wide variety of occupations and industries throughout the United States (total N = 1,252) provides support that (a) our proposed 4-factor structure replicates and fits better than alternative models; (b) the measure demonstrates high reliability and content validity; (c) the measure demonstrates evidence for convergent and discriminant validity with constructs in workaholism's nomological network; (d) the measure demonstrates incremental validity in the prediction of important outcomes over and above prior measures of workaholism; and (e) the different dimensions demonstrate incremental validity in the prediction of specific outcomes over and above other dimensions of the MWS. Overall, results from the present study suggest that the MWS is a reliable and valid measure that can advance a more nuanced approach to research and practice relating to workaholism.
The advent of wearable sensor technologies has the potential to transform organizational research by offering the unprecedented opportunity to collect continuous, objective, highly granular data over ...extended time periods. Recent evidence has demonstrated the potential utility of Bluetooth-enabled sensors, specifically, in identifying emergent networks via colocation signals in highly controlled contexts with known distances and groups. Although there is proof of concept that wearable Bluetooth sensors may be able to contribute to organizational research in highly controlled contexts, to date there has been no explicit psychometric construct validation effort dedicated to these sensors in field settings. Thus, the two studies described here represent the first attempt to formally evaluate longitudinal Bluetooth data streams generated in field settings, testing their ability to (a) show convergent validity with respect to traditional self-reports of relational data; (b) display discriminant validity with respect to qualitative differences in the nature of alternative relationships (i.e., advice vs. friendship); (c) document predictive validity with respect to performance; (d) decompose variance in network-related measures into meaningful within- and between-unit variability over time; and (e) complement retrospective self-reports of time spent with different groups where there is a "ground truth" criterion. Our results provide insights into the validity of Bluetooth signals with respect to capturing variables traditionally studied in organizational science and highlight how the continuous data collection capabilities made possible by wearable sensors can advance research far beyond that of the static perspectives imposed by traditional data collection strategies.
Several reviews have been critical of the degree to which scales in industrial/organizational psychology and organizational behavior adequately reflect the content of their construct. One potential ...reason for that circumstance is a tendency for scholars to focus less on content validation than on other validation methods (e.g., establishing reliability, performing convergent, discriminant, and criterion-related validation, and examining factor structure). We provide clear evaluation criteria for 2 commonly used content validation approaches: Anderson and Gerbing (1991) and Hinkin and Tracey (1999). To create those guidelines, we gathered all new scales introduced in Journal of Applied Psychology, Academy of Management Journal, Personnel Psychology, and Organizational Behavior and Human Decision Processes from 2010 to 2016. We then subjected those 112 scales to Anderson and Gerbing's (1991) and Hinkin and Tracey's (1999) approaches using 6,240 participants from Amazon's Mechanical Turk with detailed, transparent, and replicable instructions. For both approaches, our results provide evaluation criteria for definitional correspondence-the degree to which a scale's items correspond to the construct's definition-and definitional distinctiveness-the degree to which a scale's items correspond more to the construct's definition than to the definitions of other orbiting constructs.
The Qualitative Job Insecurity Scale (QUAL-JIS) has been
used in job insecurity (JI) research for the past 9 years, without formal
validation. The goal of the current study was to test the scale's
...psychometric properties. We checked the scale's reliability, as well as
its validity, investigating evidence based on the scale's content,
internal structure, and relations to other variables (convergent and
discriminant, predictive and concurrent, as well as incremental predictive
evidence). We additionally evaluated its cross-country and longitudinal
invariance over three measurement times (6 months apart) in two countries
(Romania and Belgium; N
RO = 388,
N
BE = 1,992). We found evidence
for the scale's reliability and validity, QUAL-JIS showing partial scalar
invariance across time and between the two countries. Interestingly, qualitative
JI measured with QUAL-JIS explained additional variance in the employees'
need for recovery above and beyond another popular qualitative JI scale.
The content validity ratio originally proposed by Lawshe is widely used to quantify content validity and yet methods used to calculate the original critical values were never reported. Methods for ...original calculation of critical values are suggested along with tables of exact binomial probabilities.
There is no universally agreed definition of well-being as a subjective experience, but Huppert and So (2013) adopted and systematically applied the definition of well-being as positive mental ...health-the opposite of the common mental disorders described in standard mental health classifications (e.g., Diagnostic and Statistical Manual of Mental Disorders). We extended their theoretical approach to include multi-item scales, using 2 waves of nationally representative U.S. adult samples to develop, test, and validate our multidimensional measure of well-being (WB-Pro). This resulted in a good-fitting a priori (48-item, 15-factor) model that was invariant over time, education, gender, and age; showed good reliability (coefficient αs .81-.93), test-retest correlation (.73-.85; M = .80), and convergent/discriminant validity based on a multitrait-multimethod analysis, and relations with demographic variables, selected psychological measures, and other multidimensional and purportedly unidimensional well-being measures. Further, we found that items from 2 widely used, purportedly unidimensional well-being measures loaded on different WB-Pro factors consistent with a priori predictions based on the WB-Pro factor structure, thereby calling into question their claimed unidimensionality and theoretical rationale. Because some applications require a short global measure, we used a machine-learning algorithm to construct 2 global well-being short versions (five- and 15-item forms) and tested these formative measures in relation to the full-form and validity criteria (to download short and long versions see https://ippe.acu.edu.au/research/research-instruments/wb-pro). The WB-Pro appears to be one of the most comprehensive measures of subjective well-being, based on a sound conceptual model and empirical support, with broad applicability for research and practice, as well as providing a framework for evaluating the breadth of other well-being measures.
Public Significance Statement
Based on a systematic and coherent theoretical approach to defining well-being, we have used state-of-the-art psychometric techniques to develop and validate a new multidimensional well-being measure (WB-Pro). The full professional version (48-items, 15-factors) is recommended for high-quality well-being research. It is also available in shorter versions (15 and 5-items) that can be utilized where is it not practical to use the full version (to download short and long versions see https://ippe.acu.edu.au/research/research-instruments/wb-pro).
PDF
