The Passion Scale, based on the dualistic model of passion, measures 2 distinct types of passion: Harmonious and obsessive passions are predictive of adaptive and less adaptive outcomes, ...respectively. In a substantive-methodological synergy, we evaluate the construct validity (factor structure, reliability, convergent and discriminant validity) of Passion Scale responses (N = 3,571). The exploratory structural equation model fit to the data was substantially better than the confirmatory factor analysis solution, and resulted in better differentiated (less correlated) factors. Results from a 13-model taxonomy of measurement invariance supported complete invariance (factor loadings, factor correlations, item uniquenesses, item intercepts, and latent means) over language (French vs. English; the instrument was originally devised in French, then translated into English) and gender. Strong measurement partial invariance over 5 passion activity groups (leisure, sport, social, work, education) indicates that the same set of items is appropriate for assessing passion across a wide variety of activities-a previously untested, implicit assumption that greatly enhances practical utility. Support was found for the convergent and discriminant validity of the harmonious and obsessive passion scales, based on a set of validity correlates: life satisfaction, rumination, conflict, time investment, activity liking and valuation, and perceiving the activity as a passion.
Introduction
Adolescence is considered as a particularly vulnerable period for body image disturbance. Body esteem is defined as the self-evaluation of one’s own body or appearance.
Objectives
...Validate the Body Esteem Scale for Adolescents and Adults (BESAA) in Tunisian adolescents.
Methods
We conducted a cross-sectional study among adolescents who attend Tunisian high school from 11 October 2021 to 11 November 2021.
We translated the BESAA into dialectal Tunisian Arabic based on the translation back-translation method. The validity of the scale was evaluated through content validity, reliability and construct validity. We used the Arabic version of Rosenberg Self Esteem Scale as an external validator.
Results
We recruited 340 adolescents aged between 12 and 19 years’ old. The translated version was considered satisfactory. The internal consistency showed a good result with a Cronbach Alpha of 0,830. The correlation between items and subscales demonstrated statistically significant and logical results. Statistically significant correlations were found between the BESAA and its external validator the Rosenberg Self Esteem Scale (r= 0,422; p< 0,01). The exploratory analysis related three factors similarly to the original version of the questionnaire and in confirmatory analysis. The scale demonstrated good model fit statistics as follow: Comparative fit index= 0,87; goodness of fit index=0,81; adjusted goodness of fit index=0,77; Root Mean Square Error of Approximation=0,1 and Standardized Root Mean Square Residual=0,09.
Conclusions
Our BESAA version can be reliably used to conduct further studies and researches on body esteem in the Tunisian population.
Disclosure of Interest
None Declared
Objective
The objective of this study was to evaluate the performance of the Professional Fulfillment Index (PFI), a 16-item instrument to assess physicians’ professional fulfillment and burnout, ...designed for sensitivity to change attributable to interventions or other factors affecting physician well-being.
Methods
A sample of 250 physicians completed the PFI, a measure of self-reported medical errors, and previously validated measures including the Maslach Burnout Inventory (MBI), a one-item burnout measure, the World Health Organization’s abbreviated quality of life assessment (WHOQOL-BREF), and PROMIS short-form depression, anxiety, and sleep-related impairment scales. Between 2 and 3 weeks later, 227 (91%) repeated the PFI and the sleep-related impairment scale.
Results
Principal components analysis justified PFI subscales for professional fulfillment, work exhaustion, and interpersonal disengagement. Test-retest reliability estimates were 0.82 for professional fulfillment (α = 0.91), 0.80 for work exhaustion (α = 0.86), 0.71 for interpersonal disengagement (α = 0.92), and 0.80 for overall burnout (α = 0.92). PFI burnout measures correlated highly (
r
≥ 0.50) with their closest related MBI equivalents. Cohen’s
d
effect size differences in self-reported medical errors for high versus low burnout classified using the PFI and the MBI were 0.55 and 0.44, respectively. PFI scales correlated in expected directions with sleep-related impairment, depression, anxiety, and WHOQOL-BREF scores. PFI scales demonstrated sufficient sensitivity to detect expected effects of a two-point (range 8–40) change in sleep-related impairment.
Conclusions
PFI scales have good performance characteristics including sensitivity to change and offer a novel contribution by assessing professional fulfillment in addition to burnout.
Although workplace incivility has received increasing attention in organizational research over the past two decades, there have been recurring questions about its construct validity, especially ...vis-à-vis other forms of workplace mistreatment. Also, the antecedents of experienced incivility remain understudied, leaving an incomplete understanding of its nomological network. In this meta-analysis using Schmidt and Hunter's Methods of meta-analysis: Correcting error and bias in research findings (3rd ed.), Sage random-effect meta-analytic methods, we validate the construct of incivility by testing its reliability, convergent and discriminant validity, as well as its incremental predictive validity over other forms of mistreatment. We also extend its nomological network by drawing on the perpetrator predation framework to systematically study the antecedents of experienced incivility. Based on 105 independent samples and 51,008 participants, we find extensive support for incivility's construct validity. Besides, we demonstrate that demographic characteristics (gender, race, rank, and tenure), personality traits (agreeableness, conscientiousness, neuroticism, negative affectivity, and self-esteem), and contextual factors (perceived uncivil climate and socially supportive climate) are important antecedents of experienced incivility, with contextual factors displaying a stronger association with incivility. In a supplementary primary study with 457 participants, we find further support for the construct validity of incivility. We discuss the theoretical and practical implications of this study.
Este artículo explora la relevancia de considerar las consecuencias de las pruebas como parte de las discusiones acerca de la validez, la investigación sobre validación, en el contexto del Programa ...Internacional para la Evaluación de Estudiantes de la OCDE, PISA. Lo primero que describe la concepción moderna de validez como un aspecto fundamental de la calidad de los ensayos y sistemas de pruebas, es que evoluciona en torno a las interpretaciones propuestas y usos de las puntuaciones de las pruebas: "La validez se refiere al grado en el cual la evidencia y la teoría apoyan las interpretaciones de las puntuaciones de las pruebas sobre las propuestas de su uso en los test. La validez es, por tanto, la consideración más fundamental en el desarrollo y evaluación de las pruebas. " (AERA, APA & SNEM, 2014, p. 11). En particular, nos centramos en el papel que han jugado sus consecuencias en la literatura sobre validez de la prueba y validación. Así como a continuación, introducimos PISA y sus interpretaciones y usos previstos como base para el examen de su validez. Esto es seguido por un resumen de los estudios empíricos existentes sobre los usos y consecuencias de PISA. Finalmente, el documento presenta piezas que faltan en la evidencia de validez en relación con las consecuencias y se analiza la importancia de una agenda pro-activa en estos temas por parte de los grupos de interés de PISA a nivel internacional y nacional.
Constructs and indicators are central to the efforts of many researchers who seek to build and test theories and articulate rich narratives about real-world phenomena. For this reason, an extensive ...discourse exists about their nature. Increasingly, this discourse has become fraught with controversy. Using Bunge’s (1977, 1979) ontology, I examine the nature of constructs and indicators as they are discussed in the extant literature. I define these concepts precisely, disentangle conceptual from measurement issues, and point to ways that discourse about them could better proceed. I show that unidimensional constructs, multidimensional constructs, dimensions, and indicators are all properties in general of a class of things. I also show that only three types of indicators exist—synonyms of the focal construct and succeeding or preceding properties in a pre-order of properties that includes the focal construct. I examine ontologically the notions of content validity, convergent validity, discriminant validity, and internal-consistency reliability and show their problematic nature. I introduce two new concepts, scope validity and the level of concomitance of indicators, that have rigorous ontological foundations. Together, they provide an improved foundation for assessing the construct validity of a set of indicators.
The current study examines the measurement properties and validity of a novel, abbreviated youth version of the UPPS-P Impulsive Behavior Scale that was developed to maintain measurement consistency ...with the existing adult short form. Specifically, we examined this scale's (a) factor structure; (b) measurement and structural invariance across four demographic characteristics: gender, ethnicity, household income, and parental education; and (c) correlates using a subset of 4,521 preadolescent (9- and 10-year old) children (53% male) from the baseline wave of the Adolescent Brain and Cognitive Development (ABCD) study, a large, community-based sample. Our findings supported a correlated 5-factor model, as well as a hierarchical model that recaptured the covariation among these 5 lower-order factors in three higher-order factors. Both of these models are consistent with the commonly observed structure of the UPPS-P among adults. We established measurement invariance across all demographic characteristics. Finally, our UPPS-P scales evidenced good convergent and discriminant validity with a broad swath of theoretically relevant external criteria, including self- and parent-reported personality and psychopathology, as well as lab-based neurocognitive tasks. Our findings indicate that we can assess multidimensional impulsivity in children reliably and validly by means of self-report, allowing assessment of this critical domain at early stages of development. We hope that this measure will facilitate the study of impulsivity in large-scale samples to begin to understand the evolution and long-term consequences of impulsivity.
Public Significance Statement
Multidimensional impulsivity can be assessed in children by means of self-report. This measure can be used to study impulsivity in large-scale samples and trace its evolution across the life span.
Reliability and validity describe desirable psychometric characteristics of research instruments. The concept of validity is also applied to research studies and their findings. Internal validity ...examines whether the study design, conduct, and analysis answer the research questions without bias. External validity examines whether the study findings can be generalized to other contexts. Ecological validity examines, specifically, whether the study findings can be generalized to real-life settings; thus ecological validity is a subtype of external validity. These concepts are explained using examples so that readers may understand why the consideration of internal, external, and ecological validity is important for designing and conducting studies, and for understanding the merits of published research.
The Campbellian validity model and the traditional top-down approach to validity have had a profound influence on research and evaluation. That model includes the concepts of internal and external ...validity and within that model, the preeminence of internal validity as demonstrated in the top-down approach. Evaluators and researchers have, however, increasingly recognized that in an evaluation, the over-emphasis on internal validity reduces that evaluation's usefulness and contributes to the gulf between academic and practical communities regarding interventions. This article examines the limitations of the Campbellian validity model and the top-down approach and provides a comprehensive, alternative model, known as the integrative validity model for program evaluation. The integrative validity model includes the concept of viable validity, which is predicated on a bottom-up approach to validity. This approach better reflects stakeholders’ evaluation views and concerns, makes external validity workable, and becomes therefore a preferable alternative for evaluation of health promotion/social betterment programs. The integrative validity model and the bottom-up approach enable evaluators to meet scientific and practical requirements, facilitate in advancing external validity, and gain a new perspective on methods. The new perspective also furnishes a balanced view of credible evidence, and offers an alternative perspective for funding.
Accurate measurement of quality of life (QoL) is important for evaluation of autism services and trials of interventions. We undertook psychometric validation of the World Health Organisation ...measure—WHOQoL-BREF, examined construct validity of the WHO Disabilities module and developed nine additional autism-specific items (ASQoL) from extensive consultation with the autism community. The sample of 309 autistic people was recruited from the Adult Autism Spectrum Cohort-UK. The WHOQoL-BREF had good psychometric properties, including criterion, convergent, divergent and discriminant validity. The WHO Disabilities module showed adequate construct validity and reliability. The ASQoL items form a unitary factor of QoL, with one global item. Future studies can use the WHO measures alongside the ASQoL items to measure QoL of autistic people.
PDF
