Introduction This study explores the stability of scores on psychometrically validated trait questionnaires over time. We illustrate potential pitfalls through a larger study that used the Ruminative ...Response Scale (RRS) to categorize participants prior to study inclusion into two groups based on their habitual tendency to ruminate. Surprisingly, when we re-administered the RRS at the start of an experimental session, significant score changes occurred, resulting in participants shifting between the two groups. Methods To address this, we modified our recruitment process, aiming to reduce careless responses, including an online RRS assessment a week before the lab appointment. We analyzed the different samples prior to and after changing the recruitment procedure, as well as the total sample regarding the psychometric properties of the RRS. We also explored various indices to identify and predict score changes due to careless responding; however, only a subgroup of participants was successfully identified. Results Our findings suggest that Mahalanobis distances are effective for identifying substantial score changes, with baseline state rumination emerging as a marginally significant predictor. Discussion We discuss the importance of conducting manipulation checks and offer practical implications for research involving psychometrically validated trait questionnaires.
Banyard, HG, Nosaka, K, and Haff, GG. Reliability and validity of the load-velocity relationship to predict the 1RM back squat. J Strength Cond Res 31(7): 1897-1904, 2017-This study investigated the ...reliability and validity of the load-velocity relationship to predict the free-weight back squat one repetition maximum (1RM). Seventeen strength-trained males performed three 1RM assessments on 3 separate days. All repetitions were performed to full depth with maximal concentric effort. Predicted 1RMs were calculated by entering the mean concentric velocity of the 1RM (V1RM) into an individualized linear regression equation, which was derived from the load-velocity relationship of 3 (20, 40, 60% of 1RM), 4 (20, 40, 60, 80% of 1RM), or 5 (20, 40, 60, 80, 90% of 1RM) incremental warm-up sets. The actual 1RM (140.3 ± 27.2 kg) was very stable between 3 trials (ICC = 0.99; SEM = 2.9 kg; CV = 2.1%; ES = 0.11). Predicted 1RM from 5 warm-up sets up to and including 90% of 1RM was the most reliable (ICC = 0.92; SEM = 8.6 kg; CV = 5.7%; ES = -0.02) and valid (r = 0.93; SEE = 10.6 kg; CV = 7.4%; ES = 0.71) of the predicted 1RM methods. However, all predicted 1RMs were significantly different (p ≤ 0.05; ES = 0.71-1.04) from the actual 1RM. Individual variation for the actual 1RM was small between trials ranging from -5.6 to 4.8% compared with the most accurate predictive method up to 90% of 1RM, which was more variable (-5.5 to 27.8%). Importantly, the V1RM (0.24 ± 0.06 m·s) was unreliable between trials (ICC = 0.42; SEM = 0.05 m·s; CV = 22.5%; ES = 0.14). The load-velocity relationship for the full depth free-weight back squat showed moderate reliability and validity but could not accurately predict 1RM, which was stable between trials. Thus, the load-velocity relationship 1RM prediction method used in this study cannot accurately modify sessional training loads because of large V1RM variability.
Decision-making styles represent the typical manner individuals use to make decisions. This study aimed to develop and test the structure of a decision-making style questionnaire based on the ...Yin-yang framework of decision making. Two studies were carried out. In Study 1, we generated an initial item pool of 122 items using a theory-driven approach. Then three focus groups were used to finalize 54 items for the field testing. Third, using a hybrid of iterative exploratory factor analysis and ant colony optimization approach (n = 895), we identified 23 items that were deemed best to represent five constructs of the yin-yang framework of decision making: adaptability, relative positioning, self-awareness, proactivity, and prudence. In Study 2, we performed the validation study (n = 569) by testing three models of the yin-yang framework of decision making styles. We also explored age and sex differences. The results from two studies provide initial support for the factor structure and reliability of the Yin-yang decision-making questionnaires. The results were discussed in the context of the yin-yang framework and age and sex differences regarding these constructs.
•The Yin-yang framework of decision-making is used as a theoretical perspective.•Iterative EFA and Ant colonization optimization used for instrument development.•Confirmatory analysis was conducted to test three models of the 23-item instrument.•Age and sex differences regarding Yin-yang decision-making styles were examined.•A promising decision-making style instrument from an eastern cultural perspective
Assertiveness is a social communication skill and is related to the effectiveness of expressing oneself while respecting others. A lack of assertiveness is associated with various mental illnesses; ...hence the importance of being able to measure it reliably. The aim of the study was to translate the short version of the Scale for Interpersonal Behavior (s-SIB) into Slovak and subsequently test its factor structure and other psychometric properties. Our convenience sample consisted of 590 respondents from Slovakia, 22.71% of whom were men and 77.29% women. The data analysis consisted of a descriptive analysis, reliability analysis, factor structure analysis, Mokken analysis, and percentile norms. The scale showed good psychometric properties. Unlike the 4-factor solution for distress and performance in the original work, our findings showed that the general factor loadings were very good and that the bifactor model had the best fit in both cases (distress and performance). Mokken analysis indicated that the total scores for distress and perfromance and their constituent subscales can be used as proposed. In conclusion, the Slovak version of the s-SIB can be used as to measure the total score for assertiveness as well as the separate factors - Positive Assertion, Negative Assertion, Expression of and Dealing with Personal Limitations, and Initiating Assertiveness.
Objectives The objective of this research was to generate psychometric evidence supporting the myasthenia gravis (MG) symptoms patient-reported outcome (PRO) scales as a fit-for-purpose measure of ...severity of core symptoms of MG and provide information allowing their meaningful interpretation using data from a phase 3 study in MG. Methods Data from the MycarinG study, a phase 3 study of rozanolixizumab in patients with generalized MG who experience moderate to severe symptoms ( ClinicalTrials.gov Identifier: NCT03971422) were analyzed with both classical test theory (CTT) and Rasch measurement theory (RMT). Meaningful within-individual change and group-level meaningful change were estimated for three MG Symptoms PRO scales using anchor- and distribution-based methods. Anchor-based methods used patient global impression of severity (PGIS) and change (PGIC) in MG symptoms as anchors. Results Good measurement properties of the MG Symptoms PRO scales were shown in the sample of 200 participants: good to excellent reliability (test–retest and internal consistency reliability) and validity (associations between items and scores within the MG Symptoms PRO scales and between the MG Symptoms PRO scores and other clinical outcomes—MG ADL, QMG score, MGC score, and MGFA classes—were as expected); and the items showed good coverage of the continuum and fit to the Rasch model. Triangulation of the anchor- and distribution-based method results led to the definition of clinically meaningful within-patient improvement in scores for Muscle Weakness Fatigability (−16.67), Physical Fatigue (−20.00), and Bulbar Muscle Weakness (−20.00), with associated ranges. Benchmarks are also proposed for the interpretation of group-level results. Conclusion The strong psychometric performance of the MG Symptoms PRO scales and the information generated to guide its interpretation supports its use in clinical trials for demonstrating the clinical benefits of new treatments targeting core symptoms of MG (muscle weakness fatigability, physical fatigue, bulbar muscle weakness, respiratory muscle weakness, and ocular muscle weakness).
Burnout syndrome (BS) has been classified as an independent ‘work-related phenomenon’, however, there is still an important discussion on whether BS is a unique clinical construct due to the ...overlapping symptoms with other domains of negative affect such as symptoms of depression, anxiety, and irritability. Thus, we investigated the common and dissociable aspects between BS and domains of negative affect such as depression, anxiety, and irritability through a cross-sectional study with 3428 essential service professionals from a national project during the COVID-19 pandemic. Participants were assessed with Burnout Assessment Tool (BAT) and the Patient-Reported Outcomes Measurement Information System (PROMIS) scales to assess the severity of depression, anxiety, and irritability. The discriminability between the constructs was investigated using correlation tests, Bifactor Exploratory Structural Equation Modeling Bifactor (ESEM), and network analyzes. The mean correlation among the four subscales of BAT-12 was stronger with each other than with depression, anxiety, and irritability. Both ESEM and network analysis, despite showing shared characteristics, clearly delineated that Burnout domains were dissociable from other domains of negative affect. Our findings corroborate the ICD-11 strategy to include BS as a separate entity that cannot be fully explained by variance accounted for by other domains.
•The most widespread definition of burnout contributes to the persistent discussion about its overlap with depression.•In the covid-19 pandemic, essential service workers were exposed to risky situations for symptoms related to negative affects.•The association of burnout with symptoms of anxiety and depression does not invalidate the existence of burnout.
The Reading the Mind in the Eyes Test is a popular measure of individual differences in Theory of Mind that is often applied in the assessment of particular clinical populations (primarily, ...individuals on the autism spectrum). However, little is known about the test's psychometric properties, including factor structure, internal consistency, and convergent validity evidence. We present a psychometric analysis of the test followed by an evaluation of other empirically proposed and statistically identified structures. We identified, and cross-validated in a second sample, an adequate short-form solution that is homogeneous with adequate internal consistency, and is moderately related to Cognitive Empathy, Emotion Perception, and strongly related to Vocabulary. We recommend the use of this short-form solution in normal adults as a more precise measure over the original version. Future revisions of the test should seek to reduce the test's reliance on one's vocabulary and evaluate the short-form structure in clinical populations.
The COPE Inventory (Carver et al., 1989) is the most frequently used measure of coping; yet previous studies examining its factor structure yielded mixed results. The purpose of the current study, ...therefore, was to validate the factor structure of the COPE Inventory in a representative sample of over 2,000 adults in Slovakia. Our second goal was to evaluate the external validity of the COPE inventory, which has not been done before. Firstly, we performed the exploratory factor analysis (EFA) with half of the sample. Subsequently, we performed the confirmatory factor analysis with the second half of the sample. Both factor analyses with 15 factor solutions showed excellent fit with the data. Additionally, we performed a hierarchical factor analysis with fifteen first-order factors (acceptance, active coping, behavioral disengagement, denial, seeking emotional support, humor, seeking instrumental support, mental disengagement, planning, positive reinterpretation, religion, restraint, substance use, suppression of competing activities, and venting) and three second-order factors (active coping, social emotional coping, and avoidance coping) which showed good fit with the data. Moreover, the COPE Inventory's external validity was evaluated using consensual qualitative research (CQR) analysis on data collected by in-depth interviews. Categories of coping created using CQR corresponded with all COPE first-order factors. Moreover, we identified two additional first-order factors that were not present in the COPE Inventory: self-care and care for others. Our study shows that the Slovak translation of the COPE Inventory is a reliable, externally valid, and well-structured instrument for measuring coping in the Slovak population.
The three-item Sexual Distress Scale (SDS-3) has been frequently used to assess distress related to sexuality in public health surveys and research on sexual wellbeing. However, its psychometric ...properties and measurement invariance across cultural, gender and sexual subgroups have not yet been examined. This multinational study aimed to validate the SDS-3 and test its psychometric properties, including measurement invariance across language, country, gender identity, and sexual orientation groups.
We used global survey data from 82,243 individuals (Mean age=32.39 years; 40.3 % men, 57.0 % women, 2.8 % non-binary, and 0.6 % other genders) participating in the International Sexual Survey (ISS; https://internationalsexsurvey.org/) across 42 countries and 26 languages. Participants completed the SDS-3, as well as questions regarding sociodemographic characteristics, including gender identity and sexual orientation.
Confirmatory factor analysis (CFA) supported a unidimensional factor structure for the SDS-3, and multi-group CFA (MGCFA) suggested that this factor structure was invariant across countries, languages, gender identities, and sexual orientations. Cronbach's α for the unidimensional score was 0.83 (range between 0.76 and 0.89), and McDonald's ω was 0.84 (range between 0.76 and 0.90). Participants who did not experience sexual problems had significantly lower SDS-3 total scores (M = 2.99; SD=2.54) compared to those who reported sexual problems (M = 5.60; SD=3.00), with a large effect size (Cohen's d = 1.01 95 % CI=-1.03, -0.98; p < 0.001).
The SDS-3 has a unidimensional factor structure and appears to be valid and reliable for measuring sexual distress among individuals from different countries, gender identities, and sexual orientations.
PDF
