Abstract
Scalar invariance is an unachievable ideal that in practice can only be approximated; often using potentially questionable approaches such as partial invariance based on a stepwise selection ...of parameter estimates with large modification indices. Study 1 demonstrates an extension of the power and flexibility of the alignment approach for comparing latent factor means in large-scale studies (30 OECD countries, 8 factors, 44 items, N = 249,840), for which scalar invariance is typically not supported in the traditional confirmatory factor analysis approach to measurement invariance (CFA-MI). Importantly, we introduce an alignment-within-CFA (AwC) approach, transforming alignment from a largely exploratory tool into a confirmatory tool, and enabling analyses that previously have not been possible with alignment (testing the invariance of uniquenesses and factor variances/covariances; multiple-group MIMIC models; contrasts on latent means) and structural equation models more generally. Specifically, it also allowed a comparison of gender differences in a 30-country MIMIC AwC (i.e., a SEM with gender as a covariate) and a 60-group AwC CFA (i.e., 30 countries × 2 genders) analysis. Study 2, a simulation study following up issues raised in Study 1, showed that latent means were more accurately estimated with alignment than with the scalar CFA-MI, and particularly with partial invariance scalar models based on the heavily criticized stepwise selection strategy. In summary, alignment augmented by AwC provides applied researchers from diverse disciplines considerable flexibility to address substantively important issues when the traditional CFA-MI scalar model does not fit the data.
Translational Abstract
Determining whether people in certain countries score differently in measurements of interest (e.g., values, attitudes, opinions, or behaviors) can assist in testing theories, comparing countries, and advancing our psychological, sociological, and cross-cultural knowledge. Meaningful comparisons of means or relationships between constructs within and across nations require equivalent measurements of these constructs. However, tests of measurement equality or invariance usually fail when many groups are considered. Asparouhov and Muthén (2014) presented a new method for multiple-group confirmatory factor analysis (CFA), referred to as the alignment method. A strength of the method is the ability to estimate group-specific factor means and variances without requiring exact measurement invariance. Study 1 introduces an extension of the alignment method that can flexibly be applied in a large range of structural equation models. This is demonstrated by comparing latent factor means and relationships between 8 motivational constructs and covariates (e.g., gender) across 30 countries in a large-scale study (PISA, N = 249,840), in which the traditional measurement invariance was not achieved. Study 2, a simulation study, was presented showing that latent means were more accurately estimated with the alignment method than with other measurement invariance models (e.g., partial invariance models). In summary, the alignment method, augmented by its more flexible extension suggested in the present article, provides applied researchers from diverse disciplines considerable flexibility to address substantively important issues when the traditional measurement model does not fit the data.
As the online world plays an increasing role in young peoples’ lives, research on compulsive internet use (CIU) is receiving growing attention. Given the social richness of the online world, there is ...a need to better understand how CIU influences adolescents’ social support and vice versa. Drawing on ecological systems theory, we examined the longitudinal links between adolescents’ CIU and perceived social support from three sources (parents, teachers, and friends) across 4 critical years of adolescence (Grades 8–11). Using random intercept cross-lagged modeling, we found that CIU consistently preceded reduced social support from teachers, whereas social support from parents preceded increases in CIU over time. We discuss the implications of our findings for parents and schools seeking to support young people experiencing CIU.
This study extends the classic constructive dialogue/debate between self-concept and self-efficacy researchers (Marsh, Roche, Pajares, & Miller, 1997) regarding the distinctions between these 2 ...constructs. The study is a substantive-methodological synergy, bringing together new substantive, theoretical, and statistical models and developing new tests of the classic jingle-jangle fallacy. We demonstrate that in a representative sample of 3,350 students from math classes in 43 German schools, generalized math self-efficacy and math outcome expectancies were indistinguishable from math self-concept, but were distinct from test-related and functional measures of self-efficacy. This is consistent with the jingle-jangle fallacies that are proposed. On the basis of pretest variables, we demonstrate negative frame-of-reference effects in social (big-fish-little-pond effect) and dimensional (internal/external frame-of-reference effect) comparisons for three self-concept-like constructs in each of the first 4 years of secondary school. In contrast, none of the frame-of-reference effects were significantly negative for either of the two self-efficacy-like constructs in any of the 4 years of testing. After controlling for pretest variables, each of the 3 self-concept-like constructs (math self-concept, outcome expectancy, and generalized math self-efficacy) in each of the 4 years of secondary school was more strongly related to posttest outcomes (school grades, test scores, future aspirations) than were the corresponding 2 self-efficacy-like factors. Extending discussion by Marsh et al. (1997), we clarify distinctions between self-efficacy and self-concept; the role of evaluation, worthiness, and outcome expectancy in self-efficacy measures; and complications in generalized and global measures of self-efficacy.
Educational Impact and Implications Statement
Positive self-beliefs are a central construct in educational psychology, and self-concept and self-efficacy are the most widely used and theoretically important representations of positive self-beliefs. In Educational Psychology, much effort has been expended in trying to distinguish between self-concept and self-efficacy. Nevertheless, in practice and theory the distinction remains murky. We critique previous conceptual attempts to distinguish the two constructs-arguing against some distinctions that have been offered in the past and offering some new theoretical distinctions and new empirical approaches to testing support for these distinctions.
Understanding how children's broader context influences their development is critical if we are to develop policies that help them flourish. Combining sociological, economic, and psychological ...literature, we argue that ability stratification - the degree to which children of similar levels of ability are schooled together - influences a child's academic self-concept. This is because countries with more ability stratification should have larger Big-Fish-Little-Pond Effects (the negative effect of school average achievement on academic self-concept). We used four cycles of the Trends in International Math and Science Study to test the hypothesis that more country-level ability stratification is associated with larger country-level Big-Fish-Little-Pond Effects for math self-concept. Findings strongly support this hypothesis. Our findings have implications for school system design and policy. Author abstract
Drawing on the expectancy-value model, the present study explored individual and gender differences in university entry and selection of educational pathway (e.g., science, technology, engineering, ...and mathematics STEM course selection). In particular, we examined the multiplicative effects of expectancy and task values on educational outcomes during the transition into early adulthood. Participants were from a nationally representative longitudinal sample of 15-year-old Australian youths (N = 10,370). The results suggest that (a) both math self-concept and intrinsic value interact in predicting advanced math course selection, matriculation results, entrance into university, and STEM fields of study; (b) prior reading achievement has negative effects on advanced math course selection and STEM fields through math motivational beliefs; and (c) gender differences in educational outcomes are mediated by gender differences in motivational beliefs and prior academic achievement, while the processes underlying choice of educational pathway were similar for males and females.
We evaluated STEM (science, technology, engineering, and mathematics) coursework selection by women and men (representative longitudinal sample, 10,370 Australians) in senior high school and ...university, controlling achievement and expectancy-value variables. A near-zero total effect of gender on high school STEM enrollment reflected pathways favoring boys through achievement and expectancy-value variables, but a counteracting direct effect of gender favoring girls. In contrast, subsequent university STEM enrollment favored boys. In both high school and university, enrollments favored girls in life sciences and boys in physical sciences, but at university there was a leaky pipeline in which girls who qualified to pursue physical sciences opted for non-STEM subjects. Qualitative analysis not only supported quantitative results but also highlighted alternative mechanisms of STEM engagement/disengagement, and mostly supported gender similarities rather than differences.
This study focuses on the situational heterogeneity of motivation by investigating in-the-moment profiles of expectancies, task values, and costs within learning situations during a university ...lecture. In a sample of 155 undergraduate students followed across one semester we examined the occurrence of six hypothesized profiles, situational profile change, and the associations of situational motivation profiles with students' dispositional motivation. Results of multilevel latent profile analysis revealed three profiles with symmetric levels of expectancies, values, and costs (reflecting high, medium, and low motivation situations), and one profile reflecting motivating but costly situations. Furthermore, situational profiles were associated with students' motivational dispositions at beginning and end of the semester, and partly related to changes in these dispositions during the semester.
Research suggests that a country does not need inequity to have high performance. However, such research has potentially suffered from confounders present in between-country comparative research ...(e.g., latent cultural differences). Likewise, relatively little consideration has been given to whether the situation may be different for high- or low-performing students. Using five cycles of the Programme for International Student Assessment (PISA) database, the current research explores within-country trajectories in achievement and inequality measures to test the hypothesis of an excellence/equity tradeoff in academic performance. We found negative relations between performance and inequality that are robust and of statistical and practical significance. Follow-up analysis suggests a focus on low and average performers may be critical to successful policy interventions.
Ever since the classic research of Nicholls (1976) and others, effort has been recognized as a double-edged sword: while it might enhance achievement, it undermines academic self-concept (ASC). ...However, there has not been a thorough evaluation of the longitudinal reciprocal effects of effort, ASC, and achievement, in the context of modern self-concept theory and statistical methodology. Nor have there been developmental equilibrium tests of whether these effects are consistent across the potentially volatile early-to-middle adolescence. Hence, focusing on mathematics, we evaluate reciprocal effects models (REMs) over the first 4 years of secondary school (grades 5-8), relating effort, achievement (test scores and school grades), ASC, and ASC × Effort interactions for a representative sample of 3,144 German students (Mage = 11.75 years at Wave 1). ASC, effort, and achievement were positively correlated at each wave, and there was a clear pattern of positive reciprocal positive effects among ASC, test scores, and school grades-each contributing to the other, after controlling for the prior effects of all others. There was an asymmetrical pattern of effects for effort that is consistent with the double-edged sword premise: prior school grades had positive effects on subsequent effort, but prior effort had nonsignificant or negative effects on subsequent grades and ASC. However, on the basis of a synergistic application of new theory and methodology, we predicted and found a significant ASC × Effort interaction, such that prior effort had more positive effects on subsequent ASC and school grades when prior ASC was high-thus providing a key to breaking the double-edged sword.
Mastery-approach (MAP) goals, focusing on developing competence and acquiring task mastery, are posited to be the most optimal, beneficial type of achievement goal for academic and life outcomes. ...Although there is meta-analytic evidence supporting this finding, such evidence does not allow us to conclude that the extant MAP goal findings generalize across cultures. Meta-analyses have often suffered from overrepresentation of Western, educated, industrialized, rich, and democratic (WEIRD) samples; reliance on bivariate correlations; and lack the ability to directly control individual-level background variables. To address these limitations, this study used nationally representative data from 77 countries/regions (N = 595,444 adolescents) to examine the relations of MAP goals to four antecedents (workmastery, competitiveness, fear of failure, fixed mindset) and 16 consequences (task-specific motivational, achievement-related, and well-being outcomes), and tested the cross-cultural generalizability of these relations. Results showed that MAP goals were: (a) grounded primarily in positive but not negative achievement motives/beliefs; (b) most strongly predictive of well-being outcomes, followed by adaptive motivation; (c) positively but consistently weakly associated with achievement-related outcomes, particularly for academic performance (β = .069); (d) negatively and weakly associated with maladaptive outcomes; and (e) uniquely predictive of various consequences, controlling for the antecedents and covariates. Further, the MAP goal predictions were generalizable across countries/regions for 13 of 16 consequences. While directions of effect sizes were slightly mixed for academic performance, perceived reading, and PISA test difficulty, the effect sizes were consistently small for most countries/regions. This generalizability points to quite strong cross-cultural support for the observed patterns.
PDF
