Effect size information is essential for the scientific enterprise and plays an increasingly central role in the scientific process. We extracted 147,328 correlations and developed a hierarchical ...taxonomy of variables reported in Journal of Applied Psychology and Personnel Psychology from 1980 to 2010 to produce empirical effect size benchmarks at the omnibus level, for 20 common research domains, and for an even finer grained level of generality. Results indicate that the usual interpretation and classification of effect sizes as small, medium, and large bear almost no resemblance to findings in the field, because distributions of effect sizes exhibit tertile partitions at values approximately one-half to one-third those intuited by Cohen (1988). Our results offer information that can be used for research planning and design purposes, such as producing better informed non-nil hypotheses and estimating statistical power and planning sample size accordingly. We also offer information useful for understanding the relative importance of the effect sizes found in a particular study in relationship to others and which research domains have advanced more or less, given that larger effect sizes indicate a better understanding of a phenomenon. Also, our study offers information about research domains for which the investigation of moderating effects may be more fruitful and provide information that is likely to facilitate the implementation of Bayesian analysis. Finally, our study offers information that practitioners can use to evaluate the relative effectiveness of various types of interventions.
Associations have been observed between socioeconomic status (SES) and language outcomes from early childhood, but individual variability is high. Exposure to high levels of stress, often associated ...with low-SES status, might influence how parents and infants interact within the early language environment. Differences in these early language behaviors, and in early neurodevelopment, might underlie SES-based differences in language that emerge later on. Analysis of natural language samples from a predominantly low-/mid-income sample of mother-infant dyads, obtained using the Language Environment Analysis (LENA) system, found that maternal reports of exposure to stressful life events, and perceived stress, were negatively correlated with child vocalizations and conversational turns when infants were 6 and 12 months of age. Greater numbers of vocalizations and conversational turns were also associated with lower relative theta power and higher relative gamma power in 6- and 12-month baseline EEG – a pattern that might support subsequent language development.
We used psychological contract theory as a framework to meta-analytically review subjective and objective predictors of employees' perceived job insecurity. Seventy-six samples from 68 studies were ...included in our review. Results revealed that lower levels of job insecurity are associated with having an internal locus of control, lower amounts of role ambiguity and role conflict, greater amounts of organizational communication, less organizational change, younger employees, and white-collar and permanent work. Moderator analyses further revealed that relations between job insecurity and age, gender, education, and formal contracts are moderated by unemployment rates, countries of origin, and type of job insecurity measure. We discuss theoretical and practical implications for psychological contract theory and occupational health, and offer directions for future research.
We assessed presumed consequences of hypothesizing after results are known (HARKing) by contrasting hypothesized versus nonhypothesized effect sizes among 10 common relations in organizational ...behavior, human resource management, and industrial and organizational psychology research. In Study 1, we analyzed 247 correlations representing 9 relations with individual performance in 136 articles published in Journal of Applied Psychology and Personnel Psychology and provide evidence that correlations are significantly larger when hypothesized compared to nonhypothesized. In Study 2, we analyzed 281 effect sizes from a meta‐analysis on the job satisfaction–job performance relation and provide evidence that correlations are significantly larger when hypothesized compared to nonhypothesized. In addition, in Study 2, we documented that hypothesized variable pairs are more likely to be mentioned in article titles or s. We also ruled out 13 alternative explanations to the presumed HARKing effect pertaining to methodological (e.g., unreliability, publication year, research setting, research design, measure contextualization, publication source) and substantive (e.g., predictor–performance pair, performance measure, satisfaction measure, occupation, job/task complexity) issues. Our results suggest that HARKing seems to pose a threat to research results, substantive conclusions, and practical applications. We offer recommended solutions to the HARKing threat.
Previous research has primarily revealed a negative relationship between collective employee turnover and organizational performance. However, this research also suggests underlying complexity in the ...relationship. To clarify the nature of this relationship, the authors conduct a meta-analytic review in which they test and provide support for a portion of Hausknecht and Trevor’s model of collective turnover. The authors’ meta-analysis includes 48 independent samples reporting 157 effect size estimates (N = 24,943), tests six hypothesized moderator variables, and provides path analyses to test alternative conceptualizations of the turnover–organizational performance relationship. Results indicate that the mean corrected correlation between turnover and organizational performance is −.03, but this relationship is moderated by several important variables. For example, the relationship is stronger in manufacturing and transportation industries (−.07), for managerial employees (−.08), in midsize organizations (−.07), in samples from labor market economies (−.05), and when organizational performance is operationalized in terms of customer service (−.10) or quality and safety (−.12) metrics. In addition, proximal performance outcomes mediate relationships with financial performance. The authors discuss implications of their results for theory and practice and provide directions for future research.
Exposure to high levels of early life stress have been associated with long-term difficulties in learning, behavior, and health, with particular impact evident in the language domain. While some have ...proposed that the increased stress of living in a low-income household mediates observed associations between socioeconomic status (SES) and child outcomes, considerable individual differences have been observed. The extent to which specific variables associated with socioeconomic status – in particular exposure to stressful life events – influence the neurocognitive mechanisms underlying language acquisition are not well understood. Auditory statistical learning, or the ability to segment a continuous auditory stream based on its statistical properties, develops during early infancy and is one mechanism thought to underlie language learning. The present study used an event-related potential (ERP) paradigm to test whether maternal stress, adjusting for socioeconomic variables (e.g., family income, maternal education) was associated with neurocognitive processes underlying statistical learning in a sample of 26-month-old children (n = 23) from predominantly low- to middle-income backgrounds. Event-related potentials were recorded while children listened to a continuous stream of tri-tone “words” in which tone elements varied in transitional probability. “Tone-words” were presented in random order, such that Tone 1 always predicted Tones 2 and 3 (transitional probability for Tone 3 = 1.0), but Tone 1 appeared randomly. A larger P2 amplitude was observed in response to Tone 3 compared to Tone 1, demonstrating that children implicitly tracked differences in transitional probabilities during passive listening. Maternal reports of stress at 26 months, adjusting for SES, were negatively associated with difference in P2 amplitude between Tones 1 and 3. These findings suggest that maternal stress, within a low-SES context, is associated with the manner in which children process statistical properties of auditory input.
•We collected neural data from toddlers during an auditory statistical learning task.•Children from low-SES backgrounds track transitional probabilities.•Maternal reports of stress were associated with the size of the neural response.•Stress explained individual variability above and beyond socioeconomic status.•Early experience might influence language via changes to statistical learning.
Cloud condensation nuclei (CCN) can affect cloud properties and therefore the Earth’s radiative balance. New particle formation (NPF) from condensable vapours in the free troposphere has been ...suggested to contribute to CCN, especially in remote, pristine atmospheric regions, but direct evidence is sparse, and the magnitude of this contribution is uncertain. Here we use in-situ aircraft measurements of vertical profiles of aerosol size distributions to present a global-scale survey of NPF occurrence. We observed intense NPF occurring at high altitude in tropical convective regions over both the Pacific and Atlantic Oceans. Together with the results of chemical-transport models, our findings indicate that NPF persists at all longitudes as a global-scale band in the tropical upper troposphere, covering about 40% of the Earth’s surface. Furthermore, we find that this NPF in the tropical upper troposphere is a globally important source of CCN in the lower troposphere, where they can affect cloud properties. Our findings suggest that the production of CCN, as these new particles descend towards the surface, is currently not adequately captured in global models, because they tend to underestimate both the magnitude of tropical upper tropospheric NPF and the subsequent growth to CCN sizes. This has potential implications for cloud albedo and the global radiative balance.
We conduct a mixed-method, multi-study investigation using a role congruity theory framework to examine prospective employees' attitudes toward working for male- and female-led ventures. Results ...using data collected from business students, alumni, and executives in India reveal three insights: (1) prospective employees report similar evaluations for male- and female-led ventures under normal circumstances but evaluate female-led ventures more favorably than male-led ventures when the entrepreneur has a hierarchical workplace romance; (2) favorable attitudes toward female-led rather than male-led ventures when the entrepreneur is engaged in a hierarchical workplace romance are motivated by benevolent sexism; and (3) although respondents report a higher inclination to work for ventures without (vs with) a policy prohibiting workplace romance, the decline in willingness to work for an entrepreneur engaged in a workplace romance is higher for female- than male-led ventures. We discuss implications and directions for future research.
The authors content analyzed 196 meta-analyses including 5,581 effect-size estimates published in Academy of Management Journal, Journal of Applied Psychology, Journal of Management, Personnel ...Psychology, and Strategic Management Journal from January 1982 through August 2009 to assess the presumed effects of each of 21 methodological choices and judgment calls on substantive conclusions. Results indicate that, overall, the various meta-analytic methodological choices available and judgment calls involved in the conduct of a meta-analysis have little impact on the resulting magnitude of the meta-analytically derived effect sizes. Thus, the present study, based on actual meta-analyses, casts doubt on previous warnings, primarily based on selective case studies, that judgment calls have an important impact on substantive conclusions. The authors also tested the fit of a multivariate model that includes relationships among theory-building and theory-testing goals, obtained effect sizes, year of publication of the meta-analysis, and scholarly impact (i.e., citations per year). Results indicate that the more a meta-analysis attempts to test an existing theory, the larger the number of citations, whereas the more a meta-analysis attempts to build new theory, the lower the number of citations. Also, in support of scientific particularism, as opposed to scientific universalism, the magnitude of the derived effects is not related to the extent to which a meta-analysis is cited. Taken together, the results provide a comprehensive data-based understanding of how meta-analytic reviews are conducted and the implications of these practices for theory building and testing, obtained effect sizes, and scholarly impact.
The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using multiple regression. The median observed effect size (
f
2
) is ...only.002, but 72% of the moderator tests reviewed had power of.80 or greater to detect a targeted effect conventionally defined as small. Results suggest the need to minimize the influence of artifacts that produce a downward bias in the observed effect size and put into question the use of conventional definitions of moderating effect sizes. As long as an effect has a meaningful impact, the authors advise researchers to conduct a power analysis and plan future research designs on the basis of smaller and more realistic targeted effect sizes.
