Sensitivity analyses refer to investigations of the degree to which the results of a meta-analysis remain stable when conditions of the data or the analysis change. To the extent that results remain ...stable, one can refer to them as robust. Sensitivity analyses are rarely conducted in the organizational science literature. Despite conscientiousness being a valued predictor in employment selection, sensitivity analyses have not been conducted with respect to meta-analytic estimates of the correlation (i.e., validity) between conscientiousness and job performance.
To address this deficiency, we reanalyzed the largest collection of conscientiousness validity data in the personnel selection literature and conducted a variety of sensitivity analyses.
Publication bias analyses demonstrated that the validity of conscientiousness is moderately overestimated (by around 30%; a correlation difference of about .06). The misestimation of the validity appears to be due primarily to suppression of small effects sizes in the journal literature. These inflated validity estimates result in an overestimate of the dollar utility of personnel selection by millions of dollars and should be of considerable concern for organizations.
The fields of management and applied psychology seldom conduct sensitivity analyses. Through the use of sensitivity analyses, this paper documents that the existing literature overestimates the validity of conscientiousness in the prediction of job performance. Our data show that effect sizes from journal articles are largely responsible for this overestimation.
Celotno besedilo
Dostopno za:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
We reviewed studies of the Dark Triad (DT) personality traits-Machiavellianism, narcissism, and psychopathy-and meta-analytically examined their implications for job performance and counterproductive ...work behavior (CWB). Relations among the DT traits and behaviors were extracted from original reports published between 1951 and 2011 of 245 independent samples (N = 43,907). We found that reductions in the quality of job performance were consistently associated with increases in Machiavellianism and psychopathy and that CWB was associated with increases in all 3 components of the DT, but that these associations were moderated by such contextual factors as authority and culture. Multivariate analyses demonstrated that the DT explains moderate amounts of the variance in counterproductivity, but not job performance. The results showed that the 3 traits are positively related to one another but are sufficiently distinctive to warrant theoretical and empirical partitioning.
The relationship between brain volume and intelligence has been a topic of a scientific debate since at least the 1830s. To address the debate, a meta-analysis of the relationship between in vivo ...brain volume and intelligence was conducted. Based on 37 samples across 1530 people, the population correlation was estimated at 0.33. The correlation is higher for females than males. It is also higher for adults than children. For all age and sex groups, it is clear that brain volume is positively correlated with intelligence.
Improvements in stable, or dispositional, mindfulness are often assumed to accrue from mindfulness training and to account for many of its beneficial effects. However, research examining these ...assumptions has produced mixed findings, and the relation between dispositional mindfulness and mindfulness training is actively debated. A comprehensive meta-analysis was conducted on randomized controlled trials (RCTs) of mindfulness training published from 2003-2014 to investigate whether (a) different self-reported mindfulness scale dimensions change as a result of mindfulness training, (b) key aspects of study design (e.g., control condition type, population type, and intervention type) moderate training-related changes in dispositional mindfulness scale dimensions, and (c) changes in mindfulness scale dimensions are associated with beneficial changes in mental health outcomes. Scales from widely used dispositional mindfulness measures were combined into 5 categories for analysis: Attention, Description, Nonjudgment, Nonreactivity, and Observation. A total of 88 studies (n = 5,787) were included. Changes in scale dimensions of mindfulness from pre to post mindfulness training produced mean difference effect sizes ranging from small to moderate (g = 0.28-0.49). Consistent with the theorized role of improvements in mindfulness in training outcomes, changes in dispositional mindfulness scale dimensions were moderately correlated with beneficial intervention outcomes (r = .27-0.30), except for the Observation dimension (r = .16). Overall, moderation analyses revealed inconsistent results, and limitations of moderator analyses suggest important directions for future research. We discuss how the findings can inform the next generation of mindfulness assessment.
Abstract The behavioral immune system (BIS) is a cluster of psychological mechanisms (e.g., disgust) that have evolved to promote disease-avoidance (Schaller M. (2006). Parasites, behavioral ...defenses, and the social psychological mechanisms through which cultures are evoked. Psychological Inquiry , 17, 96–101). Recent evidence suggests that the BIS may promote avoidance of outgroup members, an historical source of contamination, by evoking social conservatism (Terrizzi JA Jr, Shook NJ, & Ventis WL. (2010). Disgust: A predictor of social conservatism and prejudicial attitudes toward homosexuals. Personality and Individual Differences , 49, 587–592; Terrizzi J, Shook N, Ventis L. (2012). Religious conservatism: An evolutionarily evoked disease-avoidance strategy. Religion, Brain & Behavior , 2, 105 – 120.). That is, the BIS mechanisms may encourage the endorsement of socially conservative beliefs, which promote social exclusivity, tradition, and negativity toward outgroups. The current study provides a systematic review and meta-analysis of 24 studies to evaluate the hypothesis that the BIS is predictive of social conservatism. The results indicate that behavioral immune strength, as indicated by fear of contamination and disgust sensitivity, is positively related to social conservatism (i.e., right-wing authoritarianism, social dominance orientation, religious fundamentalism, ethnocentrism, collectivism, and political conservatism). These findings provide initial evidence that socially conservative values may function as evolutionarily evoked disease-avoidance strategies.
Summary
Questionable research practices (QRPs) among researchers have been a source of concern in many fields of study. QRPs are often used to enhance the probability of achieving statistical ...significance which affects the likelihood of a paper being published. Using a sample of researchers from 10 top research‐productive management programs, we compared hypotheses tested in dissertations to those tested in journal articles derived from those dissertations to draw inferences concerning the extent of engagement in QRPs. Results indicated that QRPs related to changes in sample size and covariates were associated with unsupported dissertation hypotheses becoming supported in journal articles. Researchers also tended to exclude unsupported dissertation hypotheses from journal articles. Likewise, results suggested that many article hypotheses may have been created after the results were known (i.e., HARKed). Articles from prestigious journals contained a higher percentage of potentially HARKed hypotheses than those from less well‐regarded journals. Finally, articles published in prestigious journals were associated with more QRP usage than less prestigious journals. QRPs increase in the percentage of supported hypotheses and result in effect sizes that likely overestimate population parameters. As such, results reported in articles published in our most prestigious journals may be less credible than previously believed.
Increasingly, consumers, businesses and governmental entities make decisions involving geospatial data using spatial decision support systems (SDSS). One frequent geospatial decision task is that of ...location selection, which may involve determining the best site for a new retail store or locating an ideal neighborhood for a future city park. Online and mobile SDSS often do not provide the capability to visualize information using heat maps. Understanding if, and how, heat maps influence the geospatial decision-making process provides an opportunity for SDSS developers to achieve competitive advantages. Such knowledge may also identify individual characteristics needed to effectively utilize heat maps. Scholars can benefit from a more comprehensive understanding of the characteristics that influence geospatial decision-making. Task-Technology Fit Theory (TTFT) provides the theoretical foundation of the study. Subjects (N = 294) participated in an experiment designed to model geospatial decision-making performance with and without the aid of data visualized using heat maps. Individual characteristics and perceptions, including personal innovativeness, self-efficacy, intrinsic motivation, relative advantage, and geospatial reasoning ability are examined as direct and indirect antecedents of perceived task-technology fit. Decision-making accuracy, time and satisfaction are measures of decision-performance. A partial least squares structural equation modeling approach reveals the significant influence of an individual's characteristics on decision-making performance. Furthermore, decision-making accuracy is shown to be influenced positively through the use of heat maps. Theoretical and managerial implications, as well as future research directions, are also discussed.
•We assess the efficacy of heat maps for location selection tasks.•Subjects (N = 294) participated in one of two experiment modes.•Findings consider relative advantage, cognitive ability, and fit constructs.•Decision satisfaction is influenced by cognitive ability and fit perceptions.•Heat map visualizations increase accuracy of location selection tasks.
This study reports results from a meta-analysis of 28 correlates of pay level satisfaction involving 240 samples from 203 studies conducted over the past 35 years. Results are presented in 4 ...categories: primary determinants, antecedents, correlates, and outcomes of pay satisfaction. The authors controlled for pay in examining relations between correlates and pay level satisfaction, as suggested by theory and when primary studies were available to do so. The authors found support for many of the relations suggested by a theoretical model and also note some limitations in the research that has tested this model. The authors recommend changes and additions to the model and suggest additional primary research in specific areas.
The generation effect refers to the finding that subjects who generate information (e.g., produce synonyms) remember the information better than they do material that they simply read. Meta-analytic ...techniques were used to summarize 445 effect sizes over 86 studies, thereby assessing the magnitude and 11 potential moderators of the generation effect. The size of the generation effect across the 86 studies was .40--a benefit of almost half a standard deviation of generation over reading. The variability of the effect size due to moderator type was substantial, and we attempted to use this information to clarify several theories that have been proposed to explain the generation effect.
The trustworthiness of research findings has been questioned in many domains of science. This article calls for a review of the trustworthiness of the scientific literature in ...industrial–organizational (I–O) psychology and a reconsideration of common practices that may harm the credibility of our literature. We note that most hypotheses in I–O psychology journals are confirmed. Thus, we are either approaching omniscience or our journals are publishing an unrepresentative sample of completed research. We view the latter explanation as more likely. We review structural problems in the publication process and in the conduct of research that is likely to promote a distortion of scientific knowledge. We then offer recommendations to make the I–O literature more accurate and trustworthy.
PDF
