A Misleading Review of Response Bias Rohling, Martin L; Larrabee, Glenn J; Greiffenstein, Manfred F ...
Psychological bulletin,
07/2011, Letnik:
137, Številka:
4
Journal Article
Recenzirano
In the May 2010 issue of
Psychological Bulletin
, R. E. McGrath, M. Mitchell, B. H. Kim, and L. Hough published an article entitled "Evidence for Response Bias as a Source of Error Variance in ...Applied Assessment" (pp. 450-470). They argued that response bias indicators used in a variety of settings typically have insufficient data to support such use in everyday clinical practice. Furthermore, they claimed that despite 100 years of research into the use of response bias indicators, "a sufficient justification for their use... in applied settings remains elusive" (p. 450). We disagree with McGrath et al.'s conclusions. In fact, we assert that the relevant and voluminous literature that has addressed the issues of response bias substantiates validity of these indicators. In addition, we believe that response bias measures should be used in clinical and research settings on a regular basis. Finally, the empirical evidence for the use of response bias measures is strongest in clinical neuropsychology. We argue that McGrath et al.'s erroneous perspective on response bias measures is a result of 3 errors in their research methodology: (a) inclusion criteria for relevant studies that are too narrow; (b) errors in interpreting results of the empirical research they did include; (c) evidence of a confirmatory bias in selectively citing the literature, as evidence of moderation appears to have been overlooked. Finally, their acknowledging experts in the field who might have highlighted these errors prior to publication may have prevented critiques during the review process.
Two-alternative forced-choice procedures have been the most widely employed for detecting incomplete effort and exaggeration of cognitive impairment. However, it cannot be assumed that different ...symptom validity tests (SVTs) are of equal sensitivity. In this study, 519 claimants referred for disability or personal injury related assessments were administered three SVTs, one based on digit recognition (Computerized Assessment of Response Bias, CARB), one using pictorial stimuli (Test of Memory Malingering, TOMM) and one employing verbal recognition memory (Word Memory Test, WMT). More than twice as many people failed the WMT than TOMM. CARB failure rates were intermediate between those on the other two tests. Thus, tests of recognition memory using digits, pictorial stimuli or verbal stimuli, all of which are objectively extremely easy tasks, resulted in widely different failure rates. This suggests that, while these tests may be highly specific, they vary substantially in their sensitivity to response bias.
Is Co-norming Required? Rohling, Martin L; Miller, Ronald M; Axelrod, Bradley N ...
Archives of clinical neuropsychology
30, Številka:
7
Journal Article
Recenzirano
Odprti dostop
Researchers who have been responsible for developing test batteries have argued that competent practice requires the use of a "fixed battery" that is co-normed. We tested this assumption with three ...normative systems: co-normed, meta-regressed norms and a system of these two methods. We analyzed two samples: 330 referred patients and 99 undergraduate volunteers. The T scores generated for referred patients using the three systems were highly associated with one another and quite similar in magnitude, with an Overall Test Battery Means (OTBMs) using the co-normed, hybrid, and meta-regressed scores equaled 43.8, 45.0, and 43.9, respectively. For volunteers, the OTBMs equaled 47.4, 47.5, and 47.1, respectively. The correlations amongst these OTBMs across systems were all above .90. Differences among OTBMs across normative systems were small and not clinically meaningful. We conclude that co-norming for competent clinical practice is not necessary.
This study utilized logistic regression to determine whether performance patterns on Concussion Vital Signs (CVS) could differentiate known groups with either genuine or feigned performance. For the ...embedded measure development group (n = 174), clinical patients and undergraduate students categorized as feigning obtained significantly lower scores on the overall test battery mean for the CVS, Shipley-2 composite score, and California Verbal Learning Test-Second Edition subtests than did genuinely performing individuals. The final full model of 3 predictor variables (Verbal Memory immediate hits, Verbal Memory immediate correct passes, and Stroop Test complex reaction time correct) was significant and correctly classified individuals in their known group 83% of the time (sensitivity = .65; specificity = .97) in a mixed sample of young-adult clinical cases and simulators. The CVS logistic regression function was applied to a separate undergraduate college group (n = 378) that was asked to perform genuinely and identified 5% as having possibly feigned performance indicating a low false-positive rate. The failure rate was 11% and 16% at baseline cognitive testing in samples of high school and college athletes, respectively. These findings have particular relevance given the increasing use of computerized test batteries for baseline cognitive testing and return-to-play decisions after concussion.
Celotno besedilo
Dostopno za:
BFBNIB, DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, UILJ, UKNU, UL, UM, UPUK
The authors evaluated the impact of financial incentives on disability, symptoms, and objective findings after closed-head injury.
Meta-analysis was used to review the literature. Seventeen reports, ...covering 18 study groups and a total of 2,353 subjects, contained data from which effect sizes could be calculated. Effect sizes were aggregated after weighting for group size. After discussion, there was 100% agreement between the authors on all calculations.
A moderate overall effect size, 0.47, was found. The effect was particularly strong for mild head trauma. The data showed more abnormality and disability in patients with financial incentives despite less severe injuries.
Clinical evaluation of patients after closed-head injury, particularly mild head trauma, must include consideration of the effect of financial incentives on symptoms and disability.
Several studies have reported that traumatic brain injury (TBI) has a smaller effect on neuropsychological test scores, in contrast to the large effect of poor effort on test performance. ...Consequently, many authors have concluded that effort needs to be measured routinely and that it is necessary to control for poor effort when measuring the effects of brain disease or injury on performance. Recently, however, Bowden, Shores, and Mathias (
2006
) have challenged these notions. They argued that the Immediate Recognition subtest of the Word Memory Test (Green & Flaro,
2003
), an effort measure, is another verbal memory test rather than a measure of cognitive effort. In this study we re-examine the data from Bowden et al. (
2006
) and Green, Rohling, Lees-Haley, and Allen (
2001
) to identify differences between the two studies that might account for their contradictory conclusions. In both sets of data, reanalysis showed that effort explains approximately five times more of the variance in composite neuropsychological test scores than TBI severity. Importantly, scores on the Word Memory Test-Immediate Recognition (WMT-IR) were not correlated with measures of TBI severity, and were not found to correlate with major variables known to be measuring ability (e.g., years of education). These findings challenge the conclusions offered by Bowden and colleagues (
2006
).
This study investigated the prevalence and predictors of unwanted pursuit behaviors among college students. Participants (n = 282) had experienced the termination of a meaningful romantic ...relationship. Two questionnaires were administered. One assessed unwanted pursuit behaviors that were perpetrated by individuals who had not initiated the relationship breakup (breakup sufferers; n = 120); the other assessed individuals who had initiated the relationship breakup (relationship dissolvers; n = 162). Results indicated that most breakup sufferers had engaged in at least one act of unwanted pursuit (i.e., unwanted phone calls, unwanted in-person conversations) after the breakup. Breakup sufferers were more likely than relationship dissolvers to perceive a positive impact from their unwanted pursuit behavior. Partner-specific attachment experiences and love styles emerged as significant predictors of unwanted pursuit behavior perpetration, according to both victims and perpetrators of unwanted pursuit. However, only victims of unwanted pursuit revealed an association between levels of relationship violence and unwanted pursuit behavior perpetration. Victims also reported that their unwanted pursuit was related to a lack of friendship between themselves and their ex-partners. In contrast, there was a positive association between feelings of friendship and unwanted pursuit for perpetrators. The implications of these findings and their application to the stalking literature are discussed.
This study examined the effect of depression on neurocognitive performance in patients who passed symptom validity testing. The Beck Depression Inventory (BDI) was used to assess depression in 420 ...patients with heterogeneous referral diagnoses (more than half of these cases were head injury or neurological disease). All patients had demonstrated satisfactory effort by passing two symptom validity tests. No differences were found on objective cognitive and psychomotor measures in groups sorted based on their self-reported depression. In contrast, on the self-report measures i.e., Minnesota Multiphasic Personality Inventory-2 (MMPI-2), Symptom Checklist-90-Revised (SCL-90-R), and Memory Complaints Inventory (MCI), differences were found indicating that patients with depression report more emotional, somatic, and cognitive problems. Contrary to expectation, these data suggest that depression has no impact on objective neurocognitive functioning.
The goal of this study was to examine the relationship between brain injury severity and scores on both an olfactory identification test and on many widely used neuropsychological tests in 367 ...patients with head injuries of varying levels of severity. It was hypothesized that valid olfactory test scores would correlate highly with injury severity because both the olfactory nerves and the primary olfactory cortices are especially vulnerable to damage in closed head injury. After removing data of doubtful validity from cases failing effort tests, olfactory test scores were related to Glasgow Coma Scale scores (GCS), post-traumatic amnesia and radiological abnormalities more strongly than any of the neuropsychological test scores. Based on the assumption that post-traumatic amnesia is caused by a different mechanism than loss of core consciousness, it was also predicted that there would be no cases with a GCS less than 13 and with no post-traumatic amnesia. As predicted, there were no cases in this group. The results support previous studies showing greater olfactory impairment with increased severity of head injury.
PDF
