Mental labour Kool, Wouter; Botvinick, Matthew
Nature human behaviour,
12/2018, Volume:
2, Issue:
12
Journal Article
Peer reviewed
Mental effort is an elementary notion in our folk psychology and a familiar fixture in everyday introspective experience. However, as an object of scientific study, mental effort has remained rather ...elusive. Cognitive psychology has provided some tools for understanding how effort impacts performance, by linking effort with cognitive control function. What has remained less clear are the principles that govern the allocation of mental effort. Under what circumstances do people choose to invest mental effort, and when do they decline to do so? And what regulates the intensity of mental effort when it is applied? In new and promising work, these questions are being approached with the tools of behavioural economics. Though still in its infancy, this economic approach to mental effort research has already uncovered important aspects of effort-based decision-making, and points clearly to future lines of inquiry, including some intriguing opportunities presented by recent artificial intelligence research.
In spite of its familiar phenomenology, the mechanistic basis for mental effort remains poorly understood. Although most researchers agree that mental effort is aversive and stems from limitations in ...our capacity to exercise cognitive control, it is unclear what gives rise to those limitations and why they result in an experience of control as costly. The presence of these control costs also raises further questions regarding how best to allocate mental effort to minimize those costs and maximize the attendant benefits. This review explores recent advances in computational modeling and empirical research aimed at addressing these questions at the level of psychological process and neural mechanism, examining both the limitations to mental effort exertion and how we manage those limited cognitive resources. We conclude by identifying remaining challenges for theoretical accounts of mental effort as well as possible applications of the available findings to understanding the causes of and potential solutions for apparent failures to exert the mental effort required of us.
When making decisions, humans aim to maximize rewards while minimizing costs. The exertion of mental or physical effort has been proposed to be one those costs, translating into avoidance of ...behaviors carrying effort demands. This motivational framework also predicts that people should experience positive affect when anticipating demand that is subsequently avoided (i.e., a "relief effect"), but evidence for this prediction is scarce. Here, we follow up on a previous study 1 that provided some initial evidence that people more positively evaluated outcomes if it meant they could avoid performing an additional demanding task. However, the results from this study did not provide conclusive evidence that this effect was driven by effort avoidance. Here, we report two experiments that are able to do this. Participants performed a gambling task, and if they did not receive reward they would have to perform an orthogonal effort task. Prior to the gamble, a cue indicated whether this effort task would be easy or hard. We probed hedonic responses to the reward-related feedback, as well as after the subsequent effort task feedback. Participants reported lower hedonic responses for no-reward outcomes when high vs. low effort was anticipated (and later exerted). They also reported higher hedonic responses for reward outcomes when high vs. low effort was anticipated (and avoided). Importantly, this relief effect was smaller in participants with high need for cognition. These results suggest that avoidance of high effort tasks is rewarding, but that the size off this effect depends on the individual disposition to engage with and expend cognitive effort. They also raise the important question of whether this disposition alters the cost of effort per se, or rather offset this cost during cost-benefit analyses.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Behavioral and economic theories have long maintained that actions are chosen so as to minimize demands for exertion or work, a principle sometimes referred to as the "law of less work". The data ...supporting this idea pertain almost entirely to demands for physical effort. However, the same minimization principle has often been assumed also to apply to cognitive demand. The authors set out to evaluate the validity of this assumption. In 6 behavioral experiments, participants chose freely between courses of action associated with different levels of demand for controlled information processing. Together, the results of these experiments revealed a bias in favor of the less demanding course of action. The bias was obtained across a range of choice settings and demand manipulations and was not wholly attributable to strategic avoidance of errors, minimization of time on task, or maximization of the rate of goal achievement. It is remarkable that the effect also did not depend on awareness of the demand manipulation. Consistent with a motivational account, avoidance of demand displayed sensitivity to task incentives and covaried with individual differences in the efficacy of executive control. The findings reported, together with convergent neuroscientific evidence, lend support to the idea that anticipated cognitive demand plays a significant role in behavioral decision making. (Contains 2 tables and 7 figures.)
Full text
Available for:
CEKLJ, FFLJ, NUK, ODKLJ, PEFLJ, UPUK
When Does Model-Based Control Pay Off? Kool, Wouter; Cushman, Fiery A; Gershman, Samuel J
PLOS computational biology/PLoS computational biology,
08/2016, Volume:
12, Issue:
8
Journal Article
Peer reviewed
Open access
Many accounts of decision making and reinforcement learning posit the existence of two distinct systems that control choice: a fast, automatic system and a slow, deliberative system. Recent research ...formalizes this distinction by mapping these systems to "model-free" and "model-based" strategies in reinforcement learning. Model-free strategies are computationally cheap, but sometimes inaccurate, because action values can be accessed by inspecting a look-up table constructed through trial-and-error. In contrast, model-based strategies compute action values through planning in a causal model of the environment, which is more accurate but also more cognitively demanding. It is assumed that this trade-off between accuracy and computational demand plays an important role in the arbitration between the two strategies, but we show that the hallmark task for dissociating model-free and model-based strategies, as well as several related variants, do not embody such a trade-off. We describe five factors that reduce the effectiveness of the model-based strategy on these tasks by reducing its accuracy in estimating reward outcomes and decreasing the importance of its choices. Based on these observations, we describe a version of the task that formally and empirically obtains an accuracy-demand trade-off between model-free and model-based strategies. Moreover, we show that human participants spontaneously increase their reliance on model-based control on this task, compared to the original paradigm. Our novel task and our computational analyses may prove important in subsequent empirical investigations of how humans balance accuracy and demand.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
The law of least mental effort states that, everything else being equal, the brain tries to minimize mental effort expenditure during task performance by avoiding decisions that require greater ...cognitive demands. Prior studies have shown associations between disruptions in effort expenditure and specific psychiatric illnesses (e.g., schizophrenia and depression) or clinically-related symptoms and traits (e.g., anhedonia and apathy), yet no research has explored this issue transdiagnostically. Specifically, this research has largely focused on a single diagnostic category, symptom, or trait. However, abnormalities in effort expression could be related to several different psychiatrically-relevant constructs that cut across diagnostic boundaries. Therefore, we examined the relationship between avoidance of mental effort and a diverse set of clinically-related symptoms and traits, and transdiagnostic latent factors in a large sample (n = 811). Only lack of perseverance, a dimension of impulsiveness, was associated with increased avoidance of mental effort. In contrast, several constructs were associated with less mental effort avoidance, including positive urgency, distress intolerance, obsessive-compulsive symptoms, disordered eating, and a factor consisting of compulsive behavior and intrusive thoughts. These findings demonstrate that deviations from normative effort expenditure are associated with a number of constructs that are common to several forms of psychiatric illness.
Full text
Available for:
IZUM, KILJ, NUK, PILJ, PNG, SAZU, UL, UM, UPUK
The capacity for self-control is critical to adaptive functioning, yet our knowledge of the underlying processes and mechanisms is presently only inchoate. Theoretical work in economics has suggested ...a model of self-control centering on two key assumptions: (1) a division within the decision-maker between two 'selves' with differing preferences; (2) the idea that self-control is intrinsically costly. Neuroscience has recently generated findings supporting the 'dual-self' assumption. The idea of self-control costs, in contrast, has remained speculative. We report the first independent evidence for self-control costs. Through a neuroimaging meta-analysis, we establish an anatomical link between self-control and the registration of cognitive effort costs. This link predicts that individuals who strongly avoid cognitive demand should also display poor self-control. To test this, we conducted a behavioral experiment leveraging a measure of demand avoidance along with two measures of self-control. The results obtained provide clear support for the idea of self-control costs.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK
Humans employ different strategies when making decisions. Previous research has reported reduced reliance on model-based strategies with aging, but it remains unclear whether this is due to cognitive ...or motivational factors. Moreover, it is not clear how aging affects the metacontrol of decision making, that is the dynamic adaptation of decision-making strategies to varying situational demands. In this cross-sectional study, we tested younger and older adults in a sequential decision-making task that dissociates model-free and model-based strategies. In contrast to previous research, model-based strategies led to higher payoffs. Moreover, we manipulated the costs and benefits of model-based strategies by varying reward magnitude and the stability of the task structure. Compared to younger adults, older adults showed reduced model-based decision making and less adaptation of decision-making strategies. Our findings suggest that aging affects the metacontrol of decision-making strategies and that reduced model-based strategies in older adults are due to limited cognitive abilities.
Daily life frequently offers a choice between activities that are profitable but mentally demanding (cognitive labor) and activities that are undemanding but also unproductive (cognitive leisure). ...Although such decisions are often implicit, they help determine academic performance, career trajectories, and even health outcomes. Previous research has shed light both on the executive control functions that ultimately define cognitive labor and on a "default mode" of brain function that accompanies cognitive leisure. However, little is known about how labor/leisure decisions are actually made. Here, we identify a central principle guiding such decisions. Results from 3 economic-choice experiments indicate that the motivation underlying cognitive labor/leisure decision making is to strike an optimal balance between income and leisure, as given by a joint utility function. The results reported establish a new connection between microeconomics and research on executive function. They also suggest a new interpretation of so-called ego-depletion effects and a potential new approach to such phenomena as mind wandering and self-control failure.
Full text
Available for:
CEKLJ, FFLJ, NUK, ODKLJ, PEFLJ, UPUK
To support reward-based decision-making, the brain must encode potential outcomes both in terms of their incentive value and their probability of occurrence. Recent research has made it clear that ...the brain bears multiple representations of reward magnitude, meaning that a single choice option may be represented differently—and even inconsistently—in different brain areas. There are some hints that the same may be true for reward probability. Preliminary evidence hints that, even as systematic distortions of probability are expressed in behavior, these may not always be uniformly reflected at the neural level: Some neural representations of probability may be immune from such distortions. This study provides new evidence consistent with this possibility. Participants in a behavioral experiment displayed a classic “illusion of control,” providing higher estimates of reward probability for gambles they had chosen than for identical gambles that were imposed on them. However, an fMRI study of the same task revealed that neural prediction error signals, arising when gamble outcomes were revealed, were unaffected by the illusion of control. The resulting behavioral–neural dissociation reinforces the case for multiple, inconsistent internal representations of reward probability, while also prompting a reinterpretation of the illusion of control effect itself.
Full text
Available for:
DOBA, IZUM, KILJ, NUK, PILJ, PNG, SAZU, SIK, UILJ, UKNU, UL, UM, UPUK