Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on ...scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.
Learning and attention improve perception by increasing information about a stimulus in the neural population. In this issue of Neuron, Poort et al. investigate the circuit mechanisms underlying ...attention and learning, finding they work through different mechanisms.
Abstract
The two catecholamines, noradrenaline and dopamine, have been shown to play comparable roles in behavior. Both noradrenergic and dopaminergic neurons respond to cues predicting reward ...availability and novelty. However, even though both are thought to be involved in motivating actions, their roles in motivation have seldom been directly compared. We therefore examined the activity of putative noradrenergic neurons in the locus coeruleus and putative midbrain dopaminergic neurons in monkeys cued to perform effortful actions for rewards. The activity in both regions correlated with engagement with a presented option. By contrast, only noradrenaline neurons were also (i) predictive of engagement in a subsequent trial following a failure to engage and (ii) more strongly activated in nonrepeated trials, when cues indicated a new task condition. This suggests that while both catecholaminergic neurons are involved in promoting action, noradrenergic neurons are sensitive to task state changes, and their influence on behavior extends beyond the immediately rewarded action.
Introduction
While several theories have highlighted the importance of the noradrenergic system for behavioral flexibility, a number of recent studies have also shown a role for noradrenaline in ...motivation, particularly in effort processing. Here, we designed a novel sequential cost/benefit decision task to test the causal influence of noradrenaline on these two functions in rhesus monkeys.
Methods
We manipulated noradrenaline using clonidine, an alpha-2 noradrenergic receptor agonist, which reduces central noradrenaline levels and examined how this manipulation influenced performance on the task.
Results
Clonidine had two specific and distinct effects: first, it decreased choice variability, without affecting the cost/benefit trade-off; and second, it reduced force production, without modulating the willingness to work.
Conclusions
Together, these results support an overarching role for noradrenaline in facing challenging situations in two complementary ways: by modulating behavioral volatility, which would facilitate adaptation depending on the lability of the environment, and by modulating the mobilization of resources to face immediate challenges.
Attention filters sensory inputs to enhance task-relevant information. It is guided by an “attentional template” that represents the stimulus features that are currently relevant. To understand how ...the brain learns and uses templates, we trained monkeys to perform a visual search task that required them to repeatedly learn new attentional templates. Neural recordings found that templates were represented across the prefrontal and parietal cortex in a structured manner, such that perceptually neighboring templates had similar neural representations. When the task changed, a new attentional template was learned by incrementally shifting the template toward rewarded features. Finally, we found that attentional templates transformed stimulus features into a common value representation that allowed the same decision-making mechanisms to deploy attention, regardless of the identity of the template. Altogether, our results provide insight into the neural mechanisms by which the brain learns to control attention and how attention can be flexibly deployed across tasks.
Display omitted
•Monkeys repeatedly learned new attentional templates to select visual stimuli•Neural representations of templates were structured in the prefrontal and parietal cortex•Attentional templates were iteratively updated after each trial based on reward feedback•Sensory inputs were translated into value, allowing attention to generalize across tasks
Jahn et al. show that the brain uses reward feedback to learn attentional templates that select task-relevant stimuli. Attended stimulus features were converted into a common value representation, allowing attentional control to generalize across tasks.
Abstract Staying engaged is necessary to maintain goal-directed behaviors. Despite this, engagement exhibits continuous, intrinsic fluctuations. Even in experimental settings, animals, unlike most ...humans, repeatedly and spontaneously move between periods of complete task engagement and disengagement. We, therefore, looked at behavior in male macaques ( macaca mulatta) in four tasks while recording fMRI signals. We identified consistent autocorrelation in task disengagement. This made it possible to build models capturing task-independent engagement. We identified task general patterns of neural activity linked to impending sudden task disengagement in mid-cingulate gyrus. By contrast, activity centered in perigenual anterior cingulate cortex (pgACC) was associated with maintenance of performance across tasks. Importantly, we carefully controlled for task-specific factors such as the reward history and other motivational effects, such as response vigor, in our analyses. Moreover, we showed pgACC activity had a causal link to task engagement: transcranial ultrasound stimulation of pgACC changed task engagement patterns.
The article Dual contributions of noradrenaline to behavioural flexibility and motivation written by Caroline I. Jahn, Sophie Gilardeau, Chiara Varazzani, Bastien Blain, Jerome Sallet, Mark E. ...Walton, Sebastien Bouret was originally published electronically on the publisher’s internet portal.
Repetitive training of isolated movements induces reorganization of motor cortical representations. To elucidate the mechanisms of practice-dependent cortical plasticity within the lesioned central ...motor system at the time of the application of a therapeutic intervention, we examined the effect of repetitive movements on intracortical facilitation (ICF) and inhibition of agonist (extensor carpi radialis ECR) and antagonist (flexor carpi ulnaris) muscles of the hand shortly after the movements, by the paired-pulse technique in patients with cortical (n = 9) and subcortical strokes (n = 11). Short intracortical inhibition and ICF were studied by using interstimulus intervals of 2 and 8 milliseconds, respectively, and their interaction with active or passive movement. The active movement produced significantly larger motor-evoked potentials in the ECR muscle in both patient groups. Short intracortical inhibition was particularly decreased after cortical stroke, whereas it was still significant after subcortical stroke. ICF increased significantly after movements compared with rest in the ECR for subcortical stroke patients only. We conclude that repetitive active movements increase the excitability of the motor cortex representing the agonist muscle and interact with intracortical facilitatory circuits in the subcortical stroke group but not in the cortical stroke group. This interaction of circuitry has been reported previously in control subjects and seems to still operate after subcortical stroke during active movement. Alternative networks may be recruited for active movement after cortical stroke. This finding proposes lesion-specific mechanisms of reorganization during the same rehabilitative intervention. Distinct rehabilitative strategies may be required to optimize the activation of the physiologic motor network for different lesions.
During mitosis, RNA polymerase II (Pol II) and many transcription factors dissociate from chromatin, and transcription ceases globally. Transcription is known to restart in bulk by telophase, but ...whether de novo transcription at the mitosis-G1 transition is in any way distinct from later in interphase remains unknown. We tracked Pol II occupancy genome-wide in mammalian cells progressing from mitosis through late G1. Unexpectedly, during the earliest rounds of transcription at the mitosis-G1 transition, ∼50% of active genes and distal enhancers exhibit a spike in transcription, exceeding levels observed later in G1 phase. Enhancer-promoter chromatin contacts are depleted during mitosis and restored rapidly upon G1 entry but do not spike. Of the chromatin-associated features examined, histone H3 Lys27 acetylation levels at individual loci in mitosis best predict the mitosis-G1 transcriptional spike. Single-molecule RNA imaging supports that the mitosis-G1 transcriptional spike can constitute the maximum transcriptional activity per DNA copy throughout the cell division cycle. The transcriptional spike occurs heterogeneously and propagates to cell-to-cell differences in mature mRNA expression. Our results raise the possibility that passage through the mitosis-G1 transition might predispose cells to diverge in gene expression states.
PDF
