It is proposed that a cognitive map encoding the relationships between entities in the world supports flexible behavior, but the majority of the neural evidence for such a system comes from studies ...of spatial navigation. Recent work describing neuronal parallels between spatial and non-spatial behaviors has rekindled the notion of a systematic organization of knowledge across multiple domains. We review experimental evidence and theoretical frameworks that point to principles unifying these apparently disparate functions. These principles describe how to learn and use abstract, generalizable knowledge and suggest that map-like representations observed in a spatial context may be an instance of general coding mechanisms capable of organizing knowledge of all kinds. We highlight how artificial agents endowed with such principles exhibit flexible behavior and learn map-like representations observed in the brain. Finally, we speculate on how these principles may offer insight into the extreme generalizations, abstractions, and inferences that characterize human cognition.
Behrens et al. review an emerging field building formalisms for understanding the neural basis of flexible behavior. The authors extend these ideas toward representations useful for generalization and structural abstraction, allowing rapid inferences and flexible behavior with little direct experience.
Neural Mechanisms of Foraging Kolling, Nils; Behrens, Timothy E. J.; Mars, Rogier B. ...
Science (American Association for the Advancement of Science),
04/2012, Letnik:
336, Številka:
6077
Journal Article
Recenzirano
Odprti dostop
Behavioral economic studies involving limited numbers of choices have provided key insights into neural decision-making mechanisms. By contrast, animals' foraging choices arise in the context of ...sequences of encounters with prey or food. On each encounter, the animal chooses whether to engage or, if the environment is sufficiently rich, to search elsewhere. The cost of foraging is also critical. We demonstrate that humans can alternate between two modes of choice, comparative decision-making and foraging, depending on distinct neural mechanisms in ventromedial prefrontal cortex (vmPFC) and anterior cingulate cortex (ACC) using distinct reference frames; in ACC, choice variables are represented in invariant reference to foraging or searching for alternatives. Whereas vmPFC encodes values of specific well-defined options, ACC encodes the average value of the foraging environment and cost of foraging.
Coupling stimuli and actions with positive or negative outcomes facilitates the selection of appropriate actions. Several brain regions are involved in the development of goal-directed behaviors and ...habit formation during incentive-based learning. This Review focuses on higher cognitive control of decision making and the cortical and subcortical structures and connections that attribute value to stimuli, associate that value with choices, and select an action plan. Delineating the connectivity between these areas is fundamental for understanding how brain regions work together to evaluate stimuli, develop actions plans, and modify behavior, as well as for elucidating the pathophysiology of psychiatric diseases.
Coupling stimuli and actions with positive or negative outcomes facilitates action selection. Haber and Behrens review cognitive control of decision making and the cortical and subcortical structures and connections that attribute value to stimuli, associate that value with choices, and select an action plan.
The Human Connectome Project consortium led by Washington University, University of Minnesota, and Oxford University is undertaking a systematic effort to map macroscopic human brain circuits and ...their relationship to behavior in a large population of healthy adults. This overview article focuses on progress made during the first half of the 5-year project in refining the methods for data acquisition and analysis. Preliminary analyses based on a finalized set of acquisition and preprocessing protocols demonstrate the exceptionally high quality of the data from each modality. The first quarterly release of imaging and behavioral data via the ConnectomeDB database demonstrates the commitment to making HCP datasets freely accessible. Altogether, the progress to date provides grounds for optimism that the HCP datasets and associated methods and software will become increasingly valuable resources for characterizing human brain connectivity and function, their relationship to behavior, and their heritability and genetic underpinnings.
•The Human Connectome Project (HCP) will study brain connectivity in healthy adults.•Data acquisition: multiple imaging modalities, plus behavioral, and genetic data.•Imaging modalities: diffusion MRI, resting-fMRI, task-fMRI, and MEG/EEG.•Extensive refinement and optimization efforts are currently underway.•Data will be made freely available and will enable flexible data mining.
Computation of Social Behavior Behrens, Timothy E.J; Hunt, Laurence T; Rushworth, Matthew F.S
Science (American Association for the Advancement of Science),
05/2009, Letnik:
324, Številka:
5931
Journal Article
Recenzirano
Neuroscientists are beginning to advance explanations of social behavior in terms of underlying brain mechanisms. Two distinct networks of brain regions have come to the fore. The first involves ...brain regions that are concerned with learning about reward and reinforcement. These same reward-related brain areas also mediate preferences that are social in nature even when no direct reward is expected. The second network focuses on regions active when a person must make estimates of another person's intentions. However, it has been difficult to determine the precise roles of individual brain regions within these networks or how activities in the two networks relate to one another. Some recent studies of reward-guided behavior have described brain activity in terms of formal mathematical models; these models can be extended to describe mechanisms that underlie complex social exchange. Such a mathematical formalism defines explicit mechanistic hypotheses about internal computations underlying regional brain activity, provides a framework in which to relate different types of activity and understand their contributions to behavior, and prescribes strategies for performing experiments under strong control.
Organizing conceptual knowledge in humans with a gridlike code Constantinescu, Alexandra O.; O'Reilly, Jill X.; Behrens, Timothy E. J.
Science (American Association for the Advancement of Science),
06/2016, Letnik:
352, Številka:
6292
Journal Article
Recenzirano
Odprti dostop
It has been hypothesized that the brain organizes concepts into a mental map, allowing conceptual relationships to be navigated in a manner similar to that of space. Grid cells use a hexagonally ...symmetric code to organize spatial representations and are the likely source of a precise hexagonal symmetry in the functional magnetic resonance imaging signal. Humans navigating conceptual two-dimensional knowledge showed the same hexagonal signal in a set of brain regions markedly similar to those activated during spatial navigation. This gridlike signal is consistent across sessions acquired within an hour and more than a week apart. Our findings suggest that global relational codes may be used to organize nonspatial conceptual representations and that these codes may have a hexagonal gridlike pattern when conceptual knowledge is laid out in two continuous dimensions.
Understanding how the human brain gives rise to complex cognitive processes remains one of the biggest challenges of contemporary neuroscience. While invasive recording in animal models can provide ...insight into neural processes that are conserved across species, our understanding of cognition more broadly relies upon investigation of the human brain itself. There is therefore an imperative to establish non-invasive tools that allow human brain activity to be measured at high spatial and temporal resolution. In recent years, various attempts have been made to refine the coarse signal available in functional magnetic resonance imaging (fMRI), providing a means to investigate neural activity at the meso-scale, i.e. at the level of neural populations. The most widely used techniques include repetition suppression and multivariate pattern analysis. Human neuroscience can now use these techniques to investigate how representations are encoded across neural populations and transformed by relevant computations. Here, we review the physiological basis, applications and limitations of fMRI repetition suppression with a brief comparison to multivariate techniques. By doing so, we show how fMRI repetition suppression holds promise as a tool to reveal complex neural mechanisms that underlie human cognitive function.
This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’.
Learning induces plasticity in neuronal networks. As neuronal populations contribute to multiple representations, we reasoned plasticity in one representation might influence others. We used human ...fMRI repetition suppression to show that plasticity induced by learning another individual's values impacts upon a value representation for oneself in medial prefrontal cortex (mPFC), a plasticity also evident behaviorally in a preference shift. We show this plasticity is driven by a striatal "prediction error," signaling the discrepancy between the other's choice and a subject's own preferences. Thus, our data highlight that mPFC encodes agent-independent representations of subjective value, such that prediction errors simultaneously update multiple agents' value representations. As the resulting change in representational similarity predicts interindividual differences in the malleability of subjective preferences, our findings shed mechanistic light on complex human processes such as the powerful influence of social interaction on beliefs and preferences.
We investigated the relationship between individual subjects' functional connectomes and 280 behavioral and demographic measures in a single holistic multivariate analysis relating imaging to ...non-imaging data from 461 subjects in the Human Connectome Project. We identified one strong mode of population co-variation: subjects were predominantly spread along a single 'positive-negative' axis linking lifestyle, demographic and psychometric measures to each other and to a specific pattern of brain connectivity.
Although experience-dependent structural changes have been found in adult gray matter, there is little evidence for such changes in white matter. Using diffusion imaging, we detected a localized ...increase in fractional anisotropy, a measure of microstructure, in white matter underlying the intraparietal sulcus following training of a complex visuo-motor skill. This provides, to the best of our knowledge, the first evidence for training-related changes in white-matter structure in the healthy human adult brain.